Video processing device, video distribution system, video processing method, and program
Patent Information
- Application Number
- JP2020206456
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-12-14
- Publication Date
- 2025-02-19
- Estimated Expiration
- 2040-12-14
AI Technical Summary
【0012】 本発明の一態様によれば、入力信号を受信することができない場合においても、補助情報を継続的に提供することができる。
Smart Images

Figure 0007631775000001 
Figure 0007631775000002 
Figure 0007631775000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a video processing device, a video distribution system, a video processing method, and a program, and more particularly to a video processing device, a video distribution system, a video processing method, and a program that generate and edit video data from an input signal. [Background technology]
[0002] In a related technique, a cloud server receives an input signal from a real-time encoder connected to a camera via a mobile network (wireless network). The cloud server synthesizes video data decoded from the input signal with image data including auxiliary information such as time information or emergency alerts. In a related technique, the cloud server then transmits synthesized data in which image data is superimposed on the video data to a display device such as a television receiver or a monitor, or a user terminal such as a smartphone or a tablet device.
[0003] In relation to synthetic data, Patent Document 1 describes a method of synthesizing real-life video data acquired by a camera with 3D computer graphics generated by modeling, and displaying the resulting synthetic data on a surveillance monitor.
[0004] Patent Document 2 also describes converting the contents of electronic data into sign language motion by analyzing electronic data input from an external system. Patent Document 2 also describes generating 3D animation based on the sign language motion and displaying the generated 3D animation together with Japanese subtitles based on the results of language analysis of the electronic data. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Japanese Patent Application Publication No. 09-23449 [Patent Document 2] JP 2016-038748 A Summary of the Invention [Problem to be solved by the invention]
[0006] In the related technology described in Patent Document 1, there are cases where the input signal cannot be received due to a camera failure or communication failure. In such cases, the transmission of video data is interrupted. As a result, it becomes temporarily impossible to provide auxiliary information such as emergency alerts regarding the status of natural disasters.
[0007] The present invention has been made in consideration of the above-mentioned problems, and its object is to provide a video processing device that can continuously provide auxiliary information even when it is unable to receive an input signal. [Means for solving the problem]
[0008] In order to solve the above problems, a video processing device according to one embodiment of the present invention comprises a video generation means for generating video data from an input signal, an image input means for inputting first image data to be superimposed on the video data, an editing means for synthesizing the first image data and the video data, and an output means for outputting synthetic data obtained by synthesizing the first image data and the video data, wherein the video generation means is configured to be able to generate the video data from the first image data instead of the input signal.
[0009] A video distribution system according to one embodiment of the present invention includes a video processing device according to one embodiment of the present invention, one or more user terminals to which the composite data is distributed from the video processing device, one or more imaging devices, and an encoder that converts the shooting data acquired from each of the one or more imaging devices into the input signal and transmits the input signal to the video processing device.
[0010] A video processing method according to one aspect of the present invention generates video data from an input signal, inputs first image data to be superimposed on the video data, synthesizes the first image data and the video data, and outputs synthetic data obtained by synthesizing the first image data and the video data, and in generating the video data, the video data can be generated from the first image data instead of the input signal.
[0011] A program according to one embodiment of the present invention causes a computer to execute the following processes: generating video data from an input signal; inputting first image data to be superimposed on the video data; synthesizing the first image data with the video data; and outputting synthetic data obtained by synthesizing the first image data with the video data; and the computer is configured to be capable of generating the video data from the first image data instead of the input signal in the process of generating the video data. Effect of the Invention
[0012] According to one aspect of the present invention, auxiliary information can be continuously provided even when an input signal cannot be received. [Brief description of the drawings]
[0013] [Figure 1] 1 is a block diagram showing a configuration of a video processing device according to a first embodiment. [Diagram 2] 1 is a diagram illustrating an example of a hardware configuration of a video processing device according to a first embodiment. [Diagram 3] 4 is a diagram showing a display example of composite data output by the video processing device according to the first embodiment. FIG. [Figure 4] FIG. 11 is a block diagram showing the configuration of a video processing device according to a second embodiment. [Diagram 5] FIG. 11 is a diagram illustrating an example of a hardware configuration of a video processing device according to a second embodiment. [Figure 6]FIG. 11 is a diagram showing a display example of composite data output by a video processing device according to a second embodiment. [Figure 7] FIG. 11 is a block diagram showing the configuration of a video processing device according to a third embodiment. [Figure 8] FIG. 11 is a diagram illustrating an example of a hardware configuration of a video processing device according to a third embodiment. [Figure 9] FIG. 11 is a diagram showing a display example of composite data output by a video processing device according to a third embodiment. [Figure 10] FIG. 13 is a block diagram showing the configuration of a video processing device according to a fourth embodiment. [Figure 11] FIG. 13 is a diagram illustrating an example of a hardware configuration of a video processing device according to a fourth embodiment. [Figure 12] FIG. 13 is a diagram showing a display example of an interruption video output by a video processing device according to a fourth embodiment. [Figure 13] FIG. 13 is a diagram illustrating an example of the configuration of a video distribution system according to a fifth embodiment. [Figure 14] 1 is a diagram illustrating an example of a hardware configuration of a video processing device according to any one of the first to fourth embodiments. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0014] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following describes embodiments of the present invention.
[0015] [Embodiment 1] A first embodiment will be described with reference to FIGS.
[0016] (Image processing device 10) 1 is a block diagram showing the configuration of a video processing device 10 according to embodiment 1. As shown in FIG. 1, the video processing device 10 includes a video generation unit 11, an image input unit 12, an editing unit 13, and an output unit 15.
[0017] The video generating unit 11 generates video data from an input signal. The video generating unit 11 is configured to be able to generate video data from first image data instead of the input signal. The video generating unit 11 is an example of a video generating means. In other words, the video generating unit 11 includes a circuit that switches the input signal to the first image data. In one example, the video generating unit 11 generates video data that is time-series data by duplicating the first image data that is a still image. This allows the video generating unit 11 to generate video data from either the input signal or the first image data. Note that the input signal here is time-series data transmitted from an external device (not shown), and in particular, is coded data that is converted into a communication format by encoding the video data.
[0018] In one example, the video generation unit 11 receives an input signal from a real-time encoder connected to an imaging device such as a camera via a wireless network. The video generation unit 11 outputs video data decoded from the input signal to the editing unit 13.
[0019] The image input unit 12 inputs the first image data to be superimposed on the video data. The image input unit 12 is an example of an image input means.
[0020] In one example, the image input unit 12 inputs computer graphics (hereinafter, referred to as CG (Computer Graphics)) as first image data to the video generation unit 11 and the editing unit 13. The first image data includes, for example, time information indicating the current time, or an emergency report regarding the occurrence of a natural disaster such as an earthquake or a typhoon. Alternatively, the first image data may be 3D computer graphics of a modeled person, as described in Patent Document 2.
[0021] The editing unit 13 combines the first image data with the video data. The editing unit 13 is an example of an editing means.
[0022] In one example, the editing unit 13 receives first image data from the image input unit 12. The editing unit 13 also receives video data from the video generation unit 11. The editing unit 13 generates composite data by combining the first image data and the video data. Here, the term "combination" refers to combining two or more pieces of image data or video data to generate one piece of image data or video data. An example of the composition is superimposing characters or figures on the video data. The editing unit 13 outputs the generated composite data to the output unit 15.
[0023] The output unit 15 outputs the composite data obtained by combining the first image data and the video data. The output unit 15 is an example of an output means.
[0024] In one example, the output unit 15 receives the composite data from the editing unit 13. The output unit 15 transmits the composite data to a user terminal such as a smartphone via a wireless network. However, the output destination of the composite data by the output unit 15 is not particularly limited.
[0025] (Hardware configuration) An example of a hardware configuration of the above-mentioned video processing device 10 will be described with reference to Fig. 2. As shown in Fig. 2, the video generation unit 11 receives an input X and an input Y as input signals. The input X and the input Y may be different from each other or may be the same. The video generation unit 11 decodes one of the input X and the input Y using a video mixer (shown as MIXER in Fig. 2). The video generation unit 11 outputs video data obtained by decoding the input X or the input Y to the editing unit 13.
[0026] Image input unit 12 includes three image input units A to C. A first computer graphic (called CG1) is input from image input unit A to video generation unit 11 and editing unit 13. Meanwhile, second and third computer graphics (called CG2 and CG3) are input from image input units B and C to editing unit 13, respectively.
[0027] The video generation unit 11 is configured to be capable of generating video data based on CG1 input from the image input unit A, instead of the input X or input Y. Specifically, the video generation unit 11 switches between the input X or input Y and the input from the image input unit A using a selector (shown as SEL in FIG. 2).
[0028] The editing unit 13 includes three keyers (KEYER in FIG. 2) corresponding to the image input units A to C. The keyer is software that executes keying processing. The three keyers have a function of turning on / off the inputs (CG1 to CG3) from the corresponding image input units A to C, respectively. Turning the inputs on / off refers to switching between a state in which computer graphics (hereinafter referred to as CG) is visible (ON) and a state in which the CG is not visible (OFF) on the video data. The CG is virtually placed below the video data, and the state in which the CG is visible is created by making part of the video data transparent. Here, the fact that the CG is virtually placed below the video data means that when the CG and the image of the video data are displayed superimposed on each other, the CG is hidden by the video data and cannot be seen. In this case, the video data is called the upper layer, and the CG is called the lower layer.
[0029] Editing unit 13 also includes a digital video effector (shown as DVE (Digital Video Effector) in FIG. 2). The DVE of editing unit 13 combines the video data input from the MIXER of video generation unit 11 with any combination of CG1 to CG3 input from image input units A to C. The DVE outputs to output unit 15 the combined data obtained by combining the video data with the combination of CG1 to CG3.
[0030] The output unit 15 transmits (outputs) the composite data to a user terminal such as a smartphone via a wireless network using a communication unit (not shown).
[0031] (Example) FIG. 3 is a diagram showing a display example of the composite data transmitted (output) by the video processing device 10. The frame in FIG. 3 represents, for example, the screen of a user terminal that has received the composite data. In FIG. 3, "CG1⇔Input X" and "CG1⇔Input Y" are shown. This means that in the composite data, video data based on input X or input Y and video data based on CG1 input from image input unit A are switched. That is, the state changes from one in which CG1 is displayed on the screen to one in which input X or input Y is displayed on the screen, or vice versa. This switching is performed by a selector (FIG. 2) in the video generation unit 11.
[0032] Also, as shown in Fig. 3, an arbitrary combination of CG1 to CG3 is placed in the upper right corner of the frame. The combination of CG1 to CG3 is displayed on the video data. The combination of CG1 to CG3 is determined by a keying process performed by a keyer (Fig. 2) of the editing unit 13.
[0033] (Effects of this embodiment) According to the configuration of this embodiment, the video generation unit 11 generates video data from an input signal. The image input unit 12 inputs first image data to be superimposed on the video data. The editing unit 13 synthesizes the first image data and the video data. The output unit 15 outputs synthetic data obtained by synthesizing the first image data and the video data. The video generation unit 11 is configured to be able to generate video data from the first image data instead of the input signal. When the input signal is interrupted, the video generation unit 11 can generate video data from the first image data instead of the input signal. The first image data is, for example, auxiliary information such as an emergency report regarding the occurrence of a natural disaster. This makes it possible to continuously provide auxiliary information even when the input signal cannot be received.
[0034] [Embodiment 2] A second embodiment will be described with reference to Figures 4 to 6. In the second embodiment, a configuration will be described in which second image data is provided as the background of video data.
[0035] (Video processing device 20) Fig. 4 is a block diagram showing the configuration of a video processing device 20 according to the second embodiment. As shown in Fig. 4, the video processing device 20 includes a video generation unit 11, an image input unit 12, an editing unit 13, and an output unit 15. The video processing device 20 further includes a background input unit 24. The video processing device 20 differs from the video processing device 10 according to the first embodiment in that the video processing device 20 includes the background input unit 24.
[0036] In the present embodiment 2, the image input unit 12 further inputs second image data in addition to the first image data. Note that in the present embodiment 2, the description of the above embodiment 1 is cited, and the description of the overlapping configuration is omitted.
[0037] The background input unit 24 inputs the second image data as the background of the video data. The background input unit 24 is an example of a background input means. As shown in FIG. 4, the background input unit 24 receives the second image data from the image input unit 12. The background input unit 24 generates a background of the video data based on the second image data. The background is image data virtually arranged below the video data.
[0038] The second image data is image data different from the first image data. In one example, the second image data may be any one of CG1 to CG3 described in the first embodiment or any combination thereof.
[0039] (Hardware configuration) An example of the hardware configuration of the above-mentioned video processing device 20 will be described with reference to Fig. 5. As shown in Fig. 5, the background input unit 24 has three keyers (shown as KEYER in Fig. 5) corresponding to the image input units A to C included in the image input unit 12. The three keyers of the background input unit 24, like the keyers of the editing unit 13, have a function of turning on / off the inputs from the corresponding image input units A to C.
[0040] The three keyers of background input unit 24 respectively receive CG1 to CG3 from corresponding image input units A to C. Background input unit 24 inputs any combination of CG1 to CG3 to the DVE of editing unit 13 as second image data.
[0041] The DVE of the editing unit 13 synthesizes the video data generated by the video generation unit 11, the first image data input from the image input unit 12, and the second image data input from the background input unit 24. In this case, the first image data is superimposed on the video data, while the second image data is synthesized as the background of the video data. The editing unit 13 outputs the synthesized data to the output unit 15.
[0042] The output unit 15 transmits the composite data from the DVE of the editing unit 13 to a user terminal or the like.
[0043] (Example) Fig. 6 shows a display example of the composite data transmitted (output) by the video processing device 20. The frame in Fig. 6 represents, for example, the screen of a user terminal. As shown in Fig. 6, in the composite data, a switch is made between video data based on input X or input Y and video data based on CG1 input from image input unit A. This switch is performed by a selector (Fig. 2) in the video generation unit 11.
[0044] Also, in Fig. 6, the video data is reduced by the DVE of the editing unit 13. In Fig. 6, as a result of reducing the video data, the background appears in the lower right of the frame. The background is any combination of CG1 to CG3. When the video data is re-enlarged to fill the entire frame, the background of the video data becomes invisible, as exemplified in Fig. 3.
[0045] (Effects of this embodiment) According to the configuration of this embodiment, the video generation unit 11 generates video data from an input signal. The image input unit 12 inputs first image data to be superimposed on the video data. The editing unit 13 synthesizes the first image data and the video data. The output unit 15 outputs synthetic data obtained by synthesizing the first image data and the video data. The video generation unit 11 is configured to be able to generate video data from the first image data instead of the input signal. When the input signal is interrupted, the video generation unit 11 can generate video data from the first image data instead of the input signal. The first image data is, for example, auxiliary information such as an emergency report regarding the occurrence of a natural disaster. This makes it possible to continuously provide auxiliary information even when the input signal cannot be received.
[0046] Furthermore, according to the configuration of this embodiment, the image input unit 12 inputs the second image data in addition to the first image data. The background input unit 24 inputs the second image data as the background of the video data. Therefore, auxiliary information can be provided as the background of the video data.
[0047] [Embodiment 3] A third embodiment will be described with reference to Figures 7 to 10. In the third embodiment, a configuration will be described in which third image data different from the first image data is presented together with video data.
[0048] (Video processing device 30) Fig. 7 is a block diagram showing the configuration of a video processing device 30 according to the present embodiment 3. As shown in Fig. 7, the video processing device 30 includes a video generation unit 11, an image input unit 12', an editing unit 13, and an output unit 15. The configuration of the present embodiment 3 is equivalent to the configuration of the above-mentioned embodiment 1.
[0049] However, in the first embodiment, the image input unit 12 inputs the first image data to the video generation unit 11. On the other hand, in the third embodiment, the image input unit 12' inputs the first image data to the video generation unit 11 and inputs the third image data to the output unit 15. The third image data is different from the first image data. In one example, the first image data is time information indicating the current time, and the third image data is an emergency report regarding the occurrence of a natural disaster.
[0050] (Hardware configuration) An example of a hardware configuration of the above-mentioned video processing device 30 will be described with reference to Fig. 8. As shown in Fig. 8, the image input unit 12' further includes image input units D to E in addition to the image input units A to C.
[0051] Image input units D to E input fourth and fifth computer graphics (referred to as CG4 and CG5) to output unit 15, respectively.
[0052] The output unit 15 includes two keyers (KEYER in FIG. 9) corresponding to the image input units D to E. The two keyers of the output unit 15 have a function of turning on / off the inputs from the corresponding image input units D to E.
[0053] The output unit 15 receives the composite data from the editing unit 13. The output unit 15 also receives CG4 to CG5 from the image input units D to E. The output unit 15 generates third image data from one or both of CG4 to CG5 using a keyer. The output unit 15 outputs the third image data composed of any combination of CG4 to CG5 together with the composite data received from the editing unit 13.
[0054] (Example) Fig. 9 shows a display example of the composite data transmitted (output) by the video processing device 30. The frame in Fig. 9 represents, for example, the screen of a user terminal. As shown in Fig. 9, in the composite data, a switch is made between video data based on input X or input Y and video data based on CG1 input from image input unit A. This switch is performed by a selector (Fig. 2) in the video generation unit 11.
[0055] Also, as shown in Fig. 9, an arbitrary combination of CG1 to CG3 is placed in the upper right corner of the frame. The combination of CG1 to CG3 is displayed on the video data. The combination of CG1 to CG3 is determined by a keying process performed by a keyer (Fig. 2) of the editing unit 13.
[0056] Furthermore, as shown in Fig. 9, an arbitrary combination of CG4 to CG5 is placed in the upper left of the frame. The combination of CG4 to CG5 is placed on the video data. The combination of CG4 to CG5 is determined by a keying process performed by the keyer (Fig. 8) of the output unit 15.
[0057] In FIG. 9, the displays of CG1 to CG3 are in the same layer as the video data, while the displays of CG4 to CG5 are arranged in a layer above the layer of the video data. In other words, the displays of CG4 to CG5 are in the foreground of the video data. The first image data is composited with the video data by the DVE of the editing unit 13, while the third image data is not composited with the video data. In the frame shown in FIG. 9, when the video data is reduced, the displays of CG1 to CG3 are reduced together with the video data, while the displays of CG4 to CG5 do not change. As a result, the displays of CG4 to CG5 can always be kept at a size that is easy for the user to view.
[0058] (Effects of this embodiment) According to the configuration of this embodiment, the video generating unit 11 generates video data from an input signal. The image input unit 12' inputs first image data to be superimposed on the video data. The editing unit 13 synthesizes the first image data and the video data. The output unit 15 outputs synthetic data obtained by synthesizing the first image data and the video data. The video generating unit 11 is configured to be able to generate video data from the first image data instead of the input signal. When the input signal is interrupted, the video generating unit 11 can generate video data from the first image data instead of the input signal. The first image data is, for example, auxiliary information such as an emergency report regarding the occurrence of a natural disaster. This makes it possible to continuously provide auxiliary information even when the input signal cannot be received.
[0059] Furthermore, according to the configuration of this embodiment, the image input unit 12' inputs the first image data to the video generation unit 11, and inputs the third image data to the output unit 15. The output unit 15 outputs the third image data and the composite data. The third image data is different from the first image data. In one example, the first image data is time information indicating the current time, and the third image data is an emergency report regarding the occurrence of a natural disaster. This makes it possible to provide auxiliary information based on the third image data separately from the composite data.
[0060] [Embodiment 4] A fourth embodiment will be described with reference to Fig. 10 to Fig. 12. In the fourth embodiment, a configuration in which an interruption video is presented instead of composite data will be described.
[0061] (Video processing device 40) Fig. 10 is a block diagram showing the configuration of a video processing device 40 according to the fourth embodiment. As shown in Fig. 10, the video processing device 40 includes a video generation unit 11, an image input unit 12', an editing unit 13, and an output unit 15. The video processing device 40 further includes an interrupt input unit 44. The video processing device 40 differs from the video processing device 10 according to the first embodiment in that it includes the interrupt input unit 44.
[0062] The interrupt input unit 44 inputs the video data as interrupt video data. The interrupt input unit 44 is an example of an interrupt input means. In one example, the interrupt input unit 44 acquires the video data from the video generation unit 11. The interrupt input unit 44 inputs the received video data to the output unit 15 as interrupt video data.
[0063] When the output unit 15 receives interruption video data from the interruption input unit 44, it transmits the interruption video data to a user terminal or the like instead of the composite data.
[0064] (Hardware configuration) An example of the hardware configuration of the above-mentioned video processing device 40 will be described with reference to Fig. 11. As shown in Fig. 11, video data output from the MIXER of the video generation unit 11 is input to the output unit 15 as interrupt video data by a selector (indicated as SEL in Fig. 11) of the interrupt input unit 44, bypassing the editing unit 13. In one example, the interrupt video data includes an emergency message such as "Please wait a moment." The interrupt video data may be used to continuously notify a user of emergency news regarding natural disasters or incidents.
[0065] The output unit 15 outputs the interruption video data instead of the composite data. Therefore, even if the DVE of the editing unit 13 is broken or has stopped working, the interruption video data can be output. The interruption video data is (Example) Fig. 12 shows a display example of interruption video data transmitted (output) by the video processing device 40. The frame in Fig. 12 represents, for example, the screen of a user terminal. As shown in Fig. 12, interruption video data is displayed on the screen of the user terminal instead of the composite data. The interruption video data is either video data based on the input X or input Y, or video data based on the first image data.
[0066] (Effects of this embodiment) According to the configuration of this embodiment, the video generation unit 11 generates video data from an input signal. The image input unit 12 inputs first image data to be superimposed on the video data. The editing unit 13 synthesizes the first image data and the video data. The output unit 15 outputs synthetic data obtained by synthesizing the first image data and the video data. The video generation unit 11 is configured to be able to generate video data from the first image data instead of the input signal. When the input signal is interrupted, the video generation unit 11 can generate video data from the first image data instead of the input signal. The first image data is, for example, auxiliary information such as an emergency report regarding the occurrence of a natural disaster. This makes it possible to continuously provide auxiliary information even when the input signal cannot be received.
[0067] Furthermore, according to the configuration of this embodiment, the interrupt input unit 44 inputs video data as interrupt video data. The output unit 15 outputs the interrupt video data instead of the composite data. This makes it possible to output video data even if the editing unit 13 is out of function.
[0068] [Embodiment 5] A fifth embodiment will be described with reference to Fig. 13. In the fifth embodiment, an example of a video distribution system including the video processing device according to any one of the first to fourth embodiments will be described.
[0069] (Video Distribution System 1) FIG. 13 is a diagram showing a schematic configuration of a video distribution system 1 according to the fifth embodiment. The video distribution system 1 includes one or more imaging devices, one or more encoders, a server, and one or more user terminals. The number of imaging devices, encoders, and user terminals shown in FIG. 13 may be increased or decreased. In one example, the one or more imaging devices, the one or more encoders, the server, and the one or more user terminals are connected to each other via a local network so as to be able to communicate with each other. In one example, these components of the video distribution system 1 are connected via a wired LAN (Local Area Network) or a wireless LAN. Alternatively, in the video distribution system 1, a wider range of mobile networks such as a wireless MAN (Metropolitan Area Network) or a wireless WAN (Wide Area Network) may be used instead of the wired LAN or the wireless LAN. In addition, the server is not particularly limited in type, and may be a local server or a cloud server.
[0070] The imaging device captures images to generate video data. The imaging device may be, for example, a surveillance camera, a digital camera, or a smartphone.
[0071] The encoder receives video data from an image capture device, converts the video data into an input signal by encoding the video data, and transmits the input signal to a server via a wireless network.
[0072] The server is realized on a wireless network. The server is capable of communicating with the encoder and the user terminal through the wireless network. The server includes any one of the video processing devices according to the first to fourth embodiments (that is, 10, 20, 30, or 40).
[0073] The video processing device (10, 20, 30, or 40) in the server generates video data from an input signal, as described in the first to fourth embodiments. The video processing device synthesizes the video data with the first image data. Alternatively, as described in the second embodiment, the video processing device further synthesizes the background of the video data in addition to the video data and the first image data. Then, the video processing device transmits the synthesized data obtained by synthesizing the video data with the first image data to each of one or more user terminals.
[0074] Alternatively, as described in the third embodiment, the video processing device transmits the third image data together with the composite data to one or more user terminals.
[0075] Alternatively, as described in the fourth embodiment, the video processing device transmits interruption video data, instead of composite data, to one or more user terminals.
[0076] (Effects of this embodiment) According to the configuration of this embodiment, the video generation unit 11 generates video data from an input signal. The image input unit 12 inputs first image data to be superimposed on the video data. The editing unit 13 synthesizes the first image data and the video data. The output unit 15 outputs synthetic data obtained by synthesizing the first image data and the video data. The video generation unit 11 is configured to be able to generate video data from the first image data instead of the input signal. When the input signal is interrupted, the video generation unit 11 can generate video data from the first image data instead of the input signal. The first image data is, for example, auxiliary information such as an emergency report regarding the occurrence of a natural disaster. This makes it possible to continuously provide auxiliary information even when the input signal cannot be received.
[0077] The video distribution system according to this embodiment can continuously provide auxiliary information to one or more user terminals.
[0078] (Hardware configuration) Each of the components of the video processing devices 10 to 40 described in the first to fourth embodiments is represented by a functional block. Some or all of these components are realized by an information processing device 900 as shown in Fig. 14. Fig. 14 is a block diagram showing an example of the hardware configuration of the information processing device 900.
[0079] As shown in FIG. 14, an information processing device 900 includes, as an example, the following configuration.
[0080] ·CPU(Central Processing Unit)901 ROM (Read Only Memory) 902 ·RAM(Random Access Memory)903 Program 904 loaded into RAM 903 A storage device 905 for storing a program 904 A drive device 907 for reading and writing data from the recording medium 906 A communication interface 908 for connecting to a communication network 909 An input / output interface 910 for inputting and outputting data Bus 911 connecting each component Each of the components of the video processing devices 10 to 40 described in the first to fourth embodiments is realized by the CPU 901 reading and executing a program 904 that realizes these functions. The program 904 that realizes the functions of each component is, for example, stored in advance in the storage device 905 or the ROM 902, and is loaded into the RAM 903 and executed by the CPU 901 as necessary. The program 904 may be supplied to the CPU 901 via the communication network 909, or may be stored in advance in the recording medium 906, and the drive device 907 may read out the program and supply it to the CPU 901.
[0081] According to the above configuration, the video processing devices 10 to 40 described in the first to fourth embodiments are realized as hardware, and therefore the same effects as those described in the first to fourth embodiments can be achieved. [Industrial Applicability]
[0082] The present invention can be used, for example, in a video processing device or a video distribution system that transmits video data captured by a camera to a user terminal such as a smartphone.
[0083] (Additional Note) One embodiment of the present invention is described as follows, but is not limited to the following.
[0084] (Appendix 1) an image generating means for generating image data from an input signal; an image input means for inputting first image data to be superimposed on the video data; an editing means for synthesizing the first image data and the video data; an output means for outputting composite data obtained by combining the first image data and the video data; Equipped with The image generating means is configured to generate the image data from the first image data instead of the input signal. Image processing device.
[0085] (Appendix 2) The image input means further inputs second image data, The image processing device further includes a background input unit for inputting the second image data as a background of the video data. 2. The video processing device according to claim 1 .
[0086] (Appendix 3) The background input means selectively combines one or more of the second image data and inputs them as a background of the video data. 3. The video processing device according to claim 2,
[0087] (Appendix 4) The editing means combines the video data and the first image data with the background. 4. The video processing device according to claim 2 or 3.
[0088] (Appendix 5) The image data is further provided with an interrupt input means for inputting the image data as interrupt image data. 5. The video processing device according to claim 1,
[0089] (Appendix 6) The output means outputs the interrupt video data instead of the composite data. 6. The video processing device according to claim 5,
[0090] (Appendix 7) The editing means selectively combines one or more of the first image data and synthesizes the combined image data with the video data. 7. The video processing device according to claim 1,
[0091] (Appendix 8) the image input means further inputs third image data; The output means outputs the third image data and the composite data. 8. The video processing device according to claim 1,
[0092] (Appendix 9) A video processing device according to any one of claims 1 to 8, one or more user terminals to which the composite data is delivered from the video processing device; one or more imaging devices; an encoder that converts photographic data acquired from each of the one or more image capture devices into the input signal and transmits the input signal to the video processing device; A video distribution system equipped with the above.
[0093] (Appendix 10) Generates video data from the input signal, inputting first image data to be superimposed on the video data; combining the first image data with the video data; outputting composite data obtained by combining the first image data and the video data; In generating the video data, the video data can be generated from the first image data instead of the input signal. Image processing method.
[0094] (Appendix 11) A process of generating video data from an input signal; inputting first image data to be superimposed on the video data; A process of synthesizing the first image data and the video data; a process of outputting composite data obtained by combining the first image data and the video data; In the process of generating the video data, the computer is configured to be able to generate the video data from the first image data instead of the input signal. program. [Explanation of symbols]
[0095] 1. Video distribution system 10. Image Processing Device 11 Image Generation Section 12(12´) Image input section 13 Editorial Department 15 Output section 20 Image processing device 24 Background input section 30 Image processing device 40 Image processing device 44 Interrupt input section
Claims
1. an image generating means for generating image data from an input signal; an image input unit for inputting one of a plurality of image data as a first image data to be superimposed on the video data; an editing means for synthesizing the first image data and the video data; an output unit for outputting composite data obtained by combining the first image data and the video data; Equipped with the image generating means is configured to be able to replace the input signal with replacement image data that is one of the plurality of image data; When the input signal is replaced with the replacement image data, The editing means combines the first image data with the replacement image data, and the output means outputs combined data obtained by combining the first image data with the replacement image data. Image processing device.
2. The image input means further inputs second image data, The image processing device further includes a background input unit for inputting the second image data as a background of the video data.
2. The image processing device according to claim 1.
3. The background input means selectively combines one or more of the second image data and inputs them as a background of the video data.
3. The image processing device according to claim 2.
4. The editing means combines the video data and the first image data with the background.
4. The image processing device according to claim 2, wherein the first and second inputs are connected to the first and second inputs.
5. The image data is further provided with an interrupt input means for inputting the image data as interrupt image data.
5. The image processing device according to claim 1, wherein the first and second inputs are input to the first and second inputs.
6. The output means outputs the interrupt video data instead of the composite data.
6. The image processing device according to claim 5,
7. The editing means selectively combines one or more of the first image data and synthesizes the combined image data with the video data.
7. The image processing device according to claim 1,
8. A video processing device according to any one of claims 1 to 7, one or more user terminals to which the composite data is delivered from the video processing device; one or more imaging devices; an encoder that converts photographic data acquired from each of the one or more image capture devices into the input signal and transmits the input signal to the video processing device; A video distribution system equipped with the above.
9. A computer comprising: Generates video data from the input signal, inputting one of the plurality of image data as a first image data to be superimposed on the video data; combining the first image data with the video data; outputting composite data obtained by combining the first image data and the video data; A video processing method capable of generating the video data from the first image data instead of the input signal, The computer includes: When generating the video data, the input signal can be replaced with replacement image data that is one of the plurality of image data; When the input signal is replaced with the replaced image data, combining the first image data with the replacement image data; outputting composite data obtained by combining the first image data and the replacement image data; Image processing method.
10. A process of generating video data from an input signal; A process of inputting one of a plurality of image data as first image data to be superimposed on the video data; A process of synthesizing the first image data and the video data; a process of outputting composite data obtained by combining the first image data and the video data; A program configured to enable the computer to generate the video data from the first image data instead of the input signal in a process of generating the video data, The computer includes: In the process of generating the video data, the input signal can be replaced with replacement image data that is one of the plurality of image data; When the input signal is replaced with the replaced image data, combining the first image data with the replacement image data; outputting composite data obtained by combining the first image data and the replacement image data; program.
Citation Information
Patent Citations
Actual-photographic picture and three-dimensional model composing device
JP1997023449A
Output method for video signal and video signal transmitter
JP1998285456A
Emergency image distribution system and emergency image distribution method
JP2012160939A
Sign language CG generation device and sign language CG generation program
JP2016038748A
Encoder, content transmission system, method and program
JP2019197966A