Video output program, video output device, and video output method

Abstract

To provide a video output program, a video output device, and a video output method capable of outputting a content video desired by a user at a timing intended by the user.SOLUTION: When a thumbnail button 50a or the like of a content button 50 is selected from a user content area 42 or the like, a content image in which a foreground image of a foreground content corresponding to a background image of a corresponding background content is superimposed is output to a video switcher 20. As a result, it is possible to output the content video of the desired content to the video switcher 20 at the timing intended by a user H.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a video output program, a video output device, and a video output method. [Background technology]

[0002] Patent Document 1 discloses an information processing device 1 that creates caption data and provides the created caption data to an image distribution system 5. Specifically, a user inputs material data including text information and selects a template that determines the display format of the caption, and the caption data is created by applying the selected template to the input material data. A video with the created caption data superimposed thereon is distributed from the image distribution system 5 to a distribution destination. This allows a user to easily create caption data with a display format desired by the user using a template and distribute the data to a distribution destination. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2020-137075 Summary of the Invention [Problem to be solved by the invention]

[0004] However, there are cases where a user wants to change the characters or display format included in the caption data depending on the video the caption data is superimposed on. When switching caption data depending on the video in the information processing device 1 of Patent Document 1, the caption data cannot be changed without inputting material data and selecting a template each time, which poses a problem in that caption data cannot be delivered in the display format desired by the user at the timing intended by the user.

[0005] An object of the present invention is to provide a video output program, a video output device, and a video output method that are capable of outputting a content video desired by a user at a timing intended by the user. [Means for solving the problem]

[0006] In order to achieve this object, the video output program of the present invention is a program that causes a computer to which an external device is connected to execute a process of outputting content video, which is video created based on content including at least one of video and images, and causes the computer to execute a list display step of displaying a list of the content, a selection step of selecting foreground content and background content different from the foreground content from the list displayed by the list display step, and an output step of generating a foreground video based on the foreground content selected in the selection step and a background video based on the background content selected in the selection step, and outputting the content video, with the foreground video as the foreground and the background video as the background of the foreground video, to the external device.

[0007] The video output device of the present invention is a device that outputs content video, which is video created based on content including at least one of video and images, and is equipped with a list display means that displays a list of the content, a selection means that selects foreground content and background content different from the foreground content from the list displayed by the list display means, and an output means that generates a foreground video based on the foreground content selected by the selection means and a background video based on the background content selected by the selection means, and outputs the content video, with the foreground video as the foreground and the background video as the background of the foreground video, to an external device.

[0008] Furthermore, the video output method of the present invention is a method for outputting content video, which is video created based on content including at least one of video and images, and includes a list display step of displaying a list of the content, a selection step of selecting foreground content and background content different from the foreground content from the list displayed by the list display step, and an output step of generating a foreground video based on the foreground content selected in the selection step and a background video based on the background content selected in the selection step, and outputting the content video, with the foreground video as the foreground and the background video as the background of the foreground video, to an external device. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing the appearance of a PC. [Figure 2] (a) is a diagram showing the display screen, (b) to (e) are diagrams explaining the content buttons, (f) is a diagram explaining the composite content button, and (g) is a diagram explaining the composite creation button. [Figure 3] 10A and 10B are diagrams illustrating the user content area when an auto tab is selected. [Figure 4] 10(a) to 10(d) are diagrams illustrating the editing screen. [Figure 5] FIG. 2 is a block diagram showing the electrical configuration of a PC. [Figure 6] 1A is a diagram for explaining a video output program, and FIG. 1B is a diagram for schematically illustrating a content table. [Figure 7] 1A is a diagram illustrating content data, and FIG. 1B is a diagram illustrating edit screen data. [Figure 8] FIG. 1 is a functional block diagram of a PC. [Figure 9] FIG. 10 is a sequence diagram illustrating a content start process. [Figure 10]10A is a sequence diagram showing a content deselection process, FIG. 10B is a flowchart of a content selection process, and FIG. 10C is a flowchart of an edit switching process. [Figure 11] FIG. 10 is a sequence diagram of a content editing process. [Figure 12] 10A is a sequence diagram when content or an editing screen is controlled from a MIDI device or a video switcher, and FIG. 10B is a sequence diagram when content controls a MIDI device or a video switcher. DETAILED DESCRIPTION OF THE INVENTION

[0010] A preferred embodiment will now be described with reference to the accompanying drawings. An overview of a PC 1 according to this embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram illustrating an overview of the PC 1. The PC 1 is an information processing device (computer, video output device) that outputs content to a connected video switcher 20 (described below).

[0011] In this embodiment, content refers to a set of data consisting of one or more video, image, or audio data and content data (described later) for creating a new video, i.e., a content video, from these data. In addition to the video and image, audio such as human voice and background music can be added to the content video. Such content is created in the PC 1, and the content video based on the created content is transmitted to the video switcher 20.

[0012] The PC 1 is provided with a mouse 2 and keyboard 3 for inputting instructions from the user H, a display device 4 for displaying information such as content, and a MIDI device 5. The MIDI device 5 is a device for inputting MIDI (Musical Instrument Digital Interface) messages based on operations by the user H. The PC 1 performs processing in accordance with the MIDI messages input from the MIDI device 5.

[0013] Examples of the MIDI device 5 include a controller having multiple buttons, each of which is assigned a MIDI message, and which transmits a MIDI message in response to a button pressed by the user H, or a musical keyboard of a keyboard type that transmits MIDI messages assigned to keys, but any device that uses MIDI messages may also be used as appropriate. The PC 1 performs processes such as selecting content in response to the MIDI messages input from the MIDI device 5, and switching functions assigned to the buttons of the MIDI device 5 based on the MIDI messages output from the PC 1.

[0014] The PC 1 is further connected to a video switcher 20 and a server 70. The video switcher 20 is a device (external device, video processing device) that outputs a composite video, which is a video in which input images and videos are arranged into a single video. The video switcher 20 is connected to a plurality of video cameras 21 and a projector 22. The video camera 21 is an input device that inputs images and videos to be arranged in the composite video, and the projector 22 is an output device that projects the composite video from the video switcher 20 onto a screen.

[0015] The video switcher 20 creates a composite video by superimposing the content video input from the PC 1 on the images and videos input from a plurality of video cameras 21, and outputs the created composite video to the projector 22.

[0016] The server 70 is an information processing device that transmits content to the PC 1, and is connected to the PC 1 via the Internet Nt. The server 70 stores a plurality of pre-created contents, and the content selected by the PC 1 from the stored contents is transmitted to the PC 1. Furthermore, content that has already been transmitted from the server 70 and stored in the PC 1 can be used offline without having to be obtained again from the server 70. Furthermore, content can be obtained from the server 70, or the content obtained from the server 70 can be edited, and the user H can also create new content.

[0017] The PC 1 outputs content video of content newly created by the user H to the video switcher 20, and also outputs content video based on content transmitted from the server 70 as is to the video switcher 20. Furthermore, the PC 1 outputs content video based on content that has been edited from the content transmitted from the server 70 (for example, by changing a character string included in the content) to the video switcher 20.

[0018] In the PC 1 of this embodiment, the user H selects output content, which is content to be output to the video switcher 20, and edits the content format on the display screen 4a displayed on the display device 4. The display screen 4a will be described with reference to FIGS.

[0019] 2(a) is a diagram showing a display screen 4a. Displayed on the display screen 4a are a preset content area 40, category tabs 41a to 41d, a user content area 42, a user tab 43, an auto tab 44, an edit screen 45, and an on-air button 46 for starting / ending output of content video based on the content to be output to the video switcher 20.

[0020] The preset content area 40 is a display area that displays a list of content stored in the server 70. The category tabs 41a to 41d are buttons that select the category of content to be displayed in the preset content area 40. The content stored in the server 70 is pre-classified into categories such as "Title" and "Logo," and content in the category corresponding to the selected category tab 41a to 41d is displayed in the preset content area 40.

[0021] Content buttons 50 representing content corresponding to the category selected in the category tabs 41a to 41d are displayed in the preset content area 40. Details of the content buttons 50 will be described later with reference to FIGS. 2(b) to 2(e).

[0022] The user content area 42 is a display area that displays a list of content or sequences created or edited by user H. The user tab 43 is a button that switches the content displayed in the user content area 42 to content created or edited by user H. The auto tab 44 is a button that switches the content displayed in the user content area 42 to content that makes up a sequence.

[0023] Here, a sequence is a sequence of multiple contents arranged at the timing of their output. The contents arranged in the sequence are output in the order in which they are arranged, at the specified timing (for example, outputting a certain content for 30 seconds, then displaying the next content for 20 seconds, etc.).

[0024] When the user tab 43 is selected, the user content area 42 displays a content button 50 representing content corresponding to content created or edited by user H, a composite content button 51 representing composite content that combines two separate pieces of content into one piece of content, and a composite creation button 52 for creating composite content.

[0025] When user H creates content, he or she drags and drops the content button 50 displayed in the preset content area 40 into the user content area 42. By doing so, the content is duplicated and placed in the user content area 42. User H can easily create content in the format desired by user H by editing the duplicated content. The display contents of the user content area 42 when the auto tab 44 is selected will be described later with reference to FIG. 3.

[0026] Next, the content button 50 will be described with reference to Figures 2(b) to (e). Figures 2(b) to (e) are diagrams each explaining the content button 50. As shown in Figures 2(b) to (e), the content button 50 displays a thumbnail button 50a, a foreground button 50b, an edit button 50c, and a name area 50d.

[0027] The thumbnail button 50a is a button that displays the display details (thumbnail) of the corresponding content, and further selects the content as background content, which is one of the contents to be output.

[0028] In this embodiment, two contents can be selected at the same time as the output target contents. Of the two contents, a foreground content is provided, which is a content displayed in the foreground, and a background content is provided, which is a content displayed behind the foreground content. A content video in which the foreground content is superimposed on the background content is output to the video switcher 20.

[0029] When a thumbnail button 50a is selected and the corresponding content is selected as background content, the outer frame of the thumbnail button 50a is drawn with a thick line, as shown in Figure 2(c), indicating that the corresponding content has been selected as background content.

[0030] Furthermore, when the thumbnail button 50a of one content button 50 is selected and then the thumbnail button 50a of another content button 50 is selected, the selection of the background content of the content corresponding to the first content button 50 is cancelled, and the content corresponding to the other content button 50 is selected as the background content. Then, the outer frame of the thumbnail button 50a of the first content button 50 is changed to a normal line (i.e., the thickness shown in FIG. 2(b)), and the outer frame of the thumbnail button 50a of the other content button 50 is changed to a thick line (i.e., FIG. 2(c)). This operation makes it possible to prevent multiple contents from being selected as background content at the same time.

[0031] Foreground button 50b is a button (operator) for selecting the corresponding content as foreground content. When foreground button 50b is selected and the corresponding content is selected as foreground content, the outer frame of foreground button 50b is drawn with a thick line, as shown in FIG. 2(d), indicating that the corresponding content has been selected as foreground content.

[0032] In this way, when the thumbnail button 50a or foreground button 50b of the content button 50 is selected from the preset content area 40 or the user content area 42, which display a list of contents, output of the content video of the corresponding content to the video switcher 20 begins. On the other hand, when the selected thumbnail button 50a or foreground button 50b is selected again, output of the content video of the corresponding content to the video switcher 20 is stopped.

[0033] This allows user H to instantly and easily start and stop output of the content to be output to the video switcher 20 by selecting and deselecting the content to be output, so that the content desired by user H can be output to the video switcher 20 at the timing intended by user H.

[0034] Furthermore, by selecting thumbnail button 50a corresponding to one content, the one content is selected as background content, and by selecting foreground button 50b corresponding to another content, the other content is selected as foreground content. Then, a content video in which the foreground content is superimposed on the selected background content is output to video switcher 20. In this way, a content video with rich expression that combines two types of content, foreground content and background content that are different from each other, can be output to video switcher 20.

[0035] Furthermore, by user H selecting foreground button 50b of the content designated as the background content and then selecting thumbnail button 50a of the content designated as the foreground content, the background content and the foreground content can be swapped. For example, by having video switcher 20 swap the foreground content and the background content in accordance with the video from video camera 21, content suitable for the video from video camera 21 can be easily output.

[0036] Here, a transparency (alpha channel) is preset for each content depending on the images and videos that make up the content. When the foreground content and the background content are superimposed, the transparency set for each of the foreground content and the background content is applied before the foreground content and the background content are superimposed. Therefore, in a content video in which the foreground content and the background content are superimposed, it is possible to prevent a situation in which the foreground content covers the background content and makes the background content completely invisible.

[0037] The edit button 50c is a button for selecting the target of content to be edited on the edit screen 45. When the edit button 50c is selected, the target of content to be edited on the edit screen 45 is the content corresponding to the selected edit button 50c, and at that time, the outer frame of the edit button 50c is drawn with a thick line, as shown in FIG. 2(e). Details of the edit screen 45 will be described later with reference to FIG. 4. The name area 50d is a display area in which the name given to the corresponding content is displayed.

[0038] Next, the composite content button 51 and the composite creation button 52 will be described with reference to Figures 2(f) and (g). Figure 2(f) is a diagram illustrating the composite content button 51. As shown in Figure 2(f), the composite content button 51 displays a thumbnail button 51a, a foreground button 51b, an edit button 51c, and a name area 51d.

[0039] The thumbnail button 51a and the foreground button 51b are buttons for selecting the corresponding composite content. By operating the thumbnail button 51a or the foreground button 51b when no composite content is selected, the background content of the composite content corresponding to the selected thumbnail button 51a or the foreground button 51b is selected as the background content. At the same time, the foreground content of the composite content corresponding to the selected thumbnail button 51a or the foreground button 51b is selected as the foreground content. Note that the functions of the thumbnail button 51a and the foreground button 51b when a composite content is selected are the same as those of the thumbnail button 50a and the foreground button 50b described above, and therefore detailed description thereof will be omitted. Furthermore, the functions of the edit button 51c and the name area 51d are the same as those of the edit button 50c and the name area 50d described above, and therefore detailed description thereof will be omitted.

[0040] Next, the composite creation button 52 will be described. FIG. 2(g) is a diagram illustrating the composite creation button 52. The composite creation button 52 is a button for creating composite content. As shown in FIG. 2(g), a content designation area 52a is displayed on the composite creation button 52. The content designation area 52a is a display area for designating the content that constitutes the composite content, and specifically, a foreground content designation area 52a1 for designating foreground content and a background content designation area 52a2 for designating background content are provided.

[0041] The creation of composite content using the composite creation button 52 will be explained. First, select the content button 50 of the content to be used as the foreground content in the composite content from the preset content area 40 or the user content area 42, and drag and drop it into the foreground content designation area 52a1. Next, select the content button 50 of the content to be used as the background content in the composite content from the preset content area 40 or the user content area 42, and drag and drop it into the background content designation area 52a2.

[0042] In this way, by dragging and dropping the content button 50 into the content designation area 52a, a composite content is created using the corresponding content. Note that in the above example, the foreground content is designated first, and then the background content, but it is also possible to designate the background content first, and then the foreground content. Then, a composite content button 51 using the created composite content is displayed in the user content area 42.

[0043] In this way, by creating one composite content from two pieces of content, one as foreground content and one as background content, a content video combining the foreground content and the background content can be output to the video switcher 20 easily and quickly.

[0044] Next, the user content area 42 when the auto tab 44 is selected will be described with reference to Figure 3. Figures 3(a) and 3(b) are diagrams illustrating the user content area 42 when the auto tab 44 is selected.

[0045] In the user content area 42 when the auto tab 44 is selected, first, the content button 50 corresponding to the content to be sequenced is duplicated by dragging and dropping it from the preset content area 40. In addition, the content button 50 displayed in the user content area 42 when the user tab 43 is selected may be copied and duplicated in the user content area 42 when the auto tab 44 is selected.

[0046] In this way, when the auto tab 44 is selected, the content corresponding to the content button 50 arranged in the user content area 42 is set as the content to be sequenced. Then, the content is switched in order from the content selected by the user H to the right, and the corresponding content video is output, and when the output of the content video of the rightmost content is completed, the output of the content video is stopped.

[0047] When the auto tab 44 is selected, a start point specification button 42a, an end point specification button 42b, and a duration specification area 42c are displayed below the content button 50 in the user content area 42.

[0048] The start point designation button 42a is a button that designates the content of the corresponding content button 50 as the start point content, which is the first content when looping a sequence. When the start point designation button 42a is selected, the start point designation button 42a is drawn with a thick line, as shown in Figures 3(a) and (b), and it is displayed that the corresponding content has been designated as the start point content.

[0049] The end point designation button 42b is a button for designating the content of the corresponding content button 50 as the end point content, which is the last content when looping a sequence. When the end point designation button 42b is selected, the end point designation button 42b is drawn with a thick line, as shown in Figures 3(a) and (b), and it is displayed that the corresponding content has been designated as the end point content.

[0050] When the end point designation button 42b is selected, a setting is made to loop the sequence, and the content of the content button 50 selected with the start point designation button 42a, or if the start point designation button 42a is not selected, the leftmost content, the content of the content button 50 designated with the end point designation button 42b, and the content arranged between these content buttons 50 are set as the targets of the sequence to be looped. Note that when the selected end point designation button 42b is selected again and then deselected, the setting to loop the sequence is canceled.

[0051] The duration designation area 42c is a display area for designating the time (seconds) for outputting the content of the corresponding content button 50. The time for outputting the content set in the duration designation area 42c is used both when the sequence is looped and when it is not looped.

[0052] A loop target display 42d is displayed below the start point designation button 42a, the end point designation button 42b, and the duration designation area 42c. The loop target display 42d is a display part that is displayed across the content buttons 50 that are the targets of the sequence loop. By visually checking the loop target display 42d, user H can easily understand the range of content that has been set as the target of the sequence.

[0053] Here, an example of the sequence output in Figures 3(a) and (b) will be described. In Figure 3(a), since none of the end point designation buttons 42b are selected, it is set so that the sequence will not loop. Furthermore, "3 seconds" is set in the duration designation area 42c corresponding to the leftmost content button 50, "1 second" is set in the duration designation area 42c corresponding to the second content button 50 from the left, and "10 seconds" is set in the duration designation area 42c corresponding to the rightmost content button 50.

[0054] As a result, first, the content video of the content corresponding to the leftmost content button 50 selected by user H is output to the video switcher 20 for three seconds, then the content video of the content corresponding to the second content button 50 from the left is output to the video switcher 20 for one second, and then the content video of the content corresponding to the rightmost content button 50 is output to the video switcher 20 for ten seconds. Then, when the output of the content video of the content corresponding to the rightmost content button 50 to the video switcher 20 is completed, the output of the content video is stopped.

[0055] 3(b), the start point specification button 42a of the second content button 50 from the left is selected, and the end point specification button 42b of the rightmost content button 50 is selected. This sets the sequence to loop. Also, "7 seconds" is set in the duration specification area 42c corresponding to the second content button 50 from the left, and "6 seconds" is set in the duration specification area 42c corresponding to the rightmost content button 50.

[0056] As a result, first, the content video of the content corresponding to the second content button 50 from the left is output to the video switcher 20 for seven seconds, and then the content video of the content corresponding to the rightmost content button 50 is output to the video switcher 20 for six seconds. After the output of the content corresponding to the rightmost content button 50 to the video switcher 20 is completed, the output of the content corresponding to the second content button 50 from the left to the video switcher 20 is repeated again.

[0057] Also, as shown in Figure 3(b), when the start point designation button 42a of the second content button 50 from the left is selected and the end point designation button 42b of the rightmost content button 50 is selected, and then the thumbnail button 50a of the leftmost content button 50 is selected, first, the content video of the content corresponding to the leftmost content button 50 is output to the video switcher 20 for 2 seconds, then the content video of the content corresponding to the second content button 50 from the left is output to the video switcher 20 for 7 seconds, and then the content video of the content corresponding to the rightmost content button 50 is output to the video switcher 20 for 6 seconds.

[0058] Then, after the output of the content corresponding to the rightmost content button 50 to the video switcher 20 is completed, the output of the content corresponding to the second content button 50 from the left for which the start point designation button 42a is selected is repeated, followed by the output of the content corresponding to the rightmost content button 50. In other words, when the start point designation button 42a and the end point designation button 42b are selected and the thumbnail button 50a of the content button 50 to the left of the start point designation button 42a is further selected, the content corresponding to the content button 50 to the left of the start point designation button 42a is output only the first time in the loop, and thereafter the content selected with the start point designation button 42a to the end point designation button 42b is repeatedly output.

[0059] In this way, a sequence is created in which a plurality of contents are arranged according to the timing at which they are to be output, and at the timing set in the sequence, content images of the target contents are output to the video switcher 20. This allows the user H to automatically switch the contents to be output at a preset timing, without having to select the thumbnail buttons 50a, etc. one by one in real time to switch the contents.

[0060] Next, the editing screen 45 will be described with reference to Fig. 4. Figs. 4(a) to (d) are diagrams each illustrating the editing screen 45. As shown in Figs. 4(a) to (d), the editing screen 45 mainly displays a preview editing button 45a, an output content editing button 45b, a preview area 45c, a start animation preview button 45d, an end animation preview button 45e, and an editing parts group 45f.

[0061] The preview edit button 45a is a button for specifying the content of the content button 50 for which the edit button 50c or 51c is selected as the target for editing the aspect of the content on the edit screen 45. Here, the aspect of the content refers to settings related to the display of the components that make up the content, such as the arrangement and size of the images and videos that make up the content, and the content and color of the character strings that make up the content.

[0062] The output content edit button 45b is a button for specifying the background content and foreground content selected with the thumbnail buttons 50a, 51a and foreground buttons 50b, 51b as the target for editing the aspect of the content on the edit screen 45. The preview edit button 45a and the output content edit button 45b are configured so that only one of them can be selected, and the outer frame of the selected button is drawn with a thick line.

[0063] The preview area 45c is a display area for displaying the display contents of the content being edited. The display contents of the content as a result of editing using an editing parts group 45f (described later) are displayed in the preview area 45c.

[0064] The start animation preview button 45d is a button for displaying the start animation of the content to be edited in the preview area 45c. The start animation is an animation that is output immediately after the output of the content starts. If the content to be edited includes a start animation, selecting the start animation preview button 45d causes the start animation to be displayed in the preview area 45c.

[0065] The end animation preview button 45e is a button for displaying the end animation of the content to be edited in the preview area 45c. The end animation is an animation that is output immediately before the output of the content is completed, and when the content to be edited includes an end animation, selecting the end animation preview button 45e causes the end animation to be displayed in the preview area 45c.

[0066] The editing part group 45f is a group of parts for changing the settings of the aspect of the content to be edited. Different parts are arranged in the editing part group 45f for each content to be edited. For example, the editing screen of FIG. 4(a) displays a part for changing the content of the string ("LIVE") to be displayed as content, and parts for setting the position of the string in the X and Y axes, as well as the width and height. Furthermore, the editing screen of FIG. 4(b), which is used to edit the aspect of content different from that of FIG. 4(a), displays a part for specifying the file name of the image to be displayed as content ("graph.png."), and parts for setting the position of the image in the X and Y axes and the magnification factor.

[0067] In this way, by displaying parts corresponding to the content to be edited in the edit parts group 45f, the user H can easily and intuitively edit the aspect of the content.

[0068] Next, referring to Figures 4(c) and (d), the editing screen 45 when the output content edit button 45b is selected will be described. When the output content edit button 45b is selected, the editing screen 45 displays the above-mentioned editing part group 45f, foreground edit button 45g, and background edit button 45h. Note that although the display of the preview area 45c is omitted in Figures 4(c) and (d), the preview area 45c may also be displayed when the output content edit button 45b is selected.

[0069] The foreground edit button 45g is a button for specifying foreground content as the target for editing the aspect of content on the editing screen 45. The background edit button 45h is a button for specifying background content as the target for editing the aspect of content on the editing screen 45. Only one of the foreground edit button 45g and the background edit button 45h can be selected, and the outer frame of the selected button is drawn with a thick line.

[0070] When output content edit button 45b is selected, a group of parts for changing the settings of the aspect of the foreground content or background content specified with foreground edit button 45g or background edit button 45h is also displayed as edit part group 45f. The aspect of the content set with edit part group 45f is then applied to the foreground content or background content specified with foreground edit button 45g or background edit button 45h, and is reflected in real time in the content video being output to video switcher 20. This allows foreground content or background content in the aspect intended by user H to be quickly output to video switcher 20.

[0071] Furthermore, selecting the foreground edit button 45g or the background edit button 45h switches between the edit part group 45f for editing the aspect of the foreground content and the edit part group 45f for editing the aspect of the background content. That is, selecting the foreground edit button 45g or the background edit button 45h makes it possible to easily switch between the edit screen 45 for editing the aspect of the foreground content and the edit screen 45 for editing the aspect of the background content. This allows the aspects of the foreground content and the background content to be edited easily and quickly.

[0072] Next, the electrical configuration of PC 1 will be described with reference to Figures 5 to 7. Figure 5 is a block diagram showing the electrical configuration of PC 1. PC 1 has a CPU 10, a hard disk drive (HDD) 11, and a RAM 12, which are each connected to an input / output port 24 via a bus line 13. The input / output port 24 is further connected to the above-mentioned mouse 2, keyboard 3, display device 4, MIDI device 5, video switcher 20, and communication device 15.

[0073] The CPU 10 is a computing device that controls each unit connected by a bus line 13. The HDD 11 is a rewritable nonvolatile storage device that stores programs executed by the CPU 10, fixed value data, etc., and stores a video output program 11a and a content table 11b. When the video output program 11a is executed by the CPU 10, the processing described below with reference to FIGS. 9 to 12 is executed. The video output program 11a and the content table 11b will now be described with reference to FIGS. 6 and 7.

[0074] 6(a) is a diagram illustrating the video output program 11a. As shown in FIG. 6(a), the video output program 11a includes the following modules: a control unit 11a1, a background video output unit 11a2, a foreground video output unit 11a3, an editing unit 11a4, and a composition unit 11a5. The control unit 11a1 is a module that controls other modules such as the background video output unit 11a2, as well as other devices connected to the PC 1, such as the mouse 2, the display device 4, and the video switcher 20.

[0075] Background video output unit 11a2 is a module that creates and outputs a background video, which is a content video of the content selected by control unit 11a1 as background content. As will be described in detail later, the position, size, and other configuration of the video and images arranged in the background video are expressed by content data included in the content. In this embodiment, the content data is described in HTML (HyperText Markup Language). Background video output unit 11a2 interprets the HTML description of the content data corresponding to the selected background content and outputs the background video, which is a content video created based on the results. The created background video is sent to display device 4 if it is to be displayed in preview area 45c, or to synthesis unit 11a5, described later, if it is to be output to video switcher 20.

[0076] Foreground video output unit 11a3 is a module that creates and outputs foreground video of the content designated as foreground content by control unit 11a1. Foreground video output unit 11a3 also interprets the HTML description in the content data of the content corresponding to the selected foreground content, and outputs foreground video created based on the results. The output foreground video is sent to display device 4 if it is to be displayed in preview area 45c, or to composition unit 11a5 if it is to be output to video switcher 20.

[0077] These background video output section 11a2 and foreground video output section 11a3 are collectively referred to as "output sections", and when no particular distinction is made between them, they are referred to as "output sections 11a2, 11a3".

[0078] Editing unit 11a4 is a module that creates and outputs an image of editing screen 45 of content specified by control unit 11a1. As will be described in detail later, the image of editing screen 45 is also constructed based on editing screen data written in HTML. Editing unit 11a4 interprets the HTML description of the editing screen data corresponding to the specified content and creates an image based on the results. The created image is sent to display device 4 to be displayed as editing screen 45.

[0079] In this embodiment, the background video output unit 11a2, the foreground video output unit 11a3, and the editing unit 11a4 are configured using "WebView2" from Microsoft (registered trademark), but other technologies that interpret the HTML of the content data and editing data and output images may also be used as appropriate.

[0080] Combining unit 11a5 is a module that creates a new content video by superimposing (combining) the foreground video output from foreground video output unit 11a3 on the background video output from background video output unit 11a2. As described above, the background video output from background video output unit 11a2 and the foreground video output from foreground video output unit 11a3 each have a preset transparency, so a new content video is created by superimposing these content videos according to their transparency. The created new content video has a transparency set according to the transparency preset for the background video output from background video output unit 11a2 and the foreground video output from foreground video output unit 11a3.

[0081] In this way, the content video and transparency created by the composition unit 11a5 are transmitted to the video switcher 20. In this embodiment, transmission from the composition unit 11a5 to the video switcher 20 is performed via HDMI (High-Definition Multimedia Interface, registered trademark), and the content video information and transparency information are mapped in the composition unit 11a5 so that they fit within 24 bits, and then transmitted to the video switcher 20 via HDMI. This makes it possible to output from the projector 22 a composite video of the content video created by the PC 1 and the video of the video switcher 20 to be superimposed.

[0082] It should be noted that the transmission from the synthesis unit 11a5 to the video switcher 20 is not limited to HDMI, and may be transmitted using other standards. Also, the content video information and transparency information are not limited to being mapped to fit within 24 bits, and may be more or less than 24 bits.

[0083] Next, content table 11b will be described with reference to FIG. 6(b). FIG. 6(b) is a diagram schematically illustrating content table 11b. As shown in FIG. 6(b), content table 11b stores, for each piece of content held by PC 1, i.e., each piece of content arranged in user content area 42 described above in FIGS. 2 and 3, the content data, editing screen data constituting an editing screen for editing the content aspect, and setting data storing the setting state of the content aspect, in association with each other. In addition to the content data, editing screen data, and setting data, video, images, or audio constituting the content video, and video or images constituting editing screen 45, are also stored in association with the content data, editing screen data, and setting data.

[0084] The content data and editing screen data stored in content table 11b will now be described with reference to Fig. 7. Fig. 7(a) is a diagram illustrating the content data, and Fig. 7(b) is a diagram illustrating the editing screen data. As described above, the content data and editing screen data are each written in HTML and stored in content table 11b in the form of text data.

[0085] For example, the content data describes the position (coordinates) and size of images and videos to be placed, and settings for start and end animations, in accordance with HTML. Also, the editing screen data describes the placement of controls for setting the position and size of images and videos included in the target content, and controls for reflecting settings when the placed controls are operated, in accordance with HTML.

[0086] In this embodiment, when a thumbnail button 50a or the like of the content button 50 is selected from the user content area 42 or the like that displays a list of contents, the content data of the corresponding content is loaded to the output units 11a2, 11a3 and interpreted, and the resulting content video is output to the video switcher 20. On the other hand, when the selected thumbnail button 50a or the like is selected again, the output of the content video of the corresponding content to the video switcher 20 is stopped.

[0087] The content data loaded to the output units 11a2 and 11a3 is written in human-readable HTML, which allows user H to easily change the content video structure by directly editing the content data without using any other programs.

[0088] Furthermore, because the editing screen data of editing screen 45 for setting the aspect of the content is also written in human-readable HTML, user H can directly edit the editing screen data to easily change the configuration of editing screen 45 without using other programs, etc. For example, even if user H adds an image to the content video, user H can easily add an operator for setting the aspect of the added image by editing the editing screen data.

[0089] Returning to Figure 5, the communication device 15 is a device that communicates with other information processing devices such as the server 70 via the Internet Nt. Via the communication device 15 and the Internet Nt, the PC 1 acquires content data, editing screen data, and setting data of the content stored in the server 70, as well as video, images, or audio that constitute the content.

[0090] Next, the functions of the PC 1 will be described with reference to Fig. 8. Fig. 8 is a functional block diagram of the PC 1. As shown in Fig. 8, the PC 1 has a list display means 500, a selection means 501, and an output means 502.

[0091] List display means 500 is means for displaying a list of contents, and is realized by the above-mentioned CPU 10. Selection means 501 is means for selecting foreground content and background content different from the foreground content from the list displayed by list display means 500, and is realized by CPU 10. Output means 502 is means for generating a foreground video based on the foreground content selected by selection means 501 and a background video based on the background content selected by selection means 501, and outputting content video with the foreground video as the foreground and the background video as the background of the foreground video to video switcher 20, and is realized by CPU 10.

[0092] That is, a list of contents is displayed, and a content image consisting of a foreground image based on a foreground content selected from the displayed list and a background image based on a selected background content is output to the video switcher 20. This allows a content image consisting of the content desired by the user H to be output to the video switcher 20 at the timing intended by the user H.

[0093] Next, the processing executed by the CPU 10 in accordance with the video output program 11a will be described with reference to Figures 9 to 12. Hereinafter, the sequence diagrams of Figures 9 to 12 will mainly explain the processing contents of the control unit 11a1, output units 11a2 and 11a3, and editing unit 11a4 in the video output program 11a described above in Figure 6(a), and the data flow between these modules.

[0094] 9 is a sequence diagram showing the content start processing. The content start processing is a process in which the user content area 42, etc. is displayed on the display device 4, content is selected by pressing a thumbnail button 50a, etc. in the user content area 42, etc., and content video based on the selected content is output to the video switcher 20.

[0095] The content start process begins with the control unit 11a1 displaying a list of contents, i.e., the preset content area 40 and the user content area 42, on the display device 4 (T1). After the process of T1, the user H acquires the content corresponding to the thumbnail button 50a, 51a or the foreground button 50b, 51b selected via the mouse 2 or the like (T2).

[0096] After the process of T2, the corresponding output unit 11a2, 11a3 is instructed to load the content data of the selected content (T3). Specifically, the content data of the selected content and the video, image, or audio constituting the content video of that content are acquired from the server 70 or the content table 11b. When the thumbnail button 50a, 51a is selected, an instruction to load the acquired content data together with the video, image, or audio constituting the content video of that content is sent to the background video output unit 11a2. When the foreground button 50b, 51b is selected, an instruction to load the acquired content data together with the video, image, or audio constituting the content video of that content is sent to the foreground video output unit 11a3.

[0097] Hereinafter, when the thumbnail buttons 50a, 51a are selected or deselected, the instructions from the control unit 11a1 to the output units 11a2, 11a3 are instructions from the control unit 11a1 to the background video output unit 11a2, and when the foreground buttons 50b, 51b are selected or deselected, the instructions are instructions from the control unit 11a1 to the foreground video output unit 11a3.

[0098] After the process at T3, the editing unit 11a4 is instructed to load the editing screen data of the selected content (T4). Specifically, the editing screen data of the selected content and the video or images constituting the editing screen 45 are acquired from the server 70 or the content table 11b, and an instruction to load the editing screen data together with the acquired editing screen data and the video or images constituting the editing screen 45 is sent to the editing unit 11a4. Note that if the editing screen 45 is not being displayed, the instruction by the process at T4 and the instruction by the process at T9 described below are not issued.

[0099] When output units 11a2 and 11a3 receive the instruction to load by the process of T3, they load the content data transmitted along with the instruction (T5). At this time, the video, image, or audio that constitutes the content video and is transmitted along with the content data is also loaded. After the process of T5, they transmit a notification to control unit 11a1 that the loading of the content data has been completed (T6).

[0100] Furthermore, when the editing unit 11a4 receives an instruction to load the edited screen data transmitted with the instruction in the process of T4, it loads the edited screen data transmitted with the instruction (T7). At this time, the video or image transmitted with the edited screen data is also loaded. After the process of T7, a notification that the loading of the edited screen data has been completed is transmitted to the control unit 11a1 (T8).

[0101] When control unit 11a1 receives a notification that loading from output units 11a2 and 11a3 has been completed by the processing of T6 and a notification that loading from editing unit 11a4 has been completed by the processing of T8, it instructs corresponding output units 11a2 and 11a3 and editing unit 11a4 to load the setting data of the selected content (T9). Specifically, the setting data of the selected content is acquired from server 70 or content table 11b, and an instruction to load the setting data is sent to output units 11a2 and 11a3 and editing unit 11a4 along with the acquired setting data.

[0102] When output units 11a2 and 11a3 receive an instruction to load by processing T9, they load the setting data transmitted along with that instruction (T10). After processing T10, they transmit a notification to control unit 11a1 that the loading of the setting data has been completed (T11). Similarly, when editing unit 11a4 receives an instruction to load by processing T9, they load the setting data transmitted along with that instruction (T12), and transmit a notification to control unit 11a1 that the loading of the setting data has been completed (T13).

[0103] When the control unit 11a1 receives a notification that loading from the output units 11a2 and 11a3 has been completed by processing T11 and a notification that loading from the editing unit 11a4 has been completed by processing T13, it sends an instruction to start outputting the content (T14).

[0104] When output units 11a2 and 11a3 receive an instruction to start outputting content by processing T14, they start creating content video by interpreting the content data loaded by processing T5 while applying the setting data loaded by processing T10. First, if the content data includes a start animation, they interpret the description corresponding to the start animation in the content data to create content video using the start animation, and output it to video switcher 20 via composition unit 11a5 (T15).

[0105] After the process of T15, when the start animation has finished, a message to that effect is sent to control unit 11a1 (T16). Note that if the content data does not include a start animation, the processes of T15 and T16 are skipped.

[0106] After the process of T16, output units 11a2 and 11a3 create a content video to be displayed after the start animation based on the content data, and output the content video to video switcher 20 via composition unit 11a5 (T17). After the process of T17, a message is sent to control unit 11a1 indicating that the content video to be displayed after the start animation is being output (T18).

[0107] The editing unit 11a4 applies the setting data loaded in the process of T12 and interprets the editing screen data loaded in the process of T7, thereby creating an editing screen 45 and outputting it to the display device 4 (T19).

[0108] As explained above, when content is selected in the user content area 42 or the like, the setting data for that content is loaded to the output units 11a2, 11a3 along with the content data, and is applied to the content video based on that content data. This ensures that the content aspect set by user H in the setting data is reflected in the content video from the start of output of the content video.

[0109] Furthermore, the content setting data is loaded to output units 11a2 and 11a3, and the setting data is also loaded to editing unit 11a4 and reflected on editing screen 45. This makes it possible to prevent inconsistencies from occurring between the state of the content video output to video switcher 20 and the settings displayed on editing screen 45.

[0110] Next, referring to Fig. 10(a), the processing when the selection of selected content is deselected will be described. Fig. 10(a) is a sequence diagram showing the content deselection processing. The content deselection processing is processing for displaying an end animation when the selection of content selected in the user content area 42 or the like is deselected.

[0111] In the content deselection process, first, the control unit 11a1 acquires the content corresponding to the thumbnail buttons 50a, 51a and foreground buttons 50b, 51b that have been deselected by the user H via the mouse 2 or the like (T30).

[0112] After the process of T30, an instruction to stop output of the content is transmitted to output units 11a2 and 11a3 that are outputting the deselected content (T31). When output units 11a2 and 11a3 receive the instruction to stop output of the content by the process of T31, if the loaded content data includes an end animation, they interpret the description corresponding to the end animation in the content data to create a content video with the end animation and output it to video switcher 20 via composition unit 11a5 (T32).

[0113] When the closing animation by the process of T32 has ended, the control unit 11a1 is notified that the closing animation has ended (T32). Then, if the loaded content data does not include a closing animation, or after the closing animation has ended, the output units 11a2 and 11a3 stop outputting the content video.

[0114] As described above, when content selection is cancelled, if the content includes an ending animation, the ending animation is output and then the output of the content to the video switcher 20 is stopped. This prevents a situation in which the output of the content to the video switcher 20 is suddenly stopped even though the content includes an ending animation, thereby reducing the sense of discomfort felt by the viewer regarding the content.

[0115] Next, with reference to Figure 10(b), detailed processing when new content is selected when content has already been selected will be described. Figure 10(b) is a flowchart of the content selection processing. The content selection processing is processing executed by CPU 10 periodically (for example, every 100 milliseconds) after the user content area 42, etc. is displayed on display device 4.

[0116] The content selection process first checks whether content has been selected by selecting thumbnail button 50a, 51a, etc. (S1). If content selection is confirmed in the process of S1 (S1: Yes), it is checked whether content data has been loaded to the target output units 11a2, 11a3 (S2).

[0117] Specifically, in the S2 process, when content is selected by selecting thumbnail button 50a, 51a in the S1 process, it is confirmed whether the content data has been loaded to background video output unit 11a2, and when content is selected by selecting foreground button 50b, 51b in the S1 process, it is confirmed whether the content data has been loaded to foreground video output unit 11a3.

[0118] In the process of S2, if it is confirmed that content data has been loaded on the target output units 11a2, 11a3 (S2: Yes), the closing animation included in the content data loaded on the target output units 11a2, 11a3 is output to the video switcher 20 (S3). Note that the processes of S1 to S3 are equivalent to the content selection process of Fig. 10(a). After the closing animation ends, the content data loaded on the target output units 11a2, 11a3 is unloaded from the output units 11a2, 11a3.

[0119] On the other hand, if it is confirmed in the process of S2 that the content data is not loaded on the target output unit 11a2, 11a3 (S2: No), the process of S3 is skipped. Note that the process of S3 is also skipped if the content data loaded on the target output unit 11a2, 11a3 does not include an ending animation.

[0120] After the processes of S2 and S3, it is confirmed whether the new content selected in the process of S1 is the same as the content for which the closing animation was output in the process of S3 (S4). Whether the new content in the process of S3 is the same as the content for which the closing animation was output in the process of S3 may be determined, for example, by whether the identification numbers assigned to each content match, by whether all the images and videos that make up the content match, or by other methods.

[0121] In the process of S4, if the new content is different from the content for which the ending animation was output in the process of S3 (S4: No), the content video of the new content's start animation is output to the video switcher 20 (S5), and after the start animation ends, the content video to be displayed after the start animation is output to the video switcher 20 (S6). Note that the processes of S5 and S6 are equivalent to the content start process of Fig. 9. In the process of S4, if the new content is the same as the content for which the ending animation was output in the process of S3 (S4: Yes), the processes of S5 and S6 are skipped.

[0122] That is, when new content is selected but different content is already loaded and being output on output units 11a2 and 11a3 that output that content, if the already loaded content includes an ending animation, the ending animation is output and then output of the new content begins. This prevents the loaded content from being suddenly switched to the new content, and reduces the sense of discomfort felt by viewers when the content is switched.

[0123] Furthermore, if the content data of the new content is identical to the content already loaded on the corresponding output unit 11a2, 11a3, an ending animation for that content is output, and then the output of that content to the video switcher 20 is stopped. This prevents the same content from being repeatedly output on the same output unit 11a2, 11a3, and reduces the sense of incongruity felt by the viewer regarding the output content.

[0124] After the processes of S1, S4, and S6, the content selection process ends.

[0125] Next, referring to Figure 10(c), a process for switching the editing screen 45 to a screen for editing the aspect of the content of the selected editing button 50c, 51c (see Figure 2) when the editing button 50c, 51c is selected will be described. Figure 10(c) is a flowchart of the editing switching process. The editing switching process is executed by the CPU 10 periodically (for example, every 100 milliseconds) after the user content area 42, etc. is displayed on the display device 4.

[0126] The edit switching process first checks whether the edit button 50c, 51c has been pressed (S10). If it is confirmed in the process of S10 that the edit button 50c, 51c has been pressed (S10: Yes), it checks whether edit screen data has been loaded into the editing unit 11a4 (S11). If it is confirmed in the process of S11 that the edit screen data has been loaded into the editing unit 11a4 (S11: Yes), the edit screen data loaded into the editing unit 11a4 is unloaded (S12). On the other hand, if it is not confirmed in the process of S11 that the edit screen data has been loaded into the editing unit 11a4 (S11: No), the process of S12 is skipped.

[0127] After the processes of S11 and S12, edit screen data for the content corresponding to the edit button 50c, 51c pressed in the process of S10 is obtained from the server 70 or the content table 11b and loaded into the editing unit 11a4 (S13). At this time, the setting data for the content corresponding to the edit button 50c, 51c is also obtained from the server 70 or the content table 11b and loaded into the editing unit 11a4.

[0128] When new editing screen data and setting data are loaded into the editing unit 11a4, an editing screen 45 based on the new editing screen data is created and output to the display device by processing similar to the processing at T19 in Fig. 9. As a result, the editing screen 45 for setting the aspect of the content for which the editing button 50c, 51c was pressed is displayed on the display device 4.

[0129] After the processes of S10 and S13, the edit switching process ends.

[0130] Next, a process for editing the aspect of content using the editing screen 45 will be described with reference to Fig. 11. Fig. 11 is a sequence diagram of the content editing process. In the content editing process, first, when the control unit 11a1 detects an operation on the editing screen 45 by the user H via the mouse 2 or the like, the control unit 11a1 transmits an instruction to change the setting of the aspect of content and information about the changed setting (hereinafter referred to as "changed setting information") to the editing unit 11a4 (T40).

[0131] When editing unit 11a4 receives an instruction to change the settings of the content aspect through the processing of T40 and change setting information, it acquires the change setting information (T41) and changes the aspect of editing screen 45 based on the change setting information (T42). For example, if the position of an image included in the target content is changed, the coordinate values ​​indicating the position displayed on editing screen 45 are changed. After processing of T42, editing unit 11a4 transmits the change setting information to control unit 11a1 (T43).

[0132] When control unit 11a1 receives changed setting information from editing unit 11a4 through the processing of T43, it transmits the changed setting information to corresponding output units 11a2, 11a3 (T44). When output units 11a2, 11a3 receive changed setting information from control unit 11a1 through the processing of T44, they apply the changed setting information to the mode of the content being output to video switcher 20 (T45). After the processing of T45, they transmit a notification to control unit 11a1 that the changed setting information has been applied to the mode of the content being output (T46).

[0133] Furthermore, when the control unit 11a1 receives a notification from the output units 11a2 and 11a3 that the changed setting information has been applied to the aspect of the content being output as a result of the processing in T46, it applies the changed setting information to the corresponding setting data in the server 70 or the content table 11b (T47).

[0134] That is, when the content aspect settings are changed on the editing screen 45, the changed setting information is first reflected in the editing unit 11a4, and then, via the control unit 11a1, the changed setting information is sent to the output units 11a2 and 11a3 and applied to the content being output.

[0135] This allows the setting of the content mode on editing screen 45 to be applied to the content being output in real time. Furthermore, since change setting information for setting the content mode is transmitted to editing unit 11a4 and output units 11a2 and 11a3 via control unit 11a1, it is possible to prevent inconsistencies between the display on editing screen 45 and the mode of the content being output, and since there is no need to provide a communication path for communication between editing unit 11a4 and output units 11a2 and 11a3, it is possible to simply configure editing unit 11a4 and output units 11a2 and 11a3.

[0136] Furthermore, the changed setting information is applied to the corresponding setting data in the server 70 or the content table 11b, so that the current changed setting information can be applied the next time content whose format has been changed is output.

[0137] 12, a description will be given of processing relating to control of the content or editing screen 45 from the MIDI device 5 or the video switcher 20, and processing relating to control of the MIDI device 5 or the video switcher 20 from the content. Fig. 12(a) is a sequence diagram for controlling the content or editing screen 45 from the MIDI device 5 or the video switcher 20.

[0138] When controlling the content or editing screen 45 from the MIDI device 5 or the video switcher 20, the control unit 11a1 first receives a MIDI message from the MIDI device 5 or the video switcher 20 (T60), and then transmits the MIDI message to the output units 11a2, 11a3 and the editing unit 11a4 (T61).

[0139] When the output units 11a2 and 11a3 receive a MIDI message through the processing of T61, they execute processing according to the MIDI message (T62). When the editing unit 11a4 receives a MIDI message through the processing of T61, they execute processing according to the MIDI message (T63).

[0140] An example of the processing of T62 in the output units 11a2 and 11a3 is to display / hide image 1 of a certain content being output by the output units 11a2 and 11a3 when the received MIDI message is control change "CC#0:0." In this case, the processing details, such as displaying / hiding image 1 according to the MIDI message received for the content, can be written in the content data.

[0141] As an example of the processing of T63 in the editing unit 11a4, when the received MIDI message is control change "CC#13:8," the value of operator 1 on a certain editing screen 45 being output by the editing unit 11a4 may be increased or decreased. In this case, the processing content, such as increasing or decreasing the value of operator 1 in accordance with the MIDI message received in the content, can be written in the editing screen data.

[0142] Note that processing of MIDI messages from MIDI device 5 or video switcher 20 is not limited to being performed by output units 11a2, 11a3, or editing unit 11a4, and may also be performed by control unit 11a1. For example, if the received MIDI message is program change "PC:100," control unit 11a1 may perform the same operation as when thumbnail button 50a or foreground button 50b of the content associated with the program change value is operated (the processing from T2 onward in FIG. 9, or the processing from T30 onward in FIG. 10(a)). In this way, when control unit 11a1 performs processing based on the received MIDI message, transmission of the MIDI message to output units 11a2, 11a3 and editing unit 11a4 in the processing of T61 may be omitted.

[0143] In this way, processing according to MIDI messages from the video switcher 20 and the MIDI device 5 is performed by the output units 11a2 and 11a3, so that the user H can easily change the content and editing screen 45 output from the output units 11a2 and 11a3 and the editing unit 11a4 without editing the content data or operating the output units 11a2 and 11a3 and the editing unit 11a4.

[0144] 12(b) is a sequence diagram when content controls the MIDI device 5 or the video switcher 20. When content or the editing screen 45 is controlled from the MIDI device 5 or the video switcher 20, if the content data includes a MIDI message output, the output units 11a2 and 11a3 output the MIDI message (T70) and transmit the output MIDI message to the control unit 11a1 (T71).

[0145] When the control unit 11a1 receives a MIDI message from the output units 11a2 and 11a3 through the process of T71, it transmits the MIDI message to the MIDI device 5 and the video switcher 20 (T72). The MIDI device 5 and the video switcher 20 to which the MIDI message has been transmitted perform processing according to the MIDI message.

[0146] For example, the following process is an example of the process performed by the video switcher 20 in response to a MIDI message. In the video switcher 20, a corresponding control change MIDI message is assigned in advance to each input channel to which the video camera 21 or the like is connected (for example, control change "CC#55:01" is assigned to the input channel to which the video camera 21a of the two video cameras 21 is connected, and control change "CC#55:02" is assigned to the input channel to which the video camera 21b is connected), and the video switcher 20 is set so that, upon receiving a MIDI message, the video camera 21 that acquires the video to be output to the projector 22 is switched to the video camera 21 that corresponds to the received MIDI message.

[0147] When a MIDI message (e.g., control change "CC#55") is created from output units 11a2 and 11a3 based on the description of the content data and transmitted to video switcher 20, video switcher 20 switches the video camera 21 capturing the image to be output to projector 22 to the video camera 21 corresponding to the value set in control change "CC#55" of the received MIDI message (i.e., "00" or "01").

[0148] In this way, by describing in the content data that a MIDI message will be output, sending a MIDI message based on that content data to the MIDI device 5 or the video switcher 20, and performing processing according to the MIDI message received by the MIDI device 5 or the video switcher 20, it is possible to control the MIDI device 5 or the video switcher 20 from the content data.

[0149] This allows, for example, by sending a MIDI message to the video switcher 20 in response to a change in the content aspect, it is possible to output expressive images from the video switcher 20 that combine changes in the content aspect with changes in the processing of the video switcher 20, such as switching the video camera 21.

[0150] The above has been explained based on the above embodiment, but it can be easily imagined that various improvements and modifications are possible.

[0151] In the above embodiment, two content items, a foreground content item and a background content item, can be selected as the content items to be output, but this is not limiting. For example, only one content item may be selected as the content items to be output, or three or more content items may be selected as the content items to be output. Similarly, while the composite content item is composed of two content items, this is not limiting, and the composite content item may be composed of three or more content items.

[0152] In the above embodiment, the content data and editing screen data are written in HTML, but this is not limited to this. The content data and editing screen data may be written in other human-readable formats, such as high-level languages ​​such as C or Python, or, even if not in high-level languages, the content layout, size, etc. may be written according to certain rules. Furthermore, the content data and editing screen data are not limited to being written in HTML; for example, the content data may be written in HTML and the editing screen data may be written in C, or the content data may be written in C and the editing screen data may be written in HTML.

[0153] In the above embodiment, the video output program 11a includes all of the modules, namely, the control unit 11a1, the output units 11a2 and 11a3, the editing unit 11a4, and the compositing unit 11a5. However, this is not limiting. Some of the modules of the video output program 11a may be executed by a separate program. For example, the video output program 11a may include only the control unit 11a1, and the other modules, namely, the output units 11a2 and 11a3, the editing unit 11a4, and the compositing unit 11a5, may be included in one or more other programs.

[0154] In the above embodiment, when the auto tab 44 in Figures 3(a) and 3(b) is selected in the user content area 42, if the sequence is not looped, the contents are switched and output in order from the content selected by user H to the right, but this is not limited to this. For example, the contents may be switched and output in order from the content selected by user H to the right.

[0155] Furthermore, when looping a sequence in the user content area 42 when the auto tab 44 is selected, the contents of the content buttons 50 arranged within the range between the start point designation button 42a or the leftmost content and the end point designation button 42b are output in order from the content of the leftmost content button 50 to the right, but the order in which the contents are output is not limited to this. For example, the contents of the content buttons 50 arranged within the range between the start point designation button 42a or the leftmost content and the end point designation button 42b may be output by switching the contents in order from the content of the rightmost content button 50 to the left, or the contents of the content buttons 50 arranged within the range between the start point designation button 42a or the leftmost content and the end point designation button 42b may be output by switching the contents in random order.

[0156] 12, MIDI messages are used as control signals for controlling the content of the PC 1 from the MIDI device 5 or the video switcher 20, but this is not limiting and other control signals than MIDI messages may be used to control the content of the PC 1 from the MIDI device 5 or the video switcher 20. Similarly, MIDI messages are used as control signals for controlling the MIDI device 5 or the video switcher 20 from the content of the PC 1, but this is not limiting and other control signals such as RS-232C or LAN may be used.

[0157] In the above embodiment, the input source for inputting video to the video switcher 20 is the video camera 21, but this is not limiting and video may be input from other devices such as a game console. Also, video stored (recorded) in the PC 1, the server 70, a video deck, or the like may be input to the video switcher 20.

[0158] In the above embodiment, the pre-created content is stored in the server 70, but this is not limited to this. For example, the pre-created content may be stored in an external memory (not shown) and the external memory may be connected to the PC 1, thereby allowing the PC 1 to acquire the pre-created content. Furthermore, the pre-created content may be stored in the video switcher 20 or another device, and the PC 1 may acquire the pre-created content from these devices.

[0159] In the above embodiment, the video switcher 20 is exemplified as an external device, but the present invention is not limited to this, and other devices that output video to a display device such as a projector 22 may also be used as the external device. Furthermore, a video camera 21 and a projector 22 may be connected to the PC 1, and the functions of the video switcher 20 (external device) may be integrated into the PC 1. Alternatively, the functions of the PC 1 may be integrated into the video switcher 20 by executing the video output program 11a in the video switcher 20.

[0160] Although the PC 11 has been described as an example of a computer that executes the video output program 11a, the present invention is not limited to this. For example, the video output program 11a may be executed by a computer such as a smartphone or a tablet terminal. Alternatively, the video output program 11a may be stored in a ROM or the like, and the present invention may be applied to a dedicated device (tone output device) that executes only the video output program 11a. [Explanation of symbols]

[0161] 1 PC (computer, video output device) 20 Video switcher (external device) 11a Video output program T1 List display step, list display means T2 Selection step, selection means T17 Output step, output method T19 Edit screen display step 50a,51a Thumbnail button (thumbnail) 50b, 51b Foreground buttons (operators)

Claims

1. A video output program that causes a computer connected to an external device to execute a process of outputting content video, which is video created based on content including at least one of video and images, a list display step of displaying a list of the contents; a selection step of selecting a foreground content and a background content different from the foreground content from the list displayed by the list display step; a foreground image based on the foreground content selected in the selection step and a background image based on the background content selected in the selection step, and an output step of outputting to the external device the content image with the foreground image as the foreground and the background image as the background of the foreground image.

2. the list display step displays a thumbnail of each of the content items and at least one operator for each of the content items; 2. The video output program according to claim 1, wherein the selection step, when a thumbnail displayed by the list display step is selected, selects the content corresponding to the selected thumbnail as either foreground content or background content, and when an operator displayed by the list display step is selected, selects the content corresponding to the selected operator as the other of foreground content and background content.

3. 3. The video output program according to claim 2, wherein the selection step, when a thumbnail displayed by the list display step is selected, selects content corresponding to the selected thumbnail as background content, and when an operator displayed by the list display step is selected, selects content corresponding to the selected operator as foreground content.

4. 2. The video output program according to claim 1, wherein the output step outputs the content video in which the foreground video is superimposed on the background video to an external device.

5. 2. The video output program according to claim 1, wherein the foreground content and the background content are configured to be interchangeable with each other.

6. 6. The video output program according to claim 1, wherein a combination of the foreground content and the background content can be set as one of the content.

7. further causing the computer to execute an editing screen display step of displaying an editing screen for editing aspects of the content; 6. The video output program according to claim 1, wherein the editing screen is provided so as to be switchable between a screen for editing the aspect of the foreground content and a screen for editing the aspect of the background content.

8. 8. The video output program according to claim 7, wherein the output step reflects in real time the aspect of the foreground content or the aspect of the background content edited on the editing screen in the background content or the background content being output to the external device.

9. The video output program according to claim 1, characterized in that, if another of the content is selected as the foreground content or background content by the selection step while the content video is being output to the external device, the output step starts outputting the foreground video or background video of the other of the content after completion of termination processing of the corresponding foreground video or background video.

10. The video output program of claim 9, further comprising causing the computer to execute an output stop step of stopping output of the video after completion of termination processing of the corresponding foreground video or background video if the other content selected by the selection step is the same content as the foreground video or background video while the content video is being output to the external device by the output step.

11. 2. The video output program according to claim 1, wherein the output step outputs the content video together with the transparency of the content video to the external device.

12. A sequence is created in which multiple contents are arranged according to the output timing, 2. The video output program according to claim 1, wherein the output step outputs a content video of the target content to an external device based on a timing set in the sequence.

13. A video output device that outputs content video, which is video created based on content including at least one of video and image, a list display means for displaying a list of the contents; a selection means for selecting a foreground content and a background content different from the foreground content from the list displayed by the list display means; a video output device comprising: an output means for generating a foreground image based on the foreground content selected by the selection means and a background image based on the background content selected by the selection means, and outputting the content image with the foreground image as the foreground and the background image as the background of the foreground image to an external device.

14. A video output method for outputting a content video, which is a video created based on content including at least one of a video and an image, comprising: a list display step of displaying a list of the contents; a selection step of selecting a foreground content and a background content different from the foreground content from the list displayed by the list display step; a step of generating a foreground image based on the foreground content selected in the selection step and a background image based on the background content selected in the selection step, and outputting the content image with the foreground image as the foreground and the background image as the background of the foreground image to an external device.

Images