Comparison moving image generation system, moving image generation program and moving image generation method utilizing artificial intelligence

Abstract

To provide novel technique generating a moving image that enables a comparison between details of plural pieces of content.SOLUTION: The present invention relates to a comparison moving image generation system that utilizes artificial intelligence. The moving image generation system comprises an acquisition part and a generation part, and stores comparison source moving image data including first explanation information related to an object to be explained in a moving image in a database. The acquisition part acquires comparison object data including second explanation information related to a comparison object, and the generation part inputs the first explanation information and the second explanation information to generative artificial intelligence, performs generation processing on the comparison explanation information, and generates a comparison moving image based upon the comparison explanation information and the comparison source moving image data.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a comparative video generation system, a video generation program, and a video generation method that utilize artificial intelligence. [Background technology]

[0002] Conventionally, there have been known techniques for editing videos by uploading video content. For example, Patent Document 1 proposes an example of a technique for joining multiple video contents into a single video content.

[0003] Patent document 1 discloses a method for identifying sources associated with video clips uploaded by users to a content hosting site or service, and if the video clip contains content such as a movie, identifying the movie or the like as the source based on a comparison of the video clip with sources in a source data store, creating a transcript (or classification data) of the video clip based on the subtitle text of the video clip or voice recognition technology, identifying a set of video clips having related content based on the classification data, and stitching the set of video clips together into a single integrated video according to the order of an ordering parameter, and if there is overlapping content, stitching the video clips together so that the overlapping portions are included in the other video clips. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Special Publication No. 2016-500218 Summary of the Invention [Problem to be solved by the invention]

[0005] However, while the invention described in Patent Document 1 can connect multiple related video contents to generate a single video content based on the classification data of the uploaded video content, it cannot display the contents of the video content in a comparable manner.

[0006] In view of the above circumstances, an object of the present invention is to provide a novel technique for generating moving images that allow the details of multiple pieces of content to be compared. [Means for solving the problem]

[0007] In order to solve the above problems, the present invention provides a comparison video generation system that utilizes artificial intelligence, which includes an acquisition unit and a generation unit, and stores comparison source video data including first explanatory information regarding an object described in the video in a database, the acquisition unit acquires comparison target data including second explanatory information regarding the comparison object, and the generation unit inputs the first explanatory information and the second explanatory information into a generation artificial intelligence to generate comparison explanatory information and generate a comparison video based on the comparison explanatory information and the comparison source video data.

[0008] With this configuration, a comparison video can be generated by inputting the first explanatory information of the comparison source video stored in the database and the second explanatory information of the acquired comparison target data into the generating artificial intelligence to generate comparison explanatory information. By using the generating artificial intelligence, even if there are differences in notation between the first explanatory information and the second explanatory information, a comparison video can be generated in which the notation is appropriately integrated.

[0009] In a preferred embodiment of the present invention, the generation section acquires data corresponding to the comparison explanation information from an external database, and generates the comparison video displaying the data.

[0010] With this configuration, the user can obtain more detailed information by retrieving not only the information obtained by inputting it into the generating artificial intelligence, but also related information from the database.

[0011] In a preferred form of the present invention, the comparison video generation system utilizing artificial intelligence further includes a display processing unit and an update unit, wherein the display processing unit publicly displays the comparison source video, and the update unit updates the comparison source video or the comparison video based on an evaluation of the comparison video from an administrator who manages the comparison source video data.

[0012] With this configuration, the comparison source video or the comparison video is updated according to the evaluation from the administrator of the comparison source video, and it is possible to prevent an inappropriate video from being generated in the comparison video.

[0013] In a preferred form of the present invention, the generation unit accepts a specification of the timing of the comparison source video data, inputs the first explanatory information to be displayed at the specified timing and the acquired second explanatory information into the generation artificial intelligence, processes and generates the comparison explanatory information, and generates the comparison video in which the first explanatory information to be displayed at the specified timing and the comparison explanatory information are associated.

[0014] With this configuration, by specifying the timing of the comparison source video data and generating the comparison explanation information, it is possible to associate the first explanation information at the specified timing with the comparison explanation information.

[0015] In a preferred form of the present invention, the comparison video generation system utilizing artificial intelligence further includes an identification unit that identifies the timing in the comparison source video at which the first explanation information corresponding to the generated comparison explanation information is displayed, and the generation unit generates the comparison video that displays the comparison explanation information and the first explanation information at that timing.

[0016] With this configuration, the timing of the comparison source video at which the comparison explanation information is to be displayed can be specified without the user having to specify it.

[0017] In a preferred embodiment of the present invention, the generating section generates the comparison moving image in which the comparison explanation information is displayed superimposed on the first explanation information.

[0018] With this configuration, the first explanatory information and the comparative explanatory information can be displayed superimposed on the screen, allowing the user to check the first explanatory information and the comparative explanatory information with minimal eye movement.

[0019] In a preferred embodiment of the present invention, the generation section generates a comparison video that switchably displays the content of the first explanatory information and the content based on the comparative explanatory information.

[0020] This configuration allows the display of the content of the first explanatory information and the content based on the comparative explanatory information to be switched on and off, making it possible to accommodate both cases where you want to see only the first explanatory information and cases where you want to see the content based on the comparative explanatory information.

[0021] In a preferred embodiment of the present invention, the generation section generates the comparison video in which the comparison explanation information is arranged by dividing a screen in accordance with the number of the acquired comparison target data.

[0022] This configuration allows the comparison video screen to be divided according to the number of comparison target data items acquired, and the content and indicators of the comparison source video are arranged in a way that is easier for the user to see, making it easier for the user to compare the comparison targets.

[0023] In a preferred embodiment of the present invention, the generating section generates a graph based on the comparative explanatory information when the first explanatory information and the second explanatory information include numerical data formats.

[0024] By configuring in this manner, if the first explanatory information and the second explanatory information in the comparison video include numerical data formats, a graph based on the comparative explanatory information is displayed, allowing the user to more easily confirm the comparative explanation. [Effects of the Invention]

[0025] The present invention can provide a novel technique for generating a comparison video that allows the content of multiple pieces of content to be compared. [Brief explanation of the drawings]

[0026] [Figure 1] 1 is a block diagram showing a configuration of a system according to an embodiment of the present invention. [Figure 2] FIG. 1 is a hardware configuration diagram of a system according to an embodiment of the present invention. [Figure 3] FIG. 1 is a functional block diagram according to an embodiment of the present invention. [Figure 4] 10 is an example of a process flowchart for generating a comparison video according to an embodiment of the present invention. [Figure 5] 10 is an example of a comparison video generated in one embodiment of the present invention. [Figure 6] 10 is an example of a comparison video generated in one embodiment of the present invention. [Figure 7] 10 is an example of a comparison video generated in one embodiment of the present invention. [Figure 8] 10 is a diagram illustrating an example of a comparison video to be played in one embodiment of the present invention. [Figure 9] FIG. 10 is a diagram relating to generation of a comparison video in another embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0027] The present invention will be described in more detail below with reference to the accompanying drawings, in which preferred embodiments are shown, but which may be embodied in many different forms and are not limited to the embodiments set forth herein.

[0028] For example, although the present embodiment describes the configuration, operation, etc., of a comparative video generation system utilizing artificial intelligence, similar effects can be achieved by an executed method, device, computer program, etc. Furthermore, the program may be stored on a recording medium. Using this recording medium, the program can be installed on a computer, for example, thereby configuring a comparative video generation device and a comparative video generation system utilizing artificial intelligence. Here, the recording medium storing the program may be a non-transitory recording medium, such as a CD-ROM.

[0029] The present invention relates to a system for generating a comparison video that can compare the data of a comparison source video viewed by a user with the content of acquired comparison target data. In the present invention, the comparison source video data is a video explaining the comparison target, and the comparison target data is a file related to the comparison target. The comparison target in this embodiment is the object to be compared and includes information about the company (e.g., management policy, product description, security policy, sales explanation, training materials, etc.) and information about individual products. Specifically, if the comparison target is a company's management policy, the management policies of two different companies are compared. If the comparison target is a company's product description, descriptions of two different products from the same company or descriptions of the same two products from different companies are compared. Furthermore, the file related to the comparison target includes, for example, content to be compared with the comparison target. Furthermore, in the present invention, the comparison source video is a video file such as HTML5, but may be in a file format such as MP4. Furthermore, the comparison target data is text data and / or image data, but may also be a video file such as HTML5 or MP4.

[0030] In this embodiment, an instruction to generate a comparison video is received from a user who has viewed the comparison source video, and the comparison source video data and comparison target data are input into a generation artificial intelligence, thereby generating information (language data and / or image data) regarding the comparison results of the contents of the comparison source video data and the comparison target data.The comparison video is then generated based on the information regarding the comparison source video and the comparison results.More specifically, the comparison video is generated by adding the generated information regarding the comparison results to the comparison source video.

[0031] Here, the generative artificial intelligence is a model that learns on its own based on a huge amount of data, and generates output data based on the input of text data, image data, or audio data related to the data to be output. For example, text or images are generated as output data. Here, the output text may include program code such as a script, or text data written in a specific format such as CSV. In this embodiment, the generative artificial intelligence receives input of source video data and target data, and generates output data containing information regarding the comparison results of these contents.

[0032] In addition, in this embodiment, the generative artificial intelligence is a large-scale language model such as a GPT (Generative Pretrained Transformer), but there are no restrictions on its scale or model structure, and it may be other language models that combine one or more models, such as a convolutional neural network (CNN); a recurrent neural network (RNN) such as an LSTM (Long short-term memory) or a GRU (Gated recurrent unit); or a Transformer model.

[0033] <1. System configuration> Fig. 1 is a block diagram showing the configuration of a system according to one embodiment. As shown in Fig. 1, a comparison video generation system 0 utilizing artificial intelligence includes a comparison video generation device 1, a user terminal device 3, and an administrator terminal device 4, and is configured to be able to communicate via a communication network NW. In this embodiment, the communication network NW is an IP (Internet Protocol) network, but there are no limitations on the type of communication protocol, and there are also no limitations on the type or scale of the network.

[0034] A general-purpose server computer or a personal computer can be used as the comparison video generating device 1. Furthermore, a smartphone, a tablet terminal, a personal computer, a wearable device, or the like can be used as the user terminal device 3 and the administrator terminal device 4. Furthermore, the comparison video generating device 1 may be configured by a plurality of computers that are capable of sending and receiving information via a communication network NW or another network.

[0035] <1.1. Hardware Configuration> 2 is a hardware configuration diagram of a comparative video generation system 0 utilizing artificial intelligence. As shown in FIG. 2(a), a server 10 (comparative video generation device 1) includes a processing unit 101, a storage unit 102, and a communication unit 103.

[0036] The processing unit 101 has one or more processors such as a CPU capable of executing an instruction set, and controls the overall operation and processing of the comparative video generation device 1 by executing the comparative video generation program according to the present invention, an OS, and other applications. The storage unit 102 has a volatile memory such as a RAM capable of storing an instruction set, and a non-volatile recording medium such as an HDD or SSD capable of recording an OS and a comparison video generating program according to the present invention. The communication unit 103 has a communication interface device with the communication network NW, and controls communication with the network NW to input and output information.

[0037] As shown in FIG. 2(b), the terminal device 9 (user terminal device 3 and administrator terminal device 4) includes a processing unit 91, a storage unit 92, a communication unit 93, an input unit 94, and an output unit 95.

[0038] The processing unit 91 has one or more processors such as a CPU that can execute an instruction set, and controls the overall operation and processing of the terminal device 9 by executing an OS and other applications. The storage unit 92 includes a volatile memory such as a RAM capable of storing an instruction set, and a non-volatile recording medium such as an HDD or SSD capable of recording an OS and the like. The communication unit 93 has a communication interface device for connecting to a network, and controls communication with the network NW to input and output information. The input unit 94 has an input device capable of input processing, such as a keyboard or a touch panel. The output unit 95 has a display device capable of display processing, such as a display.

[0039] <1.2. System Functional Configuration> Fig. 3 is a functional block diagram of the comparison video generating device 1. As shown in Fig. 3, the comparison video generating device 1 includes an acquisition unit 11, a generation unit 12, a registration unit 13, an update unit 14, a display processing unit 15, and a database 2. This is information processing by software (stored in a storage unit 102) specifically realized by hardware (processing unit 101).

[0040] The system configuration in this embodiment is a so-called server-client type in which the user terminal device 3 (client) receives the processing results performed by the comparison video generation device 1 (server) in response to a request from the client. Alternatively, the system may be a so-called standalone type in which a comparison video generation program is started on the client terminal. In this case, the user terminal device 3 may include some or all of the functional components (units) included in the comparison video generation device 1. For example, the user terminal device 3 may include an acquisition unit 11, a generation unit 12, a registration unit 13, an update unit 14, a display processing unit 15, and the like.

[0041] <1.3.Database 2> The database 2 stores comparison source video data and comparison video information. All of this information may be stored in the storage unit 102, or some or all of it may be stored in the storage unit 92.

[0042] <1.3.1. Source video data for comparison> The comparison source video data is information about the comparison source video that explains the comparison target. The comparison source video data includes a comparison source video ID that uniquely identifies the comparison source video, a comparison source video name, comparison source video content information, and a video administrator. Here, the comparison source video content information is information about the video and audio of the comparison source video, and includes first explanation information related to the comparison target explained in the comparison source video, multiple combinations of timing for displaying the first explanation information, and information specifying the display mode of the first explanation information (coordinates, height, width, transparency, etc.). In this embodiment, the first explanation information includes content (image, audio, and / or text), content attributes (features, functions, price, etc.), and attribute type (data type).

[0043] In this embodiment, still images are used as the video, and the video is in a slideshow format (video in which still images are switched sequentially) in which audio based on the still images is played, and the slide number of the video or the playback time (the time elapsed from the time playback started) is used as the timing. The comparison source video may also be a video in a format in which continuously changing still images are switched at high speed to display the video (a general video file in an existing video format, etc.), in which case the playback time of the video is associated with the timing.

[0044] <1.3.2. Comparison video information> The comparison video information is information about the generated comparison video. The comparison video information includes a comparison video ID that uniquely identifies the comparison video, a comparison source video ID, comparison video content information, and a creation date, and is stored in association with the user who created it. The content information of the comparison video is information that adds comparison explanation information generated by the generation unit 12 to the comparison source video content information. Here, the comparison explanation information is information about the comparison result of the first explanation information and the second explanation information, and includes data about the comparison result itself (language data (text data and audio data), image data, and graph display data) and data for displaying the comparison result in the comparison video (mapping data). The comparison result may be only data (language data and / or image data) based on the content of the second explanation information corresponding to the first explanation information, or data (language data and / or image data) based on both the content of the first explanation information and the content of the second explanation information that are related to each other.

[0045] <1.4. Acquisition part 11> The acquisition unit 11 acquires comparison target data from a user or a database. The acquisition unit 11 acquires comparison target data including second explanation information related to an object explained in the video. Here, the second explanation information includes content (image, audio, and / or text), content attributes (features, functions, price, etc.), and attribute type (data type). The database may be the database 2, a database of the user terminal device 3 or the administrator terminal device 4, or an external database connected for wired or wireless communication.

[0046] <1.5.Generation part 12> The generation unit 12 generates a comparison video using the first explanation information, the second explanation information, and the generation artificial intelligence. The generation unit 12 inputs the first explanation information and the second explanation information into the generation artificial intelligence, and processes the generation of comparison explanation information. Then, the generation unit 12 generates a comparison video based on the comparison source video data and the comparison explanation information.

[0047] The generation process in this embodiment involves sending a comparative explanation request including at least the first explanation information and the second explanation information to a generation artificial intelligence external to the system, and obtaining the generated comparative explanation information. Alternatively, the system may have a generation artificial intelligence, and the generation artificial intelligence may generate the comparative explanation information. Here, if the generation artificial intelligence is an LLM, a comparative explanation request including a prompt in addition to the first explanation information and the second explanation information is sent to the generation artificial intelligence.

[0048] In this embodiment, the generation unit 12 generates image data as comparative explanatory information by inputting the first explanatory information and the second explanatory information to the generation artificial intelligence, and generates a comparative video based on the generated images. Alternatively, the generation unit 12 may generate text data for displaying image data as comparative explanatory information, and generate a comparative video using image data based on the generated text data. The generation unit 12 may also acquire data corresponding to the comparative explanatory information from a database and generate a comparative video displaying the data. Specifically, the generation unit 12 generates text data as comparative explanatory information, acquires image data corresponding to the text data from a database, and generates a comparative video displaying a combination of the text data and the image data. The database may be the database 2 of this system or an external database that can be communicated with.

[0049] <1.6. Registration Section 13> The registration unit 13 stores the comparison video in the database 2. The registration unit 13 stores the comparison video information in association with the user who instructed the generation of the comparison video, in accordance with an evaluation of the generated comparison video received from the user.

[0050] <1.7. Update part 14> The update unit 14 updates the comparison source video or the comparison video according to an evaluation of the generated comparison video from an administrator linked to the comparison source video data.

[0051] <1.8. Display Processing Unit 15> The display processing unit 15 performs display processing on the comparison source video and the comparison video, and displays the display processing results on the user terminal device 3 or the administrator terminal device 4. Specific display details will be described later.

[0052] In this embodiment, the display process refers to a process in which the display processing unit 15 executes a process of generating information required for display, and transmits the generated information to the terminal device 9, thereby causing the terminal device 9 to display the generated information. On the other hand, in the case where the display processing unit 15 is provided in the terminal device 9 (in the case of a stand-alone type), the display process may be a process in which the display processing unit 15 executes a process of generating required information, and transmits the generated information to the output unit 95 of the terminal device 9, thereby causing the output unit 95 to display the generated information.

[0053] <2. How to generate videos> A comparison video generation method using the comparison video generation system 0 utilizing artificial intelligence will be described with reference to Figures 5 to 9. Figure 5 is a flowchart showing the process in which the comparison video generation system 0 utilizing artificial intelligence receives an instruction to generate a comparison video from a user who has viewed a comparison source video, generates a comparison video by acquiring comparison target data, and displays the generated comparison video to a third party. Note that the following description will be given using a slide video as the comparison source video, but the same applies to general video files.

[0054] <2.1. Displaying the source video for comparison> First, in step S1 (hereinafter, "step SX" will be simply referred to as "SX"), the display processing unit 15 receives from the user a designation of a comparison source video (slide video) that the user wishes to view, and performs display processing of the comparison source video. In this embodiment, the display processing unit 15 displays the slide video based on the text data and / or image data of the slide.

[0055] <2.2. Timing specification reception> In S2, the generation unit 12 receives an instruction to generate a comparison video from a user who has viewed the slide video, and receives a specification of the timing to display the comparison explanation information. In this embodiment, the generation unit 12 receives an instruction to generate a comparison video from a user for the displayed slide video, and receives the slide number of the displayed slide as the timing. Note that the timing may be received so that any slide number can be specified.

[0056] <2.3. Acceptance of designation of comparison mode> In S3, the generation unit 12 receives a designation of a comparison mode that indicates a display mode of the comparison explanation information. In this embodiment, the generation unit 12 receives the designation of a comparison mode that includes an "explanation of the difference in the comparison result," a "graph of the difference in the comparison result," and an "answer to the question item."

[0057] <2.4. Acquiring comparison data> In S4, the acquisition unit 11 acquires the comparison target data. In this embodiment, the acquisition unit 11 acquires the comparison target data including second explanatory information different from the first explanatory information of the comparison source video from the user who viewed the slide video in S1. Note that in this embodiment, the comparison source video and the comparison target data are different data, but the comparison source video and the comparison target data may be the same data. In other words, the first explanatory information and the second explanatory information may be included in the comparison source video.

[0058] <2.5. Generation of comparative explanation information> In S5, the generation unit 12 generates comparative explanatory information using a generation artificial intelligence. In this embodiment, the generation unit 12 inputs the second explanatory information and the first explanatory information included in the slide having the slide number specified in S2 into the generation artificial intelligence, whereby the content attributes of the first explanatory information obtained from the text data and / or image data for displaying the slide video played in S1 are compared with the content attributes of the second explanatory information obtained from the text data and / or image data of the comparison target data acquired in S3, and obtains comparative explanatory information for explaining the difference between the first explanatory information and the second explanatory information as the comparison result. Specifically, the generation unit 12 generates mapping data indicating the correspondence between the content of the first explanatory information and the content of the second explanatory information, and language data and / or image data related to the explanation of the difference between the first explanatory information and the second explanatory information, as the comparative explanatory information.

[0059] <2.6. Creating comparison videos> In S6, the generation unit 12 generates a comparison video based on the comparison explanatory information and the first explanatory information of the comparison source video data. In this embodiment, the generation unit 12 generates a comparison video in which the first explanatory information to be displayed on the slide with the slide number specified in S2 and the language data and / or image data of the comparison explanatory information generated in S5 are associated, based on the mapping data generated in S5.

[0060] <2.6.1. Example of a comparison video: Comparison explanation using text> FIG. 5 shows an example of a series of screens displayed until a comparison video is generated when "explanation of differences in comparison results" is specified as the comparison mode. On a slide with a certain slide number (FIG. 5(a)) displayed on the user terminal device 3 of a user viewing a slide video, an input of "compare" is accepted from the user as an instruction to generate a comparison video, and a slide number is accepted. Then, a screen (FIG. 5(b)) for accepting the specification of the comparison mode is displayed superimposed on the slide video. Then, when the specification of "explanation of differences in comparison results" (in the illustrated example, "perform a comparison and listen to an explanation of the differences") is accepted from the user as the comparison mode, a screen (FIG. 5(c)) for acquiring the comparison target data is displayed. Then, by accepting an upload of the comparison target data from the user, a comparison video (FIG. 5(d)) is generated and displayed on the user terminal device 3.

[0061] In this embodiment, when "explanation of the difference in the comparison result" is specified as the comparison mode, text data (character strings such as functional features, price, etc.) explaining the difference between the first explanatory information and the second explanatory information generated by the generation unit 12 as comparison explanatory information is displayed superimposed on the first explanatory information displayed on the slide with the specified slide number, and a comparison video is generated in which audio data corresponding to the text data is played. In the illustrated example, text (text data) explaining the difference between the first explanatory information and the second explanatory information is generated as text data explaining the difference between the first explanatory information and the second explanatory information, and the text (text data) of the content of the second explanatory information corresponding to the content of the first explanatory information is displayed superimposed on the first explanatory information of the slide video.

[0062] In addition, in this embodiment, the content of the first explanatory information and the content of the second explanatory information are arranged adjacent to each other, but the text of the first explanatory information and the text of the second explanatory information may be arranged so that they partially overlap. Alternatively, a comparison video may be generated in which the content of the first explanatory information and the content of the second explanatory information are displayed on the same screen. Specifically, a comparison video may be generated that includes slides in which the content attributes (functions, features, price, etc.) of the first explanatory information are arranged adjacent to the content attributes of the second explanatory information. In another specific example, a comparison video may be generated in which slides displaying the content attributes of the first explanatory information and the content attributes of the second explanatory information are divided vertically or horizontally, and the content attributes of the first explanatory information are arranged on one side and the content attributes of the second explanatory information are arranged on the other side.

[0063] <2.6.2. Example of a comparison video: Comparison explanation using graphs> Fig. 6 shows an example of a series of screens displayed until a comparison video is generated when "Graph of differences in comparison results" is specified as the comparison mode. The operation explanations for Figs. 6(a) and 6(c) are the same as those for Figs. 5(a) and 5(c), and therefore will be omitted. When the user specifies "Graph of differences in comparison results" as the comparison mode on the screen (Fig. 6(b)) for accepting the specification of the comparison mode (in the illustrated example, "Perform a comparison and display the differences in a graph") and the comparison target data is acquired, a comparison video (Fig. 6(d)) is generated and displayed on the user terminal device 3.

[0064] In this embodiment, when a "graph of the difference in the comparison results" is specified as the comparison mode, a graph based on the comparison explanation information is generated. When the first explanation information and the second explanation information include a numerical data format, the generation unit 12 generates graph display data as the comparison explanation information and generates a graph based on the graph display data. Specifically, the generation unit 12 generates a graph arranged for each content attribute of the first explanation information and the second explanation information (in the illustrated example, sales, number of contracts, operating profit, and ordinary profit) based on the graph display data. Then, the generation unit 12 generates a comparison video including a slide displaying the graph as a new slide. Note that the generation unit 12 may generate image data of the graph as the comparison explanation information.

[0065] <2.6.3. Example of a comparison video: Answers to questions> 7 shows an example of a series of screens displayed until a comparison video is generated when "answer to question items" is specified as the comparison mode. The operation explanations for FIGS. 7(a) and 7(c) are the same as those for FIGS. 5(a) and 5(c), and therefore will be omitted. When the user specifies "answer to question items" (in the illustrated example, "listen to answers to question items") as the comparison mode on a screen (FIG. 7(b)) for accepting the specification of the comparison mode and comparison target data including the questions is acquired, a comparison video (FIG. 7(d)) ​​is generated and displayed on the user terminal device 3.

[0066] In this embodiment, when "answers to questions" is specified as the comparison mode, comparative explanatory information including answers to the content (questions) of the second explanatory information is generated. Specifically, the generation unit 12 inputs the second explanatory information including the questions and the first explanatory information into the generation artificial intelligence, thereby generating comparative explanatory information in which the questions of the second explanatory information and answers to the questions (language data and / or graph display data) based on the content of the first explanatory information are associated with each other, and generates a comparative video that displays new slides based on the comparative explanatory information.

[0067] The above is an example of a display screen of the generated comparison video, but in this embodiment, the content including the first explanation information and the content based on the comparison explanation information associated with the first explanation information are displayed in a switchable manner. Specifically, the generation unit 12 generates a comparison video in which the content based on the comparison explanation information displayed superimposed on the content of the first explanation information can be switched on / off.

[0068] In addition, the generation unit 12 generates a comparison video in which slides can be switched by transitioning between slides of the content of the first explanation information and slides of content based on the comparison explanation information associated with the content of the first explanation information.

[0069] The generation unit 12 may also generate a comparison video displaying one avatar explaining the comparison explanatory information or two or more avatars interactively explaining the comparison video. When the comparison source video includes an avatar, the generation unit 12 may generate the comparison video based on the avatar displayed in the comparison source video. Specifically, the generation unit 12 acquires master information of the avatar associated with the comparison source video or elements of the avatar displayed in the comparison source video, and generates a comparison video displaying an avatar based on the master information or elements. In this case, when displaying slides of content based on the first explanatory information and slides of content based on the comparison explanatory information associated with the content in a transitional manner, the generation unit 12 may display an avatar in the content based on the comparison explanatory information based on the avatar displayed in the comparison source video. When the comparison video is divided and displayed as described below, one avatar may be displayed for one piece of content, or the number of avatars may vary depending on the number of slide divisions. When generating a comparison video displaying an avatar, the generation unit 12 may generate a script for generating synthetic voice to be spoken by the avatar as the comparison explanatory information. Furthermore, when two or more avatars are displayed, the script and comparison explanation information of the comparison source video may be associated with each avatar, and a comparison video may be generated that displays an avatar that speaks based on the associated script. Note that when the comparison source video does not include an avatar, the generation unit 12 may generate a comparison video that displays an avatar.

[0070] <2.7.Editing Reception> Then, in S7, the generated comparison video is edited by the user. Specifically, the text data of the generated comparison explanation information is displayed in an editable manner, and an editing unit (not shown) accepts input from the user regarding editing of the text data. The generation unit 12 then updates the comparison video based on the edited text data.

[0071] <2.8. Registration of comparison videos> In S8, the registration unit 13 stores the comparison video in the database 2 depending on whether or not a GOOD rating has been received for the comparison video from a user who has viewed the comparison video. If a GOOD rating has been received for the comparison video (YES in S8), the registration unit 13 stores the comparison video in S9. On the other hand, if a GOOD rating has not been received for the comparison video (NO in S8), the processing ends.

[0072] <2.9. Public display of comparison videos> In S10, the update unit 14 updates the comparison source video depending on whether or not a GOOD rating has been received from an administrator linked to the comparison source video that was the basis for the comparison video viewed by the user. If a GOOD rating has been received for the comparison video from the administrator (YES in S10), the update unit 14 updates the comparison source video in S11 and makes the comparison video generated in S6 displayable to third parties. On the other hand, if a GOOD rating for the comparison video has not been received from the administrator (NO in S10), the processing ends.

[0073] As described above, by executing the processes of S1 to S11, a comparison video is generated, the comparison source video is updated, and a comparison video based on the comparison source video becomes viewable. FIG. 8 shows an example of how the generated comparison video is displayed when it is played. In the illustrated example, an interactive button ("Show Graph" in the illustrated example) is added to slide number B of the played comparison video for displaying a new slide based on the comparison explanatory information corresponding to the first explanatory information displayed on the slide with slide number B. Pressing the interactive button allows the comparison video to transition from the slide displaying the content of the first explanatory information to a slide displaying content based on the comparison explanatory information. In this embodiment, an interactive button for displaying a slide displaying the first explanatory information corresponding to the comparison explanatory information is displayed on the slide displaying content based on the comparison explanatory information. By accepting the interactive button ("End Viewing" in the illustrated example) from the user, the slide displaying the content of the first explanatory information is displayed. Note that when the playback time of the slide displaying the first explanatory information corresponding to the comparison explanatory information ends, the slide displaying the comparison explanatory information may cease to be displayed, and the next slide of the comparison video may be displayed. When the second explanatory information is a slide video, the slide displaying the second explanatory information corresponding to the first explanatory information is used as comparative explanatory information, and the comparative explanatory information is displayed switchably from the slide of the first explanatory information, and the video of the slide is played. Then, when the video of the slide displaying the second explanatory information ends, the next slide of the comparative video is displayed.

[0074] In addition, when an instruction to generate a further comparison video is received from a user who has viewed the comparison video, S2 to S11 are executed, the comparison video viewed by the user is updated, and a comparison video based on the comparison video becomes viewable. Specifically, the acquisition unit 11 acquires further comparison target data from the user who viewed the comparison video. Then, the generation unit 12 inputs the comparison source video data, at least one second explanation information of one or more comparison target data acquired before the acquired comparison target data, and the second explanation information of the further acquired comparison target data into the generation artificial intelligence to generate comparison explanation information. Then, the update unit 14 updates the comparison video generated based on the comparison explanation information and the comparison video in accordance with evaluations from the user who instructed to generate the comparison video and the administrator of the comparison source video on which the comparison video was based. In other words, when a user uploads new comparison target data to a comparison video viewed by the user, a comparison video is generated that displays, in addition to one or more comparison explanation information displayed in the comparison video, comparison explanation information based on the comparison target data uploaded by the user.

[0075] In a preferred embodiment of the present invention, a comparison video is generated in which the screen is divided according to the number of acquired comparison target data and the comparison explanation information is arranged on the screen. Specifically, for example, if three comparison target data are acquired, the comparison video slide is divided into four parts, vertically and horizontally, and the content related to the first explanation information and the content related to the three pieces of second explanation information included in the comparison explanation information are arranged and displayed in each divided block so as not to overlap. In a further preferred embodiment, if more than a predetermined number of comparison target data are acquired, the acquired comparison target data may be prevented from being used in the process of generating the comparison explanation information in chronological order.

[0076] In a preferred embodiment, when additional comparison data is received for a comparison video that has already been published, the acquisition unit 11 acquires different second explanatory information from the database each time the acquired information is different. Specifically, the acquisition unit 11 inputs the second explanatory information uploaded by the user and stored in the database and the first explanatory information into the generation artificial intelligence, thereby acquiring second explanatory information from the database that includes content that is better than or similar to the content of the first explanatory information and the second explanatory information of the comparison video that has already been published. The generation unit 12 then inputs the acquired second explanatory information and the first explanatory information into the generation artificial intelligence, thereby generating a comparison video. For example, FIG. 9 is a diagram showing how a comparison video is generated by acquiring different information. In the left diagram of the illustrated example, second explanatory information including product B as content is acquired from the database, and a comparison video is generated and published. On the other hand, in the right-hand diagram of the illustrated example, second explanatory information including product C as content is obtained from the database as second explanatory information including content that is better or more similar to the first explanatory information including product A as content and the second explanatory information including product B as content, and a comparison video is generated.

[0077] Here, the process of acquiring second explanatory information that includes better content than the content of the first explanatory information is a process of acquiring second explanatory information that includes better content, in which a numerical value is assigned to each content attribute and the numerical value obtained by substituting each numerical value into a multiple regression model having a weighting coefficient for each content attribute is larger than the numerical value of the first explanatory information and other second explanatory information. Also, the process of acquiring second explanatory information that includes similar content than the content of the first explanatory information is a process of acquiring second explanatory information that includes more similar content, in which the difference between the numerical value obtained by substituting each numerical value assigned to each content attribute of the second explanatory information into a multiple regression model having a weighting coefficient for each content attribute and the numerical value obtained from the first explanatory information is smaller than the difference between the other information.

[0078] Furthermore, in this embodiment, instead of accepting a specification of the comparison mode, an instruction to generate a summary and / or details of the comparison source video can be accepted, thereby generating a comparison video that displays a summary and / or details of the comparison source video. Specifically, by accepting a specification of "summary or detailed analysis of the comparison source video" (in the example of Figure 5(b) , "listen to a summary explanation of the question items" or "listen to a detailed explanation of the question items"), the generation unit 12 inputs the text and / or image of the first explanatory information to be displayed on the slide with the specified slide number into the generation artificial intelligence. The generation unit 12 then generates a comparison video that displays slides that display the obtained summary and / or details of the first explanatory information in a manner that allows transitions from the slide with the specified slide number.

[0079] Furthermore, in this embodiment, by receiving an instruction to fill in the blanks on a checklist, if the content of the comparison source video contains content corresponding to the checklist items received as comparison target data, the checklist can be filled in and a comparison video can be generated that displays the content corresponding to the filled-in items. Specifically, by receiving a designation to "fill in the blanks on the checklist" (in the example of FIG. 5(b) , "fill in the blanks and listen to an explanation of the results"), the generation unit 12 inputs the first explanatory information and second explanatory information including the check items to the generation artificial intelligence, and generates text data corresponding to the checklist items based on the content of the first explanatory information as comparison explanatory information. The generation unit 12 then generates a comparison video that contains new slides based on the check items of the second explanatory information and the generated text data.

[0080] In this embodiment, a timing specification is accepted from a user, and a comparison video is generated in which the first explanatory information to be displayed at the specified timing corresponds to the generated comparative explanatory information. Alternatively, a specification unit (not shown) may acquire timing from the generation artificial intelligence and specify the timing as the timing for displaying the comparative explanatory information. Specifically, the specification unit acquires, from the generation artificial intelligence, the timing of the comparison source video at which the first explanatory information corresponding to the generated comparative explanatory information is displayed, and specifies the timing as the timing for displaying the comparative explanatory information.

[0081] In this embodiment, a slide video has been described as the comparison source video, but if the comparison source video is a video file such as MP4, in S2, the timing (frame) of the comparison source video is specified, and in S5, first explanatory information and second explanatory information are identified for the video file using technology such as OCR (Optical Character Recognition), thereby generating comparison explanatory information, and in S6, a comparison video is generated in which the first explanatory information displayed in the identified frame and the comparison explanatory information generated in S5 are associated.

[0082] In this embodiment, the acquisition unit 11 acquires a file related to the comparison target as the comparison target data, but may also acquire the URL (Uniform Resource Locator) of a site related to the comparison target. In this case, the generation unit 12 inputs the content of the site and the first explanation information into the generation artificial intelligence and processes to generate the comparison explanation information. The acquisition unit 11 may also accept the specification of another comparison source video as the comparison target data and acquire the other comparison source video. [Explanation of symbols]

[0083] 0: Comparison video generation system using artificial intelligence 1: Comparison video generator 3: User terminal device 4: Administrator terminal device 10: Server 101: Control unit 102: Storage section 103: Communications Department 9: Terminal device 91: Control unit 92: Storage section 93: Communications Department 94: Input section 95: Output section 11: Acquisition part 12: Generation part 13: Registration section 14: Update section 15: Display processing section NW: Communication network

Claims

1. A comparative video generation system utilizing artificial intelligence, The comparative video generation system utilizing artificial intelligence includes an acquisition unit and a generation unit, storing comparison source video data including first explanation information relating to an object explained in the video in a database; the acquiring unit acquires comparison target data including second explanation information related to the comparison target; The generation unit inputs the first description information and the second description information into a generation artificial intelligence, generates comparative description information, and generates a comparison video based on the comparative description information and the comparison source video data. A comparative video generation system that uses artificial intelligence.

2. the generation unit acquires data corresponding to the comparative explanation information from an external database; generating the comparison video that displays the data; A comparative video generation system utilizing the artificial intelligence according to claim 1.

3. The comparative video generation system utilizing artificial intelligence further includes a display processing unit and an update unit, the display processing unit publicly displays the comparison source video; The update unit updates the comparison source video or the comparison video based on an evaluation of the comparison video from an administrator who manages the comparison source video data. A comparative video generation system utilizing the artificial intelligence according to claim 1.

4. the generation unit receives a designation of a timing of the comparison source video data, inputs the first explanation information to be displayed at the designated timing and the acquired second explanation information to the generation artificial intelligence, and generates the comparison explanation information; generating the comparison video in which the first explanatory information and the comparative explanatory information to be displayed at the specified timing are associated with each other; A comparative video generation system utilizing the artificial intelligence according to claim 1.

5. The comparative video generation system utilizing artificial intelligence further includes a specifying unit, The identification unit identifies a timing of displaying the first explanatory information corresponding to the generated comparison explanatory information in the comparison source video; The generation unit generates the comparison video that displays the comparison explanation information and the first explanation information at the timing. A comparative video generation system utilizing the artificial intelligence according to claim 1.

6. The generation unit generates the comparison video by superimposing the comparison explanation information on the first explanation information. A comparative video generation system utilizing the artificial intelligence according to claim 3 or 4.

7. The generation unit generates the comparison video that switchably displays the content of the first explanation information and the content based on the comparison explanation information. A comparative video generation system utilizing the artificial intelligence according to claim 3 or 4.

8. The generation unit generates the comparison video in which the comparison explanation information is arranged by dividing a screen according to the number of the acquired comparison target data. A comparative video generation system utilizing artificial intelligence according to claim 3.

9. The generating unit generates a graph based on the comparative explanatory information when the first explanatory information and the second explanatory information include numerical data formats. A comparative video generation system utilizing the artificial intelligence according to claim 1.

10. A comparative video generation program using artificial intelligence, The comparative video generation program utilizing artificial intelligence causes a computer to function as an acquisition unit, a generation unit, and a database, the database stores comparison source video data including first explanation information relating to an object explained in the video; the acquiring unit acquires comparison target data including second explanation information related to the comparison target; The generation unit inputs the first description information and the second description information into a generation artificial intelligence, generates comparative description information, and generates a comparison video based on the comparative description information and the comparison source video data. A comparison video generation program that uses artificial intelligence.

11. A comparative video generation method utilizing artificial intelligence, The computer A process of storing comparison source video data including first explanation information related to an object explained in the video in a database; A process of acquiring comparison target data including second explanation information related to the comparison target; a process of inputting the first description information and the second description information into a generating artificial intelligence to generate comparative description information, and generating a comparative video based on the comparative description information and the comparison source video data; A comparative video generation method using artificial intelligence to perform the above.

Images