Information processing system, information processing system control method, and computer control method

Abstract

The present invention provides an information processing system, an information processing system control method, and a computer control method. Provided is an information processing system including an information processing device and a server device, said information processing system being characterized in that the server device has a transmission means for transmitting, to the information processing device, information which is generated using a first process having a first role and which is for video production, the information processing device has a display control means for displaying, in a display section, the information for video production, the display control means displays, in the display section and in a state where the information for video production is displayed in the display section, an instruction section that does not receive text input from a user but receives a review of the information for video production which is provided as a result of a second process having a second role, and the display control means displays, in the display section, a refinement of the information for video production which is generated using the second process having the second role and the information for video production, in accordance with an instruction provided to the instruction section.

Description

Information Processing System, Control Method of Information Processing System, and Control Method of Computer

[0001] This embodiment relates to an information processing system, a control method of an information processing system, and a control method of a computer.

[0002] In video production, after creating a project plan necessary for producing a video, a story line and a storyboard of the video are created. A lot of work has been required to create these project plans, story lines, and storyboards.

[0003] Patent Document 1 describes a method of determining camera work for an object in an image of a cut constituting a picture sequence, generating an image reflected by the determined camera work, and assigning a cut number to the generated image and information related to the cut of the image.

[0004] Japanese Patent Application Laid-Open No. 2023-56121

[0005] In video production support technology as disclosed in Patent Document 1, there may be a need for a user interface that can produce a more suitable video.

[0006] As one means for solving the above problems, the information processing system of the present disclosure has the following configuration. That is, in an information processing system including an information processing device and a server device, the server device has a transmission means for transmitting information for video production generated using a first process having a first role to the information processing device, and the information processing device has a display control means for displaying the information for video production on a display unit, and an instruction unit that does not accept character input from a user and accepts a review of the information for video production by a second process having a second role. In a state where the information for video production is displayed on the display unit, the display control means displays it on the display unit, and the display control means displays improvement points of the information for video production generated using the second process having the second role and the information for video production on the display unit according to an instruction to the instruction unit.

[0007] Furthermore, the information processing system disclosed herein has the following configuration: an information processing system comprising an information processing device and a server device, wherein the information processing device has a first receiving unit that receives information related to video generation, a second receiving unit that receives budget information related to the budget for video shooting, a display unit that displays the information, and a control unit that controls the display of the display unit, and the server device has a communication unit that transmits the information related to video generation and the budget information to an external device and receives video production design information created by the external device, wherein the control unit displays the created video production design information on the display unit.

[0008] According to this disclosure, a user interface is provided that enables the creation of more suitable video.

[0009] The features of this embodiment will become clear from the following description of the embodiments (see attached drawings). The following description of embodiments is provided as an example.

[0010] This is a diagram showing the system configuration including an information processing device, an application server, and a generation AI server. This is a diagram showing the hardware configuration of the information processing device, application server, and generation AI server. This is a diagram showing the software configuration of the information processing device and the application server. This is a diagram showing the software configuration of the information processing device and the application server. This is a diagram showing the software configuration of the information processing device and the application server. This is a diagram showing the software configuration of the information processing device and the application server. This is a flowchart showing the overall processing flow. This is a sequence diagram showing the processing flow for creating a project proposal. This is a sequence diagram showing the processing flow for creating a concept. This is a sequence diagram showing the processing flow for creating a storyline. This is a sequence diagram showing the processing flow for creating an image. This is a sequence diagram showing the processing flow for creating a storyboard. This is a diagram showing a screen for accepting the type of video. This is a diagram showing a screen where a question is displayed. This is a diagram showing a screen where a question is displayed. This is a diagram showing a screen where a project proposal is displayed. This is a diagram showing a screen where a project proposal is displayed. This is a diagram showing a screen where multiple concepts are displayed. This is a diagram showing a screen where the selected concept is displayed. This is a diagram showing a screen where improvements to the concept are displayed. This is a diagram showing a screen where a storyline is displayed. This is a diagram showing a screen where images of characters to be used in the storyboard are displayed. This is a diagram showing a screen where images of locations to be used in the storyboard are displayed. This is a diagram showing a screen where images of objects to be used in the storyboard are displayed. This figure shows a screen for selecting the style and color tone of image generation used in the storyboard. This figure shows a series of storyboard screens. This figure shows a flowchart of the proposal update performed by the information processing device. This figure shows a flowchart of the concept update performed by the information processing device. This figure shows a flowchart of the storyline update performed by the information processing device. This figure shows a flowchart of the storyboard update performed by the information processing device. This is a flowchart of the overall processing flow of the second embodiment. This is a sequence diagram showing the processing flow for creating a proposal in the second embodiment.This is a sequence diagram showing the process flow for creating the concept of the second embodiment. This is a diagram showing the screen for receiving the type of video and budget of the second embodiment. This is a diagram showing the screen for inputting the budget and budget allocation ratio of the second embodiment. This is a diagram showing the screen for inputting the budget and budget allocation ratio of the second embodiment. This is a diagram showing the screen for inputting the budget and budget allocation ratio of the second embodiment. This is a diagram showing the screen for sorting a series of storyboards of the second embodiment. This is a diagram showing the screen for dividing a series of storyboards of the second embodiment. This is a diagram showing the flowchart of the concept update performed by the information processing device of the second embodiment.

[0011] The following describes the implementation of this disclosure using drawings.

[0012] <First Embodiment> Figure 1 is a diagram showing the overall configuration of a system for creating information for video production according to this embodiment. In Figure 1, the client, the information processing device 101, and the application server 102 are connected via a network 110. The network 110 can be implemented by, for example, a Local Area Network (hereinafter abbreviated as LAN), such as the Internet, a Wide Area Network (hereinafter abbreviated as WAN), a dedicated digital line, an ATM or frame relay line, a cable television line, a wireless line for data broadcasting, etc. The network 110 can be of any type as long as it is capable of transmitting and receiving data.

[0013] The information processing device 101 is an information device with a built-in program execution environment. Examples include desktop computers, notebook computers, Personal Data Assistants (hereinafter abbreviated as PDAs), and smartphones. The information processing device 101 has a built-in environment for executing programs such as web browsers (internet browsers, WWW browsers, software for using the World Wide Web).

[0014] The application server 102 has applications installed for creating project proposals, concepts, storylines, and storyboards. The application server 102 creates the storylines (text storyboards) and storyboards (picture storyboards) requested by the user according to the instructions received from the information processing device 101, and sends the created storylines and storyboards to the information processing device 101.

[0015] The generation AI server 103 is a server that generates responses using generation AI in accordance with prompts from the application server 102. Here, AI stands for Artificial Intelligence, and generation AI refers to Artificial Intelligence that learns data patterns and relationships to generate content including text, images, videos, audio, music, or combinations thereof. The generation AI server 103 has multiple AIs, each with a defined role. Each AI has a different role. By assigning roles to the AIs, the AI's response style and content become appropriate to its role.

[0016] The role of the generating AI is assigned by giving it a role that mimics a specific person, occupation, or skill. The specific procedure for assigning a role to the AI ​​involves clearly defining the role, communicating the background and situation, clarifying the objective (setting the goal expected of the AI), and finally setting additional rules (adding instructions regarding the tone and style of the response). In this embodiment, examples of roles include strategist, creative director, and copywriter. Therefore, the roles in this embodiment can also be described as prerequisites, limitations, and other conditions for the AI ​​when generating output content from the input it receives.

[0017] There are several ways to assign a role to AI, as listed below.

[0018] First, the role of the AI ​​can be changed by changing the content of the prompt. By devising instructions and settings given to the AI, the AI's response style and direction can be adjusted. In order to set the role of the AI, the application server 102 can send a prompt to the AI ​​generation server 103 that includes the name of the role, such as strategist, creative director, copywriter, etc., the content of the role's work, the expertise such as the specialized skills required for the role, the role's functions, or any combination thereof.

[0019] In addition, configuration messages (system messages) are sometimes used to define "what role" an AI system should play. By adjusting these settings, the behavior of the AI ​​can be changed without changing the prompt.

[0020] Alternatively, you can obtain responses that appear to have a different role simply by adding instructions regarding tone and style, without significantly altering the content of the prompt.

[0021] Additionally, the AI's role can be changed by switching between pre-configured modes such as "Creative Mode" and "Accuracy-Focused Mode" without altering the prompt.

[0022] Furthermore, the generation AI server 103 may be a data server that aggregates information on many storylines and storyboards, or it may be a combination of a data server that aggregates storylines, storyboards, and other information related to video creation, and a server equipped with generation AI and other AI functions. In this embodiment, the video includes both audio and video, but the video may be a still image, a video, or a combination of a still image and a video, and these may be combined with one or more of text, audio, or music. In Figure 1, the application server 102 and the generation AI server 103 are shown as a single unit each in order to simplify the explanation of this embodiment, but there is no intention to limit the number of units. Each server may be composed of multiple physical server computers, multiple virtual server computers, or both.

[0023] Figure 2 shows an example of the hardware configuration of the information processing device 101, application server 102, and generation AI server 103 in a system for creating information for video production according to this embodiment. The system bus 201 is a system bus that connects each component of the information processing device 101. The CPU 202 (control unit) is a Central Processing Unit that controls the entire device and comprehensively controls access to each component connected to the system bus 201.

[0024] ROM 203 is a Read Only Memory, which is a storage means, and stores various data such as basic I / O programs internally. RAM 204 is a Random Access Memory, which is a temporary storage means, and functions as the main memory, work area, etc., of the CPU 202. Storage device 205 is one of the external storage means, and functions as a large-capacity memory, storing programs, etc., according to this embodiment. For example, it is a Hard Disk Drive (hereinafter abbreviated as HDD).

[0025] NIC206 is a Network Interface Controller that exchanges data with each component shown in Figure 1 via the network 110. The input unit 207 is an instruction input means via input devices such as a keyboard (not shown) or mouse (not shown). The display unit 208 is a display means via output devices such as a display (not shown). The CPU 202 controls the display of each screen on the display unit 208. The GPU 209 is a Graphics Processing Unit that performs processing when learning is performed multiple times using a learning model such as deep learning. By using the GPU 209, it becomes possible to process more data in parallel and perform calculations efficiently.

[0026] It should be noted that the configuration of the information processing device 101 described above is merely an example and is not limited to the combination shown in Figure 2. For example, the storage location for data and programs can be changed to ROM 203, RAM 204, or storage device 205 depending on their characteristics.

[0027] Figure 2 shows an example of the hardware configuration of the application server 102.

[0028] The system bus 211 is a system bus that connects the various components of the server. The CPU 212 is a Central Processing Unit that controls the entire device and comprehensively controls access to each component connected to the system bus 211.

[0029] ROM 213 is a Read Only Memory, a storage means, and stores various data such as basic I / O programs internally. RAM 214 is a Random Access Memory, a temporary storage means, and functions as the main memory, work area, etc., of the CPU 212 and GPU 219. Storage device 215 is one of the external storage means, functions as a large-capacity memory, and stores programs, etc., according to this embodiment. For example, it is a Hard Disk Drive (hereinafter abbreviated as HDD). NIC 216 is a Network Interface Controller, and exchanges data with each component shown in Figure 1 via the network 110.

[0030] The input unit 217 is an instruction input means via input devices such as a keyboard (not shown) or a mouse (not shown). The display unit 218 is a display means via output devices such as a display (not shown). The GPU 219 is a Graphics Processing Unit that performs processing when learning is carried out multiple times using a learning model such as deep learning. By using the GPU 219, it becomes possible to process more data in parallel and perform calculations efficiently. Note that the configuration of the application server 102 described above is merely an example and is not limited to the combination shown in Figure 2. For example, the storage location of data and programs can be changed to ROM 213, RAM 214, or storage device 215 depending on their characteristics.

[0031] Figure 2 shows an example of the hardware configuration of the generation AI server 103.

[0032] The system bus 221 is a system bus that connects the various components of the server. The CPU 222 is a Central Processing Unit that controls the entire device and comprehensively controls access to each component connected to the system bus 221.

[0033] ROM 223 is a Read Only Memory, a storage means, and stores various data such as basic I / O programs internally. RAM 224 is a Random Access Memory, a temporary storage means, and functions as the main memory and work area of ​​the CPU 222 and GPU 229. Storage device 225 is one of the external storage means, and functions as a large-capacity memory, storing programs and the like according to this embodiment. For example, it is a Hard Disk Drive (hereinafter abbreviated as HDD). NIC 226 is a Network Interface Controller, and exchanges data with each component shown in Figure 1 via the network 120.

[0034] GPU229 is a Graphics Processing Unit that handles processing when learning a learning model, such as deep learning, is performed over multiple iterations. By using GPU229, it becomes possible to process more data in parallel, enabling more efficient computation. Note that the configuration of the generated AI server 103 described above is merely an example and is not limited to the combination shown in Figure 2. For example, the storage location of data and programs can be changed to ROM223, RAM224, or storage device225 depending on their characteristics.

[0035] Figures 3A to 3D show examples of the software configurations of each component of a system for creating information for video production according to this embodiment. Figure 3A is a block diagram illustrating the software configuration of the information processing device 101 according to this embodiment. These software modules are stored as programs in the storage device 205, and the CPU 202 loads these programs into the RAM 204 and executes them.

[0036] The information processing apparatus 101 includes an information reception unit 301 and a web page information transmission / reception unit 302.

[0037] The information reception unit 301 receives an instruction from a user via the input unit 207. The web page information transmission / reception unit 302 connects to the application server 102 via the NIC 206 and the network 110, and transmits and receives web page information.

[0038] The application server 102 includes a web page information creation unit 316 and a web page information transmission / reception unit 317.

[0039] The web page information creation unit 316 creates web page information including at least one or more of the created proposal, concept, story line, image, and storyboard.

[0040] The web page information transmission / reception unit 317 connects to the information processing apparatus 101 via the NIC 216 and the network 110, and transmits and receives the web page information created by the web page information creation unit 316. The generation AI server 103 includes a proposal creation unit 311, a concept creation unit 312, a story line creation unit 313, an image creation unit 314, and a storyboard creation unit 315.

[0041] The proposal creation unit 311 creates questions necessary for creating a proposal from the received video type and length, and creates a proposal from the answers to the created questions.

[0042] The concept creation unit 312 creates a plurality of concepts from the proposal created by the proposal creation unit 311, receives an instruction from the user on which concept to adopt, and determines the concept according to the received instruction.

[0043] The story line creation unit 313 creates a story line (character content) from the concept created by the concept creation unit 312.

[0044] The image creation unit 314 creates an image from the story line created by the story line creation unit 313.

[0045] The storyboard creation unit 315 creates a storyboard (picture continuity) from the story line created by the story line creation unit 313 and the images created by the image creation unit 314.

[0046] Note that the application server 102 may hold some of the creation units of the planning document creation unit 311, the concept creation unit 312, the story line creation unit 313, the image creation unit 314, and the storyboard creation unit 315, and perform some of the processes from the planning document creation unit 311 to the storyboard creation unit 315.

[0047] The generation AI server 103 is composed of, for example, an operating system (OS), a compiler / interpreter for programming languages, libraries, a database management system (DBMS), an API and an interface, security software, monitoring tools, and the like.

[0048] The OS manages the hardware resources of the server and executes applications. The compiler / interpreter for programming languages is a compiler or interpreter for programming languages required for AI development. The libraries are various libraries for efficiently performing data processing and numerical calculations. The database management system is a database for managing a large amount of data. The API and the interface receive requests from the outside and return results.

[0049] FIG. 4 is a flowchart for explaining the overall processing flow according to the present embodiment.

[0050] A part of the control program of the flowchart shown in FIG. 4 is stored in the storage device 205 mounted on the information processing device 101, read into the RAM 204 by the CPU 202, and executed. Also, a part of the control program of the flowchart shown in FIG. 4 is stored in the storage device 215 mounted on the application server 102, read into the RAM 214 by the CPU 212, and executed. Also, a part of the control program of the flowchart shown in FIG. 4 is stored in the storage device 225 mounted on the generation AI server 103, read into the RAM 224 by the CPU 222, and executed.

[0051] In S401, the information receiving unit 301 receives information from the user via the input unit 207, including the type and length of the video to be created, and what to convey in the video. The type of video is accepted in text, and can be any type of video, such as educational, sports, or commercial. The length of the video can be any specified time, for example, 60 seconds. What to convey in the video is the purpose of the video, the subject matter of the video, etc. In addition to text, the information receiving unit 301 can also accept images of items or characters to be used in the video.

[0052] Figure 10 is an operation screen displayed on the display unit 208 of the information processing device 101, which accepts the type of video in S401. The type of video is entered into the reception unit 1001 in Figure 10. Alternatively, the desired image can be stored in the storage device 205 of the information processing device 101 and the image can be accepted by dragging and dropping it into the area 1003 in Figure 10. Accepting the input to the instruction unit 1002 in Figure 10 allows the process to proceed to S402. The instruction unit 1002 is a button displayed on the display unit 208, and input to the instruction unit 1002 can be accepted by clicking the button using a pointing device or touch operation, or by a predetermined keyboard operation. Acceptance of such input can be performed in the following description in the same manner.

[0053] Next, in S402, the proposal creation unit 311 creates questions necessary for creating the proposal based on the type and length of the video received in S401, and creates the proposal from the answers to the created questions. Figure 11A is a screen displayed on the display unit 208 of the information processing device 101, showing the questions 1101 and 1103 created in S402. Answers to each question are entered into the input fields 1102 and 1104 via the input unit 207. The questions 1101 and 1103 displayed in S402 are determined based on the type of video received in S401. Furthermore, an example answer 1107 proposed for the question is determined based on the type of video received in S401.

[0054] After the user enters their answers in input fields 1102 and 1104, the input is received by the instruction unit 1108, which starts the process of creating the proposal. Once the proposal is created, the screen shown in Figure 12A is displayed. Figure 12A is the proposal created in S402, displayed on the display unit 208. If the user agrees to the contents of the proposal, the input is received by the instruction unit 1210, which proceeds to the process in S403.

[0055] Next, in S403, the concept creation unit 312 creates multiple concepts from the project proposal created in S402, receives instructions from the user on which concept to adopt, and determines the concept according to the received instructions. Figure 13 shows the multiple concepts created in S403 displayed on the display unit 208. A concept is selected by selecting one of the multiple instruction units 1301 and 1302. Although Figure 13 shows two instruction units 1301 and 1302 as an example, there may be three or more concepts and instruction units. The process proceeds to S404 by accepting input to the instruction unit 1501 in Figure 15.

[0056] Next, in S404, the storyline creation unit 313 creates a storyline (text storyboard) from the concept decided in S403. Figure 16 shows the storyline created in S404, displayed on the display unit 208. By accepting the input for Figure 16 to the instruction unit 1603, the process proceeds to S405.

[0057] Next, in S405, the image creation unit 314 creates an image from the storyline created in S404. Figure 17 shows the image created in S405, which is displayed on the display unit 208.

[0058] Next, in S406, the storyboard creation unit 315 creates a storyboard from the storyline created in S404 and the images created in S405. Figure 21 shows the storyboard created in S406, as displayed on the display unit 208.

[0059] The above-mentioned project proposal, concept, storyline, images, and storyboards are just examples of information needed for video production. Any information relevant to video production is acceptable.

[0060] Figure 5 is a sequence diagram illustrating the process flow for creating the project proposal in S402.

[0061] In S501, the type and length of the video received in S401, the message to be conveyed by the video, etc. (information related to video generation) are sent to the application server 102. In S502, the application server 102 sends a prompt to the generation AI server 103 for creating a question based on the type and length of the video received in S501 and the message to be conveyed by the video.

[0062] In S503, the AI ​​(AI Strategist) 1105 of the first role of the generation AI server 103 creates a question from the prompt received in S502, and in S504 sends the created question to the application server 102. An example of a suggested answer 1107 to the question can be generated in S503 by the AI ​​(AI Strategist) 1105 of the first role of the generation AI server 103. At this time, the generation AI server 103 can generate an example of an answer 1107 based on all or part of the information transmitted from the information processing device 101 in S501, the type of video, the length of the video, what to convey with the video, and other information related to video generation, as well as the prompt received by the generation AI server 103 in S502, and the question generated in S503, and send it to the application server 102 in S504.

[0063] In S505, the application server 102 can create a web page containing the question and comments, as well as an example answer 1107, and send it to the information processing device 101. The generating AI server 103 has multiple AIs with assigned roles. Each AI has a different role.

[0064] The application server 102 receives multiple questions necessary for creating a proposal (for example, 1101, 1103, etc. in Figure 11A) from the generation AI server 103, and the web page information creation unit 316 creates a web page containing the questions and comments. In S505, the web page information transmission / reception unit 317 transmits the created web page to the information processing device 101. The information processing device 101 displays the received web page.

[0065] The first role of AI 1105 is that of a strategist, and its role is to faithfully determine the overall direction and purpose of the video based on the type of video input and the answers to the questions, and to clarify the message and concept that the video should convey. The first role can be set by sending a prompt to the generating AI server 103 from the application server 102 that includes the name "strategist," the strategist's duties such as planning, the strategic perspective and other expertise required of the strategist, the strategist's functions, or any combination thereof. Such a prompt may be sent in S502 or before S501.

[0066] Next, in S506, the information processing device 101 receives the answer to the question, and in S507, the received answer is sent to the application server 102. In the input fields 1102, 1104, etc. in Figure 11A, examples of suggested answers 1107 to the question are displayed based on the type of video received in S401. The examples of suggested answers 1107 to the question are generated in S502 by the AI ​​(AI Strategist) 1105 of the first role of the generating AI server 103 from the prompt received in S502, based on the type and length of the video received in S501 and what the video wants to convey. The user refers to the example answer 1107 and enters the answer in the input fields 1102, 1104, etc. in Figure 11A. Also, when input is received to the instruction unit 1109 while the example answer 1107 is displayed, the example answer 1107 is entered as text 1110 in the input fields 1102, 1104 (see Figure 11B).

[0067] In S508, the application server 102 sends a prompt to the generation AI server 103 for creating a project proposal based on the response received in S507.

[0068] In S509, the generating AI server 103 creates a proposal using the processing of the AI ​​1105 with the first role based on the received prompt, and in S510, it sends the created proposal to the application server 102. The web page information creation unit 316 of the application server 102 creates a web page containing the proposal, and in S511, the web page information transmission / reception unit 317 sends the web page containing the proposal to the information processing device 101.

[0069] In S512, the received project proposal 1209 and the comments 1203 from the second role AI (AI Creative Director) 1201 are displayed on the display unit 208 of the information processing device 101. Also in S512, with the project proposal 1209 displayed, a review button 1204, which is an instruction unit for accepting a review of the project proposal by the second role AI 1201, is displayed on the display unit 208. Note that the second role AI 1201 has a different role from the first role AI 1105. The second role AI 1201 is a creative director and is responsible for realizing the actual video expression, such as the expression of visuals and story in the concrete video production process. The creative director is sometimes called an integrated producer. The second role can be set by sending a prompt from the application server 102 to the generation AI server 103 that includes the title "Creative Director," the duties of a Creative Director such as managing the quality of video and other products based on an overall understanding of the project or the consistency between products, the expertise required of a Creative Director such as refining products based on the purpose of the video, the functions of a Creative Director such as reviewing the quality of products or the strategic consistency between products, or any combination thereof. Such a prompt may be sent in S502 or earlier.

[0070] Thus, in this embodiment, the user can review the project proposal created by the AI ​​1105 in the first role and, depending on the content of the proposal, instruct whether or not to have the AI ​​1201 in the second role review the proposal. By having the AI ​​1201 in the second role review the proposal, multifaceted opinions can be incorporated into the creation of the proposal. In this embodiment, the AI ​​1201 in the second role, which corresponds to the position of creative director that oversees and manages the entire video production process, reviews the quality of the content included in the proposal created by the AI ​​1105 in the first role, which corresponds to the specialist position of strategist, or the strategic consistency between the content and the purpose of the video. Such a review includes evaluating such quality and consistency, and generating points for improvement based on that evaluation. The AI ​​1201 in the second role may review the entire process from S401 to S406 in Figure 4, or it may review only a part of the process in Figure 4 (for example, S402 to S404). By reviewing multiple processes from an overview perspective, it becomes possible to review them from a different viewpoint than that of AI1105, which plays the primary role.

[0071] The user can review the project proposal 1209 created by the AI ​​1105 in the first role and decide whether to request the AI ​​1201 in the second role to review the proposal. Regardless of the instruction to press the review button 1204, displaying the suggested improvements 1205 to the proposal at all times would increase the system load. However, in this embodiment, if the user agrees with the contents of the project proposal 1209, the AI ​​1201 in the second role will not generate the suggested improvements 1205, thereby reducing the load on the system that generates the suggested improvements to the proposal.

[0072] Furthermore, in Figure 12A, the project proposal created by AI 1105, which has the first role, is displayed in the left area of ​​the screen, while the comments 1203 and review button 1204 from AI 1201, which has the second role, are displayed in the right area of ​​the screen. By separating the display areas, the content of the project proposal of the item to be reviewed is displayed clearly, and the user operating the review button 1204 can recognize the item to be reviewed without making a mistake. This reduces the amount of review processing performed on the wrong item, and reduces the overall processing load on the system that performs the review processing. In addition, in Figure 12A, the size of the area displaying the project proposal created by AI 1105, which has the first role, is larger than the size of the area displaying the comments 1203 and review button 1204 from AI 1201, which has the second role. This makes it easier to check the content of the project proposal.

[0073] Furthermore, region 1212 in Figure 12A shows the contents of multiple products, and the underlined process (Brief in Figure 12A) represents the contents currently being generated.

[0074] If no instruction is given to the review button 1204, the AI ​​1201, which has a second role, will not generate the improvement points 1205 for the proposal, and therefore the improvement points 1205 will not be displayed. This reduces the load on the system that generates the improvement points for the proposal. If the improvement points 1205 are always displayed regardless of the instruction given to the review button 1204, the system load will increase.

[0075] Furthermore, in Figure 12A, the review button 1204 is positioned closer to the comment 1203 of the second role AI 1201 than to the comment of the first role AI 1105. This arrangement allows users operating the review button to intuitively understand that they are requesting a review from the second role AI 1201, preventing them from mistakenly requesting a review from the first role AI 1105. This also reduces the overall processing load of the system in Figure 1 that performs the review process.

[0076] Furthermore, since the review button 1204 displays "Ask for a review" (text indicating the content of the review request), users can easily recognize that the review button 1204 is for requesting a review. This reduces the misuse of the review button 1204 and also reduces the overall processing load of the system shown in Figure 1 that performs the review process. In addition, the review button 1204 does not accept text input and is a button (instruction unit) that instructs a review; the user instructs a review by clicking or tapping the button (instruction unit).

[0077] In S513, upon receiving a command to the review button 1204, in S514, the information processing device 101 sends a review command to the application server 102, and in S515, the application server 102 sends a review command prompt to the generation AI server 103. Since the review command in S515 is a predetermined prompt to instruct a review, it can reduce the processing load on the generation AI server 103 compared to commands entered by arbitrary characters.

[0078] In S516, according to the review instructions, the AI ​​1201 of the second role generates improvements 1205 to the project proposal. In S517, the created improvements 1205 to the project proposal are sent to the application server 102. The web page information creation unit 316 of the application server 102 creates a web page containing the improvements 1205 to the project proposal, and in S518, the web page information transmission / reception unit 317 sends the web page containing the improvements 1205 to the information processing device 101.

[0079] In S519, the improvements 1205 to the project proposal are displayed on the display unit 208 of the information processing device 101.

[0080] In S520, if all of the displayed improvements 1205 are to be reflected in the project proposal, input is accepted to the Apply button 1206. Upon acceptance of input to the Apply button 1206, the contents of the project proposal are updated so that the improvements 1205 are reflected in the proposal. By placing the Apply button 1206 near the improvements 1205, the user operating the Apply button 1206 will know that they are applying the improvements 1205 and will be able to select the correct improvement target. This reduces the processing that would otherwise reflect incorrect content and also reduces the overall processing load of the system in Figure 1 that performs the improvement processing.

[0081] Furthermore, since the Apply button 1206 is labeled "Apply improvements," users can easily recognize that the Apply button 1206 is for requesting improvements. This reduces the misuse of the Apply button 1206 and also reduces the overall processing load of the system shown in Figure 1 that performs the improvement processing.

[0082] If you wish to incorporate some of the improvements 1205 into the proposal, enter the content to be incorporated into input field 1207 and click the update button 1208 to update the proposal. You can enter a request into input field 1207 before or after clicking the review button 1204. If you enter a request into input field 1207 after clicking the review button 1204, you can refer to improvements 1205 when entering your request, allowing you to request a variety of opinions that incorporate the input of AI 1201, which plays a second role.

[0083] In S520, input is received to the apply button 1206 or entered into the input field 1207, and in S521, an instruction is sent from the information processing device 101 to the application server 102, and in S522, an instruction is sent from the application server 102 to the generation AI server 103. In S523, the project proposal is updated based on the instruction. In S524, the updated project proposal is sent from the generation AI server 103 to the application server 102, and in S525, the updated project proposal is sent from the application server 102 to the information processing device 101.

[0084] In S526, the updated project proposal is displayed on the display unit 208 of the information processing device 101. Upon agreeing to the contents of the project proposal, the input is received by the instruction unit 1210, and the process proceeds to S403, i.e., to the concept creation sequence diagram in Figure 6.

[0085] Figure 22 is a flowchart of the process for updating a project proposal, which is executed by the information processing device 101. The control program for the flowchart shown in Figure 22 is stored in the storage device 205 of the information processing device 101 and is read into the RAM 204 by the CPU 202 and executed.

[0086] In S2201, upon receiving instructions to the review button 1204, in S2202, the information processing device 101 sends a review instruction to the application server 102 and receives the improvements 1205 to the project proposal generated using the AI ​​1201 of the second role of the generation AI server 103.

[0087] In S2203, the improvements 1205 to the proposal are displayed on the display unit 208 of the information processing device 101. Note that if no instruction is received for the review button 1204 in S2201, the AI ​​1201, which has a second role, will not generate the improvements 1205 to the proposal, and therefore the improvements 1205 will not be displayed. This reduces the load on the system that generates the improvements to the proposal.

[0088] In S2204, if all of the displayed improvements 1205 are to be reflected in the proposal, input is accepted at the Apply button 1206. Upon acceptance of input at the Apply button 1206, the contents of the proposal are updated so that the improvements 1205 are reflected in the proposal. If only some of the improvements 1205 are to be reflected in the proposal, the contents of the proposal are updated by entering the content to be reflected in the input field 1207 and accepting input at the Update button 1208. Upon acceptance of input at the Apply button 1206 or by entering information in the input field 1207, in S2205, the information processing device 101 sends a correction instruction to the application server 102, and the updated proposal is received using the AI ​​1201, which has a second role.

[0089] In S2206, the updated project proposal is displayed on the display unit 208 of the information processing device 101.

[0090] If no revision instructions for the proposal are accepted in S2204, the process proceeds to S2206, where the proposal created in S509 is displayed.

[0091] Once the contents of the proposal are agreed upon, the system proceeds to process S403 by accepting input to the instruction unit 1210 in Figures 12A and 12B.

[0092] Figure 6 is a sequence diagram illustrating the process flow for concept creation in S403.

[0093] In S631, the information processing device 101 sends a concept generation instruction to the application server 102 in accordance with the input received by the instruction unit 1210 in Figures 12A and 12B. In S632, the application server 102 sends a concept generation instruction to the generation AI server 103. In S633, multiple concepts are created from the project proposal created in S402, and in S634, the generation AI server 103 sends the multiple concepts to the application server 102. The web page information creation unit 316 of the application server 102 creates a web page containing the multiple concepts, and in S635, the web page information transmission / reception unit 317 transmits the web page containing the concepts to the information processing device 101.

[0094] In S601, comment 1304 from AI 1303 (copywriter), which has a third role, is displayed. Note that AI 1303, which has a third role, has a different role from AI 1105, which has a first role, and AI 1201, which has a second role. Based on the project proposal created and approved by AI 1105, which has a first role, AI 1303, which has a third role, is responsible for determining words and phrases that will resonate with viewers, the tone and style of the video, and presenting a video concept that includes important elements for constructing the story. Also in S601, multiple concepts received in S635 are displayed on the display unit 208.

[0095] Figure 13 shows the first concept 1305 and the second concept 1306, among the multiple (for example, three) concepts created. The third role can be set by sending a prompt from the application server 102 to the generation AI server 103 that includes the name "copywriter," the copywriter's duties such as creating multiple concepts, the expertise required of a copywriter, the copywriter's functions, or any combination thereof. Such a prompt may be sent in S632 or earlier.

[0096] The third role in this embodiment, the copywriter, shares the same characteristic as the first role as it is a professional role, but differs from the second role, which is a position that oversees and manages the entire project. Thus, different generating AIs based on different prompts can be used for the AI ​​1105 of the first role used in creating the proposal (S401) and the AI ​​1303 of the third role used in creating the concept (S403). This allows for setting appropriate expertise for each stage of the process or project phase and performing individual processing, thereby reducing the load on the generating AI server 103 while obtaining output that matches the objective.

[0097] In this embodiment, the AI ​​1201 in the second role can be used in both the creation of the project proposal S401 and the creation of the concept S403. The AI ​​1201 in the second role corresponds to the position of creative director, which oversees and manages the entire video production process, and can therefore play a common role throughout the video production process. This eliminates the need to increase the number of reviewing AIs depending on the progress of the processing or the phase of the project, reducing the load on the generation AI server 103 while obtaining consistent output that matches the purpose.

[0098] Here, "project" means a plan and its execution to achieve a predetermined goal, and in this embodiment, it may be all or part of the video creation specified by the user. Furthermore, "project phase" means a unit into which the project is divided, and in this embodiment, it may be a unit into which the work performed for video creation is divided. For example, the project may encompass the entire process from receiving information about the type of video, length, and message to be conveyed (S401) to creating the storyboard (S406), as shown in Figure 4, either in whole or in part. The project phases may be, but are not limited to, receiving information about the type of video (S401), creating a proposal (S402), creating a concept (S403), creating a storyline (S404), creating images (S405), and creating the storyboard (S406).

[0099] In S602, a concept is selected from among the multiple concepts displayed in S601 based on the user's instructions. The concept is selected by selecting one of the multiple instruction units 1301, 1302 in Figure 13. To select the first concept 1305 in Figure 13, instruction unit 1301 is selected, and to select the second concept 1306, instruction unit 1302 is selected. In this embodiment, instruction unit 1302 is selected to select the second concept 1306. In S603, the information processing device 101 transmits the selected concept to the application server 102.

[0100] In S604, the concept is received, and in S605, the concept and the comment 1403 from the second role AI (AI Creative Director) 1201 in Figure 14 are displayed. Also in S605, while the concept is displayed, a review button 1204, which is an instruction unit for accepting a review of the concept by the second role AI 1201, is displayed on the display unit 208.

[0101] In S606, upon receiving a command to the review button 1204, in S607, the information processing device 101 sends a review command to the application server 102, and in S608, the application server 102 sends a review command to the generation AI server 103. Since the review command in S608 is a predetermined prompt to instruct a review, it can reduce the processing load on the generation AI server 103 compared to commands entered by arbitrary characters.

[0102] In S609, in accordance with the review instructions, the processing of the second role AI 1201 is used to generate the improvement points 1505 of the concept. In S610, the created improvement points of the concept are sent to the application server 102. The web page information creation unit 316 of the application server 102 creates a web page containing the improvement points of the concept, and in S611, the web page information transmission / reception unit 317 sends the web page containing the improvement points 1505 of the concept to the information processing device 101.

[0103] In S612, the improvements to the concept 1505 are displayed on the display unit 208 of the information processing device 101.

[0104] In S613, if all of the displayed improvements 1505 are to be reflected in the concept, input is accepted at the Apply button. Upon acceptance of input at the Apply button, the content of the concept is updated so that the improvements 1505 are reflected in the concept. If only some of the improvements 1505 are to be reflected in the concept, the content of the concept is updated by entering the content to be reflected in the input field 1506 and accepting input at the Update button 1507. It is possible to enter a request in the input field 1506 before or after instructing the Review button 1204. If a request is entered in the input field 1506 after instructing the Review button 1204, the request can be entered by referring to the improvements 1505, so it is possible to request diverse opinions that incorporate the opinions of the second role AI 1201.

[0105] In S613, input is received via the apply button or by entering information into the input field 1506. In S614, the information processing device 101 sends an instruction to the application server 102, and in S615, the application server 102 sends an instruction to the generation AI server 103. In S616, the concept is updated based on the instruction. In S617, the generation AI server 103 sends the updated concept to the application server 102, and in S618, the application server 102 sends the updated concept to the information processing device 101.

[0106] In S619, the updated concept is displayed on the display unit 208 of the information processing device 101. Upon agreeing to the content of the concept, input is received to the instruction unit 1501 in Figure 15, and the process proceeds to S404, i.e., to the storyline creation sequence diagram in Figure 7.

[0107] Figure 23 is a flowchart showing the process of updating a concept executed by the information processing device 101. The control program of the flowchart shown in Figure 23 is stored in the storage device 205 of the information processing device 101 and is read into the RAM 204 by the CPU 202 and executed.

[0108] In S2301, upon receiving an instruction to the review button 1204, in S2302, the information processing device 101 sends a review instruction to the application server 102 and receives the improvement points 1505 of the concept generated using the AI ​​1201 of the second role of the generation AI server 103.

[0109] In S2303, the improvement points 1505 of the concept are displayed on the display unit 208 of the information processing device 101. However, if no instruction is received for the review button 1204 in S2301, the AI ​​1201, which has a second role, will not generate the improvement points 1505 of the concept, and therefore the improvement points 1505 of the concept will not be displayed.

[0110] In S2304, if all of the displayed improvements 1505 are to be reflected in the concept, input is accepted at the Apply button. Upon acceptance of input at the Apply button, the content of the concept is updated so that the improvements 1505 are reflected in the concept. If only some of the improvements 1505 are to be reflected in the concept, the content of the concept is updated by entering the content to be reflected in the input field 1506 and accepting input at the Update button 1507. Upon acceptance of input at the Apply button or by entering information in the input field 1506, in S2305, the information processing device 101 sends a correction instruction to the application server 102, and the updated concept is received using the AI ​​1201 with a second role.

[0111] In S2306, the updated concept is displayed on the display unit 208 of the information processing device 101.

[0112] If no feedback is received on the concept in S2304, the process proceeds to S2306, where the concept created in S633 is displayed again.

[0113] Figure 7 is a sequence diagram illustrating the process flow for creating the storyline in S404.

[0114] In S701, the instruction unit 1501 receives input, thereby receiving an instruction to generate a storyline. In S702, the information processing device 101 sends the storyline generation instruction to the application server 102, and in S703, the application server 102 sends the storyline generation instruction to the generation AI server 103.

[0115] In S704, the generation AI server 103 generates a storyline; in S705, the generation AI server 103 sends the generated storyline to the application server 102; and in S706, the application server 102 sends the storyline to the information processing device 101.

[0116] In S707, the received storyline is displayed on the display unit 208. Figure 16 shows the storyline displayed in S707.

[0117] Furthermore, in S707, while the storyline is displayed, a review button 1204, which is an instruction unit for receiving a review of the storyline by the AI ​​1201 (which has a second role), is displayed on the display unit 208.

[0118] In S708, upon receiving a command to the review button 1204, in S709, the information processing device 101 sends a review command to the application server 102, and in S710, the application server 102 sends a review command to the generation AI server 103. Since the review command in S710 is a predetermined prompt to instruct a review, it can reduce the processing load on the generation AI server 103 compared to commands entered by arbitrary characters.

[0119] In S711, according to the review instructions, the processing of the second role AI 1201 is used to generate improvements to the storyline. In S712, the created improvements to the storyline are sent to the application server 102. The web page information creation unit 316 of the application server 102 creates a web page containing the improvements to the storyline, and in S713, the web page information transmission / reception unit 317 sends the web page containing the improvements to the storyline to the information processing device 101.

[0120] In S714, improvements to the storyline are displayed on the display unit 208 of the information processing device 101.

[0121] In S715, if all of the displayed improvements are to be reflected in the storyline, input is accepted via the Apply button. Upon acceptance of input via the Apply button, the storyline content is updated so that the improvements are reflected in the storyline. If only some of the improvements are to be reflected in the storyline, the content of the storyline is updated by entering the content to be reflected in input field 1601 and accepting input via the Update button 1602. It is possible to enter a request in input field 1601 before or after instructing the Review button 1204. If a request is entered in input field 1601 after instructing the Review button 1204, the request can be entered by referring to the improvements, allowing for a diverse range of opinions that incorporate the opinions of the second AI, 1201.

[0122] In S715, input is received via the apply button or by entering information into the input field 1601. In S716, the information processing device 101 sends an instruction to the application server 102, and in S717, the application server 102 sends an instruction to the generation AI server 103. In S718, the storyline is updated based on the instruction. In S719, the generation AI server 103 sends the updated storyline to the application server 102, and in S720, the application server 102 sends the updated storyline to the information processing device 101.

[0123] In S721, the updated storyline is displayed on the display unit 208 of the information processing device 101. Upon agreeing to the content of the storyline, the input is received by the instruction unit 1603, and the process proceeds to S405, i.e., to the image creation sequence diagram shown in Figure 8.

[0124] Figure 24 is a flowchart showing the process of updating the storyline executed by the information processing device 101. The control program for the flowchart shown in Figure 24 is stored in the storage device 205 of the information processing device 101 and is read into the RAM 204 by the CPU 202 and executed.

[0125] In S2401, upon receiving instructions to the review button 1204, in S2402, the information processing device 101 sends a review instruction to the application server 102 and receives improvements to the storyline generated using the AI ​​1201, which is the second role of the generation AI server 103.

[0126] In S2403, improvements to the storyline are displayed on the display unit 208 of the information processing device 101. However, if no instruction is received from the review button 1204 in S2401, the AI ​​1201, which has a second role, will not generate improvements to the storyline, and therefore the improvements to the storyline will not be displayed.

[0127] In S2404, if all of the displayed improvements are to be reflected in the storyline, input is accepted at the Apply button. Upon acceptance of input at the Apply button, the content of the storyline is updated so that the improvements are reflected in the storyline. If only some of the improvements are to be reflected in the storyline, the content of the storyline is updated by entering the content to be reflected in the input field 1601 and accepting input at the Update button 1602. Upon acceptance of input at the Apply button or by entering information in the input field 1601, in S2405, the information processing device 101 sends a correction instruction to the application server 102, and the updated storyline is received using the AI ​​1201, which has a second role.

[0128] In S2406, the updated storyline is displayed on the display unit 208 of the information processing device 101.

[0129] Figure 8 is a sequence diagram illustrating the process flow for creating the image in S405.

[0130] In S801, the display unit 208 displays an image 1701 of a character used in the storyboard, as shown in Figure 17, and text 1702 of the character's age, gender, appearance, accessories, clothing, and image type (colored image, line drawing, etc.). In S802, when the user inputs the content to modify the text 1702 of the character's age, gender, appearance, accessories, clothing, and image type (colored image, line drawing, etc.) and the input is accepted by the update button 1703, the information processing device 101 sends a modification instruction to the application server 102 in S803. In S804, the application server 102 sends a modification instruction to the generation AI server 103, and in S805, the character image is updated based on the instruction. In S806, the generation AI server 103 sends the updated character image to the application server 102, and in S807, the application server 102 sends the updated character image to the information processing device 101.

[0131] Next, in S808, the display unit 208 displays the location image 1801 used in the storyboard, along with the image description, location, and city text 1802, as shown in Figure 18. In S809, when the user inputs the content to modify the location image description, location, and city text 1802 and the input is received by the update button 1803, in S810, the information processing device 101 sends a modification instruction to the application server 102. In S811, the application server 102 sends a modification instruction to the generation AI server 103, and in S812, the location image is updated based on the instruction. In S813, the generation AI server 103 sends the updated location image to the application server 102, and in S814, the application server 102 sends the updated location image to the information processing device 101.

[0132] Next, in S815, the display unit 208 displays the image 1901 of the object used in the storyboard and the explanatory text 1902 of the image, as shown in Figure 19. In S816, when the content to be modified in the explanatory text 1902 of the object image is entered and the input is received by the update button 1903, in S817 the information processing device 101 sends a modification instruction to the application server 102. In S818 the application server 102 sends a modification instruction to the generation AI server 103, and in S819 the object image is updated based on the instruction. In S820 the generation AI server 103 sends the updated object image to the application server 102, and in S821 the application server 102 sends the updated object image to the information processing device 101. In S822 the updated object image is displayed on the display unit 208.

[0133] Furthermore, in the screens shown in Figures 17, 18, and 19, the review button 1204 shown in Figure 12A may be placed, and the AI ​​1201, which has a second role, may be asked to review the character image 1701, location image 1801, and object image 1901 according to the instructions given to the review button 1204.

[0134] Figure 9 is a sequence diagram illustrating the process flow for creating the storyboard in S406.

[0135] In S901, the image generation style 2001 and color tone 2002 shown in Figure 20 are selected. The image generation style can be selected from, for example, POP ART, COLOR SKETCH, PHOTOREAL, and ANIME. The color tone can be selected from, for example, MUTED, VIVID, WARM, and COLD. Alternatively, the image generation style may be selected from line drawings without color. The input to the instruction unit 2003 in Figure 20 is accepted, and the process proceeds to S902.

[0136] In S902, the information processing device 101 sends the style and color tone to the application server 102, and in S903, the application server 102 sends a prompt to the generation AI server 103 for creating a storyboard based on the style and color tone.

[0137] In S904, the generation AI server 103 generates a storyboard; in S905, the generation AI server 103 sends the generated storyboard to the application server 102; and in S906, the application server 102 sends the storyboard to the information processing device 101.

[0138] In S907, a series of storyboards 2101 to 2103 are displayed as shown in Figure 21. Also in S907, the action, viewpoint, and location 2104 during filming are displayed. Filming actions include long shots that capture the entire subject, full shots that fill the screen with the subject, medium shots to express movement in detail, close-up shots that show a part of the subject, especially the face or hands, in detail, and extreme close-up shots that capture a specific part of the subject from very close up. Furthermore, when there are multiple people, filming actions include over-the-shoulder shots that capture one person over the shoulder of another person, and bird's-eye view shots that are shot from directly above to get an overview of the entire scene.

[0139] In S908, upon receiving a request to the review button, in S909, the information processing device 101 sends a review instruction to the application server 102, and in S910, the application server 102 sends a review instruction to the generation AI server 103. In S911, according to the review instruction, the second role AI 1201 is used to generate improvements to the storyboard. In S912, the created improvements to the storyboard are sent to the application server 102. The web page information creation unit 316 of the application server 102 creates a web page containing the improvements to the storyboard, and in S913, the web page information transmission / reception unit 317 sends the web page containing the improvements to the storyboard to the information processing device 101.

[0140] In S914, improvements to the storyboard are displayed on the display unit 208 of the information processing device 101.

[0141] In S915, when the content to modify the action, viewpoint, and location 2104 during shooting is entered and the input is accepted at the update button 2105, in S916 an update instruction based on the entered modification content is sent from the information processing device 101 to the application server 102. In S917, the application server 102 sends an instruction to the generation AI server 103.

[0142] In S918, the storyboard is updated based on the above instructions. In S919, the updated storyboard is sent from the generation AI server 103 to the application server 102, and in S920, the updated storyboard is sent from the application server 102 to the information processing device 101.

[0143] In S921, the updated storyboard is displayed on the display unit 208 of the information processing device 101. Through these processes, multiple storyboards are completed.

[0144] In addition, the review button for receiving review instructions from S908 during storyboard creation is optional, and this embodiment also includes configurations in which the review button is not displayed or in which improvements to the storyboard are not displayed.

[0145] Figure 25 is a flowchart showing the process of updating a storyboard executed by the information processing device 101. The control program for the flowchart shown in Figure 25 is stored in the storage device 205 of the information processing device 101 and is read into the RAM 204 by the CPU 202 and executed. In S2501, when an instruction is received to the review button, in S2502 the information processing device 101 sends a review instruction to the application server 102 and receives the improvements to the storyboard generated using the AI ​​1201, which is the second role of the generation AI server 103.

[0146] In S2503, improvements to the storyboard are displayed on the display unit 208 of the information processing device 101. However, if no instruction is received to the review button in S2501, the AI ​​1201, which has a second role, will not generate improvements to the storyboard, and therefore the improvements to the storyboard will not be displayed.

[0147] In S2504, when the content of the action, viewpoint, and location 2104 during shooting is entered and the input is accepted at the update button 2105, the contents of the storyboard are updated so that the improvements are reflected in the storyboard. Upon accepting the input at the update button 2105, in S2505, the information processing device 101 sends a correction instruction to the application server 102, and the updated storyboard is received using the AI ​​1201, which has a second role.

[0148] In S2506, the updated storyboard is displayed on the display unit 208 of the information processing device 101.

[0149] If no modification instructions for the storyboard are accepted in S2504, the process proceeds to S2506, where the storyboard created in S907 is displayed.

[0150] In this embodiment, the process of creating a storyboard was described using the flowchart in Figure 4. However, it is not necessary to execute all the processes in Figure 4, but only some of them. For example, S401 to S402 may be executed to create a video proposal, S401 to S403 may be executed to create a video concept, or S401 to S404 may be executed to create a video storyline.

[0151] Furthermore, in this embodiment, although Figure 1 describes a configuration in which the information processing device 101, application server 102, and generation AI server 103 are connected via a network, the program stored in the application server 102 (Figure 3B) may be stored in the information processing device 101, and the flowcharts shown in Figures 4 to 9 may be executed in the information processing device 101 without using the application server 102. In that case, the information processing device 101 and the generation AI server 103 communicate directly via the network.

[0152] Furthermore, although this embodiment describes an example using the generation AI server 103, it is also possible to store a lookup table (LUT) in the storage device 215 of the application server 102 and perform each process using the LUT without using the generation AI server 103. For example, in S502 of Figure 5, an LUT that takes information related to video generation as input and outputs a question may be used, or in S505 of Figure 5, an LUT that takes the answer to the question as input and outputs a project proposal may be used. When performing each process using an LUT, as shown in Figure 3D, the application server 102 has a project proposal creation unit 311, a concept creation unit 312, a storyline creation unit 313, an image creation unit 314, and a storyboard creation unit 315.

[0153] When using an LUT, the number of input / output patterns is limited, but when using the generation AI server 103, a larger number of input / output patterns can be used than when using an LUT, thus enabling high-precision output for a given input.

[0154] According to this embodiment, information generated by a process with a first role can be reviewed, and depending on the content of the information, it is possible to instruct whether or not to perform a review of the information by a process with a second role. By performing a review of the information by the second role, multifaceted opinions can be incorporated for information creation. If the information generated by the process with the first role is agreed upon, the review of the information by the second role is not performed, thereby reducing the overall processing load of the system.

[0155] Furthermore, by placing the review button 1204 near the comment 1203 of the second AI 1201, users operating the review button will understand that they are requesting a review from the second AI 1201, thus ensuring they select the correct review target. This reduces the number of review processes performed on the wrong target, thereby lowering the overall processing load on the system performing the review.

[0156] Furthermore, since the review button 1204 displays "Ask for a review" (text indicating the content of the review request), users can easily recognize that the review button 1204 is for requesting a review. This reduces the misuse of the review button 1204 and also reduces the overall processing load on the system that performs the review process.

[0157] <Second Embodiment> In the first embodiment, the type and length of the video the user wanted to create, the message they wanted to convey through the video, etc., were received, and a project proposal, concept, storyline, images, and storyboards were created in that order. The difference between this embodiment and the first embodiment is that the budget required for filming is received, and a project proposal, concept, storyline, and storyboards are created based on the type and length of the video the user wanted to create, the message they wanted to convey through the video, and the received budget. Note that the same reference numerals are used for each step of the configuration and flowchart that have already been explained in the first embodiment, and their explanations are omitted.

[0158] In the first and second embodiments, the "project proposal" includes, but is not limited to, the purpose and direction of the video production, the target audience for the video, the platform on which the video will be published, and at least all or part of the message to be conveyed by the video. It may also include synonyms and similar concepts that a person skilled in the art would understand, but each concept has its own effect. In this embodiment, the "concept" is a more concrete version of the project proposal, including, but is not limited to, at least all or part of the title of the video to be created, what scenes will be included in the video, and descriptions that will excite the target audience for the video (for example, content encouraging participation in an event). It may also include synonyms and similar concepts that a person skilled in the art would understand, but each concept has its own effect. In this embodiment, the "storyline" is a description of the story development in the video production, and in a story that includes multiple scenes, a description of the theme and location of each scene. It may also include synonyms and similar concepts that a person skilled in the art would understand, but each concept has its own effect. In this embodiment, "storyboard" refers to a series of illustrations or images used to visually represent the flow and structure of a scene in video production or animation, but is not limited to this. It may include synonyms and similar concepts that a person skilled in the art would understand, but each concept has its own effect.

[0159] Figure 26 is a flowchart illustrating the overall processing flow according to this embodiment.

[0160] A portion of the control program for the flowchart shown in Figure 26 is stored in the memory device 205 mounted on the information processing device 101, and is read into the RAM 204 by the CPU 202 and executed. Furthermore, a portion of the control program for the flowchart shown in Figure 26 is stored in the memory device 215 mounted on the application server 102, and is read into the RAM 214 by the CPU 212 and executed. Additionally, a portion of the control program for the flowchart shown in Figure 26 is stored in the memory device 225 mounted on the generation AI server 103, and is read into the RAM 224 by the CPU 222 and executed.

[0161] In S2601, the information receiving unit 301 receives information about video generation from the user via the input unit 207. This information includes, for example, the type and length of the video to be created, and what the user wants to convey through the video. The type of video is accepted in text, and can be any type of video, such as educational, sports, or commercial. The length of the video can be any specified time, for example, 60 seconds. What the user wants to convey through the video includes the purpose of the video and the subject matter of the video. In addition to text, the information receiving unit 301 can also accept images of items or characters to be used in the video.

[0162] Figure 29 is an operation screen displayed on the display unit 208 of the information processing device 101, which accepts the type of video in S2601. The type of video is entered into the reception unit 2901 (first reception unit) in Figure 29. Alternatively, the desired image can be stored in the storage device 205 of the information processing device 101 and the image can be entered into the area 2903 in Figure 29 by dragging and dropping, etc. Accepting the input to the instruction unit 2902 in Figure 29 allows the process to proceed to S2602. The instruction unit 2902 is a button displayed on the display unit 208, and input to the instruction unit 2902 can be accepted by clicking the button using a pointing device or touch operation, or by a predetermined keyboard operation. Acceptance of such input can be done in the same way in the following explanation. Also, in Figure 29, the budget is entered into the reception unit 2904. This budget is the cost incurred when the photographer takes pictures, referring to the storyboard created in S406 of Figure 26. If the budget has not yet been decided, select the indicator unit 2905 which indicates that the budget has not yet been decided.

[0163] Next, in S2602, the proposal creation unit 311 creates questions necessary for creating the proposal based on the type and length of the video received in S2601, and creates the proposal from the answers to the created questions. Figure 11A is a screen displayed on the display unit 208 of the information processing device 101, showing the questions 1101 and 1103 created in S2602. Answers to each question are entered into the input fields 1102 and 1104 via the input unit 207. The questions 1101 and 1103 displayed in S2602 are determined based on the type of video received in S2601. Furthermore, an example answer 1107 proposed for the questions is determined based on the type of video received in S2601.

[0164] After the user enters their answers in input fields 1102 and 1104, the input is received by the instruction unit 1108, which starts the process of creating the proposal. Once the proposal is created, the screen shown in Figure 12A is displayed. Figure 12A is the proposal created in S2602, displayed on the display unit 208. If the user agrees to the contents of the proposal, the input is received by the instruction unit 1210, which proceeds to the process in S2603.

[0165] In addition, in S2602, the proposal creation unit 311 may create questions necessary for creating a proposal from the video generation information and budget received in S2601, and create a proposal from the answers to the created questions. Alternatively, in S2602, the proposal creation unit 311 may create questions necessary for creating a proposal from the video generation information received in S2601, and create a proposal from the answers to the created questions and the budget.

[0166] Next, in S2603, the concept creation unit 312 creates multiple concepts from the project proposal created in S2602, receives instructions from the user on which concept to adopt, and determines the concept according to the received instructions. Figure 13 shows the multiple concepts created in S2603 displayed on the display unit 208. A concept is selected by selecting one of the multiple instruction units 1301 and 1302. Although Figure 13 shows two instruction units 1301 and 1302 as an example, there may be three or more concepts and instruction units. The process proceeds to S404 by accepting input to the instruction unit 1501 in Figure 15. Note that the processing in S404 to S406 in Figure 26 is the same as the processing in S404 to S406 in Figure 4, so the explanation is omitted.

[0167] The photographer takes the shots referring to the location, composition, and type of shot shown in the storyboard created in S406 of Figure 4.

[0168] Figure 27 is a sequence diagram illustrating the process flow for creating the project proposal in S2602.

[0169] In S2701, the type and length of the video received in S2601, the message to be conveyed in the video (information related to video generation), and the budget are sent to the application server 102. In S2702, the application server 102 sends a prompt to the generation AI server 103 for creating a question based on the video generation information and budget received in S2701.

[0170] In S2703, the AI ​​(AI Strategist) 1105 of the first role of the generation AI server 103 creates a question from the prompt received in S2702. Specifically, in S2702, a basic prompt and a prompt for question generation are sent to the AI ​​(AI Strategist) 1105 of the first role. The basic prompt defines the basic thinking patterns and approaches to the problem as a strategist and is set to extract the information necessary for creating the proposal. The prompt for question generation includes instructions to analyze the content of the information related to video generation and check for any excesses or deficiencies, and is set to ask questions about any deficiencies by comparing the information from coarse to fine granularity with the information necessary for creating the proposal.

[0171] The first role of AI 1105 is that of a strategist, and its role is to faithfully determine the overall direction and purpose of the video based on the type of video input and the answers to the questions, and to clarify the message and concept that the video should convey. The first role can be set by sending a prompt to the generating AI server 103 from the application server 102 that includes the name "strategist," the strategist's duties such as planning, the strategic perspective and other expertise required of the strategist, the strategist's functions, or any combination thereof. Such a prompt may be sent in S2702 or before S2701.

[0172] Next, in S2706, the information processing device 101 receives the answer to the question, and in S2707, the received answer is sent to the application server 102. In the input fields 1102, 1104, etc. in Figure 11A, examples of suggested answers 1107 to the question are displayed based on the type of video received in S2601. The examples of suggested answers 1107 to the question are generated in S2702 by the AI ​​(AI Strategist) 1105 of the first role of the generation AI server 103 from the prompt received in S2702, based on the video generation information and budget received in S2701. The user refers to the example answer 1107 and enters the answer in the input fields 1102, 1104, etc. in Figure 11A. Also, when input is received to the instruction unit 1109 while the example answer 1107 is displayed, the example answer 1107 is entered as text 1110 in the input fields 1102, 1104 (see Figure 11B). In S2708, the application server 102 sends a prompt to the generation AI server 103 for creating a project proposal based on the response received in S2707.

[0173] Furthermore, in S2707, the response received in S2706 and the budget received in S2601 may be sent to the application server 102, and in S2708, the application server 102 may send a prompt to the generation AI server 103 for creating a project proposal based on the response and budget received in S2707.

[0174] In S2709, the generating AI server 103 creates a project proposal using the processing of the first role AI 1105 based on the received prompt, and in S2710, it sends the created project proposal to the application server 102. The web page information creation unit 316 of the application server 102 creates a web page containing the project proposal, and in S2711, the web page information transmission / reception unit 317 sends the web page containing the project proposal to the information processing device 101. In S2712, the received project proposal 1209 and the comments 1203 from the second role AI (AI creative director) 1201 are displayed on the display unit 208 of the information processing device 101. Also in S2712, while the project proposal 1209 is displayed, a review button 1204, which is an instruction unit for accepting a review of the project proposal by the second role AI 1201, is displayed on the display unit 208.

[0175] Note that the processes S504, S505, and S513-S526 in Figure 27 are the same as those in S504, S505, and S513-S526 in Figure 5, so their explanation is omitted.

[0176] Figure 28 is a sequence diagram illustrating the process flow for concept creation in S2603.

[0177] In S641, the budget is entered into the instruction unit 1222 (second reception unit) in Figure 30. This budget is the cost incurred by the photographer when shooting, using the storyboard created in S406 of Figure 26 as a reference. For example, it includes the rental fee for the shooting location, the fees paid to the talent who is the subject of the shoot, and the rental fee for equipment such as cameras and lenses used for shooting. Furthermore, it may also include the personnel costs of art staff, lighting staff, and sound staff involved in the shoot.

[0178] In addition, in S641, the allocation ratios of multiple elements that make up the budget may be input in addition to the budget itself. For example, the allocation ratios of budgets such as filming location, talent, equipment, and personnel costs may be directly input into the instruction unit 1215, or the allocation ratios may be indicated by moving the arrows 1213 and 1214. The size 1216 of each area corresponds to the allocation ratio, and the allocation ratios of filming location and talent can be changed by changing the arrow 1213 at the boundary between filming location and talent, and the allocation ratios of talent and equipment can be changed by changing the arrow 1214 at the boundary between talent and equipment.

[0179] The budget for each element is determined based on the budget entered into the instruction unit 1222 and the allocation ratio of the elements entered. For example, if a budget of "2000" is entered into the instruction unit 1222, and the ratios for location, talent, and equipment are specified as 60%, 30%, and 10%, the budgets for location, talent, and equipment will be 2000 x 0.6 = "1200", 2000 x 0.3 = "600", and 2000 x 0.1 = "200", respectively.

[0180] In S642, in accordance with the acceptance of input to the instruction unit 1230 in Figure 30, the information processing device 101 sends a budget and a concept generation instruction to the application server 102. Alternatively, the budget, budget allocation ratio, and concept generation instruction may be sent, and in S643, the budget, budget allocation ratio, and concept generation instruction may be sent. In S644, multiple concepts are created from the project proposal and budget created in S2602. For example, multiple concepts are created from the project proposal and budget so that the contents of the project proposal stay within the budget. For example, as shown in Figure 13, a first concept 1305 and a second concept 1306 that stay within the budget are generated. Alternatively, in S644, multiple concepts may be created from the project proposal, budget, and allocation ratio created in S2602. For example, if the ratio of shooting locations is high and the ratio of talent and equipment is low, shooting is possible in many locations or luxurious locations, but a concept is created that minimizes the number of talents and shoots are carried out by renting inexpensive equipment. Furthermore, if the ratio of filming locations is low and the ratio of talent to equipment is high, filming will be done in locations with fewer or lower costs, a concept will be created that features many talents, and expensive equipment will be rented for filming.

[0181] Before deciding on a concept, the necessary budget for filming is entered in advance. A concept is then generated that allows for a filming plan within that budget. Based on this generated concept, a storyboard is created. This prevents exceeding the budget during filming, which is based on the storyboard. It avoids having to recreate the video production design information from scratch due to budget overruns, and reduces the processing load on the device that generates the proposal, concept, storyline, and storyboard. Note that video production design information refers to at least one of the following: proposal, concept, storyline, images, and storyboard.

[0182] Furthermore, when entering a budget into the instruction unit 1222 in Figure 30, it is not necessary to enter the budget into the reception unit 2904 in Figure 29; it is sufficient to enter the budget at least once. Also, when entering a budget into the reception unit 2904 in Figure 29, it is not necessary to enter the budget into the instruction unit 1222 in Figure 30; it is sufficient to enter the budget at least once.

[0183] Furthermore, in the embodiment where the budget is received at S2601 in Figure 26 using the reception unit 2904 in Figure 29 before the proposal is created, the purpose is to understand the scale of the budget, so detailed budget allocation ratios are not necessary, and it is sufficient to input only an estimated total budget.

[0184] Alternatively, in S641, different budgets may be entered into each of the instruction units 1216 to 1218 in Figure 31. In that case, in S644, a concept corresponding to each budget is created.

[0185] In S645, the generation AI server 103 transmits multiple concepts to the application server 102. The application server 102's web page information creation unit 316 creates a web page containing the multiple concepts, and in S646, the web page information transmission / reception unit 317 transmits the web page containing the concepts to the information processing device 101.

[0186] In S647, the comments 1304 of the third role AI 1303 (copywriter) and the multiple concepts received in S646 are displayed on the display unit 208.

[0187] Note that the processes S602 to S619 in Figure 28 are the same as those in Figure 6, so their explanation is omitted.

[0188] Figure 35 is a flowchart showing the process of updating a concept executed by the information processing device 101. The control program for the flowchart shown in Figure 35 is stored in the storage device 205 of the information processing device 102 and is read into the RAM 204 by the CPU 202 and executed.

[0189] In S3501, if a command to generate a concept is received via button 1230 in Figure 30, the process proceeds to S3502. In S3502, if a budget is entered in the instruction unit 1222 in Figure 30, it is determined that the budget has been received, and the process proceeds to S3503. If no budget is entered in the instruction unit 1222 in Figure 30, it is determined that the budget has not been received, and the process proceeds to S3504.

[0190] In S3503, the entered budget and concept generation instructions are sent to the application server 102. In S3504, the concept generation instructions are sent to the application server 102.

[0191] In S3505, multiple concepts are received from the application server 102 and displayed on the display unit 208 of the information processing device 101.

[0192] Next, in S3506, when a selection of a concept is received from among the displayed multiple concepts, in S3507, the selected concept is displayed on the display unit 208 of the information processing device 101.

[0193] Alternatively, in S3502, the instruction unit 1215, arrows 1213 and 1214 in Figure 30 may be operated to receive the budget and the allocation ratios of multiple elements that constitute the budget, and in S3503, the budget, allocation ratios, and concept generation instructions may be sent to the application server 102.

[0194] Furthermore, as shown in Figure 33, by checking checkbox 3301, the series of storyboards displayed in S907 can be sorted and displayed by location. This allows the cameraman to easily recognize the storyboard for each location when shooting video by referring to the storyboards.

[0195] Furthermore, as shown in Figure 34, by checking checkbox 3401, the series of storyboards displayed in S907 can be divided into storyboards for which a shooting plan can be proposed and storyboards for which a shooting plan is difficult to propose and which are generated by AI. For example, a storyboard showing the city center is classified as a storyboard generated by AI because it is determined that a shooting plan cannot be proposed as it would require traffic restrictions in the city area for filming, making filming impractical.

[0196] Furthermore, the storyboard generated in S406 of Figures 4 and 26 may be stored in the storage device 205 of the information processing device 101 along with the shot list and used as a navigator during shooting. Here, the shot list is a document created after the storyboard is made that summarizes the types of shots required for the scene, outdoor and indoor locations, and an overview of the characters and shots. The shooting data actually shot according to this navigator is linked to the storyboard. In addition, the shooting data may be sorted according to the order of the storyboard and stored in the storage device 205 of the information processing device 101.

[0197] Before the concept is finalized, the budget required for filming is entered in advance. However, after the storyboard is completed, the user may review the storyboard content, revise the budget, and recreate the storyboard. Recreation can be done by returning to S2603 in Figure 26 and recreating the concept, storyline, images, and storyboard, or by returning to S406 in Figure 26 and recreating the storyboard. In the screen shown in Figure 32, the revised budget is entered into the instruction unit 3230. Also, in the screen shown in Figure 32, the allocation ratio of the budget elements can be changed.

[0198] In this embodiment, the process of creating a storyboard using the flowchart in Figure 26 has been described, but it is not necessary to execute all the processes in Figure 26, and only some of the processes in Figure 26 may be executed. For example, S2601 to S2602 may be executed to create a video proposal, S2601 to S2603 may be executed to create a video concept, or S2601 to S404 may be executed to create a video storyline.

[0199] Furthermore, in this embodiment, although Figure 1 describes a configuration in which the information processing device 101, application server 102, and generation AI server 103 are connected via a network, the program stored in the application server 102 (Figure 3B) may be stored in the information processing device 101, and the flowcharts shown in Figures 26 to 28 may be executed in the information processing device 101 without using the application server 102. In that case, the information processing device 101 and the generation AI server 103 communicate directly via the network.

[0200] Furthermore, although this embodiment describes an example using the generation AI server 103, it is also possible to store a lookup table (LUT) in the storage device 215 of the application server 102 and perform each process using the LUT without using the generation AI server 103. For example, in S2702 of Figure 27, an LUT that takes information related to video generation as input and outputs a question may be used, or in S505 of Figure 27, an LUT that takes the answer to the question as input and outputs a project proposal may be used. When performing each process using an LUT, as shown in Figure 3D, the application server 102 has a project proposal creation unit 311, a concept creation unit 312, a storyline creation unit 313, an image creation unit 314, and a storyboard creation unit 315.

[0201] When using an LUT, the number of input / output patterns is limited, but when using the generation AI server 103, a larger number of input / output patterns can be used than when using an LUT, thus enabling high-precision output for a given input.

[0202] According to this embodiment, information for video production can be created and displayed within the budget for the accepted filming. This prevents exceeding the filming budget after generating the storyboard, avoids the need to recreate the proposal, concept, storyline, and storyboard from scratch, and reduces the processing load on the device that generates the proposal, concept, storyline, and storyboard.

[0203] This disclosure can also be implemented by supplying a program that implements one or more of the functions of the embodiments described above to a system or device via a network or storage medium, and by a computer in that system or device reading and executing the program. The computer has one or more processors or circuits and may include a plurality of separate computers or a network of a plurality of separate processors or circuits for reading and executing computer executable instructions.

[0204] A processor or circuit may include a central processing unit (CPU), a microprocessing unit (MPU), a graphics processing unit (GPU), an application-specific integrated circuit (ASIC), or a field-programmable gateway (FPGA). Alternatively, a processor or circuit may include a digital signal processor (DSP), a dataflow processor (DFP), or a neural processing unit (NPU).

[0205] While various embodiments have been described in detail above, it should be understood that this disclosure is not limited to these embodiments and encompasses all modifications, variations, substitutions, and equivalents included in the claims.

[0206] This disclosure is not limited to the embodiments described above, and various modifications and alterations are possible without departing from the spirit and scope of this disclosure. Accordingly, the following claims are attached to make the scope of this disclosure public.

[0207] This application claims priority based on European Patent Application No. 25159754.8, filed on 24 February 2025, the entire contents of which are incorporated herein by reference.

Claims

1. An information processing system comprising an information processing device and a server device, wherein the server device has a transmission means for transmitting information for video production generated using a first process having a first role to the information processing device, the information processing device has a display control means for displaying the information for video production on a display unit, an instruction unit which does not accept character input from a user and accepts a review of the information for video production by a second process having a second role, the display control means displays the instruction unit on the display unit while the information for video production is displayed on the display unit, and the display control means displays improvements to the information for video production generated using the second process having a second role and the information for video production on the display unit in accordance with the instructions to the instruction unit.

2. The information processing system according to claim 1, characterized in that the instruction unit is located closer to the location of the comment by the second role than to the location of the comment by the first role.

3. The information processing system according to claim 1 or 2, characterized in that, if the display control means does not receive instructions to the instruction unit, it does not generate the improvements and does not display the improvements on the display unit.

4. The information processing system according to any one of claims 1 to 3, characterized in that the instruction unit displays text indicating the content of the request for review.

5. The information processing system according to any one of claims 1 to 4, characterized in that the display control means displays an instruction unit on the display unit that receives instructions to reflect the improvements while the improvements are displayed on the display unit, and displays information reflecting the improvements generated in accordance with the input to the instruction unit on the display unit.

6. The information processing system according to any one of claims 1 to 5, characterized in that the instruction unit that receives input reflecting the improvements is located near the improvements.

7. The information processing system according to any one of claims 1 to 6, characterized in that the display control means displays a reception unit for receiving opinions on the information for video production on the display unit while the information for video production and the improvements are displayed on the display unit.

8. The information processing system according to any one of claims 1 to 7, wherein the information processing device has a receiving means for receiving the type of video, and the information for video production is information generated based on the type of video.

9. The information processing system according to any one of claims 1 to 8, characterized in that the receiving means can receive images by dragging and dropping the images.

10. An information processing system comprising an information processing device and a server device for generating information for video production, wherein the information processing device includes a receiving means for receiving the type of video, and a first transmitting means for transmitting the type of video received by the receiving means to the server device, the server device includes a receiving means for receiving information generated from the type of video using an AI of a first role, the information processing device further includes a display control means for displaying the information on a display unit, the display control means displays an instruction unit on the display unit for receiving a review of the information by an AI of a second role, and while the information is displayed on the display unit, the system displays improvements to the information generated using the AI ​​of a second role on the display unit in accordance with the instructions to the instruction unit.

11. An information processing system comprising an information processing device and a server device for generating documents for video production, wherein the server device has receiving means for receiving documents generated using a first-role AI, the information processing device has display control means for displaying the documents on a display unit, and the display control means is characterized by having an instruction unit for receiving a review of the documents by a second-role AI, displaying the documents on the display unit, and displaying on the display unit improvements to the documents generated using the second-role AI in accordance with the instructions to the instruction unit, and an instruction unit for reflecting the improvements in the documents.

12. A control method for an information processing device that can communicate with a server device, comprising: a reception step for receiving information related to video generation; a transmission step for transmitting the information related to video generation received by the reception step to the server device; a display control step for displaying information for video production generated from the information related to video generation using a first information processing having a first role on a display unit; and an instruction unit that does not accept text input from a user and accepts a review of the information for video production by a second processing having a second role, wherein, while the information for video production is displayed on the display unit, the display control step displays the instruction unit on the display unit and, in accordance with the instructions to the instruction unit, displays improvements to the information for video production generated using a second information processing having a second role on the display unit.

13. The information processing system according to claim 12, characterized in that the instruction unit is located closer to the location of the comment by the second role than to the location of the comment by the first role.

14. The information processing system according to claim 12 or 13, characterized in that the display control means displays an instruction unit on the display unit that receives instructions to reflect the improvements while the improvements are displayed on the display unit, and displays information reflecting the improvements generated according to the input to the instruction unit on the display unit.

15. A control method for an information processing system comprising an information processing device and a server device, wherein the server device performs a transmission step of transmitting information for video production generated using a first information processing having a first role to the information processing device; the information processing device performs a display control step of displaying the information for video production on a display unit; in the display control step, the information processing device does not accept character input from a user, but displays an instruction unit on the display unit that accepts a review of the information for video production by a second processing having a second role, while the information for video production is displayed on the display unit; and in the display control step, the information processing device displays improvements to the information for video production generated using the second information processing having a second role and the information for video production on the display unit in accordance with the instructions to the instruction unit.

16. An information processing system comprising an information processing device and a server device, wherein the information processing device has a first receiving unit for receiving information relating to video generation, a second receiving unit for receiving budget information relating to the budget for video shooting, a display unit for displaying information, and a control unit for controlling the display of the display unit, and the server device has a communication unit for transmitting the information relating to video generation and the budget information to an external device and for receiving design information for video production created by the external device, wherein the control unit displays the created design information for video production on the display unit.

17. The information processing system according to 16, characterized in that the information relating to video generation includes at least one of the type of video, the length of the video, and the purpose of the video, and the design information for video production includes at least one of the proposal, concept, storyline, images, and storyboard.

18. The information processing system according to claim 16 or 17, which creates a video production plan based on the video generation information and creates a video production concept based on the plan and budget information.

19. The information processing system according to any one of paragraphs 16 to 18, characterized in that the design information for the video production includes a storyboard, after the storyboard is created, the second receiving unit receives revised budget information to modify the budget information, and the revised storyboard is recreated based on the revised budget information.

20. The information processing system according to any one of paragraphs 16 to 19, characterized in that the budget information includes the total amount of the budget or information on the allocation of the budget to the budget components constituting the budget.

21. The information processing system according to claim 20, characterized in that the budget component includes at least one of a filming location, a talent who is the subject of filming, and equipment used for filming.

22. The information processing system according to any one of claims 16 to 21, characterized in that the control unit displays a concept and a storyboard capable of proposing a shooting plan within the budget information.

23. The information processing system according to any one of claims 16 to 22, characterized in that the first receiving unit receives a plurality of budget information, and the control unit displays the video production design information for each of the plurality of budget information on the display unit.

24. The information processing system according to any one of claims 16 to 23, characterized in that the design information for the video production includes a plurality of storyboards, and the control unit displays the plurality of storyboards created from the plurality of budget information for each location, using information indicating the location where the video associated with each storyboard is to be filmed.

25. The information processing system according to any one of claims 16 to 23, characterized in that the design information for the video production includes a plurality of storyboards, and the control unit displays the plurality of storyboards separately into storyboards that can propose a shooting plan and storyboards that are recommended to be generated by AI.

26. An information processing system comprising an information processing device and a server device, wherein the information processing device comprises: a first receiving unit that receives information relating to video generation; a control unit that displays a project proposal created from the video generation information using an AI of a first role on a display unit; and a second receiving unit that receives budget information relating to the budget for video shooting, wherein the control unit displays a concept created based on the project proposal and the budget information on the display unit.

27. The information processing system according to claim 26, wherein the budget information includes the total amount of the budget or information on the allocation of the budget to budget components constituting the budget.

28. A computer control method, characterized in that the computer performs a reception step of receiving information relating to video generation and budget information relating to the budget for video shooting, and a control step of displaying video production design information created from the video generation information and budget information received in the reception step to a display unit.

29. A computer control method, characterized in that the computer performs: a first reception step of receiving information relating to video generation; a proposal control step of displaying a proposal created from the video generation information using an AI of a first role on a display unit; a second reception step of receiving budget information relating to the budget for video shooting; and a concept control step of displaying a video concept created based on the video generation information and the budget information on the display unit.

Images