Electronic apparatus and moving image management method

The electronic device and method facilitate video shooting and editing by enabling scenario creation, long-take shooting, and group management, addressing the challenge of managing multiple cuts in video production workflows.

JP2025155946APending Publication Date: 2025-10-14PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2025030428
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-03-28
Filing Date
2025-02-27
Publication Date
2025-10-14

AI Technical Summary

Technical Problem

Existing video management systems struggle to efficiently manage video shooting across multiple cuts in a scenario, lacking comprehensive tools for scenario creation, long-take shooting, and seamless integration with video editing processes.

Method used

An electronic device and method that includes a digital camera and an information support terminal, enabling scenario creation, long-take shooting, and video editing by allowing users to set groups of cuts, display group information, and facilitate video management through a series of functions and screens, including scenario input, cut shooting, and export for editing.

Benefits of technology

Enhances video shooting management across multiple cuts by providing intuitive scenario creation, long-take shooting capabilities, and streamlined video editing, improving user convenience and efficiency in video production workflows.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025155946000001_ABST
    Figure 2025155946000001_ABST
Patent Text Reader

Abstract

To provide an electronic apparatus and a moving image management method which facilitate management of a moving image shooting over a plurality of cuts in a scenario.SOLUTION: An imaging system includes an information support terminal, which is an example of an electronic apparatus composed of a digital camera, a smartphone, a tablet terminal, and the like and a moving image editing personal computer (PC). An information support terminal (200) that manages moving image shooting in a scenario including a plurality of cuts includes: a display part (240) that displays information; an input part (230) that inputs an operation of a user; and a control part (210) that controls the display part in accordance with the operation input by the input part. The control part receives a user operation of setting a group including one set of cuts among the plurality of cuts, on the touch panel, and causes the display unit to display group information for managing moving image photographing in the group based on the setting of the group.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to an electronic device and a video management method for managing video shooting in a scenario including multiple cuts. [Background technology]

[0002] Patent Document 1 discloses a video program production support system that allows a scenario in electronic file format to be used consistently from the planning and composition stage to the editing stage. The video program production support system includes an imaging device that creates take metadata from the composition sheet metadata for each take and associates the take's content data and take metadata with cuts in the program metadata. When shooting a selected cut is completed, if only one take is associated with that cut, the imaging device is automatically configured to mark that take as OK (adopted). On the other hand, if multiple takes are associated with that cut, the system is configured to mark one take as OK and mark the others as NG (rejected) based on the cameraman's OK / NG selection operation.

[0003] Patent Document 2 discloses an electronic device that displays images representing content in a suitable manner to improve user convenience. This electronic device displays a selection image representing one piece of content included in a corresponding group on a timeline that displays multiple zones corresponding to multiple groups along a time axis. Furthermore, this electronic device displays, in association with the zone, non-selection images representing content that is not the content of the selected image among the multiple pieces of content included in the group corresponding to the zone. Patent Document 2 discloses arranging multiple thumbnail images of the same group, such as selected and non-selection images, in the order in which the video was recorded. This allows the user to understand the number of times the video was shot simply by checking the order in which the thumbnail images are arranged. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-187275 [Patent Document 2] Japanese Patent Publication No. 2020-102821 Summary of the Invention [Problem to be solved by the invention]

[0005] The present disclosure provides an electronic device and a video management method that can facilitate management of video shooting across multiple cuts in a scenario. [Means for solving the problem]

[0006] In the present disclosure, the electronic device is an electronic device that manages video shooting for a scenario including multiple cuts. The electronic device includes a display unit that displays information, an input unit that inputs user operations, and a control unit that controls the display unit in response to the operations input via the input unit. The control unit receives a user operation via the input unit to set a group including one set of cuts from the multiple cuts, and causes the display unit to display group information that manages video shooting for the group based on the group setting.

[0007] In the present disclosure, a video management method is a method for managing videos in a scenario including multiple cuts, in which a control unit of an electronic device receives a user operation via an input unit to set a group including one set of cuts from the multiple cuts, and causes a display unit to display group information for managing video shooting in the group based on the group setting. [Effects of the Invention]

[0008] The electronic device and video management method disclosed herein can facilitate management of video shooting across multiple cuts in a scenario. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 illustrates an example of the configuration of an imaging system according to a first embodiment of the present disclosure. [Figure 2] FIG. 1 is a diagram showing the configuration of a digital camera in an imaging system. [Figure 3] FIG. 1 is a diagram showing the configuration of an information support terminal in an imaging system. [Figure 4] FIG. 10 is a diagram showing an example of a function selection screen displayed on an information support terminal. [Figure 5] FIG. 1 is a diagram for explaining an overview of long-take shooting in an imaging system. [Figure 6] FIG. 10 shows an example of a scenario input screen displayed on an information support terminal. [Figure 7] FIG. 10 is a diagram illustrating the data structure of cut data in an information support terminal; [Figure 8] 1 is a flowchart illustrating a long take setting process in an imaging system; [Figure 9] FIG. 10 is a diagram showing a display example of a long take setting process on an information support terminal. [Figure 10] FIG. 10 is a diagram showing an example of a cut selection screen displayed on an information support terminal. [Figure 11] 10 is a flowchart illustrating an example of the operation of the cut photography function in the imaging system; [Figure 12] FIG. 10 is a diagram showing an example of a rating screen displayed on an information support terminal. [Figure 13] 10 is a flowchart illustrating a cut list generation process in an imaging system. [Figure 14] Diagram to explain cut list filtering [Figure 15] A diagram showing an example of a cut list when there are additional cuts [Figure 16] 10 is a flowchart illustrating a process in a recording mode in an imaging system; [Figure 17] FIG. 10 is a diagram showing a display example in a recording mode of the information support terminal. [Figure 18] FIG. 10 is a diagram illustrating an example of the data structure of video metadata in an information support terminal. [Figure 19] 10 is a flowchart illustrating a process in a playback mode in an imaging system; [Figure 20] FIG. 10 is a diagram showing a display example in a playback mode of the information support terminal. [Figure 21] A diagram showing an example of the video management screen for long-take groups displayed on an information support terminal. [Figure 22] A diagram showing an example of a video editing screen display on a video editing PC of an imaging system. [Figure 23] 10 is a flowchart illustrating the operation of an export function in an imaging system. [Figure 24] A diagram showing a display example of the export function of the information support terminal. [Figure 25] A diagram illustrating a video folder on a video editing screen. [Figure 26] A diagram illustrating a video timeline on a video editing screen. [Figure 27] 10 is a flowchart illustrating a folder configuration process in an imaging system; [Figure 28] FIG. 10 is a diagram illustrating an example of the data structure of management data obtained by folder configuration processing; [Figure 29] 1 is a flowchart illustrating a timeline setting process in an imaging system; [Figure 30] FIG. 10 is a diagram illustrating an example of the data structure of management data in a timeline setting process. [Figure 31] FIG. 1 is a diagram illustrating a modified example of a digital camera. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, detailed descriptions of well-known matters and redundant descriptions of substantially identical configurations may be omitted. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0011] (Embodiment 1) In the first embodiment of the present disclosure, a system using an electronic device separate from an imaging device that performs video shooting will be described.

[0012] 1. Configuration An imaging system according to the first embodiment of the present disclosure will be described with reference to FIG.

[0013] 1, the system 10 includes a digital camera 100, an information support terminal 200, and a video editing personal computer (PC) 300. In the system 10, the digital camera 100 and the information support terminal 200 are connected to each other so that data can be communicated therebetween, for example, via wired or wireless communication.

[0014] This system 10 can be used, for example, when a user creates a desired video work by shooting and editing multiple videos using a digital camera 100. This system 10 provides useful information support for a series of workflows, such as when a user creates a scenario that outlines the concept of the video work, repeatedly shoots videos according to multiple cuts that divide the scenario, and edits the multiple shot videos.

[0015] In the present system 10, the information support terminal 200 can, for example, manage the scenario of a video work and control the digital camera 100 to manage video shooting for each cut. For example, a live view image of the digital camera 100 can be confirmed on the information support terminal 200. Video data captured by the digital camera 100 is edited on a video editing PC 300. The present system 10 uses data managed on the information support terminal 200 to facilitate video editing on the video editing PC 300 or the like.

[0016] In the present system 10, the video editing PC 300 may or may not be communicatively connected to one or both of the digital camera 100 and the information support terminal 200. For example, data from the digital camera 100 and / or the information support terminal 200 may be input to the video editing PC 300 via a portable recording medium such as a memory card. The present system 10 does not necessarily have to include the video editing PC 300.

[0017] 1.1.Digital camera configuration The configuration of the digital camera 100 according to this embodiment will be described with reference to FIG.

[0018] 2 is a diagram illustrating an example of the configuration of a digital camera 100 in the system 10. The digital camera 100 is an example of an imaging device in this embodiment. The digital camera 100 of this embodiment includes an image sensor 115, an image processing engine 120, a display monitor 130, and a control unit 135. The digital camera 100 also includes a buffer memory 125, a card slot 140, a flash memory 145, an operation unit 150, a communication module 155, a microphone 160, and a speaker 170. The digital camera 100 also includes, for example, an optical system 110 and a lens driving unit 112.

[0019] The optical system 110 includes a focus lens, a zoom lens, an optical image stabilization lens (OIS), an aperture, a shutter, etc. The focus lens is a lens for changing the focus state of the subject image formed on the image sensor 115. The zoom lens is a lens for changing the magnification of the subject image formed by the optical system. Each of the focus lens, etc. is composed of one or more lenses.

[0020] Lens driving unit 112 drives the focus lens and the like in optical system 110. Lens driving unit 112 includes a motor, and moves the focus lens along the optical axis of optical system 110 under the control of control unit 135. The configuration for driving the focus lens in lens driving unit 112 can be realized by a DC motor, a stepping motor, a servo motor, an ultrasonic motor, or the like.

[0021] The image sensor 115 captures an image of a subject formed via the optical system 110 and generates imaging data. The imaging data constitutes image data representing an image captured by the image sensor 115. The image sensor 115 generates new frame image data at a predetermined frame rate (e.g., 30 frames / second). The timing of generating imaging data and the electronic shutter operation in the image sensor 115 are controlled by the control unit 135. The image sensor 115 can be any of a variety of image sensors, such as a CMOS image sensor, a CCD image sensor, or an NMOS image sensor.

[0022] The image sensor 115 performs operations such as capturing still images and through images. Through images are mainly moving images, and are displayed on the display monitor 130 so that the user can determine the composition for capturing the still image. The through images and still images are each an example of a captured image in this embodiment. The image sensor 115 is an example of an imaging unit in this embodiment.

[0023] The image processing engine 120 performs various processes on the imaging data output from the image sensor 115 to generate image data, and performs various processes on the image data to generate an image to be displayed on the display monitor 130. The various processes include, but are not limited to, white balance correction, gamma correction, YC conversion processing, electronic zoom processing, compression processing, and expansion processing. The image processing engine 120 may be configured with a hardwired electronic circuit, or may be configured with a microcomputer, processor, or the like using a program.

[0024] The display monitor 130 is an example of a display unit that displays various information. For example, the display monitor 130 displays an image (through image) represented by image data captured by the image sensor 115 and processed by the image processing engine 120. The display monitor 130 also displays a menu screen or the like that allows the user to make various settings for the digital camera 100. The display monitor 130 can be configured, for example, by a liquid crystal display device or an organic EL device.

[0025] Operation unit 150 is a general term for hard keys such as operation buttons and operation levers provided on the exterior of digital camera 100, and accepts operations by the user. Operation unit 150 includes, for example, a release button, a mode dial, and a touch panel. When operation unit 150 accepts an operation by the user, it transmits an operation signal corresponding to the user operation to control unit 135.

[0026] The control unit 135 controls the overall operation of the digital camera 100. The control unit 135 includes a CPU and the like, and the CPU executes a program (software) to realize predetermined functions. Instead of a CPU, the control unit 135 may include a processor configured with a dedicated electronic circuit designed to realize the predetermined functions. In other words, the control unit 135 can be realized by various processors such as a CPU, MPU, GPU, DSP, FPGA, ASIC, etc. The control unit 135 may be configured with one or more processors. Furthermore, the control unit 135 may be configured on a single semiconductor chip together with the image processing engine 120, etc.

[0027] The buffer memory 125 is a recording medium that functions as a work memory for the image processing engine 120 and the control unit 135. The buffer memory 125 is realized by a DRAM (Dynamic Random Access Memory) or the like. The flash memory 145 is a non-volatile recording medium. Although not shown, the control unit 135 may have various types of internal memory, for example, a built-in ROM. The ROM stores various programs executed by the control unit 135. The control unit 135 may also have a built-in RAM that functions as a work area for the CPU.

[0028] The card slot 140 is a means for inserting a removable memory card 142. The card slot 140 can electrically and mechanically connect the memory card 142. The memory card 142 is an external memory equipped with a recording element such as a flash memory inside. The memory card 142 can store data such as image data generated by the image processing engine 120.

[0029] The communication module 155 is a module (circuit) that connects to an external device in accordance with a predetermined communication standard for wired or wireless communication. The predetermined communication standard includes, for example, USB, HDMI (registered trademark), IEEE802.11, Wi-Fi, Bluetooth, etc. The digital camera 100 can communicate with other devices via the communication module 155.

[0030] The microphone 160 includes, for example, one or more microphone elements built into the digital camera 100. The microphone 160 outputs an audio signal indicating the picked-up sound to the control unit 135. The digital camera 100 may also use an external microphone. Instead of or in addition to the built-in microphone 160, the digital camera 100 may also include a connection unit such as a terminal for connecting to an external microphone.

[0031] The speaker 170 includes, for example, one or more speaker elements built into the digital camera 100, and outputs sound to the outside of the digital camera 100 under the control of the control unit 135. An external speaker, earphones, or the like may also be used with the digital camera 100. Instead of or in addition to the built-in speaker 170, the digital camera 100 may be provided with a connection unit for connecting to an external speaker, or the like.

[0032] 1.2.Configuration of information support terminal The configuration of the information support terminal 200 in this embodiment will be described with reference to FIG.

[0033] 3 is a diagram illustrating an example of the configuration of information support terminal 200. Information support terminal 200 is an example of an electronic device configured, for example, by a smartphone, a tablet terminal, or a PC. Information support terminal 200 illustrated in FIG. 3 includes a control unit 210, a storage unit 220, an operation unit 230, a display unit 240, a communication unit 250, a microphone 260, and a speaker 270.

[0034] The control unit 210 includes, for example, a CPU or MPU that works in cooperation with software to realize predetermined functions. The control unit 210 controls, for example, the overall operation of the information support terminal 200. The control unit 210 reads data and programs stored in the storage unit 220 and performs various arithmetic processing to realize various functions.

[0035] The control unit 210 executes, for example, a program including a set of instructions for implementing each of the above functions. The program may be provided via a communication network such as the Internet, or may be stored on a portable recording medium. The control unit 210 may also be a hardware circuit such as a dedicated electronic circuit or a reconfigurable electronic circuit designed to implement each of the above functions. The control unit 210 may also be configured with various semiconductor integrated circuits such as a CPU, MPU, GPU, GPGPU, TPU, microcomputer, DSP, FPGA, and ASIC.

[0036] The storage unit 220 is a storage medium that stores programs and data necessary to realize the functions of the information support terminal 200. The storage unit 220 includes a storage unit 221 and a temporary storage unit 222, as shown in FIG.

[0037] The storage unit 221 stores parameters, data, control programs, etc. for realizing predetermined functions. The storage unit 221 is configured, for example, with an HDD or SSD. For example, the storage unit 221 stores the above-mentioned programs and various image data, etc.

[0038] The temporary storage unit 222 is configured with a RAM such as a DRAM or an SRAM, and temporarily stores (i.e., holds) data. For example, the temporary storage unit 222 holds image data that is in the middle of being edited. The temporary storage unit 222 may also function as a work area for the control unit 210, and may be configured as a storage area in the internal memory of the control unit 210.

[0039] The operation unit 230 is a general term for operation members operated by the user. The operation unit 230 is, for example, a touch panel superimposed on the display unit 240 for inputting various touch operations, and is an example of an input unit of the information support terminal 200. The input unit may be a connection software unit that communicates with various external input devices and receives operation signals. The operation unit 230 may be physical buttons or switches provided on the information support terminal 200, or may be a keyboard, mouse, touchpad, or the like. The operation unit 230 may be various GUIs such as virtual buttons, icons, cursors, software keyboards, and objects displayed on the display unit 240.

[0040] The display unit 240 is configured with, for example, a liquid crystal display or an organic EL display. The display unit 240 may display various types of information, such as various GUIs for operating the operation unit 230 and information input from the operation unit 230.

[0041] The communication unit 250 is a module (circuit) that connects to an external device in accordance with a predetermined communication standard for wired or wireless communication. The predetermined communication standard includes, for example, USB, HDMI, IEEE802.11, Wi-Fi, Bluetooth, etc. The communication unit 250 may connect the information support terminal 200 to a communication network such as the Internet. The communication unit 250 is an example of an acquisition unit that receives various information from an external device or a communication network.

[0042] Microphone 260 includes, for example, one or more microphone elements built into information support terminal 200. Microphone 260 outputs an audio signal indicating the picked-up sound to control unit 210. Instead of or in addition to built-in microphone 260, information support terminal 200 may include a connection unit such as a terminal for connecting to an external microphone.

[0043] Speaker 270 includes, for example, one or more speaker elements built into digital camera 100, and outputs sound to the outside of information support terminal 200 under the control of control unit 210. Instead of or in addition to built-in speaker 270, information support terminal 200 may be provided with a connection unit for connecting to an external speaker, earphones, or the like.

[0044] The above-described configuration of information support terminal 200 is an example, and the configuration of information support terminal 200 is not limited to this. For example, various display devices such as a projector and a head-mounted display may be used for display unit 240 of information support terminal 200. Furthermore, when an external display device is used, display unit 240 of information support terminal 200 may be an output interface circuit for a video signal conforming to, for example, the HDMI standard.

[0045] 2. Operation The operation of the system 10 configured as above will be described below.

[0046] In the present system 10, the information support terminal 200 has various functions for sequentially providing information support to the user in the workflow of video production. An example of a screen display for selecting various functions of the information support terminal 200 is shown in FIG.

[0047] The display unit 240 of the information support terminal 200 displays a scenario creation button 11, a shooting button 12, and an export button 13 on the function selection screen illustrated in Fig. 4. Hereinafter, the longitudinal direction of the screen of the display unit 240 is referred to as the X direction, and the width direction is referred to as the Y direction.

[0048] The scenario creation button 11 is a virtual button that accepts user operation to execute a function (i.e., a scenario creation function) that provides information support for the process in which the user creates a scenario before shooting a video in the system 10. The information support terminal 200 of the system 10 manages various information for each cut, such as a shooting section that divides the scenario created in this way. A cut constitutes, for example, a section in multiple video shoots for a scenario.

[0049] The shooting button 12 is a virtual button for executing a function (i.e., a cut shooting function) that supports video shooting of each cut in a scenario created by, for example, the scenario creation function. The number of times a video is shot for one cut is not limited to one take, and multiple takes may be used. In this embodiment, the information support terminal 200 controls video shooting by the digital camera 100 in the cut shooting function and manages the shooting results for each cut.

[0050] The export button 13 is a virtual button for executing a function (i.e., an export function) that performs preprocessing for external output on the management results of video shooting using the cut shooting function and outputs the result. The preprocessing using the export function provides information support that makes it easier to edit multiple video shoot results according to a scenario on the video editing PC 300, for example.

[0051] The information support terminal 200 of this system 10 can provide consistent information support from scenario creation to pre-processing of video editing, for example, by the user sequentially using each function of the scenario creation button 11, shooting button 12, and export button 13.

[0052] In the present system 10, the function selection screen of the information support terminal 200 may further include a delete button for deleting various data in the information support described above. For example, in response to a user operation of the delete button, the information support terminal 200 may collectively delete video files of the same scenario.

[0053] 2.1. Long Take Shooting The system 10 provides information support that enables continuous video shooting across multiple cuts (i.e., long take shooting) in a scenario desired by the user, rather than just shooting individual cuts. An overview of such long take shooting will be explained using FIG. 5.

[0054] Fig. 5 is a diagram for explaining an overview of long take shooting in the present system 10. Fig. 5 shows an example of a case where long take shooting is performed on five cuts excluding the first cut among cut numbers "1" to "6".

[0055] It is assumed that a user of this system 10 may have a scene for which he or she wishes to shoot a video of one cut, such as cut number "1," and another scene for which he or she wishes to shoot a long take across multiple cuts, such as cut numbers "2" to "6." Therefore, this system 10 accepts a user operation to set a group of cuts to be shot in a long take, i.e., a long take group L, among the cuts in a scenario, as shown in Fig. 5, for example.

[0056] In the long take group L shown in Figure 5, the cuts with cut numbers "2" and "4" are set to a common angle A, while the cuts with cut numbers "3" and "6" are set to an angle B that is different from angle A. In addition, the cut with cut number "5" is set to an insert of a different kind from angles A and B.

[0057] In long-take shooting using the system 10, a user may wish to use video shot from different angles for each cut of the same scene, or to insert a video shot separately into a specific cut within the scene. Therefore, the system 10 provides settings such as various angles A, B, or inserts for each cut in the long-take group L. The system 10 accepts settings for long-take shooting made by the user using, for example, the scenario creation function, and reflects the settings for the long-take group L in subsequent cut shooting functions, etc. (details will be described later).

[0058] 2.2. About the Scenario Creation Function The scenario creation function of the information support terminal 200 of the present system 10 will be described with reference to FIGS.

[0059] Fig. 6 shows an example of a scenario input screen displayed on the information support terminal 200. When a user operation, such as tapping the scenario creation button 11 on the function selection screen of Fig. 4, is input from the operation unit 230, the control unit 210 of the information support terminal 200 causes the display unit 240 to display the scenario input screen as shown in Fig. 6.

[0060] The scenario input screen is a screen that allows the user to input a scenario into information support terminal 200 in the scenario creation function of system 10. As shown in Fig. 6, for example, the scenario input screen includes a storyboard input field 20 for each cut, cut edit button 14, long take setting button 18, long take range indicator 19, and back button 15. Control unit 210 of information support terminal 200 accepts various user operations related to the scenario input screen displayed on display unit 240 via operation unit 230.

[0061] In the information support terminal 200, a storyboard input field 20 accepts user input of information indicating a storyboard, such as an outline of the scenario concept, for each scene that constitutes a scenario. The storyboard input field 20 for each scene includes, for example, a composition field 21, a script field 22, a shooting time field 23, a shooting location field 24, and a memo field 25, as shown in FIG.

[0062] The composition field 21 accepts input of image information indicating the composition of the video of the corresponding cut. The input of image information may be a drawing by a user operation or may be a specification of image data. The script field 22 accepts text input such as a script divided into parts for the corresponding cut in the scenario.

[0063] The shooting time field 23 accepts a numerical input indicating the estimated length of time it will take to shoot the video of the cut. The shooting location field 24 accepts an input of information indicating the location where the video of the cut will be shot. The shooting location may be input as text, or data search may be used as appropriate. The memo field 25 accepts input of various information desired by the user regarding the shooting of the video of the cut, such as the shooting equipment, for example, as text.

[0064] 6, the display unit 240 displays storyboard input fields 20 for two cuts. The control unit 210 acquires storyboard information for each cut in accordance with user input into the various fields 21 to 25 in the storyboard input field 20 for each cut in the scenario. On the scenario input screen of the information support terminal 200, the storyboard input field 20 for the cut displayed on the display unit 240 can be changed, for example, in response to a swipe operation for scrolling in the X direction in which the storyboard input fields 20 for each cut are arranged.

[0065] The cut edit button 14 switches on / off a state in which various user operations can be input, such as adding, deleting, and changing the order of cuts to be included in the scenario. For example, by performing a touch operation while the cut edit button 14 is in the on state, the user can arrange the storyboard input fields 20 for the desired number of cuts in chronological order in the scenario.

[0066] The long take setting button 18 accepts a user operation to set a long take group L (FIG. 5) for multiple cuts in a scenario. This long take setting process will be described later. The long take range indicator 19 visualizes the range included in the long take group L for multiple cuts in a scenario, for example, by displaying an arrow along the storyboard input field 20. FIG. 6 shows an example where the long take group L of FIG. 5 has been set (same below).

[0067] The back button 15 accepts a user operation to go back one screen in the screen transition of the information support terminal 200. For example, the control unit 210 transitions the display unit 240 to the function selection screen (FIG. 4) in response to a user operation of the back button 15 on the scenario input screen (FIG. 6). The control unit 210 of this embodiment generates cut-out data including storyboard information for each cut as an output of such a scenario creation function and stores the cut-out data in the storage unit 220. An example of such cut-out data at the end of the scenario creation function is shown in FIG. 7.

[0068] 7, the cut data D1 manages, for each "cut number," a "script," a "composition," a "shooting time," a "shooting location," a "shooting completion flag," a "group number," an "angle name," and a "video metadata list." The cut data D1 is an example of management information in this embodiment.

[0069] The control unit 210 of the information support terminal 200 assigns cut numbers indicating identification information of the cuts in the cut allocation data D1 in ascending order in the storyboard input field 20 for each cut arranged on the scenario input screen, for example. Furthermore, if the order of the cuts is changed, the control unit 210 reassigns the cut numbers according to the changed order. For each cut, the control unit 210 records the information entered in the script field 22, composition field 21, shooting time field 23, shooting location field 24, and memo field 25 of the storyboard input field 20 in the "script," "composition," "shooting time," "shooting location," and "memo" fields of the cut allocation data D1, respectively.

[0070] In the cut division data D1, the "shooting completion flag" manages whether the shot in question has been shot or not by setting it to ON / OFF. When the scenario creation function is terminated, the shooting completion flag for all shots is set to OFF as the initial setting.

[0071] The "group number" is an identification number of the long take group L. The same group number is stored for cuts that belong to the same long take group L. Also, for cuts that do not belong to the long take group L, the "group number" in the cut division data D1 is, for example, a null value.

[0072] "Angle name" is the name of the angle set in the long take group L. The same angle name is stored for cuts that belong to a common angle in the long take group L. On the other hand, for an insert cut in the long take group L, the "angle name" in the cut division data D1 is, for example, a null value. Also, for cuts outside the long take group L, the "angle name" is a null value.

[0073] The "movie metadata list" is a list for storing metadata of the movie that is shot in association with the cut. When the scenario creation function is terminated, the movie metadata list is initially set to null.

[0074] As described above, the scenario creation function of the information support terminal 200 of this system 10 generates cut-by-cut data D1 from user input on the scenario input screen, thereby providing information support for the process of creating a scenario for the user's desired video work cut by cut.

[0075] The scenario creation function of information support terminal 200 is not particularly limited to the above. For example, information support terminal 200 may accept a user instruction to output storyboard information of a scenario entered on a scenario input screen using a data format (e.g., PDF format) that can be shared with another device, and output the data.

[0076] 2.2.1. Long take setting processing The process of making settings for long take shooting in the scenario creation function of the system 10 will be described with reference to FIGS.

[0077] Fig. 8 is a flowchart illustrating the long take setting process in the present system 10. The process shown in the flow of Fig. 8 is executed, for example, by the control unit 210 of the information support terminal 200. The process of this flow is started, for example, when the long take setting button 18 on the scenario input screen (Fig. 6) is operated.

[0078] First, the control unit 210 acquires the range of a long take group L spanning multiple cuts in a scenario (S21), for example, in accordance with a user operation on a scenario input screen on the operation unit 230. For example, the control unit 210 accepts a user operation to specify the first and last cuts in the long take group L by touching the scenario input screen.

[0079] The control unit 210 also determines a group number for the long take group L (S22). The user can set multiple long take groups L in the scenario. In this case, the control unit 210 assigns a different group number to each long take group L. The control unit 210 stores the determined group number in the "group number" field of each cut within the range of the long take group L in the cut division data D1.

[0080] Furthermore, the control unit 210 sequentially selects each cut in the long take group L in order to accept a user operation for detailed settings for long take shooting, for example (S23). An example of the display on the information support terminal 200 in step S23 is shown in FIG.

[0081] FIG. 9 shows an example of the individual setting dialog 17 that the display unit 240 displays superimposed on the scenario input screen (FIG. 6) when the cut with cut number "2" is selected in step S23. For example, the individual setting dialog 17 includes an angle / insert selection field 17a and an angle name input field 17b, and accepts user operations for detailed settings of long take shooting for each cut. The individual setting dialog 17 may further include input fields for the shooting time and shooting location of the cut. In this case, the input results are reflected appropriately in the storyboard input field 20.

[0082] For example, the control unit 210 accepts a user operation to select either "angle" or "insert" as options to be presented in the angle / insert selection field 17a (S24).

[0083] When the option "Angle" is selected by a user operation in the selection field 17a (YES in S24), the control unit 210 accepts a user operation in the input field 17b to set the cut to "Angle" and input the angle name of the cut (S25).

[0084] An "angle" is a setting for a cut that shows a specific viewpoint in a video that continues between cuts in a long take group L. One or more cuts can be set to one angle, and multiple cuts set to a common angle are an example of a set of cuts in this embodiment. In step S25, for example, an angle name entered for another cut may be presented as an input candidate.

[0085] On the other hand, if the option "angle" is not selected by the user's operation and the other option "insert" is selected (NO in S24), the control unit 210 sets the cut to "insert" (S26).

[0086] "Insert" is a setting for cuts in which individual cuts are shot within the range of long take group L. For example, a video of an insert cut can be inserted into the middle of a scene shot in a long take when editing a video. In step S26, for example, the angle name input field 17b is grayed out to indicate that input is disabled.

[0087] Next, the control unit 210 determines whether or not the above detailed settings have been made for all cuts in, for example, the long take group L (S27). If there are any cuts in the long take group L for which detailed settings have not yet been made (NO in S27), the control unit 210 repeats the processing from step S23 onwards for the unset cuts. In this way, detailed angle / insert settings are made for each cut in the long take group L (S24-S26).

[0088] When detailed settings for all cuts in the long take group L have been made (YES in S27), the control unit 210 saves various setting information so that the various settings for the long take group L are stored in, for example, the cut division data D1 (S28), and terminates the long take setting process (Figure 8).

[0089] According to the above-described long take setting process (FIG. 8), when a user creates a scenario using the scenario creation function, the system 10 can accept the user's setting of a long take group L during a cut in the scenario. The user can confirm the long take group L that has been set by using the long take range indicator 19 on the scenario input screen. Such long take range indicator 19 is an example of group information in the scenario input function of the system 10.

[0090] 2.3.About the Cut Shooting Function The outline of the operation of the cut-shot function in the information support terminal 200 of the system 10 will be described with reference to FIG.

[0091] 10 shows an example of a cut selection screen displayed on the information support terminal 200. The cut selection screen is a screen for the cut shooting function of the present system 10 to select a desired cut from among cuts provided by, for example, the scenario creation function. The cut selection screen is an example of a selection screen on the information support terminal 200 of this embodiment.

[0092] 10, the cut selection screen includes a cut list 30, a storyboard display field 31, a filter button 32, an add cut button 33, a recording mode button 34, a playback mode button 35, and a back button 15. The cut list 30 is a list that lists various cuts as options that the user can select. The storyboard display field 31 is a display field that displays storyboard information about the selected cut. The cut selection screen will be described in detail later.

[0093] In the cut shooting function of the present system 10, the information support terminal 200 provides information support that makes it easy for the user to comprehensively proceed with video shooting of each cut while checking various cuts, for example, by using a cut selection screen shown in Fig. 10. The user may shoot videos in an order different from the order of the cuts in the scenario, or may shoot multiple takes for one cut of video.

[0094] Therefore, the information support terminal 200 of the present system 10 accepts the user's evaluation of the video for each take of the selected cut when the video is being shot, manages whether or not the shot has been completed, and visualizes to the user the progress of video shooting for each cut in the cut list 30.

[0095] The cut selection screen of the example in Fig. 10 includes, for example, a long take range indicator 37 in the cut list 30, similar to the scenario input screen (Fig. 6). The long take range indicator 37 of this example visualizes the corresponding long take shooting range in the cut list 30 by setting the long take group L of the example in Fig. 5 in the long take setting process (Fig. 8) for example (see Figs. 10 and 15). The cut list 30 and the long take range indicator 37 are an example of group information in this embodiment.

[0096] For example, in the cut shooting function, the information support terminal 200 of the present system 10 also visualizes the progress of video shooting at various angles A, B, and inserts, depending on the prior setting of the long take group L. The operation of the present system 10 will be described in detail below.

[0097] 2.3.1. Overall operation of the snapshot function The overall operation of the cut photography function in the system 10 will be described with reference to FIGS.

[0098] Fig. 11 is a flowchart illustrating the operation of the shot shooting function in the system 10. Each process shown in the flowchart in Fig. 11 is executed, for example, by the control unit 210 of the information support terminal 200. The process of this flow starts, for example, when the shooting button 12 on the function selection screen (Fig. 4) is operated in a state where shot data D1 generated by the scenario creation function has been stored in the storage unit 220 and a communication connection with the digital camera 100 has been established in the communication unit 250.

[0099] First, the control unit 210 of the information support terminal 200 generates a cut list 30 to be displayed on the cut selection screen (FIG. 10) based on the cut layout data D1 (S1). The cut list generation process (S1) is repeatedly executed in the system 10, for example, while the cut shooting function is being executed, in accordance with the progress of video shooting and various user operations, and the cut list 30 is updated successively. The process of step S1 will be described in detail later.

[0100] Next, the control unit 210 causes the display unit 240 to display a cut selection screen, for example as shown in FIG. 10, based on the generated cut list 30 and the cut layout data D1 (S2).

[0101] The cut list 30 on the cut selection screen includes a plurality of cut icons 3, as shown in FIG. 10, for example. Each cut icon 3 represents an individual cut as an option. While FIG. 10 illustrates an example in which the selected cut icon 3 is cut number "2," the selected cut icon 3 is initially set to cut number "1," for example. For example, if the corresponding cut is set as an angle in long take group L, the angle name is displayed on the cut icon 3.

[0102] For example, the control unit 210 controls the display unit 240 to highlight the cut icon 3 indicating the selected cut (S2). The selected cut icon 3 is highlighted, for example, by displaying it in a larger size than the other cut icons 3 and by surrounding it with a frame in a highlighted color. The control unit 210 also references the cut allocation data D1 and causes the storyboard display field 31 to display storyboard information about the cut indicated by the selected cut icon 3 (S2). Furthermore, for example, if there is a cut (cut number "4" in this example) with the same angle as the selected cut icon 3 (cut number "2"), the corresponding cut icon 3 may be highlighted in a partially common manner, such as by surrounding it with a frame in the same color as the selected cut icon 3.

[0103] In the example of FIG. 10, cuts with cut numbers "1" and "3" are in an incomplete state, while cuts with cut numbers "2" and "4" are in a completed state. In the cut list 30 of this embodiment, the cut icon 3 has a display attribute that distinguishes between a completed state and an incomplete state. For example, these display attributes are set so that the display mode for the completed state highlights the display mode for the incomplete state. Furthermore, these display attributes are managed by, for example, the control unit 210 so that cuts in the long take group L have the same angle.

[0104] 10, the control unit 210 accepts various user operations on the operation unit 230, such as a touch panel, when the display unit 240 displays a cut selection screen (S3). The user operations targeted in step S3 include (I) a cut selection operation, (II) an operation to switch to a recording mode, (III) an operation to switch to a playback mode, (IV) a filtering operation, (V) an operation to add a cut, and (VI) an operation to end the operation.

[0105] The cut selection operation ((I) in S3) is a user operation for changing the selected cut, and is, for example, an operation of tapping a cut icon 3 other than the selected cut icon 3 in the cut list 30 displayed on the cut selection screen. The cut selection operation is not limited to this, and for example, a swipe operation in the storyboard display field 31 may be input as a cut selection operation for changing from the selected cut to an adjacent cut.

[0106] When a cut selection operation is input ((I) of S3), the control unit 210 changes the selected cut icon 3 in accordance with the input cut selection operation (S4), and performs the processes from step S2 onwards again. As a result, the selected cut icon 3 is changed on the cut selection screen, and the storyboard display column 31 for the newly selected cut is displayed (S2).

[0107] The transition operation to the recording mode ((II) of S3) is a user operation for transitioning to the recording mode, which is an operating mode for shooting video of the selected cut, and is, for example, a tap operation on the recording mode button 34. In addition to or instead of this, the transition operation may be a swipe operation in a predetermined direction of the ±X directions on the cut selection screen. Also, the recording mode button 34 may be omitted.

[0108] When an operation to switch to recording mode is input ((II) of S3), the control unit 210 executes various processes for recording one take of a moving image in association with the selected cut in recording mode (S5). An example of the display in step S5 is shown in FIG.

[0109] 12 shows an example of a rating screen displayed on information support terminal 200. The rating screen is a screen for prompting the user to rate the video of the captured take. The rating screen is an example of an evaluation screen on information support terminal 200 of this embodiment.

[0110] 12, the rating screen includes an information display field 40 about the filmed video, and rating options including an OK button 41, a KEEP button 42, and an NG button 43. The information display field 40 displays information about the filmed take of the video, including, for example, a thumbnail image of the take, the cut number associated with the take, and the number of takes.

[0111] The OK button 41 indicates, for example, an "OK" rating when the user has decided that the take should be used in the corresponding cut. The KEEP button 42 indicates, for example, a "KEEP" rating when the user is unsure whether to use the take. The NG button 43 indicates, for example, an "NG (No Good)" rating when the user has clearly decided not to use the take. In this embodiment, the rating "NG" is an example of a first rating, and the ratings "OK" and "KEEP" are each examples of a second rating.

[0112] In this embodiment, the recording mode process (S5) displays, for example, a rating screen as shown in FIG. 12 each time one take of video is shot, and acquires rating information indicating the user's evaluation of that take. Based on the rating results of this recording mode process (S5), the control unit 210 again performs the cut list generation process (S1) as shown in FIG. 11 to update the cut list 30. Furthermore, the video shooting and ratings of each take in this recording mode are managed so that they are shared among cuts with the same angle, for example, in a long take group L. The process of step S5 will be described in detail later.

[0113] The operation to transition to playback mode ((III) of S3) is a user operation for transitioning to playback mode, which is an operating mode for playing back and displaying the video shot for the selected cut, and is, for example, an operation of the playback mode button 35. In addition to or instead of this, the operation to transition to playback mode may be a swipe operation in the ±X direction of the cut selection screen, opposite to the operation to transition to recording mode. Also, the playback mode button 35 may be omitted.

[0114] When an operation to transition to playback mode is input ((III) of S3), the control unit 210 executes a process to play back various takes of video related to the selected cut in playback mode (S6). In the playback mode process (S6) in this embodiment, re-rating can be performed to change the evaluation of the video of each take. Based on the re-rating results of this playback mode process (S6), the control unit 210 performs the cut list generation process (S1) again to update the cut list 30. Also, in this playback mode, information management reflecting the long take group L is performed. Details of the process of step S6 will be described later.

[0115] The filtering operation (S3(IV)) is a user operation for narrowing down the cuts to be displayed in the cut list 30, for example, by operating the filter button 32. When the filtering operation is input (S3(IV)), the control unit 210 acquires the conditions for filtering the cuts to be displayed in accordance with the user's selection (S7).

[0116] The information support terminal 200 of this embodiment uses the shooting locations in the storyboard information of each cut as filtering conditions for the cut list 30. The control unit 210 performs the cut list generation process (S1) again based on the shooting locations acquired as filtering conditions. In this way, the cut list 30 is updated so as to limit the cut icons 3 to those corresponding to the shooting locations of the filtering conditions (details will be described later).

[0117] The cut addition operation (S3(V)) is a user operation for adding a new cut to the cut list 30 in addition to the existing cuts, for example, the operation of the cut addition button 33. When the cut addition operation is input (S3(V)), the control unit 210 sets various information about the added cut (S8) and performs the cut list generation process (S1) again (details will be described later).

[0118] The end operation (S3(VI)) is a user operation for ending the shot shooting function, such as operating the back button 15 on the shot selection screen (FIG. 10). When the end operation is input (S3(VI)), the control unit 210 transitions the display unit 240 from the shot selection screen to the function selection screen (FIG. 4), for example, and ends the processing shown in this flow.

[0119] According to the above process, the user of the system 10 can check various cuts (S4) on the cut selection screen (FIG. 10) in the cut shooting function of the information support terminal 200, and can then shoot a desired cut (S5) and play back and display it (S6). This makes it easy for the user to manage the shooting of multiple cuts in a scenario.

[0120] In the cut selection screen of this embodiment, each cut icon 3 is displayed with a distinguishable indication of whether or not shooting has been completed, thereby preventing the user from forgetting to shoot a cut. The distinguishable indication of whether or not shooting of each cut has been completed is performed in a manner that reflects the user's evaluation of each take of video, making it easy to ensure video quality that meets the user's intentions. Such ratings are performed for each take (S5), and further re-rating can be performed in playback mode (S6). This makes it easy to achieve quality control of video shooting that meets the user's intentions.

[0121] Furthermore, the cut selection screen (FIG. 10) of this embodiment is not limited to updating the cut list 30 in accordance with the rating / re-rating of cuts as described above (S5, S6, S1), but can also be updated to filter the display targets or add cuts (S7, S8, S1). This allows the user to efficiently use the desired cuts on the cut selection screen, for example, on-site at a video shoot, making it easier to use the cut shooting function of this system 10.

[0122] In the shot shooting function of this embodiment, the communication connection with the digital camera 100 may be managed, and for example, a button for managing the communication connection may be provided on the shot selection screen. When the communication connection with the digital camera 100 is not established, the control unit 210 may disable the operation to switch to the recording mode ((II) in S3).

[0123] 2.3.2.Cut list generation process The cut list generation process in step S1 of FIG. 11 will be described in detail with reference to FIGS.

[0124] Fig. 13 is a flowchart illustrating the cut list generation process (S1) in the present system 10. The process shown in the flow of Fig. 13 is started, for example, in response to the operation of the capture button 12 on the function selection screen (Fig. 4). Alternatively, the process of this flow is started after steps S5 to S8 are executed in response to a predetermined user operation ((II) to (V) of S3 in Fig. 11) on the cut selection screen (Fig. 10).

[0125] First, the control unit 210 of the information support terminal 200 selects one cut from all the cuts included in the cut allocation data D1 (FIG. 7) to check whether it should be included in the cut list 30 (S10). The selection in step S10 is performed, for example, in ascending order of the cut numbers in the cut allocation data D1.

[0126] Next, the control unit 210 determines whether or not the shooting location of the shot to be checked satisfies the filtering conditions, for example, based on the shooting location of the shot to be checked in the shot layout data D1 (S11). Such filtering will be described with reference to FIG.

[0127] Fig. 14 shows an example of the display of the selection dialog 32a in step S7 of Fig. 11. For example, when the user taps the filter button 32 on the cut selection screen (Fig. 10) ((IV) of S3), the display unit 240 displays the selection dialog 32a in step S7. The selection dialog 32a includes options for filtering conditions such as "All Locations," "Shooting Location 1," "Shooting Location 2," etc.

[0128] For example, the filtering condition is initially set to "all locations" (see filter button 32 in FIG. 10), and in this case the determination in step S11 is "YES." Also, when a specific shooting location is selected as a filtering condition in the user's filtering operation (S3 (IV) in FIG. 11) (S7), the control unit 210 determines whether the shooting location of the cut to be checked matches the specific shooting location (S11).

[0129] 11, the control unit 210 displays a selection dialog 32a (FIG. 14) based on various shooting locations included in the shot layout data D1, and accepts a user operation to select one of the options in the selection dialog 32a. For example, when the user taps on one of the options in the selection dialog 32a, the control unit 210 acquires the shooting location of that option as a filtering condition (S7), and makes a determination in step S11 of the shot list generation process (S1) based on the filtering condition.

[0130] 13, if the shooting location to be checked does not meet the filtering conditions (NO in S11), the control unit 210 proceeds to step S16 without performing steps S12 to S15, such as generating a cut icon 3. In this way, cuts with shooting locations that differ from the filtering conditions are excluded from the cut list 30 to be displayed.

[0131] If the shooting location to be checked meets the filtering conditions (YES in S11), the cut is included in the display targets of the cut list 30. In this case, the control unit 210 generates, for example, a cut icon 3 corresponding to the cut (S12). For example, in step S12, the control unit 210 refers to the cut division data D1, and if the cut has an angle name, reflects the angle name in the cut icon 3.

[0132] Next, the control unit 210 determines whether the shooting completion flag of the cut that generated the cut icon 3 is ON, for example, based on the cut division data D1 (S13). The shooting completion flag is turned ON if, for example, the videos associated with the cut to be checked include a video rated "OK" or "KEEP," and is turned OFF otherwise. The determination in step S13 may be made by referring to the ratings of each video associated with the cut to be checked, instead of using the shooting completion flag. Such shooting completion flags are managed for each angle for cuts in the long take group L.

[0133] If the shooting completion flag of the cut is ON (YES in S13), the control unit 210 sets the display attribute of the shooting completion state to the corresponding cut icon 3 (S14).

[0134] On the other hand, if the shooting completion flag of the cut is OFF rather than ON (NO in S13), the control unit 210 sets the display attribute of the corresponding cut icon 3 to indicate an incomplete shooting state (S15).

[0135] The control unit 210 determines whether or not all of the cuts to which cut numbers have been assigned have been checked, for example, based on the cut allocation data D1 (S16). The determination in step S16 is made within the range of cuts (hereinafter referred to as "normal cuts") that have been included in the cut allocation data D1 since the scenario was created, separate from the additional cuts.

[0136] If all normal cuts have not been checked (NO in S16), the control unit 210 repeats the process from step S11 onwards for the unchecked normal cuts. In this way, all normal cuts are checked in sequence for display in the cut list 30 (YES in S16).

[0137] When all normal cuts have been checked (YES in S16), the control unit 210 determines whether there are any additional cuts (S17). The additional cuts are set in step S8 of Fig. 11 so that they are assigned additional cut numbers, which are identification information different from the cut numbers in the cut division data D1 (see Fig. 15).

[0138] If there are no additional cuts (NO in S17), the control unit 210 does not particularly perform the process of step S18, and generates a cut list 30 based on the check results of the normal cuts (S11 to S16) (S19). For example, in the cut list 30, the cut icons 3 to be displayed are arranged in ascending order of cut numbers.

[0139] On the other hand, if there are additional cuts (YES in S17), the control unit 210 performs various processes for checking the additional cuts to be displayed in the cut list 30, in the same way as for normal cuts (S18). The process of step S18 is performed in the same way as the processes of steps S11 to S16, except that the range of the additional cuts, instead of the normal cuts, is the check target. In this case, the control unit 210 generates the cut list 30 based on the check results of the normal cuts and the additional cuts (S11 to S16, S18) (S19).

[0140] Also, for example, in step S19, the control unit 210 places a long take range indicator 37 for each long take group L of cuts having the same group number in the cut list 30, with reference to the cut division data D1.

[0141] When the cut list 30 is generated in this way (S19), the control unit 210 ends the processing of, for example, step S1 in FIG. 11, and proceeds to step S2.

[0142] According to the cut list generation process (S1), the information support terminal 200 of the present system 10 generates a cut list 30 that lists the cuts included in the scenario based on the cut allocation data D1, with an indication of whether or not the shots have been shot (S14, S15). When the evaluation of each take for each cut changes (S5, S6 in FIG. 11), the indication of the cut list 30 is dynamically updated in accordance with the changed evaluation. This makes it easier for the user to check the progress of shooting a video with multiple cuts. Furthermore, in the present system 10, the cut list 30 is updated as needed with the settings of the long take group L visualized, making it easier for the user to shoot long takes.

[0143] Furthermore, in the present system 10, the shot list 30 can be narrowed down using the shooting location as a filtering condition (see S7 in FIG. 11 and S11 in FIG. 13). This allows the user to use the shot selection screen by selecting, for example, the shooting location of the location as a filtering condition, narrowing down the shots to be shot on location. In this way, the present system 10 makes it easier for the user to prevent forgetting to take shots on location.

[0144] Furthermore, in the present system 10, the cut list 30 can also be updated to include additional cuts (see S8 in FIG. 11 and S17 to S18 in FIG. 13). An example of the cut list 30 when additional cuts are included is shown in FIG.

[0145] For example, when the user performs a cut addition operation ((V) of S3 in FIG. 11), the control unit 210 sets the added cut (S8), and then proceeds to YES in step S17 in the cut list generation process (S1), and checks the added cut (S18). In this way, for example, as shown in FIG. 15, the cut list 30 is updated to include a cut icon 3a for the added cut.

[0146] With the added cut feature of the present system 10, the user can instantly add cuts on location, such as at a shooting location, without having to re-edit the scenario. The cut icon 3a for the added cut is placed at the end of the cut list 30, for example, in step S1 after step S8, as shown in Fig. 15. If there are multiple added cuts, they are placed in ascending order of the added cut number, for example.

[0147] Also, in step S8 of FIG. 11, the control unit 210 automatically sets, for example, the shooting location in the storyboard information of the added cut in accordance with the filtering conditions. Alternatively, the shooting location of the added cut may be set by user input. By setting the shooting location of the added cut in this way, the added cut can also be subject to filtering (S7) in the same way as normal cuts. For example, the storyboard information of the added cut is set to null values ​​other than the shooting location. A predetermined image indicating that it is an added cut may be used as the composition of the storyboard information. Also, the added cut may be deleteable by a predetermined user operation, and for example, the predetermined user operation may be a long press on the cut icon 3a of the added cut.

[0148] 2.3.3. Recording Mode The details of the recording mode process in step S5 of FIG. 11 will be described with reference to FIGS.

[0149] Fig. 16 is a flowchart illustrating the recording mode process (S5) in the present system 10. The process shown in the flow of Fig. 16 starts when, for example, an operation to switch to the recording mode is input on the cut selection screen (Fig. 10) (S3 (II)).

[0150] First, the control unit 210 of the information support terminal 200 shifts to a recording mode and causes the display unit 240 to transition to a screen for waiting for video recording (S30). An example of the display on the information support terminal 200 in step S30 is shown in FIG. 17(A).

[0151] 17A, the recording standby screen in step S30 includes a timer button 44, a live view image 45, and a recording button 46. The timer button 44 accepts a user operation to set a timer period for timing the start of shooting, for example. The recording button 46 accepts a user operation to start shooting and recording a video.

[0152] In this system 10, when the control unit 210 of the information support terminal 200 transitions to, for example, a recording mode, it requests the digital camera 100 to transmit a live view image 45 via the communication unit 250 (S30). For example, in the recording mode, the control unit 210 sequentially receives image data of the live view image 45 from the digital camera 100 via the communication unit 250 and displays the live view image 45. Furthermore, the control unit 210 receives, as appropriate, audio data of the sound picked up by the microphone 160 from the digital camera 100, for example.

[0153] The control unit 210 sets a timer period in response to, for example, a user operation of the timer button 44 (S31). An example of the display on the information support terminal 200 in step S31 is shown in Fig. 17(B). The timer period may be set for each take or uniformly for each cut.

[0154] 17B illustrates an example of a timer selection field 44a that is displayed in response to operation of the timer button 44 on the shooting standby screen of FIG. 17A. FIG. 17B shows an example in which the timer period is set to "5 seconds" in the timer selection field 44a. The timer selection field 44a includes options indicating the numerical value of the timer period, such as "OFF," which corresponds to a timer period of 0 seconds, and "5 seconds." In step S31, when the control unit 210 receives a user operation on the timer selection field 44a via the operation unit 230, the control unit 210 sets the timer period in accordance with the user operation and returns the display unit 240 from FIG. 17(B) to FIG. 17(A).

[0155] In response to a user operation of the record button 46, the control unit 210 performs various controls to start shooting and recording one take of a moving image associated with the selected cut (S32). For example, in step S32, the control unit 210 instructs the digital camera 100 to start shooting and recording the moving image via the communication unit 250. Examples of the display on the information support terminal 200 in step S32 are shown in FIGS. 17(C) and 17(D).

[0156] FIG. 17(C) illustrates an example of a shooting screen when the recording button 46 is operated when a timer period is set as in the example of FIG. 17(B). FIG. 17(D) illustrates an example of a shooting screen after the timer period from FIG. 17(C). The control unit 210 counts down the elapsed time from the time the recording button 46 is operated (S32) by the set timer period, and displays it superimposed on, for example, a live view image. In this example, video recording is performed including this timer period. Furthermore, if the timer period is set to "OFF," in step S32, the control unit 210 does not particularly display the countdown as in FIG. 17(C), and transitions the display unit 240 to, for example, the shooting screen as in FIG. 17(A) to FIG. 17(D).

[0157] 17(C) and (D), the shooting screen in step S32 includes a live view image 45, a time display field 47, a recording stop button 46a, and a marking button 48. The live view image 45 on the shooting screen is highlighted, for example, with a frame or other display to indicate that recording is in progress. The time display field 47 displays, for example, the shooting time of a selected cut in the cut data D1 and the elapsed time since the start of shooting of the video of that take, for comparison.

[0158] In step S32, the control unit 210 controls the display unit 240 to switch the display from the shooting standby screen (FIG. 17(A)) to the shooting screen (FIGS. 17(C) and (D)). The control unit 210 also records, in the storage unit 220 of the information support terminal 200 (S32), a video file showing the live view images 45 sequentially received from the digital camera 100 after the record button 46 is operated. The video file includes, for example, audio data picked up by the microphone 160 in synchronization with the video shooting by the digital camera 100.

[0159] The control unit 210 also determines a file name for the moving image file based on, for example, the cut data D1 and the number of takes already shot for the selected cut. The control unit 210 may include the determined file name in an instruction to the digital camera 100. The control unit 135 of the digital camera 100 starts shooting the moving image in accordance with an instruction from the information support terminal 200 received via, for example, the communication module 155.

[0160] At this time, the control unit 135 repeats the imaging operation of the image sensor 115 and records moving image data of the imaging results onto the memory card 142, for example, via the card slot 140. The moving image data includes, for example, audio data of the sound pickup results of the microphone 160. The control unit 135 may start collecting sound in synchronization with the video shooting in the digital camera 100 in response to such an imaging instruction.

[0161] For example, on the shooting screen of Fig. 17(D), a recording stop button 46a is operated by the user to stop shooting and recording a moving image. A marking button 48 is operated by the user to mark a desired timing during shooting of a moving image. The user can use the marking button 48 at a timing they want to refer to, for example, when editing the moving image in post-processing.

[0162] Thereafter, control unit 210 performs various controls to stop the shooting and recording of the video in response to a user operation of recording stop button 46a (S33). For example, in step S33, control unit 210 instructs digital camera 100 to stop shooting and recording of the video via communication unit 250. Control unit 210 also stops the video recording of live view image 45 in information support terminal 200 (S33). Control unit 135 of digital camera 100 ends video shooting in accordance with the instruction from information support terminal 200.

[0163] Furthermore, the control unit 210 causes the display unit 240 to display a rating screen, as shown in FIG. 12, for example, in order to prompt the user to rate the video of the take shot as described above (S34).

[0164] The control unit 210 receives user operations on the various buttons 41 to 43 on a rating screen such as that shown in Fig. 12, and acquires the user's evaluation as a rating result for the video of the taken take (S35). In this embodiment, each time a take of video is shot, the user can arbitrarily select a desired evaluation from the three types of evaluations "OK," "KEEP," and "NG" for the shot video, without interfering with the evaluations of other takes of video.

[0165] The control unit 210 determines, for example, whether the user's evaluation is "NG" or not based on the acquired user's evaluation (S36). For example, if the user's evaluation is "OK" or "KEEP," the determination in step S36 is "NO."

[0166] If the acquired user evaluation is not "NG" (NO in S36), the control unit 210 sets the shooting completion flag of the cut associated with the take in the cut division data D1 (i.e., the selected cut) to "ON" (S37). For example, if the number of takes in the video is "1," or if the number of takes is "2" or more and the evaluation of the video of the existing takes is "NG," the shooting completion flag is switched from "OFF" to "ON" by executing step S37.

[0167] Also, for example, in step S37, if the selected cut belongs to long take group L and long take group L contains a cut with the same angle name as the selected cut, the control unit 210 sets the shooting completion flags of all cuts with the same angle to "ON." For cuts in long take group L that are at angles different from the selected cut or for insert cuts, the control unit 210 manages the shooting completion flags separately. Furthermore, if the selected cut is an insert, the control unit 210 manages the shooting completion flag separately from the other cuts in long take group L.

[0168] On the other hand, if the acquired user evaluation is "NG" (YES in S36), the control unit 210 proceeds to step S38 without particularly updating the setting of the shooting completion flag. As a result, if the shooting completion flag for the corresponding cut when the video with the evaluation "NG" was shot is OFF, for example, the OFF state is maintained. Also, if the shooting completion flag is ON because a video of a take shot in the past has "KEEP" or "OK", for example, the ON state is maintained.

[0169] The control unit 210 generates metadata for the moving image of the takes shot as described above, and records it, for example, in the cut data D1 in the storage unit 220 (S38). Examples of such moving image metadata D2 are shown in Figures 18(A) and (B).

[0170] 18(A) illustrates video metadata D2 for take M in cut number "1" outside long take group L (FIG. 5). FIG. 18(B) illustrates video metadata D2 for take M in cut number "2" within long take group L (FIG. 5). For example, as shown in FIGS. 18(A) and 18(B), video metadata D2 includes a "video file name," "rating information," a "timer period," and "marker information."

[0171] For example, for cuts outside the long take group L, the control unit 210 determines the moving image file name so as to reflect the cut number and the number of takes, as shown in FIG. 18(A). On the other hand, for cuts set as angles within the long take group L, the control unit 210 determines the moving image file name by referencing the data of cuts with the same group number in the cut division data D1. For example, in the example of FIG. 18(B), the moving image file name "XXX_002-006_A_M" includes the cut numbers "2" to "6," the angle name "A," and the number of takes "M" within the range of the long take group L. For example, as shown in FIG. 18(B), for cuts set as angles within the long take group L, the control unit 210 can reflect the cut numbers and angle names within the range of the long take group L, along with the number of takes, in the moving image file name.

[0172] In this way, in the present system 10, moving images of each take during long take shooting can be managed by angle of the long take group L. Furthermore, for insert cuts within the long take group L, the control unit 210 can manage the moving images of each take by cut, just as it does for cuts outside the long take group L. Alternatively, the control unit 210 may determine a moving image file name for the insert cut to appropriately reflect that it is a cut within the long take group L. For example, for a moving image with a take number of "2" for an insert cut in the long take group L in the example of FIG. 5, the control unit 210 can determine the moving image file name to be "XXX_002-006_5_02" to reflect the insert cut number "5" (see FIG. 25).

[0173] 16, the control unit 210 includes in the video metadata D2 the video file name determined in steps S32 to S33 so as to reflect the number of takes and the like for the video shot, the user rating acquired in step S35, and the timer period set in step S31. Furthermore, when the user operates the marking button 48, the control unit 210 identifies the timing of the user operation during the video shooting time, and includes it as marker information in the video metadata D2.

[0174] The control unit 210 stores the generated video metadata D2 in a video metadata list for a cut associated with the video in the cut-by-cut data D1 (FIG. 7) (S38). The video metadata D2 is not limited to the above, and may include various setting information for long-take shooting, such as the number of takes for the video, the long-take group L, and angle / insert, in addition to or instead of the video file name. In the cut-by-cut data D1, the video metadata lists for multiple cuts with the same long-take group number and angle name are managed collectively as appropriate by, for example, the control unit 210.

[0175] The control unit 210 ends the recording mode process (S5) by storing the video metadata D2 (S38), for example, and proceeds to step S1 in FIG.

[0176] According to the above-described recording mode process (S5), the system 10 can shoot and record one take of a video for the selected cut and prompt the user to rate it (S32-S35). The system 10 also manages the shooting completion flag for the cut based on the acquired evaluation information (S36, S37). In this way, the user's evaluation information for each take can be appropriately reflected in managing whether or not the cut is in a shooting completion state. Furthermore, according to the recording mode process (S5) of this embodiment, the information support terminal 200 can control the shooting and recording of the video by the digital camera 100, thereby realizing management of video shooting.

[0177] In rating each take of a video (S34-S35), multiple takes associated with the same scene may have the same rating. For example, multiple takes of the same scene may have a rating of "OK."

[0178] The rating screen displayed in step S34 may be displayed as a dialogue. For example, control unit 210 may control display unit 240 to superimpose the dialogue of the rating screen on the display screen before and after step S33.

[0179] The recording standby screen in recording mode (FIG. 17(A)) may further include a back button 15 for returning the screen transition to, for example, the cut selection screen. Such a back operation may be a swipe operation in a predetermined direction among the ±X directions on the video management screen. The information support terminal 200 may also transition to playback mode by a swipe operation in the opposite direction.

[0180] 2.3.4. Playback Mode The playback mode process in step S6 in FIG. 11 will be described with reference to FIGS.

[0181] Fig. 19 is a flowchart illustrating the processing (S6) of the playback mode in the present system 10. The processing shown in the flow of Fig. 19 is started, for example, when an operation to switch to the playback mode is input on the cut selection screen (Fig. 10) (S3 (III)).

[0182] First, the control unit 210 of the information support terminal 200 transitions the display unit 240 to a screen for managing the moving image of the selected cut, based on the moving image file of the take associated with the selected cut and the cut division data D1 (S51). An example of the display on the information support terminal 200 in step S51 is shown in FIG. 20(A).

[0183] FIG. 20(A) illustrates an example of a video management screen when the selected cut does not belong to long take group L. As shown in FIG. 20(A), the video management screen in step S51 includes a cut identification field 51, a video list 50, a re-rating button 52, and a back button 15. The cut identification field 51 displays identification information for the selected cut. The video list 50 includes video icons 5 that indicate videos for each take in the selected cut. The video icons 5 are configured, for example, by superimposing rating information on a thumbnail image of the video in that take.

[0184] In step S51, for example, if the selected cut does not belong to the long take group L, the control unit 210 references the video metadata list of the selected cut in the cut division data D1 and generates each video icon 5 so as to visualize the evaluation information of each take associated with the selected cut. The control unit 210 arranges the video icons 5, for example, in ascending order of the number of takes, to generate the video list 50 (S51).

[0185] 20(A), for example, the control unit 210 accepts various user operations via the operation unit 230. The user operations that are the subject of step S52 include (I) a playback selection operation, (II) a re-rating operation, and (III) a back operation.

[0186] The playback selection operation ((I) of S52) is a user operation for selecting a video file to be played and displayed, for example, an operation of tapping a desired video icon 5 in the video list 50 displayed on the video management screen.

[0187] The re-rating operation ((II) of S52) is a user operation for re-rating a video file, for example, by tapping the re-rating button 52 and then tapping the desired video icon 5.

[0188] The back operation ((III) of S52) is a user operation to return from the playback mode to the function selection screen, for example, the operation of the back button 15 on the video management screen. The back operation in (III) of step S52 may be, for example, a swipe operation in a predetermined direction among the ±X directions on the video management screen. The information support terminal 200 may transition to the recording mode by a swipe operation in the opposite direction.

[0189] When a playback selection operation is input ((I) of S52), the control unit 210 transitions the display unit 240 to a screen for playing and displaying the selected video file (S53). An example of the display on the information support terminal 200 in step S53 is shown in FIG. 20(B).

[0190] 20(B), the playback screen in step S53 includes a playback image 53, a playback control bar 54, a marker button 55, and a back button 15. The control unit 210 accepts various user operations related to the playback screen via the operation unit 230. For example, the user can switch between playing and pausing the video by tapping the playback image 53, or can change the playback position by tapping the playback control bar 54.

[0191] The playback control bar 54 indicates the playback timing of the entire video, and markers 56 are placed at positions indicating specific timings. For example, the control unit 210 places the markers 56 on the playback control bar 54 by referring to the marker information in the video metadata D2.

[0192] 20(B), the user can place a new marker 56 by operating the marker button 55, or change the position of the marker 56 by dragging the marker 56. When such various marker operations are accepted (YES in S54), the control unit 210 updates the marker information in the video metadata D2 in accordance with the marker operation (S55).

[0193] Furthermore, when a user instruction to end playback of the video is input, for example, by operating the back button 15 (YES in S56), the control unit 210 transitions the display unit 240 from, for example, the playback screen (Figure 20(B)) to the video management screen (Figure 20(A)), and returns to step S52.

[0194] When a re-rating operation ((II) of S52) is input on the video management screen (FIG. 20(A)), the control unit 210 causes the display unit 240 to display a screen to prompt the user to re-rate (S57). An example of the display in step S57 is shown in FIG. 20(C).

[0195] 20(C) illustrates, for example, a re-rating dialog 52a that the display unit 240 displays superimposed on the video management screen. The re-rating dialog 52a includes various buttons 41-43 as user rating options, similar to the rating screen (FIG. 12). The control unit 210 accepts user operations on the various buttons 41-43 in the re-rating dialog 52a, and acquires rating information indicating the re-rating result for the take of the video icon 5 selected by the user in step S52(II) (S58).

[0196] Next, the control unit 210 updates, for example, the cut division data D1 based on the evaluation information of the re-rating result (S59). For example, the control unit 210 rewrites the evaluation information of the take in the video metadata list of the selected cut, or manages the shooting completion flag of the selected cut taking the re-rating result into consideration. For example, when the re-rating changes the evaluation information of all takes associated with the selected cut from "NG" to "KEEP" or "OK," the shooting completion flag is switched from OFF to ON.

[0197] Thereafter, the control unit 210 returns to step S51 and updates the moving image list 50 on the moving image management screen so that the re-rating result is reflected in the moving image icon 5 of the take.

[0198] For example, when a back operation ((III) of S52) is input on the video management screen (FIG. 20(A)), the control unit 210 ends the playback mode processing (S6) and returns to step S1 of FIG. 11. In this way, when re-rating is performed in playback mode (S58), the cut list 30 is updated in the subsequent cut list generation processing (S1) to reflect the new evaluation information.

[0199] According to the above playback mode processing (S6), the user can check the playback display of various takes of the selected cut (S53 to S56) and redo the rating depending on the results of the check (S57 to S58). Furthermore, when checking the video, the user can place marker 56 at the desired timing, which makes it easier to perform subsequent video editing, etc.

[0200] In the above explanation, an example of operation when the selected cut does not belong to long take group L (FIG. 20(A)) has been explained, but the playback mode of this system 10 operates in the same manner as steps S51 to S59 above even when the selected cut belongs to long take group L. Such an example of operation will be explained using FIG.

[0201] Fig. 21 shows an example of a video management screen display for long take group L on information support terminal 200 of system 10. For example, if the selected shot at the time of switching to playback mode (S3 (III) in Fig. 11) belongs to long take group L, the video management screen of information support terminal 200 collectively manages videos of various takes in long take shooting, as shown in Fig. 21. This video management screen is an example of group information in playback mode of system 10.

[0202] For example, the control unit 210 of the information support terminal 200 references the movie metadata list of each cut in the cut division data D1 that has the same group number as the selected cut, and generates a movie list 50 on the movie management screen (FIG. 21) (S51). In this case, the movie list 50 includes movie icons 5 for each take for various angles A, B and inserts in the long take group L, as shown in FIG.

[0203] 21, the video icon 5 for each angle in the long take group L is displayed by the control unit 210 to reflect the name of each angle and the number of takes for each angle. If there are multiple insert cuts in the long take group L, the video icon 5 for each insert may reflect information identifying each separate insert. The video icon 5 in the long take group L may also display one or more corresponding cut numbers.

[0204] On this video management screen for long take group L (FIG. 21), control unit 210 also accepts user operations in steps S52(I) to (III), as in the example of FIG. 20(A) described above. For example, control unit 210 performs various processes (S53 to S56) on the video playback screen (FIG. 20(B)) for a video selected from video list 50 in response to a video playback operation (S53(I)). Furthermore, control unit 210 performs re-rating processing for the selected video in response to a re-rating operation (S53(II)) (S57 to S59, see FIG. 20(C)).

[0205] If there is a cut in the long take group L that has the same angle as the moving image to be re-rated, the control unit 210 updates the cut division data D1 so that the shooting completion flags for cuts with the same angle name are managed together (S59). For insert cuts, the control unit 210 manages the shooting completion flags for each cut individually, in the same way as for cuts outside the long take group, for example (S59).

[0206] As described above, the system 10 can play back various takes of video and accept re-ratings from the user on the video management screen (FIG. 21) for the long take group L.

[0207] In the present system 10, the video management screen for the long take group L is not limited to the example in Fig. 21, but may be categorized by angles A, B, and inserts, or by cuts within the long take group L. The video management screen may also be configured to allow for narrowing down the display from these perspectives.

[0208] 2.4. Export function The export function of the information support terminal 200 of the system 10 will be outlined with reference to FIG.

[0209] Fig. 22 shows an example of a video editing screen display on the video editing PC 300 of the system 10. The video editing PC 300 (Fig. 1) loads, for example, management data output from the export function of the information support terminal 200 and video data captured by the digital camera 100 into predetermined editing software, and displays the video editing screen as shown in Fig. 22. The editing software may be various non-linear editing (NLE) software, such as DaVinci Resolve, Adobe Premiere Pro, Final Cut Pro, or Vegas Pro.

[0210] 22 includes a material display field 61, a timeline editing field 62, a metadata display field 63, and a preview image 64. The video editing screen is a screen on which the user can perform various video editing operations, and is an example of an editing screen in which the video editing PC 300 is an example of an external device.

[0211] The material display field 61 displays a list of video data (i.e., video material) that has been loaded as video editing material in the video editing PC 300. In the present system 10, for example, the material display field 61 displays a folder that manages video material for each cut, i.e., a video folder 70 (details of which will be described later).

[0212] The timeline editing field 62 displays a video timeline 80 including a plurality of video materials arranged on a time axis 81, and accepts user operations for editing a video work combining the video materials on the video timeline 80. The video timeline 80 has tracks for each row in which the video materials are arranged along the time axis 81. On the video timeline 80, the plurality of tracks are arranged in a direction V that intersects with the time axis 81, and different video materials can be arranged at the same position on the time axis 81. Hereinafter, the +V side of the direction V of such an arrangement may be referred to as the upper side, and the opposite -V side may be referred to as the lower side.

[0213] The metadata display field 63 displays metadata of the video material displayed in the material display field 61 or the timeline editing field 62. The preview image 64 displays an image of the video material at a timing corresponding to the position of a playback head 82 arranged on a time axis 81 in a video timeline 80.

[0214] For example, on the video editing screen (FIG. 22), the user can adjust the arrangement of video materials in the timeline editing field 62 while checking the preview image 64, or place new video materials in the material display field 61 on the video timeline 80. These user operations are used to edit the video work in the system 10.

[0215] In order to facilitate the user's editing of the video work as described above, for example, after the cut shooting function is executed, the information support terminal 200 of this embodiment generates management data for systematically managing video material in an export function that reflects the cuts and the user's evaluation. This facilitates the video editing process in the system 10, and ultimately improves the processing efficiency of the video editing process by the video editing PC 300. The export function of the system 10 will be described in detail below.

[0216] 2.4.1. Overall operation of the export function The overall operation of the export function in the present system 10 will be described with reference to FIGS.

[0217] Fig. 23 is a flowchart illustrating the operation of the export function in the present system 10. Each process shown in the flowchart in Fig. 23 is executed, for example, by the control unit 210 of the information support terminal 200. The process of this flow starts when, for example, the export button 13 on the function selection screen (Fig. 4) is operated in a state in which cut data D1 including video metadata D2 obtained by the cut shooting function is stored in the storage unit 220.

[0218] First, the control unit 210 of the information support terminal 200 sets the number of tracks in the video timeline 80, i.e., the number of tracks, etc., in response to, for example, a user operation on the operation unit 230 (S61). An example display in step S61 is shown in FIG.

[0219] 24 illustrates an example of the export setting dialog 16 that the display unit 240 displays superimposed on the function selection screen (FIG. 4). For example, the export setting dialog 16 includes an input field 16a for inputting the number of tracks in the video timeline 80 and a rating selection field 16b. The control unit 210 receives, for example, a user operation on the export setting dialog 16 via the operation unit 230, and acquires the user settings for the video timeline 80 (S61).

[0220] In the export setting dialog 16, the track number input field 16a accepts an operation in which the user inputs the number of tracks that the user wants to display on the video timeline 80 within a predetermined numerical range (for example, 1 to 20). The rating selection field 16b accepts a user operation to select, for example, "both OK and KEEP" or "OK ​​only" as options to be displayed on the timeline. The rating selection field 16b allows videos with a relatively high rating of "OK" to be preferentially displayed on the video timeline 80 regardless of which of the above options is selected.

[0221] Furthermore, the control unit 210 creates a video folder 70 that is displayed in the material display field 61 of the video editing screen (FIG. 22), for example, based on the cut data D1 (S62). An example of the video folder 70 obtained by this folder creation process (S62) is shown in FIG.

[0222] 25, the video folder 70 includes folders for each cut, i.e., cut folders 71, and a KEEP folder 72 and an OK folder 73 provided within each cut folder 71. For cuts belonging to a long take group L, the cut folder 71 is provided for each long take group L, similar to the video management screen (FIG. 21) described above, collecting all the cuts in the long take group L.

[0223] The KEEP folder 72 stores video files that have been evaluated as "KEEP" in the video material of the cut or long take group L. The OK folder 73 stores video files that have been evaluated as "OK" in the video material of the cut or long take group L. In the folder configuration process of step S62, the control unit 210 automatically describes in the management data a directory structure for realizing such a configuration of the video folder 70. The folder configuration process (S62) will be described in detail later.

[0224] The icons representing video files in the video folder 70 are an example of video information in this embodiment. Furthermore, in the material display field 61, an icon representing a video timeline 80 may be displayed together with the video folder 70 as described above, as exemplified in Fig. 25. Furthermore, in the example of Fig. 25, the video icon in the cut folder 71 with cut number "1" is displayed, but according to the video folder 70, video icons in other cut folders 71 can also be displayed as appropriate by a user operation on the material display field 61.

[0225] Furthermore, the control unit 210 sets (S63) a video timeline 80 to be displayed in the timeline editing field 62 (FIG. 22) when the user starts video editing, based on the results of the folder configuration process (S62) and the number of tracks set by the user (S61). An example of the video timeline 80 obtained by such timeline setting process (S63) is shown in FIG.

[0226] Figure 26 illustrates an example of a video timeline 80 when the number of tracks "4" and the display target "both OK and KEEP" are set in step S61 in the video folder 70 of Figure 25, and the video folder 70 of Figure 25 is configured in step S62.

[0227] 26, the video timeline 80 includes a set number of video tracks 83 and audio tracks 84 corresponding to each of the video tracks 83. The video tracks 83 include video clips 85 representing video in the video file for each cut or long take group L. The audio tracks 84 include audio clips 86 representing audio in the video file for each cut or long take group L. The video / audio clips 85, 86 are each an example of video information in this embodiment.

[0228] 26, the video track 83 is positioned above (on the +V side of) the audio track 84. In this example, the video / audio tracks 83 and 84 with track number "1" are adjacent to each other and are intended to be used primarily by users to complete a video work. In this example, the video track 83 has a higher priority the further down (towards -V) it is, and the audio track 84 has a higher priority the further up (towards +V) it is.

[0229] In the timeline setting process of step S63, the video timeline 80 is automatically set to reflect the user's ratings so that more highly rated video / audio clips 85, 86 are placed on video / audio tracks 83, 84 with higher priorities. As a result, for example, the most highly rated video / audio clips 85, 86 in each cut are placed on the video / audio track 83, 84 with track number "1," which is the track number the user primarily uses. For long take group L, priorities can be set appropriately between various angles A, B and inserts, and the various clips 85, 86 within long take group L can be placed, for example. The timeline setting process (S63) will be described in detail later.

[0230] The control unit 210 stores management data including the results of the folder configuration process (S62) and timeline setting process (S63) in the storage unit 220, for example (S64), and ends the process shown in the flow of FIG.

[0231] According to the above-described processing of the export function, the information support terminal 200 of the present system 10 can provide a video folder 70 and a video timeline 80 that facilitate the process of editing various video cuts taken by the user in accordance with a scenario on the video editing PC 300 (S62, S63).

[0232] For example, in the video timeline 80 (FIG. 26) provided by the system 10, the video / audio tracks 83 and 84 with track number "1," which are primarily used by the user, contain the most highly rated video material for each cut. These video / audio tracks 83 and 84 are expected to be close to what the user desires. This allows the user to perform video editing so as to consider the differences from these video / audio tracks 83 and 84, for example. In this case, since the video timeline 80 contains highly rated video material for the same cut in the adjacent video / audio tracks 83 and 84, it is easy for the user to consider the differences.

[0233] Furthermore, according to the video folder 70 (FIG. 25) of the present system 10, for example, video of each take that has received a high rating of "OK / KEEP" from the results of shooting using the cut shooting function is systematically arranged according to the priority of the rating for each cut. This allows the user to extract video material that has been rated as potentially usable from the video folder 70 and use it for editing, even if it is not placed on the video timeline 80, for example. Furthermore, by not including video of takes that have received a low rating of "NG" that are unlikely to be usable in the video folder 70, the amount of data in the video folder 70 can be reduced, and the processing load of video editing on the video editing PC 300 can be reduced.

[0234] Furthermore, for cuts within long take group L, the user can compare various angles A, B, and insert footage between multiple tracks 83, 84, for example, and consider which parts to use in the video work. In this way, the user can edit within long take group L, which includes multiple cuts, by cutting out the parts to use from each video / audio clip 85, 86 and arranging them on the finished video / audio track 83, 84 with track number "1."

[0235] In the above description of step S61, an example has been described in which the export setting dialog 16 of Fig. 24 is used. The user setting (S61) for the export function is not limited to the above example, and for example, the control unit 210 may further receive a user operation for switching between modes for arranging one track or multiple tracks on the video timeline 80. In this case, when the one track mode is selected, the control unit 210 may disable the user operation on the track number input field 16a and set the number of tracks to "1."

[0236] In the present system 10, the video folder 70 can have various configurations. For example, it is not necessary to provide an OK folder 73 and a KEEP folder 72 for every cut or long take group L; for example, the OK / KEEP folders 73, 72 may be omitted for additional cuts. Also, in the present system 10, the video folder 70 may be further provided with a folder for storing videos of takes that are rated "NG." Also, the cut folder 71 for cuts within the long take group L is not limited to the above configuration, and may instead have OK / KEEP folders 73, 72 for each of the various angles A, B or insert cuts.

[0237] 2.4.2. Folder configuration processing The folder configuration process in step S62 of FIG. 23 will be described in detail with reference to FIGS.

[0238] Fig. 27 is a flowchart illustrating the folder configuration process (S62) in the system 10. Fig. 28 illustrates the data structure of management data D3 resulting from the folder configuration process (S62). The management data D3 in Fig. 28 corresponds to the video folder 70 in Fig. 25.

[0239] First, the control unit 210 selects one or one group of cuts from among the multiple cuts included in the cut division data D1 (S71). Step S71 is performed to set a storage destination for one cut or long take group L of video material. For example, normal cuts are selected in ascending order of cut numbers in the cut division data D1. At this time, the control unit 210 refers to the cut division data D1, for example, and if the cut in question has a group number, selects all cuts with the same possible group number at once. Furthermore, if there are additional cuts, the additional cuts are selected after the normal cuts in ascending order of their additional cut numbers.

[0240] Next, the control unit 210 lists information about each file of the video material in the selected cut in order of evaluation, for example, based on the video metadata list of the selected cut in the cut division data D1 (S72).

[0241] For example, the control unit 210 generates a video material list in which the video file names of each take in the cut are arranged in order from the highest rating of "OK" to "KEEP" based on the rating information in the video metadata D2 for each take. In such a video material list, takes with the same rating are sorted in ascending order of take number, for example. Also, the video material list does not need to include the video file names of takes with a low rating of "NG," for example. Furthermore, when a cut from long take group L is selected, priority is set so that angle cuts take precedence over insert cuts, for example. Priority can be set between video files for different angles A and B, for example, in ascending order of cut number.

[0242] 28, the control unit 210 also provides a cut folder 71 (FIG. 25) for the selected cut, and folders for different evaluations, such as an OK folder 73 and a KEEP folder 72, under the cut folder 71 (S73). For example, each of the folders 71 to 73 is described as a tag in the XML language.

[0243] Next, the control unit 210 selects one take of video file in order from the video material list obtained in step S72 (S74). In step S74, takes other than those rated "NG" for the selected cut are selected, for example, in descending order of rating.

[0244] The control unit 210 references, for example, the rating information for the selected take in the video metadata D2 and determines the folder in which to store the video of that take from the OK folder 73 and the KEEP folder 72 (S75). For example, if the take is rated "OK," the control unit 210 determines the OK folder 73 as the storage destination. On the other hand, if the take is rated "KEEP," the control unit 210 determines the KEEP folder 72 as the storage destination.

[0245] Next, the control unit 210 determines whether the storage destination for each take's video file in the selected cut has been determined, for example, by referring to the video material list of step S72 (S76). If there are any take's video files for which the storage destination has not been determined (NO in S76), the control unit 210 repeats the processing from step S74 onwards for the unstored takes. This allows all takes in the selected cut (or long take group L) that have been evaluated as "OK" or "KEEP" to be stored in the corresponding cut folder 71.

[0246] Furthermore, once the storage destination for the video files of each take in the selected cut has been determined (YES in S76), the control unit 210 determines whether the folder construction process (S71 to S76) has been completed for all cuts in the cut division data D1 (S77). If there are any unprocessed cuts (NO in S77), the control unit 210 repeats the process from step S71 onwards for the unprocessed cuts. In this way, a video folder 70 is obtained in which video files for all cuts are stored in evaluation order.

[0247] For example, when the process for creating folders has been performed for all cuts (YES in S77), the control unit 210 generates management data D3 for the moving image folder 70 by description in XML language, for example (S78).

[0248] 28, the control unit 210 sets tags for each moving image file determined in step S75 under the tags for the OK / KEEP folders 73 and 72 for each cut folder 71, and writes the moving image file name and detailed information (S78). The detailed information for the moving image file includes, for example, the duration of the moving image material and the timer period.

[0249] By generating management data D3 for the video folder 70 in this way, the control unit 210 ends the folder configuration process (S62) and proceeds to step S63 in Fig. 23. In step S63, information for the video timeline 80 in management data D3 in Fig. 28 is automatically written, for example.

[0250] According to the above folder configuration process (S62), the information support terminal 200 of the present system 10 can prepare a video folder 70 in which various video materials are systematically managed, reflecting the user's ratings and scenario, before the video editing process. For example, when loading the video editing software, the video editing PC 300 can store video data having the same file name as the result of shooting with the digital camera 100, for example, as video files in the OK / KEEP folders 73 and 72 of each cut folder 71 in the video folder 70, according to the description of the management data D3.

[0251] 2.4.3.Timeline setting process The timeline setting process in step S63 of FIG. 23 will be described in detail with reference to FIGS.

[0252] Fig. 29 is a flowchart illustrating the timeline setting process (S63) in the system 10. Fig. 30 illustrates the data structure of management data D3 resulting from the timeline setting process (S63). The management data D3 in Fig. 30 is an example of sequence information corresponding to the timeline 80 in Fig. 26.

[0253] First, the control unit 210 selects one cut folder 71 from among the multiple cut folders 71 (S81), for example, based on management data D3 for the video folder 70 obtained by the folder configuration process (S62). Step S81 is a process for determining the arrangement of video material on the video timeline 80 for each cut or long take group L, and is performed, for example, in ascending order for normal cuts.

[0254] Next, the control unit 210 determines whether or not the number of moving image files, ie, the number of files, in the currently selected cut folder 71 is greater than the number of tracks set in step S61 of FIG. 23 (S82).

[0255] The number of files in step S82 is, for example, the total number of video files of takes that have a rating of "OK" or "KEEP" in a specific cut folder 71. Note that if the rating of the display target on the video timeline 80 is set to "OK only" in step S61 of Fig. 23 (see Fig. 24), the number of files in each cut folder 71 that have only a rating of "OK" may be used in step S82.

[0256] If the number of files in the selected cut (or long take group L) is greater than the number of tracks (YES in S82), the control unit 210 extracts, for example, video files to be placed on the video timeline 80 in that cut (S83). In step S83, video files equal to the number of tracks are extracted, for example, from the cut folder 71 in the management data D3 (FIG. 28), in descending order of highest rating.

[0257] For example, for the cut folder 71 of the long take group L, the control unit 210 extracts moving image files for the highest priority angle A in order of evaluation, and then extracts moving image files for the next highest priority angle B in order of evaluation (S83). After that, the insert moving image files are extracted in order of evaluation (S83). In the example of Fig. 26, the priority within the long take group L is managed in this order.

[0258] Next, the control unit 210 manages the time range of the cut in the video timeline 80, for example, by referring to the detailed information of each extracted video file (S84). In the present system 10, the time range of the cut in the video timeline 80 is managed, for example, as the longest playback period among the video files to be arranged. If a timer period is included, the playback period of the video is managed by excluding the timer period from the overall time length of the video. Furthermore, for the cuts in the long take group L, the control unit 210 manages the playback period of the video as an entire group, for example, shot in a long take.

[0259] On the other hand, if the number of files in the selected cut folder 71 is equal to or less than the number of tracks (NO in S82), the control unit 210 proceeds to step S84 without performing the process of step S83, for example, with all video files in the cut folder 71 as targets for placement. In this case, the management of the time range for the cut in the video timeline 80 (S84) is performed with reference to all video files in the cut folder 71.

[0260] Next, the control unit 210 sequentially selects one track from the set number of tracks (S85). Step S85 is a process for arranging video material on each track in the cut.

[0261] For example, the control unit 210 selects video tracks 83 (and audio tracks 84) in ascending order from track number "1" on the video timeline 80 in Fig. 26 (S85). Furthermore, as shown in Fig. 30, for example, the control unit 210 performs initial settings for each video / audio track 83, 84 regarding the playback of preview images 64 (Fig. 22) along the video timeline 80. For example, the video / audio track 83, 84 with track number "1" is set to enable playback display and audio output, and the other video / audio tracks 83, 84 are set to disable playback display and audio output.

[0262] Next, the control unit 210 determines the arrangement of the moving image material for the cut in the selected track based on, for example, the management data D3 (FIG. 28) in the moving image folder 70 (S86).

[0263] In step S86, for example, the control unit 210 first identifies the video file name of the video material corresponding to the priority of the track selected for the cut, and determines various timing information for the video material. For example, the control unit 210 references the timer period of the video material with the identified file name and determines the start timing for the video material to be adopted into the video timeline 80. For example, if the timer period is "5 seconds," the timing 5 seconds after the beginning of the video material is determined to be the start timing for adoption.

[0264] Furthermore, the control unit 210 sets the timing to start and end playback of the video material on the video timeline 80 (S86). In the present system 10, the playback start timing is set to be common among the video files within a cut. For example, the playback start timing for the first cut is set to the start timing of the video timeline 80, and for the second and subsequent cuts, the playback start timing is set to the end of the time range of the previous cut, i.e., the playback end timing of the longest video file. Furthermore, the playback end timing of the video material is set to a timing that is the playback period of the file after the playback start timing.

[0265] In step S86, the control unit 210 sets the placement of the video clips 85 of the video material in the video track 83 so as to reflect the various timing settings as described above. Similarly to the setting of the video clips 85, the control unit 210 also sets the placement of the audio clips 86 of the video material in the audio track 84 (S86).

[0266] Next, the control unit 210 determines whether the placement setting of the video material for the cut has been completed (S87). For example, if the placement setting of the video material for the set number of tracks has been completed for the cut, the control unit 210 proceeds to YES in step S87. Alternatively, for a cut in which the number of video materials in the cut folder 71 is less than the number of tracks, the control unit 210 proceeds to YES in step S87 if the placement setting of all video materials in the cut folder 71 has been completed, and proceeds to NO if not.

[0267] If the placement setting of the video material for the cut has not been completed (NO in S87), the control unit 210 performs the processes from step S85 onwards for the video material that has not been placed in the cut. In this way, the video / audio clips 85, 86 are placed for the cut within the number of tracks (S86).

[0268] Furthermore, when the placement setting of the video material for the cut is completed (YES in S87), the control unit 210 determines whether the placement setting for all cuts to be placed on the video timeline 80 is completed (S88). The determination in step S88 is made within the scope of normal cuts, excluding, for example, additional cuts.

[0269] If there are any unset normal cuts in the video timeline 80 (NO in S88), the control unit 210 performs the processes from step S81 onwards again for the unset normal cuts. In this way, the video timeline 80 is obtained in which video files are arranged in the order of evaluation for all normal cuts.

[0270] For example, when the placement settings for all normal cuts are completed (YES in S88), the control unit 210 generates management data D3 for the video timeline 80 by description in XML language, for example (S89).

[0271] In step S89, the control unit 210 creates tags for each of the video and audio in the tags of the video timeline 80 in the management data D3 of Fig. 28, for example, as shown in Fig. 30, and creates tags for each track number under each tag. Furthermore, the control unit 210 writes, for each cut in the tag of each track number, information related to placement settings such as the video file names and timing information of the video / audio clips 85, 86 determined in step S86.

[0272] By generating the management data D3 for the video timeline 80 in this way, the control unit 210 ends the timeline setting process (S63) and proceeds to step S64 in FIG.

[0273] According to the timeline setting process (S63) described above, the information support terminal 200 of the present system 10 can prepare a video timeline 80 in which video / audio clips 85, 86 are arranged according to a scenario so as to reflect the user's ratings before the video editing process. The user can start video editing without having to go through the trouble of arranging the video material after the cut shooting function according to a scenario, and can obtain a video timeline 80 that reflects the user's ratings.

[0274] For example, during the video editing process, a user can check video / audio clips 85, 86 for each cut on the video timeline 80. In this case, the playback display / audio output of video / audio clips 85, 86 of track number "1" is enabled by default, allowing the user to start reviewing from the most highly rated video material. Furthermore, the video editing PC 300 can appropriately switch between enabling and disabling such playback display / audio output in response to user operations on the video editing screen.

[0275] In the present system 10, the prepared video timeline 80 is managed so that the time ranges of multiple video / audio clips 85, 86 are aligned between separate video / audio tracks 83, 84 for each cut (S84, see FIG. 26). This makes it easier for the user to check each clip 85, 86 for each cut during the video editing process than when the clips 85, 86 are arranged with close time intervals between them on each track 83, 84.

[0276] Furthermore, the time range management in step S84 is performed based on, for example, the longest playback period of the video material placed in each cut (see FIG. 26). This makes it possible to avoid situations where clips overlap between adjacent cuts, for example, and makes it easier to check each cut.

[0277] In this embodiment, the management of the time range for each cut (S84) is not limited to the longest playback period of each cut, but may be performed based on various time lengths of the video material for each cut. For example, the control unit 210 may manage the time range of each cut on the video timeline 80 so as to align it with the playback period of the video material with the highest priority (S84).

[0278] Furthermore, in the present system 10, the arrangement of the portions of the video timeline 80 corresponding to the long take group L is not limited to the above, and various arrangements are possible. For example, the video / audio clips 85, 86 for the insert take may be arranged within the long take group L so that they are shifted from the playback start timing of other angles, etc. by the time difference until the corresponding cut is reached. For example, the control unit 210 may calculate this time difference using the shooting period set in the cut-by-cut data D1, and set the playback start timing of the insert video.

[0279] 3. Summary As described above, in this embodiment, information support terminal 200, an example of an electronic device, manages video shooting for a scenario including multiple cuts. Information support terminal 200 includes display unit 240 that displays information, operation unit 230, an example of an input unit that inputs user operations, and control unit 210 that controls display unit 240 in response to operations input via operation unit 230. Control unit 210 accepts user operations via operation unit 230 to set long take group L, which is an example of a group including at least one set of cuts that continue video shooting across multiple cuts (S21-S27), and causes display unit 240 to display cut list 30, long take range indicator 37, etc., as examples of group information for managing video shooting in long take group L based on the setting of long take group L (S1-S2, see FIG. 15).

[0280] The information support terminal 200 described above makes it easier for the user to manage long take shots across multiple cuts in a scenario by accepting the user's setting of the long take group L and visualizing it using the cut list 30, etc. It is also possible to improve the processing efficiency of the system 10 in providing information support for video shooting that includes long take shots, making it easier for the information support terminal 200 to manage long take shots.

[0281] In the information support terminal 200 of this embodiment, the control unit 210 accepts, via the operation unit 230, a user operation to set an angle for one example of at least one set of cuts in the long take group L (YES in S24, S25), and manages the video shot in association with at least one angle, for example, in a cut icon 3 corresponding to a cut with the same angle in the cut list 30 (see FIG. 10, etc.). This allows the system 10 to set the angle desired by the user in the long take group L and perform long take shooting, making it easier to manage long take shooting.

[0282] In the information support terminal 200 of this embodiment, when the operation unit 230 receives a user operation to set multiple angles A and B for one example of multiple sets of cuts made up of different cuts in the long take group L (S23-S27), the control unit 210 manages each video shot in association with each angle in the group information (see FIG. 10, etc.). This allows the system 10 to set various angles A and B in the long take group L and perform long take shooting, making it easier to manage the long take shooting.

[0283] In the information support terminal 200 of this embodiment, when the operation unit 230 receives a user operation to set an insert cut that is an example of a single cut not included in angles A or B in the long take group L (NO in S24, S26), the control unit 210 manages the video shot in association with the single cut in the cut icon 3 or the like corresponding to the insert cut in the cut list 30 (see FIG. 10, etc.). This allows the system 10 to set cuts to be shot individually in the long take group L, making it easier to use long take shooting.

[0284] In the information support terminal 200 of this embodiment, the control unit 210 acquires, from the operation unit 230, rating information indicating a user's rating of a video shot in association with a selected cut from among multiple cuts (S5, S6). If the selected cut is included in a set of cuts, the control unit 210 manages the video and its rating information in association with the set of cuts (S37, S59). This allows, for example, video and rating results to be shared between cuts shot at the same angle within a long take group L, making it easier to utilize long take shooting.

[0285] In information support terminal 200 of this embodiment, control unit 210 generates management data D3 that manages the priority order in which moving image information indicating each moving image is arranged on a moving image editing screen, which is an example of an editing screen for editing multiple moving images associated with multiple cuts, in accordance with the evaluation information (S61 to S64). Management data D3 collectively manages the moving images associated with cuts in long take group L (see FIGS. 28 and 30). This makes it possible to collectively manage the moving image information in long take group L in management data D3 output by, for example, an export function, making it easier to edit the results of long take shooting.

[0286] In the information support terminal 200 of this embodiment, when a video associated with a cut included in the long take group L is shot, the control unit 210 adds, for example, the video file name as information indicating the group to the video metadata D2, which is an example of metadata for the video (see FIG. 18(B)). This makes it possible to identify the long take group L of the video from the video metadata D2, making it easier to manage long take shooting.

[0287] In this embodiment, information support terminal 200 further includes storage unit 220 for storing cut division data D1, which is an example of management information for managing moving images associated with multiple cuts in a scenario. Control unit 210 manages the relationship between the moving images and long take group L using group numbers and the like in cut division data D1 (see FIG. 7). This makes it easier to manage the cuts in long take group L on information support terminal 200.

[0288] In this embodiment, the information support terminal 200 further includes a communication unit 250 that performs data communication with the digital camera 100, which is an example of an imaging device that performs video shooting. The control unit 210 manages the video shot by the digital camera 100 through data communication via the communication unit 250 (S5). This makes it easier to manage the video shooting for each cut in the information support terminal 200, which is separate from the digital camera 100.

[0289] In this embodiment, a video management method for managing video shooting in a scenario including multiple cuts is provided. In this method, the control unit 210 of the information support terminal 200 accepts, via the operation unit 230, a user operation for setting a long take group L including at least one set of cuts for continuing video shooting across multiple cuts, and causes the display unit 240 to display group information for managing video shooting in the long take group L based on the setting of the long take group L.

[0290] In this embodiment, a program is provided for causing the control unit 210 to execute the above video management method. This video management method makes it easier to manage video shooting across multiple cuts in a scenario.

[0291] (Other embodiments) As described above, embodiment 1 has been described as an example of the technology disclosed in this application. However, the technology in this disclosure is not limited to this, and can be applied to embodiments in which appropriate modifications, substitutions, additions, omissions, etc. are made. Furthermore, it is also possible to combine the components described in the above embodiment to create new embodiments.

[0292] In the first embodiment described above, the long take group L was described as an example of a cut group in the system 10, but the present disclosure is not particularly limited thereto. For example, in the present embodiment, a group may be an angle as in the first embodiment, or multiple cuts having the same angle may constitute one group. In the information support terminal 200 of the present embodiment, the cut list 30 has similar highlighting for cuts at the same angle A, as shown in FIG. 10 , and from this perspective, may be an example of group information in the present embodiment. Furthermore, the video list 50 may be organized by angle as described above, and such a video list 50 is also an example of group information in the present embodiment. The system 10 can also use such cut groups to manage information to reduce forgetting to shoot videos, as in the first embodiment, and can facilitate management of video shooting across multiple cuts.

[0293] Furthermore, in this embodiment, cut groups such as angles and long takes may be set independently. For example, in the long take setting process (FIG. 8), the angle and insert settings (S23-S26) may be omitted. Alternatively, in this embodiment, the long take setting may be omitted, and for example, the long take group number may be omitted from the cut division data D1.

[0294] In this embodiment, the cut group does not have to be an angle, but may be set from various perspectives. For example, a user of the system 10 can use a cut group for a flashback scene in a video work or when reusing the same video shooting results in multiple cuts in a scenario. The information support terminal 200 of this embodiment may manage group names instead of angle names in the cut division data D1, for example. In this embodiment, such a cut group does not have to include at least one set of cuts that continue shooting the video, but may be a combination of various cuts.

[0295] Furthermore, the information support terminal 200 of this embodiment does not necessarily need to use the long take group L in its export function. For example, in step S71 of the folder configuration process (S62), the control unit 210 may select a group of cuts, such as an angle, all together instead of the long take group L, or may select each cut within that group individually. The control unit 210 of this embodiment may configure the video folder 70 so that, for cuts in the same group, a cut folder 71 is set up for each cut (S73), and videos of common takes are stored in each cut folder 71 (S74-S76). Alternatively, the control unit 210 may set up a common cut folder 71 for cuts within a group.

[0296] Furthermore, the information support terminal 200 of this embodiment may not use the long take group L in the timeline setting process (S63). For example, the control unit 210 of this embodiment may arrange videos of common takes for cuts in the same group on the video timeline 80. Videos of different cuts in the same group may have common timing information on the video timeline 80, or may have different timing information.

[0297] As described above, in the information support terminal 200 of this embodiment, the control unit 210 may receive, via the input unit, a user operation for setting a group including a set of cuts from among a plurality of cuts, and manage the cuts in the group by associating a common video with the cuts in the group based on the group setting. This allows the information support terminal 200 of this embodiment to easily manage video shooting across a plurality of cuts, for example, for groups of cuts such as flashback scenes or angles, as in the above-described embodiment.

[0298] Furthermore, in the information support terminal 200 of this embodiment, the control unit 210 may generate management data for the video folder 70 or the video timeline 80 as an example of management data for collectively managing videos associated with cuts in a group among a plurality of cuts. This allows the information support terminal 200 of this embodiment to facilitate video editing using a group of cuts that share a common video.

[0299] In each of the above embodiments, the information support terminal 200 has been described as an example of an electronic device separate from an imaging device, but the present disclosure is not limited to this. The electronic device of the present embodiment may be integrated with an imaging device that captures video. Such a modification will be described with reference to FIG. 31.

[0300] 31 illustrates a modified example of the digital camera 100. In this embodiment, the digital camera 100 has various functions, such as the cut shooting function of the information support terminal 200 described above. For example, as shown in FIG. 31, the control unit 135 of the digital camera 100 displays a cut selection screen including multiple cuts based on a cut list 30 on the display monitor 130, and accepts cut selection by the user via the operation unit 150, such as a touch panel or operation buttons.

[0301] In the example of Fig. 31, the display monitor 130 displays a cut list 30 superimposed on a live view image. The control unit 135 of the digital camera 100 generates video data, for example, by the imaging operation of the image sensor 115. As with the recording mode processing of the first embodiment (Fig. 16), when a video of a selected cut is shot, the control unit 135 of the digital camera 100 displays a rating screen (Fig. 12) on the display monitor 130 and acquires user evaluation information. As with the first embodiment, this digital camera 100 can also provide the user with information support through the cut shooting function and export function.

[0302] As described above, in this embodiment, digital camera 100, which is an example of an electronic device, further includes image sensor 115, which is an example of an imaging unit that captures an image of a subject and generates image data. Control unit 135 manages a moving image composed of the image data generated by image sensor 115. This makes it easier for digital camera 100 to manage the shooting of a moving image for each cut.

[0303] In each of the above embodiments, a cut selection screen including a cut list 30 has been exemplified, but the selection screen of the present disclosure is not limited to this. The selection screen of the present embodiment may not include the cut list 30, and may include multiple cuts in a display format different from the cut icon 3. Furthermore, the selection screen of the present embodiment may be a dialog display, or may be displayed superimposed on various display screens. In the present embodiment, the cut list 30 may be an example of a selection screen. In the present embodiment, the selection screen of the information support terminal 200 may distinguish whether or not video shooting has been completed for each cut in various display formats not limited to the above examples.

[0304] In the above embodiments, examples have been described in which the evaluation information is three types: "OK," "KEEP," and "NG." However, the evaluation information is not limited to these. In this embodiment, the evaluation information may be three types of evaluation different from the above, or may be two or four or more types instead of three. Furthermore, in this embodiment, the evaluation information may be a continuous score. The electronic device of this embodiment may accept user input of such various evaluation information and manage video recording for each cut. For example, by appropriately setting a criterion for determining whether video recording of a cut has been completed, this can be displayed as an identification. Furthermore, the information support terminal 200 of this embodiment may set a priority in the management data D3 to reflect such various evaluations.

[0305] In the above embodiments, an example has been described in which the management data D3 includes a video folder 70 and a video timeline 80. In this embodiment, the management data may include either the video folder 70 or the video timeline 80, and the other may be omitted. Furthermore, in the above embodiments, an example has been described in which the management data D3 is written in XML language. In this embodiment, the management data D3 is not limited to XML language and may be written in various markup languages ​​or data description languages ​​that are compatible with editing software used in the video editing process. The management data D3 may also be various metadata for managing videos in various cuts.

[0306] In addition, in each of the above embodiments, the information support terminal 200 is described as an example of an electronic device, and the video editing PC 300 is described as an example of an external device. In this embodiment, the electronic device may be the video editing PC 300, and the video editing PC 300 may have various functions of the information support terminal 200 described above. In this embodiment, the editing screen may be displayed not only on an external device, but also on the electronic device. Furthermore, if an external display device is used in the video editing PC 300, the external device in this embodiment may include such a display device.

[0307] Furthermore, in each of the above embodiments, the digital camera 100 is illustrated as including the optical system 110 and the lens driving unit 112. The imaging device of this embodiment does not necessarily have to include the optical system 110 and the lens driving unit 112, and may be, for example, an interchangeable lens camera.

[0308] Furthermore, in each of the above embodiments, a digital camera has been described as an example of an imaging device, but the present disclosure is not limited to this. The imaging device of the present disclosure may be any electronic device having an image capturing function (for example, a video camera, a smartphone, a tablet terminal, etc.). Furthermore, the electronic device of the present disclosure does not necessarily have to have an image capturing function, and may be any of various electronic devices.

[0309] (Example) Various aspects of the present disclosure will be exemplified below.

[0310] A first aspect of the present disclosure is an electronic device that manages video shooting for a scenario including multiple scenes. The electronic device includes a display unit that displays information, an input unit that inputs user operations, and a control unit that controls the display unit in response to the operations input via the input unit. The control unit receives a user operation via the input unit to set a group including one set of scenes from the multiple scenes, and causes the display unit to display group information that manages video shooting for the group based on the group setting.

[0311] In a second aspect, in the electronic device according to the first aspect, the control unit manages cuts in a group among the plurality of cuts by associating them with a common moving image based on a group setting.

[0312] In a third aspect, in the electronic device according to the first or second aspect, the group includes at least one set of cuts that continue to capture a moving image over a plurality of cuts.

[0313] In a fourth aspect, in the electronic device described in the third aspect, the control unit accepts user operation at the input unit to set at least one set of cuts in a group, and manages the video shot in association with the at least one set of cuts in the group information.

[0314] In a fifth aspect, in the electronic device described in the third or fourth aspect, when the control unit receives a user operation at the input unit to set multiple sets of cuts consisting of different cuts in a group, the control unit manages each of the videos shot in association with each set of cuts in the group information.

[0315] In a sixth aspect, in an electronic device described in any of the third to fifth aspects, when the control unit receives a user operation at the input unit to set a single cut that is not included in at least one set of cuts in a group, the control unit manages the video shot in association with the single cut in the group information.

[0316] In a seventh aspect, in an electronic device described in any of the first to sixth aspects, the control unit acquires, from the input unit, evaluation information indicating a user's evaluation of a video shot in association with a selected cut from among a plurality of cuts, and if the selected cut is included in a set of cuts, manages the video and its evaluation information in association with the set of cuts.

[0317] In an eighth aspect, in the electronic device according to the seventh aspect, the control unit generates management data for managing the priority of arrangement of video information indicating each video on an editing screen for editing a plurality of videos associated with a plurality of cuts, according to the evaluation information. The management data manages the videos associated with each group of cuts.

[0318] In a ninth aspect, in the electronic device according to any one of the first to eighth aspects, the control unit generates management data for collectively managing moving images associated with cuts in a group among the plurality of cuts.

[0319] In a tenth aspect, in the electronic device according to any one of the first to ninth aspects, when a video associated with a cut included in a group is shot, the control unit includes information indicating the group in the metadata of the video.

[0320] In an eleventh aspect, the electronic device according to any one of the first to tenth aspects further comprises a storage unit for storing management information for managing videos associated with each of a plurality of cuts in a scenario, and the control unit manages the relationship between the videos and groups in the management information.

[0321] In a twelfth aspect, the electronic device according to any one of the first to eleventh aspects further includes a communication unit that performs data communication with an image capture device that captures moving images, and the control unit manages the moving images captured by the image capture device through data communication via the communication unit.

[0322] In a thirteenth aspect, the electronic device according to any one of the first to eleventh aspects further includes an imaging unit that captures an image of a subject and generates image data, and the control unit manages a moving image configured from the image data generated by the imaging unit.

[0323] A fourteenth aspect is a video management method for managing videos in a scenario including multiple cuts, in which a control unit of an electronic device receives, via an input unit, a user operation for setting a group including at least one set of cuts for continuing video shooting in the multiple cuts, and causes a display unit to display, based on the group setting, group information for managing the video shooting in the group.

[0324] In a fifteenth aspect, there is provided a program for causing a control unit to execute the video management method according to the fourteenth aspect.

[0325] A sixteenth aspect is an electronic device that manages video shooting for a scenario including a plurality of cuts, and includes an input unit that inputs user operations, and a control unit that generates information related to the video shooting in response to the operation input to the input unit. The control unit receives a user operation at the input unit that sets a group including a set of cuts from the plurality of cuts, and manages the cuts in the group by associating a common video with the cuts from the plurality of cuts based on the group setting. A video management method or a program therefor executed by the control unit of the electronic device according to the sixteenth aspect may be provided.

[0326] As described above, the embodiments have been described as examples of the technology of the present disclosure. For this purpose, the accompanying drawings and detailed description have been provided. Therefore, among the components described in the accompanying drawings and detailed description, not only components essential for solving the problem but also components that are not essential for solving the problem in order to exemplify the above technology may be included. [Industrial Applicability]

[0327] The present disclosure is applicable to various uses in which video including multiple cuts is shot. [Explanation of symbols]

[0328] 10. Imaging System 100 digital cameras 200 Information Support Terminal 210 Control Unit 220 Storage section 230 Operation section 240 Display section 250 Communications Department

Claims

1. An electronic device for managing video shooting for a scenario including multiple cuts, a display unit that displays information; an input unit for inputting user operations; a control unit that controls the display unit in response to an operation input through the input unit, The control unit receiving, via the input unit, a user operation for setting a group including one set of cuts from the plurality of cuts; Displaying group information for managing video shooting in the group on the display unit based on the group settings electronic equipment.

2. The control unit manages the cuts in the group among the plurality of cuts by associating a common moving image with the cuts in the group based on the setting of the group. The electronic device according to claim 1 .

3. The group includes at least one set of cuts that continue the video shooting in the plurality of cuts. The electronic device according to claim 1 .

4. The control unit receives a user operation to set the at least one set of cuts in the group via the input unit, and manages a video to be shot in association with the at least one set of cuts in the group information. The electronic device according to claim 3 .

5. When the control unit receives a user operation to set a plurality of sets of cuts each consisting of different cuts in the group, the control unit manages each of the videos shot in association with each set of cuts in the group information. The electronic device according to claim 3 .

6. When the control unit receives a user operation to set a single cut that is not included in the at least one set of cuts in the group, the control unit manages a video that is shot in association with the single cut in the group information. The electronic device according to claim 3 .

7. The control unit acquiring, from the input unit, evaluation information indicating a user's evaluation of the video shot in association with a selected cut from the plurality of cuts; If the selected cut is included in the set of cuts, the moving image and its evaluation information are managed in association with the set of cuts. The electronic device according to claim 1 .

8. the control unit generates management data for managing a priority order in which moving image information indicating each moving image is arranged on an editing screen that edits a plurality of moving images associated with the plurality of cuts, according to the evaluation information; The management data manages a moving image associated with each cut of the group.

8. The electronic device according to claim 7.

9. The control unit generates management data for collectively managing videos associated with the cuts in the group among the plurality of cuts. The electronic device according to claim 1 .

10. When a video associated with the cuts included in the group is shot, the control unit includes information indicating the group in metadata of the video. The electronic device according to claim 1 .

11. a storage unit for storing management information for managing moving images associated with the plurality of cuts in the scenario, The control unit manages the relationship between the video and the group in the management information. The electronic device according to claim 1 .

12. a communication unit that performs data communication with the imaging device that performs the video shooting, The control unit manages the video captured by the imaging device through data communication via the communication unit. The electronic device according to claim 1 .

13. further comprising an imaging unit that captures an image of a subject and generates image data; The control unit manages a moving image formed from image data generated by the imaging unit. The electronic device according to claim 1 .

14. A video management method for managing video shooting for a scenario including multiple cuts, comprising: The control unit of the electronic device receiving, via an input unit, a user operation for setting a group including one set of cuts from the plurality of cuts; Displaying group information for managing video shooting in the group on a display unit based on the group settings How to manage videos.

15. A program for causing the control unit to execute the video management method according to claim 14.

16. An electronic device for managing video shooting for a scenario including multiple cuts, an input unit for inputting user operations; a control unit that generates information about the video shooting in response to an operation input through the input unit, The control unit receiving, via the input unit, a user operation for setting a group including one set of cuts from the plurality of cuts; Based on the setting of the group, a common moving image is associated with the cuts in the group among the plurality of cuts and managed. electronic equipment.

Citation Information

Patent Citations

  • Picture program production assistance system, planning device, processing device, processing method of video program and program and data structure

    JP2004187275A

  • Electronic apparatus

    JP2020102821A