Electronic apparatus and shooting management method

Abstract

To provide an electronic apparatus capable of facilitating the management of video recording according to the music, and a shooting management method.SOLUTION: The electronic apparatus for managing video recording according to music includes: a display unit that displays information; an input unit for inputting user operations; and a control unit that generates management information for managing video associated with audio data representing music. The control unit causes the display unit to display the period included in the music in the audio data, receives the user operations to set the shooting unit for video recording corresponding to the period in the music in the management information from the input unit, and generates management information while associating the time period in the music with the shooting unit set by the user operation.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present disclosure relates to an electronic device and a shooting management method for managing video shooting according to music. [Background technology]

[0002] Patent Document 1 discloses a video recording device that records video data in accordance with the flow of a song. When a section of a song divided into multiple sections is specified, the video recording device stores video data representing footage captured by a camera while playing the specified section of the song, corresponding to the specified section and to the progression of the song. The video recording device plays the video data stored for each section continuously, simultaneously with the playback of the song spanning multiple sections. In this way, Patent Document 1 aims to make it easy to create video data spanning the entire song, even for long songs. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-103659 Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure provides an electronic device and a shooting management method that can easily manage video shooting according to music. [Means for solving the problem]

[0005] In the present disclosure, an electronic device manages video recording in accordance with music. The electronic device includes a display unit that displays information, an input unit that inputs user operations, and a control unit that generates management information for managing video associated with audio data representing the music. The control unit causes the display unit to display a period included in the music in the audio data, and accepts a user operation from the input unit to set a recording unit for recording the video corresponding to the period in the music in the management information. The control unit generates the management information by associating the recording unit set by the user operation with the period in the music.

[0006] In the present disclosure, a shooting management method is a method for managing video shooting according to music. The method includes a step in which a control unit of an electronic device generates management information for managing video associated with audio data representing the music. The control unit is configured to control a display unit that displays information and an input unit that inputs user operations. In the method, the step of generating management information includes a step of displaying a period included in the music in the audio data on the display unit and receiving, from the input unit, a user operation for setting a shooting unit for shooting the video corresponding to the period in the music in the management information; and a step of generating management information by associating the period in the music with the shooting unit set by the user operation.

[0007] In another aspect of the present disclosure, an electronic device includes an imaging unit that captures an image of a subject and generates video data, a storage unit that stores management information for managing videos associated with audio data representing music, and a control unit that controls video capture by the imaging unit. The management information includes a recording unit that associates a period within the music with a recording unit set to record a video corresponding to a period within the music in the audio data. The control unit controls video capture for each recording unit based on the management information.

[0008] In another aspect of the present disclosure, an electronic device includes a display unit that displays information, an input unit that inputs user operations, a control unit that controls the display unit and the input unit, and a storage unit that stores management information for managing videos associated with audio data representing songs. The management information includes periods within the songs associated with shooting units set to shoot videos corresponding to periods within the songs in the audio data. The control unit displays the videos shot in the shooting units on the display unit based on the management information, and accepts user operations from the input unit to edit the videos associated with the audio data. [Effects of the Invention]

[0009] The electronic device and shooting management method according to the present disclosure can facilitate management of video shooting according to music. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 10 is a diagram showing a display example of a function selection screen in the electronic device according to the first embodiment of the present disclosure. [Figure 2] FIG. 1 is a diagram illustrating a configuration of an electronic device. [Figure 3] FIG. 10 is a diagram showing an example of a display of a plan creation screen on an electronic device. [Figure 4] FIG. 10 is a diagram showing an example of an angle setting screen displayed on an electronic device. [Figure 5] 1 is a flowchart illustrating an example of the operation of a plan creation function in an electronic device. [Figure 6] A diagram showing a display example for setting the range of songs in the plan creation function [Figure 7] FIG. 10 is a diagram showing an example of a display after the angle is set on the electronic device. [Figure 8A] Flowchart illustrating an angle setting process in an electronic device [Figure 8B] A flowchart illustrating the angle setting process following FIG. 8A. [Figure 9] FIG. 10 is a diagram illustrating an example of a data structure of angle data in an electronic device. [Figure 10] FIG. 10 is a diagram showing an example of an angle selection screen display in the photographing function of the electronic device; [Figure 11] 1 is a flowchart illustrating an example of an operation of a photographing function in an electronic device; [Figure 12] FIG. 10 is a diagram showing an example of a rating screen display on an electronic device. [Figure 13] 10 is a flowchart illustrating a process in a recording mode in an electronic device; [Figure 14] FIG. 10 is a diagram showing an example of a display in a recording mode of an electronic device. [Figure 15] A diagram for explaining a timer function in the recording mode of an electronic device [Figure 16] FIG. 10 is a diagram showing an example of a video editing screen displayed on an electronic device. [Figure 17A] Flowchart illustrating the operation of a video editing function in an electronic device [Figure 17B] A flowchart illustrating the operation of the video editing function following FIG. 17A. [Figure 18] A diagram for explaining the operation of a video editing function in an electronic device [Figure 19] 10 is a flowchart illustrating a process in a recording mode according to a modification of the first embodiment; DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, detailed descriptions of well-known matters and redundant descriptions of substantially identical configurations may be omitted. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0012] (Embodiment 1) In the first embodiment of the present disclosure, an electronic device having a video shooting function will be described.

[0013] 1. Configuration An electronic device 200 according to a first embodiment of the present disclosure will be described with reference to Fig. 1. The electronic device 200 according to this embodiment has various functions for sequentially providing information support to a user in the production of a video work. Fig. 1 shows an example of a display of a function selection screen for selecting these various functions.

[0014] The electronic device 200 can be used to create desired video works, such as music videos or dance videos, by, for example, allowing a user to shoot and edit multiple videos in accordance with a song. The electronic device 200 provides useful information support for a series of workflows, such as when a user creates a plan outlining a video shoot concept in accordance with a song, repeatedly shoots videos in accordance with the created plan, and then edits the multiple shot videos. Such information support can, for example, make it easier to manage the workflow in the production of a video work. The video data of a video work created by the electronic device 200 can be exported to an external device, for example, via a communication network.

[0015] 1.1.Configuration of electronic devices The configuration of the electronic device 200 according to this embodiment will be described with reference to FIG.

[0016] 3 is a diagram illustrating an example of the configuration of electronic device 200. Electronic device 200 is configured as, for example, a smartphone or a tablet terminal. Electronic device 200 illustrated in FIG. 3 includes a control unit 210, a storage unit 220, an operation unit 230, a display unit 240, a communication unit 250, a microphone 260, a speaker 270, and an imaging unit 280.

[0017] The control unit 210 includes, for example, a CPU or MPU that works in cooperation with software to realize predetermined functions. The control unit 210 controls, for example, the overall operation of the electronic device 200. The control unit 210 reads data and programs stored in the storage unit 220, performs various arithmetic processing, and realizes various functions.

[0018] The control unit 210 executes, for example, a program including a set of instructions for implementing each of the above functions. The program may be provided via a communication network such as the Internet, or may be stored on a portable recording medium. The control unit 210 may also be a hardware circuit such as a dedicated electronic circuit or a reconfigurable electronic circuit designed to implement each of the above functions. The control unit 210 may also be configured with various semiconductor integrated circuits such as a CPU, MPU, GPU, GPGPU, TPU, microcomputer, DSP, FPGA, and ASIC.

[0019] The storage unit 220 is a storage medium that stores programs and data necessary to realize the functions of the electronic device 200. The storage unit 220 includes a storage unit 221 and a temporary storage unit 222, as shown in FIG.

[0020] The storage unit 221 stores parameters, data, control programs, etc. for realizing predetermined functions. The storage unit 221 is configured, for example, with an HDD or SSD. For example, the storage unit 221 stores the above-mentioned programs, audio data representing music, various image data, etc.

[0021] The temporary storage unit 222 is configured with a RAM such as a DRAM or an SRAM, and temporarily stores (i.e., holds) data. For example, the temporary storage unit 222 holds image data that is in the middle of being edited. The temporary storage unit 222 may also function as a work area for the control unit 210, and may be configured as a storage area in the internal memory of the control unit 210.

[0022] The operation unit 230 is a general term for operation members operated by the user. The operation unit 230 is, for example, a touch panel superimposed on the display unit 240 for inputting various touch operations, and is an example of an input unit of the electronic device 200. The input unit may be a connection software unit that communicates with various external input devices and receives operation signals. The operation unit 230 may be a physical button or switch provided on the electronic device 200, or may be a keyboard, a mouse, a touchpad, or the like. The operation unit 230 may be various GUIs such as virtual buttons, icons, cursors, software keyboards, and objects displayed on the display unit 240.

[0023] The display unit 240 is configured with, for example, a liquid crystal display or an organic EL display. The display unit 240 may display various types of information, such as various GUIs for operating the operation unit 230 and information input from the operation unit 230.

[0024] The communication unit 250 is a module (circuit) that connects to an external device in accordance with a predetermined communication standard for wired or wireless communication. The predetermined communication standard includes, for example, USB, HDMI (registered trademark), IEEE802.11, Wi-Fi (registered trademark), Bluetooth (registered trademark), etc. The communication unit 250 may connect the electronic device 200 to a communication network such as the Internet. The communication unit 250 is an example of an acquisition unit that receives various information from an external device or a communication network.

[0025] Microphone 260 includes, for example, one or more microphone elements built into electronic device 200. Microphone 260 outputs an audio signal indicating the picked-up sound to control unit 210. Instead of or in addition to built-in microphone 260, electronic device 200 may include a connection unit such as a terminal for connecting to an external microphone.

[0026] The speaker 270 includes, for example, one or more speaker elements built into the electronic device 200, and outputs sound to the outside of the electronic device 200 under the control of the control unit 210. The electronic device 200 may include a connection unit for connecting to an external speaker, earphones, or the like, instead of or in addition to the built-in speaker 270. The speaker 270 and / or the connection unit are an example of an output unit in this embodiment.

[0027] The imaging unit 280 is realized by, for example, an optical system and an image sensor. The optical system includes various lenses, an aperture, a shutter, etc. The image sensor is, for example, a CCD image sensor or a CMOS image sensor, and captures an image of a subject formed via the optical system to generate imaging data. The imaging data constitutes image data representing an image captured by the image sensor. The image sensor generates image data for a new frame at a predetermined frame rate (e.g., 30 frames / second). The timing of generating imaging data and the operation of the electronic shutter in the image sensor of the imaging unit 280 are controlled by the control unit 210. The lens in the optical system of the imaging unit 280 may include a focus lens and / or a zoom lens, etc.

[0028] In electronic device 200 of this embodiment, imaging unit 280 includes, for example, an in-camera provided on a surface having display unit 240, and an out-camera provided on a surface opposite to the surface on the display unit 240 side. In electronic device 200, control unit 210 may perform various processes on imaging data output from the image sensor of imaging unit 280 to generate image data, or may perform various processes on image data to generate an image to be displayed on display unit 240.

[0029] The above-described configuration of electronic device 200 is an example, and the configuration of electronic device 200 is not limited thereto. For example, various display devices such as a projector and a head-mounted display may be used for display unit 240 of electronic device 200. Furthermore, when an external display device is used, display unit 240 of electronic device 200 may be an output interface circuit for a video signal conforming to, for example, the HDMI standard.

[0030] 2. Operation The operation of electronic device 200 configured as above will be described below.

[0031] As shown in FIG. 1, the electronic device 200 of this embodiment provides various functions in a workflow for producing a moving image.

[0032] 1, the display unit 240 of the electronic device 200 displays a plan creation button 11, a shooting button 12, a video editing button 13, and an export button 14. Hereinafter, the longitudinal direction of the screen of the display unit 240 is defined as the X direction, and the width direction is defined as the Y direction.

[0033] The plan creation button 11 is a virtual button that accepts a user operation to execute a plan creation function in the electronic device 200. The plan creation function is a function that provides information support for the process in which the user creates a plan before shooting a video. The electronic device 200 of this embodiment manages various information for each angle at which video shooting is performed in the created plan. The angle constitutes a shooting unit, such as a unit for managing video shooting corresponding to a period in a song.

[0034] The shooting button 12 is a virtual button for executing a function (i.e., a shooting function) that supports video shooting at each angle in a plan created by, for example, the plan creation function. The number of times a video is shot for one angle is not limited to one take, and multiple takes may be possible. The electronic device 200 of this embodiment controls video shooting by the electronic device 200 in the shooting function and manages the shooting results for each angle.

[0035] The video editing button 13 is a virtual button for executing a function (i.e., a video editing function) that supports the process of editing video data captured at each angle using the shooting function. The video editing function provides information support that makes it easier to edit video data captured according to a plan into a video work.

[0036] The export button 14 is a virtual button for executing a function (i.e., an export function) to output a video edited by the video editing function. In the export function, the electronic device 200 accepts a user operation to specify, for example, the output destination and output format of the video. For example, the output format can be selected from a single video file representing a video work in which video data from multiple captures is integrated by the video editing function, and multiple files that are easy to edit in external video editing software.

[0037] The electronic device 200 of this embodiment can provide consistent information support from creating a plan to outputting the edited video, for example, by the user sequentially using the functions of the plan creation button 11, the shooting button 12, the video editing button 13, and the export button 14.

[0038] The function selection screen of the electronic device 200 may further include a delete button for deleting various data in the information support described above. For example, in response to a user operation of the delete button, the electronic device 200 may collectively delete video files of the shooting results according to the same plan.

[0039] 2.1. About the plan creation function The operation of the plan creation function in the electronic device 200 will be outlined with reference to FIGS. 1 and 3 to 4. FIG.

[0040] When a user operation, such as tapping the plan creation button 11 on the function selection screen of FIG. 1 , is input from the operation unit 230, the control unit 210 of the electronic device 200 causes the display unit 240 to display a plan creation screen as shown in FIG. 3. The plan creation screen is a screen for selecting each function in the plan creation function. The display unit 240 displays a back button 15, a music selection button 16, a music range setting button 17, and an angle setting button 18 on the plan creation screen exemplified in FIG. 3.

[0041] The back button 15 accepts a user operation to go back by one screen in the screen transition of the electronic device 200. For example, the control unit 210 transitions the display unit 240 to the function selection screen (FIG. 1) in response to a user operation of the back button 15 on the plan creation screen (FIG. 3).

[0042] The song selection button 16 is a virtual button for executing a function to select a song to be played in the video work. The song range setting button 17 is a virtual button for executing a function to specify a range to be included in the video work from the period of the song selected by the song selection function. The angle setting button 18 is a virtual button for executing a function to set an angle for video shooting in association with the audio data of the song.

[0043] For example, when the angle setting button 18 is selected on the plan creation screen, the control unit 210 causes the display unit 240 to display the angle setting screen shown in FIG. 4(A) and accepts various user operations related to angle setting from the operation unit 230.

[0044] For example, the control unit 210 transitions the display unit 240 to an angle editing screen as shown in FIG. 4(B) in response to a user operation to select an angle setting field 20 for each angle on the angle setting screen. In the electronic device 200, the angle setting field 20 accepts a user operation to select an angle to be set. The angle editing screen is a screen for editing the angle in the selected angle setting field 20. In this embodiment, as shown in FIG. 4(A), an example will be described in which a maximum of four angles can be set in a plan for producing one video work.

[0045] 2.1.1. Overall operation of the plan creation function The overall operation of the plan creation function in the electronic device 200 will be described with reference to FIGS.

[0046] Fig. 5 is a flowchart illustrating the operation of the plan creation function in the electronic device 200. Each process shown in the flowchart in Fig. 5 is executed by, for example, the control unit 210 of the electronic device 200. The process of this flowchart starts when, for example, the plan creation button 11 on the function selection screen (Fig. 1) is operated, with the plan creation screen (Fig. 3) displayed on the display unit 240.

[0047] The control unit 210 executes a song selection function in response to a user operation, for example, selecting the song selection button 16 on the plan creation screen by tapping or the like (S10). For example, the control unit 210 causes the display unit 240 to display, as options, titles and the like of songs corresponding to audio data, based on the audio data stored in the storage unit 221 or the like and metadata associated with the audio data. When a user operation to select an option of the displayed songs is input from the operation unit 230, the control unit 210 reads, for example, the audio data of the selected song into the temporary storage unit 222, and transitions the display unit 240 to the plan creation screen. The control unit 210 may store information indicating the selected song in the storage unit 220 in association with angle data, which will be described later.

[0048] Next, the control unit 210 determines whether or not an instruction to set a music range has been given, for example, based on whether or not a user operation to select the music range setting button 17 on the plan creation screen has been input from the operation unit 230 (S11). After the music is selected in step S10, for example, the control unit 210 may enable the music range setting button 17 and the angle setting button 18 on the plan creation screen to be selectable.

[0049] If there is an instruction to set the song range (YES in S11), the control unit 210 causes the display unit 240 to display a screen for the user to specify the song range using the song range setting function (S12). FIG. 6 shows an example of the display of such a song range setting screen. The screen shown in FIG. 6 includes a back button 15, a song icon 2, a song name 21 indicating the song title or file name, a play field 22, and a play button 25. The control unit 210 accepts various user operations related to the displayed song range setting screen via the operation unit 230. For example, operating the play button 25 starts or stops audio output from the speaker 270, etc.

[0050] In the electronic device 200, the playback field 22 accepts a user operation to specify a range to be associated with a video from a period, such as the playback time of the audio data of a song. The playback field 22 includes a playback head 23, an audio timeline 24, markers 26a and 26b, a period display 27, and a marker time 28, as shown in FIG.

[0051] The playhead 23 is disposed, for example, on an audio timeline 24 and indicates a position corresponding to the time currently being played in the audio data of the song indicated by the song title 21. The audio timeline 24 is updated sequentially as the song is played, for example, by displaying the played period in the audio data in the -Y direction from the position indicated by the playhead 23 and the unplayed period in the +Y direction from that position. The audio timeline 24 may display a portion of the audio data, such as a predetermined period before or after the position of the playhead 23. For example, the predetermined period displayed on the audio timeline 24 may be changed by a user operation such as pinching in and out on the audio timeline 24. The playhead 23 may also be fixed at the center of the audio timeline 24 in the Y direction, or the time of the playhead may be changed by a user operation such as scrolling the audio timeline 24 in the ±Y directions.

[0052] Marker 26a and marker 26b respectively indicate the start point and end point of a range specified from the period of the audio data, and move in the Y direction on audio timeline 24 in response to a drag operation or the like. Period display 27 indicates the period of the music in the audio data. On the screen of FIG. 6, period display 27 displays a comparison between the period from the start point to the end point specified by marker 26 and the entire period set in the music range setting. Marker time 28 indicates the time at which marker 26a or marker 26b being operated is located in the audio data.

[0053] 5, when a user operation to specify a range in the duration of a song using markers 26a, 26b is input from operation unit 230, and then, for example, back button 15 is operated, control unit 210 sets the specified range as the range to be played in the video work (S13). Control unit 210 may store information indicating the song range thus set in storage unit 220 or the like in association with the audio data of the song.

[0054] On the other hand, if there is no instruction to set the music range (NO in S11), the control unit 210 proceeds to the process of step S 14. In this case, for example, the entire period of the music in the audio data is set as the music range to be played in the video work.

[0055] The control unit 210 executes the angle setting function in response to, for example, a user operation of selecting the angle setting button 18 on the plan creation screen (FIG. 3) (S14). For example, the control unit 210 generates angle data including input angle setting information in response to various user operations on the angle setting screen (FIG. 4(A)) and the angle editing screen (FIG. 4(B)) (S14). In the electronic device 200 of this embodiment, the angle data is an example of management information that manages video that is shot in association with audio data of music. An example of the angle setting screen after the angle setting process (S14) is completed is shown in FIG. 7.

[0056] 7 shows an example in which four angles are set. The control unit 210 assigns angle numbers indicating angle identification information in the angle data to the angles that are arranged in the X direction on the angle setting screen and set sequentially, for example, in ascending order.

[0057] In the electronic device 200 of this embodiment, an angle is an example of a unit of shooting that manages how video shooting is performed in accordance with a song by associating it with a range of the song's duration specified by the user in the audio data. The electronic device 200 can manage multiple videos shot in accordance with the specified range of the song for each angle. Multiple takes may be associated with each angle.

[0058] For example, an angle icon 3 indicating a composition for capturing a subject in video shooting for each angle is set for each angle. Also, the designated period 29 for each angle in the display example of Fig. 7 indicates the range designated for each angle within the period of a song, and corresponds to the range designated by the marker 26 on the audio timeline 24 similar to the screen for setting the song range (Fig. 6), for example. The electronic device 200 of this embodiment can set multiple angles within overlapping ranges within the period of a song, as shown in Fig. 7, for example.

[0059] In the electronic device 200 of this embodiment, for example, by setting a plurality of angles in the overlapping range of music pieces and shooting a video, the user can use the shooting results from each angle and a video editing function to incorporate the shooting results from a desired angle into the video work. Details of the angle setting process (S14) will be described later.

[0060] After the angle setting process (S14) is executed, the control unit 210 refers to the generated angle data and determines whether or not one or more angles have been set for the entire music range set in step S13 (S15). If there is no instruction to set a music range (NO in S11), the determination in step S15 may be performed for the entire music period in the audio data. If one or more angles have not been set for the entire music range (NO in S15), the control unit 210 repeats the process of step S14.

[0061] If one or more angles are set for the entire range of music (YES in S15), the control unit 210 enables the shooting function of the electronic device 200 (S16) and ends the processing of this flowchart. For example, the control unit 210 may change the state of the function selection screen (FIG. 1) in which user operation of the shooting button 12 is disabled to enabled.

[0062] According to the process of the plan creation function described above, a song to be played in a video work is selected (S10), and one or more angles are set in association with the audio data of the selected song (S14, S15). The set angles can make it easier to manage video shooting according to the song in the subsequent shooting function, for example.

[0063] Furthermore, the angle setting process (S14) of this embodiment can set multiple angles, each including a composition for video shooting, for each specified range within the duration of a song, as shown in Fig. 7. This makes it easier to shoot videos with different compositions for overlapping ranges of a song using the multiple angles that have been set.

[0064] 2.1.2.Angle setting process The angle setting process in step S14 in FIG. 5 will be described in detail with reference to FIG. 4 and FIGS.

[0065] Fig. 8A is a flowchart illustrating the angle setting process (S14) in electronic device 200. Fig. 8B is a flowchart illustrating the angle setting process (S14) subsequent to Fig. 8A. The process shown in this flowchart starts in a state where the audio data of a song has been read into temporary storage unit 222, for example, after a song has been selected (S10 in Fig. 5) or after a song range has been set by a user operation (S13).

[0066] First, the control unit 210 of the electronic device 200 causes the display unit 240 to display an angle setting screen as shown in Fig. 4A (S21). For example, the angle setting screen includes an angle setting field 20 for each angle and a playback field 22, as well as a play button 25, a back button 15, and an aspect ratio switching button 10. The aspect ratio switching button 10 is a virtual button that accepts a user operation for collectively switching the aspect ratio of images in video shooting for each angle.

[0067] The control unit 210 receives a user operation from the operation unit 230, such as tapping the aspect ratio switching button 10 on the angle setting screen, and sets the aspect ratio of the image to be recorded in video shooting (S22). In the electronic device 200 of this embodiment, the aspect ratio is set commonly for all angles.

[0068] The control unit 210 receives a user operation from the operation unit 230, such as tapping on the angle setting field 20 for each angle, and selects one angle corresponding to the angle setting field 20 (S23).

[0069] The control unit 210 causes the display unit 240 to display an angle edit screen for the selected angle (S24). The angle edit screen includes, for example, an angle icon 3, preset icons 51a, 51b, and 51c, an input icon 52, a memo field 53, a playback field 22, a playback button 25, and a back button 15, as shown in FIG. 4(B).

[0070] The preset icon 51 and the input icon 52 are displayed as options for the angle icon 3. In the electronic device 200 of this embodiment, the preset icon 51 is registered in advance as a composition template, such as a zoom magnification or angle of view for video shooting. For example, the preset icons 51a, 51b, and 51c indicate compositions such as wide, medium, and tight, respectively, in ascending order of zoom magnification.

[0071] Input icon 52 accepts a user input for setting an angle for a composition different from each preset icon 51 in electronic device 200. For example, when input icon 52 is selected by a user operation, control unit 210 may accept a user input for drawing an icon by executing a drawing function or the like of electronic device 200. Memo field 53 accepts, by text input, input of various information desired by the user regarding video shooting at the selected angle, such as the shooting location and / or the shooting direction relative to the subject.

[0072] With the display unit 240 displaying the angle editing screen as shown in Fig. 4(B), the control unit 210 accepts various user operations via the operation unit 230, such as a touch panel (S25). The user operations in step S25 include (I) a music editing operation, (II) a composition setting operation, (III) a memo editing operation, and (IV) an editing end operation. The control unit 210 stores information input by each user operation in the temporary storage unit 222 or the like, for example, in association with the angle number of the currently selected angle.

[0073] The music editing operation ((I) of S25) is, for example, an operation to play or stop a music piece by tapping the play button 25 on the angle editing screen, or to change the range of the music piece corresponding to the selected angle by dragging the marker 26 in the playback field 22. For example, in the initial state when the processing of this flowchart starts, the range of the music piece corresponding to each angle may be the range of the entire music piece, or a range from that range set by the user operation in step S13 of FIG. 5.

[0074] When a music editing operation is input ((I) of S25), the control unit 210 causes the speaker 270 to output sound based on the audio data as music playback, and stores the time indicating the changed music range in the temporary storage unit 222 in association with the selected angle (S26). After executing this music editing process (S26), the control unit 210 repeats the processes from step S24 onwards. As a result, the display in the playback field 22 is updated, for example, in accordance with the playback of the music and the change in the music range.

[0075] The composition setting operation ((II) of S25) is a user operation for setting an angle icon 3 corresponding to the composition for video shooting to the selected angle, for example, a tap operation on the preset icon 51 or the input icon 52 on the angle editing screen.

[0076] When a composition setting operation is input ((II) of S25), the control unit 210 changes the angle icon 3 in accordance with the input composition setting operation, associates the angle icon 3 with the selected angle as the set composition, and stores the associated angle icon 3 in the temporary storage unit 222 or the like (S27). Thereafter, the processing from step S24 onwards is repeated, and the angle editing screen is updated. In the example of FIG. 4(B), the preset icon 51b is selected as the angle icon 3.

[0077] The memo editing operation ((III) of S25) is a user operation for inputting text into the memo field 53, for example, a tap operation on the memo field 53. When the memo editing operation is input ((III) of S25), the control unit 210 accepts text input into the memo field 53, for example, via a software keyboard or the like on the operation unit 230, and updates the memo field 53 on the display unit 240 (S28). Thereafter, the control unit 210 repeats the processes from step S24 onwards.

[0078] The angle editing end operation (S25(IV)) is a user operation for ending editing of the selected angle, such as operating the back button 15 on the angle editing screen (FIG. 4(B)). When the angle editing end operation is input (S25(IV)), the control unit 210 determines whether or not the first angle, i.e., the angle with angle number "1", has been set, by referring to, for example, the temporary storage unit 222 (S29 in FIG. 8B).

[0079] When the first angle is set (YES in S29), the control unit 210 disables user operation of the aspect ratio switching button 10 on the angle setting screen (S30). For example, as shown in the angle setting screen of FIG. 7, the aspect ratio switching button 10 may be displayed grayed out. In this way, in the electronic device 200 of this embodiment, the setting of the image aspect ratio (S22 in FIG. 8A) is limited to when the first angle is set. This makes it possible to avoid, for example, a situation where different aspect ratios are set between multiple angles, making it easier to manage video shooting at multiple angles.

[0080] After executing step S30, the control unit 210 causes the display unit 240 to display the angle setting screen again (S31). On the other hand, if the first angle has not been set (NO in S29), the control unit 210 does not perform the process of step S30 and proceeds to display the angle setting screen (S31).

[0081] The control unit 210 determines whether or not the angle setting is complete, for example, in response to a user operation on the angle setting screen (S32). For example, if the back button 15 on the angle setting screen is not operated from the operation unit 230, the control unit 210 determines that the angle setting is not complete (NO in S32) and repeats the processing from step S23 onwards. This allows settings to be made on the angle editing screen for each angle selected on the angle setting screen.

[0082] On the other hand, if it is determined that the angle setting is complete, for example, by operating the back button 15 on the angle setting screen (YES in S32), the control unit 210 generates angle data including the setting information input by the various user operations in step S25 (S33). The angle data is stored, for example, in the storage unit 220. An example of the angle data at the end of the angle setting process is shown in FIG. 9.

[0083] 9 is a diagram illustrating an example of the data structure of angle data D1 in electronic device 200. For example, as shown in FIG. 9, angle data D1 manages, for each "angle number," a "composition," a "music range," a "memo," a "shooting completion flag," and a "video metadata list" in association with each other.

[0084] For each angle corresponding to the angle number, the control unit 210 records the composition indicated by the angle icon 3 on the angle editing screen, the music range specified in the playback field 22, and the information entered in the memo field 53 in the "composition," "music range," and "memo" fields of the angle data D1, respectively.

[0085] In the angle data D1, the "shooting completion flag" is set to ON / OFF to indicate whether the angle has been shot or not. At the end of the angle setting process, the shooting completion flags for all angles are set to OFF as the initial setting.

[0086] The "video metadata list" is a list for storing metadata of the video that is shot in association with the angle. At the end of the angle setting process, the video metadata list is initially set to null.

[0087] After generating the angle data D1 (S33), the control unit 210 transitions the display unit 240 from, for example, the angle setting screen to the plan creation screen (FIG. 3), and ends the processing of this flowchart.

[0088] According to the angle setting process (S14) described above, the plan creation function generates angle data D1 including the range of music for each angle and the composition of video shooting from user input on the angle setting screen and angle editing screen. This allows angles for video shooting that correspond to the range of music to be set in a plan to create a video work that corresponds to a song.

[0089] The angle setting process of the electronic device 200 is not limited to the above example. For example, the control unit 210 may accept a user operation for music editing ((I) in S25) on an angle setting screen, not limited to the angle editing screen, and perform music editing process (S26).

[0090] 2.2. About the shooting function The operation of the photographing function of the electronic device 200 will be outlined with reference to FIG.

[0091] 10 shows an example of a display of an angle selection screen in electronic device 200. The angle selection screen is a screen for selecting a desired angle from among angles set by the photographing function of electronic device 200, for example, by the plan creation function.

[0092] As shown in Fig. 10, the angle selection screen includes an angle list 30, an angle display field 31, a recording mode button 34, a playback mode button 35, a playback button 25, and a back button 15. The angle list 30 is a list listing various angles that the user can select from. The angle display field 31 is a display field that displays setting information for the selected angle. The angle selection screen will be described in detail later.

[0093] In the shooting function, electronic device 200 provides information support that makes it easy for the user to comprehensively proceed with video shooting at each angle while checking various angles, for example, by using an angle selection screen shown in Fig. 10. The user may shoot videos in an order different from the order of the angle numbers in the plan, or may shoot videos in multiple takes for one angle.

[0094] Therefore, electronic device 200 receives a user's evaluation of the video when shooting each take of the video for the selected angle, manages whether shooting for that angle has been completed, and visualizes to the user the progress of video shooting for each angle in angle list 30. The operation of the shooting function in electronic device 200 will be described in detail below.

[0095] 2.2.1. Overall operation of the shooting function The overall operation of the photographing function in electronic device 200 will be described with reference to FIGS.

[0096] Fig. 11 is a flowchart illustrating the operation of the photographing function in electronic device 200. Each process shown in the flowchart in Fig. 11 is executed by, for example, control unit 210. The process of this flowchart starts when, for example, photographing button 12 on the function selection screen (Fig. 1) is operated in a state where angle data D1 set by the plan creation function is stored in storage unit 220.

[0097] First, the control unit 210 generates an angle list 30 to be displayed on the angle selection screen (FIG. 10) based on the angle data D1 (S41). The angle list 30 of this embodiment is generated to list the angles included in the plan and to indicate whether or not each angle has completed shooting. For example, the control unit 210 determines whether or not the shooting completion flag for that angle in the angle data D1 is ON for each angle, and if the shooting completion flag is ON, sets the corresponding angle icon 3 to a shooting completion state. On the other hand, if the shooting completion flag for that angle is OFF rather than ON, the control unit 210 sets the corresponding angle icon 3 to a shooting incomplete state.

[0098] In the electronic device 200, the angle list generation process (S41) is repeatedly executed in accordance with the progress of video shooting and various user operations while the shooting function is being executed, for example, and the angle list 30 is updated successively.

[0099] Next, the control unit 210 causes the display unit 240 to display an angle selection screen, for example as shown in FIG. 10, based on the generated angle list 30 and angle data D1 (S42).

[0100] 10, the angle list 30 on the angle selection screen includes a plurality of angle icons 3. Each angle icon 3 indicates a different angle in the angle list 30 as an option. The angle icon 3 being selected is initially set to angle number "1," for example.

[0101] For example, the control unit 210 controls the display unit 240 to highlight the angle icon 3 indicating the selected angle (S42). The selected angle icon 3 is highlighted, for example, by displaying it in a larger size than the other angle icons 3 and by surrounding it with a frame in a highlighted color. The control unit 210 also references the angle data D1 and causes the angle display field 31 to display setting information for the angle indicated by the selected angle icon 3 (S42).

[0102] In the example of Fig. 10, angles with angle numbers "1" to "3" are in an incomplete state, and angle with angle number "4" is in a completed state. In the angle list 30, the angle icon 3 has a display attribute that distinguishes between a completed state and an incomplete state. Such a display attribute is set, for example, so that the display mode of the completed state highlights the display mode of the incomplete state.

[0103] 10, the control unit 210 accepts various user operations on the operation unit 230 such as a touch panel (S43). The user operations targeted in step S43 include (I) an angle selection operation, (II) an operation to switch to a recording mode, (III) an operation to switch to a playback mode, (IV) an operation to play music, and (V) an end operation.

[0104] The angle selection operation ((I) in S43) is a user operation for changing the selected angle, such as tapping an angle icon 3 other than the currently selected angle icon 3 in the angle list 30 displayed on the angle selection screen. The angle selection operation is not limited to this, and for example, a swipe operation in the angle display field 31 may be input as an angle selection operation for changing the currently selected angle to an adjacent angle.

[0105] When an angle selection operation is input ((I) of S43), the control unit 210 changes the selected angle icon 3 in accordance with the input angle selection operation (S44), and performs the processes from step S42 onwards again. As a result, the selected angle icon 3 is changed on the angle selection screen, and the angle display field 31 for the newly selected angle is displayed (S42).

[0106] The transition operation to the recording mode ((II) of S43) is a user operation for transitioning to the recording mode, which is an operating mode for shooting video at the selected angle, and is, for example, a tap operation on the recording mode button 34. In addition to or instead of this, the transition operation may be a swipe operation in a predetermined direction of the ±Y directions on the angle selection screen. Also, the recording mode button 34 may be omitted.

[0107] When an operation to switch to recording mode is input ((II) of S43), the control unit 210 executes various processes for recording one take of video associated with the selected angle in recording mode (S45). For example, the control unit 210 outputs audio so as to play back the range of music associated with the selected angle during video recording. The control unit 210 also executes processing related to the rating of the taken take. An example of the display in step S45 is shown in FIG. 12.

[0108] 12 shows an example of a rating screen displayed on electronic device 200. The rating screen is a screen for prompting the user to rate the video of the taken take.

[0109] 12, the rating screen includes an information display field 40 about the filmed video, and rating options including an OK button 41, a KEEP button 42, and an NG button 43. The information display field 40 displays information about the video of the filmed take, including, for example, a thumbnail image of the video of the take, the angle number associated with the take, and the number of takes.

[0110] The OK button 41 indicates, for example, an "OK" rating when the user has decided that the take should be used for the corresponding angle. The KEEP button 42 indicates, for example, a "KEEP" rating when the user is unsure whether to use the take. The NG button 43 indicates, for example, an "NG (No Good)" rating when the user has clearly decided not to use the take. The control unit 210 manages the shooting completion flag for the angle data D1 based on information indicating these ratings. The shooting completion flag is turned ON if, for example, videos associated with the selected angle include videos rated "OK" or "KEEP," and is turned OFF otherwise.

[0111] In the recording mode process (S45) of this embodiment, each time one take of video is shot, a rating screen such as that shown in Fig. 12 is displayed to obtain rating information indicating the user's rating for that take. Based on the rating results of this recording mode process (S45), the control unit 210 performs the angle list generation process (S41) again as shown in Fig. 11 to update the angle list 30. The process of step S45 will be described in detail later.

[0112] The operation to transition to playback mode ((III) of S43) is a user operation for transitioning to playback mode, which is an operating mode for playing back and displaying video shot at the selected angle, and is, for example, an operation of the playback mode button 35. In addition to or instead of this, the operation to transition to playback mode may be a swipe operation in the ±Y direction of the angle selection screen, opposite to the operation to transition to recording mode. Also, the playback mode button 35 may be omitted.

[0113] When an operation to switch to playback mode is input ((III) of S43), the control unit 210 executes a process to play back various takes of video related to the angle currently selected as the playback mode (S46). In the playback mode process (S46) of this embodiment, re-rating can be performed to change the evaluation of the video of each take. Based on the re-rating results of the playback mode process (S46), the control unit 210 executes the angle list generation process (S41) again to update the angle list 30.

[0114] The music playback operation ((IV) of S43) is a user operation for playing back the music range corresponding to the selected angle, such as operating the play button 25. When the music playback operation is input ((IV) of S43), the control unit 210 outputs the audio of the music range corresponding to that angle to the speaker 270 or the like based on the music audio data (S47), and performs the processes from step S42 onwards again. This makes it easier for the user to check the music range associated with the selected angle, for example, and makes it easier to shoot video for each angle.

[0115] The end operation ((V) in S43) is a user operation for ending the shooting function, such as operating the back button 15 on the angle selection screen (FIG. 10). When the end operation is input ((V) in S43), the control unit 210 transitions the display unit 240 from, for example, the angle selection screen to the function selection screen (FIG. 1), and ends the processing shown in this flowchart.

[0116] According to the above process, the user of electronic device 200 can check various angles (S44) on the angle selection screen (FIG. 10) in the shooting function of electronic device 200, and can shoot a video at a desired angle (S45) and play back and display (S46). In this way, the user can easily manage video shooting from multiple angles in a scenario.

[0117] On the angle selection screen of this embodiment, each angle icon 3 is displayed with a distinguishable indication of whether or not shooting has been completed, thereby preventing the user from forgetting to shoot an angle. The distinguishable indication of whether or not shooting has been completed for each angle is performed in a manner that reflects the user's rating of each take of video, making it easy to ensure video quality that meets the user's intentions. This rating is performed for each take (S45), and further re-rating can be performed in playback mode (S46). This makes it easy to achieve quality control of video shooting that meets the user's intentions.

[0118] The angle selection screen displayed in step S42 is not limited to the example in Fig. 10 and may be displayed according to, for example, the maximum number of angles that can be set in the plan. For example, if the number of angles set in the angle data D1 is less than four, unset angles that are not included in the angle list 30 may be displayed on the angle selection screen in a manner such as grayed out to indicate that they cannot be selected.

[0119] 2.2.2. Recording Mode Handling The details of the recording mode process in step S45 in FIG. 11 will be described with reference to FIGS.

[0120] Fig. 13 is a flowchart illustrating the process (S45) of the recording mode in the electronic device 200 of this embodiment. The process shown in the flow of Fig. 13 is started when, for example, an operation to switch to the recording mode is input on the angle selection screen (Fig. 10) ((II) of S43).

[0121] First, the control unit 210 shifts to a recording mode and causes the display unit 240 to transition to a screen for waiting for video recording (S71). An example of a display on the electronic device 200 in step S31 is shown in Fig. 14(A).

[0122] 14(A), the recording standby screen in step S71 includes a timer button 44, a live view image 45, a recording button 46, a speaker icon 47, and a camera switching button 48. For example, in the recording mode, the control unit 210 sequentially acquires image data of the live view image 45 from the imaging unit 280 and displays the live view image 45.

[0123] The timer button 44 accepts a user operation to set a timer period for timing the start of shooting, for example. The record button 46 accepts a user operation to start shooting and recording a video. The speaker icon 47 displays the connection status with an external speaker, for example, via the communication unit 250. In the shooting function of this embodiment, the communication connection with the external speaker may be managed, and for example, when switching to the recording mode, a display may be displayed prompting the user to connect to the external speaker. The camera switch button 48 accepts a user operation to switch whether to use the in-camera or out-camera of the imaging unit 280 to shoot a video.

[0124] The control unit 210 determines the audio output destination and the shooting camera for video shooting (S72). The audio output destination indicates a speaker that outputs audio, and is determined, for example, according to the connection status with an external speaker indicated by the speaker icon 47. For example, if the electronic device 200 is connected to an external speaker, the control unit 210 determines the external speaker as the audio output destination, and if not connected, determines the speaker 270 as the audio output destination. The shooting camera indicates a camera that shoots video, and is, for example, the in-camera or out-camera of the imaging unit 280. The control unit 210 determines the shooting camera in response to a user operation, for example, tapping the camera switch button 48 on the recording standby screen.

[0125] The control unit 210 sets the timer period in response to, for example, a user operation of the timer button 44 (S73). An example of the display on the electronic device 200 in step S73 is shown in Fig. 14(B). The timer period may be set for each take or may be set uniformly for each angle.

[0126] 14(B) illustrates an example of a timer selection field 44a that is displayed in response to operation of the timer button 44 on the shooting standby screen of FIG. 14(A). FIG. 14(B) shows an example in which the timer period is set to "5 seconds" in the timer selection field 44a. The timer selection field 44a includes options indicating the timer period's numerical value, such as "OFF," which corresponds to a timer period of 0 seconds, and "5 seconds." In step S31, when the control unit 210 receives a user operation on the timer selection field 44a via the operation unit 230, the control unit 210 sets the timer period in accordance with the user operation and returns the display unit 240 from FIG. 14(B) to FIG. 14(A).

[0127] The control unit 210 determines whether or not the timer period is set to a value other than "OFF" in step S72, that is, whether or not the timer setting is ON (S74).

[0128] If the timer setting is set to "OFF," the control unit 210 performs various controls in response to a user operation of the record button 46 to start shooting and recording one take of video associated with the selected angle and playing back music (S75). For example, the control unit 210 instructs the audio output destination determined in step S72 to output audio for the range of music associated with the angle based on the audio data. In step S75, the control unit 210 instructs audio output so that the range of music is played back simultaneously with the start of shooting and recording, for example.

[0129] On the other hand, if the timer setting is ON (YES in S74), the control unit 210 performs various controls in response to the user's operation of the record button 46, such as recording a moving image and playing a music piece, as well as displaying a countdown according to the set timer period (S76). Display examples of the electronic device 200 in step S76 are shown in Figures 14(C) and (D).

[0130] FIG. 14(C) illustrates an example of a shooting screen when the recording button 46 is operated when a timer period is set as in the example of FIG. 14(B). FIG. 14(D) illustrates an example of a shooting screen after the timer period from FIG. 14(C). The control unit 210 counts down the elapsed time from the time the recording button 46 is operated (S76) by the set timer period, and displays it superimposed on, for example, a live view image. In this example, video recording is performed including this timer period. Furthermore, if the timer period is set to "OFF" (NO in S74), the control unit 210 does not particularly display the countdown as in FIG. 14(C) in step S75, and transitions the display unit 240 to, for example, the shooting screen as in FIG. 14(A) to FIG. 14(D) (S75).

[0131] 14(C) and (D), the shooting screen in step S76 includes a live view image 45, a recording stop button 46a, and a time display field 49. The live view image 45 on the shooting screen is highlighted, for example, with a frame or other display to indicate that recording is in progress. The recording stop button 46a accepts a user operation to stop the shooting and recording of the video. The time display field 49 displays, for example, a comparison between the elapsed time since the start of shooting the video of the take and the period of the music range associated with the selected angle.

[0132] In step S76, the control unit 210 controls the display unit 240 to switch the display from the shooting standby screen (FIG. 14(A)) to the shooting screen (FIGS. 14(C) and (D)). The control unit 210 also records, in the storage unit 220, a video file showing the live view images 45 captured sequentially by the imaging unit 280 after the record button 46 is operated (S76).

[0133] In step S76, the electronic device 200 of this embodiment plays music according to the set timer period in addition to displaying a countdown as shown in Fig. 14(C). Fig. 15 is a diagram for explaining the timer function of the electronic device 200.

[0134] 15(A) shows an example in which the start time ts of the music range Tp set in the angle setting process (S14 in FIG. 5) is later than the beginning of the music in the audio data by at least the timer period. In the example of FIG. 15(A), the control unit 210 starts playing the music based on the audio data at a time ta that is the timer period before the music range Tp. For example, in step S76, the control unit 210 determines the playback start time ta for the pre-playback of the music based on the music range Tp of the currently selected angle and the timer period set in step S73.

[0135] FIG. 15(B) shows an example in which the start time ts of the music range Tp coincides with the beginning of the music. In the example of FIG. 15(B), the control unit 210 determines the start time ts of the music range Tp as the music playback start time ta, and performs only countdown display and video recording during the timer period. FIG. 15(C) shows an example in which the timer period is set to "15 seconds" and the start time ts of the music range Tp is set 10 seconds after the beginning of the music. In the example of FIG. 15(C), the control unit 210 determines the music playback start time ta as 10 seconds before the start time ts of the music range Tp, and performs pre-playback of the music from the playback start time ta after starting the countdown display and video recording during the timer period.

[0136] Thus, in step S76, the control unit 210 performs forward playback from the start time ta at which music can be played back, in accordance with the timer period and the start time ts of the music range Tp for each angle. Also, in this example, video recording and music playback continue until recording stop time tb, when video recording is stopped by operating the recording stop button 46a, regardless of whether this time is later than the end time te of the music range Tp from the playback start time ta.

[0137] 14, the control unit 210 performs various controls to stop video recording and music playback in response to a user operation of the recording stop button 46a (S77). For example, the control unit 210 stops video recording of the live view image 45 and stops audio output (S77). The control unit 210 may determine the file name of the video file based on, for example, the angle data D1 and the number of takes already shot for the selected angle.

[0138] Furthermore, the control unit 210 causes the display unit 240 to display a rating screen, as shown in FIG. 12, for example, to prompt the user to rate the video of the take shot as described above (S78).

[0139] The control unit 210 receives user operations on the various buttons 41 to 43 on a rating screen such as that shown in Fig. 12, and acquires the user's evaluation as a rating result for the video of the taken take (S79). In this embodiment, each time a video of one take is shot, the user can arbitrarily select a desired evaluation from the three types of evaluations "OK," "KEEP," and "NG" for the shot video, without interfering with the evaluations of other videos of the taken.

[0140] The control unit 210 determines whether the evaluation is "NG" or not based on the acquired user evaluation (S80). For example, if the user evaluation is "OK" or "KEEP", the determination in step S36 is "NO".

[0141] If the acquired user evaluation is not "NG" (NO in S80), the control unit 210 sets the shooting completion flag for the angle associated with the take in the angle data D1 (i.e., the selected angle) to "ON" (S81). For example, if the number of takes for the video is "1," or if the number of takes is "2" or more and the evaluation of the video of an existing take is "NG," the shooting completion flag is switched from "OFF" to "ON" by executing step S81.

[0142] On the other hand, if the acquired user evaluation is "NG" (YES in S80), the control unit 210 proceeds to step S82 without particularly updating the setting of the shooting completion flag. As a result, if the shooting completion flag for the corresponding cut when the video with the evaluation "NG" was shot is OFF, for example, the OFF state is maintained. Also, if the shooting completion flag is ON because a video of a take shot in the past has "KEEP" or "OK", for example, the ON state is maintained.

[0143] The control unit 210 generates metadata for the video of the takes shot as described above and records it in angle data D1 in the storage unit 220, for example (S82). The video metadata includes, for example, a video file name and rating information for each take. The control unit 210 generates video metadata by including in video metadata D2 the video file name determined to reflect the number of takes for the video shot in steps S75 to S77 and the user rating acquired in step S79. The control unit 210 stores the generated video metadata in a video metadata list for the angle associated with the video in the angle data D1 (FIG. 9) (S82). The video metadata may include, for example, the number of takes for the video in addition to or instead of the video file name.

[0144] The control unit 210 ends the recording mode process (S45) by, for example, recording video metadata (S82), and proceeds to step S41 in FIG.

[0145] According to the above-described process in the recording mode (S45), the electronic device 200 can shoot and record one take of a video for the selected angle while playing back the range of music associated with that angle, and prompt the user to rate it (S75-S79). In addition to displaying a countdown before starting video recording according to the timer setting (S73), the electronic device 200 can also play back music from a time before the range of music Tp associated with the angle (S76), making it easier to shoot a video according to the music.

[0146] Furthermore, the electronic device 200 manages the shooting completion flag for the cut based on the acquired evaluation information (S80, S81). In this way, the user's evaluation information for each take can be appropriately reflected in the management of whether or not the cut is in a shooting completion state. Furthermore, according to the recording mode processing (S45) of this embodiment, the electronic device 200 can control the shooting and recording of the video, thereby realizing the management of video shooting.

[0147] In rating each take of video (S78-S79), multiple takes associated with the same angle may have the same rating. For example, multiple takes of video for the same angle may have a rating of "OK."

[0148] The rating screen displayed in step S78 may be displayed as a dialogue. For example, control unit 210 may control display unit 240 to superimpose the dialogue of the rating screen on the display screen before and after step S77.

[0149] The recording standby screen in the recording mode (FIG. 14(A)) may further include a back button 15 for returning the screen transition to, for example, the angle selection screen. Such a back operation may be a swipe operation in a predetermined direction among the ±Y directions on the recording standby screen. The electronic device 200 may also transition to the playback mode by a swipe operation in the opposite direction to the back operation.

[0150] 2.3.Video editing function The video editing function of the electronic device 200 of this embodiment will be described with reference to FIG.

[0151] FIG. 16 shows an example of the display of a video editing screen in electronic device 200. Electronic device 200 reads video data captured at each angle using the imaging function, and displays the video editing screen on display unit 240 as shown in FIG. 16. The video editing screen is a screen on which the user can perform various video editing operations. The video editing screen includes, for example, a multi-view screen that displays a list of video data from multiple angles as shown in FIG. 16(A), and a single-view screen that displays video data from one angle as shown in FIG. 16(B). The single-view screen may be used by the user to check the edited video work.

[0152] 16(A) and 16(B) include a material display field 61, a timeline editing field 62, a single view button 63a, a multi-view button 63b, a folder icon 64, a video playback button 65, and a cut button 66. For example, as shown in FIG. 16(B), the single view screen further includes an audio delay correction field 67. Each video editing screen also includes a cancel button 69a, a re-cancel button 69b, and a back button 65.

[0153] The material display field 61 displays video data (i.e., video material) loaded as material for video editing. In the electronic device 200 of this embodiment, the material display field 61 displays a preview image of the video material for each angle. The preview image is, for example, an image of a take arranged at each angle from the video material, at a timing corresponding to the position of the playback head 82. As shown in FIG. 16(A), for example, if a video with angle number "4" has not been shot using the shooting function, the material display field 61 does not display a preview image for that angle.

[0154] The timeline editing field 62 displays a video timeline 80 in which video materials are arranged along the time axis of the audio data of a song, and accepts user operations for editing a video work that combines video materials on the video timeline 80. In the example of Fig. 16, the video timeline 80 includes one or more video materials arranged along the time axis in the +Y direction. A playback head 82 moves along the time axis according to, for example, the time being played on the video timeline 80.

[0155] The single-view button 63a is a virtual button that accepts a user operation for switching from the multi-view screen (FIG. 16(A)) to the single-view screen (FIG. 16(B)). The multi-view button 63b is a virtual button that accepts a user operation for switching from the single-view screen to the multi-view screen. For example, the electronic device 200 of this embodiment initially displays the multi-view screen, and by operating the view switching button 63, the video editing screen is switched between the multi-view screen and the single-view screen.

[0156] The folder icon 64 accepts a user operation for changing the take assigned to each angle. The video playback button 65 accepts a user operation for playing back the video material of the take arranged at each angle in the material display field 61 from the position of the playback head 82. In response to the user operation, the electronic device 200 of this embodiment plays back music along with the video material, for example.

[0157] The cut button 66 is a virtual button that accepts a user operation to divide the video timeline 80 into multiple cuts on the time axis. Each cut is a time region on the video timeline 80 that does not overlap with other cuts. In the electronic device 200 of this embodiment, for example, a user can assign video material of different angles to the divided multiple cuts. For example, the timeline editing field 62 displays the angle number of an angle initially arranged on the video timeline 80 or an angle assigned after a cut is made by a user operation.

[0158] The audio delay correction field 67 is provided on a single view screen as shown in Figure 16 (B) and accepts user operations to adjust the association between the time in the audio data of the song and the time in the video material of the angle displayed in the material display field 61.

[0159] For example, on the video editing screen ( FIG. 16 ), while checking the material display field 61, the user can adjust the arrangement of video materials in the timeline editing field 62, or place new video materials in the material display field 61 on the video timeline 80. Through such user operations, editing operations for a video work are performed in the electronic device 200.

[0160] 2.3.1. Video editing function operation The operation of the video editing function in electronic device 200 will be described in detail with reference to FIGS. 17A, 17B, and 18. FIG.

[0161] Fig. 17A is a flowchart illustrating the operation of the video editing function in electronic device 200. Fig. 17B is a flowchart illustrating the operation of the video editing function following Fig. 17A. The processing shown in this flowchart is started when video editing button 13 on the function selection screen (Fig. 1) is operated, for example, in a state where angle data D1 from the plan creation function and video data from the shooting function are associated with video metadata and stored in storage unit 220. Each process in this flowchart is executed by control unit 210.

[0162] First, the control unit 210 generates a video timeline 80 for a period corresponding to a music range to be played in a video work from audio data, based on information set in the plan creation function (FIG. 5). In this way, the music range of the video work is associated with the video timeline 80. In step S51, the control unit 210 places the video material with angle number "1" on the video timeline 80, for example, by referring to angle data D1.

[0163] FIG. 18 is a diagram illustrating the video editing function of electronic device 200. FIG. 18(A) illustrates the relationship between video material captured for each angle by the capture function according to angle data D1 and music time. Music time indicates the time within the range of music in a video work. In this example, two takes are captured for each of four angles, angle numbers "1" to "4." For example, the takes with angle numbers "1" and "2" are captured across the entire range of music in the video work, and the takes with angle numbers "3" and "4" are captured within a portion of the range of music. FIG. 18(B) illustrates an example of how the video material in FIG. 18(A) is arranged on video timeline 80 according to the processing of this flowchart.

[0164] Based on the angle data D1, the control unit 210 arranges one take for each angle displayed in the material display field 61 of the multi-view screen as shown in Fig. 16(A) (S52). The control unit 210 arranges the take with the highest rating for each angle, for example, based on the rating obtained for each take for each angle on the rating screen (Fig. 12) by the recording mode processing (S45 in Fig. 11, Fig. 13). For example, takes are arranged in order of highest rating, "OK," "KEEP," and "NG." If there are multiple takes with the same rating for one angle, the take with the most recent shooting date and time among those multiple takes may be arranged.

[0165] The control unit 210 reads, for example, from the storage unit 220, video data of the takes arranged at each angle as video material (S53).

[0166] (1) Multi-view screen The control unit 210 causes the display unit 240 to display a multi-view screen so that preview images of each angle are displayed in the material display field 61 based on the loaded video material (S54).

[0167] 16(A), for example, the control unit 210 accepts various user operations on the operation unit 230, such as a touch panel, when the display unit 240 displays a multi-view screen (S55). The user operations in step S55 include (I) a video playback operation, (II) a cut editing operation, (III) an angle assignment operation, (IV) a take swap operation, (V) a switch to single view operation, and (VI) an end operation.

[0168] The video playback operation ((I) of S55) is a user operation for playing back video from the position of the playback head 82 on the video timeline 80, such as tapping the video playback button 65. When a video playback operation is input on the multi-view screen ((I) of S55), the control unit 210 simultaneously plays and displays the video material of each angle arranged in the material display field 61 on the display unit 240 (S56). The control unit 210 updates the preview image of each angle over time, for example.

[0169] In step S56, the control unit 210 controls the speaker 270 etc. to output the sound of the music based on the audio data from the position of the playhead 82 on the video timeline 80 associated with the range of the music, in parallel with the playback display of the video material. The control unit 210 may control an external speaker connected via the communication unit 250 instead of the speaker 270. The control unit 210 may output the sound to the audio output destination determined in step S72 of the recording mode process (S45, FIG. 13).

[0170] A cut editing operation ((II) of S55) is a user operation related to a plurality of cuts that divide the video timeline 80, and includes, for example, a tap operation on the cut button 66, a drag operation on the division position, and a long press operation on the division position. The division position indicates a position on the video timeline 80 that corresponds to the boundary between the divided cuts. For example, when a tap operation on the cut button 66 is input as a cut editing operation ((II) of S55), the control unit 210 divides the video timeline 80 into two cuts that respectively correspond to before and after the position of the playhead 82 (S57).

[0171] 18(B), one of the takes rated "OK" from the video material with angle number "1" is placed on the video timeline 80 (S51), and then, at editing time t1, the video timeline 80 is divided into two cuts (S57). For example, in the cut editing process (S57), the same angle as before the division is assigned to each cut after the division.

[0172] Furthermore, when a drag operation on the division position is input as a cut editing operation ((II) of S55), the control unit 210 moves the division position on the video timeline 80 in accordance with this operation (S57). Furthermore, when a long press operation on the division position is input as a cut editing operation ((II) of S55), the control unit 210 deletes the division position and updates the video timeline 80 so as to combine the cuts before and after the division position (S57). For example, video material may be arranged on the combined video timeline 80 in accordance with the cut before the division position (in the -Y direction). Before deleting the division position, a pop-up screen or the like may be displayed on the display unit 240, allowing the user to select whether or not to continue with the deletion.

[0173] The angle assignment operation ((III) of S55) is a user operation for assigning a desired angle to at least one of the divided cuts. For example, the angle assignment operation is an operation of dragging a preview image of an angle selected from the angles in the material display field 61 and dropping it near the cut to which the angle is to be assigned among the divided cuts on the video timeline 80. When the angle assignment operation is input ((III) of S55), the control unit 210 changes the angle of the cut to which the angle is to be assigned on the video timeline 80 to the selected angle (S58).

[0174] In the example of FIG. 18(B), one of the cuts divided at edit time t1 has its angle number changed from "1" to "2" by the angle assignment process (S58) at edit time t2.

[0175] After executing the processing corresponding to each of the above operations ((I) to (III) in S55) (S56 to S58), the control unit 210 returns to step S54 and displays the multi-view screen (S54). This updates the multi-view screen to reflect the processing corresponding to each operation. This allows, for example, the user to listen to the music and check the video material for each angle in the material display field 61 (S56), adjust the cuts in the video timeline 80 (S57), and assign video material for the desired angle to each cut (S58).

[0176] 18(B), for example, there may be a case where the end point of the video footage with angle number "3" assigned by the angle assignment process (S58) at editing time t4 is earlier than the end point of the assigned cut. In this case, the video timeline 80 may be automatically divided into two cuts at the end point of the video footage, or no angles may be assigned to cuts after the end point of the video footage.

[0177] 18(B), two cuts that were split at editing time t5 are joined by deleting the split position in the cut editing process (S57) at editing time t6. At this time, because the video material with angle number "3" is shorter than the video timeline 80, for example, the joined cut will have no angle assigned. Thereafter, at editing time t8, the video material with angle number "1" is assigned to the cut (S58).

[0178] The take swap operation ((IV) of S55) is a user operation for changing the takes arranged at each angle in the material display field 61. For example, the take swap operation includes an operation of selecting a desired angle and dragging and dropping a preview image onto the folder icon 64, and an operation of selecting a take other than the take currently arranged from the take list screen to which the display unit 240 transitions as a result of this operation. The take list screen is a screen that displays a list of takes at that angle using preview images, etc. On the take list screen, video playback of each take and re-rating similar to the playback mode processing (S46 in FIG. 11) may be performed.

[0179] When a take swap operation is input ((IV) of S55), the control unit 210 replaces the take arranged in the material display column 61 with the selected take (S59), and returns to step S53. As a result, the video data of the replaced take is loaded as video material (S53). In the example of FIG. 18, at editing time t8, the take with angle number "1" was replaced with another take evaluated as "OK." In the take swap process (S59) of this embodiment, when the same angle is assigned to multiple cuts, even if a take swap operation is performed on one of the cuts, the control unit 210 will, for example, change the takes for those multiple angles all at once.

[0180] The operation to switch to single view ((V) of S55) is a user operation for switching from the multi-view screen to the single-view screen, such as tapping the single-view button 63a on the multi-view screen. When the operation to switch to single view is input ((V) of S55), the control unit 210 switches the video editing screen from the multi-view screen to the single-view screen (FIG. 16(B)) (S60). The operation after transition to the single-view screen will be described later.

[0181] The end operation ((VI) of S55) is a user operation for ending the video editing function, such as a tap operation on the back button 15. When the end operation is input ((VI) of S55), the control unit 210 transitions the display unit 240 from, for example, the multi-view screen to the function selection screen (FIG. 1), and ends the processing shown in this flowchart.

[0182] (2) Single view screen The operation of the video editing function on the single view screen will be described with reference to FIG. 17B.

[0183] For example, when an operation to switch to single view is input ((V) of S55), the control unit 210 switches the video editing screen to the single view screen (S60) by referring to the position of the playhead 82 on the video timeline 80. The control unit 210 displays the single view screen so that a preview image of the angle assigned to the position of the playhead 82 is displayed in the material display field 61 (S61).

[0184] 16(B), for example, the control unit 210 accepts various user operations via the operation unit 230. The user operations in step S62 include (I) a video playback operation, (II) a cut editing operation, (IV) a take swap operation, and (VI) an end operation, similar to those in step S55 on the multi-view screen. The user operations in step S62 further include (III) an audio delay correction operation and (V) a switch to single view operation, instead of the (III) angle assignment operation and (V) switch to multi-view operation in step S55. Operations and processes similar to those on the multi-view screen will not be described as appropriate.

[0185] The audio delay correction operation (S62 (III)) is a user operation for adjusting the synchronization timing between the music range set in the angle data D1 for each angle and the shot video, such as a tap operation in the audio delay correction field 67 shown in FIG. 16 (B). When an audio delay correction operation is input (S62 (III)), the control unit 210 executes audio delay correction processing for, for example, the take arranged at the angle currently displayed in the material display field 61 (S65). The audio delay correction processing (S65) changes the correspondence between, for example, the time in the music range for that angle and the time in the video material for that take, in accordance with the input operation.

[0186] The operation to switch to multi-view ((V) of S62) is a user operation for switching from a single-view screen to a multi-view screen, such as tapping the multi-view button 63b on the single-view screen. When the operation to switch to multi-view is input ((V) of S62), the control unit 210 switches the video editing screen from the single-view screen to the multi-view screen (S68).

[0187] Furthermore, when a video playback operation is input on the single-view screen ((I) of S62), the control unit 210 plays back music in the same manner as in step S56 of FIG. 17A, for example, and causes the display unit 240 to play and display the video material of the angle currently being displayed in the material display field 61 (S63). When a cut editing operation is input ((II) of S62), the control unit 210 performs cut editing processing in the same manner as in step S57 (S64). After executing processing in accordance with each operation in steps S62 (I) to (III) (S63 to S65), the control unit 210 returns to step S61 and causes the display unit 240 to display the single-view screen.

[0188] For example, when a take swap operation is input (S62(IV)) similar to (IV) of step S55, control unit 210 performs take swap processing (S66) similar to step S59, and reads video data of the swapped take from storage unit 220 (S67). When an end operation (VI) is input (VI of S62), control unit 210 transitions display unit 240 from the single view screen to the function selection screen (FIG. 1), and ends the processing shown in this flowchart.

[0189] On each of the multi-view and single-view video editing screens (FIGS. 16A and 16B), in addition to the operations of steps S55 and S62, the control unit 210 further accepts various user operations related to canceling operations at the operation unit 230, and executes processing according to the operations. For example, the operations include a user operation (undo operation) for canceling an input operation by tapping the cancel button 69a, and a user operation (redo operation) for returning to the state in which the canceled operation was input by tapping the re-cancel button 69b.

[0190] According to the operation of the video editing function described above, electronic device 200 can provide a multi-view screen and a single-view screen as a video editing screen that allows a user to easily edit, according to music, videos shot from various angles according to a user's plan (S51 to S54, S61, FIG. 16). For example, the video editing screen provides cut editing operations and angle assignment operations using a video timeline 80 generated corresponding to the range of music in a video work and a material display field 61 into which video material for each angle is loaded ((II) and (III) of S55). This allows, for example, a period of music range shot from multiple angles to be divided by the cut editing process on video timeline 80, and video material from desired angles to be assigned to the divided cuts from the material display field 61 (S55 to S58, S62 to S64).

[0191] When placing takes at each angle in the material display field 61 (S52), if the musical range of angle number "1" is shorter than the duration of the video timeline 80, no video material may be placed in the period outside that musical range, leaving it blank and with no angle assigned. Alternatively, it may be determined in ascending order of angle number whether the period of the musical range set for each angle is shorter than the duration of the video timeline 80, and if the periods of all angle numbers are short, the video timeline 80 may be automatically divided to generate a blank cut for that period.

[0192] In the above step S59, an example was described in which, when the same angle is assigned to multiple cuts, the takes for those multiple cuts are swapped all at once. The control unit 210 may accept a take swap operation for each cut ((IV) of S55, (IV) of S62), or may arrange video material of different takes for each cut (S59, S66).

[0193] 16(A) and 16(B), an example has been described in which the playback head 82 in the video timeline 80 moves in response to playback of the video. The playback head 82 in the video timeline 80 may be fixed to the center in the Y direction, similar to the playback head 23 in the audio timeline 24. As with the audio timeline 24, the video timeline 80 may sequentially update the displayed period in response to playback of the video, or may change the displayed period in response to user operations such as pinching in and out.

[0194] 3. Summary As described above, in this embodiment, electronic device 200 manages video shooting in accordance with music. Electronic device 200 includes display unit 240 that displays information, operation unit 230, an example of an input unit that inputs user operations, and control unit 210 that generates angle data D1, an example of management information for managing video associated with audio data representing music. Control unit 210 causes display unit 240 to display a period included in the music in the audio data (S21, S24, S31), accepts from operation unit 230 a user operation that sets an angle, an example of a shooting unit at which the video is shot, corresponding to the period in the music in angle data D1 (S25), and generates angle data D1 by associating the angle set by the user operation with the period in the music (S14; see FIG. 4).

[0195] According to the above electronic device 200, the user can set the angle at which to shoot video corresponding to a period in a song, and angle data D1 generated by associating the set angle with the period makes it easier to manage video shooting according to the song.

[0196] In this embodiment, the control unit 210 receives a user operation from the operation unit 230 to set multiple angles for at least a portion of a period in a song (see (I) of S14 and S25, FIG. 7). This allows multiple angles to be set for the same period in a song, for example, by setting angles for multiple overlapping ranges in the period in a song, and video shooting corresponding to the ranges can be performed at each of the set angles.

[0197] In this embodiment, the control unit 210 accepts, from the operation unit 230, a user operation to specify a period in the music corresponding to each angle among a plurality of angles (S23, (I) of S25). This allows the user to specify a desired period as the period in the music corresponding to each angle, making it easier to manage video shooting for each angle in accordance with the user's intentions.

[0198] In this embodiment, the control unit 210 causes the display unit 240 to display a video editing screen (FIG. 16), which is an example of an editing screen for editing video associated with audio data (S51 to S54, S61), and accepts a user operation from the operation unit 230 to divide a period in which music is played in the video into a plurality of cuts (see (II) of S55, S57, (II) of S62, S64, FIG. 18). The control unit 210 assigns a first captured video from a plurality of captured videos captured from each of a plurality of angles to the divided cuts in the video, and updates the video editing screen ((III) of S55, S58, S54). The control unit 210 accepts a user operation from the operation unit 230 to change a first shot video assigned to a plurality of cuts to a second shot video different from the first shot video among the plurality of shot videos (S55(IV), S58, S62(IV), S66), and updates the video editing screen in accordance with the change in the assigned shot video (S53-S54, S67, S61). As a result, for example, on the video timeline 80, the playback period of a song in a video such as a video work can be divided into a plurality of cuts, and shot videos shot at different angles can be assigned to each cut.

[0199] In this embodiment, the control unit 210 controls video shooting at angles based on the angle data D1 (FIG. 11, S41 to S47), which makes it easier to manage video shooting for each angle set in the angle data D1.

[0200] In this embodiment, the electronic device 200 further includes a speaker 270, which is an example of an output unit that outputs audio. The control unit 210 controls the speaker 270 to output audio corresponding to a period in a song associated with an angle during video shooting at that angle, based on the angle data D1 and the audio data (S45, S75, S76). This allows the audio for the period in the song associated with the angle in the angle data D1 to be played back, allowing the user to confirm the range of the song corresponding to that angle and facilitating video shooting for each angle. Instead of or in addition to the speaker 270, the electronic device 200 may output audio to an external speaker or the like connected via the communication unit 250.

[0201] In this embodiment, the control unit 210 receives from the operation unit 230 a user operation specifying a timer period, which is an example of a start time for starting video shooting at an angle (S73, see FIGS. 14A and 14B), and controls the speaker 270, which is an example of an output unit, to output an audio signal corresponding to audio data from a period before the period in the music associated with the angle in the angle data D1, in accordance with the timer period selected from the options (S74, S76, see FIG. 15). This allows the user to check the audio for the period in the music associated with the angle in accordance with the timer period before starting video shooting at the angle, making it easier to time the start of shooting.

[0202] In this embodiment, the angle data D1 includes at least one of the zoom magnification for video shooting at an angle and the shooting direction relative to the subject in the video shooting. For example, the angle data D1 shown in Fig. 9 includes the items "Composition" corresponding to the angle icon 3 selected from the preset icons 51 for each zoom magnification, and "Memo" such as the shooting direction entered in the memo field 53. Such angle data D1 makes it easier to manage video shooting at that angle according to the composition, etc. set for the angle.

[0203] In this embodiment, a shooting management method for managing video shooting in accordance with music is provided. This method includes the control unit 210 of the electronic device 200 generating angle data D1 for managing video associated with audio data representing music (S14). The control unit 210 is configured to control the display unit 240 and the operation unit 230. Generating the angle data D1 (S14) includes causing the display unit 240 to display a period included in the music in the audio data (S21, S24, S31), accepting a user operation from the operation unit 230 to set an angle at which the video will be shot corresponding to the period in the music in the angle data D1 (S25), and generating angle data D1 by associating the angle set by the user operation with the period in the music (S33).

[0204] In this embodiment, a program is provided for causing the control unit 210 to execute the above-described shooting management method. According to this shooting management method, it is possible to easily manage video shooting according to music.

[0205] In this embodiment, electronic device 200 includes imaging unit 280 that captures an image of a subject and generates video data, storage unit 220 that stores angle data D1 that manages videos associated with audio data representing music, and control unit 210 that controls video capture by imaging unit 280. Angle data D1 includes angles set to capture a video corresponding to a period in the music in the audio data, associated with the period in the music (see FIGS. 7 and 9). Control unit 210 controls video capture at the angles based on angle data D1 (FIG. 11, S41 to S47).

[0206] According to the electronic device 200 described above, by controlling video shooting at an angle set in the angle data D1 in association with a period in a song, it is possible to easily manage video shooting according to the song.

[0207] Furthermore, in this embodiment, electronic device 200 includes display unit 240, operation unit 230, control unit 210 that controls display unit 240 and operation unit 230, and storage unit 220 that stores angle data D1 that manages moving images associated with audio data representing music. Control unit 210 causes display unit 240 to display moving images captured at angles based on angle data D1, and accepts user operations from operation unit 230 to edit the moving images associated with the audio data (FIGS. 17A and 17B, S51 to S68).

[0208] According to the electronic device 200, a video shot at an angle set in the angle data D1 in association with a period in a song can be displayed, and the video associated with the audio data of the song can be edited. This also makes it easier to manage video shooting according to the song, for example, when editing a video, using video shot at an angle corresponding to the period in the song as material.

[0209] (Other embodiments) As described above, embodiment 1 has been described as an example of the technology disclosed in this application. However, the technology in this disclosure is not limited to this, and can be applied to embodiments in which appropriate modifications, substitutions, additions, omissions, etc. are made. Furthermore, it is also possible to combine the components described in the above embodiment to create new embodiments.

[0210] In the above-described first embodiment, an example has been described in which the electronic device 200 displays a countdown and pre-plays music in accordance with a timer setting before playing back a music range for each angle in the process of the recording mode of the photographing function (S45) (S76, FIGS. 14(C), 15). The electronic device 200 may output sound for timing purposes, such as a metronome, before playing back the music range. Such a modified example will be described with reference to FIG. 19.

[0211] 19 is a flowchart illustrating the recording mode process (S45A) in a modification of the first embodiment. In this modification, instead of the process including pre-playback of music (S76) in the recording mode process (S45, FIG. 13) of the first embodiment, a process including metronome playback (S76A) and music playback after the countdown display (S76B) are executed. Furthermore, in the recording mode process (S45A) of this modification, in addition to the same processes as in the first embodiment, a process related to metronome playback is executed (S90).

[0212] In this modification, when the timer setting is ON (YES in S74), the control unit 210 of the electronic device 200 generates audio data representing the sound of a metronome based on BPM (Beats Per Minute) information of the music (S90). BPM information is information that indicates the tempo of the music. For example, a GUI for inputting BPM information may be provided on various screens in the plan creation function and / or on the shooting standby screen. The control unit 210 acquires BPM information input from the operation unit 230 by a user operation on the GUI. Furthermore, the control unit 210 may acquire BPM information using various audio analysis techniques based on the audio data of the music.

[0213] 13, and also causes the speaker 270 or the like to output the sound indicated by the generated audio data so as to play a metronome based on the audio data (S76A).The control unit 210 starts the video recording and countdown display simultaneously with the video recording and countdown display in accordance with the timer period set in step S73, for example (S76A).

[0214] For example, after a set timer period has elapsed, the control unit 210 plays music for the angle selected as the shooting target from the start of the music range set for that angle in the angle data D1 based on the audio data of the music (S76B).

[0215] According to the above-described recording mode process (S45A), in addition to the countdown display, a metronome corresponding to the BPM information of the music is played (S90, S76A). This also makes it easier to set the timing at the start of recording and to manage video recording according to the music.

[0216] In the first embodiment described above, the electronic device 200, in its photographing function, refers to the angle data D1 and displays an angle selection screen on which a subject to be photographed can be selected from set angles (S41, S42). The electronic device of this embodiment may, in its photographing function, further control the imaging unit 280 and the like in video shooting based on the angle data D1. For example, the control unit 210 may change the zoom magnification and the like in video shooting according to information indicating the composition for each angle set in the angle data D1.

[0217] In the above embodiments, an example has been described in which preset icons 51 corresponding to zoom magnifications (angles of view) are provided as composition options for video shooting on the angle editing screen ( FIG. 4(B) ) of the electronic device 200. In the electronic device of the present embodiment, for example, it may be possible to set not only the zoom magnification but also the shooting direction of the subject as a composition for each angle. For example, on an angle editing screen similar to that of FIG. 4(B) , a plurality of icons indicating shooting direction options may be further provided between the preset icon 51 and the memo field 53, or may be provided instead of the preset icon 51. The angle data in the present embodiment may include information indicating the shooting direction as a composition for video shooting for each angle, in addition to or instead of the zoom magnification.

[0218] In the above embodiments, an example has been described in which the electronic device 200 divides the video timeline 80 corresponding to the range of music in a video work into multiple cuts in response to a user's cut editing operation ((II) of S55) in the video editing function (S57). In the present embodiment, the electronic device may, for example, in the plan creation function, accept a user operation from the operation unit 230 specifying the time period of music that is expected to be divided into cuts. For example, the user operation in the angle setting process (S25 of FIG. 8A) may further include an operation of a cut marker or the like placed on the audio timeline 24 of the playback field 22 (see FIGS. 4(B) and 6). In addition to the processes of steps S26 to S28, the control unit 210 may acquire cut information indicating the period of the cut specified by the marker operation. The control unit 210 may perform the cut editing process by referring to the cut information when generating the video timeline 80 in the video editing function (S51).

[0219] In the above embodiments, angle data D1 has been described as an example of management information for managing video associated with audio data of a song. The management information of the present disclosure is not limited to angle data D1, but may be various information for managing a period in a song by associating a shooting unit, such as an angle set by a user operation, with the period in the song. The shooting unit of the present disclosure is not limited to the above-described angle, but may be various shooting units that can be set by a user operation, in which a video is shot corresponding to a period in the song.

[0220] In the above embodiments, the electronic device 200 having a video shooting function has been described, but the electronic device of the present disclosure may also be various electronic devices that do not have a video shooting function. For example, the electronic device of this embodiment may control an imaging device that performs video shooting by various data communications via the communication unit 250, and perform a shooting function similar to that of the first embodiment, or may acquire image data from the imaging device and perform a video editing function.

[0221] In the above embodiments, examples have been described in which the evaluation information is three types: "OK," "KEEP," and "NG." However, the evaluation information is not limited to these. In this embodiment, the evaluation information may be three types of evaluation different from the above, or may be two or four or more types instead of three. Furthermore, in this embodiment, the evaluation information may be a continuous score. The electronic device of this embodiment may accept user input of such various types of evaluation information and manage video shooting for each angle. For example, by appropriately setting a criterion for whether video shooting for an angle has been completed, the criterion can be displayed.

[0222] (Example) Various aspects of the present disclosure will be exemplified below.

[0223] A first aspect of the present disclosure is an electronic device that manages video recording in accordance with music. The electronic device includes a display unit that displays information, an input unit that inputs user operations, and a control unit that generates management information for managing video associated with audio data representing the music. The control unit causes the display unit to display a period included in the music in the audio data, and accepts, from the input unit, a user operation that sets a recording unit for recording the video corresponding to the period in the music in the management information. The control unit generates the management information by associating the recording unit set by the user operation with the period in the music.

[0224] In a second aspect, in the electronic device according to the first aspect, the control unit receives, from the input unit, a user operation for setting a plurality of capture units in at least a part of a period of a song.

[0225] In a third aspect, in the electronic device described in the second aspect, the control unit accepts, from the input unit, a user operation that specifies a period in the song corresponding to each shooting unit among the multiple shooting units.

[0226] In a fourth aspect, in the electronic device according to the second or third aspect, the control unit causes the display unit to display an editing screen for editing a video associated with the audio data, and receives from the input unit a user operation for dividing a period during which music is played in the video into multiple cuts. The control unit assigns a first captured video from multiple captured videos shot for each shooting unit in multiple shooting units to the multiple cuts divided in the video, and updates the editing screen. The control unit receives from the input unit a user operation for changing the captured video assigned to the multiple cuts to a second captured video different from the first captured video among the multiple captured videos, and updates the editing screen in accordance with the change in the assigned captured video.

[0227] In a fifth aspect, in the electronic device according to any one of the first to fourth aspects, the control unit controls moving image shooting in shooting units based on the management information.

[0228] In a sixth aspect, the electronic device according to the fifth aspect further includes an output unit configured to output audio, and the control unit controls the output unit to output audio corresponding to a period in a song associated with a recording unit based on the management information and the audio data.

[0229] In a seventh aspect, in the electronic device according to the sixth aspect, the control unit receives from the input unit a user operation specifying a start time for video shooting in a video shooting unit, and controls the output unit to output an audio signal corresponding to audio data from a period earlier than a period in a song associated with the video shooting unit in the management information in accordance with the specified start time.

[0230] In an eighth aspect, in the electronic device according to any one of the first to seventh aspects, the management information includes at least one of a zoom magnification in moving image shooting for each shooting unit and a shooting direction of a subject in the moving image shooting.

[0231] A ninth aspect is a shooting management method for managing video shooting according to music. This method includes a step in which a control unit of an electronic device generates management information for managing video associated with audio data representing the music. The control unit is configured to control a display unit that displays information and an input unit that inputs user operations. The step of generating management information includes a step of causing the display unit to display a period included in the music in the audio data, and receiving, from the input unit, a user operation for setting a shooting unit for shooting the video corresponding to the period in the music in the management information, and a step of generating management information by associating the period in the music with the shooting unit set by the user operation.

[0232] In a tenth aspect, there is provided a program for causing a control unit to execute the photography management method according to the ninth aspect.

[0233] An eleventh aspect is an electronic device that manages video recording in accordance with music. The electronic device includes an imaging unit that captures an image of a subject to generate video data, a storage unit that stores management information for managing videos associated with audio data representing music, and a control unit that controls video recording by the imaging unit. The management information includes a period in the music associated with a recording unit set to record a video corresponding to a period in the music in the audio data. The control unit controls video recording for each recording unit based on the management information.

[0234] A twelfth aspect is an electronic device that manages video recording corresponding to music. The electronic device includes a display unit that displays information, an input unit that inputs user operations, a control unit that controls the display unit and the input unit, and a storage unit that stores management information for managing video associated with audio data representing music. The management information includes periods within the music associated with shooting units set to record video corresponding to periods within the music in the audio data. The control unit displays the video recorded in each shooting unit on the display unit based on the management information, and accepts user operations from the input unit to edit the video associated with the audio data.

[0235] As described above, the embodiments have been described as examples of the technology of the present disclosure. For this purpose, the accompanying drawings and detailed description have been provided. Therefore, among the components described in the accompanying drawings and detailed description, not only components essential for solving the problem but also components that are not essential for solving the problem in order to exemplify the above technology may be included. [Industrial Applicability]

[0236] The present disclosure is applicable to various uses for shooting video in accordance with music. [Explanation of symbols]

[0237] 200 Electronic equipment 210 Control Unit 220 Storage section 230 Operation section 240 Display section 250 Communications Department 270 Speaker 280 Imaging unit D1 Angle Data

Claims

1. An electronic device that manages video recording according to music, a display unit that displays information; an input unit for inputting user operations; a control unit that generates management information for managing a video associated with the audio data representing the music piece; The control unit displaying a period included in the music piece in the audio data on the display unit, and receiving, from the input unit, a user operation for setting a shooting unit for shooting a video corresponding to the period in the music piece in the management information; The management information is generated by associating a period in the music piece with the unit of recording set by the user operation. electronic equipment.

2. The control unit receives, from the input unit, a user operation for setting a plurality of shooting units in at least a part of a period of the music piece. The electronic device according to claim 1 .

3. The control unit receives, from the input unit, a user operation for specifying a period in the music piece corresponding to each of the plurality of shooting units. The electronic device according to claim 2 .

4. The control unit displaying an editing screen for editing a moving image associated with the audio data on the display unit, and receiving a user operation from the input unit to divide a period during which the music is played in the moving image into a plurality of cuts; assigning a first photographed moving image from among a plurality of photographed moving images photographed for each shooting unit in the plurality of shooting units to a plurality of cuts divided in the moving image, and updating the editing screen; A user operation to change the shot videos assigned to the plurality of cuts to a second shot video different from the first shot video among the plurality of shot videos is accepted from the input unit, and the editing screen is updated in accordance with the change in the assigned shot videos. The electronic device according to claim 2 .

5. The control unit controls video shooting in the shooting unit based on the management information. The electronic device according to claim 1 .

6. further comprising an output unit for outputting audio; The control unit controls the output unit based on the management information and the audio data to output audio corresponding to a period in the music associated with the shooting unit during video shooting of the shooting unit. The electronic device according to claim 5 .

7. The control unit receiving, from the input unit, a user operation that specifies a start time at which video shooting is to start in the video shooting of the shooting unit; In accordance with the specified start time, the output unit is controlled so that, in video shooting of the shooting unit, an audio signal corresponding to the audio data is output from a period before a period in the music associated with the shooting unit in the management information.

7. The electronic device according to claim 6.

8. The management information includes at least one of a zoom magnification in the video shooting of the video shooting unit and a shooting direction of a subject in the video shooting. The electronic device according to claim 1 .

9. A shooting management method for managing video shooting according to music, comprising: a step of generating, by a control unit of the electronic device, management information for managing a video associated with the audio data representing the music piece; the control unit is configured to control a display unit that displays information and an input unit that inputs a user's operation; The step of generating management information includes: a step of displaying a period included in the music piece in the audio data on the display unit, and receiving, from the input unit, a user operation for setting a shooting unit for shooting a video corresponding to the period in the music piece in the management information; and generating the management information by associating a period in the music piece with the unit of recording set by the user operation. Shooting management methods.

10. A program for causing the control unit to execute the photography management method according to claim 9.

11. An electronic device that manages video recording according to music, an imaging unit that captures an image of a subject and generates video data; a storage unit that stores management information for managing a video associated with the audio data representing the music; a control unit that controls video shooting by the imaging unit, the management information includes a period in the music piece in the audio data in association with a shooting unit set for shooting a video corresponding to the period in the music piece; The control unit controls video shooting in the shooting unit based on the management information. electronic equipment.

12. An electronic device that manages video recording according to music, a display unit that displays information; an input unit for inputting user operations; a control unit that controls the display unit and the input unit; a storage unit that stores management information for managing a video associated with the audio data representing the music piece; the management information includes a period in the music piece in the audio data in association with a shooting unit set for shooting a video corresponding to the period in the music piece; The control unit causes the display unit to display the video captured in the capture unit based on the management information, and accepts, from the input unit, a user operation for editing the video associated with the audio data. electronic equipment.

Images