Electronic devices

By introducing an artificial intelligence engine to electronic devices to determine important scenes of dynamic images and generate edited videos, the problem that the prior art cannot select important scenes based on the subject state is solved, and more efficient dynamic image processing and storage optimization are achieved.

CN114979496BActive Publication Date: 2024-11-19SHARP KK
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210764845.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-04-22
Filing Date
2020-04-08
Publication Date
2024-11-19
Estimated Expiration
2040-04-08

AI Technical Summary

Technical Problem

The existing imaging device cannot select important scenes based on the state of the subject, resulting in the inability to effectively extract the dynamic image parts of the user's interest.

Method used

An electronic device is designed, including a camera device and a control device, which determines important scenes of the captured dynamic images through an artificial intelligence engine, generates important scene information, including the determination result of whether each frame is an important scene, and generates edited videos and eliminates them. Non-important scene part.

Benefits of technology

It realizes determining important scenes based on image information in dynamic images, and generates edited videos more in line with user preferences, reducing storage space requirements and improving the efficiency of video editing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114979496B_ABST
    Figure CN114979496B_ABST
Patent Text Reader

Abstract

The present invention is an electronic device including a camera device and a control device, and the control device executes: a dynamic image acquisition process, which acquires a first dynamic image shot by the camera device; an important scene determination process, which determines whether each frame included in the first dynamic image is an important scene based on image information included in the first dynamic image; and a scene information generation process, which generates important scene information, and the important scene information includes a determination result of whether each frame is an important scene, and the important scene determination process is executed after the shooting of the dynamic image is completed.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an electronic device, a control device, a recording medium and a control method. Background Art

[0002] In recent years, many smart phones and the like are equipped with a video shooting function, which increases the number of video shooting opportunities for users. In order to effectively view and organize the many video images that have been shot, there is an increasing demand for extracting important scenes from the video images and editing or reproducing them.

[0003] For example, Patent Document 1 proposes an imaging device that performs a process of selecting an important scene captured portion from captured data based on input information during execution of the capturing process, such as a zoom operation during capturing.

[0004] Prior art literature

[0005] Patent Literature

[0006] [Patent Document 1] Japanese Patent Application Publication No. 2007-134770 Summary of the invention

[0007] Technical Problems to be Solved by the Invention

[0008] However, the camera device described in Patent Document 1 can select important scenes based on input information during shooting, but cannot select important scenes based on the state of the subject in the captured dynamic image, etc. Therefore, there is a problem that important scenes are selected regardless of the state of the subject that the photographer is very interested in.

[0009] In order to solve such a problem, an object of one embodiment of the present invention is to realize an electronic device or the like that determines an important scene based on image information in a captured moving image.

[0010] Means of solving the problem

[0011] In order to solve the above-mentioned problems, an electronic device of one embodiment of the present invention is an electronic device including at least one camera device and at least one control device, and the control device executes: a dynamic image acquisition process, which acquires a first dynamic image shot by the camera device; an important scene determination process, which determines whether each frame included in the first dynamic image is an important scene based on image information included in the first dynamic image; and a scene information generation process, which generates important scene information, and the important scene information includes a determination result of whether each of the frames is the important scene, and the important scene determination process is executed after the shooting of the dynamic image is completed.

[0012] Beneficial Effects

[0013] According to one embodiment of the present invention, it is possible to realize an electronic device or the like that determines an important scene based on image information in a captured moving image. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 It is a block diagram showing the functional structure of a smartphone according to one embodiment of the present invention.

[0015] Figure 2 This is a flowchart showing a composition recognition process performed by a control device according to an embodiment of the present invention.

[0016] Figure 3 1 is a flowchart showing a subject recognition process performed by a control device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0017] 〔Smartphone Structure〕

[0018] The following reference Figure 1 to Figure 3 An embodiment of the present invention is described below. Figure 1 As shown, the smart phone (electronic device) 1 includes at least one camera (camera) 10, at least one display device 20, at least one AI (Artificial Intelligence) engine control device 30, and at least one control device 40. In addition, the AI ​​engine control device 30 and the control device 40 are both examples of control devices described in the claims.

[0019] <Camera>

[0020] The camera 10 includes a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) as a light receiving element and is capable of at least capturing moving images. The camera 10 may also be capable of capturing still images in addition to capturing moving images. The smartphone 1 may include another camera for capturing still images in addition to the camera 10 for capturing moving images, and the camera 10 may also be capable of capturing both moving images and still images.

[0021] <Display device>

[0022] The display device 20 is provided on one side of the smartphone 1 to display various information including still images and moving images stored in the smartphone 1. The display device 20 may be, for example, a liquid crystal display or an organic EL (ElectroLuminescence) display.

[0023] <AI Engine Control Device>

[0024] The AI engine control device 30 functions as an AI engine for starting artificial intelligence (AI). The functions of this AI engine are implemented by the CPU (Central Processing Unit), GPU (Graphics Processing Unit), or DSP (Digital Signal Processor) provided in the AI engine control device 30. In addition, the AI engine control device 30 may also be provided with a storage unit (not shown) that stores data learned by artificial intelligence and the like.

[0025] The AI engine control device 30 calculates a score (evaluation importance) for each frame included in the moving image or for each scene composed of a plurality of consecutive frames included in the moving image, based on the image information in the frame or the scene. Here, the image information refers to the information of each frame or scene, and may be at least one of, for example, a subject, composition, or color tone.

[0026] For example, when this score is calculated based on the subject included in the moving image, it is calculated based on a reference pre-learned by artificial intelligence, such as the type of the subject (whether it is a specific object such as a person or an animal), size, movement, position, direction, number, or brightness.

[0027] As a specific example, the AI engine control device 30 may calculate a higher score when the type of the subject is a person than when the subject is not a person. In addition, the AI engine control device 30 may calculate an even higher score when the expression of this person is a smiling face. Also, what kind of subject to calculate a high score for can be set by the user. With this configuration, the user can appropriately set different score calculation criteria according to the situation of shooting a moving image with a person as the subject and the situation of shooting a moving image with an object other than a person, such as an animal, as the subject.

[0028] Similarly, when the AI engine control device 30 calculates a score based on the composition included in the moving image, the score is calculated according to a reference pre-learned by artificial intelligence. For example, the closer the composition is to a generally good composition such as following the rule of thirds, the higher the score the AI engine control device 30 will calculate.

[0029] The information of the score for each frame or each scene calculated by the AI engine control device 30 is output to the following important scene determination unit 42.

[0030] <Control Device>

[0031] The control device 40 includes, for example, a CPU to comprehensively control the operation of the smartphone 1. The control device 40 includes a moving image acquisition unit 41, an important scene determination unit 42, and a scene information generation unit 43. The control device 40 may further include a moving image generation unit 44 and a moving image reproduction unit 45.

[0032] (Moving image acquisition unit)

[0033] The moving image acquisition unit 41 executes a moving image acquisition process to acquire a captured video (first moving image) that is a moving image captured by the camera 10 . The moving image acquisition unit 41 outputs the acquired captured video to the AI ​​engine control device 30 .

[0034] (Important scene judgment department)

[0035] The important scene determination unit 42 determines whether each frame or each scene included in the captured video is an important scene based on the score of the frame or each scene calculated by the AI ​​engine control device 30. In other words, the important scene determination unit 42 performs an important scene determination process, which determines whether each frame included in the captured video is an important scene based on the image information included in the captured video. In addition, the important scene determination unit 42 determines whether each frame or each scene is an important scene based on at least one of the subject, composition, and color tone of the image included in the captured video.

[0036] The important scene determination unit 42 determines whether it is an important scene by whether the score is above a predetermined threshold. The predetermined threshold is set to an appropriate value by the important scene determination unit 42 corresponding to the scoring benchmark of the AI ​​engine. In addition, the user can also set the predetermined threshold to an arbitrary value. Thus, the user can adjust the number of frames or scenes determined to be important scenes by changing the predetermined threshold.

[0037] Furthermore, when the length of the clipped video (second dynamic image) described below is predetermined, the important scene determination unit 42 may appropriately adjust the predetermined threshold value in such a manner that the length of the dynamic image obtained by adding all the important scenes together is substantially the same as the length of the predetermined clipped video. Thus, the important scene determination unit 42 can extract important scenes from the shot video in such a manner that the clipped video is a dynamic image of a predetermined length.

[0038] In addition, the function of the AI ​​engine included in the AI ​​engine control device 30 may also be included in the important scene determination unit 42. In this case, the AI ​​engine operates through the CPU or the like included in the control device 40, and the important scene determination unit 42 performs both the processing of calculating the score of each frame or each scene included in the shot video and the processing of determining whether it is an important scene.

[0039] As described above, the important scene determination unit 42 can determine which part of the captured video is classified as an important scene based on the images included in the captured video.

[0040] (Scene Information Generation Unit)

[0041] The scene information generating unit 43 performs scene information generating processing, which generates important scene information based on the determination result of the important scene determining unit 42, wherein the important scene information includes the determination result of whether each frame or scene included in the captured video is an important scene. The important scene information may be a result of directly attaching information on whether it is an important scene to each frame in the captured video in the form of a tag.

[0042] Alternatively, the scene information generating unit 43 may generate information for specifying a frame determined as an important scene as important scene information independently of the captured video data. With this configuration, the smartphone 1 can manage the captured video and the important scene information separately.

[0043] As the information for specifying the frame, the frame determined as the important scene in the shot video may be information of the moment when the frame exists in the shot video, or may be information indicating which frame number in the shot video it is. In addition, by using the structure in which the moment when the frame exists in the shot video is used as the information for specifying the frame, even when the frame rate of the shot video is changed later, the position of the frame determined as the important scene in the shot video will not change. Therefore, there is no need to change the important scene information of the shot video.

[0044] (Dynamic image generation unit)

[0045] The dynamic image generation unit 44 generates a clipped video (second dynamic image) in which important scenes are clipped from the captured video. In other words, the dynamic image generation unit 44 extracts frames determined to be important scenes from the captured video as connection frames based on the important scene information generated by the scene information generation unit 43. Then, a dynamic image generation process is performed to generate a second dynamic image composed of a single connection frame or a plurality of connection frames connected to each other.

[0046] With this configuration, the video generation unit 44 can generate a clip video that is shorter than the shot video and contains only important scenes. Therefore, the user can obtain a clip video with a smaller video length and data size, and can easily manage the video stored in the smartphone 1.

[0047] In addition, the control device 40 may also store both the shot video and the edited video in a storage device (not shown) provided in the smart phone 1 after generating the edited video. Thus, even if the edited video does not include a scene that the user considers important, the user can regenerate the edited video from the shot video by changing the predetermined threshold value, etc. In addition, the control device 40 may also store only the edited video in the storage device after generating the edited video and clear the shot video. Thus, the capacity of the storage device can be reduced to the capacity of the shot video, so the user can use the smart phone 1 to store many dynamic images.

[0048] Furthermore, the dynamic image generation unit 44 may extract frames that also satisfy a predetermined condition as connection frames from the frames determined as important scenes by the important scene determination unit 42. Here, the predetermined condition may be, for example, a condition such as the expression, composition, size of movement, etc. of the subject in the frames that is applied only when the frames determined as important scenes are continuous for a certain number or more.

[0049] Specifically, the dynamic image generation unit 44 may also extract more frames as connecting frames for a series of frames determined to be important scenes when the subject's expression is a smiley face, compared to when the subject's expression is not a smiley face. With this structure, the dynamic image generation unit 44 can change the number of a series of continuous frames determined to be important scenes according to specified conditions. Therefore, the dynamic image generation unit 44 can adjust the length of scenes containing the same subject or composition, so that a montage video containing various scenes, which is better content for the user, can be generated in a short time.

[0050] The prescribed conditions are not limited to the above examples, and may be any conditions. Regarding the prescribed conditions, various conditions may be pre-set in the smart phone 1, and the user may also arbitrarily set the prescribed conditions. In addition, the communication function of the smart phone 1 may be used to sequentially increase or update the options of the prescribed conditions.

[0051] In this way, by extracting frames that also meet the prescribed conditions from frames determined as important scenes as connection frames, the control device 40 can set prescribed conditions for generating a clip video in addition to the prescribed threshold value related to the score of the important scene determination. Therefore, the user can set and change the generation conditions of the clip video in detail, so the control device 40 can generate a clip video that better suits the user's preferences.

[0052] In addition, the control device 40 may execute the processing performed by the dynamic image acquisition unit 41, the important scene determination unit 42, and the scene information generation unit 43 after the completion of the shooting of the video by the camera 10, or may execute it in real time substantially in parallel with the shooting. Such real-time processing is achieved by the control device 40 using the AI ​​engine for at least a part of the determination of the important scene.

[0053] By configuring the control device 40 to execute these processes in real time during the shooting of the video, the control device 40 can generate important scene information immediately after the shooting of the video by the camera 10 is completed. Therefore, the time delay from the completion of the shooting of the video by the camera 10 to the generation of the edited video by the dynamic image generation unit 44 can be effectively reduced.

[0054] (Moving image reproduction unit)

[0055] The video reproducing unit 45 performs processing for displaying the reproduced video clip on the display device 20. The video reproducing unit 45 may give a transition effect such as fading out to the reproduced video clip. The video reproducing unit 45 may also reproduce only specific connection frames in the video clip for a certain period of time.

[0056] In addition, the dynamic image playback unit 45 can play back the clipped video by sliding each connecting frame in the clipped video from the side and alternating one by one, or can play back the clipped video by alternating one connecting frame being played back slowly becoming smaller and the connecting frame immediately following it slowly becoming larger.

[0057] Furthermore, if a still image captured during the shooting of the video exists, the dynamic image reproducing unit 45 may also insert the still image into a predetermined position of the edited video for reproducing. The predetermined position may be the position where the connecting frame corresponding to the still image appears in the edited video, the beginning or the end of the edited video, or any other position.

[0058] The dynamic image reproducing unit 45 may also reproduce the clip video in any other form. In addition, the above-mentioned transition effect and the like may also be applied to the clip video when the dynamic image generating unit 44 generates the clip video.

[0059] In addition, the dynamic image reproducing unit 45 may also reproduce the captured video instead of the edited video on the display device 20. In this case, the dynamic image reproducing unit 45 may also reproduce the captured video in a form in which the user can recognize the frame or scene determined as an important scene. The so-called form that the user can recognize is, for example, a form in which a frame or scene determined as an important scene is displayed on the display device 20 as a small red ball.

[0060] With this structure, the user can confirm the location of important scenes by viewing and listening to the shot video. Thus, for example, the user can change the above-mentioned predetermined threshold or the above-mentioned predetermined condition to study the settings for generating a more ideal edited video.

[0061] [Processing performed by the control device]

[0062] The following reference Figure 2 and Figure 3 The processing executed by the control device 40, that is, the control method of the smartphone 1 using the control device 40 will be described. Figure 2 An example of processing by the control device 40 to determine whether it is an important scene based on the composition in the captured video is shown in FIG. Figure 3 2 shows an example of a process in which the control device 40 determines whether or not the scene is an important scene based on a subject in a captured video.

[0063] <Composition Recognition Processing>

[0064] like Figure 2 As shown, the moving image acquisition unit 41 acquires the video captured by the camera 10 (moving image acquisition step), and outputs the captured video to the AI ​​engine control device 30. The AI ​​engine control device 30 receives the input of the captured video and activates a composition recognition engine as one of the AI ​​engines (S1).

[0065] Next, the AI ​​engine control device 30 calculates a score based on the composition of the image for each frame included in the captured video, and determines whether the calculated score is above a predetermined threshold (whether the score is high) (S2, important scene determination step). When the score of the composition for a frame is not above a predetermined threshold (NO in S2), the AI ​​engine control device 30 performs the determination of S2 for the next frame.

[0066] When the score of the composition for a frame is greater than or equal to a predetermined threshold (YES in S2), the important scene determination unit 42 determines that the frame is an important scene. Then, the scene information generation unit 43 identifies the frame as an important scene and generates important scene information to mark the frame (S3, scene information generation step).

[0067] Next, the important scene determination unit 42 determines whether the video recording by the camera 10 is completed (S4). If the recording is not completed (NO in S4), the AI ​​engine control device 30 and the control device 40 repeatedly perform the processing of S2 and S3 until the recording is completed. If the recording is completed (YES in S4), the AI ​​engine control device 30 terminates the function of the composition recognition engine (S5).

[0068] Next, the moving image generation unit 44 extracts frames marked as important scenes from the captured video as connection frames, and connects the connection frames to generate a cut video ( S6 , moving image generation step).

[0069] <Subject Recognition Processing>

[0070] In addition, Figure 3 As shown, the moving image acquisition unit 41 acquires the video captured by the camera 10 (moving image acquisition step), and outputs the captured video to the AI ​​engine control device 30. The AI ​​engine control device 30 receives the input of the captured video and activates the subject recognition engine as one of the AI ​​engines (S11).

[0071] Next, the AI ​​engine control device 30 determines whether the image information of each frame of the captured video contains a specific subject such as a person or an animal (S12). When a frame does not contain a specific subject (NO in S12), the AI ​​engine control device 30 performs the determination of S12 for the next frame.

[0072] When a frame contains a specific subject (YES in S12), the AI ​​engine control device 30 will also determine whether the specific subject has a large movement based on the image information of the frames surrounding the frame (S13). When the specific subject has a small movement (NO in S13), the AI ​​engine control device 30 will perform the determination of S12 for the next frame.

[0073] When the movement of a specific subject is large (YES in S13), the AI ​​engine control device 30 calculates a score above a predetermined threshold for the frame, and the important scene determination unit 42 determines that the frame is an important scene (important scene determination step). Then, the scene information generation unit 43 marks the frame by treating it as an important scene and generating important scene information (S14, scene information generation step).

[0074] Next, the important scene determination unit 42 determines whether the video recording by the camera 10 is completed (S15). If the recording is not completed (NO in S15), the AI ​​engine control device 30 and the control device 40 repeatedly perform the processing of S12 to S14 until the recording is completed. If the recording is completed (YES in S15), the AI ​​engine control device 30 terminates the function of the subject recognition engine (S16).

[0075] Next, the moving image generation unit 44 extracts frames marked as important scenes from the captured video as connection frames, and connects the connection frames to generate a cut video ( S17 , moving image generation step).

[0076] In addition, an example is shown here in which the subject recognition engine calculates a score based on the type of subject (whether it is a specific subject) and the size of the subject's activity contained in the image information of the frame to be determined. However, the subject recognition engine is not limited to this, and the score can also be calculated based on any feature of the subject.

[0077] The composition recognition processing of the composition recognition engine and the subject recognition processing of the subject recognition engine can also be performed simultaneously in the process of determining whether each frame included in the captured video is an important scene. That is, the AI ​​engine control device 30 can also determine whether each frame is an important scene based on two or more of the subject, composition, and color tone of the image included in the captured video.

[0078] In addition, the AI ​​engine included in the AI ​​engine control device 30 is not limited to the above-mentioned composition recognition engine and subject recognition engine, and may be any AI engine that can analyze the captured video.

[0079] [Variation]

[0080] The above-mentioned functions and processes of the smart phone 1 of one embodiment of the present invention are described on the premise that the user is shooting a moving image with the camera 10. However, when the user is shooting a still image with the camera 10, the camera 10 simultaneously shoots a moving image in the background, and the AI ​​engine control device 30 and the control device 40 use the moving image as a shot video to perform processes such as determination of important scenes. In other words, the shot video can also be shot in a still image shooting state. The so-called still image shooting state here refers to a state in which the camera 10 can accept a trigger (shutter, etc.) for still image shooting or a state that includes at least one of still image shooting. In addition, in this case, the still image can also be shot by a camera device other than the camera 10 of the smart phone 1.

[0081] For example, the control device 40 can also be controlled to always allow the camera 10 to capture dynamic images in the background while the camera application used by the user to capture still images is started. The important scene determination unit 42 uses the dynamic image as a captured video to determine the presence or absence of important scenes, and the dynamic image generation unit 44 extracts frames in the captured video that are determined to be important scenes as connecting frames to generate a clipped video.

[0082] With this structure, when the user shoots a still image, a dynamic image including the moment around the still image is automatically shot by the smartphone 1. Therefore, when the user looks back at the still image, he or she can watch and listen to the corresponding edited video. In addition, when the smartphone 1 is set to store only edited videos instead of the videos shot in the background, every time the camera application is started, even if a dynamic image is shot, only the edited videos including the important scenes are stored in the smartphone 1. Therefore, the storage capacity of the smartphone 1 is not used more than necessary.

[0083] 〔Software Implementation Example〕

[0084] The control blocks of the control device 40 (particularly the moving image acquisition unit 41, the important scene determination unit 42 and the scene information generation unit 43) can be implemented by a logic circuit (hardware) formed on an integrated circuit (IC chip) or the like, or can be implemented by software.

[0085] In the latter case, the control device 40 includes a computer for executing commands of software, i.e., programs, for implementing the functions. The computer includes, for example, at least one processor (control device), and includes at least one computer-readable recording medium storing the program. Then, in the above-mentioned computer, the above-mentioned program is read and executed from the above-mentioned recording medium by the above-mentioned processor to achieve the purpose of the present invention. As the above-mentioned processor, for example, a CPU (Central Processing Unit) can be used. As the above-mentioned recording medium, "non-temporary tangible media" such as ROM (Read Only Memory), as well as tapes, disks, cards, semiconductor memories, programmable logic circuits, etc. can be used. In addition, a RAM (Random Access Memory) for expanding the above-mentioned program may also be included. In addition, the program may also be supplied to the above-mentioned computer via any transmission medium (communication network or broadcast wave, etc.) that can transmit the program. In addition, one embodiment of the present invention can also be implemented in the form of a data signal embedded in a carrier wave after the above-mentioned program is concretized by electronic transmission.

[0086] 〔Summarize〕

[0087] The electronic device (smart phone 1) of form 1 of the present invention is an electronic device including at least one camera device (camera 10) and at least one control device (AI engine control device 30 and control device 40), wherein the control device performs: a dynamic image acquisition process, which acquires a first dynamic image taken by the camera device; an important scene determination process, which determines whether each frame included in the first dynamic image is an important scene based on the image information included in the first dynamic image; and a scene information generation process, which generates important scene information, which includes a determination result of whether each of the frames is the important scene.

[0088] The electronic device of form 2 of the present invention is based on form 1, wherein the control device also performs dynamic image generation processing, which extracts the frame determined to be the important scene as a connecting frame, and generates a second dynamic image composed of a single connecting frame or connecting a plurality of connecting frames to each other.

[0089] The electronic device according to form 3 of the present invention is based on form 2, wherein the control device extracts the frames that meet prescribed conditions as the connection frames from the frames determined to be the important scenes in the dynamic image generation process.

[0090] The electronic device of form 4 of the present invention is based on forms 1 to 3, wherein the control device determines whether each of the frames is the important scene based on at least one of the subject, composition and color tone of the image information in the important scene determination process.

[0091] The electronic device of form 5 of the present invention is based on form 4, wherein the control device evaluates the importance of each frame based on at least one of the subject, composition and color tone of the image information in the important scene determination process, and determines the frame whose importance is above a specified threshold as the important scene.

[0092] The electronic device according to aspect 6 of the present invention is based on aspects 1 to 5, wherein the important scene information includes information on the time when the frame determined to be the important scene exists in the first moving image.

[0093] The electronic device according to aspect 7 of the present invention is based on aspects 1 to 6, wherein the first moving image can also be captured when the camera device is in a still image capturing state.

[0094] The control device (AI engine control device 30 and control device 40) of form 8 of the present invention is a control device for controlling an electronic device (smart phone 1) including at least one camera device (camera 10), and includes: a dynamic image acquisition unit (41), which can execute a process of acquiring a first dynamic image taken by the camera device; an important scene determination unit (42), which can execute a process of determining whether each frame included in the first dynamic image is an important scene based on image information included in the first dynamic image; and a scene information generation unit (43), which can execute a process of generating important scene information, wherein the important scene information includes a determination result of whether each of the frames in the first dynamic image is the important scene.

[0095] The control method of form 9 of the present invention is a control method for controlling an electronic device (smart phone 1) including at least one camera device (camera 10), comprising: a dynamic image acquisition step, which acquires a first dynamic image taken by the camera device; an important scene determination step, which determines whether each frame included in the first dynamic image is an important scene based on image information included in the first dynamic image; and a scene information generation step, which generates important scene information, and the important scene information includes a determination result of whether each of the frames in the first dynamic image is the important scene.

[0096] The control devices of various forms of the present invention may also be implemented by a computer. In this case, the control device implemented by a computer by making the computer work as the various parts (software elements) of the control device, the control program of the control device, and the computer-readable recording medium recording the control program are also included in the scope of the present invention.

[0097] [Additional Notes]

[0098] The present invention is not limited to the above-mentioned embodiments, and various changes can be made within the scope of the claims. The embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. Moreover, new technical features can be formed by combining the technical means disclosed in each embodiment.

Claims

1. An electronic device comprising at least one camera device and at least one control device, characterized in that: The control device performs the following processing: A moving image acquisition process of acquiring a first moving image captured by the camera device; and A dynamic image generation process, which extracts a connecting frame from the frames included in the first dynamic image based on the image information included in the first dynamic image, and generates a second dynamic image in which at least one of the connecting frames is connected to each other, The control device performs an important scene determination process for determining whether each frame included in the first dynamic image is an important scene based on image information included in the first dynamic image. In the dynamic image generation process, the frames satisfying a predetermined condition are extracted as the connection frames from the frames determined to be the important scenes. After the shooting of the dynamic image is completed, the important scene determination process is performed. The length of the second dynamic image is substantially the same as the prescribed length.

2. An electronic device comprising at least one camera device and at least one control device, characterized in that: The control device performs the following processing: A moving image acquisition process of acquiring a first moving image captured by the camera device; and A dynamic image generation process, which extracts a connecting frame from the frames included in the first dynamic image based on the image information included in the first dynamic image, and generates a second dynamic image in which at least one of the connecting frames is connected to each other, The control device performs an important scene determination process for determining whether each frame included in the first dynamic image is an important scene based on image information included in the first dynamic image. In the dynamic image generation process, the frames satisfying a predetermined condition are extracted as the connection frames from the frames determined to be the important scenes. After the shooting of the dynamic image is completed, the important scene determination process is performed. Both the first dynamic image and the second dynamic image are stored in a storage device.