Video generation method and device, electronic equipment and readable storage medium

Abstract

The invention discloses a video generation method and device, electronic equipment and a readable storage medium, and belongs to the field of video processing. The method comprises the following steps: acquiring at least two shot objects and a shooting associated object when each shot object is shot; the shooting associated object comprises an audio file; and generating a first video according to the at least two shot objects and each shooting associated object.

Description

Technical Field

[0001] The present application belongs to the field of video processing, and specifically relates to a video generation method, device, electronic device and readable storage medium. Background Art

[0002] As the shooting functions of electronic devices continue to enrich, more and more people will use electronic devices to shoot images and videos to record every bit of life. However, most of the images and videos taken will be slowly forgotten by people over time after being stored in electronic devices.

[0003] In order to allow users to recall recorded moments of life, static images captured within a period of time can be displayed in a carousel through the memory function of the electronic device, so that users can view the static images captured within the period of time and recall the beautiful static moments.

[0004] However, in the above-mentioned recall function, only static images captured within a period of time can be displayed in a carousel, and only displaying static images in a carousel will make the displayed content relatively monotonous and fail to awaken the user's comprehensive and vivid memories. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide a video generation method, device, electronic device and readable storage medium, which can enrich the video content and awaken the user's comprehensive and vivid memories.

[0006] In a first aspect, an embodiment of the present application provides a video generation method, the method comprising: obtaining at least two photographed objects and shooting-related objects when shooting each photographed object; the shooting-related objects include audio files; and generating a first video based on at least two photographed objects and each shooting-related object.

[0007] In a second aspect, an embodiment of the present application provides a video generating device, which includes an acquisition module and a generation module; the acquisition module is used to acquire at least two photographed objects and shooting-related objects when shooting each photographed object; the shooting-related objects include audio files; the generation module is used to generate a first video based on the at least two photographed objects and each shooting-related object acquired by the acquisition module.

[0008] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0009] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0010] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0011] In a sixth aspect, an embodiment of the present application provides a computer program / program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0012] In the embodiment of the present application, at least two photographed objects and shooting-related objects when each photographed object is photographed can be obtained; the shooting-related objects include audio files; and a first video is generated based on the at least two photographed objects and each shooting-related object. Through this solution, the first video can be generated through the photographed objects and the shooting-related objects, thereby enriching the video content and awakening the user's comprehensive and vivid memories. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 It is one of the flow charts of the video generation method provided in the embodiment of the present application;

[0014] Figure 2 This is the second flowchart of the video generation method provided in the embodiment of the present application;

[0015] Figure 3 This is the third flowchart of the video generation method provided in the embodiment of the present application;

[0016] Figure 4 This is the fourth flowchart of the video generation method provided in the embodiment of the present application;

[0017] Figure 5 This is the fifth flowchart of the video generation method provided in the embodiment of the present application;

[0018] Figure 6 is a schematic diagram showing shooting-related information of a first video in a video generation method provided in an embodiment of the present application;

[0019] Figure 7 is a schematic diagram of a video generating device provided in an embodiment of the present application;

[0020] Figure 8 is a schematic diagram of an electronic device provided in an embodiment of the present application;

[0021] Fig. 9It is a hardware schematic diagram of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0023] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0024] The term "indication" in this application can be a direct indication (or explicit indication) or an indirect indication (or implicit indication). A direct indication can be understood as the sender explicitly informing the receiver of specific information, operations to be performed, or request results in the sent indication; an indirect indication can be understood as the receiver determining the corresponding information according to the indication sent by the sender, or making a judgment and determining the operation to be performed or the request result according to the judgment result.

[0025] The terms "at least one (item)", "at least one of" and the like in the specification and claims of the present application refer to any one, any two or a combination of more than two of the objects included therein. For example, at least one (item) of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c" and "a, b and c", where a, b, and c can be single or multiple. Similarly, "at least two (items)" refers to two or more, and its meaning is similar to that of "at least one (item)".

[0026] The video generation method, device, electronic device and readable storage medium provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

[0027] The video generation method provided in the embodiment of the present application can be applied to the scenario of generating a recall video.

[0028] In a possible application scenario, the electronic device may first obtain at least two captured images and an audio file when each captured image is captured; and then generate a recall video based on the at least two captured images and each audio file.

[0029] In a possible application scenario, the electronic device may first obtain at least two shot videos and an audio file when each shot video is shot; and then generate a recall video based on the at least two shot videos and each audio file.

[0030] In a possible application scenario, the electronic device may first obtain at least one captured image and at least one captured video, as well as an audio file when each captured image and each captured video is captured; and then generate a recall video based on the at least one captured image, the at least one captured video and each audio file.

[0031] In this way, through this solution, a recall video can be generated through the photographed objects and the photographed related objects, so as to enrich the video content and awaken the user's comprehensive and vivid memories.

[0032] It should be noted that the video generation method provided in the embodiments of the present application can be executed by a video generation device, an electronic device, or a functional module in an electronic device, etc. In some embodiments of the present application, the video generation method provided in the embodiments of the present application is described by taking an electronic device executing the video generation method as an example.

[0033] Figure 1 FIG. 1 is a flow chart of a video generation method provided by an embodiment of the present application. Figure 1 As shown, the video generation method provided in the embodiment of the present application may include the following steps 101 and 102.

[0034] Step 101: The electronic device obtains at least two photographed objects and a photographing-related object when photographing each photographed object.

[0035] Among them, the above-mentioned shooting-related objects include audio files.

[0036] Optionally, in the embodiment of the present application, the photographed object may include a photographed multimedia file, and the multimedia file may include at least one of an image file and a video file.

[0037] For example, the at least two photographed objects may include at least two image files, or include at least two video files, or include at least one image file and at least one video file.

[0038] Optionally, in the embodiment of the present application, the at least two photographed objects may be objects that have been photographed by the electronic device and stored in the electronic device.

[0039] For example, the at least two photographed objects may be multimedia files stored in an album application in the electronic device.

[0040] Optionally, in an embodiment of the present application, the similarity of shooting information of any two of the at least two shot objects may be greater than or equal to a similarity threshold; the shooting information includes at least one of the following: shooting time, shooting location, shooting object, shooting scene.

[0041] Optionally, in the embodiment of the present application, the above similarity threshold may be a system default, or may be arbitrarily set by the user according to actual usage requirements.

[0042] It can be understood that if the similarity of the shooting information of two photographed objects is greater than or equal to the above similarity threshold, it can be considered that the shooting information of the two photographed objects is similar; otherwise, if the similarity of the shooting information of the two photographed objects is less than the above similarity threshold, it can be considered that the shooting information of the two photographed objects is not similar or not close.

[0043] Optionally, in an embodiment of the present application, the above-mentioned shooting object may include but is not limited to at least one of the following: a person object, an animal object, a plant object, an object object, a scenery object, etc.

[0044] Optionally, in an embodiment of the present application, the above-mentioned shooting scenes may include but are not limited to at least one of the following: a snowy scene, a rainy scene, a windy scene, a sunrise scene, a sunset scene, a mountain climbing scene, etc.

[0045] In an embodiment of the present application, since the similarity of shooting information of any two of the at least two photographed objects mentioned above can be greater than or equal to the similarity threshold, the electronic device can obtain photographed objects with similar shooting information, so as to display the photographed objects with similar shooting information to the user together, thereby awakening the user's refined memories.

[0046] Optionally, in the embodiment of the present application, the at least two photographed objects may be selected by the user from all photographed objects in the electronic device through input, or may be automatically determined by the electronic device from all photographed objects in the electronic device.

[0047] Optionally, in an embodiment of the present application, when the at least two photographed objects are selected by the user from all photographed objects in the electronic device through input, the input may be any possible form of input such as touch input, voice input or physical button input.

[0048] For example, taking the above-mentioned input as touch input as an example, the input may include but is not limited to: a single-click input, a double-click input, a triple-click input, a long-press input, a heavy-press input, a sliding input or a special trajectory input of the at least two photographed objects by the user through a finger or a stylus; wherein the special trajectory input may include but is not limited to: any trajectory input such as a circular trajectory input, an elliptical trajectory input, a heart-shaped trajectory input, a wavy trajectory input, a square trajectory input, a rectangular trajectory input, a diamond trajectory input or a trapezoidal trajectory input.

[0049] For example, taking the above input as voice input as an example, the input may include but is not limited to: voice "select the photographed object A" or voice "select the photographed object B" and any other possible voice inputs.

[0050] For example, taking the above-mentioned input as physical button input as an example, the input may include but is not limited to any of the following: the input of pressing the lock screen button and the volume "+" button at the same time, the input of pressing the lock screen button and the volume "-" button at the same time, the input of pressing the volume "+" button and the volume "-" button at the same time, and the input of pressing the lock screen button, the volume "+" button and the volume "-" button at the same time.

[0051] Optionally, in an embodiment of the present application, when the at least two photographed objects are automatically determined by the electronic device from all photographed objects in the electronic device, the electronic device may determine the at least two photographed objects having similar photographing information from all photographed objects based on the photographing information of the photographed objects.

[0052] Exemplarily, assuming that the above-mentioned shooting information includes shooting time, the electronic device can determine the above-mentioned at least two photographed objects with similar shooting time from all the photographed objects based on the shooting time of the above-mentioned all-photographed objects; for example, determine the photographed objects captured on a certain day, a certain week or a certain month from all the photographed objects, or determine the photographed objects with multiple frames shot continuously.

[0053] Exemplarily, assuming that the above-mentioned shooting information includes the shooting location and the shooting object, the electronic device can determine the above-mentioned at least two photographed objects with similar shooting locations and shooting objects from all the above-mentioned photographed objects based on the shooting locations and shooting objects of the above-mentioned all-shot objects; for example, determine the photographed object A at location a from all the photographed objects.

[0054] Exemplarily, assuming that the above-mentioned shooting information includes shooting time, shooting location, shooting object and shooting scene, the electronic device can determine the at least two photographed objects with similar shooting time, shooting location, shooting object and shooting scene from all the photographed objects based on the shooting time, shooting location, shooting object and shooting scene of all the above-mentioned photographed objects; for example, determine the photographed object of object B photographed at location b in a snowy scene on a certain day from all the photographed objects.

[0055] Optionally, in the embodiment of the present application, the audio files included in the photographing-related objects when photographing each photographed object may include audio files played or recommended by the electronic device when photographing each photographed object.

[0056] Step 102: The electronic device generates a first video according to at least two photographed objects and each photographed-related object.

[0057] Optionally, in an embodiment of the present application, the electronic device may directly synthesize the at least two photographed objects and each photographed-related object to obtain a first video.

[0058] For example, assuming that the at least two photographed objects include image A and video B, the shooting-related objects when shooting image A include audio file a, and the shooting-related objects when shooting video B include audio file b, then the electronic device can directly synthesize image A, video B, audio file a and audio file b to obtain a first video; wherein, the background music when playing image A in the first video is audio file a, and the background music when playing video B is audio file b.

[0059] Optionally, in the embodiment of the present application, combined with Figure 1 ,like Figure 2 As shown, the above step 102 can be specifically implemented through the following steps 102a and 102b.

[0060] Step 102a: The electronic device determines background music according to each audio file.

[0061] Optionally, in the embodiment of the present application, the above-mentioned audio files may be the same audio file, or may be at least partially different audio files.

[0062] Optionally, in the embodiment of the present application, when the above-mentioned audio files may be the same audio file, the electronic device may determine the audio file as background music.

[0063] Optionally, in the embodiment of the present application, when the above-mentioned audio files are at least partially different audio files, the electronic device can randomly select an audio file from these audio files as background music, or select the audio file with the highest play popularity from these audio files as background music, or select the most recently played audio file from these audio files as background music, etc. The specific selection can be made according to actual use requirements, and the embodiment of the present application is not limited thereto.

[0064] Step 102b: The electronic device generates a first video according to at least two photographed objects and background music.

[0065] Optionally, in an embodiment of the present application, after determining the above-mentioned background music, the electronic device may directly synthesize the above-mentioned at least two photographed objects and the background music to obtain the first video.

[0066] For a specific description of synthesizing the at least two photographed objects and the background music, reference may be made to the specific description in the related art of multimedia file synthesis, which will not be described again here to avoid repetition.

[0067] In the embodiment of the present application, since the electronic device can determine the background music based on various audio files and generate a first video based on at least two photographed objects and the background music, the background music in the generated first video can be strongly correlated with the at least two photographed objects, thereby accurately evoked the user's memories through the audio files when the photographed objects were shot.

[0068] Optionally, in the embodiment of the present application, the above-mentioned shooting-related objects may also include at least one of the following: shooting location, shooting time, physiological data, mood-related data, weather data, and conversation messages.

[0069] Optionally, in an embodiment of the present application, the above-mentioned shooting-related objects can be obtained from historical content information of an application in the electronic device.

[0070] Optionally, in an embodiment of the present application, the above-mentioned application may include but is not limited to at least one of the following: a weather application, a music playback application, a health monitoring application, an instant messaging application, a news application, a reading application, a game application, etc.

[0071] Optionally, in the embodiment of the present application, the above-mentioned application may be all application programs in the electronic device.

[0072] Optionally, in an embodiment of the present application, the historical content information of an application may include, but is not limited to, at least one of the following: content information acquired by the application, content information in the application.

[0073] For example, the historical content information of a weather application may include historical weather information; the historical content information of a music playback application may include historical playback records and historical music recommendation records, etc.; the historical content information of a health monitoring application may include historical heart rate information, historical blood pressure information, and historical walking steps, etc.; the historical content information of an instant messaging application may include historical chat records and historical contact information, etc.; the historical content information of a news application may include historical news information and historical news recommendation news information, etc.; the historical content information of a reading application may include historical reading records and historical reading recommendation records, etc.; the historical content information of a game application may include historical operation information.

[0074] Optionally, in an embodiment of the present application, the above-mentioned shooting location and the above-mentioned shooting time can be obtained from historical content information of a camera application or a gallery application in the electronic device.

[0075] Optionally, in an embodiment of the present application, the above-mentioned physiological data may include but is not limited to at least one of the following: blood pressure data, pulse data, heart rate data, etc.

[0076] Optionally, in an embodiment of the present application, the above-mentioned mood-related data may include but is not limited to at least one of the following: happy mood data, sad mood data, excited mood data, etc.

[0077] Optionally, in an embodiment of the present application, the above-mentioned physiological data and the above-mentioned mood-related data can be obtained from historical content information of a health monitoring application in an electronic device.

[0078] Optionally, in an embodiment of the present application, the above-mentioned weather data can be obtained from historical content information of a weather application in the electronic device.

[0079] Optionally, in an embodiment of the present application, the above-mentioned conversation message can be obtained from the historical content information of the instant messaging application in the electronic device.

[0080] In an embodiment of the present application, since the above-mentioned shooting-related objects can also include at least one of the following: shooting location, shooting time, physiological data, mood-related data, weather data, and conversation messages; therefore, the first video can be generated based on more different shooting-related objects, so that the generated first video can flexibly display richer content.

[0081] Optionally, in the embodiment of the present application, combined with Figure 1 ,like Figure 3 As shown, the above step 102 can be specifically implemented through the following steps 102c and 102d.

[0082] Step 102c: The electronic device determines multimedia materials according to each shooting-related object.

[0083] Optionally, in an embodiment of the present application, the above-mentioned multimedia material may include but is not limited to at least one of the following: image material, video material, audio material, text material, etc.

[0084] Optionally, in an embodiment of the present application, the above-mentioned image material may include static image material or dynamic image material.

[0085] For example, assuming that the above-mentioned shooting-related object includes weather data, and the weather data indicates that it is light snow, then the electronic device can generate image materials of dynamic snowfall based on the weather data.

[0086] For example, assuming that the above-mentioned shooting-related object includes physiological data, and the physiological data includes heart rate data indicating a faster heart rate, the electronic device can generate an image material of a beating red heart and a dynamic electrocardiogram curve material based on the heart rate data.

[0087] Step 102d: The electronic device generates a first video according to at least two photographed objects and multimedia materials.

[0088] For the specific method of video synthesis, please refer to the specific description in the relevant technology. In order to avoid repetition, it will not be described here.

[0089] It can be understood that the synthesized first video includes the at least two photographed objects and the multimedia material.

[0090] Optionally, in the embodiment of the present application, the multimedia material may be displayed superimposed on at least one of the at least two photographed objects.

[0091] Optionally, in an embodiment of the present application, when synthesizing the at least two photographed objects and the multimedia material, the electronic device may first adjust display parameters of the at least two photographed objects and the multimedia material, such as adjusting filters, display size, display color, display shape, display transparency, etc., and then synthesize the at least two photographed objects and the multimedia material after the adjustment to obtain a first video.

[0092] In an embodiment of the present application, since the electronic device can first generate multimedia materials corresponding to each shooting-related object based on the above-mentioned shooting-related objects, and then synthesize the above-mentioned at least two shot objects and the multimedia materials to obtain the first video, the content of the first video can be made richer and more vivid, thereby improving the effect of the synthesized video.

[0093] In the video generation method provided in the embodiment of the present application, through this scheme, a first video can be generated through the photographed object and the photographed related objects, thereby enriching the video content and awakening the user's comprehensive and vivid memories.

[0094] Optionally, in the embodiment of the present application, combined with Figure 1 ,like Figure 4 As shown, after the above step 102, the video generation method provided in the embodiment of the present application may further include the following step 103 or step 104.

[0095] Step 103: When receiving the first input, the electronic device plays the first video in response to the first input.

[0096] Optionally, in an embodiment of the present application, the first input is used to play a video.

[0097] Optionally, in the embodiment of the present application, the first input may be any possible form of input such as touch input, voice input or physical key input.

[0098] For example, taking the above-mentioned first input as touch input as an example, the first input may include but is not limited to: single-click input, double-click input, triple-click input, long press input, heavy press input, sliding input or special trajectory input performed by the user through a finger or a stylus; among them, the special trajectory input may include but is not limited to: circular trajectory input, elliptical trajectory input, heart-shaped trajectory input, wavy trajectory input, square trajectory input, rectangular trajectory input, diamond trajectory input or trapezoidal trajectory input and other arbitrary trajectory inputs.

[0099] For example, taking the above-mentioned first input as voice input as an example, the first input may include but is not limited to: voice "play the first video" or voice "watch the first video" and any other possible voice inputs.

[0100] For example, taking the above-mentioned first input as a physical button input as an example, the first input may include but is not limited to any of the following items: the input of pressing the lock screen button and the volume "+" button at the same time, the input of pressing the lock screen button and the volume "-" button at the same time, the input of pressing the volume "+" button and the volume "-" button at the same time, and the input of pressing the lock screen button, the volume "+" button and the volume "-" button at the same time.

[0101] Optionally, in an embodiment of the present application, when receiving a first input, the electronic device may play the first video on a first interface; the first interface may be a screen-off interface, a playback interface of a video application in the electronic device, or an interface of an electronic notebook application, etc.

[0102] Optionally, in the embodiment of the present application, parameter information such as size, position, shape, etc. of the first interface may be a system default, or may be arbitrarily set by the user according to actual usage requirements.

[0103] For example, the first interface may be an interface in a small window that is displayed floating above the desktop of the electronic device.

[0104] Optionally, in an embodiment of the present application, the electronic device may add a desktop component on the desktop, which is used to display all synthesized videos classified by shooting time or shooting location, etc., and then the user can select and play the first video among all the videos through the first input of the first video.

[0105] Step 104: The electronic device plays the first video at a preset play time.

[0106] Optionally, in the embodiment of the present application, the preset playback time may be a playback time preset by the system, or may be a playback time preset by a user through input.

[0107] It can be understood that when the current time of the system of the electronic device reaches the above-mentioned preset play time, the electronic device can automatically play the first video.

[0108] Optionally, in an embodiment of the present application, the preset playback time can be a moment on the last day of each month, quarter or year. When the current time of the system reaches this moment, the electronic device automatically plays the first video to facilitate the user to recall the life moments recorded in a month, quarter or year.

[0109] Optionally, in an embodiment of the present application, the electronic device can play the first video on the first interface at the preset playback time.

[0110] In the embodiment of the present application, since the electronic device can trigger or automatically play the first video through user input after synthesizing the first video, the playing of the first video can be triggered in different ways, thereby improving the flexibility of playing the first video.

[0111] Optionally, in the embodiment of the present application, combined with Figure 1 ,like Figure 5 As shown, after the above step 102, the video generation method provided in the embodiment of the present application may further include the following steps 105 and 106.

[0112] Step 105: The electronic device receives a second input.

[0113] Optionally, in an embodiment of the present application, the second input is used to display shooting related information.

[0114] Optionally, in the embodiment of the present application, the second input may be any possible form of input such as touch input, voice input or physical key input.

[0115] For example, taking the above-mentioned second input as touch input as an example, the second input may include but is not limited to: single-click input, double-click input, triple-click input, long press input, heavy press input, sliding input or special trajectory input performed by the user through a finger or a stylus; among them, the special trajectory input may include but is not limited to: circular trajectory input, elliptical trajectory input, heart-shaped trajectory input, wavy trajectory input, square trajectory input, rectangular trajectory input, diamond trajectory input or trapezoidal trajectory input and other arbitrary trajectory inputs.

[0116] For example, taking the second input as voice input, the second input may include but is not limited to: voice “display shooting related information 1” or voice “display shooting related information 2” and any other possible voice inputs.

[0117] For example, taking the above-mentioned second input as a physical button input as an example, the second input may include but is not limited to any of the following items: the input of pressing the lock screen button and the volume "+" button at the same time, the input of pressing the lock screen button and the volume "-" button at the same time, the input of pressing the volume "+" button and the volume "-" button at the same time, and the input of pressing the lock screen button, the volume "+" button and the volume "-" button at the same time.

[0118] Step 106: The electronic device displays shooting-related information of the first video in response to the second input.

[0119] The above-mentioned shooting related information is determined according to the above-mentioned shooting related object.

[0120] Optionally, in the embodiment of the present application, the above-mentioned shooting related information may be content information corresponding to the above-mentioned shooting related object.

[0121] Optionally, in an embodiment of the present application, after receiving the second input, the electronic device may display the shooting-related information of the first video in the form of a card component.

[0122] Optionally, in an embodiment of the present application, the electronic device can display the shooting-related information of the first video while playing the first video; at the same time, it can also generate a text matching the content of the first video and the displayed shooting-related information. For example, if the first video plays content showing many flowers in spring, and the displayed shooting-related information is a historical number of walking steps, and the historical number of walking steps is relatively large, then the electronic device can generate the text: Spring is always busy with flowers.

[0123] In the embodiment of the present application, since the electronic device can display the shooting-related information of the first video through the user's input after playing the first video, the relevant information when shooting the at least two photographed objects can be displayed in multiple dimensions and in all directions, thereby awakening the user's comprehensive and vivid memories through multi-dimensional information.

[0124] Optionally, in the embodiment of the present application, the video generation method provided in the embodiment of the present application may further include: the electronic device receives a third input, and the electronic device displays shooting-related information of the photographed object in response to the third input.

[0125] In the embodiment of the present application, more information can be recorded for the photographed object, and the user can view richer information when viewing the photographed object.

[0126] The video generation method provided in the embodiment of the present application is exemplarily described below with reference to the accompanying drawings.

[0127] Exemplarily, the video generation method provided in the embodiment of the present application may include the following steps:

[0128] Step 1: Capture and record everyday moments, including dynamic images, still images and videos.

[0129] Step 2: Identify and select the objects to be photographed.

[0130] According to the shooting time of the file shot in step 1, shooting-related objects such as the music played by the electronic device during shooting, the weather conditions at the time, and the recorded emotional stress conditions are recorded.

[0131] Step 3: Process the shooting-related objects and merge the materials.

[0132] According to the comprehensive judgment of the shooting related objects in step 2, by judging the shooting time of the dynamic images and identifying the previous and next frames, the dynamic images with similar scenes shot nearby are merged into short videos, and then these short videos are merged with static images and videos, and appropriate music is added. Among them, the choice of music can be comprehensively judged based on the shooting scene, the weather conditions at the time, and the recorded emotional stress conditions. For example, if the shooting scene is mountain climbing, the weather conditions at the time are sunny, and the user is in a happy mood, light music can be selected from the music played at the time as background music.

[0133] Step 4: Place an electronic notebook on the desktop to facilitate data display.

[0134] Add a widget to the desktop of the electronic device, select the synthesized video for display based on the shooting time or shooting location, and match it with other cards to form a diary-like feeling. You can also select the shooting-related information such as heart rate, weather, pace, etc. at the time for data display, and match some corresponding copy according to the shooting location and video content.

[0135] You can also set up a separate notebook application to classify these notebooks into books, record them systematically, and have a complete display at the end of the year, recording every moment of memory in more detail. It is not just about generating videos from multimedia files of the same shooting location, but also about the same season, the same theme (such as food), etc. For example, Figure 6 As shown, in the interface 60 of the notebook application, the first video 61 can be played, and the shooting related information a and the shooting related information b can be displayed in the form of cards, and at the same time, according to the content of the first video 61 and the displayed shooting related information, the relevant copy 62 is generated and displayed. In this way, the photographed object can be displayed in multiple dimensions, reproducing the vivid moments of the past.

[0136] In the above video generation method, on the one hand, by judging the shooting time of the dynamic image and identifying the previous and next frames, the dynamic image can be automatically connected and merged into a short video. For example, if there are multiple images shot by continuous pressing, they can be merged into a video; in this way, the video, picture, and video can be combined in an interlaced manner. On the other hand, the captured and collected information of the song listening on the day or at that time is used as the background music for generating the video; for example, when a user travels to a certain place, the user may frequently listen to a piece of music during the travel. The artificial intelligence model can be used to synthesize the video with static images, dynamic images, videos, etc., and the music can be used as the background music. On the other hand, by recording the information of the moment of shooting and recording the state at that time, such as the number of steps, heart rate, mood, weather, time and place, etc., the user's mood can also be determined through this information and associated with the multimedia file. Then generate an album memory video and display it to the user by year or month. You can also add a desktop component to the mobile phone desktop. In addition to the carousel of short videos, you can form an electronic notebook with the mood, heart rate and number of steps of the day to achieve a multi-dimensional and multi-sensory memory display.

[0137] In this way, users can create their own notebook records and video logs without any additional operations, visualize information and memories, and display them more vividly and flexibly on electronic devices, so that the records of photographed objects and information of other applications are no longer monotonous and boring, thereby awakening users' comprehensive and vivid memories.

[0138] The above-mentioned method embodiments, or various possible implementation methods in each method embodiment, can be executed separately, or, under the premise that there is no contradiction, can also be executed in combination with each other. The specific implementation can be determined according to actual usage requirements, and the embodiments of the present application do not limit this.

[0139] The video generation method provided in the embodiment of the present application can be executed by a video generation device. In the embodiment of the present application, the video generation device provided in the embodiment of the present application is described by taking the video generation method executed by the video generation device as an example.

[0140] like Figure 7 As shown, an embodiment of the present application provides a video generating device 70 , which may include an acquisition module 71 and a generation module 72 .

[0141] The acquisition module 71 can be used to acquire at least two photographed objects and photographing-related objects when photographing each photographed object; the photographing-related objects include audio files. The generation module 72 can be used to generate a first video according to the at least two photographed objects and each photographing-related object acquired by the acquisition module 71.

[0142] In a possible implementation, the generation module 72 may be specifically configured to determine background music according to each of the above-mentioned audio files; and to generate a first video according to the above-mentioned at least two photographed objects and the background music.

[0143] In a possible implementation manner, the above-mentioned shooting-related objects may also include at least one of the following: shooting location, shooting time, physiological data, mood-related data, weather data, and conversation messages.

[0144] In a possible implementation, the generation module 72 may be specifically configured to determine multimedia materials according to each of the above-mentioned shooting-related objects; and generate a first video according to the above-mentioned at least two shot objects and the multimedia materials.

[0145] In a possible implementation, the similarity of shooting information of any two of the at least two shot objects may be greater than or equal to a similarity threshold; the shooting information includes at least one of the following: shooting time, shooting location, shooting object, shooting scene.

[0146] In a possible implementation, the video generating device 70 may further include a playing module. The playing module may be configured to play the first video in response to the first input when receiving the first input after the generating module 72 generates the first video according to the at least two photographed objects and each photographed-related object; or play the first video at a preset playing time.

[0147] In a possible implementation, the video generating device 70 may further include a receiving module and a display module. The receiving module may be configured to receive a second input after the generating module 72 generates the first video according to the at least two photographed objects and each photographing-related object. The display module may be configured to display photographing-related information of the first video in response to the second input received by the receiving module; the photographing-related information is determined according to the photographing-related object.

[0148] In the video generation device provided in the embodiment of the present application, a first video can be generated by photographing the object and photographing the related objects, thereby enriching the video content and awakening the user's comprehensive and vivid memories.

[0149] The video generating device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0150] The video generation device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an IOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0151] The video generation device provided in the embodiment of the present application can implement each process implemented in the above method embodiment and achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0152] like Figure 8 As shown, an embodiment of the present application further provides an electronic device 100, including a processor 101 and a memory 102, wherein the memory 102 stores programs or instructions that can be executed on the processor 101, and when the program or instructions are executed by the processor 101, the various steps of the above-mentioned video generation method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0153] It should be noted that the electronic devices in the embodiments of the present application include mobile electronic devices and non-mobile electronic devices.

[0154] Fig. 9 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0155] like Fig. 9 As shown, the electronic device 1000 includes but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010 and other components.

[0156] Those skilled in the art will appreciate that the electronic device 1000 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1010 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig. 9 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0157] Among them, the processor 1010 can be used to obtain at least two photographed objects and shooting-related objects when shooting each photographed object; the shooting-related objects include audio files; and generate a first video based on the at least two photographed objects and each shooting-related object.

[0158] In a possible implementation, the processor 1010 may be specifically configured to determine background music according to each of the above-mentioned audio files; and generate a first video according to the above-mentioned at least two photographed objects and the background music.

[0159] In a possible implementation manner, the above-mentioned shooting-related objects may also include at least one of the following: shooting location, shooting time, physiological data, mood-related data, weather data, and conversation messages.

[0160] In a possible implementation, the processor 1010 may be specifically configured to determine multimedia materials according to each of the above-mentioned shooting-related objects; and generate a first video according to the above-mentioned at least two shot objects and the multimedia materials.

[0161] In a possible implementation, the similarity of shooting information of any two of the at least two shot objects may be greater than or equal to a similarity threshold; the shooting information includes at least one of the following: shooting time, shooting location, shooting object, shooting scene.

[0162] In one possible implementation, the processor 1010 may also be used to, after generating a first video based on the at least two photographed objects and each photographed-related object, play the first video in response to the first input when receiving a first input; or play the first video at a preset playback time.

[0163] In a possible implementation, the user input unit 1007 may be used to receive a second input after the processor 1010 generates the first video according to the at least two photographed objects and each photographing-related object. The display unit 1006 may be used to display photographing-related information of the first video in response to the second input received by the user input unit 1007; the photographing-related information is determined according to the photographing-related object.

[0164] In the electronic device provided in the embodiment of the present application, a first video can be generated by photographing the object and photographing the related objects, so as to enrich the video content and awaken the user's comprehensive and vivid memories.

[0165] It should be understood that in the embodiment of the present application, the input unit 1004 may include a graphics processor (Graphics Processing Unit, GPU) 10041 and a microphone 10042, and the graphics processor 10041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and at least one of other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0166] The memory 1009 can be used to store software programs and various data. The memory 1009 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1009 may include a volatile memory or a non-volatile memory, or the memory 1009 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1009 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0167] The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1010.

[0168] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned video generation method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0169] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0170] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned video generation method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0171] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0172] An embodiment of the present application provides a computer program / program product, which is stored in a storage medium. The program / program product is executed by at least one processor to implement the various processes of the above-mentioned video generation method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0173] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0174] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0175] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A video generation method, characterized in that: The method comprises: Acquire at least two photographed objects and photographing-related objects when photographing each of the photographed objects; the photographing-related objects include audio files; A first video is generated according to the at least two photographed objects and each of the photograph-related objects.

2. The method according to claim 1, characterized in that The step of generating a first video according to the at least two photographed objects and each of the photographed related objects includes: Determine the background music according to each of the audio files; The first video is generated according to the at least two photographed objects and the background music.

3. The method according to claim 1, characterized in that The shooting-related objects also include at least one of the following: shooting location, shooting time, physiological data, mood-related data, weather data, and conversation messages.

4. The method according to claim 3, characterized in that: The step of generating a first video according to the at least two photographed objects and each of the photographed related objects includes: Determining multimedia materials according to each of the shooting-related objects; The first video is generated according to the at least two photographed objects and the multimedia material.

5. The method according to claim 1, characterized in that The similarity of shooting information of any two of the at least two shot objects is greater than or equal to a similarity threshold; the shooting information includes at least one of the following: shooting time, shooting location, shooting object, and shooting scene.

6. The method according to any one of claims 1 to 5, characterized in that After generating the first video according to the at least two photographed objects and each of the photographed related objects, the method further includes: upon receiving a first input, playing the first video in response to the first input; or, At the preset playback time, the first video is played.

7. The method according to claim 1, characterized in that After generating the first video according to the at least two photographed objects and each of the photographed related objects, the method further includes: receiving a second input; In response to the second input, shooting-related information of the first video is displayed; the shooting-related information is determined according to the shooting-related object.

8. A video generating device, characterized in that: The device comprises an acquisition module and a generation module; The acquisition module is used to acquire at least two photographed objects and photographing-related objects when photographing each of the photographed objects; the photographing-related objects include audio files; The generating module is used to generate a first video according to the at least two photographed objects and each of the photograph-related objects acquired by the acquiring module.

9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the video generation method according to any one of claims 1 to 7 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores a program or an instruction, and when the program or the instruction is executed by the processor, the steps of the video generation method according to any one of claims 1 to 7 are implemented.

Images