Multimedia information interaction method and device, electronic equipment and medium

Abstract

The invention discloses a multimedia information interaction method and device, electronic equipment and a medium, and belongs to the technical field of image processing. The method provided by the embodiment of the invention comprises the following steps: receiving first input; generating a first video and at least one picture in response to the first input; wherein the picture is a picture shot in a shooting process of the first video; according to the shooting time of a video frame in the first video and the shooting time of the picture, a first identifier is added in a display interface of the first video frame, a second identifier is added in a display interface of the first picture, the first identifier is associated with the first picture, and the second identifier is associated with the first video frame; the first video frame is a video frame in the first video, and the first picture is a picture in the at least one picture.

Description

Technical Field

[0001] The present application belongs to the field of image processing technology, and specifically relates to a multimedia information interaction method, device, electronic device and medium. Background Art

[0002] In related technologies, video recording and photography have become essential tools for users to document their lives. Compared to separate recording or photography, the integrated recording and photography feature is simpler and more convenient. This technology allows users to capture still images while recording video. Current integrated recording and photography features utilize a dual-threaded storage mechanism, storing video and image streams independently. This separate storage approach makes it difficult for users to quickly locate the corresponding image based on video content, or vice versa. Summary of the Invention

[0003] The purpose of the embodiments of the present application is to provide a multimedia information interaction method, device, electronic device and medium, which can solve the problem that based on the existing recording and shooting function, users find it difficult to quickly locate the corresponding picture based on the video content or find it difficult to quickly locate the corresponding video content based on the picture.

[0004] In a first aspect, an embodiment of the present application provides a method for interacting with multimedia information, including:

[0005] receiving a first input;

[0006] generating a first video and at least one picture in response to the first input; wherein the picture is a picture taken during the shooting process of the first video;

[0007] According to the shooting time of the video frame in the first video and the shooting time of the picture, a first identifier is added to the display interface of the first video frame, and a second identifier is added to the display interface of the first picture. The first identifier is associated with the first picture, and the second identifier is associated with the first video frame. The first video frame is a video frame in the first video, and the first picture is a picture among the at least one picture.

[0008] In a second aspect, an embodiment of the present application provides a multimedia information interaction device, including:

[0009] A first receiving module, configured to receive a first input;

[0010] a first processing module, configured to generate a first video and at least one picture in response to the first input; wherein the picture is a picture taken during the shooting of the first video;

[0011] The second processing module is used to add a first identifier in the display interface of the first video frame and a second identifier in the display interface of the first picture according to the shooting time of the video frame in the first video and the shooting time of the picture, the first identifier is associated with the first picture, the second identifier is associated with the first video frame, the first video frame is a video frame in the first video, and the first picture is a picture among the at least one picture.

[0012] In a third aspect, an embodiment of the present application provides an electronic device comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0013] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0014] In a fifth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the method described in the first aspect.

[0015] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the method described in the first aspect.

[0016] In an embodiment of the present application, a first input is received; a first video and at least one picture are generated in response to the first input; a first identifier is added to the display interface of the first video frame and a second identifier is added to the display interface of the first picture based on the shooting time of the video frame in the first video and the shooting time of the picture, the first identifier is associated with the first picture, and the second identifier is associated with the first video frame, so that the user can quickly locate the first picture from the first video frame based on the first identifier, or quickly locate the first video frame from the first picture based on the second identifier, so that the user can quickly locate the corresponding picture based on the video content or quickly locate the corresponding video content based on the picture. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 1 is a flowchart of a multimedia information interaction method according to an embodiment of the present application;

[0018] Figure 2 Schematic diagram of video recording in an embodiment of the present application;

[0019] Figure 3This is a schematic diagram of the operation of the first interaction identifier in the display interface of the first video frame in an embodiment of the present application;

[0020] Figure 4 Schematic diagram of the operation of the thumbnail in the display interface of the first video frame in an embodiment of the present application;

[0021] Figure 5 Schematic diagram of jumping from the display interface of the first video frame to the display interface of the first recorded picture in an embodiment of the present application;

[0022] Figure 6 This is a schematic diagram of the operation of the second interactive identifier in the display interface of the first recorded picture in an embodiment of the present application;

[0023] Figure 7 2 is a schematic diagram of a display interface of a first recorded picture jumping to a display interface of a first video frame in an embodiment of the present application;

[0024] Figure 8 This is a schematic diagram of displaying a first interaction identifier in a playback progress bar in a display interface of a first video frame in an embodiment of the present application;

[0025] Figure 9 This is a schematic diagram of a module of a multimedia information interaction device according to an embodiment of the present application;

[0026] Figure 10 This is one of the structural block diagrams of the electronic device in the embodiment of the present application;

[0027] Figure 11 This is the second structural block diagram of the electronic device in the embodiment of the present application. DETAILED DESCRIPTION

[0028] The following will be combined with the accompanying drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the embodiments described are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.

[0029] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than that illustrated or described herein, and that the objects distinguished by "first," "second," and the like are generally of the same type, and do not limit the number of objects; for example, the first object can be one or more. In addition, the term "and / or" in the specification and claims refers to at least one of the connected objects, and the character " / " generally indicates that the objects connected are in an "or" relationship.

[0030] The multimedia information interaction method provided by the embodiment of the present application is described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

[0031] like Figure 1 As shown, the embodiment of the present application provides a multimedia information interaction method, including:

[0032] Step 101: Receive a first input;

[0033] The first input in the embodiment of the present application includes video input and shooting input. Figure 2 As shown, after the camera is started, it receives the video input of the record button 201, performs video recording processing according to the video input, and then receives the shooting input of the record button 201, and performs picture shooting processing according to the shooting input.

[0034] The aforementioned recording and shooting inputs can be user inputs such as click inputs or long press inputs, or can also be voice commands. For example, after the camera is activated, it receives a user recording input, which is a click input, and then receives a user shooting input, which is a voice command, and performs image capture processing based on the voice command. Step 102: Generate a first video and at least one image in response to the first input; wherein the image is an image captured during the shooting of the first video.

[0035] The first video in the embodiment of the present application can also be described as a recorded video, and the above-mentioned pictures can also be described as recorded pictures.

[0036] In an embodiment of the present application, after the above-mentioned recorded video and recorded pictures are generated, the recorded video and recorded pictures are stored independently.

[0037] Step 103: According to the shooting time of the video frame in the first video and the shooting time of the picture, a first identifier is added to the display interface of the first video frame, and a second identifier is added to the display interface of the first picture, the first identifier is associated with the first picture, and the second identifier is associated with the first video frame. The first video frame is a video frame in the first video, and the first picture is a picture among the at least one picture.

[0038] As an implementation manner, the first identifier is associated with at least one of a storage address, an image identifier, or a shooting time of the first image. The identifier information of the first image may be a name or an index of the first image.

[0039] As an implementation, the second identifier is associated with at least one of a storage address of the first video frame, a video frame identifier, a timestamp of the video frame, and a playback time of the video frame. The identifier information of the first video frame can be determined based on the identifier of the recorded video and the index or name of the first video frame. The index of the first video frame is used to indicate the position or order of the first video frame in the recorded video.

[0040] In this embodiment of the present application, the first image is a picture taken when the first video frame was recorded, that is, the shooting time of the first image corresponds to the same time as the recording time of the first video frame. The first identifier or the second identifier is used to associate the first video frame and the first image in time and storage space, making it easier for users to link video content with recorded images.

[0041] In the above scheme of the embodiment of the present application, a first input is received; a first video and at least one picture are generated in response to the first input; a first identifier is added to the display interface of the first video frame and a second identifier is added to the display interface of the first picture according to the shooting time of the video frame in the first video and the shooting time of the picture, the first identifier is associated with the first picture, and the second identifier is associated with the first video frame, so that the user can quickly locate the first picture from the first video frame based on the first identifier, or quickly locate the first video frame from the first picture based on the second identifier, so that the user can quickly locate the corresponding picture based on the video content or quickly locate the corresponding video content based on the picture.

[0042] In some embodiments of the present application, the multimedia information interaction method further includes:

[0043] receiving a second input of the first identifier; updating the display interface of the first video frame to the display interface of the first picture in response to the second input; and / or,

[0044] A third input of the second identifier is received; and in response to the third input, the display interface of the first picture is updated to the display interface of the first video frame.

[0045] The second input or the third input may be a click input or a long press input, etc., which is not specifically limited in this application. Of course, the second input or the third input may also be a voice input command.

[0046] In some embodiments of the present application, after receiving the second input, the first image associated with the first identifier is obtained and then displayed, or after receiving the third input, the first video frame associated with the second identifier is obtained and then the video content of the first video frame is displayed. Exemplarily, after receiving the second input, the first image is obtained by retrieving the storage address, image identifier, or shooting time of the first image associated with the first identifier, and after receiving the third input, the first video frame is obtained by retrieving the storage address, timestamp, or identifier of the first video frame associated with the second identifier.

[0047] For example, the current display interface is the display interface of the first video frame, and a first identifier is displayed in the display interface. After receiving a click input on the above-mentioned first identifier, the storage address of the picture associated with the first identifier is retrieved as address A, and the address A is the storage address of the first picture. The first picture is found based on the address A, and then the display interface of the first video frame is updated to the display interface of the first picture, thereby achieving the purpose of quickly locating the corresponding picture based on the video content.

[0048] For another example, the current display interface is the display interface of the first video frame, and a first identifier is displayed in the display interface. After receiving a long press input of the above-mentioned first identifier, the picture identifier associated with the first identifier is retrieved as the first picture identifier. The first picture identifier is the identifier of the first picture. The first picture is found based on the first picture identifier, and then the display interface of the first video frame is updated to the display interface of the first picture, thereby achieving the purpose of quickly locating the corresponding picture based on the video content.

[0049] For another example, the current display interface is the display interface of the first picture, and a second identifier is displayed in the display interface. After receiving a click input on the above-mentioned second identifier, the second identifier is retrieved and associated with the first video storage path and the first timestamp. The first video is found based on the first video storage path, and then the first video frame in the first video is obtained based on the first timestamp. Then, the display interface of the first picture is updated to the display interface of the first video frame.

[0050] For another example, the current display interface is the display interface of the first image, and a second identifier is displayed in the display interface. After receiving a click input on the second identifier, the second identifier is retrieved and associated with the first video storage path and the first video frame identifier. The first video is found based on the first video storage path, and then the first video frame in the first video is obtained based on the first video frame identifier. Then, the display interface of the first image is updated to the display interface of the first video frame. The first video frame identifier can be an index or identifier of a video frame.

[0051] In an embodiment of the present application, through the above-mentioned first identifier and second identifier, it is possible to switch between the display interface of the first video frame and the display interface of the first picture, which is convenient for the user to quickly retrieve the corresponding picture based on the first video frame, or quickly retrieve the corresponding video content based on the picture, thereby improving the retrieval efficiency.

[0052] In some embodiments of the present application, updating the display interface of the first video frame to the display interface of the first picture in response to the second input includes:

[0053] displaying a thumbnail of the first picture in a display interface of the first video frame in response to the second input;

[0054] receiving a fourth input of a thumbnail of the first image;

[0055] In response to the fourth input, the display interface of the first video frame is updated to the display interface of the first picture.

[0056] In some implementations, the thumbnail is a low-resolution image generated after decoding the image.

[0057] like Figure 3 As shown, after receiving the second input of the first identifier 301, the thumbnail of the first picture is displayed in a suspended manner in the display interface of the first video frame, and supports dragging and positioning, as shown in FIG. Figure 3 As shown, the thumbnail of the first picture is the target picture 302. Figure 4 As shown, receiving a fourth input of a thumbnail of the first picture, such as Figure 5 As shown, jump to the display interface of the first picture.

[0058] In some implementations of the present application, the thumbnail of the first image may be displayed in a floating position on a preset position on the display interface of the first video frame. The preset position may be adjusted according to user needs. For example, the preset position may be a position on the display interface of the first video frame where the video content is not displayed to avoid blocking the displayed content of the video frame, or the preset position may be a position near a progress bar on the display interface of the first video frame. For example, the preset position may be a position above or below the first indicator on the first progress bar on the display interface of the first video frame.

[0059] The purpose of jumping from the display interface of the first video frame to the display interface of the first picture is achieved through the above-mentioned first identifier and the above-mentioned thumbnail.

[0060] In addition, if Figure 6 As shown, the user receives the third input of the second identifier 601 in the display interface of the first picture, and then jumps to Figure 7 The display interface of the first video frame is shown. Figure 6The second logo is taken as a camera logo as an example for explanation. Of course, the second logo can also be a logo of other shapes, and this application does not make specific limitations on this.

[0061] In some embodiments of the present application, adding a first identifier to the display interface of the first video frame includes:

[0062] The first identifier is displayed at the first position of the play progress bar in the display interface of the first video frame, wherein the first position is the position in the play progress bar corresponding to the display time of the first video frame. Figure 8 As shown, the first identifier 301 is a diamond-shaped control, and multiple diamond-shaped controls are displayed in the playback progress bar 801, each diamond-shaped control corresponds to a video frame, and each diamond-shaped control is associated with a picture. It can be understood that the present application includes multiple pairs of associated video frames and pictures. For example, the first diamond-shaped control corresponds to the first video frame, and the first diamond-shaped control is associated with the first picture, the second diamond-shaped control corresponds to the second video frame, and the second diamond-shaped control is associated with the second picture. Of course, the first identifier in the present application can also be a control of other shapes, and the present application does not make specific limitations on this.

[0063] By displaying the first identifier at the first position of the playback progress bar, the purpose of associating the first identifier with the timestamp of the first video frame is achieved, thereby facilitating the subsequent interaction between the display interface of the first video frame and the display interface of the first picture based on the first identifier.

[0064] In some embodiments of the present application, the display interface of each video frame of the first video includes a timestamp corresponding to the video frame;

[0065] The display interface of the picture includes the shooting time of the picture.

[0066] Exemplarily, when playing a recorded video, the timestamp is converted into a dynamic horizontal display on the video frame, and the video frame is identified by the timestamp and the time in the play progress bar.

[0067] In the embodiment of the present application, when generating the first video and picture, the timestamp is retained in the video frame and the shooting time is retained in the picture, so that the video frame and the picture can be subsequently associated based on the timestamp and shooting time. The associated video frame and picture can be understood as the video frame timestamp and the picture shooting time corresponding to the same time.

[0068] In some embodiments of the present application, adding a first identifier to the display interface of the first video frame and adding a second identifier to the display interface of the first picture based on the shooting time of the video frame in the first video and the shooting time of the picture includes:

[0069] Determining a first video frame and a first picture according to a shooting time of a video frame in the first video and a shooting time of the picture; wherein a first shooting time of the first video frame is associated with a second shooting time of the picture;

[0070] The first identifier is added to the display interface of the first video frame, and the second identifier is added to the display interface of the first picture.

[0071] For example, the shooting time of the above-mentioned first video frame is time A, the shooting time of the second video frame is time B, and the shooting time of the first picture is time A, then it is determined that the first video frame is associated with the first picture, the second video frame is associated with the second picture, the first identifier is added to the display interface of the first video frame, and the second identifier is added to the display interface of the first picture.

[0072] The shooting time of the first video frame can be determined based on the timestamp of the first video frame or the playing time of the progress bar in the first video frame display interface. The shooting time of the first picture can be determined based on the shooting time in the first picture display interface.

[0073] Here, based on the shooting time corresponding to the video frame and the shooting time corresponding to the picture, the mutually associated first video frame and first picture are determined, so as to subsequently display the first logo in the display interface of the first video frame and display the second logo in the first picture.

[0074] Through the above-mentioned scheme of the embodiment of the present application, a multi-dimensional association channel between recorded videos and recorded pictures is established. Through the first identifier in the display interface of the video frame and the second identifier in the picture display interface, users can be assisted to quickly locate related pictures or video content, effectively improving the retrieval rate of video content or recorded pictures, which is conducive to meeting real-time interaction needs.

[0075] The multimedia information interaction method provided in the embodiment of the present application can be executed by a multimedia information interaction device. In the embodiment of the present application, the multimedia information interaction method performed by a multimedia information interaction device is taken as an example to illustrate the multimedia information interaction device provided in the embodiment of the present application.

[0076] like Figure 9 As shown, the embodiment of the present application further provides a multimedia information interaction device 900, including:

[0077] A first receiving module 901 is configured to receive a first input;

[0078] A first processing module 902 is configured to generate a first video and at least one picture in response to the first input; wherein the picture is a picture taken during the shooting of the first video;

[0079] The second processing module 903 is used to add a first identifier in the display interface of the first video frame and a second identifier in the display interface of the first picture according to the shooting time of the video frame in the first video and the shooting time of the picture, the first identifier is associated with the first picture, the second identifier is associated with the first video frame, the first video frame is a video frame in the first video, and the first picture is a picture among the at least one picture.

[0080] The multimedia information interaction device of the embodiment of the present application further includes:

[0081] a second receiving module for receiving a second input of the first identifier; a third processing module for jumping from the display interface of the first video frame to the display interface of the first picture according to the first input of the first identifier; and / or

[0082] The third receiving module is configured to receive a third input of the second identifier; and the fourth processing module is configured to update the display interface of the first picture to the display interface of the first video frame in response to the third input.

[0083] In the multimedia information interaction device according to the embodiment of the present application, the third processing module is configured to:

[0084] displaying a thumbnail of the first picture in a display interface of the first video frame in response to the second input;

[0085] receiving a fourth input of a thumbnail of the first image;

[0086] In response to the fourth input, the display interface of the first video frame is updated to the display interface of the first picture.

[0087] In the multimedia information interaction device according to the embodiment of the present application, the second processing module is configured to:

[0088] The first identifier is displayed at a first position of a play progress bar in a display interface of the first video frame, wherein the first position is a position in the play progress bar corresponding to a display time of the first video frame.

[0089] In the multimedia information interaction device of the embodiment of the present application, the display interface of each video frame of the first video includes a timestamp corresponding to the video frame;

[0090] The display interface of the picture includes the shooting time of the picture.

[0091] In the multimedia information interaction device according to the embodiment of the present application, the second processing module is configured to:

[0092] Determining a first video frame and a first picture according to a shooting time of a video frame in the first video and a shooting time of the picture; wherein a first shooting time of the first video frame is associated with a second shooting time of the picture;

[0093] The first identifier is added to the display interface of the first video frame, and the second identifier is added to the display interface of the first picture.

[0094] In an embodiment of the present application, a first input is received; a first video and at least one picture are generated in response to the first input; a first identifier is added to the display interface of the first video frame and a second identifier is added to the display interface of the first picture based on the shooting time of the video frame in the first video and the shooting time of the picture, the first identifier is associated with the first picture, and the second identifier is associated with the first video frame, so that the user can quickly locate the first picture from the first video frame based on the first identifier, or quickly locate the first video frame from the first picture based on the second identifier, so that the user can quickly locate the corresponding picture based on the video content or quickly locate the corresponding video content based on the picture.

[0095] The multimedia information interaction device in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices other than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not specifically limit it.

[0096] The multimedia information interaction device in the embodiment of the present application can be a device with an operating system. The operating system can be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0097] The multimedia information interaction device provided in the embodiment of the present application can achieve Figures 1 to 8 To avoid repetition, the various processes implemented in the method embodiment are not described here.

[0098] Alternatively, as Figure 10 As shown, an embodiment of the present application also provides an electronic device 1000, including a processor 1001 and a memory 1002, wherein the memory 1002 stores a program or instruction that can be run on the processor 1001, and when the program or instruction is executed by the processor 1001, the various steps of the above-mentioned multimedia information interaction method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0099] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0100] Figure 11 A schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

[0101] The electronic device 1100 includes but is not limited to components such as a radio frequency unit 1101 , a network module 1102 , an audio output unit 1103 , an input unit 1104 , a sensor 1105 , a display unit 1106 , a user input unit 1107 , an interface unit 1108 , a memory 1109 , and a processor 1110 .

[0102] Those skilled in the art will understand that the electronic device 1100 may also include a power source (such as a battery) to power each component, and the power source may be logically connected to the processor 1110 through a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system. Figure 11 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be repeated here.

[0103] Among them, the processor 1110 is used to receive a first input; generate a first video and at least one picture in response to the first input; wherein the picture is a picture taken during the shooting process of the first video; according to the shooting time of the video frame in the first video and the shooting time of the picture, add a first identifier in the display interface of the first video frame, and add a second identifier in the display interface of the first picture, the first identifier is associated with the first picture, the second identifier is associated with the first video frame, the first video frame is a video frame in the first video, and the first picture is a picture among the at least one picture.

[0104] In the embodiment of the present application, the processor 1110 is further configured to:

[0105] receiving a second input of the first identifier; updating the display interface of the first video frame to the display interface of the first picture in response to the second input; and / or,

[0106] A third input of the second identifier is received; and in response to the third input, the display interface of the first picture is updated to the display interface of the first video frame.

[0107] In the embodiment of the present application, the processor 1110 is further configured to:

[0108] displaying a thumbnail of the first picture in a display interface of the first video frame in response to the second input;

[0109] receiving a fourth input of a thumbnail of the first image;

[0110] In response to the fourth input, the display interface of the first video frame is updated to the display interface of the first picture.

[0111] In the embodiment of the present application, the processor 1110 is further configured to:

[0112] The first identifier is displayed at a first position of a play progress bar in a display interface of the first video frame, wherein the first position is a position in the play progress bar corresponding to a display time of the first video frame.

[0113] In the embodiment of the present application, the display interface of each video frame of the first video includes a timestamp corresponding to the video frame;

[0114] The display interface of the picture includes the shooting time of the picture.

[0115] In the embodiment of the present application, the processor 1110 is further configured to:

[0116] Determining a first video frame and a first picture according to a shooting time of a video frame in the first video and a shooting time of the picture; wherein a first shooting time of the first video frame is associated with a second shooting time of the picture;

[0117] The first identifier is added to the display interface of the first video frame, and the second identifier is added to the display interface of the first picture.

[0118] In an embodiment of the present application, a first input is received; a first video and at least one picture are generated in response to the first input; a first identifier is added to the display interface of the first video frame and a second identifier is added to the display interface of the first picture based on the shooting time of the video frame in the first video and the shooting time of the picture, the first identifier is associated with the first picture, and the second identifier is associated with the first video frame, so that the user can quickly locate the first picture from the first video frame based on the first identifier, or quickly locate the first video frame from the first picture based on the second identifier, so that the user can quickly locate the corresponding picture based on the video content or quickly locate the corresponding video content based on the picture.

[0119] It should be understood that in an embodiment of the present application, the input unit 1104 may include a graphics processing unit (GPU) 11041 and a microphone 11042, and the graphics processor 11041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 1106 may include a display panel 11061, and the display panel 11061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1107 includes a touch panel 11071 and at least one of other input devices 11072. The touch panel 11071 is also called a touch screen. The touch panel 11071 may include two parts: a touch detection device and a touch controller. Other input devices 11072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and an operating stick, which will not be repeated here.

[0120] The memory 1109 can be used to store software programs and various data. The memory 1109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 1109 may include a volatile memory or a non-volatile memory, or the memory 1109 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DRRAM). The memory 1109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0121] Processor 1110 may include one or more processing units. Optionally, processor 1110 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 1110.

[0122] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned multimedia information interaction method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0123] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0124] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned multimedia information interaction method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0125] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0126] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned multimedia information interaction method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0127] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0128] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0129] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.

Claims

1. A multimedia information interaction method, characterized in that: include: receiving a first input; generating a first video and at least one picture in response to the first input; wherein the picture is a picture taken during the shooting process of the first video; According to the shooting time of the video frame in the first video and the shooting time of the picture, a first identifier is added to the display interface of the first video frame, and a second identifier is added to the display interface of the first picture. The first identifier is associated with the first picture, and the second identifier is associated with the first video frame. The first video frame is a video frame in the first video, and the first picture is a picture among the at least one picture.

2. The multimedia information interaction method according to claim 1, characterized in that: Also includes: receiving a second input of the first identifier; updating the display interface of the first video frame to the display interface of the first picture in response to the second input; and / or, A third input of the second identifier is received; and in response to the third input, the display interface of the first picture is updated to the display interface of the first video frame.

3. The multimedia information interaction method according to claim 2, characterized in that: The updating, in response to the second input, the display interface of the first video frame to the display interface of the first picture includes: displaying a thumbnail of the first picture in a display interface of the first video frame in response to the second input; receiving a fourth input of a thumbnail of the first image; In response to the fourth input, the display interface of the first video frame is updated to the display interface of the first picture.

4. The multimedia information interaction method according to any one of claims 1 to 3, characterized in that: Adding a first identifier to the display interface of the first video frame includes: The first identifier is displayed at a first position of a play progress bar in a display interface of the first video frame, wherein the first position is a position in the play progress bar corresponding to a display time of the first video frame.

5. The multimedia information interaction method according to claim 1, characterized in that: The display interface of each video frame of the first video includes a timestamp corresponding to the video frame; The display interface of the picture includes the shooting time of the picture.

6. The multimedia information interaction method according to claim 1 or 5, characterized in that: The adding a first identifier to the display interface of the first video frame and adding a second identifier to the display interface of the first picture according to the shooting time of the video frame in the first video and the shooting time of the picture includes: Determining a first video frame and a first picture according to a shooting time of a video frame in the first video and a shooting time of the picture; wherein a first shooting time of the first video frame is associated with a second shooting time of the picture; The first identifier is added to the display interface of the first video frame, and the second identifier is added to the display interface of the first picture.

7. A multimedia information interactive device, characterized in that: include: A first receiving module, configured to receive a first input; a first processing module, configured to generate a first video and at least one picture in response to the first input; wherein the picture is a picture taken during the shooting of the first video; The second processing module is used to add a first identifier in the display interface of the first video frame and a second identifier in the display interface of the first picture according to the shooting time of the video frame in the first video and the shooting time of the picture, the first identifier is associated with the first picture, the second identifier is associated with the first video frame, the first video frame is a video frame in the first video, and the first picture is a picture among the at least one picture.

8. The multimedia information interactive device according to claim 7, characterized in that: Also includes: A second receiving module, configured to receive a second input of the first identifier; a third processing module, configured to jump from the display interface of the first video frame to the display interface of the first picture according to a first input of the first identifier; and / or, A third receiving module, configured to receive a third input of the second identifier; A fourth processing module is configured to update the display interface of the first picture to the display interface of the first video frame in response to the third input.

9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the multimedia information interaction method according to any one of claims 1 to 6 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the multimedia information interaction method according to any one of claims 1 to 6 are implemented.

Images