Media data generation method, apparatus, device, medium, and product

Abstract

The method comprises the following steps: in response to receiving a first triggering operation of generating media data, displaying a shooting page to present preview media data in a field of view collection range in the shooting page; in response to a second triggering operation in the shooting page, displaying acquired first media data and at least part of the preview media data in the shooting page; and in response to detecting that a condition of generating second media data is met, generating the second media data based on at least two first media data. The technical scheme provided by the embodiment of the application achieves the following effects: after shooting the first media data, the first media data is displayed in the shooting page, and the preview media data can also be displayed, and after synthesizing the second media data based on all the shot first media data, the second media data generation process is visible, and the richness of picture content is improved.

Description

Technical Field

[0001] This disclosure relates to the field of image processing technology, and more particularly to a media data generation method, apparatus, device, medium, and product. Background Technology

[0002] More and more users are using smart devices with camera functions to record their lives, optionally through video or images.

[0003] In existing technologies, only the captured content can be displayed after an image is taken. When multiple images need to be combined into a single image, existing image processing software is required to stitch the captured images, resulting in poor real-time performance. Furthermore, displaying multiple images in the same frame using the above method requires first selecting a stitching template and then choosing the images to be stitched from an image library, which is cumbersome, complex, and inefficient. Summary of the Invention

[0004] This disclosure provides a media data generation method, apparatus, device, medium, and product to make the media data generation process visible and to display multiple images corresponding to different acquisition times in a single frame in real time, thereby improving the richness of the screen content and greatly satisfying user needs.

[0005] In a first aspect, embodiments of this disclosure provide a media data generation method, the method comprising:

[0006] In response to receiving a first trigger operation that generates media data, a shooting page is displayed to present a preview of the media data within the field of view.

[0007] In response to a second trigger operation on the shooting page, the acquired first media data and at least a portion of the preview media data are displayed on the shooting page according to page layout information; wherein, the page layout information is used to characterize the display position of the first media data on the shooting page;

[0008] In response to detecting that the conditions for generating second media data are met, the second media data is generated based on at least two of the first media data.

[0009] Secondly, embodiments of this disclosure also provide a media data generation apparatus, the apparatus comprising:

[0010] The preview media data display module is used to display the shooting page in response to the first trigger operation of receiving generated media data, so as to present the preview media data within the field of view on the shooting page;

[0011] A media data display module is used to respond to a second trigger operation on the shooting page and display the acquired first media data and at least a partial preview of the media data on the shooting page according to the page layout information; wherein, the page layout information is used to characterize the display position of the first media data on the shooting page;

[0012] A media data synthesis module is configured to generate second media data based on at least two pieces of first media data in response to detecting that conditions for generating second media data are met.

[0013] Thirdly, embodiments of this disclosure also provide an electronic device, the electronic device comprising:

[0014] One or more processors;

[0015] Storage device for storing one or more programs.

[0016] When the one or more programs are executed by the one or more processors, the one or more processors implement the media data generation method as described in any of the embodiments of this disclosure.

[0017] Fourthly, embodiments of this disclosure also provide a storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to perform the media data generation method as described in any of the embodiments of this disclosure.

[0018] Fifthly, embodiments of this disclosure also provide a computer program product, including a computer program that, when executed by a processor, implements the media data generation method as described in any of the embodiments of this disclosure.

[0019] The technical solution provided in this disclosure, in response to a first trigger operation that generates media data, displays a shooting page to present preview media data within the field of view. During the display of preview media data, if some preview media data is of interest, a second trigger operation on the shooting page can be performed to display the acquired first media data and continue displaying at least a portion of the media preview data. When the conditions for generating second media data are detected, second media data is generated based on at least two acquired first media data. It should be noted that the final generated second media data is simply data generated based on the first media data. This solves the problem in the prior art where a camera device can only capture and display one image, resulting in a single image content that cannot meet the user's requirements for diverse and rich image content. The solution achieves the goal of displaying not only the captured first media data but also preview media data on the shooting page. Furthermore, when the conditions for generating second media data are detected, multiple images can be displayed on a single page, thereby improving the richness and personalization of the image content. Attached Figure Description

[0020] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.

[0021] Figure 1 This is a schematic flowchart of a media data generation method provided in an embodiment of this disclosure;

[0022] Figure 2 This is a schematic diagram of the shooting page displayed after the first triggering operation, provided in an embodiment of this disclosure;

[0023] Figure 3 This is the shooting page corresponding to the second trigger operation provided in the embodiments of this disclosure;

[0024] Figure 4 A schematic flowchart illustrating a media data generation method provided in an embodiment of this disclosure;

[0025] Figure 5 This is a schematic diagram of an interface provided in an embodiment of the present invention;

[0026] Figure 6 A schematic flowchart illustrating a media data generation method provided in an embodiment of this disclosure;

[0027] Figure 7 This is a schematic diagram of an interface provided in an embodiment of the present disclosure;

[0028] Figure 8 A schematic flowchart illustrating a media data generation method provided in an embodiment of this disclosure;

[0029] Figure 9 A schematic flowchart illustrating a media data generation method provided in an embodiment of this disclosure;

[0030] Figure 10 This is a schematic diagram of the structure of a media data generation apparatus provided in an embodiment of the present disclosure;

[0031] Figure 11 This is a schematic diagram of an electronic device structure provided in an embodiment of the present disclosure. Detailed Implementation

[0032] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0033] It should be understood that the steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.

[0034] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.

[0035] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0036] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0037] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0038] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0039] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the electronic device, application, server, or storage medium performing the operations of this disclosed technical solution, based on the prompt message.

[0040] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0041] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0042] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0043] Before introducing the technical solutions provided in the embodiments of this disclosure, the application scenarios can be illustrated by example.

[0044] The technical solutions provided in this disclosure can be applied to any scenario where media data can be generated. Optionally, the solutions provided in this disclosure can be integrated as a functional module into any existing application software capable of image and video capture. In practical applications, if the functional module in the application is triggered, the final second media data can be generated based on the solutions provided in this disclosure.

[0045] Of course, the solution provided in this embodiment can also be displayed as a special effects prop in an application software with shooting functionality. The special effects prop can be displayed as an icon in the application, which can be a thumbnail pre-set for the special effects prop, corresponding to the display effect of the special effects prop. When a trigger operation on the icon is detected, the corresponding special effects resource is retrieved to generate second media data based on the special effects resource.

[0046] Alternatively, the solution provided in the embodiments of the present invention can be integrated as a function into software with video chat capabilities. During video chat, if the function module is triggered, second media data can be obtained based on the solution provided in the embodiments of the present invention.

[0047] It should be noted that the apparatus for executing the media data generation method provided in this embodiment can be integrated into application software that supports image processing functions, and this software can be installed on an electronic device, optionally a mobile terminal or a PC. The application software can be a type of software for image / video processing; specific application software will not be detailed here, as long as it can perform image / video processing. Alternatively, it can be a specially developed application program to generate media data, or it can be integrated into a corresponding page, allowing users to generate the corresponding media data through the integrated page on the PC.

[0048] Figure 1 This is a flowchart illustrating a media data generation method provided in an embodiment of the present disclosure. This embodiment is applicable to scenarios where a shooting page can not only display real-time captured media data but also continue to display previewed media data, and finally generate second media data based on the first real-time captured media data. The method can be executed by a media data generation device, which can be implemented in the form of software and / or hardware, and optionally, by an electronic device, such as a mobile terminal, a PC, or a server.

[0049] like Figure 1 As shown, the method in this embodiment may specifically include:

[0050] S110, In response to receiving a first trigger operation that generates media data, display a shooting page to present preview media data within the field of view on the shooting page.

[0051] Specifically, when a triggering operation is detected in the application for a functional control corresponding to the embodiments of this disclosure, or when a triggering operation is detected in the application for a special effect prop, it indicates that the first triggering operation has been triggered. Therefore, the first triggering operation is generated based on the triggering operation of a physical control displayed on the screen. Of course, in practical applications, it can also be determined based on the triggering operation of a non-physical control. Optionally, when the shooting interface is active, the first triggering operation is determined to be triggered when the display duration corresponding to the special effect prop reaches a preset duration threshold.

[0052] Alternatively, if the function module is detected to be triggered during a video call, it indicates that the first trigger operation has been triggered.

[0053] It should also be noted that the first trigger operation can also be based on a shortcut. Optionally, the shortcut can be triggered based on audio information or based on the gesture information swiped on the terminal device.

[0054] In response to the first trigger operation, the terminal device's built-in camera can be invoked to display the captured page when the camera is activated. This can be understood as the page presented on the terminal device being the captured page. In other words, the captured page is the page displayed on the screen after the camera is invoked. The display size of this page is typically consistent with the size of the terminal device's screen.

[0055] It should be noted that the camera device has the function of capturing screen content, and can continuously capture and display images even without triggering the shooting control, that is, continuously outputting image frames, which can be used as preview media data.

[0056] It should also be noted that the terminal device can be a handheld device. While the handheld device is being moved, it can capture image content within different field-of-view ranges and display it on the terminal. Of course, the camera device can include a front-end capture module and a rear-end capture module, and the user can determine whether to activate the front-end or rear-end capture module according to actual needs. Regardless of whether a front-end or rear-end capture method is used, the second media data can be generated based on the solution provided in the embodiments of this disclosure.

[0057] For example, taking the integration of the solution provided in this disclosure embodiment into a special effects prop as an example, when a triggering operation on the special effects prop is detected, it is considered that the first triggering operation has been triggered. At this time, the camera device carried by the terminal device can be activated. Based on the preview media data of the field of view collected by the camera device, see [link to relevant documentation]. Figure 2 It can continuously display and preview media data on the shooting page.

[0058] S120, in response to a second trigger operation on the shooting page, displays the acquired first media data and at least a portion of the preview media data on the shooting page based on the page layout information.

[0059] The second triggering operation corresponds to the operation of capturing the first media data. Optionally, the second triggering operation is a click operation on the capturing control; or, the second triggering operation is a preset gesture operation for capturing an image. In this case, the preset gesture operation can be an operation on the display screen, or an operation that determines the existence of a preset gesture based on the analysis of the preview media data; or, the second triggering operation corresponds to an operation in which the captured audio information includes the intention or instruction to capture the first media data. In this embodiment, whether the second triggering operation has been triggered can be determined based on at least one of the above methods.

[0060] In this embodiment, the first media data can be video data or image data. The first media data is data captured by the camera device after the second trigger operation is triggered. That is, the first media data is image data captured by the camera device or recorded video data when the second trigger operation is triggered. The first media data can be displayed on the shooting page; that is, the shooting page includes at least one area for carrying the first media data.

[0061] To achieve real-time data stitching, while displaying the first media data, preview media data can continue to be collected using the camera device. This facilitates timely determination of whether the first media data needs to be collected again. At least part of the preview media data can be all the media data collected by the camera device, or it can be only the media data not covered by the first media data.

[0062] In this embodiment, the method of displaying at least a portion of the preview media data can be:

[0063] If the first media data and the preview media data are located on the same display layer, in order to achieve a comprehensive data display effect, the first media data occupies a certain display area on the shooting page. At this time, the content of the continuously captured first part of the preview media data is obscured, while the second part of the preview media data can continue to be displayed on the shooting page. See [link to relevant documentation]. Figure 3 This method can display not only the initial media data acquired by the user, but also the continuously output media data, making it easier for the shooting user to determine the initial media data for the next shot based on the harmony of the image, thereby meeting the user's personalized needs.

[0064] If the primary media data and the preview media data are located on different display layers, to clearly understand the captured primary media data, the layer displaying the primary media data can be located on the top layer, i.e., the side closest to the display screen. The layer displaying the shooting page should be located on the side furthest from the screen. In this case, all preview media content can be displayed on the shooting page. Since the primary media data is located on top of the preview media data, part of the preview media data can be obscured, while the remaining preview media data can be displayed on the shooting page.

[0065] Of course, in order to make it easier for users to understand the preview media content in a timely manner, the preview data display area can be determined based on the area where the first media data is displayed and the total display area of ​​the shooting page. The preview media data can then be compressed based on the preview display area to achieve the effect of displaying all the preview media data.

[0066] When displaying the first media data on the shooting page, it's necessary to determine its display position and area. This can be done based on the page layout information. The page layout information includes the display position and area of ​​the first media data captured the first time, the display position and area of ​​the first media data captured subsequently, and so on, up to the display position and area of ​​the first media data captured the last time. Based on the page layout information, the first media data captured each time can be presented in the corresponding display area of ​​the shooting page.

[0067] Specifically, during the process of displaying preview media data on the shooting page, if a second trigger operation to acquire the first media data is detected, an image or video can be captured using the camera device to obtain the first media data. After acquiring the first media data, the display position and area of ​​the captured first media data on the shooting page can be determined based on the page layout information, and the first media data can be displayed. Simultaneously, the preview media data collected by the camera device continues to be displayed in areas of the shooting page not displaying the first media data.

[0068] It should be noted that while displaying the first media data and previewing the media data on the shooting page, if a second trigger operation to acquire the first media data is detected again, the first media data can be captured again. Based on the page layout information, the newly acquired first media data is displayed on the shooting page, while the previewing media data continues to be displayed in areas not displaying the first media data. This process can be repeated until an event satisfying the requirement to display the second media data is detected.

[0069] Based on the above, it is known that the first media data can be collected multiple times and displayed on the shooting page. At the same time, the preview media data can be displayed in areas where the first media data is not displayed.

[0070] For example, when the shooting control on the shooting page is detected for the first time, the backend considers it to have triggered a first trigger operation to acquire first media data. At this time, the first media data can be acquired, and at least a portion of the preview media data continues to be displayed, as shown in the figure. When the shooting control on the shooting page is detected again, the first media data can be acquired again, and based on the original first media data, the second acquired first media data can be displayed. Preview media data is displayed in areas not displaying the first media data. The above operation can be repeated until the conditions for generating second media data are met. At this time, the image captured by the shooting device is a full-screen image, and the image displayed is also a full-screen image, except that some of the preview media data is covered by the first media data.

[0071] S130. In response to detecting that the conditions for generating second media data are met, the second media data is generated based on at least two of the first media data.

[0072] In this embodiment, the conditions for generating the second media data can be at least one of the following:

[0073] The system detects that the number of times the first media data has been collected has reached a preset threshold; it also collects a wake word including preset words, which are used to represent the words to be used to generate the second media data; it collects preset facial features, which are features used to generate the second media data, and optionally, the preset facial features are eyebrow-raising adjustments; and it collects preset gestures or poses. The preset threshold is determined based on the number of display areas in the page layout information, that is, the preset threshold is consistent with the number of display areas in the page layout information.

[0074] Here, "at least two of the first media data" can be understood as meaning that the first media data is collected two or more times. The second media data is data synthesized based on at least two of the first media data. Optionally, when the first media data is an image or video, the second media data displayed on the shooting page is data composed of multiple first media data.

[0075] It should be noted that after acquiring the first media data each time, the first media data can be displayed in the corresponding position on the shooting page. Correspondingly, when the conditions for generating the second media data are met, the second media data can be directly generated based on at least two pieces of the first media data and presented on the shooting page. That is to say, the second media data is either the final synthesized image data, or it includes data of the video played in each display area, the content of which is related to the acquired first media data.

[0076] Specifically, when the conditions for generating second media data are met, second media data can be generated directly based on the first media data collected multiple times.

[0077] The technical solution provided in this disclosure, in response to a first trigger operation that generates media data, displays a shooting page to present preview media data within the field of view. During the display of preview media data, if some preview media data is of interest, a second trigger operation on the shooting page can be performed to display the acquired first media data and continue displaying at least a portion of the media preview data. When the conditions for generating second media data are detected, second media data is generated based on at least two acquired first media data. It should be noted that the final generated second media data is simply data generated based on the first media data. This solves the problem in the prior art where a camera device can only capture and display one image, resulting in a single image content that cannot meet the user's requirements for diverse and rich image content. The solution achieves the goal of displaying not only the captured first media data but also preview media data on the shooting page. Furthermore, when the conditions for generating second media data are detected, multiple images can be displayed on a single page, thereby improving the richness and personalization of the image content.

[0078] Figure 4 This is a flowchart illustrating a media data generation method provided in an embodiment of the present invention. Based on the foregoing embodiments, the first media data can be displayed based on the default page layout information, or the page layout information can be generated in a configurable manner to meet the user's personalized needs, and then the collected first media data can be displayed based on the page layout information. The specific implementation method can be described in detail in this embodiment. In this embodiment, the same or corresponding technical terms as those in the above embodiments will not be repeated.

[0079] like Figure 4 As shown, the method includes:

[0080] S210, Display layout configuration interface.

[0081] The layout configuration interface is used to configure the layout information when the first media data is displayed on the shooting interface. Layout information can be understood as the display layout of the first media data on the shooting page. Optionally, the display layout can be characterized by the display positions and the size information of the display area corresponding to each display position. The layout configuration interface can include multiple layout options. Each layout option corresponds to a simplified diagram for each page layout. Optionally, the simplified diagram corresponding to the layout option can be a three-grid, four-grid, nine-grid, irregular polygon, etc. Each layout option, when triggered, determines the page layout to be used.

[0082] In this embodiment, various page layouts can be preset. Optionally, the page layout can correspond to a nine-grid layout, a four-grid layout, a pentagonal layout, a hexagonal layout, a circular layout, an elliptical layout, etc., or it can be an irregularly shaped layout. A simplified diagram of the page layout can be used as the content displayed on the optional controls. That is, based on the content displayed on the optional controls, a preliminary understanding of the page layout can be obtained.

[0083] To achieve customized page layout, the layout configuration page also includes custom configuration options. These options, once triggered, determine the page layout information based on the user's editing actions.

[0084] Specifically, after detecting the first trigger operation, the default page layout information can be directly invoked. Of course, during the display of the shooting page, if a control triggering the page layout configuration is detected, the layout configuration interface can be displayed. Alternatively, the layout configuration interface can be automatically launched upon detecting a control triggering the layout configuration. If no layout selection option is triggered within a preset time, the default page layout information can be used directly, and the layout configuration interface will be exited; however, if the user triggers a layout option, the selected layout option will be used as the default page layout information.

[0085] For example, see Figure 5 During the process of displaying and previewing media data on the shooting page, if the layout configuration control is triggered, the layout configuration interface can be displayed on the shooting page. Based on the editing operations on the layout configuration page, it can be determined how the acquired first media data should be displayed on the shooting page and how many times the first media data can be acquired.

[0086] S220, in response to an editing operation in the layout configuration interface, determines page layout information for displaying at least two first media data on the shooting page.

[0087] This can be understood as follows: based on the click operation in the layout configuration interface, the page layout information used can be determined, that is, the page layout information that displays at least two primary media data in the shooting page can be obtained.

[0088] In this embodiment, as described above, the layout configuration interface includes at least one first selection control corresponding to preset layout information and a second selection control for custom layout. The method for determining page layout information differs depending on the triggered control.

[0089] Optionally, in response to an editing operation in the layout configuration interface, determining page layout information for displaying at least one first media data on the shooting page includes: in response to a triggering operation on a first selection control in the layout configuration interface, using the first layout information that triggers the selection as page layout information; and in response to a triggering operation on a second selection control in the layout configuration interface, displaying a layout editing page to edit the page layout information for displaying at least one first media data on the layout editing page.

[0090] This can be understood as follows: When the user triggers the first selection control, it indicates that the user needs to use a pre-configured page layout. In this case, the selected page layout can be used as the page layout information for presenting the first media data. When the user triggers the second control, it indicates that the user needs to draw the page layout for presenting the first media data themselves. In this situation, a layout editing page can be displayed to determine the page layout information for presenting the first media data based on the user's drawing information on the layout editing page.

[0091] In this embodiment, determining the page layout information based on the drawing information in the layout editing page can be as follows: in response to the triggering operation of the second selection control in the layout configuration page, the trajectory drawing information of the touch point in the shooting page is collected; at least two regions are determined according to the trajectory information, and the display order in the page layout information is determined based on the formation order of the at least two regions.

[0092] Specifically, upon detecting the second selection control in the trigger layout configuration interface, i.e., after receiving the trajectory drawing instruction, the backend can collect the trajectory drawing information of the touch point on the shooting page based on this instruction. The touch point can be a finger or stylus touch point on the shooting page. At least two areas can be understood as closed or semi-closed areas formed based on the drawn trajectory.

[0093] In this embodiment, the instruction to complete trajectory drawing may be: the trajectory drawing time reaches a preset time threshold, or no motion information of the touch point on the shooting page is detected within the preset time (optionally, 3S), or a control that triggers the completion of trajectory drawing is detected.

[0094] The advantage of determining page layout information in the above way is that users can create according to their actual needs, so that the collected preview media data and primary media data can meet the personalized needs of the shooting user when displayed.

[0095] Based on the above technical solution, when drawing motion trajectories based on touch points, trajectory drawing guidance prompts can be displayed.

[0096] Optionally, a prompt message guiding the drawing of a trajectory can be displayed at a first preset location on the shooting page. This prompt message can be text-based or a trajectory-based prompt message. Regardless of the prompt method, its main purpose is to remind the user that at least two areas need to be drawn in order to display the preview media data and the first media data based on at least two areas. The first preset location can be any location on the shooting page that the user can see.

[0097] The text prompt could be: "Please draw at least two areas." The trajectory prompt could be displaying trajectories of various shapes on the shooting page, making it easier for users to draw the corresponding areas based on these trajectories.

[0098] By prompting users on how to draw trajectories in the above manner, the efficiency of users drawing layout areas can be improved, thereby achieving the effect of efficient interaction.

[0099] The technical solution provided in this disclosure, when a user has personalized requirements for page layout information, can display a layout configuration interface based on triggering operations on layout configuration controls. This interface displays at least one first selection control corresponding to preset layout information and a second selection control for a custom layout. Based on triggering operations on different selection controls, the page layout information most suitable for the user can be determined. Furthermore, based on the page layout information, the acquired first media data can be presented, achieving a personalized media data presentation effect.

[0100] Figure 6 This is a flowchart illustrating a media data generation method provided in an embodiment of the present invention. Based on the foregoing embodiments, the statement "in response to a second trigger operation on the shooting page, displaying the acquired first media data and at least a partial preview of the media data on the shooting page" can be further refined. For specific implementation details, please refer to the detailed description of this technical solution. Technical terms that are the same as or corresponding to those in the above embodiments will not be repeated in this embodiment.

[0101] like Figure 6 As shown, the method includes:

[0102] S310, in response to the first trigger operation of receiving generated media data, displays the shooting page to present preview media data within the field of view in the shooting page.

[0103] In this embodiment, when the shooting page presents preview media data within the field of view, the method further includes: obtaining page layout information; parsing the page layout information to obtain the number of display areas in the page layout information; and determining the conditions for generating second media data based on the number of display areas; wherein the number of display areas corresponds to the number of times the first media data is obtained.

[0104] The number of display areas refers to the number of areas in the page layout information that can display the primary media data.

[0105] This can be understood as follows: After obtaining the page layout information, it can be parsed to determine the number of display areas within the layout. The display area is the area where the first media data is presented. Once the number of display areas is determined, it can be used as a condition for generating second media data. That is, when the number of times the first media data has been obtained reaches the number of display areas, it can be determined that second media data can be generated based on the obtained first media data. In other words, the condition for generating second media data can be confirmed.

[0106] S320, In response to the second trigger operation, acquire the preview media data presented when the second trigger operation occurs, and use it as the first media data.

[0107] The second triggering operation can be either capturing or previewing media data. In other words, the second triggering operation is the operation that triggers the acquisition of the first media data. Optionally, the capturing page includes a capturing control; when a triggering operation on the capturing control is detected, it is determined that the second triggering operation has been triggered.

[0108] It should be noted that the operation of acquiring the first media data can be used as the second trigger operation. The second trigger operation can be triggered two or more times, and the specific number of times can be related to the number of display areas in the pre-set page layout information.

[0109] Since the shooting page can output the preview media data collected within the field of view in real time, the first media data collected by the camera device that triggers the second trigger operation is the data in the preview media data.

[0110] Specifically, when the shooting control is triggered, preview media data can be captured by the camera device, and the preview media data captured at this time can be used as the first media data.

[0111] S330. Based on the predetermined page layout information, determine the first display position of the first media data on the shooting page, and display the first media data at the first display position.

[0112] As mentioned above, the page layout information includes the display position and size information of the display area corresponding to each acquired first media data. For example, if the page layout information is a three-grid display, the display information of each grid could be: the horizontal dimension of each grid is the same as the horizontal width of the captured page, and the vertical dimension of each grid is one-third of the vertical height of the captured page.

[0113] Specifically, after acquiring the first media data, the display position and area of ​​the first media data on the shooting page can be determined based on the page layout information and the number of times the first media data has been acquired. The first media data is then displayed in the corresponding position and area. In other words, the page layout information is mainly used to determine the display position and area of ​​the first media data acquired each time.

[0114] S340, continue to display preview media data within the field of view on the shooting page.

[0115] For example, the page layout information is a three-grid layout, arranged as follows: Figure 7 As shown. The display order in the page layout information is to display the acquired first media data from top to bottom. When the first media data is acquired for the first time, it can be displayed at the top position according to the page layout information, that is, the display position marked 1. At this time, the preview media data can continue to be displayed on the shooting page where the first media data is not yet displayed, that is, the preview media data can be displayed at the position marked 2.

[0116] S350, In response to detecting that the conditions for generating second media data are met, generate second media data based on at least two first media data.

[0117] For example, when it is detected that the number of times the first media data is acquired reaches the number of display areas in the page layout information, or when it is detected that a "composite" control for generating second media data is triggered, at least two first media data displayed on the shooting page can be combined into one second media data.

[0118] This can be understood as follows: if the first media data is image data, then the second media data is data synthesized from the image data. If the first media data is video, then the synthesized second media data is data of the video data collected and played in each display area. If at least two types of data exist in at least two of the first media data, one being video and the other being images, then the corresponding first media data can be displayed in the corresponding display area.

[0119] In this embodiment, the presentation format or content of at least a portion of the preview media data presented after the first media data is acquired can be further described.

[0120] Optionally, at least a portion of the preview media data displayed after acquiring the first media data is the media data displayed after acquiring the first media data, or at least a portion of the preview media data displayed after acquiring the first media data is compressed data presented in the shooting area, where the shooting area is the area where the first media data is not displayed.

[0121] This can be understood as follows: After acquiring the first media data and displaying it in the appropriate position according to the page layout information, you can continue to collect preview media data using the shooting device. The preview media data can fill the entire shooting page. At this point, the displayed first media data partially covers the preview media data; that is, the remaining preview media data is displayed in the area of ​​the shooting page where the first media data is not currently displayed. Alternatively, after acquiring the first media data and displaying it in the appropriate position according to the page layout information, you can continue to collect preview media data using the shooting device. The captured preview media data is then compressed based on the area of ​​the shooting page where the first media data is not currently displayed. In other words, the compressed preview media data is then displayed. The shooting area is the area of ​​the shooting page that does not contain the first media data.

[0122] The technical solution provided in this disclosure, in response to a first trigger operation that generates media data, displays a shooting page to present preview media data within the field of view. During the display of preview media data, if some preview media data is of interest, a second trigger operation on the shooting page can be performed to display the acquired first media data and continue displaying at least a portion of the media preview data. When the conditions for generating second media data are detected, second media data is generated based on at least two acquired first media data. It should be noted that the final generated second media data is simply data generated based on the first media data. This solves the problem in the prior art where a camera device can only capture and display one image, resulting in a single image content that cannot meet the user's requirements for diverse and rich image content. The solution achieves the goal of displaying not only the captured first media data but also preview media data on the shooting page. Furthermore, when the conditions for generating second media data are detected, multiple images can be displayed on a single page, thereby improving the richness and personalization of the image content.

[0123] Figure 8This is a schematic diagram of a media data generation method provided in an embodiment of the present invention. Based on the foregoing embodiments, the step of "generating second media data based on at least two first media data" can be further refined. For specific implementation methods, please refer to the detailed description of this embodiment. In this embodiment, technical terms that are the same as or corresponding to those in the above embodiments will not be repeated.

[0124] like Figure 8 As shown, the method includes:

[0125] S410, in response to the first trigger operation of receiving generated media data, displays the shooting page to present preview media data within the field of view in the shooting page.

[0126] S420. In response to the third trigger operation on the first media data, adjust the display content of the first media data at the corresponding display position.

[0127] It should be noted that regardless of whether the first media data collected is image data or video data, it corresponds to the entire shooting page, i.e., the entire display screen. However, the display area for each piece of first media data is only a portion of the display screen; that is, the display area can only show a portion of the captured first media data.

[0128] In practical applications, in order to facilitate users in determining the first media data to be displayed in the display area according to their actual needs, the display content of the first media data in the display area can be adjusted based on the trigger operation of the first media data, thereby meeting the user's personalized needs for the display content.

[0129] The third trigger operation is a trigger operation that adjusts the display content corresponding to the first media data within the display area. Optionally, the first media data is an image, and the third trigger operation is a drag operation that drags the image to display content within the display area.

[0130] Specifically, when the first media data displayed in the trigger display area is detected, the display content of the first media data can be adjusted based on the user's trigger operation, such as dragging left, right, up, or down.

[0131] Based on the above technical solution, after acquiring the first media data, the first media data can be analyzed and processed to determine the first media data to be displayed in the display area. That is, the image can be analyzed and processed to determine which part of the screen content in the displayed image, so as to realize the automatic adjustment of the screen content on the shooting page, thereby improving the effect of screen content coordination.

[0132] Optionally, the first media data displayed on the shooting page is determined based on at least one of the following methods: inputting the first media data into a pre-trained content extraction model to output first media data that marks a first region in the first media data, and displaying the marked first media data on the shooting page; determining the first media data displayed on the shooting page based on the content attributes of the first media data already presented on the shooting page and the collected first media data, wherein the displayed first media data is data from the collected first media data.

[0133] The content extraction model is a pre-trained model used to extract salient content from images. Salient content mainly refers to the prominent content in the image. After inputting the image corresponding to the first media data into the content extraction model, the model can identify the salient content in the image and mark it to obtain the first region. That is, the content extraction model can output the first media data that marks the content of interest to the user.

[0134] Specifically, after capturing the first media data, the first media data can be processed based on a pre-deployed content extraction model, and the first media data with the content that the user is interested in marked can be output.

[0135] Another way to determine the first media data to be displayed in the display area is: if the first media data obtained this time is not the first media data obtained, the data consistency can be determined based on the first media data already displayed on the shooting page and the first media data obtained in this shooting, and the first media data to be displayed on the shooting page can be determined based on the consistency.

[0136] In this embodiment, the content attribute can be the RGB value of each pixel, and / or the image content.

[0137] Based on the above technical solution, after determining the display area of ​​the first media data on the shooting page according to the page layout information, the method further includes: obtaining the texture sampling range corresponding to the display area of ​​the display position, and sampling and processing the first media data according to the texture sampling range to obtain the first media data corresponding to the display area at the display position.

[0138] It should be noted that the capacity of each display area is limited, and the screen size corresponding to the first media data is consistent with the screen size of the entire display screen. Based on this, when displaying the data content of the first media data in the display area, it is necessary to perform texture sampling processing on the first media data to determine the first media data presented in the display area.

[0139] This can be understood as follows: the display area corresponding to each display location is pre-resolution, and correspondingly, the height and width data of this display area are known. Based on this, the texture sampling range can be determined according to the height and width data. The texture sampling range can be represented by UV coordinates. During the texturing process, UV coordinates are used to map each pixel of the texture to the surface of the 3D model. After determining the texture sampling range, the first media data can be sampled and processed to obtain the first media data that can be presented within the display area.

[0140] In this embodiment, when determining the texture sampling range and sampling the first media data, any sampling point in the first media data can be used as a reference point for sampling to obtain the first media data displayed in the display area. To improve the adaptability between the sampled image content and the shooting user, a significant region in the first media data, i.e., the region of interest to the shooting user, can be determined before or after determining the texture sampling range, and then the first media data can be sampled based on the region of interest.

[0141] Optionally, the third media data corresponding to the first media data is determined; the third media data is sampled and processed based on the texture sampling range to obtain the first media data displayed at the display position.

[0142] The third media data refers to the salient area within the first media data, or media data corresponding to the area of ​​interest to the user, processed using a specific algorithm. In other words, the third media data is the media data from the first media data that is to be displayed at the designated location.

[0143] Specifically, a saliency analysis algorithm can be used to determine the salient regions in the first media data, and the media data corresponding to these salient regions is then used as the third media data. Of course, the range of the salient region corresponding to the third media data may be smaller than the range of the display area. In this case, the salient region can be further marked based on the range of the display area to obtain the third media data to be sampled. Conversely, if the range of the salient region corresponding to the third media data is larger than the range of the display area, the center point of the salient region can be used as the center, and the range of the display area as the neighborhood to determine the third media data including the salient region. Based on the texture sampling range, the third media data is sampled and processed to obtain the first media data displayed at the display location.

[0144] Based on the above technical solution, the method for determining the third media data in the first media data may be: inputting the first media data into a pre-trained content extraction model to output the third media data that marks the first region in the first media data; or, determining the first media data displayed on the shooting page based on the content attributes of the first media data already presented on the shooting page and the first media data collected, wherein the first media data displayed is the data in the first media data collected.

[0145] The content extraction model can be pre-trained to extract salient content from the first media data. Optionally, salient content can be foreground content, brightly colored content, content in focus during shooting, etc. The specific salient content extracted is related to the training samples used during the training of the content extraction model. The labeled data output by the content extraction model is used as the third media data. This can be understood as data from the first media data that has marked salient regions. Specifically, the first media data can be input into the content extraction model, which can output data from the first media data that has marked salient content; this data is then used as the third media data.

[0146] It should be noted that if the first media data is an image, the output will also be an image. If the first media data is video, each video frame can be processed as a unit, and the output can be an image with the corresponding area marked in the video frame.

[0147] Among them, content attributes can be understood as color attributes, the display objects of the first media data that have already been displayed, and the display objects in the first media data that have just been acquired.

[0148] Determining third media data based on color attributes can be achieved by: acquiring the area size of the acquired first media data to be displayed; using this area size as a sliding window and adjusting the window step size with a preset step size; and determining the color attribute information corresponding to each window in the acquired first media data. Optionally, the average RGB value of each pixel within the sliding window can be determined, and this average value can be used as the color attribute of the sliding window. The color attributes corresponding to the displayed first media data can be determined in the same way. The third media data can be determined based on the distance information of the color attributes.

[0149] Based on the display objects in the already displayed first media data and the display objects in the acquired first media data, the third media data is determined. This can be achieved by: extracting each display object from the acquired first media data; determining the target display object based on the category attributes corresponding to each display object and the category attributes of the display objects in the already displayed first media data; and using the data constituting the area to which the target display object belongs as the third media data.

[0150] Based on the above method, the media data to be rendered to the display area can be automatically determined, which not only improves the compatibility between the media data and the shooting user, but also improves the coordination of the content displayed in the same frame.

[0151] For example, taking a three-grid layout as an example, the shooting page can be divided into three display areas. A detailed illustration can be found here. Figure 7 At this point, the sampling texture range for the first display area can be set to [x:0-1, y:0-0.03], the sampling texture range for the second display area to [x:0-1, y:0.33-0.67], and the sampling texture range for the third display area to [x:0-1, y:0.67-1.0]. The first media data can be sampled and processed based on this. When displaying the first media data in the first display area, preview media data can be displayed within the merged area corresponding to the second and third display areas. When displaying different first media data in the first and second display areas respectively, preview media data can be displayed in the third display area. That is, when acquiring the first media data for the first time, one-third of the first media data can be taken, and two-thirds of the area of ​​the shooting interface can be used to display preview media data, and so on.

[0152] S430, In response to the third trigger operation on the first media data, adjust the display content of the first media data at the corresponding display position.

[0153] The displayed content is the data from the first media data set. To facilitate users adjusting the first media data displayed in the display area, a corresponding function can be enabled during the development phase. This allows users to adjust the displayed content based on their actions after the first media data is displayed. It should be noted that the adjusted content remains the same as the first media data set.

[0154] The third trigger operation can be understood as dragging the first media data in the display area to display content. Optionally, the first media data is an image, and the third trigger operation is dragging the image in the display area to display content.

[0155] In this embodiment, when the first media data is displayed in the display area, or when the corresponding first media data is included in all display areas, the shooting user can perform a drag operation on the first media data in each display area, and adjust the content of the screen displayed in the display area based on the drag operation.

[0156] It should be noted that the content displayed in the drag-and-drop display area is presented after the first media data has been resampled based on the texture sampling range.

[0157] This can be understood as follows: After capturing the first media data and displaying it in the corresponding display area, the user can drag the first media data and modify the corresponding UV (unique visitors) based on the dragging coordinates to display specific content from the first media data.

[0158] The reason why the above sampling method can be used to adjust the displayed content is that only a portion of the effect can be displayed each time the first media data is sampled. Therefore, when the user drags the first media data, the texture coordinates of the displayed content can be changed according to the dragging range, thereby achieving the effect of regional display.

[0159] S440, in response to a second trigger operation on the shooting page, generates second media data based on the adjusted display content at the display position.

[0160] This can be understood as follows: after detecting the "synthesis" control on the shooting page that triggers the synthesis of second media data, the final second media data can be generated based on the adjusted display content corresponding to each display position.

[0161] The solution provided by this invention, after displaying the first media data in the corresponding display area of ​​the shooting page, can adjust the display content in the display area based on the user's trigger operation on the first media data in order to meet the user's personalized needs, thus achieving the effect that the display content can meet the user's personalized needs.

[0162] Figure 9 This is a schematic flowchart of a media data generation method provided in an embodiment of the present invention. When the first media data is video, the video data file is large. In order to improve the efficiency of video data processing and display, the solution provided in the embodiment of the present invention can be used. For specific implementation methods, please refer to the detailed description of the technical solution. In this embodiment, the same or corresponding technical terms as those in the above embodiments will not be repeated.

[0163] like Figure 9 As shown, the method includes:

[0164] S510, in response to receiving a first trigger operation that generates media data, display a shooting page to present preview media data within the field of view on the shooting page.

[0165] This can be understood as follows: when a special effects prop corresponding to the triggered media data is detected, the camera device can be activated, and the shooting page can be displayed on the screen. The shooting page can display a preview of the media data, meaning that the camera device can continuously output image frames by default.

[0166] It should be noted that the preview media data displayed on the shooting page refers to the image frames that can be captured within the field of view of the camera device.

[0167] It should also be noted that during the continuous display and preview of media data based on the shooting page, the page layout information can be parsed to determine multiple display positions and the display order of the first media data in each position.

[0168] S520, in response to the second trigger operation on the shooting page, determine the display information corresponding to the first media data collected based on the page layout information.

[0169] The display information includes the display location and the display area. The display location refers to the position of the data on the shooting page, while the display area indicates the size of the display area used to show the primary media data.

[0170] Specifically, after detecting the "shoot" control on the shooting page, the number of display areas for presenting the first media data, the order in which the first media data is displayed in each display area, and the size information corresponding to each display area can be determined based on the page layout information.

[0171] S530. Sample at least one video frame in the first media data according to the texture sampling range corresponding to the display position to obtain the cropped first media data and cache it; wherein, the screen size corresponding to the cropped first media data is related to the size of the display area.

[0172] The texture sampling range corresponding to the display position can be understood as follows: the display area corresponding to each display position may have certain differences, and the texture sampling range can be determined based on the size information of the display area. This texture sampling range is only used to characterize the range of textures that can be sampled, not the range of the specific image being sampled. The range of the specific image can be determined in conjunction with pre-defined information. Optionally, the pre-defined information is to sample the salient region in the first media data based on the texture range, then the texture sampling range is the range area sampled after determining the salient region.

[0173] It should be noted that if the first media data is video data, caching all the collected first media data will result in a large amount of memory being consumed. Therefore, each video frame in the first media data can be cropped according to the sampling range, which can greatly reduce memory consumption without affecting the display of the media data.

[0174] Specifically, after detecting and acquiring the first media data, the display position of the acquired first media data on the shooting page can be determined based on the page layout information. The texture sampling range is then determined based on the display area of ​​this position. The first media data is then sampled and processed (i.e., cropped) based on this texture sampling range, and the sampled first media data is cached. This method allows caching only the video data to be displayed in the display area, significantly reducing memory usage.

[0175] S540, Display the first video frame of the first media data at the display location, and continue to present at least a portion of the preview media data on the shooting page.

[0176] The first video frame is the first frame after cropping and processing the first media data. At this point, the first video frame is also the cropped video frame, and the screen size corresponding to this video frame matches the size of the display area.

[0177] Specifically, to facilitate users' timely understanding of the captured first media data, the first video frame of the cropped first media data can be obtained and displayed in the display position. Simultaneously, a preview of the media data can continue to be displayed on the shooting page where the first media data is not yet presented.

[0178] In this embodiment, when caching the cropped first media data, the correspondence between the first media data and the display position (display area) can be recorded.

[0179] S550, In response to detecting that the conditions for generating second media data are met, first media data corresponding to at least two display positions are obtained from the cache, and the playback duration of the first media data is aligned and the first media data at the corresponding display positions is updated.

[0180] This can be understood as follows: when the conditions for generating second media data are met, i.e., when an operation triggering the composition control is detected, all cached first media data can be retrieved from the cache. After retrieving the first media data from the cache, the display position corresponding to each piece of first media data can be determined based on the correspondence, and it can be presented in the display area corresponding to the corresponding display position.

[0181] It should be noted that after multiple triggers to obtain the first media data, the playback duration of the first media data obtained may vary. In order to avoid poor picture coordination due to inconsistent playback duration in each display area during the display process, the playback duration of the first media data obtained from the cache can be aligned.

[0182] In this embodiment, the playback duration alignment process can be performed by determining the frame rate (i.e., playback speed) corresponding to the shorter first media data based on the longest playback duration, and then playing the media data according to the playback speed corresponding to each first media data. Alternatively, it can be performed by determining the mean or mode of the playback durations of all first media data, and then determining the playback speed based on the mean or mode of the playback durations and the playback duration of each first media data.

[0183] In short, playback duration alignment can be understood as follows: based on the playback duration of the corresponding first media data, a reference value for the playback duration is determined; and based on this reference value and each playback duration, the playback rate of the first media data is determined. The reference value can be a preset value, or a duration value that satisfies a preset percentage based on the playback duration of the first media data.

[0184] S560. Add the updated first media data to the display area at the corresponding display position on the shooting page to obtain the second media data, and play the first media data based on the player in the display area.

[0185] This can be understood as follows: after determining the playback rate corresponding to the first media data, the first media data can be added to the display area of ​​the shooting page according to the corresponding relationship. Simultaneously, the first media data carried by the player in each playback area can be determined based on the playback rate.

[0186] The technical solution provided by this invention, when the first media data is video data, can sample and process the first media data according to the texture sampling range of the display area carrying the first media data in the page layout information to obtain first media data that only includes part of the video data. Then, when the condition of generating second media data is detected, the cached first media data can be directly retrieved for display. This method can avoid the problem of caching all the collected first media data, which would result in a large amount of data occupying memory. It realizes that multiple video data can be displayed on the same screen based on the cached partial media data, thereby improving the technical effect of rich screen content.

[0187] As an optional embodiment of the above embodiments, the following will take image data and video data as examples to illustrate the specific exemplary content. For details, please refer to the detailed description of this embodiment. In this embodiment, the same or corresponding technical terms as those in the above embodiments will not be repeated.

[0188] Before proceeding, common terms can be defined. The methods provided in this embodiment of the invention can be integrated into a special effects prop. The operation of triggering the special effects prop is designated as the first triggering operation. The second triggering operation is the operation of triggering the capture of the first media data. The condition for generating the second media data is that the displayed first media data reaches a preset number of thresholds, wherein the preset number of thresholds is related to the number of display areas in the page layout information. Taking a three-grid page layout as an example, the width of the three grids is the width of the display screen, and the height of the three grids is one-third of the height of the display screen.

[0189] First, let's take the image data of the first media as an example to illustrate this.

[0190] Upon detecting a first trigger operation that generates the first media data, the page layout information is parsed to determine the conditions for generating the second media data, i.e., how many times the first media data can be captured. Simultaneously, a camera device can be invoked to open a recording page, displaying a preview of the media data. It should be noted that at this point, the entire display screen shows the preview media data by default.

[0191] Upon detecting a second trigger operation that initiates the first capture of the first media data, a first display area for displaying the first media data is determined, and the first media data is filled into this first display area. Simultaneously, preview media data continues to be displayed in areas of the capture page where the first media data is not yet displayed. This continues until a third trigger operation for capturing the first media data is detected, at which point the acquired first media data is filled into the third grid.

[0192] It should be noted that the data content of the first media data displayed in each cell can be sampled based on the texture sampling range corresponding to each cell and then displayed.

[0193] In practical applications, after the first media data is acquired, the first media data in a specific area (each grid, i.e., each display area) can be edited. Optionally, the first media data can be dragged up, down, left, or right.

[0194] After a trigger operation to generate second media data is detected, the first media data displayed in each grid can be collectively referred to as second media data. At this time, the second media data is image data that includes multiple first media data in a display screen.

[0195] Second, let's take video data as an example to further illustrate this point.

[0196] The first trigger operation is initiated when an effects prop pack that triggers media data generation is detected. At this point, the entire display screen is still assumed to correspond to the shooting page. After detecting the shooting control on the shooting page, recording mode can be activated to record the first media data, i.e., video data. After recording is complete, the texture sampling range is determined based on the page layout information, and the recorded video data is sampled and processed according to the texture sampling range, i.e., cropped and cached.

[0197] To facilitate users' timely understanding of their captured first media data, the first video frame of the cropped first media data can be retrieved and displayed in the corresponding display position. When the number of recordings reaches a preset threshold (the number of display areas in the page layout information), the backend can automatically confirm recording completion. At this point, the cropped first media data can be retrieved from the cache, and its playback rate adjusted according to its duration to align the playback durations of all first media data. Finally, the first media data with aligned playback durations is added to the display area on the shooting page for playback based on the player within that area.

[0198] It should be noted that regardless of whether the first media data is image data or video data, the final second media data only includes the first media data, not the process data for generating the second media data.

[0199] The technical solution provided in this disclosure, in response to a first trigger operation that generates media data, displays a shooting page to present preview media data within the field of view. During the display of preview media data, if some preview media data is of interest, a second trigger operation on the shooting page can be performed to display the acquired first media data and continue displaying at least a portion of the media preview data. When the conditions for generating second media data are detected, second media data is generated based on at least two acquired first media data. It should be noted that the final generated second media data is simply data generated based on the first media data. This solves the problem in the prior art where a camera device can only capture and display one image, resulting in a single image content that cannot meet the user's requirements for diverse and rich image content. The solution achieves the goal of displaying not only the captured first media data but also preview media data on the shooting page. Furthermore, when the conditions for generating second media data are detected, multiple images can be displayed on a single page, thereby improving the richness and personalization of the image content.

[0200] Figure 10 This is a schematic diagram of a media data generation device provided in an embodiment of the present invention. The device includes: a media data preview display module 610, a media data display module 620, and a media data synthesis module 630.

[0201] The media data preview display module 610 is used to display a shooting page in response to receiving a first trigger operation to generate media data, so as to present the preview media data within the field of view on the shooting page; the media data display module 620 is used to display the acquired first media data and at least a portion of the preview media data on the shooting page in response to a second trigger operation on the shooting page, according to page layout information; wherein the page layout information is used to characterize the display position of the first media data on the shooting page; the media data synthesis module 630 is used to generate the second media data based on at least two of the first media data in response to detecting that the conditions for generating the second media data are met.

[0202] The technical solution provided in this disclosure, in response to a first trigger operation that generates media data, displays a shooting page to present preview media data within the field of view. During the display of preview media data, if some preview media data is of interest, a second trigger operation on the shooting page can be performed to display the acquired first media data and continue displaying at least a portion of the media preview data. When the conditions for generating second media data are detected, second media data is generated based on at least two acquired first media data. It should be noted that the final generated second media data is simply data generated based on the first media data. This solves the problem in the prior art where a camera device can only capture and display one image, resulting in a single image content that cannot meet the user's requirements for diverse and rich image content. The solution achieves the goal of displaying not only the captured first media data but also preview media data on the shooting page. Furthermore, when the conditions for generating second media data are detected, multiple images can be displayed on a single page, thereby improving the richness and personalization of the image content.

[0203] Based on the above technical solution, after the first trigger operation in response to receiving the generated media data, the device further includes:

[0204] The layout configuration interface display module is used to display the layout configuration interface, wherein the layout configuration interface is used to configure the layout information when the first media data is displayed in the shooting interface;

[0205] The layout information determination module is used to determine the page layout information for displaying the at least two first media data in the shooting page in response to the editing operation in the layout configuration interface.

[0206] Based on the above technical solutions, the layout configuration interface includes at least one first selection control corresponding to preset layout information and a second selection control for custom layout;

[0207] The layout information determination module includes:

[0208] The first determining unit is configured to respond to a triggering operation on the first selection control in the layout configuration interface and use the first layout information that triggered the selection as the page layout information.

[0209] The second determining unit is configured to respond to a triggering operation of the second selection control in the layout configuration interface, display a layout editing page, and determine page layout information for displaying the at least two first media data based on the drawing information in the layout editing page.

[0210] Based on the above technical solutions, the device further includes:

[0211] A layout information acquisition module is used to acquire the page layout information.

[0212] The area quantity determination module is used to obtain the number of display areas in the page layout information by parsing the page layout information;

[0213] The generation module is used to determine the conditions for generating the second media data based on the number of display areas;

[0214] The number of display areas corresponds to the number of times the first media data is acquired.

[0215] Based on the above technical solutions, the media data display module includes:

[0216] The media data acquisition unit is configured to, in response to the second triggering operation, acquire the preview media data presented when the second triggering operation occurs, and use it as the first media data;

[0217] The first display unit is configured to determine the display position of the first media data on the shooting page based on predetermined page layout information, and display the first media data at the specified display position; and,

[0218] The preview data display unit is used to continue displaying preview media data within the field of view on the shooting page.

[0219] Based on the above technical solutions, at least a portion of the preview media data displayed after acquiring the first media data is the media data displayed after being covered by the first media data; or, at least a portion of the preview media data displayed after acquiring the first media data is data compressed and presented in the shooting area, where the shooting area is the area where the first media data is not displayed.

[0220] Based on the above technical solutions, the media data synthesis module includes:

[0221] The display content adjustment unit is used to adjust the display content of the first media data at the corresponding display position in response to a third trigger operation on the first media data; wherein, the display content is the data content in the first media data;

[0222] A data synthesis unit is configured to generate the second media data in response to a second trigger operation on the shooting page, based on the adjusted display content at the display position.

[0223] Based on the above technical solutions, the device further includes:

[0224] The sampling range determination module is used to obtain the texture sampling range corresponding to the display area of ​​the display position;

[0225] The first media data display module is used to sample and process the first media data according to the texture sampling range to obtain the first media data corresponding to the display area of ​​the display position.

[0226] Based on the above technical solutions, the first media data display module includes:

[0227] A data determination unit is used to determine the third media data corresponding to the first media data;

[0228] The data display unit is used to sample and process the third media data based on the texture sampling range to obtain the first media data to be displayed at the display position.

[0229] Based on the above technical solutions, the data determination unit includes:

[0230] A first determining subunit is configured to input the first media data into a pre-trained content extraction model to output third media data that marks the first region in the first media data; or,

[0231] The second determining subunit is used to determine the third media data displayed on the shooting page based on the first media data already presented on the shooting page and the content attributes of the first media data collected, wherein the displayed third media data is the data in the first media data collected.

[0232] Based on the above technical solutions, the device further includes:

[0233] The display information acquisition module is used to determine the display information corresponding to the collected first media data based on the page layout information, wherein the display information includes the display position and the display area;

[0234] The caching module is used to sample at least one video frame in the first media data according to the texture sampling range corresponding to the display position, to obtain the cropped first media data and cache it; wherein, the screen size corresponding to the cropped first media data is related to the size of the display area;

[0235] The display module is used to display the first video frame of the first media data at the display location, and to continue to present at least a portion of the preview media data on the shooting page.

[0236] Based on the above technical solutions, the device further includes:

[0237] The duration alignment module is used to retrieve the first media data corresponding to at least two display positions from the cache, perform playback duration alignment processing on the first media data, and update the first media data at the corresponding display positions.

[0238] Accordingly, generating the second media data based on at least two pieces of the first media data includes:

[0239] The updated first media data is added to the display area at the corresponding display position on the shooting page to obtain the second media data, and the first media data is played based on the player in the display area.

[0240] The data pre-detection device provided in this disclosure can execute the media data generation method provided in any embodiment of this disclosure, and has the corresponding functional modules and beneficial effects of executing the method.

[0241] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the protection scope of the embodiments of this disclosure.

[0242] Figure 11 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Figure 11 As shown, the electronic device 700 may include a processing unit (e.g., a central processing unit, a graphics processor, etc.) 701, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage device 708 into a random access memory (RAM) 703. The RAM 703 also stores various programs and data required for the operation of the electronic device 700. The processing unit 701, ROM 702, and RAM 703 are interconnected via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0243] Typically, the following devices can be connected to I / O interface 705: input devices 706 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 707 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 708 including, for example, magnetic tapes, hard disks, etc.; and communication devices 709. Communication device 709 allows electronic device 700 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 11An electronic device 700 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0244] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 709, or installed from storage device 708, or installed from ROM 702. When the computer program is executed by processing device 701, it performs the functions defined in the methods of embodiments of this disclosure.

[0245] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0246] The electronic device provided in this disclosure and the media data generation method provided in the above embodiments belong to the same inventive concept. Technical details not described in detail in this disclosure can be found in the above embodiments, and this embodiment has the same beneficial effects as the above embodiments.

[0247] This disclosure provides a computer storage medium storing a computer program that, when executed by a processor, implements the media data generation method provided in the above embodiments.

[0248] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0249] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0250] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0251] The aforementioned computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to:

[0252] In response to receiving a first trigger operation that generates media data, a shooting page is displayed to present a preview of the media data within the field of view.

[0253] In response to a second trigger operation on the shooting page, the acquired first media data and at least a portion of the preview media data are displayed on the shooting page according to page layout information; wherein, the page layout information is used to characterize the display position of the first media data on the shooting page;

[0254] In response to detecting that the conditions for generating second media data are met, the second media data is generated based on at least two of the first media data.

[0255] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0256] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0257] The units described in the embodiments of this disclosure can be implemented in software or in hardware. The name of a unit does not necessarily limit the unit itself; for example, the first acquisition unit can also be described as "a unit that acquires at least two Internet Protocol addresses".

[0258] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0259] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0260] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0261] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0262] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A method for generating media data, characterized in that, include: In response to receiving a first trigger operation that generates media data, a shooting page is displayed to present a preview of the media data within the field of view. In response to a second trigger operation on the shooting page, the acquired first media data and at least a portion of the preview media data are displayed on the shooting page according to page layout information; wherein, the page layout information is used to characterize the display position of the first media data on the shooting page; In response to detecting that the conditions for generating second media data are met, the second media data is generated based on at least two of the first media data.

2. The method according to claim 1, characterized in that, Following the first trigger operation in response to receiving the generated media data, the method further includes: A layout configuration interface is displayed, wherein the layout configuration interface is used to configure the layout information when the first media data is displayed in the shooting interface; In response to an editing operation in the layout configuration interface, page layout information for displaying the at least two first media data in the shooting page is determined.

3. The method according to claim 2, characterized in that, The layout configuration interface includes at least one first selection control corresponding to preset layout information and a second selection control for custom layout; The step of determining page layout information for displaying at least one first media data on the shooting page in response to an editing operation in the layout configuration interface includes: In response to the triggering operation of the first selection control in the layout configuration interface, the first layout information of the triggered selection is used as the page layout information; In response to a triggering operation on the second selection control in the layout configuration interface, a layout editing page is displayed to determine page layout information for displaying the at least two first media data based on the drawing information in the layout editing page.

4. The method according to claim 1, characterized in that, Prior to the second triggering operation in the shooting page, the method further includes: Obtain the page layout information; By parsing the page layout information, the number of display areas in the page layout information can be obtained; The conditions for generating the second media data are determined based on the number of display areas; The number of display areas corresponds to the number of times the first media data is acquired.

5. The method according to claim 1, characterized in that, The response to the second triggering operation on the shooting page, displaying the acquired first media data and at least a partial preview of the media data on the shooting page, includes: In response to the second triggering operation, the preview media data presented when the second triggering operation occurs is obtained and used as the first media data; Based on predetermined page layout information, the display position of the first media data on the shooting page is determined, and the first media data is displayed at the specified display position; and, Continue to display preview media data within the field of view on the shooting page.

6. The method according to claim 1, characterized in that, The at least part of the preview media data displayed after acquiring the first media data is the media data displayed after being covered by the first media data; or, the at least part of the preview media data displayed after acquiring the first media data is data compressed and presented in the shooting area, where the shooting area is the area where the first media data is not displayed.

7. The method according to claim 1, characterized in that, The generation of second media data based on at least two pieces of the first media data includes: In response to a third trigger operation on the first media data, the display content of the first media data at the corresponding display position is adjusted; wherein, the display content is the data content in the first media data; In response to a second triggering operation on the shooting page, the second media data is generated based on the adjusted display content at the display location.

8. The method according to claim 1 or 5, characterized in that, After determining the display area of ​​the first media data on the shooting page based on the page layout information, the method further includes: Obtain the texture sampling range corresponding to the display area of ​​the display location; The first media data is sampled and processed according to the texture sampling range to obtain the first media data corresponding to the display area of ​​the display position.

9. The method according to claim 8, characterized in that, The step of sampling and processing the first media data according to the texture sampling range to obtain the first media data corresponding to the display area of ​​the display position includes: Determine the third media data corresponding to the first media data; The third media data is sampled and processed based on the texture sampling range to obtain the first media data displayed at the display position.

10. The method according to claim 9, characterized in that, The step of determining the third media data corresponding to the first media data includes: The first media data is input into a pre-trained content extraction model to output third media data that marks the first region in the first media data; or, Based on the first media data already presented on the shooting page and the content attributes of the first media data collected, the third media data displayed on the shooting page is determined, wherein the displayed third media data is the data in the first media data collected.

11. The method according to claim 1, characterized in that, If the acquired first media data is video data, after acquiring the first media data but before detecting that the conditions for generating second media data are met, the method further includes: Based on the page layout information, determine the display information corresponding to the collected first media data, wherein the display information includes the display position and the display area; At least one video frame in the first media data is sampled and processed according to the texture sampling range corresponding to the display position to obtain the cropped first media data and cache it; wherein, the screen size corresponding to the cropped first media data is related to the size of the display area; The first video frame from the first media data is displayed at the display location, and at least a portion of the preview media data continues to be presented on the shooting page.

12. The method according to claim 11, characterized in that, After detecting that the condition for generating second media data is met, the method further includes: Retrieve first media data corresponding to at least two display positions from the cache, align the playback duration of the first media data, and update the first media data at the corresponding display positions. Accordingly, generating the second media data based on at least two pieces of the first media data includes: The updated first media data is added to the display area at the corresponding display position on the shooting page to obtain the second media data, and the first media data is played based on the player in the display area.

13. A media data generation device, characterized in that, include: The preview media data display module is used to display the shooting page in response to the first trigger operation of receiving generated media data, so as to present the preview media data within the field of view on the shooting page; A media data display module is used to respond to a second trigger operation on the shooting page and display the acquired first media data and at least a partial preview of the media data on the shooting page according to the page layout information; wherein, the page layout information is used to characterize the display position of the first media data on the shooting page; A media data synthesis module is configured to generate second media data based on at least two pieces of first media data in response to detecting that conditions for generating second media data are met.

14. An electronic device, characterized in that, The electronic device includes: One or more processors; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the media data generation method as described in any one of claims 1-12.

15. A storage medium containing computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a computer processor, are used to perform the media data generation method as described in any one of claims 1-12.

16. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the media data generation method as described in any one of claims 1-12.

Images