Video filming method and apparatus

Abstract

The present application discloses a video filming method and apparatus. An electronic device starts a camera application, wherein the camera application has a first mode for filming and splicing multiple videos of an object to be photographed, and the camera application starts recording of a first video in the first mode, and ends recording of the first video in response to a received first instruction; the device simultaneously displays reference information and an image collected by the electronic device in real time, wherein the reference information is used for identifying the position of the object to be photographed in the first video; a comparison result is generated on the basis of the image collected by the device in real time, wherein the comparison result comprises the position matching degree of the object to be photographed between the first video and the image collected in real time or a first suggestion for moving the object to be photographed; in response to a received second instruction, recording of a second video is started; and in response to a received third instruction, recording of the second video is stopped, and a spliced video of the first video and the second video is generated.

Description

Video shooting method and device

[0001] This application claims priority to the Chinese patent application with application number 202410199779.8 filed with the State Intellectual Property Office of China on February 23, 2024, and priority to the Chinese patent application with the invention name “A method and device for video shooting”, all contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of mobile terminal technology, and in particular to a method and device for video shooting. Background Art

[0003] With the continuous development of short video culture, more and more ordinary users are also participating in the trend of short video shooting and editing. When users shoot and splice multiple videos, they use editing software to splice the multiple videos at the appropriate time points to generate the final filmed work.

[0004] On the one hand, existing video editing and splicing requires the use of professional software. On the other hand, the adaptability of the spliced ​​images of the two videos determines the coherence of the final work. Inappropriate splicing will produce an obvious sense of separation, which makes it difficult for ordinary users to create such videos. Summary of the Invention

[0005] An embodiment of the present application provides a method and device for video shooting. The video shooting method provided by the present application adjusts the position of the subject in the second video segment through the reference information of the first video segment when shooting two videos before and after, ensuring that the shooting positions of the subjects in the two videos are similar, improving the coherence of splicing multiple videos, and prompting users to experience multi-video shooting and splicing.

[0006] In a first aspect, the video shooting method provided by an embodiment of the present application is applied to a first electronic device, comprising: starting a camera application, recording a first video of a subject in a first mode of the camera application, the first mode being a mode for recording multiple videos and stitching them together; receiving the recording of the first video according to a received first instruction, and the device entering a transition phase; displaying reference information and an image captured in real time by the electronic device during the transition phase, the reference information being generated based on the first video and used to identify the position of the subject in the first video; generating and displaying a comparison result based on the reference information and the image captured in real time by the electronic device, the comparison result including a matching degree and / or a first suggestion, the matching degree being a measure of the proximity between the positions of the subject in the first video and the image captured in real time, and the first suggestion being a prompt for adjusting the position of the subject in the image captured in real time; starting the recording of a second video according to a received second instruction, and stopping the recording of the second video according to a received third instruction and generating a stitched video, the stitched video being composed of the first video and the second video. The comparison result may include only the matching degree, only the first suggestion, or both the matching degree and the first suggestion.

[0007] In the above embodiment, the first mode can realize the rapid shooting and splicing of multiple videos, while ensuring the continuity of the splicing of the previous and next two videos, which is conducive to generating works with better splicing effects.

[0008] In combination with some embodiments of the first aspect, in some embodiments, the method also includes: the reference information includes depth information of the subject in the first video, and the comparison result is generated based on the reference information and the depth information of the image captured in real time by the electronic device.

[0009] In the above embodiment, by comparing the depth information of the subject in the two situations, the position of the subject relative to the electronic device in the two videos can be more accurately identified, and the position difference of the subject in the two videos can be reduced by using the depth information.

[0010] In combination with some embodiments of the first aspect, in some embodiments, the method further includes: generating a first suggestion for an orientation movement prompt for adjusting a position of a subject in an image captured in real time based on the reference information.

[0011] In the above embodiment, the user can quickly adjust the position of the subject according to simple orientation prompts, which reduces the difficulty of adjusting the position of the subject when the user shoots two videos.

[0012] In combination with some embodiments of the first aspect, in some embodiments, the method also includes: the reference information is based on the data image of the first video, which can be the image data of the last frame of the first video, or it can be the video stream data of a fixed length of video. The fixed-length video stream is the video content within a certain length from the end of the first video to the previous one, such as the video data image of the last 2 seconds before the end; the first display area of ​​the device displays the reference information, and the second display area displays the real-time captured image.

[0013] In the above embodiment, different reference information data images are used to calculate the matching degree according to different shooting contents, which is suitable for the device to calculate the best matching degree. The two images are displayed in two display areas of the device respectively, which facilitates the user to observe and adjust the subject in real time based on the reference information.

[0014] In combination with some embodiments of the first aspect, in some embodiments, the method further includes: displaying the first area of ​​the device with a first transparency, and displaying the second area of ​​the device with a second transparency, and the first transparency and the second transparency are different.

[0015] In the above embodiment, the first area and the second area are distinguished by different transparencies, so that the user can intuitively and clearly identify the two different display areas, highlighting the different display contents of the two areas.

[0016] In combination with some embodiments of the first aspect, in some embodiments, the method further includes: the reference information includes a frame selection icon, and the frame selection icon displays the location area of ​​the subject in the first video.

[0017] In the above embodiment, the reference information directly frames and displays the position of the subject when the first video is shot, so that the user can adjust the position of the subject more intuitively and quickly.

[0018] In combination with some embodiments of the first aspect, in some embodiments, the method also includes: different frame rates can be used for video recording, the first part of the first video is recorded at a first frame rate, and the remaining video content of the first video is shot at a second frame rate. The first part is an important segment in the first video, which can be a video segment of a fixed length in the first video, or the first part can be a video segment with an identified subject, and the first frame rate is higher than the second frame rate.

[0019] In the above embodiment, high frame rate shooting can obtain more accurate content and better utilize the device to determine the location of the subject. However, high frame rate shooting consumes a lot of power. The device identifies important video clips and shoots these clips at a high frame rate. The frame rate is selectively adjusted according to the content being shot. Using a combination of high and normal frame rates can obtain a more accurate location of the subject while minimizing power consumption, thereby achieving more accurate comparison results.

[0020] In combination with some embodiments of the first aspect, in some embodiments, the method also includes: the electronic device has a folding screen, the device is formed into a first screen and a second screen based on the folding screen, the device posture can be determined based on the angles of the two parts, the first posture of the device is recorded when recording the first video, and the second posture of the device is recorded when displaying reference information, the device compares the difference between the first posture and the second posture, and displays a second suggestion to adjust the second posture to the first posture. The user can restore the folding screen to the device posture when shooting the first video according to the second suggestion.

[0021] In the above embodiment, the user may adjust the opening and closing state of the folding screen during the process of shooting multiple videos. Through the second suggestion, the device can be restored to the posture when shooting the first video before shooting the second video, ensuring that the subject is in the same shooting conditions in the first video and the second video, and utilizing the post-production splicing of the device.

[0022] In combination with some embodiments of the first aspect, in some embodiments, the method also includes: when the electronic device has cameras in multiple orientations, such as a front camera and a rear camera, the device can prompt the user to use a camera with a suitable orientation to take pictures based on the position of the subject.

[0023] In the above embodiment, the device recommends a camera with a suitable orientation based on the position of the subject, so as to obtain a video with the best shooting effect.

[0024] In combination with some embodiments of the first aspect, in some embodiments, the method also includes: the device first deletes the noise data when splicing videos. For example, when the user's first instruction or the second instruction is a gesture interaction, the video content is not what the user wants to shoot, so the device automatically identifies the fragment content of the instruction interaction, that is, the noise data in the first video, and deletes the noise data in the first video; for example, when the third instruction is a gesture interaction during the recording of the second video, the video content is not what the user wants to shoot, so the device automatically identifies the fragment content of the instruction interaction, that is, the noise data in the second video, and deletes the noise data in the second video; the first video and the second video after the noise data are deleted are spliced ​​to generate the final work.

[0025] In the above example, during the shooting process, some of the recorded video may contain content that the user does not want to shoot. The device automatically identifies and deletes the noise data to reduce the noise interference in the automatically spliced ​​video work.

[0026] In combination with some embodiments of the first aspect, in some embodiments, the method also includes: all instructions include specified gestures, action recognition, voice recognition, touch operation, eye tracking or posture detection of the electronic device, and various interactive instructions can realize the control of the start and end of video shooting.

[0027] In the above embodiment, the user can freely choose a suitable interaction method based on the scene, which brings the user a better shooting experience.

[0028] In a second aspect, an embodiment of the present application provides an electronic device, comprising: one or more processors and a memory; the memory being coupled to the one or more processors, the memory being configured to store computer program code, the computer program code comprising computer instructions, the one or more processors invoking the computer instructions to cause the electronic device to: initiate a camera application and record a first video of a subject in a first mode of the camera application, the first mode being a shooting mode for recording multiple videos and stitching them together; terminate the recording of the first video according to a received first instruction; simultaneously display reference information and an image captured in real time by the electronic device, wherein the reference information is configured to identify a position of the subject in the first video; display a comparison result based on the reference information and the image captured in real time, the comparison result comprising a degree of match between the position of the subject in the first video and the image captured in real time and / or a first suggestion for moving the subject; initiate the recording of a second video according to a received second instruction; terminate the recording of the second video according to a received third instruction, and generate a stitched video, wherein the stitched video comprises the first video and the second video. The comparison result may comprise only the degree of match, only the first suggestion, or both the match and the first suggestion.

[0029] In the above embodiment, the first mode can realize the rapid shooting and splicing of multiple videos, while ensuring the continuity of the splicing of the previous and next two videos, which is conducive to generating works with better splicing effects.

[0030] In combination with some embodiments of the second aspect, in some embodiments, the one or more processors are specifically used to call the computer instructions to enable the electronic device to execute: the reference information includes depth information of the subject in the first video; and the comparison result is generated based on the depth information of the reference information and the depth information of the subject in the image captured in real time.

[0031] In the above embodiment, by comparing the depth information of the subject in the two situations, the position of the subject relative to the electronic device in the two videos can be more accurately identified, and the position difference of the subject in the two videos can be reduced by using the depth information.

[0032] In combination with some embodiments of the second aspect, in some embodiments, the one or more processors are specifically used to call the computer instructions to enable the electronic device to execute: prompting the orientation movement prompt information of the subject in the real-time captured image in the first suggestion.

[0033] In the above embodiment, the user can quickly adjust the position of the subject according to simple orientation prompts, which reduces the difficulty of adjusting the position of the subject when the user shoots two videos.

[0034] In combination with some embodiments of the second aspect, in some embodiments, the one or more processors are specifically used to call the computer instructions to enable the electronic device to execute: the reference information is based on the data image of the first video, which can be the image data of the last frame of the first video, or it can be the video stream data of the last segment of the video with a fixed length, such as the video data image of the last 2 seconds before the end; the first display area of ​​the device displays the reference information, and the second display area displays the image captured in real time.

[0035] In the above embodiment, different reference information data images are used to calculate the matching degree according to different shooting contents, which is suitable for the device to calculate the best matching degree. The two images are displayed in two display areas of the device respectively, which facilitates the user to observe and adjust the subject in real time based on the reference information.

[0036] In combination with some embodiments of the second aspect, in some embodiments, the one or more processors are specifically used to call the computer instructions to cause the electronic device to execute: the first area of ​​the device is displayed with a first transparency, and the second area of ​​the device is displayed with a second transparency, and the first transparency and the second transparency are different.

[0037] In the above embodiment, the first area and the second area are distinguished by different transparencies, so that the user can intuitively and clearly identify the two different display areas, highlighting the different display contents of the two areas.

[0038] In combination with some embodiments of the second aspect, in some embodiments, the one or more processors are specifically used to call the computer instructions to enable the electronic device to execute: the reference information includes a box selection icon, and the box selection icon displays the location area of ​​the subject in the first video.

[0039] In the above embodiment, the reference information directly frames and displays the position of the subject when the first video is shot, so that the user can adjust the position of the subject more intuitively and quickly.

[0040] In combination with some embodiments of the second aspect, in some embodiments, the one or more processors are specifically used to call the computer instructions to enable the electronic device to execute: different frame rates can be used for video recording, the first part of the first video is recorded at a first frame rate, and the remaining video content of the first video is shot at a second frame rate, the first part is an important segment in the first video, it can be a video segment of a fixed length in the first video, the first part can also be a video segment with an identified subject, and the first frame rate is higher than the second frame rate.

[0041] In the above embodiment, high frame rate shooting can obtain more accurate content and better utilize the device to determine the location of the subject. However, high frame rate shooting consumes a lot of power. The device identifies important video clips and shoots these clips at a high frame rate. The frame rate is selectively adjusted according to the content being shot. Using a combination of high and normal frame rates can obtain a more accurate location of the subject while minimizing power consumption, thereby achieving more accurate comparison results.

[0042] In combination with some embodiments of the second aspect, in some embodiments, the one or more processors are specifically used to call the computer instructions to enable the electronic device to execute: the electronic device has a folding screen, the device is formed into two parts, a first screen and a second screen based on the folding screen, the device posture can be determined based on the angles of the two parts, the first posture of the device is recorded when recording the first video, and the second posture of the device is recorded when displaying reference information, the device compares the difference between the first posture and the second posture, and displays a second suggestion to adjust the second posture to the first posture. The user can restore the folding screen to the device posture when shooting the first video according to the second suggestion.

[0043] In the above embodiment, the user may adjust the opening and closing state of the folding screen during the process of shooting multiple videos. Through the second suggestion, the device can be restored to the posture when shooting the first video before shooting the second video, ensuring that the subject is in the same shooting conditions in the first video and the second video, and utilizing the post-production splicing of the device.

[0044] In combination with some embodiments of the second aspect, in some embodiments, the one or more processors are specifically used to call the computer instructions to enable the electronic device to execute: when the electronic device has cameras in multiple orientations, for example, a front camera and a rear camera, the device can prompt the user to use a camera with a suitable orientation to take pictures based on the position of the subject.

[0045] In the above embodiment, the device recommends a camera with a suitable orientation based on the position of the subject, so as to obtain a video with the best shooting effect.

[0046] In combination with some embodiments of the second aspect, in some embodiments, the one or more processors are specifically used to call the computer instructions to enable the electronic device to execute: the device first deletes the noise data when splicing the video, for example, when the user's first instruction or the second instruction is a gesture interaction, the video content is not the content that the user wants to shoot, so the device will automatically identify the fragment content of the instruction interaction, that is, the noise data in the first video, and delete the noise data in the first video; for example, when the third instruction is a gesture interaction during the recording of the second video, the video content is not the content that the user wants to shoot, so the device will automatically identify the fragment content of the instruction interaction, that is, the noise data in the second video, and delete the noise data in the second video; the first video and the second video after the noise data are deleted are spliced ​​to generate the final work.

[0047] In the above example, during the shooting process, some of the recorded video may contain content that the user does not want to shoot. The device automatically identifies and deletes the noise data to reduce the noise interference in the automatically spliced ​​video work.

[0048] In combination with some embodiments of the second aspect, in some embodiments, the one or more processors are specifically used to call the computer instructions to enable the electronic device to execute: process all interactive instruction operations, the instructions including specified gestures, motion recognition, voice recognition, touch operations, eye tracking or the electronic device posture detection, and various interactive instructions can realize the control of the start and end of video shooting.

[0049] In the above embodiment, the user can freely choose a suitable interaction method based on the scene, which brings the user a better shooting experience.

[0050] In a third aspect, an embodiment of the present application provides a computer-readable storage medium comprising instructions, which, when executed on an electronic device, enables the electronic device to execute a method as described in any possible implementation of the first and second aspects.

[0051] In a fourth aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when the computer program product is run on an electronic device, enables the electronic device to execute the method described in any possible implementation of the first and second aspects.

[0052] It is understandable that the electronic device provided in the second aspect, the computer storage medium provided in the third aspect, and the computer program product provided in the fourth aspect are all used to execute the methods provided in the embodiments of the present application. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding methods and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments, which will make the features, advantages, and other aspects of each implementation of the present disclosure more apparent. Several implementations of the present disclosure are shown here in an exemplary and non-limiting manner. In the drawings:

[0054] 1A to 1C are schematic diagrams of possible scenarios according to an embodiment of the present application;

[0055] 2A to 2F are schematic diagrams of a longitudinally foldable electronic device according to an embodiment of the present application;

[0056] 3A to 3F are schematic diagrams of the product form of a horizontally foldable electronic device provided in an embodiment of the present application;

[0057] 4A to 4E are schematic diagrams of outer screens of a longitudinally foldable electronic device provided in an embodiment of the present application;

[0058] 4F to 4H are schematic diagrams of outer screens of a horizontally foldable electronic device provided in an embodiment of the present application;

[0059] FIG5 is a schematic diagram of the hardware structure of an electronic device with a foldable screen provided in an embodiment of the present application;

[0060] FIG6 is a schematic diagram of the software structure of an electronic device with a foldable screen provided in an embodiment of the present application;

[0061] FIG7 is a schematic diagram of the main steps of an embodiment of the present application;

[0062] FIG8 is a schematic diagram of a process flow in an embodiment of the present application;

[0063] Figures 9A to 9D are schematic diagrams of previewing feasibility solutions during the transition phase of this application;

[0064] 10A to 10G are schematic diagrams of an interaction process provided in an embodiment of the present application;

[0065] 11A and 11B are schematic diagrams of possible graphic distortion according to an embodiment of the present application. DETAILED DESCRIPTION

[0066] Short videos are now in a stage of rapid development, and users love to beautify or re-create short videos from various videos to incubate new works.

[0067] In some video creation scenarios, the subject needs to be located in the same area of ​​the image at the end of the previous video and the beginning of the next video, so as to achieve a natural transition when the two videos are spliced ​​together. In this case, the connection between the two videos is particularly important. Creators can solve the problem of video connection by manually fixing the shooting position during shooting, adding changing animations, etc., but this undoubtedly greatly increases the user's workload. Users need to spend a lot of time calibrating the shooting position during the shooting process to ensure that the subject can be in the same position on the entire electronic device display at the connection between the two videos; in the later editing, it is also necessary to try to find the closest video image frames in the two videos for editing and splicing.

[0068] Figures 1A-1C illustrate the process of a user recording two videos. Figures 1A and 1B illustrate a possible scenario for a user's secondary creation. The backgrounds of the two videos need to be changed, but the subject must be kept in the same position on the display screen at the junction of the videos. In Figure 1A, the subject records the first video in Scene 1. The first video is 15 seconds long. Figure 1A shows the final clip of the first video, with the subject (the girl in Figure 1A) located in the lower left area of ​​the entire display screen 194. In Figure 1B, the subject records the second video in Scene 2. At this time, when recording in Scene 2, the subject (the girl in Figure 1B) needs to be adjusted again to the lower left area of ​​the entire display screen 194. After completing the recording of the two videos, the user uses video editing software to edit and splice the two videos. The user needs to identify two frames of image with a high degree of matching in the two videos as the splicing junction. Therefore, the matching degree of the image composition position at the beginning of the second video and the end of the first video determines the coherence of the two videos after splicing.

[0069] Figures 1A and 1C illustrate another possible scenario for user secondary creation, where the subject needs to change their outfits between the two videos. When the subject completes the costume change and begins the second video, they need to adjust as much as possible to the position they were standing in at the end of the first video. This ensures a natural transition when the two videos are spliced ​​together in post-production. Figure 1A shows the final clip of the first video, and Figure 1C shows the subject after they have changed their outfits and are filming the second video. At this point, the subject's starting position needs to be adjusted to the sitting position where the subject was standing in Figure 1A, improving the coherence of the two videos after splicing.

[0070] Against the backdrop of the short video shooting craze, creators have a demand for fast video splicing and editing. At the same time, more convenient and faster video splicing solutions have greatly lowered the editing technology threshold for ordinary creators, allowing more ordinary enthusiasts to quickly complete the creation of their own works and allowing more ordinary enthusiasts to join the short video shooting craze.

[0071] In the embodiments of this application, the subject refers to any entity that needs to be photographed. For example, the subject includes but is not limited to people, objects, vehicles, animals, etc. The state of the subject can be still or moving. The embodiments of this application do not limit the type and state of the subject. The following embodiments use people as an example for detailed description. When the subject is a person, the subject can directly complete the video capture and splicing independently through the selfie mode.

[0072] The embodiment of the present application provides a shooting method for quickly splicing videos, provides corresponding shooting guidance throughout the entire process of video creation, and at the same time, in the interval between the front and rear video recordings, previews the current shooting picture and the position of the subject directly adjusted according to the image information at the end of the previous video in real time on the display screen, so that the subject can adapt to the position at the start of the video recording more quickly and conveniently, thereby improving the matching degree of the front and rear videos, allowing creators to complete their splicing works more quickly and conveniently, and ensuring the continuity of the video connection.

[0073] In one possible implementation, the embodiments of the present application can use a foldable screen to quickly stitch together multiple captured videos. The foldable screen can rely on its own mechanical structure to stand steadily on the shooting table. At the same time, the foldable screen has multiple cameras, and the creator can choose the corresponding camera as needed. If the rear camera is used, the image quality of the video can be further improved. The technical solutions in the embodiments of the present application will be clearly and comprehensively described below with reference to the accompanying drawings. Among them, the "multiple" involved in the following embodiments of the present application refers to greater than or equal to two. The term "and / or" herein is simply a description of the association relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " herein, unless otherwise specified, generally indicates that the related objects are in an "or" relationship. In the description of the embodiments of the present application, the terms "first" and "second" are used only for the purpose of distinguishing the description and should not be understood to indicate or imply relative importance or order.

[0074] The terms "including," "having," and any variations thereof mentioned in the description of the embodiments of the present application are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or units is not limited to the listed steps or units, but may optionally include other steps or units not listed, or may optionally include other steps or units inherent to the process, method, product, or apparatus.

[0075] In the embodiments of the present application, "terminal device", "electronic device", "mobile terminal" and "terminal" all have the same meaning and can be interchanged.

[0076] The operating interface involved in the embodiments of the present application may also be referred to as a user interface (UI) or a graphical interface, or other names. The operating interface is an interface for human-computer interaction between an electronic device and a user. The electronic device can display and output relevant information through the interface, such as displaying images / text / data, etc., and can also receive user operations through the operating interface, such as touch / click / long press / double-click / drag / typing, etc. The commonly used form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of an electronic device.

[0077] Human-computer interaction (HCI; or, human-machine interaction, HMI) is a discipline that studies the interactive relationship between systems and users. The system here can be various machines, or computerized systems and software. Human-computer interaction can integrate various senses for interaction, such as through text, voice, vision, action, environment and other methods, and improve the user experience through multimodal interaction. The embodiments described in this application include various interactions between users and electronic devices, and the forms of interactive instructions also have various forms.

[0078] One possible method of interaction is for the user to directly perform touch operations on the user interface of the electronic device and send corresponding interaction instructions by clicking the corresponding controls. The user can also send corresponding interaction instructions by long pressing / double-clicking / dragging / typing on the user interface.

[0079] Another possible interaction method is voice control. Users can use fixed keywords such as "Xiaoyi" to activate voice control capabilities. During use, the electronic device receives the user's specified instructions or keywords and matches the specific interaction instructions corresponding to the keywords. These keywords can be keywords preset by the device, keywords set by the user, or keywords learned by the electronic device through machine learning during use.

[0080] Another possible method of interaction is user gesture recognition. Fixed gestures match the corresponding activated functions, and the corresponding interactive functions are realized by recognizing the user's gesture control. The gestures can be pre-fixed gestures, such as two-finger double-click, three-finger single-click, and any other gesture that can trigger a specified interaction. The gestures can be gesture commands in the air, such as air click, air slide, air drag, and OK gesture.

[0081] Another possible interactive implementation is motion recognition, which includes facial recognition. When a user makes a specific motion or facial expression, the electronic device executes the corresponding action. For example, if a subject smiles at the camera during a preview, the device can be considered to have completed the pose adjustment and initiate the capture.

[0082] Another possible interaction implementation method is gaze control, where the electronic device uses sensors to track the position of the human eye's gaze, and the user sends corresponding interaction instructions based on the gaze information. The interactive operations involved in the embodiments of this application are not specifically limited. In addition to the interaction implementation methods described above, any method for implementing human-computer interaction can also be used.

[0083] The camera application involved in the embodiments of this application is a software application that can realize the shooting of photos or videos. The shooting application mentioned in this application can be an application pre-installed in the terminal device, such as a camera, or it can be a program with a shooting function that the user downloads from the Internet or obtains and installs through other means while using the electronic device, such as WeChat.

[0084] It should be noted that in the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being more preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0085] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only some of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0086] The embodiment of the present application provides a display method for a folding screen, which can be applied to an electronic device 100 with a longitudinally folding screen or a transversely folding screen. The folding screen of the electronic device 100 can be folded along the folding edge to form at least two screens, such as screen A and screen B. Depending on the degree of folding, the folding screen can present a variety of forms. In the embodiment of the present application, the folding screen of the electronic device 100 can present an unfolded form, a forward half-folded form, and a forward folded form. Optionally, the folding screen of the electronic device 100 can also present a reverse half-folded form and a reverse folded form. When the folding screen presents an unfolded form, the electronic device 100 is in an unfolded state; when the folding screen presents a forward half-folded form or a reverse half-folded form, the electronic device 100 is in a half-folded state; when the folding screen presents a forward folded form or a reverse folded form, the electronic device 100 is in a folded state. The unfolded state, half-folded state, and folded state of the electronic device 100 are referred to as device postures.

[0087] For example, Figures 2A to 2F show a schematic diagram of the product form of an electronic device 100 with a longitudinal folding screen provided in an embodiment of the present application, where the folding edge of the longitudinal folding screen is perpendicular to the top edge line (for ease of description, the top edge line is referred to as the top edge) and the bottom edge line (for ease of description, the bottom edge line is referred to as the bottom edge) of the electronic device 100.

[0088] 2A is a schematic diagram of the unfolded form of the longitudinal folding screen. The longitudinal folding screen shown in FIG2A can be folded inward along the folding edge according to the direction 11a and / or 11b shown in FIG2A to form the forward semi-folded form of screen A (i.e., the second screen) and screen B (i.e., the third screen) shown in FIG2B and FIG2C. When the longitudinal folding screen is folded into screen A and screen B, screen A can be on the same side of the folding edge as the front camera on the electronic device 100. The longitudinal folding screen shown in FIG2C can continue to be folded inward along the folding edge according to the directions 11a and 11b shown in FIG2C to form the longitudinal folding screen in the forward folding form shown in FIG2D. As shown in FIG2D, after the longitudinal folding screen of the electronic device 100 is completely folded forward, screen A and screen B are opposite to each other and are invisible to the user.

[0089] In some embodiments, the longitudinal folding screen shown in FIG2A can further be folded outward along the folding edge to form screen A and screen B in a reverse half-folded configuration as shown in FIG2E . The longitudinal folding screen shown in FIG2E can further be folded outward along the folding edge in directions 22a and 22b shown in FIG2E to form a longitudinal folding screen in a reverse folded configuration as shown in FIG2F . As shown in FIG2F , after the longitudinal folding screen of the electronic device 100 is completely folded in reverse, screen A and screen B face each other, and the back of the electronic device 100 (i.e., the back of screen A and the back of screen B) are not visible to the user.

[0090] For example, Figures 3A to 3F show a schematic diagram of the product form of an electronic device 100 with a horizontally folding screen provided in an embodiment of the present application, where the folding edges of the horizontally folding screen are parallel to the top and bottom edges of the electronic device 100.

[0091] Among them, Figure 3A is a schematic diagram of the unfolded form of the horizontal folding screen. The horizontal folding screen shown in Figure 3A can be folded inward along the folding edge according to the direction 33a and / or 33b shown in Figure 3A to form the forward semi-folded form of screen A and screen B shown in Figures 3B and 3C. Among them, when the horizontal folding screen is folded into screen A and screen B, screen A can be on the same side of the folding edge as the front camera on the electronic device 100. The horizontal folding screen shown in Figure 3C can continue to fold inward along the folding edge according to the directions 33a and 33b shown in Figure 3C to form the horizontal folding screen in the forward folding form shown in Figure 3D. As shown in Figure 3D, after the horizontal folding screen of the electronic device 100 is completely folded forward, screen A and screen B are opposite to each other and are invisible to the user.

[0092] In some embodiments, the horizontal folding screen shown in Figure 3A can also be folded outward along the folding edge to form the reverse half-folded form of screen A and screen B as shown in Figure 4E. The horizontal folding screen shown in Figure 2E can continue to fold outward along the folding edge in the directions 44a and 44b shown in Figure 3E to form the horizontal folding screen in the reverse folded form as shown in Figure 3F. As shown in Figure 3F, after the horizontal folding screen of the electronic device 100 is completely folded in the reverse direction, screen A and screen B are facing each other, and the back of the electronic device 100 (i.e., the back of screen A and the back of screen B) are not visible to the user.

[0093] The foldable screen (either vertically or horizontally) provided in the embodiments of the present application further includes a display screen (screen C) on the back of screen A and / or screen B. The foldable screen, consisting of screens A and B, is the inner screen of the electronic device 100, with screens A, B, and the front camera located on the front of the electronic device 100. Screen C is the outer screen of the electronic device 100, with screen C and the rear camera located on the same side of the electronic device 100, i.e., the rear. When the rear camera is used, the captured image can be simultaneously previewed in real time on the outer screen, screen C.

[0094] In the embodiment of the present application, the outer screen C can be called the first screen, the A screen can be called the second screen, the B screen can be called the third screen, and the inner screen composed of the A and B screens can be called the fourth screen; the rear camera corresponding to the C screen can be called the first camera, and the front camera corresponding to the A screen can be called the second camera. It can be understood that the orientation of the C screen is consistent with the shooting direction of the rear camera (the back of the electronic device), and the orientation of the A screen is consistent with the shooting direction of the front camera (the front of the electronic device). When the folding screen configured in the inner screen of the electronic device is folded along the folding edge to form the A screen and the B screen, the front cameras corresponding to the B screen and the A screen (i.e., the second camera) are located on different sides of the folding edge.

[0095] 4A to 4E illustrate schematic diagrams of the outer screen of an electronic device 100 whose inner screen is configured as a vertical folding screen. FIG4F to 4H illustrate schematic diagrams of the outer screen of an electronic device 100 whose inner screen is configured as a horizontal folding screen.

[0096] Among them, the external screen C (first screen) can be a display screen of any size and characteristics, and can be located at any position on the back of the electronic device 100; similarly, the rear camera can be located at any position on the back, and the external screen C and the rear camera can be located on the same side of the folding edge as shown in 4A, or on both sides as shown in Figure 4D. For example, as shown in Figures 4A and 4B, an external screen C and a rear camera may be provided on the back of screen A in the vertical folding screen of the electronic device 100; as shown in Figure 4C, a flexible folding screen external screen C may be provided on the back of the vertical folding screen of the electronic device 100, with the external screen C located behind the inner screens A and B, and the rear camera may be located anywhere on the back of the inner screen, such as on the back of screen A or on the back of screen B in the figure; as shown in Figures 4D and 4E, an external screen C may be provided on the back of screen B in the vertical folding screen of the electronic device 100, with the rear camera located anywhere on the back of the inner screen, such as on the back of screen A or on the back of screen B in the figure; as shown in Figures 4D and 4E, the external screen C may also have a secondary front camera, with the secondary front camera and rear camera located on both sides of the folding edge of the electronic device 100. Figure 4D shows the back of an electronic device 100 with a vertical folding screen as the inner screen configuration, in a possible unfolded form.

[0097] For example, as shown in Figures 4F and 4G , a screen C can be positioned behind screen A in the horizontally foldable screen of electronic device 100. As shown in Figures 4B and 4G , when the foldable screen corresponding to the inner screen is fully folded forward, screens A and B are invisible to the user, while screen C is located behind screen A and is visible to the user. Screen C can be on the same side of the folded edge as the rear camera of electronic device 100.

[0098] For example, as shown in FIG4C , a vertically foldable C screen may be provided on the back of the inner screen A and screen B. For example, as shown in FIG4H , a horizontally foldable C screen may be provided on the back of the inner screen A and screen B. As can be seen from FIG4C and FIG4H , when the inner screen of the electronic device 100 (i.e., the folding screen composed of screens A and B) is in the unfolded form, the outer screen (i.e., screen C) is also in the unfolded form; when the inner screen of the electronic device 100 is folded, the outer screen is also folded accordingly; when the inner screen of the electronic device 100 is in the folded form, the outer screen is also in the folded form.

[0099] In an embodiment of the present application, for an electronic device 100 having a C screen, when the inner screen (i.e., a folding screen composed of screens A and B) is in a folded form, the electronic device 100 can display a user interface on screen C; when the inner screen is in a semi-folded form and an unfolded form, the electronic device 100 can display a user interface on screen A, screen B and / or screen C.

[0100] In an embodiment of the present application, for an electronic device 100 having a C screen, when the rear camera is working, the electronic device 100 selects a suitable display screen to display image data captured by the rear camera. When the inner screen (i.e., the folding screen composed of screen A and screen B) is in a folded form, the electronic device 100 can display the captured image on screen C; when the inner screen is in a semi-folded form and an unfolded form, the electronic device 100 can display the captured image on screen A, screen B and / or screen C.

[0101] In some embodiments, the folding screen of the electronic device 100 may surround the electronic device 100 , and the above-mentioned screen A, screen B, and screen C may all be part of the folding screen.

[0102] In an embodiment of the present application, the electronic device 100 can determine the form of the folding screen based on the detected angle α between screen A and screen B. In some embodiments, the angle α between screen A and screen B of the folding screen (vertical folding screen or horizontal folding screen) of the electronic device 100 takes a value range of [0°, 180°], and the electronic device 100 cannot be folded in the reverse direction. In some embodiments, the angle α between screen A and screen B of the folding screen (vertical folding screen or horizontal folding screen) of the electronic device 100 takes a value range of [0°, 360°], and the electronic device 100 can be folded both forward and reverse.

[0103] Exemplarily, when the electronic device 100 cannot be folded in reverse, the value range of α is [0°, 180°]. When the angle α∈[0°, P1), the electronic device 100 can determine that the folding screen is in a forward folding state, and the electronic device 100 is in a folded state; when the angle α∈[P1, P2), the electronic device 100 can determine that the folding screen is in a forward semi-folded state, and the electronic device is in a semi-folded state; when the angle α∈[P2, P3), the electronic device 100 can determine that the folding screen is in an unfolded state, and the electronic device 100 is in an unfolded state. Among them, 0°<P1<P2<180°, P1 and P2 are preset angle thresholds. P1 and P2 can be set by the user in the electronic device 100, or set by default by the electronic device 100.

[0104] In the embodiments of the present application, when the electronic device 100 is a foldable screen device, the electronic device 100 is in a semi-folded state. The user does not need to hold the electronic device 100 with both hands, and the electronic device 100 can independently stabilize the device for tasks such as shooting, video calls, and live streaming. In some embodiments, the electronic device 100 can also be independently stabilized when in the unfolded state without the user needing to hold the device with both hands. This frees the user's hands and provides a better user experience.

[0105] It should be noted that the at least two display screens formed after the folding screen in the embodiment of the present application is folded can be multiple independent display screens, or a complete display screen with an integrated structure, which is just folded into at least two parts.

[0106] For example, the foldable screen can be a flexible foldable screen, including folding edges made of a flexible material. Part or all of the flexible foldable screen is made of a flexible material. When the flexible foldable screen is folded, the at least two screens formed are a complete screen with an integrated structure, but are folded into at least two parts.

[0107] For another example, the foldable screen may be a multi-screen foldable screen. The multi-screen foldable screen may include multiple (two or more) display screens. These multiple display screens are multiple independent display screens. These multiple display screens may be connected in sequence via folding axes. Each screen may rotate about the folding axis connected to it, thereby folding the multi-screen foldable screen.

[0108] In the subsequent embodiments of this application, the method provided in the embodiments of this application will be described by taking the folding screen as an example in which the front side of the flexible folding screen is folded horizontally as shown in Figure 2A and the back side is configured as shown in Figure 4D.

[0109] The electronic device 100 may be equipped with Or terminal devices of other operating systems, for example, the electronic device 100 can be a mobile phone, tablet computer, desktop computer, laptop computer, handheld computer, notebook computer, ultra-mobile personal computer (UMPC), netbook, as well as cellular phone, personal digital assistant (PDA), augmented reality (AR) and virtual reality (VR) devices, etc., including the above-mentioned camera. If the electronic device 100 has a folding screen, the camera and the folding screen can be on the same side (front / back) of the electronic device 100. The embodiment of the present application does not impose any special restrictions on the specific type of the electronic device 100.

[0110] FIG5 shows a schematic structural diagram of the electronic device 100 .

[0111] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) connector 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, an angle sensor 180N, etc.

[0112] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0113] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0114] The processor can generate operation control signals based on instruction opcodes and timing signals to complete the control of instruction fetching and execution.

[0115] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 may be a cache memory. This memory can store instructions or data that have been used or are frequently used by processor 110. When processor 110 needs to use the instruction or data, it can directly access it from this memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0116] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface. The processor 110 may be connected to modules such as a touch sensor, an audio module, a wireless communication module, a display, and a camera through at least one of the above interfaces.

[0117] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0118] The charging management module 140 is used to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the electronic device through the power management module 141.

[0119] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), etc. The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor. The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100.

[0120] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0121] The wireless communication module 160 can provide wireless communication solutions for application on the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), Bluetooth low energy (BLE), ultra wide band (UWB), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc.

[0122] Electronic device 100 can implement display functions using a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0123] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-OLED, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or more display screens 194.

[0124] Display screen 194 can be a flat display, a curved display, or a foldable screen. When display screen 194 is a foldable screen, it includes at least a first display area and a second display area when folded. The first and second display areas have different light-emitting surfaces. The first display area is located in the first folded area, and the second display area is located in the second folded area. When the foldable screen is folded, the angle between the first and second areas is less than or equal to 0 degrees and less than 180 degrees.

[0125] The electronic device 100 can realize the camera function through the camera module 193, ISP, video codec, GPU, display screen 194, application processor AP, neural network processor NPU, etc.

[0126] Camera module 193 is used to capture still images or videos and can be used to collect color image data and depth data of the subject. The ISP can be used to process the color image data collected by camera module 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then transmitted to the ISP for processing and converted into an image visible to the naked eye. The ISP can also perform algorithmic optimization on image noise, brightness, and skin color. The ISP can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be provided in camera module 193.

[0127] In some embodiments, the camera module 193 may be composed of a color camera module and a 3D sensing module.

[0128] In some embodiments, the photosensitive element of the camera of the color camera module can be a charge coupled device (CCD) or complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then transmitted to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard format such as RGB or YUV.

[0129] In some embodiments, the 3D sensing module can be a time of flight (TOF) 3D sensing module or a structured light 3D sensing module. Structured light 3D sensing is an active depth sensing technology, and its basic components may include an infrared emitter, an IR camera module, and the like. The operating principle of a structured light 3D sensing module is to first emit a specific pattern of light spots at the object being photographed, then receive the light spot pattern coding on the object's surface, compare the similarities and differences with the original projected light spot, and calculate the object's three-dimensional coordinates using triangulation principles. These three-dimensional coordinates include the distance between the electronic device 100 and the object being photographed. TOF 3D sensing can be an active depth sensing technology, and its basic components may include an infrared emitter, an IR camera module, and the like. The operating principle of a TOF 3D sensing module is to calculate the distance (i.e., depth) between the TOF 3D sensing module and the object being photographed based on the time it takes for the infrared light to return, thereby generating a 3D depth map.

[0130] Structured light 3D sensing modules can also be used in facial recognition, motion-sensing game consoles, industrial machine vision inspection, and other fields. Time of Flight 3D sensing modules can also be used in game consoles, augmented reality (AR) and virtual reality (VR).

[0131] In other embodiments, the camera module 193 may also be composed of two or more cameras. The two or more cameras may include a color camera, which can be used to collect color image data of the object being photographed. The two or more cameras may use stereo vision technology to collect depth data of the object being photographed. Stereo vision technology is based on the principle of human eye parallax. Under natural light, two or more cameras are used to capture images of the same object from different angles, and then triangulation and other calculations are performed to obtain distance information between the electronic device 100 and the object being photographed, that is, depth information.

[0132] In some embodiments, the electronic device 100 may include one or more camera modules 193. Specifically, the electronic device 100 may include one front camera module 193 and one rear camera module 193. The front camera module 193 may generally be used to capture color image data and depth data of the photographer facing the display screen 194, while the rear camera module may be used to capture color image data and depth data of the subject (e.g., a person, scenery, etc.) facing the photographer.

[0133] In some embodiments, the CPU or GPU or NPU in the processor 110 can process the color image data and depth data collected by the camera module 193. In some embodiments, the NPU can identify the color image data collected by the camera module 193 (specifically the color camera module) through a neural network algorithm based on the skeleton point recognition technology, such as a convolutional neural network algorithm (CNN), to determine the skeleton points of the person being photographed. The CPU or GPU can also run a neural network algorithm to determine the skeleton points of the person being photographed based on the color image data. In some embodiments, the CPU or GPU or NPU can also be used to confirm the figure of the person being photographed (such as body proportions, fatness and thinness of body parts between skeleton points) based on the depth data and identified skeleton points collected by the camera module 193 (which can be a 3D sensing module), and can further determine the body beautification parameters for the person being photographed, and finally process the captured image of the person being photographed according to the body beautification parameters so that the body shape of the person being photographed in the captured image is beautified. The subsequent embodiments will describe in detail how to perform body beautification processing on the image of the photographed person based on the color image data and depth data collected by the camera module 193, which will not be described in detail here.

[0134] The digital signal processor is used to process digital signals and can also process other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0135] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0136] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.

[0137] In some embodiments, the electronic device 100 needs to identify the image content in the captured image, detect and track the position of the specified image content, and determine the outline of the specified image content. The application processor can send the pre-processed RGB image (or BGR image or single-channel image or grayscale image, etc.) to the NPU. The NPU can detect and track the position of the specified image content in the RGB image (or BGR image or single-channel image or grayscale image, etc.) through the AI ​​model, and determine the outline of the specified image content. The NPU can output the detection frame information or outline information of the specified image content to the application processor. The application processor can determine the cropping frame information based on the detection frame information and / or outline information of the specified image. The application processor can crop the video stream based on the cropping frame information, or the application processor can instruct the ISP to crop the video stream based on the cropping frame information.

[0138] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be saved on the external memory card or transferred from the electronic device to the external memory card.

[0139] The internal memory 121 can be used to store computer executable program code, which includes instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional methods or data processing of the electronic device 100 by running instructions stored in the internal memory 121, and / or instructions stored in a memory provided in the processor.

[0140] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0141] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.

[0142] The speaker 170A, also called a "speaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or output audio signals for hands-free calls through the speaker 170A.

[0143] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the user can place the receiver 170B close to the ear to hear the voice.

[0144] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, realize directional recording function, etc.

[0145] The headphone jack 170D is used to connect a wired headphone.

[0146] The pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal. The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., X, Y, and Z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, controls the reverse movement of the lens to offset the shaking of the electronic device 100, and achieves anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.

[0147] In an embodiment of the present application, the display screen 194 of the electronic device 100 can be folded to form multiple display screens. Each display screen can be provided with a gyroscope sensor 180B for measuring the orientation of the display screen (i.e., a direction vector perpendicular to the display screen and pointing from the inside of the electronic device 100 to the outside). The electronic device 100 can determine the angle between adjacent screens based on the change in the orientation of each display screen measured by the gyroscope sensor 180B.

[0148] Referring to Figures 1A to 2F , the display screen 194 of electronic device 100 can be folded to form adjacent screens A and B. Screen A is equipped with a gyroscopic sensor A, which allows electronic device 100 to measure the orientation of screen A. Screen B is equipped with a gyroscopic sensor B, which allows electronic device 100 to measure the orientation of screen B. Based on the measured changes in the orientations of screens A and B, electronic device 100 can determine the angle α between screens A and B.

[0149] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude based on the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.

[0150] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip case. If the electronic device is a foldable device, the magnetic sensor 180D can be used to detect whether the electronic device is folded or unfolded, or the folding angle. In some embodiments, if the electronic device 100 is a flip device, the electronic device 100 can detect the opening and closing of the flip cover based on the magnetic sensor 180D. Based on the detected opening and closing status of the leather case or the flip cover, features such as automatic unlocking of the flip cover can be configured.

[0151] Accelerometer 180E can detect the magnitude of acceleration of electronic device 100 in all directions (generally three axes). It can also detect the magnitude and direction of gravity when electronic device 100 is stationary. It can also be used to identify the electronic device's posture, enabling applications such as switching between landscape and portrait modes and pedometers.

[0152] The distance sensor 180F is used to measure distance. The electronic device 100 can measure distance using infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure distance to achieve fast focusing.

[0153] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The electronic device 100 emits infrared light through the LED. The electronic device 100 uses the photodiode to detect infrared reflected light from nearby objects.

[0154] Ambient light sensor 180L can be used to sense ambient light brightness. Electronic device 100 can adaptively adjust the brightness of display screen 194 based on the perceived ambient light brightness. Ambient light sensor 180L can also be used to automatically adjust white balance when taking photos. Ambient light sensor 180L can also work with proximity light sensor 180G to detect whether electronic device 100 is obstructed.

[0155] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0156] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. The touch sensor 180K is also called a "touch device". The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0157] The bone conduction sensor 180M can acquire vibration signals.

[0158] Angle sensor 180N can be used to determine the unfolding angle of the foldable display screen 194 when it is a foldable screen. This angle sensor 180N can be located at the bend of the foldable display screen of the electronic device 100. The electronic device 100 can use angle sensor 180N to measure the angle formed by the two ends of the middle bend of the foldable display screen during folding. The angle formed by the two ends of the bend of the electronic device 100 can be used to determine the physical form of the electronic device 100, such as half-folded, folded, or unfolded.

[0159] The buttons 190 may include a power button, a volume button, etc. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.

[0160] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. Motor 191 can also correspond to different vibration feedback effects for touch operations acting on different areas of the display screen 194. Indicator 192 can be an indicator light, which can be used to indicate charging status, power changes, and can also be used to indicate messages, missed calls, notifications, etc.

[0161] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0162] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present application, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.

[0163] FIG6 is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present application.

[0164] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into five layers: from top to bottom: the application layer, the application framework layer, the Android runtime (ART) and native C / C++ libraries, the hardware abstraction layer (HAL), and the kernel layer.

[0165] The application layer can include a series of application packages.

[0166] As shown in FIG6 , the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.

[0167] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0168] As shown in FIG6 , the application framework layer may include a window manager, a content provider, a view system, a resource manager, a notification manager, an activity manager, an input manager, and the like.

[0169] The window manager provides window management services (WMS). WMS can be used for window management, window animation management, surface management, and as a transfer station for the input system.

[0170] Content providers are used to store and retrieve data and make it accessible to applications. This data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0171] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0172] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0173] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0174] The Activity Manager can provide Activity Management Service (AMS), which can be used to start, switch, and schedule system components (such as activities, services, content providers, and broadcast receivers) as well as manage and schedule application processes.

[0175] The Input Manager provides Input Management Service (IMS), which manages system inputs, such as touch screen input, key input, and sensor input. The IMS retrieves events from input device nodes and, through interaction with the WMS, distributes the events to the appropriate window.

[0176] The Android runtime consists of the core libraries and the Android runtime. The Android runtime is responsible for converting source code into machine code. It primarily utilizes ahead-of-time (AOT) and just-in-time (JIT) compilation technologies.

[0177] The core library primarily provides basic Java class library functionality, such as basic data structures, mathematics, IO, tools, databases, and networking. It also provides an API for users to develop Android applications.

[0178] Native C / C++ libraries can include multiple functional modules, such as surface manager, media framework, libc, OpenGL ES, SQLite, Webkit, etc.

[0179] Among them, the surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications. The media framework supports the playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. OpenGL ES provides the drawing and operation of 2D graphics and 3D graphics in the application. SQLite provides a lightweight relational database for the application of the electronic device 100.

[0180] The hardware abstraction layer runs in user space, encapsulates kernel layer drivers, and provides a calling interface to the upper layer.

[0181] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0182] The following describes the workflow of the software and hardware of the electronic device 100 in conjunction with capturing a photo scene.

[0183] When the touch sensor 180K receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including touch coordinates, touch operation timestamp, and other information). The raw input event is stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer and identifies the control corresponding to the input event. For example, if the touch operation is a touch single-click operation and the control corresponding to the single-click operation is the control of the camera application icon, the camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer to capture a still image or video through the camera 193.

[0184] In the embodiment of the present application, the electronic device 100 may be a foldable screen device, that is, the electronic device 100 has a foldable display screen. The electronic device 100 may also be a dual-screen device, that is, the electronic device 100 includes two independent display screens. The electronic device 100 may also be a device including at least three display screens, which is not limited in the embodiment of the present application. It is understood that when the electronic device 100 includes multiple display screens, if one of the display screens is a foldable display screen, the electronic device 100 may also be referred to as a foldable screen device.

[0185] The user can interact with the electronic device 100 through gestures, voice, etc., for example, opening an application on the electronic device 100, or opening a functional module in the application such as a mini-program, quick app, etc.

[0186] Some user operations on the electronic device 100 can cause the display state of the electronic device 100 to switch. For example, if the electronic device 100 includes a foldable display, when the user unfolds the electronic device 100, the entire area of ​​the foldable display can be used to display content; when the user folds the electronic device, a portion of the foldable display (such as the area facing the user) can be used to display content. If the electronic device 100 also includes a candy bar display, when the user folds the electronic device 100, the display state of the electronic device 100 can also switch from displaying images on the foldable display to displaying images on the candy bar display.

[0187] In the description of the embodiment of the present application, the terminal has a foldable screen form factor. The terminal is not limited to mobile phones, but also includes other mobile terminal devices with camera functions and foldable screens, such as tablet computers. The camera of the terminal with a foldable screen can be located at any position of the electronic device 100, such as below the screen, inside the screen, or between the display screen and the back cover, or on the side frame of the terminal. At the same time, the hinge of the foldable screen may be located in the middle of the screen or not. In the description of this embodiment, the hinge of the foldable screen is taken as an example to be located in the middle of the screen.

[0188] The above technology is an introduction to the hardware and software structures of the electronic devices involved in this solution. Next, based on the above content, a detailed introduction is given to the shooting method based on the folding screen in this solution. The solution of the present invention is applicable to video shooting. In the description of this embodiment, video shooting is used as an example for explanation.

[0189] The solution of the present invention is applicable to video shooting. In the description of the embodiments of the present invention, video shooting is taken as an example for illustration.

[0190] The user activates the assisted shooting function for stitched recording. After starting the first video, in response to the user stopping the first video, the app enters a transition phase, which displays reference information to facilitate the adjustment of the subject's position. During this transition phase, the user can complete all preparations for the next shot, including but not limited to adjusting the subject's makeup and clothing, changing the shooting background, etc. Simultaneously, during this transition phase, the subject adjusts the starting position of the second video based on the matching prompts of the electronic device, ensuring the continuity of the two videos when stitched together.

[0191] In one possible implementation, during the transition phase, reference information and the currently captured real-time image are displayed simultaneously on the screen, allowing the user to adjust the subject's position by comparing the reference information. The electronic device can also provide corresponding matching and position adjustment suggestions based on the depth information of the two videos for the user's reference. The reference information is generated based on the image data at the end of the previous video.

[0192] In one possible implementation, a method for previewing the matching display during the transition phase is to divide the display area into two parts, one part directly displays the content of the last segment of the previous video, and the other part previews the image data collected by the current camera in real time.

[0193] As shown in Figure 9A, display screen 194 is divided into two display areas: viewing area 904 displays the final image of the previously recorded video, while live preview area 905 displays the image currently being captured by the camera. The electronic device compares the depth information of the image in live preview area 905 with the depth information corresponding to the final image played in viewing area 904, and displays the matching degree and suggestions in real time in comparison results 906.

[0194] As shown in FIG9A , it is assumed that the background content does not undergo any displacement change during the entire recording process (the background in the figure is a table with a microwave oven placed on the table), the electronic device is placed directly in the center of the table, and no displacement or posture adjustment occurs. Only the recorded person (subject) undergoes displacement changes between the previous and next videos.

[0195] The subject was positioned directly in front of the background desktop in the image at the end of the previous video. During the transition phase, when the subject's position was adjusted, they were now positioned to the side of the background desktop. Comparing the depth information between the two images reveals that the subject's position during the transition phase was located to the rear right of the frame. The match score at this point is 70%, indicating that the subject should move to the front left of the frame. However, since the subject is facing the camera, the suggestion is to move the subject to the right and front. A higher match score indicates a smaller difference between the two images, and a better adaptation.

[0196] Another possible method for previewing the matching display during the transition phase is to divide the display area into two parts. One part displays the content of the end of the previous video segment, and the other part previews the image data collected by the current camera in real time. To better distinguish the two areas, the two areas are displayed with different levels of transparency, allowing users to better distinguish the two image areas.

[0197] As shown in FIG9B , in order to more clearly distinguish the viewing area 904 from the real-time preview area 905 , the end image of the previous video can be displayed in a semi-transparent manner, while the current real-time preview image is still displayed in a normal manner.

[0198] Another possible method of previewing the matching display during the transition phase is to directly frame the image display area at the end of the previous video in the real-time preview screen, so that the user can more intuitively understand the specific position of the subject in the shooting screen at the end of the previous video.

[0199] As shown in Figure 9C, the image data collected by the current camera in real time is displayed on the display screen 194, and the framed area 908 on the display screen 194 draws the position of the subject in the image at the end of the previous video. When the user records the next video, he can adjust the subject in the starting image to the framed area 908 to improve the adaptability of the two videos.

[0200] As shown in Figure 9D, the image data collected by the current camera in real time is displayed on the display screen 194. At the same time, the framed area 908 in the display screen 194 directly outlines the outline of the subject in the image at the end of the previous video. When the user records the next video, the subject can be adjusted to the outline outlined by the selection area 908 in the starting image. The subject can also choose the same shooting action as the image at the end of the previous video, so that the two videos can have better adaptability when splicing.

[0201] In addition to being directly displayed on the screen as shown in FIG. 9A to FIG. 9D , the comparison suggestion 906 may also be prompted to the user in other ways, such as voice prompts, direction guidance, and the like.

[0202] One possible method for calculating the matching degree is to use an image similarity algorithm to perform the calculation. An arbitrary frame of image data in the real-time preview area is selected and its similarity is calculated with all image data frames of the reference information of the previous video. The maximum value calculated by the image similarity algorithm is the similarity between the previous video and the preview video, that is, the matching degree of the current preview area.

[0203] The present invention does not impose any limitation on the calculation of the matching degree, and any solution that can calculate the matching degree of the front and back end videos is acceptable.

[0204] The following describes the overall process of auxiliary shooting provided by an embodiment of the present application. FIG7 is a schematic diagram of the main steps of the method, which illustrates a method for stitching video recording using auxiliary shooting provided by an embodiment of the present application. The method can be executed by a terminal device equipped with a camera, including but not limited to steps S701-S705, which are described in detail below:

[0205] S701: Receive the first user interaction instruction and start the function:

[0206] The user sends a first interaction instruction, and after the device receives the first interaction instruction, the electronic device starts the auxiliary shooting function in the application, and the device turns on the stitching video function. The device captures images through the camera and can observe the collected image data in real time through the display screen.

[0207] In another possible implementation, in order to achieve better shooting effects, the rear camera is specified to be used for video recording. After starting the application, the user needs to be prompted to use the rear camera for video recording.

[0208] In another possible implementation, the electronic device will identify the current device posture and match the corresponding prompt strategy according to the current device posture. For example, when it is identified that the current device is in the unfolded state, it indicates that the user is using the internal screen to work, and the user is prompted to flip the electronic device over and adjust the external camera to the correct working position. The user adjusts the device to a suitable posture and places it on the desktop, and then uses the external camera for subsequent shooting. When it is identified that the current device is in the folded state, it indicates that the user is using the external screen to work, and the user is prompted to adjust the device to a suitable posture and place it on the desktop, and then uses the external camera for subsequent shooting. When it is identified that the current device is in the semi-folded state, the user is prompted that the subsequent recording function requires the use of an external camera, and the user adjusts the external camera to the correct working position and adjusts the device to a suitable posture and places it on the desktop for recording.

[0209] The posture of the electronic device is determined according to the method described above, and the recognition of the device posture can also be achieved through other technical solutions.

[0210] Among them, the suitable posture of the electronic device in the embodiment of the present invention is the working posture adopted by the electronic device when performing splicing video recording. If a folding screen device is used at this time.

[0211] S702: Start recording the first video:

[0212] In one possible implementation scheme for starting recording of the first video, the user issues an interactive instruction to start shooting the first video. After receiving the instruction, the electronic device responds to the user's interactive instruction and starts recording the first video. Before starting, a countdown prompt can be displayed on the external screen display of the electronic device.

[0213] In another possible implementation scheme for starting the first video recording, the user can set the trigger conditions for starting the first recording. When it is detected that the trigger conditions are met, the electronic device starts recording the first video. Before the start, a countdown prompt can be displayed on the external screen display of the electronic device.

[0214] Among them, one possible trigger condition is the delayed shooting time set by the user. After setting the time, the device enters the countdown stage of the delayed shooting time. When the countdown ends, the device automatically starts recording the first video.

[0215] Among them, another possible trigger condition is a pre-set expression, gesture or action. When the user shows the specified facial expression, gesture or action, it is determined that the user is ready to enter the shooting stage, and the electronic device starts recording the first video.

[0216] In another possible implementation scheme for starting the recording of the first video, the electronic device makes a judgment based on the built-in startup strategy. When the electronic device meets the startup conditions, it automatically starts recording the first video. Before starting, a countdown prompt can be displayed on the external screen display of the electronic device.

[0217] Among them, one possible startup strategy is based on the duration of the device's appropriate working posture. After the electronic device is adjusted to a suitable working posture, the current posture of the device is continuously monitored. When the device maintains the working posture for a certain time threshold, the device does not adjust any posture. It is assumed that the device has been adjusted to the user's expected shooting position, and the device automatically starts recording the first video.

[0218] Among them, another possible startup strategy is based on the duration that the device lens captures a person. When the rear camera of the electronic device is working, it continuously captures the content. When it is found that there are people in the captured pictures within a certain period of time, it can be determined that the device is in the shooting working state, and the device automatically starts recording the first video.

[0219] In all possible embodiments of the present application, when the first recording is started, the video image captured by the device at the start of recording is very likely to be irrelevant to the current shooting content. In order to present a better video stitching effect, when the video recording is started, a start countdown is displayed on the external screen display interface to give the user a certain amount of preparation time. The device starts formal video recording after the countdown is completed.

[0220] S703: End recording of the first video.

[0221] The electronic device continuously captures the first video and terminates recording of the first video when a certain condition is met. Prior to terminating recording of the first video, the electronic device detects depth information of the currently captured image at a certain frequency during the continuous capture process and stores the corresponding depth information in a designated memory space of the device.

[0222] In a possible implementation scheme for storing depth information, the electronic device stores all the depth information detected during the video recording process, and stores it in a designated space according to the time of video recording, so as to match the depth information with the recorded video in time.

[0223] In another possible implementation scheme for saving depth information, the electronic device continuously detects the depth information of the picture at a certain frequency during the shooting process, but only dynamically saves the image depth information of the last few seconds. During the video recording process, the depth information of the last few seconds is continuously refreshed to ensure that the saved image depth information corresponds to the last few seconds of the recorded video.

[0224] In a possible implementation scheme for ending the recording of the first video, the user issues an interactive instruction to end the first video. After receiving the instruction, the electronic device responds to the instruction and ends the recording of the first video. Before the end, an end countdown prompt can be presented on the external screen of the electronic device.

[0225] In another possible implementation scheme for ending the recording of the first video, the user can set a trigger condition for ending the first recording. When it is detected that the trigger condition is met, the electronic device ends the recording of the first video, and an end countdown prompt can be displayed on the external screen of the electronic device before the end.

[0226] One possible trigger condition is that the user pre-sets the duration of each video. The device begins counting the duration from the moment the video starts recording. When the duration reaches the preset duration, the device automatically ends the recording of the first video. The preset duration can be a pre-set duration in the device system or a duration set by the user later.

[0227] Among them, another possible trigger condition is a pre-set expression, gesture or action. When the user shows a specified facial expression, gesture or action, it is determined that the user is ready to end the shooting stage, and the electronic device ends the recording of the first video. Before the end, an end countdown prompt can be displayed on the external screen of the electronic device.

[0228] In another possible implementation of ending the recording of the first video, the electronic device makes a determination based on a built-in automatic ending strategy, and automatically ends the recording of the first video when the electronic device meets the ending condition.

[0229] Another possible termination strategy is based on the content continuously captured by the device's lens. If no people appear in the captured images for a certain period of time, the device can determine that the user has completed the current shooting task, and the device will automatically end the recording of the first video. Before the end, a countdown prompt can be displayed on the external screen of the electronic device. The duration of the continuous determination can be a preset time period of the device system or a time period set by the user.

[0230] Among them, one possible ending strategy is based on the posture of the device. When it is detected that the posture of the folding device has changed during the recording of the first video, the device directly and automatically ends the recording of the first video. Before the end, an end countdown prompt can be displayed on the external screen of the electronic device.

[0231] Among them, the posture change of the device can be that the device is in the unfolded state at the beginning of the first recording, and is folded by the user during the recording process, changing the device posture to the folded state; the posture change of the device can be that the device is in the unfolded state at the beginning of the first recording, and is folded by the user during the recording process, changing the device posture to a semi-folded state, and the folding angle matched by the changed semi-folded state is smaller, resulting in the inability to support the device to be placed on the shooting table; the posture change of the device can also be a change in the folding angle of the device in the semi-folded state, the folding angle of the electronic device is larger at the beginning of the first recording, and the electronic device can be placed stably on the table for shooting, and during the recording process, the electronic device is folded by the user, and the folding angle after the folding operation causes the electronic device to be unable to be placed stably on the shooting table, or the posture of the electronic device may be directly adjusted to the folded state. These posture changes may cause the device to be unable to rely on its own mechanical mechanism to be placed stably on the shooting table, and use the rear camera to shoot, so it can be considered that the user plans to end the shooting of the first video.

[0232] In all possible embodiments of the present application, when the first recording ends, the video image captured by the device near the end moment is very likely to be irrelevant to the current shooting content. In order to present a better video splicing effect, the electronic device can appropriately crop the video clip at the last end moment of the first video.

[0233] One possible trimming solution is to automatically identify the user's actions captured at the end of the first video as ending operations rather than the video content. For example, if a specified user expression, gesture, or action is used as a trigger condition, when the trigger condition is met and the first video ends, the electronic device will automatically identify the user's ending operation video segment in the last time period of the first video and directly delete the video clip within that period.

[0234] Another possible trimming solution is to set a fixed end time, deleting the video segments within the last fixed end time of the first video and retaining the remaining video segments. The fixed end time can be a device preset end time or an end time determined by user input.

[0235] Among them, whether to trim the video's final ending moment and delete the video clip can also be chosen by the user. After the first video ends, the electronic recognition external screen display pops up a selection dialog box for whether to automatically trim the ending moment video clip. If the user chooses automatic trimming, the electronic device will trim according to any of the above-mentioned trimming schemes, delete the final ending moment video clip of the first video, and retain the remaining video data; if the user chooses to keep the ending process content operation video clip, the electronic device will save the entire first video.

[0236] In an embodiment of the present application, after the first video is finished, the captured first video data and the corresponding image depth information can be automatically saved to the designated memory space of the electronic device; the user can also confirm whether to save, and a dialog selection box for whether to save will pop up on the external screen display of the electronic device. If the user chooses to save, the first video data and the corresponding image depth information will be saved to the designated memory space of the electronic device; if the user chooses to give up saving, the electronic device will directly delete the first video data and the corresponding image depth information data, and end the first recording.

[0237] S704, transition stage, image preview matching

[0238] The electronic device simultaneously displays the image information at the end of the first video and the image data currently captured by the rear camera in real time on a display interface of the electronic device, and simultaneously collects depth information data of the current preview data in real time at a certain frequency. The electronic device compares the depth information of the real-time preview data with the depth information corresponding to the image data at the end of the first video, determines whether the current real-time preview video image matches the content of the first video, and provides corresponding adjustment suggestions.

[0239] When comparing the depth information of the first video and the real-time captured image, the electronic device can display the current degree of match on the electronic device's display interface. For example, if the depth information match reaches 80%, the user can intuitively understand the difference in depth information between the current shooting content and the data image at the end of the first video. At the same time, the electronic device can determine the difference in the position of the subject when the current preview screen and the data at the end of the first video were shot based on the real-time depth information comparison results, and provide the user with specific adjustment suggestions on the external screen display interface. The user can change the shooting position of the subject based on the adjustment suggestions to ensure a better subsequent video stitching effect.

[0240] For example, when the electronic device recognizes that the depth information of the image currently being previewed in real time is less than the depth data of the data image at the end of the first video, it means that the shooting distance between the current electronic recognition and the subject is shorter than the distance when the first video was shot. The external screen display interface of the electronic device can display a "move back" suggestion, and the user can move the subject away from the electronic device. While the user is adjusting the position of the subject, the external screen display interface can continuously provide the current matching degree and position change suggestions. Through the electronic device position change suggestion, the user continuously adjusts the position of the subject and the external camera of the electronic device to improve the matching degree, thereby ensuring that the data video at the end of the first video can be better spliced ​​with the starting video of the second video.

[0241] S705: Start recording the second video:

[0242] After the user completes the preview and matching work before the second video, the recording of the second video can be started. The possible solutions for starting the second video can refer to the solution for starting the recording of the first video in step S702.

[0243] In addition to the possible technical solutions described in step S702, there are other technical solutions that can be used to start recording the second video.

[0244] Another possible solution for starting the recording of the second video is based on the matching degree calculated in step S704. There is a threshold matching degree value. When the electronic device detects that the matching degree between the current preview image and the data at the end of the first video reaches the threshold matching degree, it indicates that the shooting distance and composition similarity between the two are already very high, which can ensure the continuity of subsequent video splicing, and the second video recording can be automatically entered directly. Among them, the threshold matching degree value can be a preset value in the electronic device, or it can be a value set by the user according to his or her own splicing accuracy requirements. Before entering the second video, a countdown prompt can be displayed on the external screen of the electronic device.

[0245] In another possible solution, the user may want to adjust to a better shooting position. After the electronic device recognizes that the matching degree between the two reaches the threshold matching degree, a selection dialog box pops up on the external screen display interface of the electronic device, and the user decides whether to continue to adjust the position. If the user chooses to continue adjusting, after the user adjusts to a satisfactory matching degree or shooting position, the user's interactive operation will start the recording of the second video; if the user does not choose to continue adjusting, the electronic device will start recording the second video. Before entering the second video, a countdown prompt can be displayed on the external screen of the electronic device.

[0246] After recording the second video begins, the electronic device selects an optimal intelligent optimization algorithm based on the comparison and analysis of the final data of the first video and the preview data in step S704, and performs data optimization on the initial video segment of the second video, thereby ensuring a better match between the initial video segment of the second video and the final video segment of the first video. At this point, the electronic device can display the optimized video data on its external display screen; alternatively, it can continue to display the video image data currently being captured by the rear camera in real time.

[0247] S706, end recording

[0248] During the recording process, the electronic device can splice the first video and the second video. When the electronic device finishes recording, it can directly display the spliced ​​video data. For possible solutions to end the recording, please refer to the technical solution for ending the first video recording in step S703.

[0249] One possible video stitching method is that the electronic device uploads the first and second videos it has taken to the cloud, and can also carry the working posture data of the electronic device during the shooting process, the identification of the video stream, synchronization information, shooting information, recording parameter information, etc. The cloud selects the optimal algorithm based on the first and second videos to stitch the videos, and then sends the stitched work to the electronic device.

[0250] Another possible video stitching method is that the electronic device completes the video stitching work directly on the device itself. The electronic device has a built-in automatic stitching algorithm that identifies image frames with a higher degree of matching based on information related to the first and second videos shot, and automatically completes the stitching of the two videos.

[0251] This application does not limit the video splicing method. In addition to the above-mentioned splicing method, any other method for splicing multiple videos is applicable. You can also directly use existing video file merging and saving technology (for example, OpenCV's video splicing technology) to merge multiple videos into a single video in a certain order. Among them, for audio synthesis, you can also refer to the video file synthesis and saving method.

[0252] When the recording ends, in addition to directly displaying the automatically stitched video data, the original first and second videos will also be retained in the designated space. Users can later stitch and edit the videos according to their own needs.

[0253] FIG8 shows a flow chart of a possible implementation scheme in an embodiment of the present application, which shows all possible events that may occur during the auxiliary shooting process through processes S801-S806.

[0254] The electronic device receives the instruction to activate the shooting function and activates the shooting function. The operation of starting the application in S801 can adopt any possible solution described in S701. The electronic device determines whether there is a signal to trigger the current video recording. The conditions for this determination can refer to any possible solution described in step S702 or S705 above. When the triggering conditions for starting the current video recording are met in S801, the electronic device begins recording the current video and also records and saves the corresponding image depth data. The specific implementation method can refer to any possible technical solution described in step S702.

[0255] If the conditions for starting the adaptive recording are not met in S802, the entire auxiliary shooting is terminated directly. There are many possibilities for not meeting the conditions for starting the recording of this video segment.

[0256] One possible solution for not starting the recording of this video is that the user directly performs an interactive operation to end the auxiliary shooting work. The end instruction directly changes the auxiliary shooting function process from a foreground service to a background service or directly closes the auxiliary shooting function process, such as ending the auxiliary shooting function, directly exiting the shooting application, starting other applications, etc.

[0257] Another possible reason for not starting the video recording is that the posture of the electronic device has changed, causing the electronic device to be unable to rely on its own structure to remain stable on the desktop for shooting.

[0258] Another possible solution for not starting video recording is that the memory area designated by the device for storing captured videos is full and there is no storage space to save subsequent captured content. The electronic device can prompt the user to delete some content to provide more storage space.

[0259] When the condition for ending the current video recording is met, the electronic device ends the current video recording. The condition for ending the first video recording can refer to any possible technical solution described in step S703.

[0260] After finishing the current video recording, the user needs to confirm whether to record the next video in S804. If the user chooses not to record the next video, the auxiliary shooting ends and the electronic device stores the content of the current video shooting in the designated memory area.

[0261] After the electronic device starts recording the current video, when it detects that the conditions for ending the current video recording are met, the electronic device performs S803 to end the current video recording operation. The specific end triggering conditions can refer to any technical solution in S703.

[0262] Next, it is necessary to confirm in S804 whether to continue recording the next video. If it is determined to be necessary, the electronic device enters the transition stage S805. During the transition stage, the user can see the display of the end segment of the previous video and a preview of the real-time image captured by the current camera. The user can adjust the distance and direction of the photographed object and the camera according to the matching suggestions of the electronic device. The specific implementation method can refer to any possible technical solution described in step S704.

[0263] If it is determined in step S804 that the next shot does not need to be continued, the auxiliary shooting is ended directly and the process jumps to step S806 to end. The user may not be able to perceive whether to continue the next shot.

[0264] One possible technical solution for determining whether to continue the next recording is that the electronic device pops up a selection dialog box on the display interface, and the user chooses whether to continue the next recording. When the user chooses no, it is determined that the next recording will not be continued.

[0265] Another possible technical solution for determining whether to continue recording the next segment is for the electronic device to record the number of video clips captured. When the number of video clips captured in this auxiliary shooting reaches a set threshold, it indicates that all footage has been captured and there is no need to continue shooting the next segment. The threshold number of shots can be a pre-set internal value or a value entered or confirmed by the user based on the shooting purpose.

[0266] After completing the transition phase adjustment in S805, the electronic device re-enters the process of shooting the next video and again detects whether the conditions for starting video recording are met. The conditions that are met can refer to any possible solution described in step S702 or S705, and then the shooting cycle continues.

[0267] The end of S806 of the auxiliary shooting function represents the completion of the entire shooting task. At the end, all video clips recorded in this shooting are saved in the electronic device, and a finished video generated by editing all the video clips may also be saved.

[0268] As shown in the end process from S802 to S806 in the figure, when video recording is started at any stage, when the video recording fails to meet the start conditions, the auxiliary shooting will be terminated.

[0269] As shown in the end process from S804 to S806 in the figure, when the video recording is completed at any stage, when it is determined that the next stage of recording is not needed, the auxiliary shooting will also be ended.

[0270] In the embodiment of the present application, if a folding screen device is used for video stitching, it can be ensured that while shooting is being performed with the rear camera, the transition phase and shooting preview can be performed simultaneously on the external screen, so the subject can complete multiple video recordings and quick stitching independently.

[0271] The embodiment of the present application involves the splicing of multiple videos. The splicing process is to match the end image data of the previous video with the starting image data of the next video. Key frames can be selected to calculate the image matching degree.

[0272] In the embodiments of the present application, there is no specific limitation on the technology for splicing two videos, and any technical solution for implementing video splicing can be used.

[0273] In the embodiments of the present application, there is no limitation on the end image data selected for splicing. The end image data can be the end segment of a video of a certain length, such as the last 2 seconds of the current video segment; the end image data can also be the image data of the last frame of the current video segment; the end image data can also be the best image data generated by the electronic device based on the end segment of the current video segment; the end image data can also be the best image data generated by the key frame image recognized by the electronic device. The end image data can also be referred to as the end image, end data, or end data image.

[0274] In the embodiments of the present application, there is no limitation on the starting image data selected for stitching. The starting image data can be the starting segment of a video of a certain length, such as the first 2 seconds of the current video recording; the starting image data can also be the image data of the first frame of the current video recording; the starting image data can also be the best image data generated by the electronic device based on the starting segment of the current video; the starting image data can also be the best image data generated by the electronic device based on the key frame image recognized by the electronic device. The starting image data can also be referred to as the starting image, starting data, or starting data image.

[0275] Frame rate is the frequency (rate) at which individual images are stitched together and displayed in rapid succession on a display. It is a metric used to measure the number of frames displayed. The unit of measurement is frames per second (FPS) or Hertz (Hz). FPS is generally used to describe the number of frames per second in movies, electronic graphics, or games. Frames are often referred to as the number of "pictures" displayed per second. One frame is one image per second, and 24 frames is 24 images per second.

[0276] Due to the unique physiological structure of the human eye, people perceive videos with a frame rate higher than 24 fps as continuous. This phenomenon is known as persistence of vision. Most videos viewed daily have a frame rate of 25 or more. Currently, when using mobile device recording, if the frame rate is too low, motion blur may appear in the video due to the longer exposure time for each frame. In principle, the higher the frame rate, the smoother the video.

[0277] The higher the shooting frame rate and the larger the number of frames, the more images are obtained per second, the more video data information is obtained, and the better the post-processing of the image can be.

[0278] In order to ensure better stitching effect of multiple video clips and collect more image information at key shooting nodes, in all embodiments described in this application, a high frame rate mode can be used at key nodes of video recording to obtain better video stitching effect.

[0279] In the embodiments of the present application, high frame rate mode refers to recording video at a higher frame rate than the standard frame rate. When the camera application uses a first frame rate, i.e., the standard frame rate, for normal video recording, and switches to a second frame rate higher than the first frame rate, high frame rate mode is considered to be in effect.

[0280] One possible approach to achieving high frame rate mode is to shoot in high frame rate mode during key stages of video recording: shooting at the beginning and end of each video recording segment in high frame rate mode, while shooting at normal frame rate for the rest of the time. For example, by default, the first 5 seconds of video recording are shot at a high frame rate (e.g., 120fps), while the rest of the time is shot at the normal video recording frame rate (e.g., 60ps).

[0281] Another possible solution to achieve the high frame rate mode is to identify the subject in the picture in real time during the shooting process, and when the subject is identified in the shooting picture, dynamically adjust the video shooting frame rate to the high frame rate mode.

[0282] For example, when the electronic device determines that the subject of this assisted photography is a person, video recording is performed at this time. At the beginning, the person is not within the shooting range. The electronic device determines that there is no person and only the scene screen appears in the current real-time preview interface, and the device uses a normal shooting frame rate (for example, 60fps) for shooting; when the person enters the shooting screen, the device recognizes the appearance of the subject and adjusts the shooting frame rate to a high frame rate (for example, 120fps); when the person leaves the shooting range again, the device recognizes that the subject disappears again and adjusts the shooting frame rate back to the normal shooting frame rate.

[0283] Another possible solution to achieve high frame rate mode is to identify in real time during video recording whether the subject in the picture is moving. If there is no dynamic target in the real-time image, the normal shooting frame rate (for example, 60fps) is used for shooting; if the presence of a dynamic target is identified in the real-time image, the high frame rate (for example, 120fps) is used for shooting.

[0284] For example, during video recording, the person in the currently captured image remains still, and the electronic device recognizes that there are no dynamic objects in the image captured by the camera, so it uses a normal frame rate (for example, 60fps) to shoot; when a person begins to swing their body in the picture, the electronic device recognizes that there are dynamic objects in the image, and can use a high frame rate (for example, 120fps) to shoot.

[0285] In the solution of dynamically adjusting the frame rate, the power consumption of electronic devices can be reduced as much as possible while ensuring the best video splicing effect.

[0286] One possible method of using a folding screen device for splicing video recording in an embodiment of the present application is that the folding screen device is in an unfolded state, relying on its own mechanical structure to be stably placed on the shooting table, using the rear camera to work, and performing real-time shooting preview on the external screen display on the same side, so as to achieve the recording and splicing of multiple videos into a film with one click. As shown in Figures 10A to 10G, the process of this splicing video recording method is demonstrated. As shown in Figure 10A, the user adjusts the folding screen to an unfolded state where it can be placed stably, and places the device on the shooting table. The user can touch the C screen of the external screen display to select the splicing video control in the shooting application to start the multi-video recording and splicing function. The shooting button 901 controls the start of the current video recording, and the lens switching button 902 controls the currently working camera. The rear camera is used by default. Clicking the lens switching button 902 can switch to the secondary front camera.

[0287] After the user clicks the capture button 901 in FIG10A, the stitching recording function enters the current video recording stage. As shown in FIG10B, the pause control 903 stops the current video recording, and the capture button 901 ends the current video recording. The recording timer and the current frame rate (60fps in the figure) are displayed at the top of the display C.

[0288] Figure 10C shows a possible user interface that appears after the user finishes recording a video segment. The user confirms whether to continue recording the next segment. If not, the current spliced ​​video is terminated. If the user chooses to continue recording, the device enters the transition phase shown in Figure 10D. The interaction process shown in Figure 10C is not a required step in this embodiment. The electronic device can independently determine whether to record the next segment in the background, and the user confirmation process shown in Figure 10C is omitted.

[0289] Figure 10D illustrates a possible implementation of the transition phase. Screen C viewing area 904 displays the image at the end of the previous video, while real-time preview area 905 displays the image of the current subject. By comparing the depth information data of the two images, corresponding adjustment suggestions are given. As shown in Figure 10C, at the end of the first video, the subject is located in the lower left area of ​​the screen. When the subject finishes changing clothes and records the second video, the transition phase shown in Figure 10D is located in the right rear area of ​​the screen, which is significantly different from the ending area in Figure 10C. Suggestions for adjusting the subject's position are given on the display. The subject can adjust their position according to the suggestions, and the matching degree and suggestions will change in real time during the adjustment process. Once the subject has adjusted their shooting position, the second video can be started.

[0290] As shown in FIG10E , the subject enters the recording of the second video. Through the adjustment of the transition stage in FIG10D , the composition of the starting image of the subject in FIG10E and the image at the end of the first video in FIG10C are highly matched, ensuring the continuity of the subsequent splicing of the two videos.

[0291] In the embodiment described in the present application, the transition phase can adopt any possible solution shown in FIG. 9A to FIG. 9D to realize the simultaneous presentation of two images.

[0292] In the embodiments described herein, to improve the coherence of the splicing of two video segments, the electronic device can intelligently optimize the revelation image of the next video segment. As shown in Figure 10F, when the subject enters the second video segment, the subject's position is in the center of the screen, which is somewhat different from the image at the end of the first segment in Figure 10C. The device can perform algorithmic optimization and correction on the starting image in Figure 10F based on the data of the image at the end of the segment, so that the corrected revelation image achieves the effect of Figure 10G, with the subject corrected to the front left of the screen, achieving a better match with the image in Figure 10C.

[0293] Another possible method of using a folding screen device for splicing video recordings in an embodiment of the present application is that the folding screen device is in a semi-folded state, and is stably placed on the shooting table relying on its own mechanical structure. The rear camera is used to perform real-time shooting preview on the external screen display on the same side, and multiple videos can be recorded and spliced ​​into a film with one click.

[0294] The implementation method of one-key splicing video in the semi-folded state is the same as the implementation method of the unfolded state described in Figures 10A-10G. The electronic device can simultaneously detect the folding angle of the semi-folded state, and determine the depth information of the image in combination with the folding angle to provide more accurate comparison suggestions. The embodiment of this application does not limit the measurement of the folding angle, and any solution that can detect the folding angle is applicable. For example, the folding angle of the folding screen can be determined using an angle sensor on the electronic device.

[0295] When the electronic device is in a semi-folded state, the image of the subject captured by the camera may be deformed due to the folding angle, that is, the image is distorted, and the displayed image is not completely consistent with the actual object photographed. Assuming that the electronic device is in the semi-folded state shown in Figure 3E, and the rear camera is used for shooting, the captured image can be displayed on the external screen C. As shown in Figure 11A-Figure 11B, the scaling ratios of the inner and outer edges of the subject are not completely consistent, resulting in the deformation of the subject's graphics in the preview image. Among them, the outer edge refers to the side of the image away from the folding edge on the folding screen, and the inner edge refers to the side of the image close to the folding edge of the folding screen.

[0296] Another way to determine the folding angle of a folding screen is to use images captured by cameras in different orientations at the same time for calculation. Assuming that the electronic device is as shown in FIG3D, in addition to the rear camera, there is also a secondary front camera on the same side of the external screen. The electronic device can capture images taken by cameras in two orientations at the same time, and calculate the corresponding folding angle based on the distortion of the two images at the same time. Assuming that the electronic device has only a rear camera on the back as shown in FIG3A, the front camera can be used for image comparison. Assuming that the electronic device is as shown in FIG1A, the front folding screen can be divided into screen A and screen B, screen A is equipped with front camera A, and screen B is equipped with front camera B, then the front camera A and the front camera B can be used to collect graphics at the same time, and the corresponding folding angle can be calculated using the deformation of the two graphics.

[0297] In order to eliminate the image distortion caused by folding, the electronic device can correct the distorted image based on the folding angle to obtain an image that matches the object photographed by the user.

[0298] There is no limitation on the method by which electronic devices correct image distortion based on the folding angle, and any algorithm capable of achieving image correction can be used. For example, it can be based on a pre-calibrated mapping relationship between the image deformation ratio and the folding angle. For example, when the folding angle is 120 degrees, the deformation ratio of the left and right sides of the image is 1.3. When the folding angle is detected to be 120, the image is restored according to the deformation ratio of 1.3. Among them, the deformation ratio can be understood as the ratio of the length of an edge before and after deformation.

[0299] Another possible method of splicing videos using a folding screen device in an embodiment of the present application is that the electronic device undergoes a state change during the shooting process, and the state change includes a position change or a posture change of the electronic device. In order to ensure the continuity of the splicing of two videos, it is necessary to ensure that the shooting conditions are consistent as much as possible, that is, to ensure that the working posture of the electronic device is consistent as much as possible. For example, different backgrounds need to be switched during video recording, and the electronic device needs to constantly change its position during the entire shooting process; the user adjusts the working posture of the electronic device (such as the folding angle) during the shooting process, etc. The position change of the electronic device includes horizontal movement and vertical height change. The posture of the electronic device refers to the unfolded state, semi-folded state, and folded state of the device. When the device is in a semi-folded state, it also includes the folding angle. The working posture refers to the posture adopted by the electronic device when it is working.

[0300] The embodiments of this application do not impose any restrictions on the detection of the electronic device status, and all feasible solutions are applicable. One possible implementation method is for the electronic device to detect changes in the electronic device status through various sensors, such as: detecting the displacement of the electronic device itself through sensor devices such as gyroscopes and accelerometers; detecting changes in the user's operating posture of the device through angle sensors, etc.

[0301] After completing a video recording, the electronic device needs to record the electronic device's operating posture during the recording of this video, which is called the first operating posture. When the user chooses to shoot the next video, the subject can change clothes and scenes in the subsequent transition phase. The user changes the shooting location of the electronic device, and the state of the electronic device changes. When the user adjusts the electronic device to the second operating posture for the next video, the electronic device will compare the difference between the first and second operating postures and provide the user with suggestions for adjusting the electronic device's operating posture. The user can restore the electronic device to the first posture as much as possible based on the suggestions.

[0302] The various implementation modes of this application can be combined arbitrarily to achieve different technical effects.

[0303] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described herein are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).

[0304] Those skilled in the art will appreciate that all or part of the process steps in the above-described method embodiments can be implemented by a computer program instructing the relevant hardware. The program can be stored in a computer-readable storage medium, and when executed, the program can include the process steps in the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

[0305] In short, the above description is only an embodiment of the technical solution of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent replacements, improvements, etc. made based on the disclosure of the present invention should be included in the scope of protection of the present invention.

Claims

1. A video shooting method, characterized in that: Applied to electronic equipment, the method includes: Launch the Camera app; Recording a first video of the subject in a first mode of the camera application, wherein the first mode is used to record multiple videos and stitch them together; End the recording of the first video segment according to the received first instruction; Simultaneously displaying reference information and an image captured in real time by the electronic device, wherein the reference information is used to identify a position of the subject in the first video segment; Based on the real-time captured image, displaying a comparison result, wherein the comparison result includes a matching degree between a position of the subject in the first video segment and a position in the real-time captured image or a first suggestion for moving the subject; Initiate recording of a second video segment according to the received second instruction; According to the received third instruction, the recording of the second video segment is ended, and a spliced ​​video is generated, wherein the spliced ​​video includes the first video segment and the second video segment.

2. The method according to claim 1, characterized in that The reference information includes depth information of the subject in the first video segment, and the method further includes: The comparison result is generated based on the depth information and the depth information of the object in the image collected in real time.

3. The method according to claim 1 or 2, characterized in that The first suggestion includes azimuth movement information for adjusting the position of the subject in the image collected in real time.

4. The method according to any one of claims 1 to 3, characterized in that The reference information includes a data image captured by the first video segment, wherein the data image includes image data of the last frame of the first video segment or a third video of the first duration of the first video segment, and the third video refers to content within the first duration before the end of the first video segment; The simultaneously displaying the reference information and the image captured in real time by the electronic device includes: The first area displays the reference information; The second area displays the real-time acquired image.

5. The method according to claim 4, characterized in that The simultaneously displaying the reference information and the image captured in real time by the electronic device includes: displaying the first area with a first transparency; The second area is displayed with a second transparency, wherein the first transparency and the second transparency are different.

6. The method according to any one of claims 1 to 3, characterized in that The reference information includes a frame selection icon, which displays the location area of ​​the subject in the first video.

7. The method according to any one of claims 1 to 5, characterized in that The first video recording includes: The first part of the first video is recorded at a first frame rate, and the other parts of the first video except the first part are recorded at a second frame rate, wherein the first part includes a portion of video with a fixed length in the first video or a portion of video in the first video that contains the subject.

8. The method according to any one of claims 1 to 7, characterized in that: The electronic device includes a foldable screen, and recording a first video includes: Recording first posture information of the electronic device, wherein the first posture information includes a folding angle of the folding screen when the first video is recorded; The method further comprises: A second suggestion is displayed to adjust the electronic device from a second posture to the first posture based on the first posture information, wherein the second posture refers to the posture of the electronic device when the reference information is displayed.

9. An electronic device, characterized in that: The electronic device comprises: One or more processors, a memory, a display, and a camera, wherein the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the method according to any one of claims 1 to 8.

10. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an electronic device, the electronic device is caused to execute the method according to any one of claims 1 to 8.

11. A computer program product comprising computer readable instructions, which when executed by one or more processors implement the method according to any one of claims 1 to 8.

Images