Human-computer interaction method, device and electronic equipment
By displaying move and copy controls on the terminal interface, the problem of inconvenient photo processing in video-generated photo scenarios is solved, enabling flexible photo movement and copying and improving the user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HONOR DEVICE CO LTD
- Filing Date
- 2022-02-28
- Publication Date
- 2026-07-24
AI Technical Summary
In existing technologies, when users record their lives using videos, it is difficult to effectively extract and process photos from the original videos, especially in shooting scenarios, and the methods for further processing photos need to be improved.
A human-computer interaction method is provided, which allows users to move or copy photos associated with videos to different albums by displaying move and copy controls on the terminal, thereby enabling operations on videos and photos. The method includes an interface design for displaying move and copy controls, and displaying prompt information based on album type and gallery data relationship.
It enables users to easily move and copy photos in scenarios where videos are generated and associated with photos, improving the flexibility and efficiency of photo processing.
Smart Images

Figure CN116701685B_ABST
Abstract
Description
Technical Field
[0001] This application relates to human-computer interaction technology, and more particularly to a human-computer interaction method, apparatus, and electronic device. Background Technology
[0002] Users can record their lives by taking photos or recording videos. Compared to photos, videos can capture more wonderful moments, which photos sometimes struggle to capture. Therefore, when users use videos to record their lives, the videos can contain a wealth of content.
[0003] In some shooting scenarios, users expect to extract photos from the captured original video. Currently, the methods for further processing of the original video and photos need improvement. Summary of the Invention
[0004] This application provides a human-computer interaction method, device, and electronic device that can enable the movement of photos in scenarios where videos are generated and associated with photos.
[0005] In a first aspect, embodiments of this application provide a human-computer interaction method, wherein the executing entity of the human-computer interaction method can be a terminal or a chip in the terminal. In this method, in a scenario where associated photos have been generated based on an original video, the movement and copying of the video and / or photos can be realized. Specifically, a video in a gallery application is associated with at least one photo, the at least one photo is generated based on the video, and the at least one photo is contained in a first album in the gallery application. The method includes: in response to a user's operation on a thumbnail of a target photo displayed in the first album or the photo tab, displaying a movement control, wherein when the thumbnail of the target photo is displayed in the photo tab, the photo in the first album is contained in the photo tab, and the target photo is contained in the at least one photo; in response to the user's operation on the movement control, displaying an identifier of a movable album; in response to the user's operation on the identifier of the target album in the identifier of the movable album, moving the target photo to the target album; and displaying a first prompt message, the first prompt message indicating that the target photo has been moved to the target album.
[0006] In one possible implementation, manipulation of the thumbnail of the target photo is used to trigger the terminal to display the target photo.
[0007] The process of displaying the mobile control includes: displaying a first interface on which the target photo is displayed, and a first operation area including the mobile control.
[0008] In one possible implementation, the operation on the thumbnail of the target photo is used to select the target photo; the display of the motion control includes: displaying a second operation area, the second operation area including the motion control.
[0009] In one possible implementation, the second operating region is different from the first operating region.
[0010] In one possible implementation, displaying the first prompt information includes: when the user operates on the thumbnail of the target photo displayed in the first album, displaying the first prompt information according to the type of the first album; or, when the user operates on the thumbnail of the target photo displayed in the photo tab, displaying the first prompt information according to whether the gallery data in the target album is included in the photo tab.
[0011] In one possible implementation, displaying the first prompt information according to the type of the first album includes: when the first album is a physical album, displaying the next content arranged after the target photo in the first album and displaying the first prompt information; when the first album is a virtual album, displaying the target photo and displaying the first prompt information.
[0012] In one possible implementation, displaying the first prompt message based on whether the gallery data in the target album is included in the photo tab includes: when the gallery data in the target album is included in the photo tab, displaying the target photo and displaying the first prompt message; when the gallery data in the target album is not included in the photo tab, displaying the next content in the photo tab after the target photo and displaying the first prompt message.
[0013] In one possible implementation, the first album can be a physical album or a virtual album. When the first album is a physical album, the movable album does not contain the first album but contains other physical albums. When the first album is a virtual album, the movable album contains all the physical albums. Or...
[0014] When the user interacts with the thumbnail of the target photo displayed in the photo tab, the movable album contains all the physical albums.
[0015] In one possible implementation, when the first album and the photo tab display thumbnails of videos associated with the at least one photo, the method further includes: displaying a first interface in response to the user's operation on the thumbnail of the video displayed in the first album or the photo tab; the display area of the first interface displays the video frame; the first interface further includes an association area and a first operation area; the association area includes an identifier of the video and an identifier of at least one photo associated with the video, the at least one photo being generated based on the video; the first operation area includes a motion control; displaying the target photo in the display area in response to the user's operation on the identifier of the target photo on the first interface; displaying an identifier of the movable album in response to the user's operation on the motion control; moving the target photo to the target album in response to the user's operation on the identifier of the target album; and displaying a first prompt message on the first interface displaying the target photo, the first prompt message indicating that the target photo has been moved to the target album.
[0016] In one possible implementation, the target album is a first target album, and the first operation area further includes a copy control. The method further includes: when the display area displays the video, in response to the user's operation of the copy control, displaying an identifier of a copyable album; in response to the user's operation on the identifier of the second target album in the identifier of the copyable album, copying the video to the second target album; and displaying a second prompt message, the second prompt message indicating that the video has been copied to the second target album.
[0017] In one possible implementation, the method further includes: displaying the first interface in response to the user triggering the terminal to display the video in the second target album.
[0018] In one possible implementation, the target album is a first target album, and the first operation area further includes a copy control. The method further includes: when the display area displays the target photo, in response to the user's operation of the copy control, displaying an identifier of a copyable album; in response to the user's operation on the identifier of the second target album in the identifier of the copyable album, copying the target photo to the second target album; and displaying a second prompt message, the second prompt message indicating that the target photo has been copied to the second target album.
[0019] In one possible implementation, the method further includes: displaying the target photo in response to the user triggering the terminal to display the target photo in the second target album, wherein the associated area is not included on the interface displaying the target photo in the second target album.
[0020] In one possible implementation, the first album can be a physical album or a virtual album. When the first album is a physical album, the copyable album does not include the first album but includes other physical albums. When the first album is a virtual album, the copyable album includes all physical albums. Or...
[0021] When the user interacts with the thumbnail of the video displayed in the photo tab, the copyable album contains all the physical albums.
[0022] In one possible implementation, the first operating area includes more controls, and the step of responding to the user's operation of the moving control further includes: responding to the user's operation of the more controls by displaying at least one operable control, wherein the at least one operable control includes the moving control and the copy control.
[0023] Secondly, embodiments of this application provide a human-computer interaction device, which can be the terminal or a chip in the terminal mentioned in the first aspect. The human-computer interaction device includes:
[0024] The display module is configured to display a movement control in response to a user's operation on a thumbnail of a target photo displayed in the first album or the photo tab, wherein when the thumbnail of the target photo is displayed in the photo tab, the photo in the first album is included in the photo tab, and the target photo is included in the at least one photo; and, in response to the user's operation on the movement control, to display an identifier of a movable album.
[0025] The processing module is configured to move the target photo to the target album in response to the user's operation on the identifier of the target album in the identifier of the movable album.
[0026] The display module is also used to display a first prompt message, which indicates that the target photo has been moved to the target album.
[0027] In one possible implementation, manipulation of the thumbnail of the target photo triggers the terminal to display the target photo. The display module is specifically configured to display a first interface, on which the target photo is displayed, and a first operation area, the first operation area including the motion control.
[0028] In one possible implementation, the manipulation of the thumbnail of the target photo is used to select the target photo. The display module is specifically used to display a second operation area, which includes the motion control.
[0029] In one possible implementation, the second operating region is different from the first operating region.
[0030] In one possible implementation, the display module is specifically used for:
[0031] When the user interacts with the thumbnail of the target photo displayed in the first album, the first prompt message is displayed according to the type of the first album; or,
[0032] When the user interacts with the thumbnail of the target photo displayed in the photo tab, the first prompt message is displayed depending on whether the gallery data in the target album is included in the photo tab.
[0033] In one possible implementation, when the first album is a physical album, the display module is specifically used to display the next content arranged after the target photo in the first album, and to display the first prompt information. When the first album is a virtual album, the display module is specifically used to display the target photo, and to display the first prompt information.
[0034] In one possible implementation, when the gallery data in the target album is included in the photo tab, the display module is specifically used to display the target photo and the first prompt information; when the gallery data in the target album is not included in the photo tab, the display module is specifically used to display the next content arranged after the target photo in the photo tab and the first prompt information.
[0035] In one possible implementation, the first album can be a physical album or a virtual album. When the first album is a physical album, the movable album does not contain the first album but contains other physical albums. When the first album is a virtual album, the movable album contains all the physical albums. Or...
[0036] When the user interacts with the thumbnail of the target photo displayed in the photo tab, the movable album contains all the physical albums.
[0037] In one possible implementation, when the first album and the photo tab display thumbnails of videos associated with at least one photo, the display module is further configured to, in response to the user's operation on the thumbnails of the videos displayed in the first album or the photo tab, display a first interface. The display area of the first interface displays the video footage. The first interface further includes an association area and a first operation area. The association area includes an identifier of the video and an identifier of at least one photo associated with the video, the at least one photo being generated based on the video. The first operation area includes a motion control. In response to the user's operation on the identifier of the target photo on the first interface, the target photo is displayed in the display area. In response to the user's operation on the motion control, the identifier of the movable album is displayed.
[0038] The processing module is also configured to move the target photo to the target album in response to the user's operation on the identifier of the target album.
[0039] The display module is also used to display a first prompt message on a first interface displaying the target photo, the first prompt message being used to indicate that the target photo has been moved to the target album.
[0040] In one possible implementation, the target album is a first target album, and the first operation area further includes a copy control and a display module, which is also used to display an identifier of a copyable album in response to the user's operation of the copy control when the display area displays the video frame.
[0041] The processing module is further configured to, in response to the user's operation on the identifier of the second target album in the identifier of the copyable album, copy the video to the second target album.
[0042] The display module is also used to display a second prompt message, which indicates that the video has been copied to the second target album.
[0043] In one possible implementation, the display module is further configured to display the first interface in response to the user's operation of triggering the terminal to display the video in the second target album.
[0044] In one possible implementation, the target album is a first target album, and the first operation area also includes a copy control. When the display area displays the target photo, in response to the user's operation of the copy control, the display module is specifically used to display an identifier of the album that can be copied.
[0045] The processing module is specifically configured to, in response to the user's operation on the identifier of the second target album in the identifier of the copyable album, copy the target photo to the second target album.
[0046] The display module is also used to display a second prompt message, which indicates that the target photo has been copied to the second target album.
[0047] In one possible implementation, the display module is further configured to display the target photo in response to the user's operation of triggering the terminal to display the target photo in the second target album, wherein the interface displaying the target photo in the second target album does not include the associated area.
[0048] In one possible implementation, the first album can be a physical album or a virtual album. When the first album is a physical album, the copyable album does not include the first album but includes other physical albums. When the first album is a virtual album, the copyable album includes all physical albums. Or...
[0049] When the user interacts with the thumbnail of the video displayed in the photo tab, the copyable album contains all the physical albums.
[0050] In one possible implementation, the display module is further configured to include more controls in the first operation area, and the display module is further configured to display at least one operable control in response to the user's operation of the more controls, wherein the at least one operable control includes the move control and the copy control.
[0051] Thirdly, embodiments of this application provide an electronic device that may include a processor and a memory. The memory stores computer-executable program code, which includes instructions; when the processor executes the instructions, the instructions cause the electronic device to perform the method described in the first aspect.
[0052] Fourthly, embodiments of this application provide a computer program product containing instructions that, when run on a computer, cause the computer to perform the method described in the first aspect above.
[0053] Fifthly, embodiments of this application provide a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the method described in the first aspect.
[0054] The beneficial effects of the various possible implementations of the second to fifth aspects described above can be found in the first aspect described above and the following embodiments, and will not be repeated here. Attached Figure Description
[0055] Figure 1 A schematic diagram of the interface for the "one record, multiple results" function provided in the embodiments of this application;
[0056] Figure 2 A schematic diagram of an interface using the one-record-multiple-captures-one-shot function provided in an embodiment of this application;
[0057] Figure 3A A schematic diagram of the interface of a terminal provided in an embodiment of this application;
[0058] Figure 3B Another schematic diagram of the terminal interface provided in this application embodiment;
[0059] Figure 4A This is a schematic diagram of an interface for image library data in a mobile physical album in existing technology.
[0060] Figure 4B This is a schematic diagram of another interface for gallery data in a mobile physical album in existing technology;
[0061] Figure 4C This is a schematic diagram of a process for mobile gallery data in existing technology.
[0062] Figure 5A This is a schematic diagram of an interface for image library data in a mobile virtual photo album in existing technology.
[0063] Figure 5B This is a schematic diagram of another interface for gallery data in a mobile virtual photo album in existing technology;
[0064] Figure 5C This is a schematic diagram of an interface for gallery data in a mobile photo tab in existing technology.
[0065] Figure 6A A schematic diagram of an interface for gallery data in a mobile physical album provided in an embodiment of this application;
[0066] Figure 6B Another schematic diagram of the interface for gallery data in a mobile physical album provided in this application embodiment;
[0067] Figure 6C This is a schematic diagram of a process for mobile gallery data provided in an embodiment of this application;
[0068] Figure 7A A schematic diagram of an interface for gallery data in a mobile virtual photo album provided in an embodiment of this application;
[0069] Figure 7B This is another schematic diagram of the interface for gallery data in a mobile virtual photo album provided in an embodiment of this application;
[0070] Figure 8A A schematic diagram of an interface for gallery data in a mobile photo tab provided in an embodiment of this application;
[0071] Figure 8B Another schematic diagram of the gallery data in the mobile photo tab provided in this application embodiment;
[0072] Figure 9A A schematic diagram of an interface for mobile AI photography provided in an embodiment of this application;
[0073] Figure 9B This is a schematic diagram of an interface for copying the original video provided in an embodiment of this application;
[0074] Figure 9C Another schematic diagram of the interface for copying AI photos provided in the embodiments of this application;
[0075] Figure 10 A flowchart illustrating a human-computer interaction method provided in an embodiment of this application;
[0076] Figure 11 A schematic diagram of the structure of a human-computer interaction device provided in an embodiment of this application;
[0077] Figure 12 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0078] The human-computer interaction method disclosed in this application is applied to a terminal, including but not limited to mobile phones, tablets, desktops, laptops, ultra-mobile personal computers (UMPCs), handheld computers, netbooks, personal digital assistants (PDAs), wearable electronic devices, smartwatches, and other electronic devices with cameras. This application does not limit the form of the terminal.
[0079] Before introducing the embodiments of this application, some terms or concepts involved in the embodiments of this application will be explained first. It should be understood that this application does not specifically limit the naming of the following terms. The following terms may have other names. The renamed terms still satisfy the following related terminology interpretations.
[0080] Definitions of terms in this application:
[0081] Original video: Video captured by the user through their device.
[0082] A magic moment (MM) refers to a memorable instant during video recording (or filming). For example, MM could be the best moment of movement, the best expression, or the best pose. It is understood that this application does not limit the term MM; MM can also be called a beautiful moment, a magical moment, a brilliant instant, a decisive moment, a brilliant keyframe, or the best shot (BS), etc. In different scenarios, a magic moment can be of different types. For example, when recording a football match video, a magic moment could be the instant a player's foot contacts the ball during a shot or pass, or it could be the instant the ball flies into the goal. When recording a video of a person jumping from the ground, a magic moment could be the instant the person reaches their highest point in the air, or it could be the instant the person's movement is most fluid and graceful while in the air.
[0083] MM tags are time tags used to indicate the location of highlight moments in a recorded video. For example, a video can correspond to one or more MM tags, which can indicate the location of the highlight moment at the 10th second, 1 minute and 20 seconds, etc.
[0084] Artificial intelligence (AI) photos: Video frames corresponding to highlights in the original video. In one embodiment, an AI photo may be called a highlight photo. For example, an AI photo may be a video frame from the original video that contains a user laughing, or a video frame that contains the user jumping the highest point, or a video frame that contains the user looking back.
[0085] In one embodiment, AI photos can be acquired and saved while a user is shooting a video using a terminal.
[0086] One Record, Multiple Gains (Function): This can be understood as the ability for users to obtain the original video, one or more photos of the highlights, and an AI profile by pressing the "Shoot" control once when shooting video using the camera application on their device.
[0087] The AI configuration file is obtained based on the original video. In one embodiment, the AI configuration file records information such as the scene and keyframes of the user-captured video. For example, the AI configuration file may include: identifiers of at least one scene in the original video, and identifiers of keyframes (such as identifiers of AI photos). For instance, the original video includes scene 1 "Aquarium" and scene 2 "Amusement Park," and identifier 1 for a keyframe in scene 1 "Aquarium," and identifier 2 for a keyframe in scene 2 "Aquarium." Alternatively, the information recorded in the AI configuration file may specifically include MM tags, overall video scene tags, segmented scene tags, shot tags, and tags for high-quality video frames. In one embodiment, tags can be understood as identifiers.
[0088] The overall video scene tag, also known as the overall video summary tag, is mainly used to indicate the overall shooting scene of the video. This application does not limit the terminology used for the overall video scene tag. For example, the overall video scene tag can be a food tag, a night scene tag, etc.
[0089] The process of achieving multiple benefits from a single recording can be as follows: During video recording, the system automatically identifies and captures photos of the subject, and after recording, it recommends these photos along with short videos (also known as featured short videos, highlight videos, or AI videos) to the user when reviewing the video. It's important to understand that the duration of these short videos is shorter than the entire video. For example, a 1-minute video might yield 4 photos of the key moments and a 15-second short video. This feature can also be called "one-click multiple captures," "one-click multiple shots," "one-click output," "one-click blockbuster," or "AI one-click blockbuster."
[0090] AI Video: Generated based on an AI profile. For example, the AI video could be a 5-second video containing a keyframe before and after identifier 1, and a 5-second video containing a keyframe before and after identifier 2, resulting in a 10-second AI video. Alternatively, for example, the AI video could be a 5-second video containing scene 1, "Aquarium," and a 5-second video containing scene 2, "Amusement Park."
[0091] In one embodiment, after recording multiple videos simultaneously, instead of generating an AI video, an AI video configuration file can be generated and saved, saving storage space when the user does not view the AI video. In another embodiment, the user can trigger the terminal to generate an AI video from the original video playback interface. For example, the user can operate... Figure 3B The "one-click blockbuster" control 351 displayed on the 'c' in the image triggers the terminal to generate AI videos. (See reference...) Figure 3B The relevant description in the document.
[0092] This application does not elaborate on the process of generating AI photos and AI configuration files from the original video, or generating AI videos from the AI configuration files.
[0093] In this embodiment, the user's operation methods on controls, icons, and other objects in the graphical user interface (GUI) include, but are not limited to, touching specific controls on the mobile phone screen, pressing specific physical buttons or button combinations, inputting voice, and using air gestures. The following embodiments use user operation on controls in the GUI as an example for illustration.
[0094] For example, refer to Figure 1 Taking a mobile phone as an example, the process of recording video using the "one-record-multiple-views" mode (or function) in this application embodiment includes:
[0095] like Figure 1 As shown in Figure a, the phone screen displays the main interface, which shows application icons for multiple applications (Apps). Users can tap the "Camera" application icon 101 on the phone's home screen to activate the camera application (hereinafter referred to as the camera). The phone displays as shown below. Figure 1 The shooting interface shown in b is shown in the image.
[0096] like Figure 1 As shown in b, the camera's shooting interface generally includes multiple controls such as a viewfinder 102, a photo control, a video recording control, and settings controls 103 (e.g., portrait mode controls, night mode controls, or other controls). Users can start recording mode by clicking the video recording control, and the phone can display... Figure 1 The recording interface is shown as shown in 'c'. Users can access the camera's settings interface by clicking the "Settings" control 103; the phone displays the following... Figure 1 The interface shown in d is shown in the figure.
[0097] Figure 1 The interface shown as 'd' displays option 104, which enables the "One Record, Multiple Results" function. This means that when the user enables "One Record, Multiple Results," the phone will record the original video, an AI photo, and an AI profile file. Of course, the user can also disable the "One Record, Multiple Results" function through option 104.
[0098] In one embodiment, Figure 1The settings interface shown as 'd' can also include a minimum time limit control. This minimum time setting control limits the minimum recording duration required to enable the "one-record-multiple-photos" feature. If the video recording duration is less than this minimum, the "one-record-multiple-photos" feature will not be triggered. For example, the minimum time limit can be set to 15 seconds; if the user's recording time is less than 15 seconds, the "one-record-multiple-photos" feature will not be triggered.
[0099] Understandable. Figure 1 The settings interface shown as 'd' can also include other controls related to recording settings, such as controls for setting video resolution and video frame rate. Figure 1 The control shown as d in the diagram is merely an illustrative example.
[0100] After enabling the "One Record, Multiple Results" feature, the user clicks... Figure 1 The 'd' indicator shows the return control 105, which allows the phone to return to its previous state. Figure 1 The interface shown in 'c' allows users to click the recording control 106 to record video. In other embodiments, the option to record multiple videos simultaneously is enabled by default, and users do not need to click it. Figure 1 Instead of clicking the settings control 103 shown in 'c', click directly. Figure 1 The recording control 106 shown in 'c' allows for recording in the one-record-multiple-records mode.
[0101] Figure 2 This is a schematic diagram of the interface taken using the one-record-multiple-captures-one-takes-multiple-captures-one-shots-features-in-an-implements-of-this-application ... Figure 2 The image shown in Figure 'a' is a frame during the recording process of the terminal using the one-record-multiple-views function (e.g., the frame at the 11th second). Figure 2 The interface shown in Figure 'a' includes a recording stop control 107, a recording pause control 108, and a photo capture button 109. During recording, the user can manually capture a photo by clicking the photo capture button 109. Figure 2 After clicking the recording stop control 107 in the middle, the recording process ends, and the phone screen displays as follows. Figure 2 The interface shown in b is... Figure 2 The interface shown in b is the preview interface after recording is completed. A pop-up bubble window 110 can appear in the interface, displaying the message: "A photo of many wonderful moments has been generated in one recording," to prompt the user to view the AI photo.
[0102] in, Figure 2 Preview image 111 in section b is a thumbnail of the recorded original video. If the user clicks on preview image 111, they can enter the gallery application (or gallery, gallery application) to view the recorded original video, as well as AI photos, etc. The playback and display of the original video and the display of AI photos can be referred to the relevant descriptions in the following embodiments.
[0103] It should be understood that the original video captured by the terminal can be stored in the terminal's gallery application, and AI photos and AI videos can also be stored in the gallery application. In one embodiment, the videos and photos stored in the gallery application can be referred to as gallery data. In one embodiment, gallery data can be displayed in the form of albums, photo tabs, etc. For example, Figure 3A In the above, 'a' refers to the interface in the gallery application provided in this application embodiment that displays gallery data in the form of an album. This interface may include an album control 31, a photo control 32, and at least one album 33.
[0104] Among them, reference Figure 3A The gallery application includes at least one album, such as a camera album, an all-photos album, a video album, a screenshot / screen recording album, a favorites album, and other albums added by the user. In one embodiment, the albums in the gallery can be divided into physical albums and virtual albums. The camera album, the screenshot / screen recording album, and other albums added by the user are physical albums, while the all-photos album and the video album are virtual albums. It should be understood that a physical album can be understood as a real, existing path used to store gallery data. A virtual album can be understood as an album that aggregates videos and photos based on their characteristics. For example, since videos, compared to photos, contain multiple video frames and have dynamic characteristics, videos captured by the terminal can be aggregated into a "video" album, which is a virtual album.
[0105] In one embodiment, the AI photos generated from the original video can be stored separately in a physical album, such as an "AI Photos" album. Figure 3A As shown in a, the name of the album storing AI photos is not limited in this embodiment of the application; it can also be called the "One-Stop, Multiple-Get" album.
[0106] Reference Figure 3A In step 'a', when the user clicks photo control 32, the terminal can display an interface showing gallery data in the form of photo tabs. (See reference...) Figure 3A In embodiment b, the interface displaying gallery data in the form of a photo tab may include an album control 31, a photo control 32, and photos displayed in chronological order. In one embodiment, the photo tab interface may display photos and videos from the camera album, as well as photos from the screenshot / screen recording album.
[0107] In one embodiment, to distinguish between original videos with generated AI photos and ordinary videos (without generated AI photos), when displaying the cover of the original video in the camera album, video album, or other user-defined albums, an identifier can be added to the cover of the original video. This identifier indicates that the original video has generated an AI photo. For example, Figure 3B a in Figure 3A Similar to 'a', when the user clicks on the camera album 33, the terminal can display thumbnails of the photos included in the camera album, as well as video covers. For example, the cover of video 1 can display the identifier "AI" 34 to indicate that video 1 is the original video for which AI photos have been generated. Figure 3B As shown in b in the figure.
[0108] In one embodiment, when the original video does not include any highlights (i.e., no AI photos are generated), if the original video generates an AI profile, the cover of video 1 can display the identifier "AI" 34. It should be understood that this application embodiment involves a scenario where "the original video has already generated AI photos."
[0109] Because the AI photos generated from the original video are related to the original video, or in other words, the original video and the AI photos generated from the original video are related, in this embodiment of the application, when a user views the original video, they can view the AI photos associated with the original video on the playback interface of the original video.
[0110] In one embodiment, AI photos can be displayed on the playback interface of the original video in the camera album, but not on the playback interface of the original video in all virtual albums such as photos and videos, as well as in My Favorites, Recycle Bin, Smart Album, Map Album, Search Results, Hidden Album, and Shared Album.
[0111] In one embodiment, AI photos can be displayed in association with the playback interface of the original video in the camera album, all photo album, video album, my favorites, smart album, map album, and search results, but not in association with the playback interface of the original video in the recycle bin, hidden album, or shared album.
[0112] In one embodiment, albums that are associated with the display and albums that are not associated with the display can be preset.
[0113] In one embodiment, the terminal can play the original video when the user clicks on the original video's cover image. For example, see [link to example]. Figure 3B In step b, when the user clicks on the cover image (thumbnail, which can be the first frame of the video), the terminal can play video 1. In one embodiment, as... Figure 3B As shown in c, the interface for playing video 1 may include: playback area 35, associated area 36, and operation area 37.
[0114] Playback area 35 can display the screen of video 1. In one embodiment, in response to a user clicking the cover of the original video, the terminal can directly display video 1 in playback area 35 (or the terminal can display video 1 and a pause control, and the user's operation of the pause control can trigger the terminal to play video 1). In one embodiment, such as Figure 3B As shown in c, the interface for playing video 1 may include: a playback area 35, an associated area 36, and an operation area 37. In one embodiment, the user clicking the cover of video 1 can be referred to as the first operation. In one embodiment, Figure 3B The interface shown as c in Figure 3 can be referred to as the first interface. It should be understood that in the embodiments of this application, c in Figure 3 takes the example of video 1 having been played for a period of time.
[0115] In one embodiment, an icon 351, such as a "One-Click Blockbuster" icon, may be displayed on the playback area 35. Clicking the "One-Click Blockbuster" icon triggers the terminal to generate an AI video based on the AI configuration file. This process will not be described in detail in this embodiment. This embodiment does not involve the "One-Click Blockbuster" function; therefore, the "One-Click Blockbuster" icon is not shown in the following figures.
[0116] In one embodiment, a playback progress bar 352 of video 1 may also be displayed on the playback area 35 so that the user can adjust the playback progress of video 1. It should be understood that the following embodiments do not involve adjusting the playback progress of video 1, and therefore the playback progress bar 352 of video 1 is not shown.
[0117] The associated area 36 may include: a thumbnail of the cover of the original video (Video 1), and a thumbnail of the AI photo associated with the original video. Figure 3B In the text c, video 1 and the AI photos associated with video 1 are represented by text. For example, the AI photos associated with video 1 may include AI photo 1, AI photo 2, and AI photo 3. It should be understood that, in one embodiment, a thumbnail can be understood as a reduced version of the original image. When a user clicks on different thumbnails, it can trigger the terminal to switch the content displayed in playback area 35. It should be understood that... Figure 3B Due to page size limitations, AI photo 3 is not fully displayed in section c. In one embodiment, the thumbnail of the cover of video 1 displayed in associated area 36 can be referred to as the identifier of video 1, and the thumbnail of the AI photo associated with the original video can be referred to as the identifier of the photo. In this embodiment, thumbnails are used to represent the identifier of video 1 and the identifier of the photo. Of course, text or other forms can also be used to represent the identifier of video 1 and the identifier of the photo. This embodiment does not limit this.
[0118] For example, Figure 3BIn the example, playback area 35 (c) is currently playing video 1. If the user clicks on AI photo 1, the terminal can display AI photo 1 in playback area 35. Figure 3B As shown in d in the diagram. Specifically, when the user clicks on the thumbnail of video 1 again, the terminal can continue playing video 1 in playback area 35, meaning it can continue playing from where it left off. Figure 3B The playback progress of video 1 in c is being maintained and video 1 will continue playing.
[0119] The first operation area 37 may include, but is not limited to, a share control 371, a delete control 372, and more controls 373. This application embodiment does not limit the controls included in the first operation area 37. Figure 3B The accompanying drawings illustrate the controls used in the embodiments of this application, as well as other controls, which can be referred to as shown in the drawings.
[0120] The following embodiments describe the process by which a user's operation of the more controls 373 triggers the terminal to perform corresponding operations. Specifically, the user's operation of the more controls 373 can trigger the terminal to perform operations such as moving and copying image library data. The following embodiments describe the process by which the terminal performs operations such as moving and copying image library data.
[0121] It should be understood that, in one embodiment, when the Photos tab includes Video 1, the user can also play Video 1 within the Photos tab to display [the content]. Figure 3B The same interface as c in the example below, and the operations performed on this interface can be referred to the relevant descriptions in the following embodiments.
[0122] Before introducing the process of the terminal moving and copying gallery data in the embodiments of this application, the process of the terminal moving gallery data in the prior art will be explained first:
[0123] 1. In existing technologies, the image library data in the mobile physical album of a terminal (taking photos as an example; the process of moving videos is the same as moving photos):
[0124] 1) Moving large images
[0125] Large image movement refers to the operation of moving a photo displayed on the terminal's interface.
[0126] For example, taking a physical photo album as an example, refer to... Figure 4A In step 'a', when the user opens photo 1 in the camera album, the terminal can display photo 1 and the first operation area 37 on the interface. When the user clicks on the more controls 373 within the first operation area 37, the terminal can display the first operation menu 41. For example... Figure 4A As shown in b, the first operation menu 41 may include, but is not limited to: a move control 411, a copy control 412, etc. It should be understood that... Figure 4AIn the first operation menu 41, the controls used in the embodiments of this application are displayed. The first operation menu 41 may also include other controls such as rename and add notes. Figure 4A Not shown in the image.
[0127] When a user clicks the movable control 411, it triggers the terminal to display a movable album. This movable album does not include the camera album containing the opened photo 1, nor the virtual album. Figure 4A As shown in 'c', the movable albums include: a screenshot / screen recording album, and user-defined albums, such as an album named "Favorites". When a user clicks on the screenshot / screen recording album, the terminal can move photo 1 from the camera album to the screenshot / screen recording album. Correspondingly, the terminal can display the next gallery data (video or photo) for photo 1, such as... Figure 4A As shown in d.
[0128] In scenarios where large images in a physical photo album are moved, the terminal displays the next content after photo 1 is moved, so users can perceive that the gallery data (such as photo 1) has been moved.
[0129] 2) Multiple selection movement
[0130] Multi-select movement refers to the process where a user action triggers the terminal to move multiple image library data items across a screen displaying thumbnails of multiple image library data items.
[0131] For example, taking a physical photo album as an example, Figure 4B The image shown as 'a' is a thumbnail of the gallery data contained in the camera album. Long-pressing any gallery data will trigger the display of the second operation area 38 on the terminal, as shown below. Figure 4B As shown in b in the figure.
[0132] In one embodiment, the second operation area 38 may be the same as the first operation area 37. In another embodiment, the second operation area 38 may be different from the first operation area 37. For example, the second operation area 38 may include: a share control 371, a select all control 381, a delete control 372, and more controls 373, etc.
[0133] If a user selects two files and then clicks "More Controls 373" in the second operation area 38, the terminal can display the second operation menu 42, such as... Figure 4B As shown in c, Figure 4B The second operation menu 42 shown in c is... Figure 4A The first operation menu 41 shown in b is the same as that in the first operation menu. In one embodiment, the controls included in the second operation menu 42 may be the same as or different from those in the first operation menu. For example, the second operation menu 42 may include a move control 411 and a copy control 412.
[0134] When a user clicks the movable control 411, it triggers the display of a movable photo album on the terminal. This movable album does not include the camera album or the virtual album. Figure 4B As shown in 'd', the movable albums include: a screenshot / screen recording album, and a user-defined "Favorites" album, etc. For example, when a user clicks on the screenshot / screen recording album, the terminal can move two selected files to that album. Correspondingly, the terminal can return and display the gallery data in the camera album, which does not include the two files the user has moved, such as... Figure 4B As shown in 'e'. It should be understood that... Figure 4B The number of gallery data entries changed from 8 to 6, indicating that the gallery data in the camera album does not include the 2 files that have been moved.
[0135] Thus, in scenarios where multiple selections of physical albums are moved, the physical album will not display the moved album data after multiple album data have been moved, so users can perceive that the album data has been moved.
[0136] In one embodiment, the process of moving gallery data in a physical album in the prior art can be simplified as follows: Figure 4C As shown in 'a'.
[0137] 2. The gallery data in the mobile virtual album of the existing terminal (taking photos as an example, the process of moving videos is the same as moving photos):
[0138] 1) Moving large images
[0139] For example, taking a virtual album as an example of all photo albums, refer to... Figure 5A In step 'a', when the user opens photo 1 in all photo albums, the terminal can display photo 1 and the first operation area 37 on the interface. When the user clicks on the more controls 373 in the first operation area 37, the terminal can display the first operation menu 41, such as... Figure 5A As shown in b. When the user clicks the movable control 411, it can trigger the terminal to display a movable album. This movable album can include all physical albums in the gallery application, such as... Figure 5A As shown in 'c', this movable album includes: a camera album, a screenshot / screen recording album, and a user-defined "Favorites" album. When the user clicks on the camera album, the terminal can move photo 1 from all photo albums to the camera album. Correspondingly, the terminal can return to displaying photo 1 (because the photos in all photo albums include those in the camera album), as shown in 'c'. Figure 5A As shown in d.
[0140] In scenarios where large images in a virtual photo album are moved, the user will still see the moved photo or video even after the user moves the image or video in the virtual album, resulting in a perceived failure of the move and a poor user experience.
[0141] 2) Multiple selection movement
[0142] For example, let's take a virtual album that represents all photos. Figure 5B The image 'a' shows thumbnails of all the gallery data contained in the photo albums. Long-pressing any gallery data will trigger the display of the second operation area 38 on the terminal, as shown below. Figure 5B As shown in b. If the user selects two files and then clicks "More Controls 373" in the second operation area 38, the terminal can display the second operation menu 42, such as... Figure 5B As shown in c in the diagram. When the user clicks the movable control 411, it triggers the terminal to display a movable photo album, which can be referenced... Figure 5A The album shown in 'c', such as Figure 5B As shown in d. For example, when a user clicks the screenshot / screen recording album, the terminal can move the two files selected by the user to the screenshot / screen recording album. Correspondingly, the terminal can return and display the gallery data in the all-photo album, which contains the two files that the user has moved, such as... Figure 5B As shown in 'e'. It should be understood that... Figure 5B Taking the example where the gallery data included in all photo albums is still 12, 'e' indicates that the gallery data contains 2 files that the user has moved.
[0143] In scenarios where multiple selections of photos or videos in a virtual album are moved, the user will still see the moved photos or videos even after the device has moved them, resulting in a perceived failure of the move and a poor user experience.
[0144] In one embodiment, the process of moving gallery data in a physical album in the prior art can be simplified as follows: Figure 4C As shown in b in the figure.
[0145] 3. The gallery data in the mobile photo tab of the terminal in the existing technology (taking photos as an example, the process of moving videos is the same as moving photos):
[0146] 1) Moving large images
[0147] The Photos tab includes photos from the camera album as well as photos from the screenshot / screen recording album.
[0148] For example, taking the moving photo 1 as an example from the camera album, refer to... Figure 5CIn step 'a', when the user opens photo 1 in the photo tab, the terminal can display photo 1 and the first operation area 37 on the interface. When the user clicks on the more controls 373 in the first operation area 37, the terminal can display the first operation menu 41, such as... Figure 5C As shown in b. When the user clicks the movable control 411, it can trigger the terminal to display a movable photo album, as shown in Figure 411. Figure 5C As shown in 'c', it should be understood that... Figure 5C The movable album shown in 'c' is... Figure 5B The movable album shown in 'c' is the same. For example, if the user clicks the screenshot / screen recording album, the terminal can move photo 1 to the screenshot / screen recording album. Correspondingly, the terminal can return to the display photo tab, which will also display photo 1. Figure 5C As shown in d.
[0149] It is worth noting that because the Photos tab contains photos from the screenshot and screen recording album, if the user moves Photo 1 to an album contained in the Photos tab, the terminal will still display Photo 1 from the screenshot and screen recording album when it returns to the Photos tab, causing the user to feel that the move has failed and resulting in a poor user experience.
[0150] In one embodiment, if in Figure 5C In step c, if the user clicks on an album not included in the Photos tab, such as the "Like" album, the terminal can then return to display the next content of photo 1 in the Photos tab, such as... Figure 5C As shown in e. In this embodiment, since the photo tab does not contain the "Favorites" album, after the user moves photo 1 to the "Favorites" album, the terminal displays the next content of photo 1 in the photo tab, and the user can feel that photo 1 has been moved.
[0151] In summary, in scenarios where large images are moved within the photo tab, whether users perceive the movement of gallery data (or, in other words, the user experience of moving gallery data) depends on whether the moved album is included in the photo tab. If the moved album is included in the photo tab, the user will perceive the movement as a failure, resulting in a poor user experience. If the moved album is not included in the photo tab, the user will perceive the gallery data as successfully moved.
[0152] 2) Multiple selection movement
[0153] Similar to the scenario of moving large images in photo tabs, the scenario of moving multiple selected photo tabs will also have the same problem as the scenario of moving large images in photo tabs. The moving process in the prior art is not illustrated with accompanying drawings in the embodiments of this application.
[0154] In one embodiment, the process of moving gallery data in the photo tab in the prior art can be simplified to: Figure 4C As shown in c in the figure.
[0155] To improve the user experience of gallery data and prevent users from mistakenly believing that the gallery data has not been moved, in one embodiment, because users can perceive the movement of gallery data in a physical album, no adjustments need to be made to the movement of gallery data in the physical album. In this embodiment, the process of moving gallery data in the physical album in this application embodiment can be simplified to... Figure 6C As shown in a1, it should be understood that Figure 6C a1 and Figure 4C The 'a' in them is the same.
[0156] In one embodiment, in a scenario where gallery data is moved within a physical album, to further improve the user experience, this embodiment can display a prompt message after the gallery data has been moved. The prompt message informs the user that the gallery data has been moved to the target album. It should be understood that the target album is the album selected by the user, such as... Figure 5C Users can choose from options such as screenshots, screen recordings, and photo albums.
[0157] 1. The gallery data in the mobile entity album of the terminal in this embodiment of the application (taking photos as an example for explanation; the process of moving videos is the same as moving photos):
[0158] For example, in a scenario where large images in a physical photo album are moved, such as... Figure 6A As shown in 'd', the terminal's interface returning the next gallery data for photo 1 can display a prompt message, such as "Moved to the screenshot / screen recording album." It should be understood that... Figure 6A ac in Figure 4A The ac values in the text are the same. It should be understood that the movement of AI photos associated with videos can be referenced to photo 1 as an example.
[0159] For example, in a scenario where multiple selections are moved within a physical photo album, such as... Figure 6B As shown in 'e', the terminal returns and displays the gallery data in the camera album. This gallery data does not include the two files that the user has moved, and the terminal can display a prompt message on this screen, such as "Moved to the screenshot / screen recording album." It should be understood that... Figure 6B ad and Figure 4B The "ad" in each case is the same. In one embodiment, the prompt message indicating that a photo (including AI photos) has been moved to the target album may be referred to as the first prompt message.
[0160] In this embodiment, the process of moving gallery data in the physical album in this application embodiment can be simplified to: Figure 6C As shown in a2 in the figure.
[0161] In one embodiment, for scenarios involving the movement of gallery data in a virtual album and the movement of gallery data in a photo tab, this application embodiment can provide a notification after the gallery data movement is completed to remind the user that the movement is finished, thereby improving the user experience. The scenarios of moving gallery data in a virtual album and moving gallery data in a photo tab in this application embodiment will be described below:
[0162] 2. Gallery data in the mobile virtual album of the terminal in this embodiment (taking photos as an example, the process of moving videos is the same as moving photos):
[0163] In scenarios where gallery data is moved within a virtual album, the terminal will still display the moved gallery data after it has been moved. To prevent users from perceiving that the gallery data move has failed, this embodiment of the application can display a prompt message on the interface of the terminal displaying the moved gallery data. This prompt message is used to inform the user that the gallery data has been moved.
[0164] For example, in a scenario where large images are moved in a virtual photo album, such as... Figure 7A As shown in 'd', the terminal returns to the screen displaying photo 1 and displays a prompt message such as "Moved to camera album". It should be understood that... Figure 7A ac in Figure 5A The ac in the equations are the same.
[0165] For example, in a scenario where multiple selections can be moved within a virtual photo album, such as... Figure 7B As shown in 'e', the terminal returns and displays the gallery data from all photo albums. This gallery data includes the two files the user has moved, and the terminal can display a prompt message on this screen, such as "Moved to the screenshot / screen recording album." It should be understood that... Figure 7B ad and Figure 5B The ad in each case is the same.
[0166] In one embodiment, the process of moving gallery data in the virtual album in this application can be simplified as follows: Figure 6C As shown in b in the figure.
[0167] 3. Gallery data in the mobile photo tab of the terminal in this embodiment (taking photos as an example for explanation; the process of moving videos is the same as moving photos):
[0168] In scenarios where gallery data is moved within the photo tab, whether the terminal displays the moved gallery data after the move depends on whether the photo tab contains the album to which the moved gallery data belongs. To avoid the user experiencing the problem of gallery data movement failure when the photo tab contains the album to which the moved gallery data belongs, this embodiment of the application can display a prompt message on the interface of the terminal displaying the moved gallery data. This prompt message is used to inform the user that the gallery data has been moved.
[0169] For example, in a scenario where a large image is moved within a photo tab, if the photo tab contains the album to which the moved gallery data belongs (such as a screenshot / screen recording album), then... Figure 8A As shown in 'd', the terminal returns to the photo tab, which will also display photo 1. The terminal can also display a notification message on this screen, such as "Moved to Screenshot / Screen Recording Album," to indicate to the user that the move is complete. It should be understood that... Figure 8A ac in Figure 5C The ac in the equations are the same.
[0170] Similarly, such as Figure 8A As shown in 'e', if a user clicks on an album not included in the Photos tab, such as the "Favorites" album, the terminal can return to display the Photos tab, which does not show photo 1. To improve the user experience, the terminal can display a prompt message on this interface, such as "Moved to the 'Favorites' album," to indicate to the user that the move is complete.
[0171] Similarly, in scenarios where multiple photo tabs are selected and moved, the terminal can display a notification message on the terminal's interface when the photo library data movement is complete, to inform the user that the photo library data movement is finished. (See reference...) Figure 8B As shown.
[0172] In one embodiment, the process of moving gallery data in the virtual album in this application can be simplified as follows: Figure 6C As shown in c1 and c2. When the photo tab contains the album to which the moved photo data belongs, a prompt message can be displayed; if the photo tab does not contain the album to which the moved photo data belongs, the prompt message may not be displayed.
[0173] In this embodiment of the application, in scenarios of moving physical album gallery data, moving virtual album gallery data, and moving photo tab gallery data, after the terminal completes the gallery data movement, a prompt message can be displayed on the terminal interface to indicate to the user that the gallery data has been moved. In this way, regardless of whether the interface displays the moved gallery data or the next content, the user can know that the gallery data has been moved successfully, resulting in a high user experience.
[0174] In this embodiment of the application, in scenarios where the original video can generate an AI photo, the original video and the AI photo can also be moved. It should be noted that in this embodiment, regardless of whether the AI photo is associated with the video 1 displayed on the terminal, the movement of the AI photo is supported, and the moved AI photo can maintain its association with the video 1. Furthermore, when the terminal displays video 1 and the associated AI photo, after the AI photo or video 1 is moved, the terminal can continue to display video 1 and the associated AI photo, and display a prompt message on the interface to indicate that video 1 or the AI photo has been moved.
[0175] For example, such as Figure 3B As shown in c, when the terminal displays the original video (Video 1), the user can click on the more controls 373 to trigger the terminal to display the first operation menu 41. The user operates the movement control 411, and the terminal can move Video 1 to the album selected by the user. The process of the terminal moving Video 1 can refer to the movement process in the prior art, or it can refer to the process of moving gallery data in the above 1-3 embodiments of this application.
[0176] Figure 9A In this context, 'a' is the same as 'd' in 3B. That is, when the terminal displays the AI photo associated with video 1, the user clicking on more controls 373 can trigger the terminal to display the first operation menu 41. The user then operates the movable control 411, and the terminal can display a movable photo album, such as... Figure 9A As shown in bc. It should be understood that the albums included in the portable album depend on whether the user opens video 1 in the "physical album" or the "virtual album". Refer to the relevant descriptions in the above embodiments. In this embodiment, the example of the user opening video 1 in the camera album is used for illustration. Accordingly, Figure 9A The camera album is not included in 'c'.
[0177] For example, if a user selects the Screenshot / Screen Recording album from the available albums, the terminal can move AI Photo 1 to the Screenshot / Screen Recording album. Since AI Photo 1 is still stored locally, only its storage location has changed, the terminal can return to the display. Figure 9A The interface shown in 'a' is used to notify the user that the AI photo 1 has been successfully moved. The terminal can... Figure 9A The interface shown as 'a' displays a prompt message, such as "Moved to Screenshot / Screen Recording Album," or similar. Figure 9A As shown in d. Where, Figure 9A The interface shown as 'a' in the diagram can be called the first interface.
[0178] In this embodiment, the original video can be moved using existing moving methods, or, to improve user experience, it can be moved in the manner described in embodiments 1-3 of this application. For the AI photo associated with video 1, this embodiment can display a prompt message after moving the AI photo to indicate successful movement to the user, thus improving user experience. Specific moving methods can be found in the relevant descriptions in embodiments 1-3 of this application.
[0179] In one embodiment, in the scenario of moving photos and videos, the album selected by the user (i.e., the album to which the photos and videos are moved) can be referred to as the first target album, and in the scenario of copying photos and videos, the album selected by the user (i.e., the album to which the photos and videos are copied) can be referred to as the second target album.
[0180] The following describes the process of copying gallery data in the embodiments of this application. In one embodiment, after video 1 is copied, video 1' can maintain the association relationship with the AI photo associated with video 1, and after video 1 or video 1' is deleted, the videos that are not deleted (such as video 1' or video 1) can maintain the association with the AI photo.
[0181] For example, such as Figure 9B As shown in 'a', when the terminal displays the original video (Video 1), the user clicking 'More Controls' 373 can trigger the terminal to display the first operation menu 41. For example... Figure 9B As shown in b, when the user operates the copy control 412, the terminal can display a copyable album. The copyable album can be referred to the description of the movable album in the above embodiments. In this embodiment, opening video 1 from the camera album is taken as an example. Correspondingly, the copyable album does not include the camera album, such as... Figure 9B As shown in c. For example, if the user selects the screenshot / screen recording album, the terminal can copy video 1 to the screenshot / screen recording album. After copying video 1, the terminal can return to the display. Figure 9B The interface shown in Figure 'a'. In one embodiment, to notify the user that video 1 has been copied, a prompt message can be displayed on the interface, such as "Copied to Screenshot / Screen Recording Album," etc. Figure 9B As shown in d in the diagram. In one embodiment, the information used to indicate that a video or photo has been copied to the target album may be referred to as the second notification information.
[0182] Correspondingly, when the terminal displays video 1' in the screenshot / screen recording album, it can display the associated area 36, and within the associated area 36, it can display a thumbnail of video 1, as well as thumbnails of the AI photos associated with video 1, such as... Figure 9B As shown in e in the figure. In one embodiment, after video 1 is copied, the AI configuration file related to video 1 can also be copied simultaneously, thus in the case of... Figure 9BThe interface of e can display controls for one-click blockbuster production to generate AI videos.
[0183] In this embodiment of the application, when the terminal displays video 1, it can support copying AI photos regardless of whether the AI photos associated with video 1 are displayed. In order to reduce the display of duplicate content, the copied AI photos can be no longer associated with video 1.
[0184] For example, such as Figure 9C As shown in Figure a, when the terminal displays AI photo 1 associated with video 1, the user can trigger the terminal to display the first operation menu 41 by clicking on more controls 373. For example... Figure 9C As shown in b, when the user operates the copy control 412, the terminal can display the copyable photo album, such as... Figure 9C As shown in 'c'. For example, if the user selects the screenshot / screen recording album, the terminal can copy AI Photo 1 to the screenshot / screen recording album. After copying AI Photo 1, the terminal can return to the display. Figure 9C The interface shown in Figure 'a'. In one embodiment, to notify the user that AI photo 1 has been copied, a prompt message can be displayed on the interface, such as "Copied to Screenshot / Screen Recording Album," etc. Figure 9C As shown in d.
[0185] Correspondingly, when the terminal displays AI Photo 1 in the screenshot / screen recording album, in order to reduce the display of duplicate content, the associated area 36 can be omitted from the interface displaying AI Photo 1, such as... Figure 9C As shown in e.
[0186] Furthermore, in scenarios where a third-party device copies Video 1 or an AI photo, the third-party device can simultaneously copy the association between Video 1 and the AI photo. Therefore, when the third-party device displays Video 1, the associated area 36 can be shown. Additionally, in scenarios where a third-party device copies Video 1 or an AI photo, the third-party device can avoid displaying duplicate content when displaying Video 1 or the AI photo.
[0187] In this embodiment, the terminal can copy video 1 and the AI photo associated with video 1. To adapt to the user's experience, the terminal can prompt the user to copy the video and not display the associated video 1 when displaying the copied AI photo, which can improve the user experience.
[0188] In one embodiment, for a terminal, a video (such as video 1) on the terminal is associated with at least one photo, the at least one photo is generated based on the video, and the at least one photo is contained in a first album in a gallery application. See also... Figure 10 The human-computer interaction method provided in this application embodiment may include:
[0189] S1001, in response to a user's operation on a thumbnail of a target photo displayed in a first album or photo tab, a movement control is displayed, wherein when a thumbnail of a target photo is displayed in a photo tab, photos in the first album are included in the photo tab, and the target photo is included in at least one photo.
[0190] S1002, in response to user operation of the moving control, displays an icon for the movable album.
[0191] S1003, in response to the user's operation on the identifier of the target album in the identifier of the movable album, the target photo is moved to the target album.
[0192] S1004, Display the first prompt message, which indicates that the target photo has been moved to the target album.
[0193] In this embodiment, S1001-S1004 can be referred to the above. Figures 6A-8B ,as well as Figure 9A The relevant descriptions are provided. Furthermore, this application embodiment also enables video sharing (see the relevant descriptions for photo sharing), and also enables the copying of videos and photos (see the relevant descriptions for...). Figures 9B-9C The description in the text.
[0194] Figure 11 This is a schematic diagram of a human-computer interaction device provided in an embodiment of this application. The human-computer interaction device can be a terminal as shown in the above embodiment, or a chip within a terminal. A video is associated with at least one photo, the at least one photo is generated based on the video, and the at least one photo is included in a first album of a gallery application, as shown below. Figure 11 The human-computer interaction device may include a display module 1101 and a processing module 1102.
[0195] Display module 1101 is configured to display a movement control in response to a user's operation on a thumbnail of a target photo displayed in the first album or the photo tab, wherein when the thumbnail of the target photo is displayed in the photo tab, the photo in the first album is included in the photo tab, and the target photo is included in the at least one photo; and, in response to the user's operation on the movement control, display an identifier of a movable album.
[0196] The processing module 1102 is configured to move the target photo to the target album in response to the user's operation on the identifier of the target album in the identifier of the movable album.
[0197] The display module 1101 is also used to display a first prompt message, which indicates that the target photo has been moved to the target album.
[0198] In one possible implementation, manipulation of the thumbnail of the target photo triggers the terminal to display the target photo. The display module 1101 is specifically used to display a first interface, on which the target photo is displayed, and a first operation area, the first operation area including the motion control.
[0199] In one possible implementation, the operation on the thumbnail of the target photo is used to select the target photo. The display module 1101 is specifically used to display a second operation area, which includes the motion control.
[0200] In one possible implementation, the second operating region is different from the first operating region.
[0201] In one possible implementation, the display module 1101 is specifically used for:
[0202] When the user interacts with the thumbnail of the target photo displayed in the first album, the first prompt message is displayed according to the type of the first album; or,
[0203] When the user interacts with the thumbnail of the target photo displayed in the photo tab, the first prompt message is displayed depending on whether the gallery data in the target album is included in the photo tab.
[0204] In one possible implementation, when the first album is a physical album, the display module 1101 is specifically used to display the next content arranged after the target photo in the first album, and to display the first prompt information. When the first album is a virtual album, the display module 1101 is specifically used to display the target photo, and to display the first prompt information.
[0205] In one possible implementation, when the gallery data in the target album is included in the photo tab, the display module 1101 is specifically used to display the target photo and the first prompt information; when the gallery data in the target album is not included in the photo tab, the display module 1101 is specifically used to display the next content arranged after the target photo in the photo tab and the first prompt information.
[0206] In one possible implementation, the first album can be a physical album or a virtual album. When the first album is a physical album, the movable album does not contain the first album but contains other physical albums. When the first album is a virtual album, the movable album contains all the physical albums. Or...
[0207] When the user interacts with the thumbnail of the target photo displayed in the photo tab, the movable album contains all the physical albums.
[0208] In one possible implementation, when the first album and the photo tab display thumbnails of videos associated with at least one photo, the display module 1101 is further configured to, in response to the user's operation on the thumbnails of the videos displayed in the first album or the photo tab, display a first interface. The display area of the first interface displays the video footage. The first interface further includes an association area and a first operation area. The association area includes an identifier of the video and an identifier of at least one photo associated with the video, the at least one photo being generated based on the video. The first operation area includes a motion control. In response to the user's operation on the identifier of the target photo on the first interface, the target photo is displayed in the display area. In response to the user's operation on the motion control, the identifier of the movable album is displayed.
[0209] The processing module 1102 is further configured to move the target photo to the target album in response to the user's operation on the identifier of the target album.
[0210] The display module 1101 is also used to display a first prompt message on a first interface displaying the target photo, the first prompt message being used to indicate that the target photo has been moved to the target album.
[0211] In one possible implementation, the target album is a first target album, and the first operation area further includes a copy control. The display module 1101 is also used to display an identifier of the album that can be copied in response to the user's operation of the copy control when the display area displays the video frame.
[0212] The processing module 1102 is further configured to, in response to the user's operation on the identifier of the second target album in the identifier of the copyable album, copy the video to the second target album.
[0213] The display module 1101 is also used to display a second prompt message, which indicates that the video has been copied to the second target album.
[0214] In one possible implementation, the display module 1101 is further configured to display the first interface in response to the user's operation of triggering the terminal to display the video in the second target album.
[0215] In one possible implementation, the target album is a first target album, and the first operation area also includes a copy control. When the display area displays the target photo, in response to the user's operation of the copy control, the display module 1101 is specifically used to display an identifier of the album that can be copied.
[0216] The processing module 1102 is specifically used to copy the target photo to the second target album in response to the user's operation on the identifier of the second target album in the identifier of the copyable album.
[0217] The display module 1101 is also used to display a second prompt message, which indicates that the target photo has been copied to the second target album.
[0218] In one possible implementation, the display module 1101 is further configured to display the target photo in response to the user's operation of triggering the terminal to display the target photo in the second target album, wherein the interface displaying the target photo in the second target album does not include the associated area.
[0219] In one possible implementation, the first album can be a physical album or a virtual album. When the first album is a physical album, the copyable album does not include the first album but includes other physical albums. When the first album is a virtual album, the copyable album includes all physical albums. Or...
[0220] When the user interacts with the thumbnail of the video displayed in the photo tab, the copyable album contains all the physical albums.
[0221] In one possible implementation, the display module 1101 is further configured to include more controls in the first operation area, and the display module 1101 is further configured to display at least one operable control in response to the user's operation of the more controls, wherein the at least one operable control includes the move control and the copy control.
[0222] The human-computer interaction device provided in this application embodiment can be used to implement the human-computer interaction method in the above embodiments, and has the same implementation principle and technical effect as the above embodiments, which will not be repeated here.
[0223] In one embodiment, reference is made to... Figure 12This application also provides an electronic device, which can be the terminal described in the above embodiments. The electronic device may include a processor 1201 (e.g., a CPU) and a memory 1202. The memory 1202 may include high-speed random-access memory (RAM) and may also include non-volatile memory (NVM), such as at least one disk storage device. The memory 1202 may store various instructions for performing various processing functions and implementing the method steps of this application.
[0224] Optionally, the electronic device involved in this application may further include: a power supply 1203, a communication bus 1204, a communication port 1205, and a display 1206. The communication port 1205 is used to enable communication between the electronic device and other peripherals. In this embodiment, the memory 1202 stores computer-executable program code, which includes instructions. When the processor 1201 executes the instructions, the instructions cause the processor 1201 of the electronic device to perform the actions described in the above method embodiments. The implementation principle and technical effects are similar and will not be repeated here. In one embodiment, the display 1206 may be a screen of the electronic device, used to display the interface of the electronic device.
[0225] It should be noted that the modules or components described in the above embodiments can be one or more integrated circuits configured to implement the above methods, such as one or more application-specific integrated circuits (ASICs), one or more digital signal processors (DSPs), or one or more field-programmable gate arrays (FPGAs), etc. Furthermore, when a module is implemented through processing element scheduler code, the processing element can be a general-purpose processor, such as a central processing unit (CPU) or other processors capable of calling program code, such as a controller. Additionally, these modules can be integrated together to implement a system-on-a-chip (SOC).
[0226] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., a solid-state disk (SSD)).
[0227] The term "multiple" in this document refers to two or more. The term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. Furthermore, the character " / " in this document generally indicates an "or" relationship between the preceding and following related objects; in formulas, " / " indicates a "division" relationship. Additionally, it should be understood that in the description of this application, words such as "first" and "second" are used only for descriptive purposes and should not be construed as indicating or implying relative importance or order.
[0228] It is understood that the various numerical designations used in the embodiments of this application are merely for descriptive convenience and are not intended to limit the scope of the embodiments of this application.
[0229] It is understood that, in the embodiments of this application, the order of the above-mentioned process numbers does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
Claims
1. A human-computer interaction method, characterized in that, The method includes: associating a video with at least one photo, the at least one photo being generated based on the video, and the at least one photo being contained in a first album within a gallery application; In response to a user's operation on a thumbnail of a target photo displayed in the first album or photo tab, a movement control is displayed, wherein when the thumbnail of the target photo is displayed in the photo tab, the photo in the first album is included in the photo tab, and the target photo is included in the at least one photo; In response to the user's operation of the mobile control, an icon for the movable album is displayed; In response to the user's operation on the identifier of the target album in the identifier of the movable album, the target photo is moved to the target album; When the user operates on the thumbnail of the target photo displayed in the first album, if the first album is a virtual album, the target photo is displayed and a first prompt message is displayed; if the first album is a physical album, the next content in the first album after the target photo is displayed and the first prompt message is not displayed. When the user interacts with the thumbnail of the target photo displayed in the photo tab, if the image library data in the target album is included in the photo tab, the target photo is displayed, and the first prompt message is also displayed; if the image library data in the target album is not included in the photo tab, the next content in the photo tab after the target photo is displayed, and the first prompt message is not displayed. The first notification message indicates that the target photo has been moved to the target album.
2. The method according to claim 1, characterized in that, The manipulation of the thumbnail of the target photo is used to trigger the terminal to display the target photo; The display of the mobile control includes: The first interface displays the target photo and a first operation area, which includes the motion control.
3. The method according to claim 2, characterized in that, The operation on the thumbnail of the target photo is used to select the target photo; The display of the mobile control includes: Display a second operation area, which includes the motion control.
4. The method according to claim 3, characterized in that, The second operating area is different from the first operating area.
5. The method according to any one of claims 1-4, characterized in that, The first album can be a physical album or a virtual album. When the first album is a physical album, the movable album does not contain the first album but contains other physical albums. When the first album is a virtual album, the movable album contains all physical albums; or... When the user interacts with the thumbnail of the target photo displayed in the photo tab, the movable album contains all the physical albums.
6. The method according to any one of claims 1-4, characterized in that, When the first album and the photo tab display thumbnails of the at least one photo-related video, the method further includes: In response to the user's operation on the thumbnail of the video displayed in the first album or the photo tab, a first interface is displayed. The display area of the first interface displays the screen of the video. The first interface also includes an association area and a first operation area. The association area includes the identifier of the video and the identifier of at least one photo associated with the video. The at least one photo is generated based on the video. The first operation area includes a motion control. In response to the user's operation of marking the target photo on the first interface, the target photo is displayed in the display area; In response to the user's operation of the mobile control, an icon for the movable album is displayed; In response to the user's operation on the identifier of the target album, the target photo is moved to the target album; A first prompt message is displayed on the first interface that displays the target photo, the first prompt message being used to indicate that the target photo has been moved to the target album.
7. The method according to claim 6, characterized in that, The target album is a first target album, and the first operation area also includes a copy control. The method further includes: When the display area displays the video frame, in response to the user's operation of the copy control, an icon indicating that the album can be copied is displayed; In response to the user's operation on the identifier of the second target album in the identifier of the copyable album, the video is copied to the second target album; A second notification message is displayed, indicating that the video has been copied to the second target album.
8. The method according to claim 7, characterized in that, The method further includes: In response to the user's action of triggering the terminal to display the video in the second target album, the first interface is displayed.
9. The method according to claim 6, characterized in that, The target album is a first target album, and the first operation area also includes a copy control. The method further includes: When the target photo is displayed in the display area, in response to the user's operation of the copy control, an icon of the album that can be copied is displayed; In response to the user's operation on the identifier of the second target album in the identifier of the copyable album, the target photo is copied to the second target album; A second prompt message is displayed, indicating that the target photo has been copied to the second target album.
10. The method according to claim 9, characterized in that, The method further includes: In response to the user triggering the terminal to display the target photo in the second target album, the target photo is displayed, and the associated area is not included on the interface of the second target album where the target photo is displayed.
11. The method according to any one of claims 7-10, characterized in that, The first album can be a physical album or a virtual album. When the first album is a physical album, the copyable album does not include the first album but includes other physical albums. When the first album is a virtual album, the copyable album includes all physical albums; or... When the user interacts with the thumbnail of the video displayed in the photo tab, the copyable album contains all the physical albums.
12. The method according to any one of claims 7-10, characterized in that, The first operating area includes more controls, and the response to the user's operation of the movement control further includes: In response to the user's operation of the additional controls, at least one operable control is displayed, including the move control and the copy control.
13. A human-computer interaction device, characterized in that, A video is associated with at least one photo, the at least one photo being generated based on the video, and the at least one photo being contained in a first album within a gallery application; the device includes: The display module is used for: In response to a user's action on a thumbnail of a target photo displayed in the first album or photo tab, a movement control is displayed, wherein when the thumbnail of the target photo is displayed in the photo tab, the photo in the first album is included in the photo tab, and the target photo is included in the at least one photo; and, In response to the user's operation of the mobile control, an icon for the movable album is displayed; The processing module is configured to, in response to the user's operation on the identifier of the target album in the identifier of the movable album, move the target photo to the target album; The display module is further configured to, when the user operates on the thumbnail of the target photo displayed in the first album, if the first album is a virtual album, display the target photo and display a first prompt message; if the first album is a physical album, display the next content in the first album arranged after the target photo, and do not display the first prompt message. When the user interacts with the thumbnail of the target photo displayed in the photo tab, if the image library data in the target album is included in the photo tab, the target photo is displayed, and the first prompt message is also displayed; if the image library data in the target album is not included in the photo tab, the next content in the photo tab after the target photo is displayed, and the first prompt message is not displayed. The first notification message indicates that the target photo has been moved to the target album.
14. An electronic device, characterized in that, include: Processor and memory; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory, causing the processor to perform the method as described in any one of claims 1-12.
15. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program or instructions that, when executed, implement the method as described in any one of claims 1-12.
16. A computer program product comprising a computer program or instructions, characterized in that, When the computer program or instructions are executed by a processor, they implement the method of any one of claims 1-12.