Message display method and electronic device
Patent Information
- Application Number
- JP2023519481
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-09-29
- Filing Date
- 2021-09-22
- Publication Date
- 2025-03-11
- Estimated Expiration
- 2041-09-22
AI Technical Summary
【0053】 第2態様から第6態様の有益な効果については、第1態様の有益な効果を参照されたい。詳細は再び説明されない。
Smart Images

Figure 0007643786000001 
Figure 0007643786000002 
Figure 0007643786000003
Abstract
Description
[Technical field]
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to Chinese Patent Application No. 202011051557.X, entitled “Message Display Method and Electronic Device,” filed with the China National Intellectual Property Office on September 29, 2020, the entire contents of which are incorporated herein by reference.
[0002] The present application relates to the field of terminal technology, in particular to a message display method and electronic device. [Background technology]
[0003] Instant messaging is an Internet-based communication method that allows two or more people to send messages, such as text, voice, video, and photos, through the Internet. This enriches people's communication methods and provides great convenience for people's life and work. An instant messaging application is a tool for implementing instant messaging, such as WeChat (registered trademark), QQ (registered trademark), DingTalk (registered trademark), or MeeTime (registered trademark), and can be installed on an electronic device (e.g., a mobile phone or a tablet computer) to provide users with communication services. However, in the prior art, some functions of instant messaging applications need to be further improved to make them more convenient for users to use. Summary of the Invention
[0004] The present application provides a message display method and an electronic device, so that a user can select to perform an operation on an area of a video message based on the user's request, and the electronic device can play the video associated with the video message in a video playback manner corresponding to the area, thereby helping to improve the flexibility of playing the video associated with the video message.
[0005] According to a first aspect, an embodiment of the present application provides a message display method, the method being applied to an electronic device, an instant message application being installed on the electronic device, the method specifically including:
[0006] The electronic device displays a first user chat interface of an instant messaging application, where the first user chat interface includes a first video message, the first video message includes a first area and a second area, the first video message is associated with a first video, the first video includes a first audio and a first image of at least one frame, the first area corresponds to the first audio and the second area corresponds to the first image of the at least one frame; the electronic device plays the first video in a first manner in response to operations performed by the user on the first area; and the electronic device plays the first video in a second manner in response to operations performed by the user on the second area.
[0007] In this embodiment of the present application, the first video message includes a first area and a second area, so that the electronic device can play the first video in a first manner in response to an operation performed by a user on the first area, and can play the first video in a second manner in response to an operation performed by a user on the second area, which helps improve the flexibility of playing the first video.
[0008] It should be noted that the first video associated with the first video message may be transmitted by the electronic device in response to a user action or may be received by the electronic device, without being limited in this respect.
[0009] In a possible design, the second region may correspond to an image of at least one frame in the following manner.
[0010] The second area is used to display a thumbnail of a target image, which is an image associated with the first image, thereby helping to provide a clearer display to the user on the second area.
[0011] For example, the image associated with the first video is one of the first images of the at least one frame. In another example, the image associated with the first video is a predetermined image, and the predetermined image is different from the first image of the at least one frame.
[0012] In a possible design, the electronic device playing a first video in a first manner in response to an operation performed by a user on a first area may be implemented in the following manner.
[0013] The electronic device plays the first sound but skips playing the first image for at least one frame in response to an operation performed by a user on the first region.
[0014] The electronic device playing the first video in the second manner in response to an operation performed by a user on the second area may be implemented in the following manner.
[0015] The electronic device plays at least one frame of a first image and plays a first sound in response to an operation performed by a user on the second area.
[0016] According to the above technical solution, the user can only play the audio in the first video, but cannot play the image of at least one frame based on the user's request.
[0017] In a possible design, the electronic device may reproduce a first image of at least one frame in the following manner.
[0018] The electronic device plays the first image of the at least one frame in a small window, or the electronic device plays the first image of the at least one frame in a full screen mode.
[0019] In a possible design, the electronic device playing a first video in a first manner in response to an operation performed by a user on a first area may be implemented in the following manner.
[0020] In response to an operation performed by a user on the first area, the electronic device plays a first sound and plays at least one frame of a first image in the small window.
[0021] The electronic device playing the first video in the second manner in response to an operation performed by a user on the second area may be implemented in the following manner.
[0022] In response to an operation performed by a user on the second area, the electronic device plays a first sound and plays at least one frame of a first image in a full screen mode.
[0023] In a possible design, the electronic device plays the first image in full-screen mode in response to the user tapping the small window, so that it is convenient for the user to switch to full-screen playback when the first image of the at least one frame is played in the small window.
[0024] In a possible design, the electronic device playing a first video in a first manner in response to an operation performed by a user on a first area may be implemented in the following manner.
[0025] The electronic device plays the first sound but skips playing the first image for at least one frame in response to an operation performed by a user on the first region.
[0026] The electronic device playing the first video in the second manner in response to an operation performed by a user on the second area may be implemented in the following manner.
[0027] The electronic device plays the first image for at least one frame but skips playing the first audio in response to an operation performed by the user on the second region.
[0028] In a possible design, the electronic device playing a first image of at least one frame but skipping playing a first audio in response to an operation performed by a user on a second area may be implemented in the following manner.
[0029] In response to an operation performed by the user on the second region, the electronic device plays the first image of the at least one frame and converts and displays the first speech into text when the first image of the at least one frame is displayed, such that comprehension is not affected when the user does not play the speech but the image of the at least one frame is viewed.
[0030] For example, when a first image of at least one frame is played, text converted from the first audio may be displayed in the form of subtitles.
[0031] In a possible design, the first user chat interface further includes a second video message, the second video message is associated with the second video, the second video message includes a third region and a fourth region, the second video includes a second audio and a second image of at least one frame, the third region corresponds to the second audio, the fourth region corresponds to the second image of at least one frame, both the first video message and the second video message are in an unread state, and the second video message follows the first video message; in response to an operation performed by the user on the first region, the electronic device automatically plays the second audio after the first audio is completely played, which helps reduce user operations.
[0032] Please note that the first video message and the second video message are each displayed in two regions, that is, the display style of the first video message is the same as the display style of the second video message.
[0033] In a possible design, the first user chat interface further includes a first voice message, the first voice message follows the first video message, and both the first voice message and the first video message are in an unread state; in response to an operation performed by the user on the first area, after the first audio is completely played, the electronic device automatically plays a voice associated with the first voice message, thereby helping to reduce user operations.
[0034] In a possible design, the first user chat interface further includes a second voice message and a third video message, the third video message is associated with the third video, the third video includes a third audio and a third image of at least one frame, the third video message includes a fifth region and a sixth region, the fifth region corresponds to the third audio and the sixth region corresponds to the third image of at least one frame, the third video message follows the second voice message, and both the second voice message and the third video message are in an unread state; in response to an operation performed by the user on the second voice message, the electronic device plays a voice associated with the second voice message, and automatically plays the third audio after the voice associated with the second voice message has been completely played, which helps reduce user operations.
[0035] In a possible design, the electronic device receives a first operation in a first user chat interface; in response to the first operation, the electronic device performs shooting by using a camera and displays a shooting interface, and the shooting interface is used to display an image captured by the camera. According to the above technical solution, a user can perform video recording or image shooting by performing only one operation, thereby simplifying the manner of triggering the electronic device to perform shooting by using a camera.
[0036] In a possible design, the first action is for the user to slide upwards in the first user chat interface.
[0037] In a possible design, the electronic device receives a second operation in the first user chat interface; in response to the second operation, the electronic device collects voice by using a microphone. In this way, it is convenient for the user to collect voice.
[0038] In a possible design, the first user chat interface further includes a first control, a seventh region, and an eighth region, where the first control is used for message input, and the seventh region and the eighth region do not overlap; the first operation is for a user to hold the first control and slide it to the seventh region; and the second operation is for a user to hold the first control and slide it to the eighth region, which helps a user implement audio and video mixing.
[0039] In a possible design, the seventh area is further used to display the image captured by the camera, thus making it convenient for users to preview the image.
[0040] In a possible design, the electronic device displays a consolidate and forward box, the consolidate and forward box is used to forward the N messages in the second user chat interface, the consolidate and forward box includes M profile pictures, the M profile pictures are used to indicate a user group or user to which the N messages are forwarded, each of the M profile pictures includes one delete icon; in response to the user tapping the delete icon on a first profile picture in the M profile pictures, the electronic device deletes the first profile picture in the consolidate and forward box, where M and N are positive integers. In this way, it is convenient for the user to delete a user group or user to which the N messages are forwarded.
[0041] In a possible design, the electronic device displays a consolidate and forward box, which is used to forward N messages in a second user chat interface, the consolidate and forward box including a second control and / or a third control; in response to an operation on the second control, the electronic device displays a chat selection interface, which is used to select a user group or user to which the messages are consolidated and forwarded, and in response to an operation on the third control, the electronic device displays a user chat interface, which is used for the user to select a message, where N is a positive integer. In this way, it is convenient for the user to add or remove messages, user groups, or users during consolidation and forwarding.
[0042] In a possible design, the electronic device displays a consolidation and forwarding box, which is used to forward N messages in the second user chat interface, and the consolidation and forwarding box includes message number prompt information, which is used to indicate the number of messages forwarded by the user, where N is a positive integer. In this way, it is convenient for the user to see the number of messages forwarded.
[0043] In a possible design, the electronic device displays a consolidate and forward box, the consolidate and forward box including K messages, the K messages including N messages to be forwarded in a second user chat interface, K greater than or equal to N, where K and N are positive integers; in response to an operation performed by the user on a second message in the N messages, the electronic device opens a file associated with the second message, the file associated with the second message being one of voice, video, audio and video, document, photo, location, and link. In this manner, the user can preview the file associated with the message in the consolidate and forward box.
[0044] In a possible design, the K messages in the Merge and Forward boxes are each displayed in a bubble format, so that it is convenient for the user to view the K messages.
[0045] In a possible design, each of the N messages corresponds to one selection control, and the selection control corresponding to each of the N messages is in a selected state; in response to an operation performed by a user on the selection control corresponding to a third message in the N messages, the electronic device switches the selection control corresponding to the third message from a selected state to an unselected state, and the electronic device skips forwarding the third message when the selection control corresponding to the third message is in an unselected state. In this way, it is convenient for a user to add or remove messages during consolidation and forwarding.
[0046] Note that in some embodiments, when K is greater than N, the selection controls corresponding to messages in the K messages other than the N messages are in an unselected state. In response to an operation performed by a user on the selection control corresponding to a fourth message in the other message, the electronic device switches the selection control corresponding to the fourth message from an unselected state to a selected state. The electronic device forwards the fourth message when the selection control corresponding to the fourth message is in a selected state.
[0047] In a possible design, the electronic device displays a third user chat interface, the third user chat interface including a fifth message, the fifth message being associated with an integrated and forwarded chat history, the integrated and forwarded chat history including N messages; in response to an operation performed by the user on the fifth message, the electronic device displays a detailed chat history interface, the detailed chat history interface including the N messages, the N messages being displayed in a bubble format. In this manner, the user's chat history can be restored and viewed.
[0048] According to a second aspect, an embodiment of the present application provides an electronic device, the electronic device including modules / units for performing the method in the first aspect or any one of the possible designs of the first aspect, the modules / units may be implemented by hardware or may be implemented by hardware by executing corresponding software.
[0049] According to a third aspect, an embodiment of the present application provides a chip, the chip being coupled to a memory in an electronic device, configured to call a computer program stored in the memory and implement the technical solution of the first aspect of the embodiment of the present application and any one of the possible designs of the first aspect of the embodiment of the present application. "Coupled" in the embodiment of the present application indicates that two components are directly or indirectly combined with each other.
[0050] According to a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, the computer-readable storage medium including a computer program, which, when executed on an electronic device, enables the electronic device to implement the technical solution in the first aspect and any one of the possible designs of the first aspect.
[0051] According to a fifth aspect, an embodiment of the present application provides a computer program, the computer program comprising instructions, which, when executed on a computer, enable the computer to implement the technical solution in the first aspect and any one of the possible designs of the first aspect.
[0052] According to a sixth aspect, an embodiment of the present application provides a graphical user interface on an electronic device. The electronic device has a display, one or more memories and one or more processors. The one or more processors are configured to execute one or more computer programs stored in the one or more memories. The graphical user interface includes a graphical user interface displayed when the electronic device executes the technical solution in any one of the first aspect and possible designs of the first aspect.
[0053] For the beneficial effects of the second to sixth aspects, please refer to the beneficial effects of the first aspect. Details will not be described again. [Brief description of the drawings]
[0054] [Figure 1] FIG. 2 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.
[0055] [Figure 2A-A] FIG. 2 is a schematic diagram of a user interface according to an embodiment of the present application. [Figure 2A-B] FIG. 2 is a schematic diagram of a user interface according to an embodiment of the present application.
[0056] [Figure 2B-A] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application. [Figure 2B-B] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application. [Figure 2B-C] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application. [Figure 2B-D] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application.
[0057] [Figure 3A] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application. [Figure 3B]FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application. [Figure 3C] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application.
[0058] [Figure 4] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application.
[0059] [Diagram 5] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application.
[0060] [Figure 6] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application.
[0061] [Figure 7A] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application. [Figure 7B] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application. [Figure 7C] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application. [Figure 7D] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application.
[0062] [Figure 8] 2 is a schematic diagram of an image captured by an electronic device according to an embodiment of the present application;
[0063] [Figure 9] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application.
[0064] [Figure 10A] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application. [Figure 10B] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application. [Figure 10C] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application. [Figure 10D] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application.
[0065] [Figure 11] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application.
[0066] [Figure 12] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application.
[0067] [Figure 13A] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application. [Figure 13B] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application.
[0068] [Figure 14A] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application. [Figure 14B] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application. [Figure 14C] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application. [Figure 14D] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application. [Figure 14E] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application. [Figure 14F] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application. [Figure 14G] FIG. 2 is a schematic diagram of another user interface according to an embodiment of the present application.
[0069] [Figure 15A] FIG. 2 is a schematic diagram of a consolidation and forwarding box according to an embodiment of the present application. [Figure 15B]FIG. 2 is a schematic diagram of a consolidation and forwarding box according to an embodiment of the present application.
[0070] [Figure 16A] FIG. 2 is a schematic diagram of another consolidation and transfer box according to an embodiment of the present application. [Figure 16B] FIG. 2 is a schematic diagram of another consolidation and transfer box according to an embodiment of the present application.
[0071] [Figure 17] FIG. 2 is a schematic diagram of a user interface according to an embodiment of the present application.
[0072] [Figure 18] FIG. 2 is a schematic diagram of another consolidation and transfer box according to an embodiment of the present application.
[0073] [Figure 19] FIG. 2 is a schematic diagram of a structure of another electronic device according to an embodiment of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0074] First, some terms used in the embodiments of the present application will be explained to facilitate understanding by those skilled in the art.
[0075] Instant Message Application: The instant message application in the embodiment of the present application is a tool for implementing instant messaging, which allows two or more people to send messages, such as text, voice, video, document, and photo, through the Internet. This provides great convenience for people to communicate with each other. For example, the instant message application in the embodiment of the present application may be WeChat, MeeTime, or QQ. Specifically, the instant message application may be installed on an electronic device and provide services to a user. In response to a user's operation of opening the instant message application, the electronic device may display a user chat interface. For example, the user chat interface may be a group chat interface (i.e., a chat interface including at least three users, e.g., a chat interface including user A, user B, and user C), or may be a separate chat interface (i.e., a chat interface including two users, e.g., a chat interface including user A and user B). In the user chat interface, a user can view messages, such as voice, video, and text, sent by the user or another user.
[0076] Video: In the embodiments of the present application, video includes audio and multiple frame images. For a video message in a user chat interface, an electronic device playing a video associated with the video message may be understood as, for the video, the electronic device playing multiple frame images when playing audio. For a video message in a user chat interface, an electronic device playing audio in the video associated with the video message may be understood as, for the video, the electronic device playing only audio but not multiple frame images. For a video message in a user chat interface, an electronic device playing multiple frame images in the video associated with the video message may be understood as, for the video, the electronic device playing only audio but not multiple frame images.
[0077] Typically, an instant messaging application displays a video message in a first style in a chat interface, where in response to an operation performed by a user on the video message displayed in the first style, the electronic device can only play a video associated with the video message, but cannot independently play audio or images of multiple frames in the video associated with the video message.
[0078] In view of this, an embodiment of the present application provides a message display method, so that an electronic device can display a video message in a second style in a user chat interface of an instant message application. When the video message is displayed in the second style, the video message includes a first region and a second region. A video playback manner corresponding to the first region is a first manner, and a video playback manner corresponding to the second region is a second manner. The first region and the second region are different regions, the first manner is different from the second manner, and the video message is associated with a video. In this way, a user can select a corresponding region for the video message based on a user's request and perform an operation, and play the video associated with the video message in the video playback manner corresponding to the region. This improves the flexibility of video playback. For example, if the first manner is to play an audio in the video, the user performs an operation on the first region, so that the electronic device can play the audio in the video associated with the video message. In another example, if the second manner is to play an image of at least one frame in the video, the user performs an operation on the second region, so that the electronic device can play the image of at least one frame in the video associated with the video message.
[0079] It should be understood that "at least one" in the embodiments of the present application means one or more. "Multiple" means two or more than two. "And / or" describes a correspondence between related objects and indicates that three relationships may exist. For example, A and / or B may indicate three cases: when only A is present, when both A and B are present, and when only B is present. A and B may be singular or plural. The character " / " usually indicates an "or" relationship between related objects. At least one of the following, or similar expressions thereof, indicates any combination of those items, including any combination of a single item or multiple items. For example, at least one of a, b, or c may indicate seven cases, namely a, b, c, a and b, a and c, b and c, or a, b, and c. Each of a, b, and c may be an element or a set including one or more elements.
[0080] In this application, the words "for example," "in some embodiments," "in some other embodiments," and the like, are used to denote providing an example, illustration, or explanation. Any embodiment or design manner described in this application as an "example" should not be described as preferred or having more advantages over another embodiment or design manner. Specifically, words such as example are used to present concepts in a specific manner.
[0081] It should be noted that in the embodiments of the present application, words such as "first" and "second" are used merely for purposes of distinction and explanation, but should not be understood as indicating or implying relative importance, or as indicating or implying an order.
[0082] The electronic device in the embodiment of the present application supports the installation of an instant messaging application. The instant messaging application may be installed before delivery of the electronic device, or may be installed by a user based on a user's request. This is not limited. For example, the electronic device in the embodiment of the present application may be a portable terminal, such as a mobile phone, a tablet computer, a notebook computer, or a wearable electronic device (e.g., a smart watch). For example, the portable terminal has an operating system including, but not limited to, IOS, Android, Windows, or another operating system. In addition, the electronic device in the embodiment of the present application may not be a portable terminal, and may be, for example, a desktop computer with a touch-sensitive surface.
[0083] For example, Figure 1 is a schematic diagram of the structure of an electronic device according to an embodiment of the present application. Specifically, as shown in the figure, the electronic device includes a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a handset 170B, a microphone 170C, a headset jack 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, a subscriber identity module (SIM) card interface 195, and the like. The sensor module 180 may include a pressure sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, an optical proximity sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, and a bone conduction sensor, etc.
[0084] Processor 110 may include one or more processing units. For example, processor 110 may include an application processor (AP), a modem, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be separate components, or two or more different processing units may be integrated into one component.
[0085] A memory may also be disposed in the processor 110 and configured to store computer programs and / or data. In some embodiments, the memory in the processor 110 is a cache. The memory may store computer programs and / or data that have been used or are used periodically by the processor 110. When the processor 110 needs to use the computer programs and / or data again, the processor 110 may retrieve the computer programs and / or data directly from the memory, thereby avoiding repeated accesses, reducing the waiting time of the processor 110, and improving system efficiency.
[0086] In some embodiments, the processor 110 may include one or more interfaces. For example, the processor 110 may include a universal serial bus (USB) interface 130 and a subscriber identity module (SIM) interface 195. In another example, the processor 110 may further include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), and / or a general-purpose input / output (GPIO) interface.
[0087] It can be understood that the interface connection relationship between modules shown in this embodiment of the present application is merely an example for explanation, and is not a limitation on the structure of the electronic device. In some other embodiments of the present application, the electronic device may alternatively use an interface connection method different from the above-mentioned embodiment, or may use a combination of multiple interface connection methods.
[0088] The USB interface 130 is an interface conforming to the USB standard specification, and may be, for example, a mini USB interface, a micro USB interface, or a USB Type-C interface. The USB interface 130 may be configured to connect to a charger to charge the electronic device, or to transmit data between the electronic device and a peripheral device, or to connect to a headset and play audio by using the headset. Alternatively, the interface may be configured to connect to another electronic device, such as an AR device.
[0089] The SIM card interface 195 is configured to be connected to a SIM card. The SIM card may be inserted into or removed from the SIM card interface 195 to implement contact with or separation from the electronic device. The electronic device may support 2 or N SIM card interfaces, where N is a positive integer greater than 2. The SIM card interface 195 may support nano-SIM cards, micro-SIM cards, SIM cards, etc. Multiple cards may be inserted into the same SIM card interface 195 at the same time. The multiple cards may have the same type or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device interacts with the network through the SIM card to implement functions such as calling and data communication. In some embodiments, the electronic device uses an eSIM, i.e., an embedded SIM card. The eSIM card may be embedded in the electronic device and cannot be separated from the electronic device.
[0090] The charging management module 140 is configured to receive a charging input from a charger. The charger may be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 140 may receive a charging input from the wired charger through the USB interface 130. In some embodiments of wireless charging, the charging management module 140 may receive a wireless charging input through a wireless charging coil of the electronic device. The charging management module 140 may further provide power to the electronic device by using the power management module 141 while the battery 142 is being charged.
[0091] The power management module 141 is configured to connect to the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives inputs from the battery 142 and / or the charging management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, etc. The power management module 141 may further be configured to monitor parameters such as battery capacity, battery cycle count, and battery health (electrical leakage or impedance). In some other embodiments, the power management module 141 may alternatively be located in the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 may alternatively be located in the same component.
[0092] The wireless communication functionality of the electronic device may be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, a modem, a baseband processor, and the like.
[0093] Antenna 1 and Antenna 2 are configured to transmit and receive electromagnetic signals. Each antenna in the electronic device may be configured to cover one or more communication frequency bands. Alternatively, different antennas may be multiplexed to improve antenna utilization. For example, Antenna 1 may be multiplexed as a diversity antenna in a wireless local area network. In some other embodiments, the antennas may be used in combination with tuning switches.
[0094] The mobile communication module 150 may be applied to electronic devices and provide a wireless communication solution including standards such as 2G / 3G / 4G / 5G, etc. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc.
[0095] The wireless communication module 160 may be applied to an electronic device and provide wireless communication solutions including wireless local area network (WLAN) (e.g., Wi-Fi® network), Bluetooth® (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC) technology, infrared (IR) technology, or the like.
[0096] In some embodiments, antenna 1 and mobile communication module 150 in the electronic device are coupled, and antenna 2 and wireless communication module 160 in the electronic device are coupled, such that the electronic device can communicate with a network and another device by using a wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, IR technology, and / or the like. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a BeiDou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and / or a satellite-based augmentation system (SBAS).
[0097] The electronic device may implement display functionality by using a GPU, a display 194, an application processor, and the like. The display 194 is configured to display images, videos, and the like. The display 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini-LED, a micro-LED, a micro-OLED, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, the electronic device may include one or N displays 194, where N is a positive integer greater than one.
[0098] The electronic device may implement the photographing function by using an ISP, a camera 193, a video codec, a GPU, a display 194, an application processor, and the like. The ISP is configured to process data fed back by the camera 193. For example, during photographing, a shutter is opened and light is transmitted through a lens to the light-sensitive elements of the camera. The light signal is converted into an electrical signal, which is then sent to the ISP for processing to convert the electrical signal into a visible image. The ISP may further perform algorithmic optimization on noise, brightness, and color of the image. The ISP may further optimize parameters such as exposure and color temperature of the photographed scene. In some embodiments, the ISP may be located within the camera 193.
[0099] The camera 193 is configured to capture still images or video. An optical image of an object is generated through a lens and projected onto a photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then sent to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into a standard format image signal, e.g., RGB or YUV. In some embodiments, the electronic device may include one or N cameras 193, where N is a positive integer greater than 1.
[0100] The external memory interface 120 may be configured to connect to an external memory card (e.g., a micro SD card) to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as audio and video are stored on the external memory card.
[0101] The internal memory 121 includes an operating memory and a built-in memory. The operating memory may be configured to store computer programs and / or data and the like. The processor 110 executes various functional applications and data processing of the electronic device by executing computer programs stored in the operating memory. For example, the operating memory may include a high-speed random access memory. The built-in memory may also be referred to as an internal external memory or the like and may be configured to store computer programs and / or data. For example, the built-in memory may store an operating system and application programs. The electronic device typically loads computer programs and / or data in the built-in memory into the operating memory, and the processor 110 executes the corresponding computer programs and / or data to implement the corresponding functions. In addition, the internal memory 121 may include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or a universal flash storage (UFS).
[0102] The electronic device may implement audio functions such as music playback and recording using an audio module 170, a speaker 170A, a handset 170B, a microphone 170C, a headset jack 170D, an application processor, etc.
[0103] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical or touch-sensitive buttons. The electronic device may receive the button input and generate button signal inputs related to user settings and function control of the electronic device.
[0104] The motor 191 may generate a vibration alert. The motor 191 may be used as an incoming call vibration alert and may also be used for touch vibration feedback. For example, touch operations performed in different applications (e.g., taking pictures and playing audio) may correspond to different vibration feedback effects. For touch operations on different areas of the display 194, the motor 191 may also generate correspondingly different vibration feedback effects. Different application scenarios (e.g., time reminder, information reception, alarm clock, and games) may also correspond to different vibration feedback effects. The touch vibration feedback effects may be further customized.
[0105] Indicator 192 may be an indicator light and may be configured to indicate charging status and power changes, or may be configured to indicate messages, missed calls, notifications, and the like.
[0106] It may be understood that the structure shown in this embodiment of the present application is not intended to be any particular limitation on the electronic device. In some other embodiments of the present application, the electronic device may include more or fewer components than those shown in the figures, or some components may be combined, or some components may be divided, or different component arrangements may be used. The components shown in the figures may be implemented by hardware, software, or a combination of software and hardware.
[0107] The method in the embodiment of the present application is described in detail by using a mobile phone having the hardware structure of the electronic device shown in FIG. 1 as an example.
[0108] In response to a user's operation of opening an instant message application, the electronic device may display a user chat interface of the instant message application. For example, the user's operation of opening an instant message application may be an operation of the user tapping an icon of the instant message application, or may be a voice command to open the instant message application, or may be a shortcut gesture operation. This is not limited. For example, as shown in FIG. 2A-A, an interface 10 is a schematic diagram of a user chat interface of an instant message application. As shown in the figure, the interface 10 includes an area 210 and an area 220. The area 210 is used to display a chat history of a user. The area 220 is a control display area. For example, as shown in FIG. 2A-A, the area 210 includes a chat history between user 1 and user 2, and the area 220 includes a control 201, a control 202, a control 203, and a control 204. In response to a user tapping control 201, the electronic device may switch control 202 to control 202', so that the user can send a voice by performing an operation on control 202'; the electronic device presents a voice message associated with the voice in a user chat interface, for example, as shown in FIG. 2A-B. The user may tap a voice message in the user chat interface, so that the electronic device may play the voice associated with the voice message for the user. In addition, when region 210 includes control 202', in response to a user tapping control 201, the electronic device may switch control 202' to control 202, so that the user can send a text by performing an operation on control 202; the electronic device presents the text in a user chat interface. Control 203 is configured to input stickers. Control 201 is configured to implement more functions, such as, for example, taking a picture, a voice call, and a video call.There is no limitation on this.
[0109] For example, as shown in FIG. 2B-A, a user taps control 204, which causes the electronic device to display area 230. Area 230 includes one or more controls, such as control 205. A user taps control 205, which causes the electronic device to display a capture interface. For example, as shown in FIG. 2B-B, the capture interface may include capture preview area 240 and control 206. A user may tap control 206 to take a picture or hold control 206 to record footage. For example, in response to a user releasing control 206, the electronic device may display a capture completion interface. For example, as shown in FIG. 2B-C, the capture completion interface may include capture preview area 250 and control 207. A user may preview a captured image or recorded footage in capture preview area 250. For example, in response to a user tapping control 208, the electronic device may close the display capture interface, delete the recorded footage or captured image, and display a user chat interface. For example, the user chat interface may be shown in Figures 2A-B. In another example, as shown in Figures 2B-D, when the captured content is video a, in response to the user tapping the control 207, the electronic device transmits video a and displays a video message a in the interface 10 in a first style, and the video message a is associated with the video a. In response to the operation of tapping the video message a displayed in the interface 10 in the first style, the electronic device plays the video a in full-screen mode. Specifically, the electronic device playing the video a in full-screen mode may be understood as the electronic device sequentially displaying and playing multiple frames of images in the video a in full-screen mode and playing audio in the video a. Thus, when the video message is displayed in the user chat interface in the first style, in response to the operation performed by the user on the video message, the electronic device can only play the video, but cannot independently play audio or multiple frames of images in the video.
[0110] In some embodiments, the shooting completion interface as shown in FIG. 2B-C is used as an example. When the electronic device displays the shooting completion interface, in response to the user tapping the control 207, the electronic device transmits the video a and displays a user chat interface. For example, as shown in FIG. 3A, the user chat interface may include an area 310. The area 310 is used to display the user's chat history. For example, as shown in FIG. 3A, the area 310 includes a video message a, and the video message a is displayed in a second style. The area 310 includes an area 301 and an area 302. The playback manner corresponding to the area 301 is a first manner, and the playback manner corresponding to the area 302 is a second manner, and the video message a is associated with the video a. For example, in the first manner, the sound in the video is mainly played; in the second manner, the image in the video is mainly played. The area 301 corresponds to the sound, and the area 302 corresponds to the image. For example, the area 301 may be used to display a graph related to the sound and may be associated with the sound in the video a, and the area 302 may be associated with the image in the video a. For example, the area 302 may be used to display a thumbnail of the first image. The thumbnail of the first image may be a thumbnail of a partial area of the first image, or may be a thumbnail of the entire area of the first image. Specifically, the first image may be determined based on a predetermined location in the video a. For example, the first image may be a first frame of an image in the video a, or may be a last frame of an image in the video a, or may be a frame of an intermediate image in the video a. This is not limited. Alternatively, the first image may be determined by the electronic device based on an algorithm or policy. For example, the first image is a frame of an image that satisfies a preset condition selected by the electronic device from the video a. For example, the preset condition may be that the image is relatively clear or that the expression of the characters is natural. Alternatively, in some other embodiments, the first image may be an image specified by the user, unrelated to the image in the video a, for example, a profile picture or wallpaper of the user. There is no limitation on this.
[0111] When the video message a is displayed in the second style in the user chat interface, the electronic device may determine the manner of playing the video a based on whether the user performs an operation on the area 301 or on the area 302, specifically, determine whether to play the video a, play the audio in the video a, or play at least one frame of the image in the video a. This helps to improve the flexibility of playing the video a. In addition, compared with displaying the video message a in the first style, displaying the video message a in the second style is similar to the manner of displaying a voice message. This helps to reduce the area occupied by the video message a in the user chat interface. In the following, the method 1, the method 2, and the method 3 are used as examples for explanation.
[0112] Method 1
[0113] In response to a user tapping on region 301, the electronic device plays the audio in video a. In this case, the electronic device does not display an image of at least one frame in video a. In response to a user tapping on region 302, the electronic device plays video a. Note that video a may be played in a small window or in full screen mode.
[0114] For example, the duration of the audio in video a is 30 seconds. In some other embodiments of the present application, in response to a user tapping on region 301, the electronic device plays the audio in video a, and the audio in video a is played for a period of time but the audio in video a is not played completely, for example, when the audio in video a is played up to 15 seconds, in response to a user tapping on region 302, the electronic device may play the video in full screen mode starting from 16 seconds. Specifically, the electronic device sequentially plays the images of multiple frames in video a in full screen mode starting from the image located at 16 seconds, and continues to play the audio in video a.
[0115] Alternatively, in some embodiments, in response to a user tapping area 302, the electronic device plays video a. If video a has been played for a period of time but video a has not been played completely and the user taps control 304 shown in FIG. 3C, in response to the user tapping control 304, the electronic device may stop playing video a and continue playing the audio in video a until the audio in video a has been played completely. Alternatively, in response to a user tapping control 304, the electronic device may stop playing video a and not continue playing the audio in video a.
[0116] Method 2
[0117] In response to a user tapping on region 301, the electronic device plays the audio in video a and plays at least one frame of image in video a in a small window 303 shown in Fig. 3B. In response to a user tapping on region 302, the electronic device plays video a in full-screen mode. Specifically, the electronic device sequentially executes full-screen display starting from the first frame of image in video a, and simultaneously plays the audio in video a starting from the first second.
[0118] It should be noted that in some embodiments, when the electronic device plays images of multiple frames of the video a in the small window 303, the user may move the display location of the small window 303 based on the user's request. Alternatively, the display location of the small window 303 may be fixed or may not move. This is not limited to the embodiments of the present application.
[0119] In some other embodiments, for example, the duration of the audio in video a is 30 seconds. In response to the user tapping on the area 301, the electronic device plays the audio in video a and plays images of multiple frames in the video in the small window 303. When video a has been played for a period of time but has not been played completely, for example, video a has been played up to 15 seconds, in response to the user tapping on the small window 303, the electronic device may play the video in full screen mode starting from 16 seconds. Specifically, the electronic device sequentially plays images of multiple frames in video a in full screen mode starting from the image located at 16 seconds, and continues to play the audio in video a until the audio in video a is played completely.
[0120] Method 3
[0121] In response to a user touching and holding the region 301, the electronic device displays a toolbar 402. As shown in FIG. 4, the toolbar 402 includes options such as earphone playback, text conversion, delete, and multi-select. In response to a user selecting the earphone playback option, the electronic device plays the audio in the image a by using the earphone. Alternatively, in some embodiments, in response to a user tapping the region 301 when the electronic device is close to a human ear, the electronic device plays the audio in the image a by using the earphone. In some other embodiments, in response to a user tapping the region 302 when the electronic device is far away from a human ear, the electronic device plays the audio in the image a by using the speaker.
[0122] In response to a user touching and holding the region 302, the electronic device displays a toolbar 401. As shown in FIG. 4, the toolbar 401 includes options such as play sound and silent play. In response to a user selecting the play sound option, the electronic device plays the video a. In response to a user selecting the silent play option, the electronic device plays the video a in a muted manner. The electronic device playing the video a in a muted manner may be understood to mean that the electronic device only plays images of multiple frames in the video a but does not play audio in the video a, or that the electronic device plays images and audio of multiple frames in the video a but with the volume set to 0. Furthermore, in some embodiments, when the electronic device plays images of multiple frames in the video a, the electronic device may convert audio in the video a into text and display the text in a subtitle format. In this way, it is convenient for the user to watch the video. For example, when playing the video a in a muted manner, the electronic device converts audio in the video a into text and displays the text in a subtitle format when playing images of multiple frames in the video a. In this way, the user can view the video in a quiet environment.
[0123] Please note that the above operation of ending or stopping the full-screen playback of the image a is merely an example for explanation, which is not limited in the embodiment of the present application. For example, in the embodiment of the present application, the operation of ending the full-screen playback of the image a can alternatively be an operation such as sliding downwards, sliding leftwards, or a voice command.
[0124] In this embodiment of the present application, since the video message is presented to the user in the second style, the user can freely choose to play the video, the audio in the video, or the image of multiple frames in the video in different scenarios based on the user's request. This improves the flexibility of playing the video. In addition, for the receiving side, in some embodiments, if the user taps only the area associated with the audio in the video in the user chat interface, the electronic device can only download the audio in the video, but not download all the images in the video, and the electronic device can only download the images in the video when the user taps the area associated with the video or a small window. This helps to save user traffic. Of course, in this embodiment of the present application, for the receiving side, the electronic device can alternatively download the audio in the video before the user taps the area associated with the audio in the video or the area associated with the video. In some embodiments, for the receiving side, the electronic device can alternatively download the images in the video before the user taps the area of the audio in the video or the area of the video, to avoid the case where the user experience is affected due to the freezing of the frame during the video playback.
[0125] In some other embodiments of the present application, when playing the audio in the video a, the electronic device may further present the audio playing progress to the user. For example, as shown in FIG. 5, it is convenient for the user to see the audio playing progress in the video.
[0126] Further, in some embodiments, as shown in FIG. 6, when the user chat interface includes video message 01, video message 02, voice message 03, and video message 04, video message 01, video message 02, voice message 03, and video message 04 are in an unread state, and in response to the user tapping on region 500, the electronic device plays the audio in the video associated with video message 01. After the audio in the video associated with video message 01 is fully played, the electronic device automatically plays the audio in the video associated with video message 02, the voice associated with voice message 03, and the audio in the video associated with video message 04, in sequence, until the audio in the video associated with video message 04 is fully played. In this manner, the audio in the unread state can be automatically played without user operation. Region 500 is associated with the audio in video 01, and video 01 is the video associated with video message 01.
[0127] In addition, the embodiment of the present application further provides a way to quickly record video or take pictures. Figures 7A to 7D are used as examples. When displaying the user chat interface shown in Figure 7A, the electronic device displays a shooting interface in response to a first operation performed by a user. For example, the shooting interface may be shown in Figure 7C. In the shooting interface, the user may view an image captured by the camera in real time. For example, the first operation may start from the upper boundary of the control display area and slide upward.
[0128] For example, the control display area may be the area 220 shown in FIG. 7A. For example, the first operation is that the user's finger starts from the upper boundary of the control display area and slides upward. As the user's finger moves, the electronic device may dynamically present the user with the process of spreading the shooting interface. For example, FIG. 7B shows an interface obtained when the electronic device spreads the shooting interface in the process of the user's finger moving. The area 700 is used to display the image captured by the camera in real time.
[0129] In some embodiments, as shown in FIG. 7C, the capture interface includes one or more of control 701, control 702, and control 703. For example, as shown in FIG. 7D, the electronic device captures an image in response to a user tapping control 701; the electronic device records a video in response to a user holding control 701; and the electronic device transmits the recorded video or the captured image in response to a user releasing control 701. If a user slides upward in the process of holding control 701 to record a video, the capture is canceled and a user chat interface is displayed. In some embodiments, control 701 is further configured to display a capture duration. When the capture duration reaches a threshold, the electronic device transmits the recorded video regardless of whether the user releases control 701, or the electronic device stops recording the video. If the electronic device stops recording the video when the capture duration reaches a threshold, the electronic device transmits the recorded video in response to a user releasing control 701. In this case, the duration of the video transmitted by the electronic device may be the above-mentioned threshold. It should be noted that the threshold value may be specified by the user based on the user's requirements, or may be pre-configured by the device manufacturer prior to delivery of the electronic device. For example, the threshold value may be 15 seconds, 20 seconds, or 30 seconds, but is not limited thereto.
[0130] The control 702 is configured to beautify the captured image or the recorded video. For example, in response to a user tapping the control 702, the electronic device displays a video beautification toolbar 710. When a user selects a scene option in the video beautification toolbar 710, the electronic device may display a plurality of optional background options in the video beautification toolbar 710, so that the user can select a corresponding background option based on the user's request and use the scene indicated by the background option as the background of the image captured by the camera. When the user does not select a background option, the actual captured scene of the camera is the background of the image captured by the camera. For example, the foreground captured by the camera is a person. As shown in FIG. 7C, the background may be the actual captured scene of the camera, or may be the scene indicated by the background option selected by the user based on the user's request. For example, an image captured by the electronic device by using the camera is shown in FIG. 8. The person shown in FIG. 8 is the foreground, and the others are the background. The user may select a background option in the video beautification toolbar 710 based on the user's request to replace the background captured by the camera in FIG. 8.
[0131] The control 703 is configured to switch between the front camera and the rear camera. For example, when the electronic device is currently taking a picture using the front camera, in response to the user tapping the control 703, the electronic device switches the rear camera to take a picture. In another example, when the electronic device is currently taking a picture using the rear camera, in response to the user tapping the control 703, the electronic device switches the front camera to take a picture. Alternatively, the electronic device may take a picture using the front camera by default. That is, the image presented to the user in the picture taking interface is an image captured in real time by the front camera.
[0132] In some other embodiments, in response to the user releasing the control 701, the electronic device displays a user chat interface. For example, the user chat interface may be shown in FIG. 9. A video message associated with the video recorded by the camera is displayed in a first style. In addition, in another example, as shown in FIG. 9, the area 220 may further include multiple controls, so that the user can not only send a message, such as a text or voice message, but also send a location, a photo, or a sticker, which is convenient for the user's use.
[0133] The embodiment of the present application further provides a way to quickly record audio and video. Figures 10A-10D are used as examples. In some embodiments, when the electronic device displays the user chat interface shown in Figure 10A, the user may hold the control 1001 and slide upward from the location 1020. As shown in Figure 10B, when the slide stops, if the finger is located in the area 1002, the electronic device may collect the user's voice by using the microphone. Similarly, as shown in Figure 10B, the user may hold the control 1001 and slide upward from the location 1010. When the slide stops, if the finger is located in the area 1003, the electronic device may record video by using the camera. Optionally, the user may preview the image captured by the camera in real time in the area 1002. Optionally, when recording video by using the camera, the electronic device may enlarge the area 1002, so that the user previews the image captured by the camera in real time. Optionally, after the duration of the image capture reaches a threshold, the electronic device may prompt the user to stop image capture. For the threshold, please refer to the relevant description of the threshold above. The details will not be described again here.
[0134] In response to the user releasing the finger, the electronic device transmits the collected voice or video, and displays a user chat interface including the voice message or video message. For example, the video message may be displayed in a first style or a second style. This is not limited. For the first style and the second style, please refer to the related description above. Details will not be described again here.
[0135] Optionally, during audio and video recording, the user may move his / her finger back and forth in areas 1002 and 1003 to perform audio and video mixing.
[0136] For example, a user holds control 1001 and slides it upward. In response to the finger being located in region 1003 when the slide stops, the electronic device collects the user's voice by using a microphone. When the microphone collects the user's voice and the user's finger slides to region 1002, the electronic device expands region 1002 and records video by using a camera, as shown in FIG. 10C. In response to the user releasing the finger, the electronic device transmits the collected audio and video and displays a user chat interface. The electronic device may transmit the collected video and audio separately by using multiple messages, or may transmit the collected video and audio by using one message. For example, when video and audio are transmitted by using one message, the message may be referred to as an audio and video message. Specifically, the audio and video message may be displayed in a first style or may be displayed in a second style. For example, the audio and video recorded by the electronic device is audio and video a. When the audio and video message is displayed in the first style, the audio and video message may be as shown in FIG. 10D.
[0137] For example, the voice occupies the first 15 seconds of the audio and video associated with the audio and video message, and the video occupies the last 15 seconds of the audio and video associated with the audio and video message. For example, in response to a playback operation performed by a user on the audio and video message, the electronic device plays the voice in the first 15 seconds and plays the video in the last 15 seconds in full screen mode. When the voice occupying the first 15 seconds is played, the electronic device may display an image of the first frame of the video occupying the last 15 seconds in full screen mode, or may display a black screen, a pre-set background wallpaper, a voice playback interface, or the like. This is not limited. In another example, the audio and video message is displayed in a second style. For example, in response to a user tapping the first region, the electronic device plays the audio in the audio and video. For a manner in which the electronic device plays the audio and video in response to a user tapping the second region, please refer to the manner in which the audio and video is played when the audio and video message is displayed in a first style. The first region is associated with the audio in the audio and video and the second region is associated with the audio and video.
[0138] It should be noted that in this embodiment of the present application, when the user's finger stops sliding and the hold location of the electronic device is located in the area 1002, the size of the area 1002 may alternatively remain unchanged, i.e., the area 1002 is not enlarged. Whether the area 1002 is enlarged is not limited in the embodiment of the present application.
[0139] Of course, through the above operations, it should be understood that in some embodiments, the user's finger can move back and forth in the area 1002 and the area 1003 to perform audio and video mixing before the finger is released. For example, the electronic device can first perform shooting and then collect audio. In this way, the flexibility of audio and video recording is improved.
[0140] Please note that the operations shown in Figures 10A-10D are merely examples. For example, the user may alternatively use a stylus to record voice and / or video in the manner described above. In addition, it should be understood that the starting location where the user holds the control 1001 to start sliding is not limited in the embodiment of the present application.
[0141] In some other embodiments, as shown in FIG. 11, when the electronic device displays the user chat interface shown in FIG. 10A, the user's finger may hold and slide upward on the control 1101. If the finger is located in the area 1110 when the slide stops, the electronic device collects the user's voice by using the microphone. If the finger is located in the area 1120 when the slide stops, the electronic device records the video by using the camera. Similarly, during recording, the user may slide upward or downward to perform audio and video mixing. For example, the user's finger may slide upward from the area 1110 to the area 1120. In response to the operation, the electronic device records the video by using the camera and displays the image captured by the camera in real time in the area 1120. Of course, when the electronic device records the video, the user's finger may alternatively slide downward from the area 1120 to the area 1110. In this case, the electronic device stops recording the video and collects the voice by using the microphone.
[0142] Alternatively, in this embodiment of the present application, the following manner of quickly recording audio and video may be used, and FIG. 12 is used as an example. In yet some other embodiments, when the electronic device displays the user chat interface shown in FIG. 10A, as shown in FIG. 12A, the electronic device records video in response to the user's finger sliding from the left border of the control 1201 to the right border of the control 1201; or as shown in FIG. 12B, the electronic device collects voice in response to the user's finger sliding from the right border of the control 1201 to the left border of the control 1201. When the user's finger releases the control 1201, the electronic device transmits the recorded audio and video. It should be noted that the user may slide leftward or rightward on the control 1201 in the video recording or audio collecting process to implement voice and video mixing. When the user records video, in the process of the user's finger sliding from the right border of the control 1201 to the left border of the control 1201, the electronic device continues to record video. After the user's finger slides to the left border of the control 1201, the electronic device stops recording video and collects voice. Alternatively, when the user collects voice, the electronic device continues to record video in the process of the user's finger sliding from the left border of the control 1201 to the right border of the control 1201. After the user's finger slides to the right border of the control 1201, the electronic device stops collecting voice and records video. In this case, it should be noted that when the electronic device records video, the user can preview the image collected by the camera in real time in full-screen mode.
[0143] It should be understood that when the method for quickly recording audio and video shown in FIG. 12 is used, the electronic device may alternatively collect voice in response to a user's finger sliding from the left border of control 1201 to the right border of control 1201, and record video in response to a user's finger sliding from the right border of control 1201 to the left border of control 1201.
[0144] It should be noted that the above-described manner of quickly recording voice and / or video provided in Fig. 11 or Fig. 12 is described by using an example in which a user performs an operation by using a finger. It can be understood that a user can alternatively perform an operation by using a stylus instead of a finger.
[0145] In this embodiment of the present application, when the electronic device enables the audio and video message mixing function, the user may perform audio and video mixing in the above-mentioned operation manner. For example, the user may enable the audio and video message mixing function in a setting interface of an instant messaging application. For example, as shown in FIG. 13A and FIG. 13B, interface 1310 is a schematic diagram of a setting interface of an application, and includes multiple setting controls, such as general items, account switching, and logout. When the user taps on communication, the electronic device displays interface 1310. For example, interface 1310 includes control 1303 configured to control enabling or disabling of the audio and video message mixing function. When control 1303 is enabled, the audio and video message mixing function of the electronic device is enabled. When control 1303 is disabled, the audio and video message mixing function of the electronic device is enabled. That is, when control 1303 is disabled, the electronic device cannot perform audio and video message mixing. For example, in response to a user enabling control 1303, the electronic device enables the audio and video mixing functionality. In another example, in response to a user disabling control 1303, the electronic device disables the audio and video mixing functionality.
[0146] In some other embodiments, the user interface 1310 may further include a message input button setting control and / or a video message display style setting control. For example, when a user taps the input button setting control, the electronic device may display a button setting list 1301. The button setting list 1301 includes button function options, such as audio and video recording or audio recording. When a user selects audio and video recording, the electronic device may record audio and video by performing an operation on the control 1001, the control 1101, or the control 1201. When a user selects audio recording, the electronic device may record audio by performing an operation on the control 1001, the control 1101, or the control 1201. For details, refer to the operation manner in which a user records audio by using the control 202 illustrated in FIG. 1. For another example, when a user taps the video message display style control, the electronic device displays a video message display style list 1302. For example, the video message display style list 1302 includes a first style and a second style. For example, when a user selects the second style, the video message in the user chat interface associated with the transmitted and received video is displayed in the second style, and the user can select whether to play the audio in the video or play the video based on the user's request. In another example, when a user selects the first style, the video message in the user chat interface associated with the transmitted and received video is displayed in the first style, and the user can only play the video and cannot select to play the audio in the video. In the above manner, the user can set the video message display style, the message input button, and the audio and video mixing based on the user's request, thereby improving the interaction between the electronic device and the user.
[0147] In addition, when the electronic device displays a user chat interface (e.g., a group chat interface including more than two users, or a chat interface including two users), the user may further transfer the chat history individually, or may merge and transfer the chat history based on the user's request. A chat interface including User 1 and User 2 is used as an example. For example, as shown in FIG. 14A, when the electronic device displays a chat interface including User 1 and User 2, the user touches and holds a message (e.g., Message 06), and the electronic device displays the message toolbar 1401. For example, the message toolbar 1401 includes one or more options of copy, forward, add to favorites, delete, and multi-select. It is noted that the options in the message toolbar 1401 displayed by the electronic device may be slightly different based on different messages touched and held by the user. For example, when the message touched and held by the user is a shared mini-program or place (e.g., Message 07), the message toolbar 1401 may not include copy. In some embodiments, when a user selects Multi-Select in the message toolbar 1401, the electronic device presents a message selection control in the user chat interface, as shown in FIG. 14B. When a user selects Message 02 and Message 05, the user taps Forward, and the electronic device displays a forwarding options box 1402 in the user chat interface. For example, as shown in FIG. 14C, the forwarding options box 1402 includes an Individual Forward option, a Merge and Forward option, and a Cancel option. For example, the user selects the Merge and Forward option. The electronic device displays a chat selection interface, as shown in FIG. 14D. The user can select users (which may be a group or a single user) to whom the message is to be sent in the interface.For example, if a user selects a user group named My Family and a user named E, after the user taps OK, a consolidation and forwarding box 1403 is displayed, as shown in FIG. 14E. The consolidation and forwarding box 1403 may send the chat history of User 1 to the user group or user whose name is selected individually. However, in the consolidation and forwarding box 1403, the user cannot see the number of messages forwarded by the user, nor can he modify the messages to be sent and need to be forwarded. This results in low flexibility. Forwarding to a user group named My Family is used as an example. The electronic device displays the chat history of User 1 in a chat interface with a user group name My Family, as shown in FIG. 14F. The user taps on the chat history of User 1, and the message in the chat interface of User 1 selected by the user is displayed in a list format, as shown in FIG. 14G. For example, if message 06 is a photo, the electronic device cannot present the photo to the user when displaying the message in the chat interface of User 1 selected by the user in a list format.
[0148] In some other embodiments of the present application, when a user selects OK shown in FIG. 14D, the electronic device displays a consolidate and forward box 1500. The consolidate and forward box 1500 may be shown in FIG. 15A or may be shown in FIG. 15B. The consolidate and forward box 1500 shown in FIG. 15A is used as an example. For example, when a user selects message 02 and message 06, the consolidate and forward box 1500 may further display messages located between message 02 and message 06, such as message 03, message 04, and message 05. Of course, when a user selects message 02 and message 06, messages located between message 02 and message 06, such as message 03, message 04, and message 05, may alternatively not be displayed in the consolidate and forward box 1500.
[0149] For example, a user may preview a corresponding message in the message integration and forwarding box 1500. For example, when a message is a text message or a photo, a user may view the corresponding text or the corresponding photo in the message integration and forwarding box 1500. In another example, when a message is a voice message, a user may play the corresponding voice in the message integration and forwarding box 1500 by tapping the message. In another example, when a message is a video message, a user may play the corresponding video in the message integration and forwarding box 1500 by tapping the message. In another example, when a message is a document (e.g., a Word document, a Text document, an Excel document, a PPT document, or a PDF document) message, a user may open and view the corresponding document in the message integration and forwarding box 1500. In another example, when a message is a location, a sticker, or a sharing mini-program, a user may also preview the message in the message integration and forwarding box 1500. It should be noted that the format of the message that can be previewed in the message integration and forwarding box 1500 is not limited in the embodiment of the present application. Additionally, the message merge and forward box 1500 may present the user with a number of messages selected by the user.
[0150] In another example, the consolidate and forward box 1500 may include a control 1501. The user may tap the control 1501, causing the electronic device to return to the interface shown in FIG. 14D to reselect the user name or user group name to which User 1's chat history is forwarded. In another example, the consolidate and forward box 1500 may further include a control 1502. In response to the user tapping the control 1502, the electronic device may display the interface shown in FIG. 14B or display the consolidate and forward box 1500 shown in FIG. 15B. The user may add or delete selected messages based on the user's request. Further, in some embodiments, when the progress bar for previewing messages in the consolidate and forward box 1500 shown in FIG. 15B is located at the top as shown in FIG. 16A and the user slides downward, the electronic device may update N messages in the chat interface including User 1 and User 2 followed by Message 02 in the consolidate and forward box 1500, where N may be a positive integer greater than or equal to 1 and may be preconfigured by the user or may be predefined on the electronic device. Each time the user slides downward, the electronic device performs one update until the first message in the chat interface including User 1 and User 2 is updated. For example, if there is only one message, e.g., Message 01 followed by Message 02, when the user slides downward, the electronic device may display Message 01 in the interface of the consolidate and forward box 1500. When the user slides downward again, the electronic device does not perform any more updates.
[0151] Similarly, it should be understood that when the progress bar for previewing messages in the consolidate and forward box 1500 is located at the bottom and the user continues to slide upwards, the electronic device may alternatively update M messages in the chat interface including user 1 and user 2, followed by message 06, in the consolidate and forward box 1500, where m may or may not be equal to N. Each time the user slides upwards, the electronic device performs one update until the last message in the chat interface including user 1 and user 2 is updated. In this way, it is convenient for the user to reselect the messages that need to be forwarded when the consolidate and forward box is displayed.
[0152] In addition, in another example, as shown in FIG. 15A and FIG. 15B, the consolidate and forward box 1500 further includes a profile photo of a user or a user group, so that the user identifies the user or the user group to which the chat history is sent. Furthermore, in some embodiments, the profile photo of the user or the user group in the consolidate and forward box 1500 includes a delete icon. As shown in FIG. 16A and FIG. 16B, in response to the user tapping the delete icon on the profile photo of the user named E, the electronic device may directly delete the user named E, that is, the electronic device does not need to send the chat history of the user 1 to the user named E. In this way, it is convenient for the user to delete the user to whom the chat history is forwarded. Alternatively, the profile photo of the user or the user group in the consolidate and forward box 1500 may be replaced with another identifier that may be used to identify the user or the user group, such as the name of the user or the user group. This is not limited in the embodiment of the present application.
[0153] 16A and 16B are used as an example. After a user taps the delete icon on the profile picture of a user named E, the consolidate and forward box 1500 includes only profile pictures of one user group. When the consolidate and forward box 1500 includes only one profile picture, the electronic device may hide the delete icon on the profile picture, or the electronic device may display a delete image on the profile picture, and in response to the user tapping the delete icon on the image, the electronic device displays a chat selection interface as shown in FIG. 14D.
[0154] Forwarding to a user group named My Family is used as an example. A user displays a chat history message 1701 in a group chat interface named My Family. The chat history message 1701 is associated with the chat history of User 1 forwarded by User 2, as shown in A in FIG. 17. In response to the user tapping the chat history message 1701, the electronic device displays a detailed interface in which User 2 forwards the chat history with User 1, as shown in B in FIG. 17. For example, in the interface shown in B in FIG. 17, the chat history of User 1 is presented to the user in a bubble format, so that the user can restore the original display of the chat history between User 1 and User 2. The user may further preview messages in different formats, such as photos, text, video, audio, location, stickers, documents, sharing links, or sharing mini-programs, in the detailed interface of User 1's chat history.
[0155] Alternatively, in some embodiments, after a user selects message 03 and message 04 shown in FIG. 14A, the electronic device may further display message 09 in the combine and forward box. Message 09 is a combined message of message 03 and message 04, for example, as shown in FIG. 18. A user can play message 03 and message 04 by tapping message 09 once in the combine and forward box, so that the user does not need to perform multiple operations. Furthermore, in some embodiments, when a user touches and holds message 09, the electronic device displays a toolbar 1800. The toolbar 1800 may include multiple options, such as speed, delete, add, and others. For example, when a user taps speed, the user may edit the playback speed of the audio in message 09. In another example, when a user taps delete, the user may edit the content of the audio in message 09. In another example, when a user taps add, the user may add content to the audio in message 09. It should be noted that for different messages, the options in the toolbar 1800 displayed by the electronic device may be different. For example, for photos, the toolbar 1800 may include Meitu and Beautify. In another example, for text messages, the toolbar 1800 may include font and size.
[0156] It should be noted that in the embodiment of the present application, the electronic device may perform unified processing on the same type of messages sent by one or more users with reference to time, for example, for the electronic device, the video and audio of the first style may be the same type of message.
[0157] For example, without limitation, when the electronic device displays a consolidated message in a consolidate and forward box and the user views the consolidated and forwarded chat history in the chat interface, the electronic device may present the consolidated and forwarded chat history to the user in a consolidated message format, or may present the consolidated and forwarded chat history to the user separately in a bubble format.
[0158] It should be noted that the above message display scheme is also applicable to individual message forwarding scenarios, and the details will not be described again here.
[0159] The above-described embodiments may be used individually or in combination with each other to achieve different technical effects, without being limited thereto.
[0160] Based on the same concept, an embodiment of the present application further provides an electronic device. As shown in Fig. 19, the electronic device includes a processor 1901, a memory 1902, a display 1903, and a camera 1904. In addition, in some embodiments, the electronic device further includes a sensor 1905, such as a touch sensor.
[0161] For example, the above-mentioned components may be connected through one or more communication buses. One or more computer programs are stored in the memory 1902 and configured to be executed by the processor 1901. The one or more computer programs include instructions, which may be used to enable the electronic device to perform steps of the methods in the above-mentioned embodiments.
[0162] For example, the processor 1901 may specifically be the processor 110 shown in Fig. 1, the memory 1902 may specifically be the internal memory 121 shown in Fig. 1 and / or an external memory connected to the electronic device, the display 1903 may specifically be the display 194 shown in Fig. 1, and the sensor 1905 may specifically be one or more sensors in the sensor module 180 shown in Fig. 1. This is not limited to the embodiments of the present application.
[0163] Additionally, embodiments of the present application further provide a graphical user interface (GUI) on the electronic device, specifically including a graphical user interface that is displayed when the electronic device executes embodiments of the above-mentioned methods.
[0164] Depending on the context, the terms "when" or "after" used in the above embodiments may be interpreted to mean "when" or "after" or "in response to determining" or "in response to detecting." Similarly, depending on the context, the phrase "when it is determined that" or "if (a described condition or event) is detected" may be interpreted to mean "when it is determined that" or "in response to determining" or "when (a described condition or event) is detected" or "in response to detecting (a described condition or event)."
[0165] All or part of the above-mentioned embodiments may be implemented by software, hardware, firmware, or any combination thereof. When software is used to implement the embodiments, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the procedures or functions according to the embodiments of the present invention are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or another programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from a computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center in a wired (e.g., coaxial cable, optical fiber, or digital subscriber line (DSL)) or wireless (e.g., infrared, radio wave, or microwave) manner. The computer-readable storage medium may be any available medium accessible by a computer, or a data storage device (e.g., a server or data center) integrating one or more available media. The usable medium may be a magnetic medium (e.g., a floppy disk, a hard disk, or a magnetic tape), an optical medium (e.g., a DVD), a semiconductor medium (e.g., a solid state drive (SSD)), etc. When there is no contradiction, the solutions in the above-mentioned embodiments may be combined for use.
[0166] It should be noted that portions of this patent application document contain material that is protected by copyright. The copyright owner reserves the copyright, except for the right to reproduce the contents of the patent document in the Patent Office or as filed by the Patent Office.
Claims
1. 1. A method for displaying a message applied to an electronic device, the electronic device having an instant message application installed thereon, the method comprising: displaying, by the electronic device, a first user chat interface of the instant messaging application, where the first user chat interface includes a first video message, the first video message including a first region and a second region, the first video message associated with a first video, the first video including a first audio and a first image of at least one frame, the first region corresponding to the first audio and the second region corresponding to the first image of the at least one frame; playing, by the electronic device, the first video in a first manner in response to an operation performed by a user on the first area; and and playing, by the electronic device, the first video in a second manner in response to an operation performed by the user on the second area. Equipped with The step of playing the first video in a first manner by the electronic device in response to an operation performed by a user on the first area includes: playing, by the electronic device, only the first sound in response to the operation performed by the user on the first area. The method includes:
2. The second region corresponds to an image of the at least one frame, The method of claim 1 , wherein the second area is used to display a thumbnail of a target image, the target image being one of the first images of the at least one frame.
3. and playing, by the electronic device, the first video in a second manner in response to an operation performed by the user on the second area, further comprising: and playing, by the electronic device, a first image of the at least one frame and playing the first sound in response to the operation performed by the user on the second area. Including, The method according to claim 1 or 2.
4. The step of playing, by the electronic device, a first image of the at least one frame in response to the operation performed by the user on the second area, further comprises: playing, by the electronic device, a first image of the at least one frame in a window in response to the operation performed by the user on the second area; or and playing, by the electronic device, a first image of the at least one frame in a full screen mode in response to the operation performed by the user on the second area. The method of claim 3 , comprising:
5. The method further comprises: playing, by the electronic device, the first video in a full screen mode in response to the user tapping on the window. The method of claim 4 comprising:
6. and playing, by the electronic device, the first video in a second manner in response to an operation performed by the user on the second area, further comprising: playing, by the electronic device, a first image of the at least one frame but skipping playing the first sound in response to the operation performed by the user on the second area. Including, The method according to claim 1 or 2.
7. The step of playing, by the electronic device, a first image of the at least one frame but skipping playing the first sound in response to the operation performed by the user on the second area includes: and in response to the operation performed by the user on the second area, playing, by the electronic device, a first image of the at least one frame and converting the first audio into text for display as the first image of the at least one frame is displayed. Including, The method according to claim 6.
8. the first user chat interface further includes a second video message, the second video message associated with a second video, the second video message including a third region and a fourth region, the second video including a second audio and a second image of at least one frame, the third region corresponding to the second audio and the fourth region corresponding to the second image of the at least one frame, both the first video message and the second video message being in an unread state, and the second video message following the first video message; The method further comprises: automatically playing, by the electronic device, the second sound after the first sound has been played in its entirety in response to the operation performed by the user on the first area. Equipped with 8. The method according to any one of claims 1 to 7.
9. the first user chat interface further includes a first voice message, the first voice message following the first video message, and both the first voice message and the first video message being in an unread state; the method further includes: automatically playing, by the electronic device, a voice associated with the first voice message after the first audio is played in full in response to the operation performed by the user on the first area. Equipped with 8. The method according to any one of claims 1 to 7.
10. the first user chat interface further comprises a second voice message and a third video message, the third video message associated with a third video, the third video comprising a third audio and a third image of at least one frame, the third video message comprising a fifth region and a sixth region, the fifth region corresponding to the third audio and the sixth region corresponding to the third image of the at least one frame, the second voice message is followed by the third video message, and both the second voice message and the third video message are in an unread state; the method further comprises: playing, by the electronic device, a voice associated with the second voice message in response to an action performed by the user on the second voice message, and automatically playing the third voice after the voice associated with the second voice message has been played in its entirety. Equipped with 10. The method according to any one of claims 1 to 9.
11. The method further includes receiving, by the electronic device, a first operation in the first user chat interface; and performing, by the electronic device, photographing by using a camera in response to the first operation, and displaying a photographing interface, where the photographing interface is used to display an image captured by the camera; The method of any one of claims 1 to 10, comprising:
12. The method of claim 11 , wherein the first action is an upward slide by the user in the first user chat interface.
13. The method further comprises: receiving, by the electronic device, a second operation in the first user chat interface; and collecting, by the electronic device, a human voice by using a microphone in response to the second operation. The method of claim 11 , comprising:
14. the first user chat interface further includes a first control, a seventh area, and an eighth area, the first control being used for message input, the seventh area and the eighth area being non-overlapping; the first operation being the user holding the first control and sliding it to the seventh region; the second operation is that the user holds the first control and slides it to the eighth region; The method of claim 13.
15. The method of claim 14 , wherein the seventh area is further used to display the image captured by the camera.
16. The method further comprises: displaying, by the electronic device, a consolidation and forwarding box, where the consolidation and forwarding box is used to forward the N messages in a second user chat interface, the consolidation and forwarding box includes M profile pictures, the M profile pictures are used to indicate user groups or users to which the N messages are forwarded, and each of the M profile pictures includes a delete icon; and deleting, by the electronic device, the first profile photo in the combine and forward box in response to the user tapping a delete icon on a first profile photo in the M profile photos, where M and N are positive integers. Including, 16. The method according to any one of claims 1 to 15.
17. The method further comprises: displaying, by the electronic device, a consolidation and forwarding box, where the consolidation and forwarding box is used to forward the N messages in a second user chat interface, the consolidation and forwarding box including a second control and / or a third control; displaying, by the electronic device, a chat selection interface in response to an operation on the second control, where the chat selection interface is used to select a user group or user to which messages are aggregated and forwarded; and displaying, by the electronic device, in response to an operation on the third control, a user chat interface through which the user can select a message, where N is a positive integer; Equipped with 16. The method according to any one of claims 1 to 15.
18. The method further comprises: displaying, by the electronic device, a consolidation and forwarding box, where the consolidation and forwarding box is used to forward N messages in a second user chat interface, the consolidation and forwarding box including message number prompt information, the message number prompt information being used to indicate a number of messages forwarded by the user, where N is a positive integer; Equipped with 16. The method according to any one of claims 1 to 15.
19. The method further comprises: displaying, by the electronic device, a consolidation and forwarding box, where the consolidation and forwarding box includes K messages, the K messages including N messages to be forwarded in the second user chat interface, K being greater than or equal to N, and K and N being positive integers; and in response to an operation performed by the user on a second message in the N to-be-forwarded messages, the electronic device opens a file associated with the second message, where the file associated with the second message is one of a voice, a video, an audio and video, a document, a photo, a location, and a link. Equipped with 16. The method according to any one of claims 1 to 15.
20. The method of claim 19 , wherein each of the K messages is displayed in a bubble format.
21. each of the N messages to be forwarded corresponds to one selection control, and the selection control corresponding to each of the N messages to be forwarded is in a selected state; in response to an operation performed by the user on a selection control corresponding to a third message in the N to-be-forwarded messages, switching, by the electronic device, the selection control corresponding to the third message from the selected state to an unselected state, wherein the electronic device skips forwarding the third message when the selection control corresponding to the third message is in the unselected state.
21. The method of claim 19 or 20.
22. The method further comprises: displaying, by the electronic device, a third user chat interface, where the third user chat interface includes a fourth message, the fourth message being associated with an aggregated and forwarded chat history, the aggregated and forwarded chat history including the N to-be-forwarded messages; and displaying, by the electronic device, a detailed interface of the chat history in response to an operation performed by the user on the fourth message, where the detailed interface of the chat history includes the N to-be-forwarded messages, the N to-be-forwarded messages being displayed in a bubble format. Equipped with 22. The method according to any one of claims 16 to 21.
23. 1. A method for displaying a message applied to an electronic device, the electronic device having an instant message application installed thereon, the method comprising: displaying, by the electronic device, a first user chat interface of the instant messaging application, where the first user chat interface includes a first video message, the first video message including a first region and a second region, the first video message associated with a first video, the first video including a first audio and a first image of at least one frame, the first region corresponding to the first audio and the second region corresponding to the first image of the at least one frame; playing, by the electronic device, the first video in a first manner in response to an operation performed by a user on the first area; and and playing, by the electronic device, the first video in a second manner in response to an operation performed by the user on the second area. Equipped with The step of playing the first video in a first manner by the electronic device in response to an operation performed by a user on the first area includes: playing, by the electronic device, the first sound and playing in a window a first image of the at least one frame in response to the operation performed by the user on the first area. Including; and playing, by the electronic device, the first video in a second manner in response to an operation performed by the user on the second area, further comprising: and playing, by the electronic device, the first sound and the first image of the at least one frame in a full screen mode in response to the operation performed by the user on the second area. A method comprising:
24. the first user chat interface further includes a second video message, the second video message associated with a second video, the second video message including a third region and a fourth region, the second video including a second audio and a second image of at least one frame, the third region corresponding to the second audio and the fourth region corresponding to the second image of the at least one frame, both the first video message and the second video message being in an unread state, and the second video message following the first video message; The method further comprises: automatically playing, by the electronic device, the second sound after the first sound has been played in its entirety in response to the operation performed by the user on the first area. Equipped with 24. The method of claim 23.
25. the first user chat interface further includes a first voice message, the first voice message following the first video message, and both the first voice message and the first video message being in an unread state; the method further includes: automatically playing, by the electronic device, a voice associated with the first voice message after the first audio is played in full in response to the operation performed by the user on the first area. Equipped with 25. The method of claim 23 or 24.
26. the first user chat interface further comprises a second voice message and a third video message, the third video message associated with a third video, the third video comprising a third audio and a third image of at least one frame, the third video message comprising a fifth region and a sixth region, the fifth region corresponding to the third audio and the sixth region corresponding to the third image of the at least one frame, the second voice message is followed by the third video message, and both the second voice message and the third video message are in an unread state; the method further comprises: playing, by the electronic device, a voice associated with the second voice message in response to an action performed by the user on the second voice message, and automatically playing the third voice after the voice associated with the second voice message has been played in its entirety. Equipped with 26. The method of any one of claims 23 to 25.
27. The method further includes receiving, by the electronic device, a first operation in the first user chat interface; and performing, by the electronic device, photographing by using a camera in response to the first operation, and displaying a photographing interface, where the photographing interface is used to display an image captured by the camera; 27. The method of any one of claims 23 to 26, comprising:
28. 30. The method of claim 27, wherein the first action is an upward slide by the user in the first user chat interface.
29. The method further comprises: receiving, by the electronic device, a second operation in the first user chat interface; and collecting, by the electronic device, a human voice by using a microphone in response to the second operation.
28. The method of claim 27 comprising:
30. the first user chat interface further includes a first control, a seventh area, and an eighth area, the first control being used for message input, the seventh area and the eighth area being non-overlapping; the first operation being the user holding the first control and sliding it to the seventh region; the second operation is that the user holds the first control and slides it to the eighth region; 30. The method of claim 29.
31. The method of claim 30 , wherein the seventh area is further used to display the image captured by the camera.
32. The method further comprises: displaying, by the electronic device, a consolidation and forwarding box, where the consolidation and forwarding box is used to forward the N messages in a second user chat interface, the consolidation and forwarding box includes M profile pictures, the M profile pictures are used to indicate user groups or users to which the N messages are forwarded, and each of the M profile pictures includes a delete icon; and deleting, by the electronic device, the first profile photo in the combine and forward box in response to the user tapping a delete icon on a first profile photo in the M profile photos, where M and N are positive integers. Including, 32. The method of any one of claims 23 to 31.
33. The method further comprises: displaying, by the electronic device, a consolidation and forwarding box, where the consolidation and forwarding box is used to forward the N messages in a second user chat interface, the consolidation and forwarding box including a second control and / or a third control; displaying, by the electronic device, a chat selection interface in response to an operation on the second control, where the chat selection interface is used to select a user group or user to which messages are aggregated and forwarded; and displaying, by the electronic device, in response to an operation on the third control, a user chat interface through which the user can select a message, where N is a positive integer; Equipped with 32. The method of any one of claims 23 to 31.
34. The method further comprises: displaying, by the electronic device, a consolidation and forwarding box, where the consolidation and forwarding box is used to forward N messages in a second user chat interface, the consolidation and forwarding box including message number prompt information, the message number prompt information being used to indicate a number of messages forwarded by the user, where N is a positive integer; Equipped with 32. The method of any one of claims 23 to 31.
35. The method further comprises: displaying, by the electronic device, a consolidation and forwarding box, where the consolidation and forwarding box includes K messages, the K messages including N messages to be forwarded in the second user chat interface, K being greater than or equal to N, and K and N being positive integers; and in response to an operation performed by the user on a second message in the N to-be-forwarded messages, the electronic device opens a file associated with the second message, where the file associated with the second message is one of a voice, a video, an audio and video, a document, a photo, a location, and a link. Equipped with 32. The method of any one of claims 23 to 31.
36. 36. The method of claim 35, wherein each of the K messages is displayed in a bubble format.
37. each of the N messages to be forwarded corresponds to one selection control, and the selection control corresponding to each of the N messages to be forwarded is in a selected state; in response to an operation performed by the user on a selection control corresponding to a third message in the N to-be-forwarded messages, switching, by the electronic device, the selection control corresponding to the third message from the selected state to an unselected state, wherein the electronic device skips forwarding the third message when the selection control corresponding to the third message is in the unselected state.
37. The method of claim 35 or 36.
38. The method further comprises: displaying, by the electronic device, a third user chat interface, where the third user chat interface includes a fourth message, the fourth message being associated with an aggregated and forwarded chat history, the aggregated and forwarded chat history including the N to-be-forwarded messages; and displaying, by the electronic device, a detailed interface of the chat history in response to an operation performed by the user on the fourth message, where the detailed interface of the chat history includes the N to-be-forwarded messages, the N to-be-forwarded messages being displayed in a bubble format. Equipped with 38. The method of any one of claims 32 to 37.
39. 1. An electronic device comprising at least one processor and at least one memory, The one or more memories store one or more computer programs, the one or more computer programs including instructions that, when executed by the one or more processors, are capable of causing the electronic device to perform the method of any one of claims 1 to 38. Electronic devices.
40. 39. A computer readable storage medium comprising a computer program, the computer program being capable of executing a method according to any one of claims 1 to 38 on an electronic device.
41. 39. A computer program comprising instructions which, when executed on a computer, enable the computer to carry out the method of any one of claims 1 to 38.
Citation Information
Patent Citations
Message user interface for capture and transmission of media and location content
JP2017521804A
Methods and systems for providing efficient multimedia message depending on user context in messenger service
JP2019175450A
Suggested items for use with embedded applications in chat conversations
US20180367484A1