Message display method and electronic device

Abstract

The application discloses a message display method and an electronic device, and relates to the technical field of terminals. The method is applied to an electronic device, the electronic device is provided with an instant messaging application, and the method comprises the following steps: the electronic device displays a first user chat interface of the instant messaging application, the first user chat interface comprises a first video message, the first video message comprises a first area and a second area, the first video message is associated with a first video, the first video comprises first audio and at least one frame of first image, the first area corresponds to the first audio, and the second area corresponds to the at least one frame of first image; in response to user operation on the first area, the electronic device plays the first video in a first mode; and in response to user operation on the second area, the electronic device plays the first video in a second mode. The technical scheme is helpful to improve the flexibility of first video playing.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of terminal, in particular to a message display method and electronic equipment. BACKGROUND

[0002] Instant messaging is a communication method based on the Internet, which allows two or more people to communicate through the Internet by sending text, voice, video, pictures and other messages, enriching people's communication methods and providing great convenience for people's life and work. Instant messaging application is a tool for realizing instant messaging, such as WeChat, QQ, etc. It can provide communication services for users by being installed on electronic equipment (such as mobile phones, tablet computers, etc.). However, some functions in the instant messaging application in the prior art need to be further improved to facilitate user use. SUMMARY

[0003] The present application provides a message display method and electronic equipment, so that the user can select to operate a certain region of the video message according to the user's own needs, so that the electronic equipment can play the video associated with the video message in the video playing mode corresponding to the region, thereby helping to improve the flexibility of playing the video associated with the video message.

[0004] In a first aspect, a message display method is provided for the embodiments of the present application, which is applied to an electronic equipment, and the electronic equipment is installed with an instant messaging application, and the method specifically comprises:

[0005] The electronic equipment displays a first user chat interface of the instant messaging application, the first user chat interface includes a first video message, the first video message includes a first region and a second region, and the first video message is associated with a first video, the first video includes a first audio and at least one frame of first image, the first region corresponds to the first audio, and the second region corresponds to the at least one frame of first image;

[0006] In response to the user's operation on the first region, the electronic equipment plays the first video in a first mode;

[0007] In response to the user's operation on the second region, the electronic equipment plays the first video in a second mode.

[0008] In the embodiments of the present application, since the first video message includes the first region and the second region, the electronic equipment can play the first video in the first mode in response to the user's operation on the first region, and play the first video in the second mode in response to the user's operation on the second region, thereby helping to improve the flexibility of playing the first video.

[0009] ​It should be noted that the first video associated with the first video message can be sent by the electronic device in response to an operation of the user, or can be received by the electronic device, and the present disclosure is not limited in this regard.

[0010] In a possible design, the second region corresponding to the at least one image can be implemented in the following manner:

[0011] The second region is configured to display a thumbnail of a target image, and the target image is an image associated with the first video. This helps to improve the visuality of the second region to the user.

[0012] In an example, the image associated with the first video is one of the at least one first image. In another example, the image associated with the first video is a predefined image, which is different from the at least one first image.

[0013] In a possible design, the electronic device playing the first video in the first manner in response to the operation of the user on the first region can be implemented in the following manner:

[0014] The electronic device plays the first audio and does not play the at least one first image in response to the operation of the user on the first region.

[0015] In a possible design, the electronic device playing the first video in the second manner in response to the operation of the user on the second region can be implemented in the following manner:

[0016] The electronic device plays the at least one first image and plays the first audio in response to the operation of the user on the second region.

[0017] With the above technical solutions, the user can play only the audio in the first video and not play the at least one image according to the user's own needs.

[0018] In a possible design, the electronic device can play the at least one first image in the following manner:

[0019] The electronic device plays the at least one first image in a small window, or the electronic device plays the at least one first image in full screen.

[0020] In a possible design, the electronic device playing the first video in the first manner in response to the operation of the user on the first region can be implemented in the following manner:

[0021] The electronic device plays the first audio and plays the at least one first image in a small window in response to the operation of the user on the first region.

[0022] In a possible design, the electronic device playing the first video in the second manner in response to the operation of the user on the second region can be implemented in the following manner:

[0023] In response to the user operation on the second region, the electronic device plays the first audio and plays the at least one frame of the first image in full screen.

[0024] In a possible design, in response to the user clicking the small window, the electronic device plays the first video in full screen. Thus, the user can be facilitated to switch to full screen playing when the at least one frame of the first image is played in the small window.

[0025] In a possible design, in response to the user operation on the first region, the electronic device playing the first video in the first mode can be implemented in the following manner:

[0026] In response to the user operation on the first region, the electronic device plays the first audio and does not play the at least one frame of the first image;

[0027] In a possible design, in response to the user operation on the second region, the electronic device playing the first video in the second mode can be implemented in the following manner:

[0028] In response to the user operation on the second region, the electronic device plays the at least one frame of the first image and does not play the first audio.

[0029] In a possible design, in response to the user operation on the second region, the electronic device playing the at least one frame of the first image and not playing the first audio can be implemented in the following manner:

[0030] In response to the user operation on the second region, the electronic device plays the at least one frame of the first image and displays the first audio converted into text when playing the at least one frame of the first image. Thus, the user can be facilitated to understand the at least one frame of the image without playing the audio.

[0031] In an example, the first audio converted into text when playing the at least one frame of the first image can be displayed in the form of subtitles.

[0032] In a possible design, the first user chat interface further includes a second video message, the second video message is associated with a second video, and the second video message includes a third region and a fourth region, the second video includes second audio and at least one frame of a second image; the third region corresponds to the second audio, the fourth region corresponds to the at least one frame of the second image, the first video message and the second video message are both in an unread state, the second video message is located after the first video message, and in response to the user operation on the first region, the electronic device automatically plays the second audio after the first audio is played. Thus, the user operation can be facilitated.

[0033] It should be noted that the first video message and the second video message are both displayed in two regions, that is, the display style of the first video message and the display style of the second video message are the same.

[0034] In a possible design, the first user chat interface further includes a first voice message, the first voice message is located after the first video message, and the first voice message and the first video message are in an unread state; in response to the operation of the user on the first region, the electronic device automatically plays the voice associated with the first voice message after the first audio playing ends. Thus, user operations can be reduced.

[0035] In a possible design, the first user chat interface further includes a second voice message and a third video message, the third video message is associated with a third video, the third video includes third audio and at least one frame of third image; the third video message includes a fifth region and a sixth region, the fifth region corresponds to the third audio, and the sixth region corresponds to the at least one frame of third image; the second voice message is located before the third video message, and the second voice message and the third video message are in an unread state; in response to the operation of the user on the second voice message, the electronic device plays the voice associated with the second voice message, and automatically plays the third audio after the voice associated with the second voice message playing ends. Thus, user operations can be reduced.

[0036] In a possible design, the electronic device receives a first operation on the first user chat interface; in response to the first operation, the electronic device performs shooting through the camera and displays a shooting interface; the shooting interface is used to display an image collected by the camera. The above technical solution enables the user to perform video or image shooting only by one operation, and simplifies the manner of triggering the electronic device to perform shooting through the camera.

[0037] In a possible design, the first operation is an upward swipe of the user on the first user chat interface.

[0038] In a possible design, the electronic device receives a second operation on the first user chat interface; in response to the second operation, the electronic device collects a voice through the microphone. Thus, the user can conveniently collect a voice.

[0039] In a possible design, the first user chat interface further includes a first control, a seventh region and an eighth region, the first control is used for message input, and the seventh region and the eighth region are not overlapped.

[0040] The first operation is that the user slides the first control to the seventh region while pressing the first control; and the second operation is that the user slides the first control to the eighth region while pressing the first control. Thus, the user can realize audio-video mixed recording.

[0041] In a possible design, the seventh region is further used to display an image collected by the camera. Thus, the user can preview.

[0042] In a possible design, the electronic device displays a combined forwarding box, the combined forwarding box is used to forward N messages on a second user chat interface, the combined forwarding box includes M avatars, the M avatars are used to indicate a user group or a user to which the N messages are forwarded; the M avatars each include a delete icon.

[0043] In response to the user clicking the delete icon on a first avatar in the M avatars, the electronic device deletes the first avatar in the combined forwarding box, where M and N are positive integers. Thus, the user can conveniently delete the user group or the user to which the N messages are forwarded.

[0044] In a possible design, the electronic device displays a combined forwarding box, the combined forwarding box is used to forward N messages on a second user chat interface, the combined forwarding box includes a second control and / or a third control.

[0045] In response to an operation on the second control, the electronic device displays a chat selection interface, the chat selection interface is used to select a user group or a user to which the messages are forwarded.

[0046] In response to an operation on the third control, the electronic device displays a user chat interface used by the user to select messages, where N is a positive integer. Thus, the user can conveniently add or delete messages, or a user group or a user during forwarding.

[0047] In a possible design, the electronic device displays a combined forwarding box, the combined forwarding box is used to forward N messages on a second user chat interface, the combined forwarding box includes message number prompt information, the message number prompt information is used to indicate a number of messages forwarded by the user, where N is a positive integer. Thus, the user can conveniently view the number of messages forwarded.

[0048] In a possible design, the electronic device displays a combined forwarding box, the combined forwarding box includes K messages, the K messages include N messages on a second user chat interface to be forwarded; where K is greater than or equal to N, and K and N are positive integers.

[0049] In response to an operation of the user on a second message in the N messages, the electronic device opens a file associated with the second message, the file associated with the second message is one of a voice, a video, an audio and video, a document, a picture, a location, and a link. Thus, the user can preview the file associated with the message in the combined forwarding box.

[0050] In a possible design, the K messages in the combined forwarding box are displayed in the form of bubbles respectively. Thus, the user can conveniently view.

[0051] In a possible design, each message in the N messages corresponds to a selection control, and the selection controls corresponding to the N messages are in a selected state.

[0052] In response to a user operation on the selection control corresponding to the third message of the N messages, the electronic device switches the selection control corresponding to the third message from the selected state to the unselected state, where the electronic device does not forward the third message when the selection control corresponding to the third message is in the unselected state. Thus, the user can add or delete messages in the merged forwarding.

[0053] It should be noted that in some embodiments, when K is greater than N, the selection controls corresponding to the other messages in the K messages except the N messages are in the unselected state, and in response to a user operation on the selection control corresponding to the fourth message in the other messages, the electronic device switches the selection control corresponding to the fourth message from the unselected state to the selected state, where the electronic device forwards the fourth message when the selection control corresponding to the fourth message is in the selected state.

[0054] In a possible design, the electronic device displays a third user chat interface, the third user chat interface including a fifth message, the fifth message being associated with the merged forwarding chat record, and the merged forwarding chat record including the N messages.

[0055] In response to a user operation on the fifth message, the electronic device displays a chat record detail interface, the chat record detail interface including the N messages, and the N messages being displayed in the form of bubbles. Thus, the user's chat record can be restored for easy viewing.

[0056] In a possible design, the electronic device displays a third user chat interface, the third user chat interface including a fifth message, the fifth message being associated with the merged forwarding chat record, and the merged forwarding chat record including the N messages.

[0057] In a possible design, the electronic device displays a third user chat interface, the third user chat interface including a fifth message, the fifth message being associated with the merged forwarding chat record, and the merged forwarding chat record including the N messages.

[0058] In a possible design, the electronic device displays a third user chat interface, the third user chat interface including a fifth message, the fifth message being associated with the merged forwarding chat record, and the merged forwarding chat record including the N messages.

[0059] In a fifth aspect, a computer program is provided for the embodiments of the present application. The computer program includes instructions, which when executed on a computer, cause the computer to perform the technical solutions of the first aspect and any possible design of the first aspect.

[0060] In a sixth aspect, a graphical user interface on an electronic device is provided for the embodiments of the present application. The electronic device has a display screen, one or more memories, and one or more processors configured to execute one or more computer programs stored in the one or more memories. The graphical user interface includes the graphical user interface displayed by the electronic device when executing the technical solutions of the first aspect and any possible design of the first aspect.

[0061] The beneficial effects of the second aspect to the sixth aspect can be found in the beneficial effects of the first aspect, and are not repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0062] Figure 1 A hardware structure diagram of an electronic device is provided for the embodiments of the present application.

[0063] Figure 2A A schematic diagram of a user interface is provided for the embodiments of the present application.

[0064] Figure 2B A schematic diagram of another user interface is provided for the embodiments of the present application.

[0065] Figure 3 A schematic diagram of another user interface is provided for the embodiments of the present application.

[0066] Figure 4 A schematic diagram of another user interface is provided for the embodiments of the present application.

[0067] Figure 5 A schematic diagram of another user interface is provided for the embodiments of the present application.

[0068] Figure 6 A schematic diagram of another user interface is provided for the embodiments of the present application.

[0069] Figure 7 A schematic diagram of another user interface is provided for the embodiments of the present application.

[0070] Figure 8 A schematic diagram of an image taken by an electronic device is provided for the embodiments of the present application.

[0071] Figure 9 A schematic diagram of another user interface is provided for the embodiments of the present application.

[0072] Figure 10 A schematic diagram of another user interface is provided for the embodiments of the present application.

[0073] Figure 11 A schematic view of another user interface of an embodiment of the present application;

[0074] Figure 12 A schematic view of another user interface of an embodiment of the present application;

[0075] Figure 13 A schematic view of another user interface of an embodiment of the present application;

[0076] Figure 14 A schematic view of another user interface of an embodiment of the present application;

[0077] Figure 15 A schematic view of a merge forwarding box of an embodiment of the present application;

[0078] Figure 16 A schematic view of another merge forwarding box of an embodiment of the present application;

[0079] Figure 17 A schematic view of a user interface of an embodiment of the present application;

[0080] Figure 18 A schematic view of another merge forwarding box of an embodiment of the present application;

[0081] Figure 19 A schematic view of a structure of another electronic device of an embodiment of the present application. DETAILED DESCRIPTION

[0082] First, some nouns involved in the embodiments of the present application are explained to facilitate the understanding of those skilled in the art.

[0083] 1. Instant messaging application. The instant messaging application in the embodiments of the present application is a tool for realizing instant messaging, allowing two or more people to transmit messages such as text, voice, video, document, picture, etc. through the Internet, which provides great convenience for people's communication. For example, the instant messaging application involved in the embodiments of the present application can be WeChat, Changelin, QQ, etc. Specifically, the instant messaging application can provide services for users by being installed on an electronic device. In response to the operation of the user opening the instant messaging application, the electronic device can display a user chat interface, for example, the user chat interface can be a group chat interface (i.e. a chat interface including at least three users, such as a chat interface of user A, user B and user C), or a separate chat interface (i.e. a chat interface of two users, such as a chat interface of user A and user B). The user can view the messages sent by himself or other users on the user chat interface, such as voice, video, text, etc.

[0084] 2、Video. The video involved in the embodiments of the present application includes audio and multiple frames of images. The electronic device plays the video associated with a video message on the user chat interface, which can be understood as: for the video, the electronic device plays the audio and the multiple frames of images at the same time. The electronic device plays the audio in the video associated with a video message on the user chat interface, which can be understood as: for the video, the electronic device only plays the audio, but does not play the multiple frames of images. The electronic device plays the multiple frames of images in the video associated with a video message on the user chat interface, which can be understood as: for the video, the electronic device only plays the multiple frames of images, but does not play the audio.

[0085] Generally, the instant messaging application usually displays a video message in the first style on the chat interface, in which case, in response to the user's operation on the video message displayed in the first style, the electronic device can only play the video associated with the video message, and cannot play the audio or the multiple frames of images in the video associated with the video message separately.

[0086] Therefore, the embodiments of the present application provide a message display method, so that the electronic device can display a video message in a second style on the user chat interface of the instant messaging application. When the video message is displayed in the second style, the video message includes a first area and a second area, the video playback mode corresponding to the first area is a first mode, the video playback mode corresponding to the second area is a second mode, the first area and the second area are different areas, the first mode is different from the second mode, and the video message is associated with a video, so that the user can select the corresponding area to operate according to his own needs, and play the video associated with the video message in the video playback mode corresponding to the area, which helps to improve the flexibility of video playback. For example, the first mode is to play the audio in the video, so that the user operates the first area, so that the electronic device can play the audio in the video associated with the video message. For another example, the second mode is to play at least one frame of image in the video, so that the user operates the second area, so that the electronic device can play at least one frame of image in the video associated with the video message.

[0087] It should be understood that in the embodiments of this application, "at least one" means one or more. "More than one" means two or more. "And / or" describes the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can represent three cases: A exists alone, A and B exist simultaneously, and B exists alone. A and B can be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent seven cases: a, b, c, a and b, a and c, b and c, or a, b, and c. Each of a, b, and c can be an element itself or a set containing one or more elements.

[0088] In this application, terms such as "exemplary," "in some embodiments," and "in other embodiments" are used to indicate that something is an example, illustration, or description. Any embodiment or design that is described as "exemplary" in this application should not be construed as being more preferred or advantageous than other embodiments or designs. Rather, the term "exemplary" is used to present the concept in a specific manner.

[0089] It should be noted that the terms "first" and "second" used in the embodiments of this application are used only for the purpose of distinguishing descriptions and should not be construed as indicating or implying relative importance or order.

[0090] The electronic device in this application embodiment supports the installation of instant messaging applications. These applications can be pre-installed at the factory or installed by the user according to their own needs; there is no limitation on this. For example, the electronic device in this application embodiment can be a portable terminal, such as a mobile phone, tablet computer, laptop computer, wearable electronic device (such as a smartwatch), etc. For example, the portable terminal includes, but is not limited to, devices equipped with… Alternatively, it can use another operating system. Furthermore, the electronic device in this application embodiment may not be a portable terminal, such as a desktop computer with a touch-sensitive surface.

[0091] For example, such as Figure 1As shown, the electronic device includes a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a loudspeaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 can include a pressure sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0092] The processor 110 can include one or more processing units. For example, the processor 110 can include an application processor (AP), a modem, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices, or two or more different processing units can be integrated in one device.

[0093] The processor 110 can also be provided with a memory for storing computer programs and / or data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can hold computer programs and / or data that the processor 110 has just used or recycled. If the processor 110 needs to use the computer programs and / or data again, it can be directly called from the memory. This avoids repeated access and reduces the waiting time of the processor 110, thus improving the efficiency of the system.

[0094] In some embodiments, the processor 110 can include one or more interfaces. For example, the processor 110 includes a universal serial bus (USB) interface 130, a subscriber identity module (SIM) card interface 195. For another example, the processor 110 can also include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), and / or a general-purpose input / output (GPIO) interface, etc.

[0095] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a structural limitation on the electronic device. In some other embodiments of the present application, the electronic device can also use different interface connection modes or a combination of multiple interface connection modes in the above embodiments.

[0096] The USB interface 130 is an interface conforming to the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device, and can also be used to transmit data between the electronic device and a peripheral device. It can also be used to connect earphones to play audio through the earphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0097] The SIM card interface 195 is configured to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with the electronic device. The electronic device can support two or N SIM card interfaces, where N is a positive integer greater than two. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external storage cards. The electronic device interacts with a network through the SIM card to achieve functions such as calling and data communication. In some embodiments, the electronic device uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device and cannot be separated from the electronic device.

[0098] The charging management module 140 is configured to receive a charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive a charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive a wireless charging input through a wireless charging coil of the electronic device. The charging management module 140 can charge the battery 142 while also supplying power to the electronic device through the power management module 141.

[0099] The power management module 141 is configured to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives an input from the battery 142 and / or the charging management module 140 to supply power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 can also be configured to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), and the like. In other embodiments, the power management module 141 can also be disposed in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be disposed in the same device.

[0100] The wireless communication function of the electronic device can be achieved through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem, the baseband processor, and the like.

[0101] The antenna 1 and the antenna 2 are configured to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in combination with a tuning switch.

[0102] The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G and the like applied to the electronic device. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), and the like.

[0103] The wireless communication module 160 includes a solution for wireless communication including wireless local area networks (WLAN) (e.g., a Wi-Fi network), bluetooth (BT), a global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, and the like, which can be applied to the electronic device.

[0104] In some embodiments, the antennas 1 and the mobile communication module 150 are coupled, and the antennas 2 and the wireless communication module 160 are coupled, so that the electronic device can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0105] The electronic device implements a display function through a GPU, a display screen 194, an application processor, and the like. The display screen 194 is used to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled, a Micro Led, a Micro-oLed, a quantum dot light emitting diodes (QLED), and the like. In some embodiments, the electronic device can include 1 or N display screens 194, N being a positive integer greater than 1.

[0106] The electronic device can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like. The ISP is used to process data fed back by the camera 193. For example, when taking a photo, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing to convert it into an image visible to the naked eye. The ISP can also optimize the algorithm of the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature, and other parameters of the shooting scene. In some embodiments, the ISP can be arranged in the camera 193.

[0107] The camera 193 is used to capture still images or videos. Objects generate optical images through lenses and project them onto photosensitive elements. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into a standard RGB, YUV, and the like format image signal. In some embodiments, the electronic device can include 1 or N cameras 193, N being a positive integer greater than 1.

[0108] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to extend the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, audio, video, and other files can be saved in the external memory card.

[0109] The internal memory 121 includes a running memory and a built-in memory. The running memory can be used to store computer programs and / or data, etc. The processor 110 executes various functional applications and data processing of the electronic device by running the computer programs stored in the running memory. For example, the running memory can include a high-speed random access memory. The built-in memory, which can also be referred to as a built-in external storage, etc., can be used to store computer programs and / or data. For example, the built-in memory can store an operating system, application programs, etc. The electronic device usually loads the computer programs and / or data in the built-in memory to the running memory, so that the processor 110 runs the corresponding computer programs and / or data to implement the corresponding functions. In addition, the internal memory 121 can include a non-volatile memory, such as at least one disk storage device, a flash storage device, a universal flash storage (UFS), etc.

[0110] The electronic device can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, the application processor, etc. For example, music playing, recording, etc.

[0111] The keys 190 include a power-on key, a volume key, etc. The keys 190 can be mechanical keys. They can also be touch keys. The electronic device can receive key inputs and generate key signal inputs related to user settings and function control of the electronic device.

[0112] The motor 191 can generate a vibration prompt. The motor 191 can be used for incoming call vibration prompts and also for touch vibration feedback. For example, touch operations on different applications (such as taking pictures, playing audio, etc.) can correspond to different vibration feedback effects. Touch operations on different regions of the display screen 194 can also correspond to different vibration feedback effects of the motor 191. Different application scenarios (such as time reminders, received messages, alarms, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customizable.

[0113] The indicator 192 can be an indicator light, which can be used to indicate charging status, power changes, and also to indicate messages, missed calls, notifications, etc.

[0114] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device can include more or fewer components than shown, or combine certain components, or split certain components, or different arrangement of components. The components shown can be implemented in hardware, software or a combination of software and hardware.

[0115] The electronic device shown in the hardware structure of the mobile phone is taken as an example to introduce the method of the embodiments of the present application in detail. Figure 1

[0116] In response to the operation of the user opening a certain instant messaging application, the electronic device can display the user chat interface of the instant messaging application. For example, the operation of the user opening a certain instant messaging application can be the operation of the user clicking the icon of the instant messaging application, or the voice instruction of opening the instant messaging application, or the shortcut gesture operation, which is not limited. For example, as shown in A of FIG. 10, the interface 10 is a schematic diagram of the user chat interface of a certain instant messaging application. As shown in the figure, the interface 10 includes a region 210 and a region 220. The region 210 is used to display the chat record of the user. The region 220 is a control display region. For example, as shown in A of FIG. 11, the region 210 includes the chat record of user 1 and user 2, and the region 220 includes a control 201, a control 202, a control 203 and a control 204. Figure 2A Figure 2A In response to the user clicking the control 201, the electronic device switches the control 202 to a control 202', so that the user can send a voice through the operation of the control 202', and present a voice message associated with the voice on the user chat interface, for example, as shown in B of FIG. 11. The user clicks the voice message on the user chat interface, so that the electronic device can play the voice associated with the voice message to the user. In addition, in the case that the region 210 includes the control 202', in response to the operation of the user clicking the control 201, the electronic device can switch the control 202' to the control 202, so that the user can operate the control 202 to send text and present it on the user chat interface. The control 203 is used for expression input. The control 201 is used to realize more functions, such as shooting, voice call, video call, etc., which is not limited. Figure 2A For example, as shown in A of FIG. 12, the user clicks the control 204, so that the electronic device displays a region 230. The region 230 includes one or more controls, such as a control 205. The user clicks the control 205, so that the electronic device displays a shooting interface. For example, the shooting interface can be as shown in B of FIG. 12.

[0117] Figure 2B For example, as shown in A of FIG. 12, the user clicks the control 204, so that the electronic device displays a region 230. The region 230 includes one or more controls, such as a control 205. The user clicks the control 205, so that the electronic device displays a shooting interface. For example, the shooting interface can be as shown in B of FIG. 12. Figure 2B ​​​B, which includes the photograph preview area 240 and the control 206. The user can tap the control 206 to take a photo, or hold the control 206 to take a video. In an example, in response to the user releasing the control 206, the electronic device displays a photograph completion interface. For example, the photograph completion interface can be as shown in Figure 2B C, which includes the photograph preview area 250 and the control 207. The user can preview the taken image or video in the photograph preview area 250. For example, in response to the user tapping the control 208, the electronic device can exit the photograph display interface, delete the taken video or image, and display a user chat interface. For example, the user chat interface can be as shown in Figure 2A B. For another example, in the case of the taken content being a video a, in an example, in response to the user tapping the control 207, the electronic device sends the video a, and displays the video message a in the first style on the interface 10, the video message a being associated with the video a, for example as shown in Figure 2B D. In response to an operation of tapping the video message a displayed in the first style on the interface 10, the electronic device plays the video a in full screen. Specifically, the electronic device playing the video a in full screen can be understood as the electronic device displaying and sequentially playing the multiple frames of images in the video a in full screen, and playing the audio in the video a. Thus, when the video message is displayed in the first style on the user chat interface, the electronic device can only play the video in response to the user operation on the video message, and cannot play the audio or the multiple frames of images in the video separately.

[0118] In some embodiments, in the case of the taken content being a video a, in response to the user tapping the control 207, the electronic device sends the video a, and displays a user chat interface. For example, the user chat interface can be as shown in Figure 2B C. When the electronic device displays the photograph completion interface, in response to the user tapping the control 207, the electronic device sends the video a, and displays a user chat interface. In an example, the user chat interface can be as shown in Figure 3 A, which includes the area 310. The area 310 is used to display the chat record of the user. For example, as shown in Figure 3As shown in A, the region 310 includes a video message a, which is displayed in a second style, including a region 301 and a region 302. The region 301 corresponds to a first playing manner, the region 302 corresponds to a second playing manner, and the video message a is associated with a video a. For example, the first manner is mainly to play audio in the video, and the second manner is mainly to play images in the video. The region 301 corresponds to the audio, and the region 302 corresponds to the images. For example, the region 301 is used to display graphics related to the audio, which can be associated with the audio in the video a, and the region 302 is associated with the images in the video a. For example, the region 302 is used to display a thumbnail of a first image. The thumbnail of the first image can be a thumbnail of a partial region of the first image, or a thumbnail of the entire region of the first image. Specifically, the first image can be determined by a predefined position in the video a. For example, the first image can be the first frame image in the video a, the last frame image in the video a, or an image located in the middle of the video a, which is not limited. Alternatively, the first image can be determined by the electronic device according to a certain algorithm or strategy. For example, the first image is an image selected by the electronic device from the video a that meets a preset condition. For example, the preset condition can be that the image is relatively clear, the facial expression is natural, etc. Alternatively, in some other embodiments, the first image can be a certain image set by the user, which is irrelevant to the images in the video a, such as the user's avatar, or a certain wallpaper, etc., which is not limited.

[0119] In the case that the video message a is displayed in the second style on the user chat interface, the electronic device can determine the playing manner of the video a according to whether the user operates the region 301 or the region 302, that is, whether to play the video a, or to play the audio in the video a, or to play at least one frame of image in the video a, thereby helping to improve the flexibility of playing the video a. Moreover, compared with displaying the video message a in the first style, displaying the video message a in the second style is similar to the display manner of the voice message, which helps to reduce the area occupied by the video message a on the user chat interface. The following describes an example in the first manner, the second manner and the third manner.

[0120] The first manner:

[0121] In response to the user clicking the region 301, the electronic device plays the audio in the video a. At this time, the electronic device does not display at least one frame of image in the video a. In response to the user clicking the region 302, the electronic device plays the video a. It should be noted that playing the video a can be playing the video a in a small window, or playing the video a in full screen.

[0122] For example, the duration of the audio in the video a is 30 seconds. In some embodiments of the present application, when the electronic device plays the audio in the video a in response to the user clicking the area 301, the electronic device plays the video a for a period of time, but the audio in the video a is not played to the end. For example, the audio in the video a is played to 15 seconds, and in response to the user clicking the area 302, the electronic device can play the video in full screen from the 16th second. That is, the electronic device plays and displays in full screen the images in the video a in sequence starting from the image at the 16th second, and continues to play the audio in the video a.

[0123] Alternatively, in some embodiments, in response to the user clicking the area 302, the electronic device plays the video a. If the video a is played for a period of time, but the video a is not played to the end, the user clicks the control 304, and in response to the user clicking the control 304, the electronic device stops playing the video a, and can continue to play the audio in the video a until the audio in the video a is played to the end. Alternatively, in response to the user clicking the control 305, the electronic device stops playing the video a, and no longer continues to play the audio in the video a.

[0124] Method two:

[0125] In response to the user clicking the area 301, the electronic device plays the audio in the video a, and plays at least one image in the video a in the small window 303. In response to the user clicking the area 302, the electronic device plays the video a in full screen. That is, the electronic device displays in full screen the images in the video a in sequence starting from the first image, and simultaneously plays the audio in the video a starting from the 1st second.

[0126] It should be noted that in some embodiments, when the electronic device plays multiple images in the video a in the small window 303, the user can move the display position of the small window 303 according to his own needs. Alternatively, the display position of the small window 303 can be fixed and immovable, and the embodiments of the present application do not limit this.

[0127] In some embodiments, for example, the duration of the audio in the video a is 30 seconds. When the electronic device plays the audio in the video a in response to the user clicking the area 301, and plays multiple images in the video a in the small window 303, the video a is played for a period of time, but the video a is not played to the end. For example, the video a is played to the 15th second, and in response to the user clicking the small window 303, the electronic device can play the video in full screen from the 16th second. That is, the electronic device plays and displays in full screen the images in the video a in sequence starting from the image at the 16th second, and continues to play the audio in the video a until the audio in the video a is played to the end.

[0128] Method three:

[0129] In response to the user long-pressing the area 301, the electronic device displays the toolbar 402, such asFigure 4 As shown, the options include earpiece playback, transcript, delete, and multi-select, etc. In response to the user selecting the earpiece playback option, the electronic device plays the audio in video a in an earpiece. Alternatively, in some embodiments, the electronic device plays the audio in video a in an earpiece in response to the user tapping region 301 when the electronic device is close to a human ear. In yet other embodiments, the electronic device plays the audio in video a in a loudspeaker in response to the user tapping region 302 when the electronic device is far away from a human ear.

[0130] In response to the user long-pressing region 302, the electronic device displays toolbar 401, as shown. Figure 4 As shown, the options include sound playback and no sound playback, etc. In response to the user selecting the sound playback option, the electronic device plays video a. In response to the user selecting the no sound playback option, the electronic device plays video a in silence. Here, the electronic device playing video a in silence can be understood as the electronic device playing only the multiple frames of images in video a, without playing the audio in video a; or the electronic device playing the multiple frames of images and the audio in video a, but with the volume set to 0. Further, in some embodiments, the electronic device can also convert the audio in video a into text, and display the text in the form of subtitles when playing the multiple frames of images in video a, so as to facilitate the user to watch the video. For example, the electronic device plays video a in silence, converts the audio in video a into text, and displays the text in the form of subtitles when playing the multiple frames of images in video a, so as to facilitate the user to watch the video in a quiet environment.

[0131] It should be noted that the above operations of exiting or pausing the full-screen playback of video a are merely illustrative, and the embodiments of the present application are not limited thereto. For example, the operation of exiting the full-screen playback of video a in the embodiments of the present application can also be a downward swipe, a leftward swipe, or a voice instruction, etc.

[0132] In the embodiments of the present application, since the video message is presented to the user in the second style, it not only helps the user to freely select to play the video, the audio in the video, or the multiple frames of images in different scenarios according to the user's own needs, and improves the flexibility of video playback. Moreover, for the recipient, in some embodiments, if the user only taps the region associated with the audio in the video on the user chat interface, the electronic device can only download the audio in the video, without downloading all the images in the video, and when the user taps the region associated with the video or the small window, the images in the video are downloaded again. Thus, it helps to save the user traffic. Of course, in the embodiments of the present application, for the recipient, the electronic device can also download the audio in the video before the user taps the region associated with the audio in the video or the video. In some embodiments, for the recipient, the electronic device can also download the images in the video before the user taps the region associated with the audio in the video or the video. So as to avoid the video playback from being stuck, and affect the user experience.

[0133] In other embodiments of this application, the electronic device may also display the audio playback progress to the user while playing audio in video a. For example, such as... Figure 5 As shown, this allows users to easily view the audio playback progress in the video.

[0134] Furthermore, in some embodiments, such as Figure 6 As shown, when the user chat interface includes video message 01, video message 02, voice message 03, and video message 04, and video message 01, video message 02, voice message 03, and video message 04 are in an unread state, in response to the user clicking area 500, the electronic device plays the audio from the video associated with video message 01. After the audio from the video associated with video message 01 finishes playing, it automatically plays the audio from the video associated with video message 02, the voice message associated with voice message 03, and the audio from the video associated with video message 04 in sequence, until the audio from the video associated with video message 04 finishes playing. Thus, unread audio can be played automatically without user intervention. Area 500 is associated with the audio in video message 01, and video message 01 is the video associated with video message 01.

[0135] Furthermore, embodiments of this application also provide a method for quickly recording videos or images. Figure 7 For example, electronic device display. Figure 7 When the user chat interface is shown in Figure A, the electronic device displays the camera interface in response to the user's first action. For example, the camera interface could be as follows: Figure 7 As shown in C, users can view images captured in real-time by the camera on the shooting interface. For example, the first operation could be to swipe upwards from the top edge of the control display area.

[0136] For example, the control display area can be as follows: Figure 7 Area 220 is shown in section A. For example, taking the first operation as the user's finger sliding upwards from the upper boundary of the control display area, the electronic device can follow the user's finger movement, dynamically presenting the process of opening the shooting interface to the user. For example, as... Figure 7 As shown in B, this is an interface when the electronic device pulls open the shooting interface as the user's finger moves, where area 700 is used to display the image captured by the camera in real time.

[0137] In some embodiments, such as Figure 7As shown in C, the photographing interface includes one or more of control 701, control 702 and control 703. In response to the user tapping control 701, the electronic device takes a photo; in response to the user pressing control 701, the electronic device takes a video; and in response to the user releasing control 701, the electronic device sends the taken video or image. During the process of taking a video by pressing control 701, if the user slides upwards, the photographing is cancelled and the user chat interface is displayed. In some embodiments, control 701 is also used to display the photographing duration. When the photographing duration reaches a threshold, the electronic device sends the taken video regardless of whether the user releases control 701 or not, or the electronic device stops continuing to take the video. If the electronic device stops continuing to take the video when the photographing duration reaches the threshold, in response to the user releasing control 701, the electronic device sends the taken video. In this case, the duration of the video sent by the electronic device can be the threshold. It should be noted that the threshold can be set by the user according to his own needs, or can be pre-configured by the device manufacturer before the electronic device is shipped, etc., for example, the threshold can be 15 seconds, 20 seconds or 30 seconds, etc., which is not limited.

[0138] Control 702 is used to beautify the taken image or video. For example, in response to the user tapping control 702, the electronic device displays video beautification toolbar 710. When the user selects a scene option in video beautification toolbar 710, the electronic device can display a plurality of selectable background options in video beautification toolbar 710, so that the user can select a corresponding background option according to his own needs, and take the scene indicated by the background option as the background of the image taken by the camera. When the user does not select a background option, the actual scene taken by the camera is the background of the image taken by the camera. For example, as shown in A, the foreground is a person, and the other is the background. The user can select a background option in video beautification toolbar 710 according to his own needs, to replace the background taken by the camera in B. Figure 7 As shown in C, the background can be the actual scene taken by the camera, or the scene indicated by the background option selected by the user according to his own needs. For example, as shown in D, the image taken by the camera is as shown in E, wherein the person is the foreground, and the other is the background. The user can select a background option in video beautification toolbar 710 according to his own needs, to replace the background taken by the camera in F. Figure 8 As shown in G, the foreground is a person, and the other is the background. The user can select a background option in video beautification toolbar 710 according to his own needs, to replace the background taken by the camera in H. Figure 8 As shown in I, the foreground is a person, and the other is the background. The user can select a background option in video beautification toolbar 710 according to his own needs, to replace the background taken by the camera in J. Figure 8 As shown in K, the foreground is a person, and the other is the background. The user can select a background option in video beautification toolbar 710 according to his own needs, to replace the background taken by the camera in L.

[0139] Control 703 is used to switch the front and rear cameras. For example, when the electronic device currently uses the front camera to take a photo, in response to the user tapping control 703, the electronic device switches to the rear camera to take a photo. For another example, when the electronic device currently uses the rear camera to take a photo, in response to the user tapping control 703, the electronic device switches to the front camera to take a photo. Alternatively, the electronic device can also default to use the front camera to take a photo, that is, the image presented to the user on the photographing interface is the image collected by the front camera in real time.

[0140] In some embodiments, in response to the user releasing the control 701, the electronic device displays a user chat interface. For example, the user chat interface can be displayed as shown in Figure 9 In some embodiments, the video message associated with the video captured by the camera is displayed in the first style. In addition, in another example, as shown in Figure 9 In some embodiments, the region 220 can further include a plurality of controls, so that the user can not only send text or voice messages, but also send locations, pictures, and emoticons, etc., to facilitate user use.

[0141] The embodiments of the present application also provide a quick audio / video recording method. For example, in some embodiments, when the electronic device displays the user chat interface shown as A in Figure 10 In some embodiments, when the electronic device displays the user chat interface shown as A in Figure 10 In some embodiments, the user can press and hold the control 1001 and slide up from the position 1020, as shown as B in Figure 10 In some embodiments, if the finger is located in the region 1002 when the sliding is stopped, the electronic device can collect the user's voice through the microphone. Similarly, as shown as B in Figure 10 In some embodiments, the user can press and hold the control 1001 and slide up from the position 1010, and if the finger is located in the region 1003 when the sliding is stopped, the electronic device can capture video through the camera. Optionally, the user can preview the image collected by the camera in real time in the region 1002. Optionally, when capturing video through the camera, the electronic device can expand the region 1002 to facilitate the user to preview the image collected by the camera in real time. Optionally, the electronic device can prompt the user to stop capturing when the capturing time reaches a certain threshold. The threshold can refer to the related description of the threshold above, and will not be described here.

[0142] In response to the user releasing the finger, the electronic device sends the collected voice or video, and displays a user chat interface including the voice message or the video message. For example, the video message can be displayed in the first style or the second style, which is not limited, and the first style and the second style can refer to the related description above, and will not be described here.

[0143] Optionally, when recording audio / video, the user can move the finger back and forth between the region 1002 and the region 1003 to mix the audio and the video.

[0144] For example, the user presses and holds the control 1001 and slides up, and in response to the finger being located in the region 1003 when the sliding is stopped, the electronic device collects the user's voice through the microphone. When the microphone collects the user's voice, the user slides the finger to the region 1002, and then the electronic device displays the user chat interface as shown as C in Figure 10As shown in C of FIG. 10, the electronic device enlarges the region 1002 and performs photographing through the camera. In response to the user releasing the finger, the electronic device sends the collected audio and video, and displays the user chat interface. The electronic device can send the collected video and audio through multiple messages respectively, or send the collected video and audio through one message. For example, when the video and audio are sent through one message, the message can be referred to as an audio-video message. Specifically, the audio-video message can be displayed in the first style or the second style. Taking the audio-video a recorded by the electronic device as an example, if the audio-video message is displayed in the first style, the electronic device can display the audio-video message as shown in A of FIG. 11. Figure 10

[0145] Taking the first 15 seconds of the audio-video associated with the audio-video message as voice and the last 15 seconds as video as an example, for example, in response to a play operation of the audio-video message by the user, the electronic device plays the voice for the first 15 seconds and plays the video for the last 15 seconds in full screen. When playing the voice for the first 15 seconds, the electronic device can display the first frame image of the video for the last 15 seconds in full screen, or display a black screen, or a preset background wallpaper, or a voice playing interface, and the like, which is not limited herein. Taking the audio-video message displayed in the second style as another example, for example, in response to the user clicking the first region, the electronic device plays the audio in the audio-video, and in response to the user clicking the second region, the electronic device can refer to the playing mode of the audio-video when the audio-video message is displayed in the first style. The first region is associated with the audio in the audio-video, and the second region is associated with the audio-video.

[0146] It should be noted that in the embodiments of the present application, when the user stops sliding and the position of the finger is located in the region 1002, the size of the region 1002 can also remain unchanged, that is, the region 1002 is not enlarged. Whether the region 1002 is enlarged or not is not limited in the embodiments of the present application.

[0147] Of course, it should be understood that through the above operation, in some embodiments, the user can move back and forth between the region 1002 and the region 1003 before releasing the finger, to mix record the audio and the video, for example, the electronic device can first perform photographing, and then collect the audio. Thus, the flexibility of audio-video recording is improved.

[0148] It should be noted that, Figure 10 The operation shown in FIG. 10 is only an example, for example, the user can also use a stylus to record the voice and / or video in the above manner. In addition, it should be understood that the starting position of the user starting to slide the control 1001 is not limited in the embodiments of the present application.

[0149] In other embodiments, as shown in FIG. 10B, when the electronic device displays the region 1002, Figure 11 Figure 10 ​​In the user chat interface shown in Figure A, the user can slide their finger upwards while holding control 1101. If the finger stops sliding and is located in area 1110, the electronic device will capture the user's voice through the microphone; if the finger stops sliding and is located in area 1120, the electronic device will capture video through the camera. Similarly, during recording, the user can slide upwards or downwards to mix audio and video. For example, if the user slides their finger upwards from area 1110 to area 1120, the electronic device will capture video through the camera and display the real-time image captured by the camera in area 1120. Of course, the user can also slide their finger downwards from area 1120 to area 1110 while the electronic device is capturing video, at which point the electronic device will stop capturing video and instead capture voice through the microphone.

[0150] Alternatively, embodiments of this application may also employ the following quick audio and video recording method to... Figure 12 For example. In some other embodiments, the electronic device displays... Figure 10 When the user chat interface shown in Figure A is in motion, the control responds to the user sliding their finger from the left edge to the right edge of control 1201, as shown in Figure A. Figure 12 As shown in Figure A, the electronic device captures video, or, in response to the user sliding their finger from the right edge of control 1201 to the left edge of control 1201, as... Figure 12 As shown in Figure B, the electronic device captures voice data. When the user releases their finger from control 1201, the electronic device sends the recorded audio and video. It should be noted that the user can slide left and right on control 1201 during video recording or audio capture, thus achieving mixed recording of voice and video. When the user is recording video, as the user slides their finger from the right edge to the left edge of control 1201, the electronic device continues recording video. When the user's finger reaches the left edge of control 1201, the electronic device stops recording video and begins capturing voice data. Alternatively, when the user is capturing audio, as the user slides their finger from the left edge to the right edge of control 1201, the electronic device continues recording video. When the user's finger reaches the right edge of control 1201, the electronic device stops capturing voice data and begins recording video. It should be noted that in this case, when the electronic device is recording video, the user can preview the image captured in real-time by the camera in full screen.

[0151] It should be understood that the adoption Figure 12 When recording audio and video using the quick recording method shown, the electronic device can also collect voice data in response to the user sliding their finger from the left edge to the right edge of the control 1201; and capture video data in response to the user sliding their finger from the right edge to the left edge of the control 1201.

[0152] It should be noted that the above Figure 11 Or Figure 12 The provided fast voice and / or video recording mode is illustrated by taking the user's finger operation as an example. It can be understood that the user can also use a stylus to replace the finger to operate.

[0153] In the embodiments of the present application, the electronic device can start the audio and video message mixed recording function, and the user can perform audio and video mixed recording through the above operation mode. For example, the user can start the audio and video message mixed recording function on the setting interface of the instant messaging application. For example, as shown in Figure 13 The interface 1300 is a schematic diagram of a setting interface of an application, including a plurality of setting controls, such as general, switching account, logging out, and the like. The user clicks on the communication, and the electronic device displays the interface 1310. For example, the interface 1310 includes a control 1303 for controlling the start or stop of the audio and video message mixed recording function. When the control 1303 is started, the audio and video message mixed recording function of the electronic device is started, and when the control 1303 is stopped, the audio and video message mixed recording function of the electronic device is started. That is, when the control 1303 is stopped, the electronic device cannot perform audio and video message mixed recording. For example, in response to the user's operation of setting the control 1303 to start, the electronic device starts the audio and video mixed recording function. For another example, in response to the user's operation of setting the control 1303 to stop, the electronic device stops the audio and video mixed recording function.

[0154] In some other embodiments, the interface 1310 can also include a message input key setting control and / or a video message display style setting control. For example, the user clicks on the input key setting control, and the electronic device can display a key setting list 1301, which includes key function options such as recording audio and video, recording audio. When the user selects recording audio and video, the electronic device can record audio and video by operating the control 1001, the control 1101 or the control 1201. When the user selects recording audio, the electronic device can record audio by operating the control 1001, the control 1101 or the control 1201. For details, please refer to Figure 1The diagram illustrates how a user records audio using control 202. For example, when a user clicks the video message display style control, the electronic device displays a video message display style list 1302. This list may include a first style and a second style. For instance, when the user selects the second style, video messages associated with sent and received videos on the user's chat interface are displayed in the second style, allowing the user to choose whether to play the video's audio or the video itself. Conversely, when the user selects the first style, video messages associated with sent and received videos on the user's chat interface are displayed in the first style, and the user can only play the video, not the audio. These methods allow users to customize video message display styles, message input buttons, and audio / video mixing settings according to their needs, improving the interaction between the electronic device and the user.

[0155] Furthermore, when an electronic device displays a chat interface (such as a group chat interface between two or more users, or a chat interface between two users), users can forward or merge chat messages according to their needs. For example, consider the chat interface between User 1 and User 2. (Example:) Figure 14 As shown in Figure A, when the electronic device displays the chat interface between User 1 and User 2, if a user long-presses a message (e.g., message 06), the electronic device displays a message toolbar 1401. For example, the message toolbar 1401 includes one or more options such as copy, forward, favorite, delete, and multi-select. It should be noted that the options displayed in the message toolbar 1401 may vary slightly depending on the message long-pressed by the user. For example, if the long-pressed message is a shared mini-program or a location (e.g., message 07), the copy option may not be included in the message toolbar 1401. In some embodiments, when the user selects multiple selections in the message toolbar 1401, the electronic device presents a message selection control on the user's chat interface, such as... Figure 14 As shown in B. When the user selects messages 02 and 05 and clicks "forward," the electronic device displays a forwarding option box 1402 in the user's chat interface. For example, as shown... Figure 14 As shown in C, the forwarding option box 1402 includes a forwarding option for each message, a merge forwarding option, and a cancel option. Taking the user selecting the merge forwarding option as an example, the electronic device displays a chat selection interface, such as... Figure 14 As shown in D, users can select the user(s) to send the message to (either a group or a single user) on this interface. For example, if a user selects a user group name "My family" and a user name "E", then after the user clicks "complete", the merge forwarding box 1403 will be displayed, as shown in the image. Figure 14As shown in F of FIG. 13B, the user clicks the chat record of the user 1, and the messages on the chat interface of the user 1 selected by the user are displayed in a list form, as shown in G of FIG. 13B. For example, for the message 06 being a picture, the electronic device cannot present the picture to the user when displaying the messages on the chat interface of the user 1 selected by the user in a list form. Figure 14 Figure 14

[0156] In some embodiments of the present application, when the user selects the completion as shown in D of FIG. 13A, the electronic device displays a merge forwarding box 1500. As shown in A of FIG. 13B, the merge forwarding box 1500 can also be as shown in B of FIG. 13B. For example, as shown in A of FIG. 13B, in the case that the user selects the message 02 and the message 06, the merge forwarding box 1500 can also display the messages between the message 02 and the message 06, such as the message 03, the message 04 and the message 05. Of course, in the case that the user selects the message 02 and the message 06, the merge forwarding box 1500 can also not display the messages between the message 02 and the message 06, such as the message 03, the message 04 and the message 05. Figure 14 Figure 15 Figure 15 Figure 15 For example, in the case that the message is a text message or a picture, the user can view the corresponding text or picture in the merge forwarding box 1500. For another example, in the case that the message is a voice message, the user can play the corresponding voice in the merge forwarding box 1500 by clicking the message. For another example, in the case that the message is a video message, the user can play the corresponding video in the merge forwarding box 1500 by clicking the message. For another example, in the case that the message is a document (such as a word document, a text document, an excel document, a PPT document, or a PDF document, etc.) message, the user can open the corresponding document in the merge forwarding box 1500 for viewing. For another example, in the case that the message is a location, an expression, or a shared applet, the user can also preview in the merge forwarding box 1500. It should be noted that the format of the message that can be previewed in the merge forwarding box 1500 is not limited in the embodiments of the present application. Further, the merge forwarding box 1500 can also present the number of messages selected by the user to the user.

[0157] For example, in the case that the message is a text message or a picture, the user can view the corresponding text or picture in the merge forwarding box 1500. For another example, in the case that the message is a voice message, the user can play the corresponding voice in the merge forwarding box 1500 by clicking the message. For another example, in the case that the message is a video message, the user can play the corresponding video in the merge forwarding box 1500 by clicking the message. For another example, in the case that the message is a document (such as a word document, a text document, an excel document, a PPT document, or a PDF document, etc.) message, the user can open the corresponding document in the merge forwarding box 1500 for viewing. For another example, in the case that the message is a location, an expression, or a shared applet, the user can also preview in the merge forwarding box 1500. It should be noted that the format of the message that can be previewed in the merge forwarding box 1500 is not limited in the embodiments of the present application. Further, the merge forwarding box 1500 can also present the number of messages selected by the user to the user.​​​​​

[0158] Further, the merged forwarding frame 1500 can include a control 1501. A user taps the control 1501, and the electronic device can return to the interface shown in FIG. 15D, and reselect the user name or the user group name to which the chat record of user 1 is forwarded. Further, the merged forwarding frame 1500 can also include a control 1502. In response to a user tapping the control 1502, the electronic device can display the interface shown in FIG. 15B, or display the merged forwarding frame 1500 shown in FIG. 15B. The user can add or delete the selected messages according to the user's own needs. Further, in some embodiments, when the progress bar for previewing the messages in the merged forwarding frame 1500 is located at the top end, as shown in FIG. 15B, the user slides down, and the electronic device can update N messages located before message 02 on the chat interface of user 1 and user 2 to the merged forwarding frame 1500, N can be a positive integer greater than or equal to 1, and can be preconfigured by the user or pre-defined in the electronic device. The electronic device updates once for each time the user slides down, until the first message on the chat interface of user 1 and user 2 is updated. For example, there is only one message before message 02, such as message 01, the user slides down, and the electronic device can display message 01 on the interface of the merged forwarding frame 1500, and the electronic device no longer updates when the user slides down again. Figure 14 Figure 14 Figure 15 Figure 15 Figure 15

[0159] It should be understood that similarly, when the progress bar for previewing the messages in the merged forwarding frame 1500 is located at the lower end, the user continues to slide up, and the electronic device can update M messages located after message 06 on the chat interface of user 1 and user 2 to the merged forwarding frame 1500, M can be equal to N, or not equal to N. Wherein, the electronic device updates once for each time the user slides up, until the last message on the chat interface of user 1 and user 2 is updated. Thus, it is convenient for the user to reselect the messages to be forwarded when the merged forwarding frame is displayed.

[0160] In addition, further, as shown in FIG. 15E, the merged forwarding frame 1500 further includes the avatar of the user or the user group, so as to facilitate the user to identify the user or the user group to which the chat record is sent. Further, in some embodiments, the avatar of the user or the user group in the merged forwarding frame 1500 includes a delete icon, as shown in FIG. 15E. Figure 15 Figure 16 ​​​​​​As shown, in response to a user clicking the delete icon on the avatar of user E, the electronic device can directly delete user E. This means the electronic device does not need to send user 1's chat history to user E, thus facilitating the deletion of users who have forwarded chat history. Alternatively, the avatars of users or user groups in the merge forwarding box 1500 can be replaced with the names of users or user groups, or other identifiers that can be used to identify users or user groups. This embodiment does not limit this approach.

[0161] by Figure 16 For example, after a user clicks the delete icon on the avatar of user E, the merge forwarding box 1500 only includes the avatars of one user group. When the merge forwarding box 1500 only includes one avatar, the electronic device can hide the delete icon on that avatar, or it can display the delete image on that avatar. In response to the user clicking the delete icon on that image, the electronic device displays a chat selection interface, such as... Figure 14 As shown in D in the diagram.

[0162] For example, taking a message forwarded to a user group named "My Family" as an example, the user sees chat message 1701 displayed in the group chat interface of "My Family". This chat message 1701 is associated with the chat history between user 1 and user 2 that was forwarded by user 2. Figure 17 As shown in A. In response to the user clicking on chat message 1701, the electronic device displays a details interface of the chat history forwarded by user 2 to user 1, as shown in Figure 1. Figure 17 As shown in B. For example, in Figure 17 On the interface shown in B, User 1's chat history is presented to the user in the form of bubbles, allowing the user to restore the original appearance of the chat history between User 1 and User 2. In addition, the user can also preview messages in different formats on the interface of User 1's chat history details, such as pictures, text, videos, audio, location, emoticons, documents, shared links or mini-programs, etc.

[0163] Alternatively, in some embodiments, when the user selects... Figure 14 Following messages 03 and 04 as shown in Figure A, the electronic device can also display message 09 in the merge forwarding box. Message 09 is a merged message of messages 03 and 04, as illustrated in the example below. Figure 18As shown, the user can play the message 03 and the message 04 by clicking the message 09 once in the forwarding box, without the user operating multiple times. Further, in some embodiments, the user long-presses the message 09, and the electronic device displays the toolbar 1800. The toolbar 1800 can include multiple options, such as speed, cut, add, more, and the like. For example, the user clicks the speed, and the user can edit the playing speed of the audio of the message 09. For another example, the user clicks the cut, and the user can edit the content of the audio of the message 09. For another example, the user clicks the add, and the user can add the audio content of the message 09, and the like. It should be noted that the options in the toolbar 1800 displayed by the electronic device can be different for different messages. For example, for a picture, the toolbar 1800 can include a photo, a skin, and the like. For another example, for a text message, the toolbar 1800 can include a font, a size, and the like.

[0164] It should be noted that in the embodiments of the present application, the electronic device can combine the same type of messages sent by the same or multiple users in combination with time, for example, the first style of video and audio can be the same type of message for the electronic device.

[0165] For example, when the electronic device displays the combined messages in the forwarding box, the user views the chat record of the forwarding chat in the chat interface, the electronic device can present the user in the form of the combined messages, or can present the user in the form of bubbles respectively, which is not limited.

[0166] It should be noted that the above message display mode can also be applied to the forwarding scene by piece, which will not be repeated here.

[0167] The above various embodiments can be used alone or in combination to achieve different technical effects, and the comparison is not limited.

[0168] Based on the same concept, the embodiments of the present application also provide an electronic device, such as Figure 19 As shown, the electronic device includes a processor 1901, a memory 1902, a display screen 1903, and a camera 1904. Further, in some embodiments, the electronic device further includes a sensor 1905, such as a touch sensor.

[0169] For example, the above devices can be connected through one or more communication buses. The one or more computer programs stored in the above memory 1902 and configured to be executed by the processor 1901 include instructions that can be used to make the electronic device perform the steps of the methods in the above embodiments.

[0170] For example, the above processor 1901 can be specifically Figure 1The processor 110 shown, the above-mentioned memory 1902 can be specifically Figure 1 The internal memory 121 shown and / or the external memory connected with the electronic device, the above-mentioned display screen 1903 can be specifically Figure 1 The display screen 194 shown, the above-mentioned sensor 1905 can be specifically Figure 1 One or more sensors in the sensor module 180 shown. The embodiments of the present application do not make any limitation to this.

[0171] In addition, the embodiments of the present application also provide a graphical user interface (GUI) on an electronic device, which specifically includes the graphical user interface displayed by the electronic device when executing the above-mentioned various method embodiments.

[0172] In the above embodiments, according to the context, the term "when" or "after" can be interpreted as meaning "if" or "after" or "in response to determining" or "in response to detecting". Similarly, according to the context, the phrase "upon determining" or "if detecting (the stated condition or event)" can be interpreted as meaning "if determining" or "in response to determining" or "upon detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)".

[0173] In the above embodiments, all or part can be realized by software, hardware, firmware or any combination thereof. When realized by software, all or part can be realized in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer readable storage medium or transferred from one computer readable storage medium to another, for example, the computer instructions can be transferred from one website, computer, server or data center to another through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) mode. The computer readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. integrated with one or more available media. The available media can be magnetic media (for example, floppy disk, hard disk, magnetic tape), optical media (for example, DVD), or semiconductor media (for example, solid state disk (SSD)) and the like. In the case of no conflict, the schemes of the above embodiments can be combined for use.

[0174] Note that a portion of the patent application file will be subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.

Claims

1. A message display method characterized by, The method is applied to an electronic device on which an instant messaging application is installed, and the method comprises: The electronic device displays a first user chat interface of the instant messaging application, the first user chat interface comprises a first video message, the first video message comprises a first region and a second region, and the first video message is associated with a first video, the first video comprises first audio and at least one frame of first image, the first region corresponds to the first audio, and the second region corresponds to the at least one frame of first image; In response to user operation on the first region, the electronic device plays the first audio and does not play the at least one frame of first image; In response to user operation on the second region, the electronic device plays the at least one frame of first image and plays the first audio.

2. The method of claim 1, wherein, The second region corresponds to the at least one frame of first image, and the second region is configured to display a thumbnail of a target image, the target image being one of the at least one frame of first image. The first region displays time length information of the first audio.

3. The method of claim 1, wherein, In response to user operation on the second region, the electronic device plays the at least one frame of first image, and the playing the at least one frame of first image comprises:

4. The method of claim 1, wherein, In response to user operation on the second region, the electronic device plays the at least one frame of first image in a small window, or In response to user operation on the second region, the electronic device plays the at least one frame of first image in full screen. In response to user operation on the first region, the electronic device plays the first video in a first mode, and the playing the first video in the first mode comprises:

5. The method of claim 1 or 2, wherein, In response to user operation on the first region, the electronic device plays the first audio and plays the at least one frame of first image in a small window; In response to user operation on the second region, the electronic device plays the first video in a second mode, and the playing the first video in the second mode comprises: In response to user operation on the second region, the electronic device plays the first audio and plays the at least one frame of first image in full screen. The method further comprises:

6. The method of claim 4, wherein, In response to user clicking on the small window, the electronic device plays the first video in full screen. The method further comprises:

7. The method of claim 5, wherein, In response to user clicking on the small window, the electronic device plays the first video in full screen. When the first audio is played, a playing progress of the first audio is displayed.

8. The method of claim 1 or 2, wherein, The method further comprises:

9. The method of claim 1 or 2, wherein, When the first audio is played to a first time point, in response to operation on the second region, the playing of the first audio is stopped, and the playing of the at least one frame of first image is continued from the first time point; wherein the first time point does not reach an end time point of the first audio; When the at least one frame of first image is played to a second time point, in response to operation on the first region, the playing of the at least one frame of first image is stopped, and the playing of the first audio is continued from the second time point; wherein the second time point does not reach an end time point of the at least one frame of first image. ​ 10. The method of any one of claims 1 to 3, wherein, The first user chat interface further comprises a second video message, the second video message is associated with a second video, and the second video message comprises a third region and a fourth region, the second video comprises second audio and at least one second image, the third region corresponds to the second audio, and the fourth region corresponds to the at least one second image; the first video message and the second video message are both in an unread state, the second video message is located after the first video message, and the method further comprises: In response to user operation on the first region, the electronic device automatically plays the second audio after the first audio is played.

11. The method of any one of claims 1 to 3, wherein, The first user chat interface further comprises a first voice message, the first voice message is located after the first video message, and the first voice message and the first video message are both in an unread state, and the method further comprises: In response to user operation on the first region, the electronic device automatically plays the voice associated with the first voice message after the first audio is played.

12. The method of any one of claims 1 to 3, wherein, The first user chat interface further comprises a second voice message and a third video message, the third video message is associated with a third video, and the third video comprises third audio and at least one third image; the third video message comprises a fifth region and a sixth region, the fifth region corresponds to the third audio, and the sixth region corresponds to the at least one third image; The second voice message is located before the third video message, and the second voice message and the third video message are both in an unread state, and the method further comprises: In response to user operation on the second voice message, the electronic device plays the voice associated with the second voice message and automatically plays the third audio after the voice associated with the second voice message is played.

13. The method of claim 1 or 2, wherein, The method further comprises: The electronic device receives a first operation on the first user chat interface; In response to the first operation, the electronic device captures an image through a camera and displays a capture interface; the capture interface is used to display the image captured by the camera.

14. The method of claim 13, wherein, The first operation is upward swiping of a user on the first user chat interface.

15. The method of claim 13, wherein, The method further comprises: The electronic device receives a second operation on the first user chat interface; In response to the second operation, the electronic device collects a voice through a microphone.

16. The method of claim 15, wherein, The first user chat interface further comprises a first control, a seventh region, and an eighth region, the first control is used for message input, and the seventh region and the eighth region are not overlapped; The first operation is swiping of a user holding the first control to the seventh region; The second operation is swiping of a user holding the first control to the eighth region.

17. The method of claim 16, wherein, The seventh region is further used to display the image captured by the camera.

18. The method of claim 1 or 2, wherein, The method further comprises: The electronic device displays a combined forwarding frame, the combined forwarding frame being used for forwarding N messages on a second user chat interface, the combined forwarding frame comprising M avatars, the M avatars being used for indicating a user group or a user to which the N messages are forwarded, and each of the M avatars comprising a deletion icon. In response to a user clicking the deletion icon on a first avatar in the M avatars, the electronic device deletes the first avatar in the combined forwarding frame, wherein the M and N are positive integers.

19. The method of claim 1 or 2, wherein, The method further comprises: The electronic device displays a combined forwarding frame, the combined forwarding frame being used for forwarding N messages on a second user chat interface, the combined forwarding frame comprising a second control and / or a third control. In response to an operation on the second control, the electronic device displays a chat selection interface, the chat selection interface being used for selecting a user group or a user to which the messages are forwarded. In response to an operation on the third control, the electronic device displays a user chat interface for the user to select messages, and the N is a positive integer.

20. The method of claim 1 or 2, wherein, The method further comprises: The electronic device displays a combined forwarding frame, the combined forwarding frame being used for forwarding N messages on a second user chat interface, the combined forwarding frame comprising message number prompt information, the message number prompt information being used for indicating a number of messages to be forwarded, and the N being a positive integer.

21. The method of claim 1 or 2, wherein, The method further comprises: The electronic device displays a combined forwarding frame, the combined forwarding frame comprising K messages, the K messages comprising N messages on a second user chat interface to be forwarded, wherein the K is greater than or equal to the N, and the K and N are positive integers. In response to a user operation on a second message in the N messages, the electronic device opens a file associated with the second message, the file associated with the second message being one of a voice, a video, an audio-video, a document, a picture, a location, and a link.

22. The method of claim 21, wherein, The K messages are displayed in the form of bubbles respectively.

23. The method of claim 21, wherein, Each of the N messages corresponds to a selection control, and the selection controls corresponding to the N messages are in a selected state respectively. In response to a user operation on a selection control corresponding to a third message in the N messages, the electronic device switches the selection control corresponding to the third message from the selected state to an unselected state, wherein when the selection control corresponding to the third message is in the unselected state, the electronic device does not forward the third message.

24. The method of claim 22, wherein, Each of the N messages corresponds to a selection control, and the selection controls corresponding to the N messages are in a selected state respectively. In response to a user operation on a selection control corresponding to a third message in the N messages, the electronic device switches the selection control corresponding to the third message from the selected state to an unselected state, wherein when the selection control corresponding to the third message is in the unselected state, the electronic device does not forward the third message.

25. The method of claim 18, wherein, The method further comprises: The electronic device displays a third user chat interface, the third user chat interface comprising a fourth message, the fourth message being associated with a combined forwarding chat record, and the combined forwarding chat record comprising the N messages. In response to a user operation on the fourth message, the electronic device displays a chat record details interface, the chat record details interface including the N messages, and the N messages being displayed in the form of bubbles.

26. An electronic device, comprising: Comprising: at least one processor and at least one memory; wherein the one or more memories store one or more computer programs comprising instructions that, when executed by the one or more processors, cause the electronic device to perform the method of any one of claims 1-25.

27. A computer-readable storage medium, characterized in that, The computer-readable storage medium comprises a computer program which, when running on an electronic device, causes the electronic device to perform the method of any one of claims 1-25.

28. A computer program product, characterised in that, Comprising computer program instructions which, when running on a computer, cause the computer to perform the method of any one of claims 1-25.

29. A graphical user interface on an electronic device, the graphical user interface comprising: The electronic device has a display screen, one or more memories, and one or more processors for executing one or more computer programs stored in the one or more memories, and the graphical user interface comprises the graphical user interface displayed when the electronic device performs the method of any one of claims 1-25.

Images