Voice message-based interaction methods, devices, computer equipment, and storage media
By displaying changes in tape reel thickness and rotating identification icons during voice message playback, the problem of low resource utilization in traditional methods is solved, achieving more efficient resource utilization and intuitive playback progress perception.
Patent Information
- Application Number
- CN202211070736.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-09-02
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2042-09-02
AI Technical Summary
In traditional voice interaction methods, resource utilization is low during voice message playback, leading to frequent instances of repeated listening.
By displaying the tape reel thickness gradually decreasing as playback progresses during voice message playback, and combining this with the rotation of the identification icon, the system simulates changes in playback progress, reducing the need for repeated listening.
It improves resource utilization, avoids repeated listening to voice messages, and enhances the intuitive perception of playback progress.
Smart Images

Figure CN117014397B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computer technology, and in particular to a voice message-based interaction method, apparatus, computer device, storage medium, and computer program product. Background Technology
[0002] With the development of computer technology, instant messaging applications are becoming increasingly diverse in type and function. Instant messaging applications, when running on the client side, include the ability to send messages via voice.
[0003] In traditional technology, when a voice interaction object receives a voice message, a message icon will be displayed in the instant messaging application. The voice interaction object can listen to the message by touching the message icon with its finger. If the message icon is clicked again during playback, the voice message will stop playing. If the message icon is clicked again, the voice message will start playing from the beginning.
[0004] However, with traditional methods, when a voice interaction object is listening to voice messages, it can only estimate the playback progress, which may result in repeated listening to voice messages, leading to continuous resource consumption and low resource utilization. Summary of the Invention
[0005] Therefore, it is necessary to provide a voice message-based interaction method, device, computer equipment, computer-readable storage medium, and computer program product that can improve resource utilization in response to the above-mentioned technical problems.
[0006] Firstly, this application provides an interaction method based on voice messages. The method includes:
[0007] Displays a message bubble containing the voice message and the corresponding identity icon;
[0008] In response to a voice message playback trigger event, the first tape reel is displayed in the message bubble, and the voice message is played.
[0009] During the playback of the voice message, at least one of the first tape reel or the identity icon is shown to rotate, and the thickness of the first tape reel gradually decreases as the playback progresses, and a first tape segment connecting the identity icon and the first tape reel is displayed for at least a portion of the playback process.
[0010] In response to the end of a voice message playback event, the first tape reel is de-displayed.
[0011] Secondly, this application also provides an interactive device based on voice messages. The device includes:
[0012] The voice message display module is used to display message bubbles and corresponding identity icons for voice messages;
[0013] The tape reel display module is used to display the first tape reel in the message bubble and trigger the playback of the voice message in response to the playback trigger event of the voice message;
[0014] The voice playback display module is used to display, during the playback of a voice message, at least one of a first magnetic tape reel or an identification icon rotating, and the thickness of the first magnetic tape reel gradually decreases as the playback progress of the voice message, and displays a first magnetic tape segment connecting the identification icon and the first magnetic tape reel for at least a portion of the playback process.
[0015] The processing module is used to cancel the display of the first tape reel in response to the end of playback of the voice message.
[0016] Thirdly, this application also provides a computer device. The computer device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to perform the following steps:
[0017] Displays a message bubble containing the voice message and the corresponding identity icon;
[0018] In response to a voice message playback trigger event, the first tape reel is displayed in the message bubble, and the voice message is played.
[0019] During the playback of the voice message, at least one of the first tape reel or the identity icon is shown to rotate, and the thickness of the first tape reel gradually decreases as the playback progresses, and a first tape segment connecting the identity icon and the first tape reel is displayed for at least a portion of the playback process.
[0020] In response to the end of a voice message playback event, the first tape reel is de-displayed.
[0021] Fourthly, this application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program thereon, which, when executed by a processor, performs the following steps:
[0022] Displays a message bubble containing the voice message and the corresponding identity icon;
[0023] In response to a voice message playback trigger event, the first tape reel is displayed in the message bubble, and the voice message is played.
[0024] During the playback of the voice message, at least one of the first tape reel or the identity icon is shown to rotate, and the thickness of the first tape reel gradually decreases as the playback progresses, and a first tape segment connecting the identity icon and the first tape reel is displayed for at least a portion of the playback process.
[0025] In response to the end of a voice message playback event, the first tape reel is de-displayed.
[0026] Fifthly, this application also provides a computer program product. The computer program product includes a computer program that, when executed by a processor, performs the following steps:
[0027] Displays a message bubble containing the voice message and the corresponding identity icon;
[0028] In response to a voice message playback trigger event, the first tape reel is displayed in the message bubble, and the voice message is played.
[0029] During the playback of the voice message, at least one of the first tape reel or the identity icon is shown to rotate, and the thickness of the first tape reel gradually decreases as the playback progresses, and a first tape segment connecting the identity icon and the first tape reel is displayed for at least a portion of the playback process.
[0030] In response to the end of a voice message playback event, the first tape reel is de-displayed.
[0031] The aforementioned voice message-based interaction method, apparatus, computer device, storage medium, and computer program product display message bubbles and corresponding identity icons for voice messages. Responding to a voice message playback trigger event, a first magnetic tape reel is displayed at the message bubble, triggering the playback of the voice message. This enriches the display format of voice message playback. During voice message playback, the first magnetic tape reel rotates along with the identity icon via a first magnetic tape segment. The thickness of the first magnetic tape reel gradually decreases as the voice message playback progresses, indicating the publisher of the voice message. The change in thickness during the tape reel's rotation simulates the playback progress, allowing the voice interaction object to intuitively perceive the playback progress without needing to repeatedly listen to the voice message. This reduces the number of times voice messages are repeatedly listened to, avoids continuous resource occupation, and improves resource utilization. Attached Figure Description
[0032] Figure 1 This is an application environment diagram of a voice message-based interaction method in one embodiment;
[0033] Figure 2 This is a flowchart illustrating a voice message-based interaction method in one embodiment.
[0034] Figure 3 This is a schematic diagram showing message bubbles and corresponding identity icons for a voice message in one embodiment;
[0035] Figure 4 This is a schematic diagram showing message bubbles and corresponding identity icons for a voice message in another embodiment;
[0036] Figure 5 This is a schematic diagram illustrating the response to a playback trigger event in one embodiment;
[0037] Figure 6 This is a schematic diagram illustrating the rotation of an identity icon in one embodiment;
[0038] Figure 7 This is a schematic diagram of the rotation of the first magnetic tape reel in one embodiment;
[0039] Figure 8 This is a schematic diagram of the voice message playback process in one embodiment;
[0040] Figure 9 This is a schematic diagram of the voice message playback process in another embodiment;
[0041] Figure 10 This is a schematic diagram illustrating a response to a voice message recording event in one embodiment;
[0042] Figure 11 This is a schematic diagram illustrating a response to a voice message recording event in another embodiment;
[0043] Figure 12 This is a schematic diagram illustrating how the recording bubble gradually decreases as the recording progresses in one embodiment;
[0044] Figure 13 This is a schematic diagram of voice message recording in one embodiment;
[0045] Figure 14 This is a schematic diagram showing how the outer contour of the second magnetic tape reel gradually expands towards the outer contour of the recording bubble as the recording progresses in one embodiment.
[0046] Figure 15 This is a schematic diagram illustrating the display and de-display of the voice recording icon in one embodiment;
[0047] Figure 16 This is a schematic diagram illustrating the response to a playback end event in one embodiment;
[0048] Figure 17 This is a schematic diagram showing a portion of a message bubble gradually increasing in size as the playback progresses in one embodiment.
[0049] Figure 18This is a schematic diagram of voice message playback in one embodiment;
[0050] Figure 19 This is a schematic diagram showing the outer contour of the first magnetic tape reel gradually shrinking towards the center of the message bubble as the playback progresses in one embodiment;
[0051] Figure 20 This is a schematic diagram illustrating the display and de-display of the voice playback icon in one embodiment;
[0052] Figure 21 This is a schematic diagram of a number icon displaying numerical changes in one embodiment;
[0053] Figure 22 This is a schematic diagram illustrating a response to a voice location event in one embodiment;
[0054] Figure 23 This is a schematic diagram illustrating the progress adjustment position, initial position, and center point position in one embodiment;
[0055] Figure 24 This is a schematic diagram illustrating the determination of the quadrant where the progress adjustment position is located in one embodiment;
[0056] Figure 25 This is a schematic diagram illustrating the relative angles obtained in one embodiment;
[0057] Figure 26 This is a schematic diagram illustrating a response to a playback interruption event in one embodiment;
[0058] Figure 27 This is a schematic diagram of the voice message recording stage in one embodiment;
[0059] Figure 28 This is a schematic diagram of the voice message recording stage in another embodiment;
[0060] Figure 29 This is a schematic diagram of the voice message playback stage in one embodiment;
[0061] Figure 30 This is a schematic diagram of the voice message playback stage in another embodiment;
[0062] Figure 31 This is a schematic diagram illustrating the response to a 2x speed playback event in one embodiment;
[0063] Figure 32 This is a schematic diagram illustrating a response to a playback interruption event in another embodiment;
[0064] Figure 33 This is a structural block diagram of a voice message-based interactive device in one embodiment;
[0065] Figure 34This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation
[0066] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0067] The voice message-based interaction method provided in this application can be applied to, for example... Figure 1 In the application environment shown, terminal 102 is equipped with a client for implementing voice message-based interaction. This client can be an instant messaging application, a web client, or a sub-application running in the runtime environment of a parent application. Terminal 102 displays a message bubble 104 and a corresponding identification icon 106 for the voice message. In response to a voice message playback trigger event, a first tape reel 108 is displayed at message bubble 104, and playback of the voice message is triggered. During the playback of the voice message, at least one of the first tape reel 108 or the identification icon 106 is rotated. Figure 1 (This is illustrated by the rotating identity icon), and the thickness of the first tape reel 108 gradually decreases as the voice message playback progresses. For at least a portion of the playback time, the first tape segment 110 connecting the identity icon 106 and the first tape reel 108 is displayed. In response to the end of voice message playback, the display of the first tape reel 108 is canceled. The terminal 102 can be, but is not limited to, various desktop computers, laptops, smartphones, tablets, IoT devices, and portable wearable devices. IoT devices can include smart speakers, smart TVs, smart air conditioners, smart in-vehicle devices, etc. Portable wearable devices can include smartwatches, smart bracelets, head-mounted devices, etc.
[0068] In one embodiment, such as Figure 2 As shown, a voice message-based interaction method is provided, which can be applied to... Figure 1 Taking terminal 102 as an example, the explanation includes the following steps:
[0069] Step 202: Display the voice message bubble and the corresponding identity icon.
[0070] The message bubble is used to display voice messages and is a voice message display effect that appears after the voice message recording ends. The message bubble includes bubble color and bubble shape. The bubble color can be configured according to the actual application scenario. In this embodiment, the bubble color is not specifically limited; for example, the bubble color can be white or green. Furthermore, the user of the terminal can also pre-configure the bubble color according to their own preferences. The bubble shape can be configured according to the actual application scenario. In this embodiment, the bubble shape is not specifically limited. For example, the bubble shape can be circular, rectangular, or square. Furthermore, the user of the terminal can also pre-configure the bubble shape according to their own preferences. The identity icon refers to the icon of the voice message publisher. For example, the identity icon can specifically refer to the avatar of the voice message publisher, and the avatar of the publisher can be pre-configured by the publisher according to their own preferences.
[0071] Specifically, during voice interaction, the terminal displays message bubbles and corresponding identification icons for the voice message. In practical applications, when a voice message needs to be displayed during voice interaction, the terminal obtains the pre-configured bubble color and shape, displays the message bubble according to the bubble color and shape, and also displays the corresponding identification icon for the voice message.
[0072] In specific applications, the relative positions of the message bubbles and corresponding identification icons displayed on the terminals used by the sender and receiver of voice messages in voice interaction can differ. In a specific application, such as... Figure 3 As shown, for the recipient of a voice message in a voice interaction, the message bubble displayed on the terminal is located to the right of the corresponding identity icon, and the center of the message bubble and the center of the identity icon are on the same horizontal line. In a specific application, such as Figure 4 As shown, for the voice message publishing object in the voice interaction object, the message bubble of the voice message displayed by the terminal it uses is located to the left of the corresponding identity icon, and the center of the message bubble and the center of the identity icon are on the same horizontal line.
[0073] Step 204: In response to the playback trigger event of the voice message, the first tape reel is displayed in the message bubble, and the playback of the voice message is triggered.
[0074] Among them, a playback trigger event refers to an event that triggers the playback of a voice message. For example, a playback trigger event could specifically refer to a selection operation on a message bubble. Specifically, a selection operation on a message bubble could be one of a click, long press, or double-click. Another example is that a playback trigger event could occur when at least two voice messages can be played consecutively, and the previous voice message corresponding to the current voice message has finished playing. The first tape reel refers to the tape reel representing the playback of the voice message; the tape reel refers to the form of the tape being wound around itself, i.e., the tape reel being formed by the winding of the tape.
[0075] Specifically, in response to a voice message playback trigger event, the terminal displays a first tape reel representing voice message playback in the message bubble and triggers the playback of the voice message. In specific applications, the terminal monitors voice message playback trigger events in real time. Upon detecting a playback trigger event, it responds by displaying a first tape reel representing voice message playback in the message bubble and triggering voice message playback. In a specific application, such as... Figure 5 As shown, the terminal displays a message bubble for the voice message and a corresponding identification icon. In response to the voice message playback trigger event, the terminal displays the first tape reel representing the voice message playback at the message bubble.
[0076] Step 206: During the playback of the voice message, at least one of the first tape reel or the identity icon is shown to rotate, and the thickness of the first tape reel gradually decreases as the playback progress of the voice message, and a first tape segment connecting the identity icon and the first tape reel is displayed for at least a portion of the playback process.
[0077] The thickness of the first magnetic tape reel refers to the thickness of the magnetic tape wound on the reel, which is related to the duration of the voice message; the longer the message, the thicker the tape. The phrase "the thickness of the first magnetic tape reel gradually decreases with the playback progress" means that the thickness of the first magnetic tape reel changes as the playback progresses; that is, the amount of magnetic tape wound on the first magnetic tape reel gradually decreases with increasing playback progress. The first magnetic tape segment refers to the segment of magnetic tape used to connect the identification icon and the first magnetic tape reel during the playback of the voice message. The first magnetic tape segment includes a first end and a second end; the first end of the first magnetic tape segment is used to connect to the identification icon, and the second end of the first magnetic tape segment is used to connect to the first magnetic tape reel.
[0078] Specifically, during the playback of a voice message, the terminal will display at least one of the first tape reel or the identity icon rotating, and the thickness of the first tape reel will gradually decrease as the playback progresses. During at least a portion of the playback time, the terminal will display the first tape segment connecting the identity icon and the first tape reel.
[0079] In specific applications, the terminal will display a rotating identity icon, while the first tape reel remains stationary. The rotation direction of the identity icon can be pre-configured according to the actual application scenario; for example, the rotation direction can be clockwise or counterclockwise. In a specific application, such as... Figure 6 As shown, during the playback of the voice message, the terminal displays an identity icon rotating clockwise, while the first tape reel does not rotate. The thickness of the first tape reel gradually decreases as the playback progresses, and the first tape segment connecting the identity icon and the first tape reel is displayed for at least a portion of the playback time.
[0080] In specific applications, the terminal will display an identity icon that does not rotate, while the first tape reel rotates. The rotation direction of the first tape reel can be pre-configured according to the actual application scenario; for example, the rotation direction can be clockwise or counterclockwise. In a specific application, such as... Figure 7 As shown, during the playback of the voice message, the terminal displays the first tape reel rotating clockwise while the identity icon does not rotate. The thickness of the first tape reel gradually decreases as the playback progresses. At least a portion of the playback time is spent displaying the first tape segment connecting the identity icon and the first tape reel.
[0081] In practical applications, the terminal will display an identity icon and the first tape reel rotating simultaneously. The rotation directions of the identity icon and the first tape reel can be pre-configured according to the actual application scenario; they can be the same or different. For example, when the identity icon and the first tape reel rotate simultaneously, the rotation method can be that the identity icon rotates clockwise and the first tape reel rotates counterclockwise, or the identity icon rotates counterclockwise and the first tape reel rotates clockwise.
[0082] In specific applications, displaying the first tape segment connecting the identity icon and the first tape reel for at least a portion of the playback process means that during playback, when the first end of the first tape segment moves to the identity icon and the second end of the first tape segment connects to the first tape reel, the first tape segment connecting the identity icon and the first tape reel is displayed; when the second end of the first tape segment moves from the first tape reel toward the identity icon, the first tape segment connecting the identity icon and the first tape reel is no longer displayed.
[0083] In a specific application, such as Figure 8 As shown, during the playback of the voice message, the terminal will first display that the second end of the first tape segment is connected to the first tape reel, and the first end of the first tape segment moves toward the identity icon. When the first end of the first tape segment moves to the identity icon, the terminal displays the first tape segment connected to the identity icon and the first tape reel. At this time, the second end of the first tape segment is connected to the first tape reel, and the first end of the first tape segment is connected to the identity icon.
[0084] Step 208: In response to the end of voice message playback event, the first tape reel is de-displayed.
[0085] The playback end event refers to the completion of the playback of the voice message.
[0086] Specifically, during the playback of a voice message, the thickness of the first tape reel gradually decreases as the playback progresses. As the playback progresses, the thickness of the first tape reel becomes thinner and thinner. When the playback of the voice message ends, indicating that the playback progress is 100%, the thickness of the first tape reel also becomes 0. In response to the end of the voice message playback event, the terminal will cancel the display of the first tape reel.
[0087] In a specific application, such as Figure 9 As shown, during the playback of the voice message, the thickness of the first tape reel becomes thinner and thinner as the playback progresses. When the playback of the voice message ends, the thickness of the first tape reel becomes 0, and the display of the first tape reel is canceled. At this time, it will return to the state before the playback trigger event of the voice message, and the terminal will display the message bubble of the voice message and the corresponding identity icon.
[0088] The aforementioned voice message-based interaction method displays a message bubble and corresponding identity icon for the voice message. In response to a voice message playback trigger event, a first tape reel is displayed at the message bubble, triggering the playback of the voice message. This enriches the display format of voice message playback. During playback, the first tape reel rotates along with the identity icon via the first tape segment, and its thickness gradually decreases as the playback progresses. This thickness change during tape reel rotation simulates the playback progress, allowing the voice interaction object to intuitively perceive the playback progress without needing to repeatedly listen to the voice message. This reduces the number of times voice messages are repeatedly listened to, avoids continuous resource occupation, and improves resource utilization.
[0089] In one embodiment, the message bubble displaying the voice message and the corresponding identification icon includes:
[0090] In response to a voice message recording event, display an identity icon and a second tape reel, and trigger voice message recording;
[0091] During the recording of the voice message, at least one of the second tape reel or the identity icon is shown to rotate, and the thickness of the second tape reel gradually increases as the recording of the voice message progresses, and a second tape segment connecting the identity icon and the second tape reel is displayed for at least a portion of the recording process.
[0092] In response to the voice message recording end event, the display of the second tape reel is canceled, and a message bubble for the voice message is displayed.
[0093] Among them, the voice message recording event refers to the event that triggers the recording of a voice message. For example, a voice message recording event can specifically refer to the selection of a recording control. Specifically, the selection of a recording control can be one of the following: a click, a long press, or a double-click.
[0094] The second magnetic tape reel refers to the magnetic tape reel used for recording voice messages. The term "magnetic tape reel" refers to the form in which the magnetic tape is wound around the reel. The thickness of the second magnetic tape reel refers to the thickness of the magnetic tape wound on it, which is related to the duration of the voice message; the longer the message, the thicker the tape. The statement that the thickness of the second magnetic tape reel gradually increases with the progress of voice message recording means that the thickness of the second magnetic tape reel changes as the recording progresses; that is, as the recording progresses, the thickness of the second magnetic tape reel gradually increases, meaning that as the recording progresses, the amount of magnetic tape wound on the second magnetic tape reel gradually increases.
[0095] The second tape segment refers to the tape segment used to connect the identification icon and the second tape reel during the recording of the voice message. The second tape segment includes a first end and a second end. The first end of the second tape segment is used to connect the identification icon, and the second end of the second tape segment is used to connect the first tape reel.
[0096] Specifically, the terminal monitors voice message recording events in real time. Upon detecting a voice message recording event, in response to the event, it displays an identity icon and a second tape reel, and triggers voice message recording. During the recording process, the terminal displays at least one of the second tape reel or the identity icon rotating, and the thickness of the second tape reel gradually increases as the recording progresses. For at least a portion of the recording process, a second tape segment connecting the identity icon and the second tape reel is displayed. During voice message recording, the terminal monitors voice message recording completion events in real time. Upon detecting a voice message recording completion event, in response to the event, it cancels the display of the second tape reel and displays a message bubble for the voice message.
[0097] In practical applications, during voice message recording, the terminal displays a rotating identity icon while the second tape reel remains stationary. The rotation direction of the identity icon can be configured according to the actual application scenario. For example, the rotation direction can be clockwise or counterclockwise. Alternatively, during voice message recording, the terminal displays a stationary identity icon while the second tape reel rotates. The rotation direction of the second tape reel can be pre-configured according to the actual application scenario. For example, the rotation direction can be clockwise or counterclockwise. In another practical application, the terminal displays the identity icon and the second tape reel rotating simultaneously. The rotation directions of both the identity icon and the second tape reel can be pre-configured according to the actual application scenario; they can be the same or different. For example, when the identity icon and the second tape reel rotate simultaneously, the rotation can be either clockwise for the identity icon and counterclockwise for the second tape reel, or vice versa.
[0098] In specific applications, displaying the second tape segment connected to the identity icon and the second tape reel for at least a portion of the recording process means that during the recording process, when the second end of the second tape segment moves to the second tape reel and the first end of the second tape segment is connected to the identity icon, the second tape segment connected to the identity icon and the second tape reel is displayed; when the first end of the second tape segment moves from the identity icon to the second tape reel, the second tape segment connected to the identity icon and the second tape reel is no longer displayed.
[0099] In this embodiment, in response to a voice recording event, an identity icon and a second tape reel are displayed, and voice message recording is triggered. This enriches the form of voice message recording. During the recording process, the second tape reel rotates along with the identity icon, and the thickness of the second tape reel gradually increases as the recording progresses. This allows the recording progress to be simulated by the thickness change during tape reel rotation, enabling the voice interaction object to intuitively perceive the recording progress. In response to a voice message recording completion event, the display of the second tape reel is canceled, completing the voice message recording and displaying the voice message bubble.
[0100] In one embodiment, displaying an identity icon and a second tape reel in response to a voice message recording event, and triggering voice message recording includes:
[0101] In response to a voice message recording event, an identity icon and a recording bubble are displayed, the first end of the second tape segment is connected to the identity icon, the second end of the second tape segment moves from the identity icon to the recording bubble, and voice message recording is triggered.
[0102] When the second end of the second tape segment is connected to the recording bubble, the second tape reel is displayed at the recording bubble.
[0103] The recording bubble is used to indicate the start of voice message recording. It is a special effect displayed when voice message recording begins. The recording bubble includes bubble color and bubble shape. The bubble color can be configured according to the actual application scenario. In this embodiment, the bubble color is not specifically limited. For example, the bubble color can be white or green. Furthermore, users of the terminal can also pre-configure the bubble color according to their own preferences. The bubble shape can be configured according to the actual application scenario. In this embodiment, the bubble shape is not specifically limited. For example, the bubble shape can be circular, rectangular, or square. Furthermore, users of the terminal can also pre-configure the bubble shape according to their own preferences.
[0104] Specifically, in response to a voice message recording event, the terminal displays an identity icon and a recording bubble, shows that the first end of the second tape segment is connected to the identity icon, shows that the second end of the second tape segment moves from the identity icon to the recording bubble, and triggers the recording of the voice message. After the voice message recording begins, the second end of the second tape segment will continue to move towards the recording bubble. When the second end of the second tape segment is connected to the recording bubble, the terminal will display the second tape reel at the recording bubble.
[0105] In a specific application, such as Figure 10As shown, in response to a voice message recording event, the terminal displays an identity icon and a recording bubble, shows that the first end of the second tape segment is connected to the identity icon, shows that the second end of the second tape segment moves from the identity icon to the recording bubble, and triggers the recording of the voice message. After the voice message recording begins, the second end of the second tape segment will continue to move towards the recording bubble. When the second end of the second tape segment is connected to the recording bubble, the terminal will display the second tape reel at the recording bubble.
[0106] In this embodiment, in response to a voice message recording event, an identity icon and a recording bubble are displayed. The first end of the second tape segment is shown to be connected to the identity icon. The second end of the second tape segment is shown to move from the identity icon to the recording bubble and trigger the recording of the voice message. This enriches the display format when the voice message starts recording. When the second end of the second tape segment is connected to the recording bubble, the second tape reel is displayed at the recording bubble. The movement of the second end of the second tape segment can be used to simulate the start of voice message recording, so that the voice interaction object can intuitively perceive that the voice message has started recording.
[0107] In one embodiment, in response to a voice message recording end event, de-displaying the second tape reel and displaying the voice message message bubble includes:
[0108] In response to a voice message recording end event, the first end of the second tape segment is shown to move from the identity icon toward the second tape reel;
[0109] When the first end of the second tape segment moves to the second tape reel, the second tape reel is de-displayed, and a message bubble for the voice message is displayed.
[0110] The "End Voice Message Recording" event refers to the event that triggers the termination of voice message recording. For example, this event can be achieved by manipulating the recording control. Specifically, it could mean stopping touching the recording control. Another example is reselecting the recording control. Furthermore, reselecting the recording control could be achieved through a click, long press, or double-click.
[0111] Specifically, in response to the voice message recording end event, the terminal displays the first end of the second tape segment moving from the identification icon to the second tape reel. When the first end of the second tape segment reaches the second tape reel, the second tape reel is dedisplayed, and a message bubble for the voice message is displayed. In specific applications, such as... Figure 11As shown, before responding to the voice message recording end event, the terminal displays the second tape segment connected to the identity icon and the second tape reel. When the voice message recording end event is detected, the terminal responds by displaying the first end of the second tape segment moving from the identity icon to the second tape reel. When the first end of the second tape segment moves to the second tape reel, the second tape reel is de-displayed, and a message bubble for the voice message is displayed.
[0112] In this embodiment, the movement of the first end of the second magnetic tape segment can be used to simulate the end of voice message recording, so that the voice interaction object can intuitively perceive that the voice message recording has ended.
[0113] In one embodiment, during the recording of a voice message, the outer contour of the second tape reel is consistent with the outer contour of the recording bubble, a portion of the recording bubble is displayed inside the second tape reel, and the displayed portion of the recording bubble gradually decreases as the recording progresses.
[0114] Specifically, such as Figure 12 As shown, during the recording of voice messages, the outer contour of the second tape reel is consistent with the outer contour of the recording bubble. A portion of the recording bubble is displayed inside the second tape reel, and the displayed portion of the recording bubble gradually decreases as the recording progresses. That is, as the recording progress increases, a portion of the recording bubble gradually decreases.
[0115] In this embodiment, by displaying a portion of the recording bubble inside the second tape reel during the recording process of the voice message, and by gradually reducing the size of the displayed portion of the recording bubble as the recording progresses, the process of recording the voice message can be simulated, allowing the voice interaction object to intuitively perceive that the voice message is being recorded.
[0116] In one embodiment, both the second tape reel and the recording bubble are circular, and the center of the second tape reel coincides with the center of the recording bubble. Before the voice message recording begins, the second tape reel is covered by the recording bubble and is invisible. When the second end of the second tape segment is connected to the recording bubble, the radius of the recording bubble gradually decreases as the voice message recording progresses, and the second tape reel becomes visible.
[0117] Specifically, both the second tape reel and the recording bubble are circular, and the center of the second tape reel coincides with the center of the recording bubble. Before the voice message starts to be recorded, the second tape reel is covered by the recording bubble and is in an invisible state, that is, the radius of the second tape reel is equal to the radius of the recording bubble at this time. When the second section of the second tape segment is connected to the recording bubble, it indicates that the recording of the voice message is in progress, the radius of the recording bubble will gradually decrease with the recording progress of the voice message, and the second tape reel is in a visible state.
[0118] In a specific application, both the second tape reel and the recording bubble are circular, and the center of the second tape reel coincides with the center of the recording bubble. Before the voice message starts to be recorded, the second tape reel is covered by the recording bubble, and a reference circle is further covered under the second tape reel, that is, as Figure 13 shown, the icon representing the voice message is formed by superimposing three circular elements, which are the reference circle, the second tape reel and the recording bubble, with radii of R1, R2 and R3 respectively. By reducing the radius of the recording bubble, the displayed partial area of the second tape reel is increased, so as to simulate the increase of the thickness of the second tape reel.
[0119] In a specific application, before the voice message starts to be recorded, the radii of the three circular elements (the recording bubble, the second tape reel, and the reference circle) are R1, R2, and R3 respectively, and R1=R2=R3. At this time, the second tape reel is covered by the recording bubble and is in an invisible state. When the voice message starts to be recorded, the first end of the second tape segment is displayed to be connected to the identity identifier icon, the second end of the second tape segment is displayed to move from the identity identifier icon to the recording bubble, and the recording of the voice message is triggered. After the voice message starts to be recorded, the second end of the second tape segment will continuously move towards the recording bubble. When the second end of the second tape segment is connected to the recording bubble, that is, the second end of the second tape segment reaches the icon representing the voice message, the terminal starts to display an animation in which the radius of the recording bubble gradually decreases with the recording progress of the voice message, and the second tape reel is in a visible state.
[0120] In a specific application, the gradual decrease of the radius R1 of the recording bubble with the recording progress of the voice message can be quantified through the reference circle (with a radius of R3). Specifically, the recording time can be divided into several intervals in advance, and the length of R1 is in different ranges in different time intervals. For example, when the recording time is less than 10 seconds, it may correspond to R1>=2 / 3×R3; when the recording time is greater than or equal to 10 seconds and less than 20 seconds, it may correspond to 1 / 3×R3<=R1<2 / 3×R3; when the recording time is greater than or equal to 20 seconds and less than or equal to 60 seconds, it may correspond to 0<R1<1 / 3×R3; when the recording time is greater than 60 seconds, it may correspond to R1=0.
[0121] In this embodiment, the thickness of the second magnetic tape reel gradually increases as the recording progresses, allowing the voice interaction object to intuitively perceive the recording progress.
[0122] In one embodiment, during the recording of a voice message, the center of the second tape reel coincides with the center of the recording bubble, and the outer contour of the second tape reel gradually expands toward the outer contour of the recording bubble as the recording progresses.
[0123] Specifically, such as Figure 14 As shown, during the recording of the voice message, the center of the second tape reel is aligned with the center of the recording bubble, and the outer contour of the second tape reel gradually expands toward the outer contour of the recording bubble as the recording progresses. That is, as the recording progress increases, the thickness of the second tape reel gradually increases.
[0124] In this embodiment, the process of recording voice messages can be simulated by gradually increasing the thickness of the second magnetic tape reel as the recording progresses, so that the voice interaction object can intuitively perceive that the voice message is being recorded.
[0125] In one embodiment, the voice message-based interaction method further includes:
[0126] During the recording of a voice message, a voice recording icon that covers part of the identity icon is added to the identity icon and displayed. In response to the voice message recording end event, the voice recording icon is removed from display.
[0127] The voice recording icon is an icon that indicates that a voice message is being recorded. For example, the voice recording icon can be a lip icon, indicating that the voice interaction object is inputting a voice message.
[0128] Specifically, such as Figure 15 As shown, during the recording of a voice message, the terminal adds a voice recording icon that covers part of the identity icon to the identity icon. The voice recording icon is displayed to indicate that the recording of the voice message is in progress. When the recording of the voice message ends, in response to the voice message recording end event, the voice recording icon is removed from the display to indicate that the recording of the voice message has ended.
[0129] In this embodiment, by adding a voice recording icon that covers part of the identity icon on the identity icon during the voice message recording process, the voice recording icon can be displayed intuitively to show that the voice message recording is in progress. By canceling the display of the voice recording icon in response to the voice message recording end event, the voice message recording can be displayed intuitively to show that the voice message recording has ended.
[0130] In one embodiment, the voice message-based interaction method further includes:
[0131] When the recorded voice message reaches the maximum duration, the second tape reel completely covers the recording bubble, triggering the voice message recording end event.
[0132] Specifically, the terminal will track the recording duration of voice messages in real time. When the recorded voice message reaches the maximum duration, the terminal will display a message indicating that the second tape reel has completely covered the recording bubble, triggering a voice message recording end event. The maximum duration can be configured according to the actual application scenario. For example, the maximum duration can be one minute; that is, when the recorded voice message reaches one minute, the terminal will display a message indicating that the second tape reel has completely covered the recording bubble, triggering a voice message recording end event.
[0133] In this embodiment, when the recorded voice message reaches the upper limit of the message duration, the second tape reel completely covers the recording bubble, triggering the voice message recording end event. This can effectively control the message duration of the voice message, avoid the situation of repeatedly listening to the voice message due to the excessive message duration, reduce the number of times the voice message is repeatedly listened to, avoid continuous occupation of resources, and improve resource utilization.
[0134] In one embodiment, displaying a first tape reel at a message bubble and triggering playback of the voice message in response to a playback trigger event of a voice message includes:
[0135] In response to the playback trigger event of a voice message, the first tape reel is displayed in the message bubble, the second end of the first tape segment is connected to the first tape reel, the first end of the first tape segment moves toward the identity icon, and the playback of the voice message is triggered.
[0136] Specifically, the terminal monitors voice message playback trigger events in real time. Upon detecting a playback trigger event, in response, it displays the first tape reel in the message bubble, shows the second end of the first tape segment connected to the first tape reel, displays the first end of the first tape segment moving towards the identity icon, and triggers the playback of the voice message. In practical applications, during voice message playback, the first end of the first tape segment continuously moves towards the identity icon as playback progresses. When the first end of the first tape segment reaches the identity icon, it displays the first tape segment connecting the identity icon and the first tape reel.
[0137] In a specific application, in response to the playback trigger event of a voice message, the terminal will display the first tape reel in the message bubble, show the second end of the first tape segment connected to the first tape reel, show the first end of the first tape segment moving towards the identity icon, and trigger the playback of the voice message. During the playback of the voice message, the first end of the first tape segment will continue to move towards the identity icon as the playback progresses. When the first end of the first tape segment moves to the identity icon, the first tape segment connected to the identity icon and the first tape reel will be displayed.
[0138] In this embodiment, in response to the playback trigger event of the voice message, the first tape reel is displayed at the message bubble, the second end of the first tape segment is displayed as connected to the first tape reel, the first end of the first tape segment is displayed as moving toward the identity icon, and the playback of the voice message is triggered. This can enrich the display form when the voice message starts playing, so that the voice interaction object can intuitively perceive that the voice message has started playing.
[0139] In one embodiment, the voice message-based interaction method further includes:
[0140] In response to the end of voice message playback event, as the first tape reel is dedisplayed, the second end of the first tape segment is moved from the first tape reel toward the identity icon until the second end of the first tape segment moves to the identity icon, at which point the first tape segment is dedisplayed.
[0141] The playback end event refers to the event that triggers the end of playback of a voice message. For example, the playback end event could specifically mean that the voice message has finished playing.
[0142] Specifically, in response to the end of voice message playback, the terminal cancels the display of the first tape reel, and the second end of the first tape reel moves from the first tape reel towards the identification icon until the second end of the first tape segment reaches the identification icon, at which point the display of the first tape segment is canceled. In specific applications, such as... Figure 16 As shown, before responding to the playback end event of the voice message, the terminal displays the first tape segment connecting the identity icon and the first tape reel. When the playback end event of the voice message is detected, the terminal responds to the playback end event by canceling the display of the first tape reel and moving the second end of the first tape segment from the first tape reel toward the identity icon until the second end of the first tape segment moves to the identity icon, at which point the display of the first tape segment is canceled.
[0143] In this embodiment, as the first tape reel is de-displayed, the movement of the second end of the first tape segment can simulate the end of the playback of a voice message, allowing the voice interaction object to intuitively perceive that the playback of the voice message has ended.
[0144] In one embodiment, during the playback of a voice message, the outer contour of the first tape reel is consistent with the outer contour of the message bubble, a portion of the message bubble is displayed inside the first tape reel, and the displayed portion of the message bubble gradually increases in size as the playback progresses.
[0145] Specifically, such as Figure 17 As shown, during the playback of the voice message, the outer contour of the first tape reel is consistent with the outer contour of the message bubble. A portion of the message bubble is displayed inside the first tape reel, and the displayed portion of the message bubble gradually increases in size as the playback progresses. That is, as the playback progress increases, a portion of the message bubble gradually increases in size.
[0146] In this embodiment, by displaying a portion of a message bubble inside the first tape reel during the recording of the voice message, and by gradually increasing the size of the displayed message bubble as the playback progresses, the process of playing the voice message can be simulated, allowing the voice interaction object to intuitively perceive that the voice message is being played.
[0147] In one embodiment, both the first tape reel and the message bubble are circular, and the center of the first tape reel coincides with the center of the message bubble; when the first tape reel is displayed at the message bubble, the radius of the message bubble gradually decreases, and the degree of decrease in the radius of the message bubble is positively correlated with the message duration of the voice message; when the first end of the first tape segment is connected to the identity icon, the radius of the message bubble gradually increases as the playback progress of the voice message continues.
[0148] Specifically, both the first tape reel and the message bubble are circular, with the center of the first tape reel coinciding with the center of the message bubble. Before the first tape reel is displayed at the message bubble, it is covered by the message bubble and is invisible; that is, at this time, the radius of the first tape reel is equal to the radius of the message bubble. When the first tape reel is displayed at the message bubble, its radius gradually decreases, and the degree of decrease is positively correlated with the duration of the voice message. At this time, the first tape reel becomes visible, and its thickness is positively correlated with the duration of the voice message. When the first end of the first tape segment is connected to the identity icon, the radius of the message bubble gradually increases as the voice message plays. That is, during the playback of the voice message, the radius of the message bubble gradually increases, and as the radius of the message bubble gradually increases, the thickness of the first tape reel gradually decreases.
[0149] In specific applications, both the first tape reel and the message bubble are circular, and the center of the first tape reel coincides with the center of the message bubble. Before the first tape reel is displayed at the message bubble, the first tape reel is covered by the message bubble, and a reference circle is further covered under the first tape reel, that is, as Figure 18 shown in the figure, the icon representing the voice message is formed by superimposing three circular elements, which are the reference circle, the first tape reel and the message bubble, with radii of R1, R2 and R3 respectively. By reducing the radius of the message bubble, the displayed partial area of the first tape reel is increased, so as to simulate the increase of the thickness of the first tape reel. By increasing the radius of the message bubble, the displayed partial area of the first tape reel is increased, so as to simulate the decrease of the thickness of the first tape reel.
[0150] In a specific application, before the first tape reel is displayed at the message bubble, the radii of the three circular elements (the message bubble, the first tape reel, and the reference circle) are R1, R2, and R3 respectively, and R1=R2=R3. At this time, the first tape reel is covered by the message bubble and is in an invisible state. When the first tape reel is displayed at the message bubble, the radius of the message bubble gradually decreases, and the reduction degree of the radius of the message bubble is positively correlated with the message duration of the voice message. At this time, the first tape reel is in a visible state, and the thickness of the first tape reel is positively correlated with the message duration of the voice message (when the message duration of the voice message reaches the upper limit of the message duration, R1=0). When the first end of the first tape segment is connected to the identity icon, that is, the first end of the first tape segment reaches the icon representing the voice message, the terminal starts to display an animation in which the radius of the message bubble gradually increases with the playback progress of the voice message. That is, during the playback of the voice message, the radius of the message bubble gradually increases with the playback progress of the voice message, and as the radius of the message bubble gradually increases, the thickness of the first tape reel gradually decreases.
[0151] In a specific application, the positive correlation between the reduction degree of the radius R1 of the message bubble and the message duration of the voice message can be quantified through the reference circle (with a radius of R3). Specifically, the message duration can be divided into several intervals in advance, and the length of R1 is in different ranges in different time intervals. For example, when the message duration is less than 10 seconds, it may correspond to R1>=2 / 3×R3; when the message duration is greater than or equal to 10 seconds and less than 20 seconds, it may correspond to 1 / 3×R3<=R1<2 / 3×R3; when the message duration is greater than or equal to 20 seconds and less than or equal to 60 seconds, it may correspond to 0<R1<1 / 3×R3; when the message duration is greater than 60 seconds, it may correspond to R1=0.
[0152] In a specific application, the gradual increase of the radius R1 of the message bubble along with the playback progress of the voice message can be quantified by a reference circle (with a radius of R3). Specifically, the remaining playback duration can be divided into several intervals in advance, and the length of R1 falls in different ranges in different time intervals. For example, when the remaining playback duration is less than 10 seconds, R1 may correspond to R1>=2 / 3×R3; when the remaining playback duration is greater than or equal to 10 seconds and less than 20 seconds, R1 may correspond to 1 / 3×R3<=R1<2 / 3×R3; when the remaining playback duration is greater than or equal to 20 seconds and less than or equal to 60 seconds, R1 may correspond to 0<R1<1 / 3×R3; when the remaining playback duration is greater than 60 seconds, R1 may correspond to R1=0.
[0153] In this embodiment, when the voice message is played, the thickness of the first tape reel can be gradually reduced along with the playback progress of the voice message, so that the voice interaction object can intuitively perceive the playback progress.
[0154] In an embodiment, during the playback of the voice message, the center of the first tape reel coincides with the center of the message bubble, and the outer contour of the first tape reel gradually shrinks toward the center of the message bubble along with the playback progress.
[0155] Specifically, as shown in Figure 19 , during the playback of the voice message, the center of the first tape reel coincides with the center of the message bubble, and the outer contour of the first tape reel gradually shrinks toward the center of the message bubble along with the playback progress, that is, as the playback progress increases, the thickness of the first tape reel gradually decreases.
[0156] In this embodiment, the process of playing the voice message can be simulated by the gradual reduction of the thickness of the first tape reel along with the playback progress, so that the voice interaction object can intuitively perceive that the voice message is being played.
[0157] In an embodiment, when the playback of the voice message is triggered, the thickness of the first tape reel is linearly and positively correlated with the message duration of the voice message.
[0158] Specifically, when the playback of the voice message is triggered, the thickness of the first tape reel is linearly and positively correlated with the message duration of the voice message, that is, the longer the message duration of the voice message is, the thicker the thickness of the first tape reel is, and the shorter the message duration of the voice message is, the thinner the thickness of the first tape reel is. In a specific application, since the thickness of the first tape reel is linearly and positively correlated with the message duration of the voice message, the thickness of the first tape reel can be determined through the proportional relationship between the message duration of the voice message and the maximum message duration.
[0159] In this embodiment, the thickness of the first tape reel is linearly and positively correlated with the message duration of the voice message, which can realize the determination of the thickness of the first tape reel by using the message duration of the voice message.
[0160] In one embodiment, when the duration of a voice message is the maximum message duration, the first tape reel completely covers the message bubble when the playback of the voice message is triggered.
[0161] Specifically, when the duration of a voice message is the maximum allowed duration, the first tape reel completely covers the message bubble when playback is triggered, meaning the message bubble is invisible. In practical applications, when the duration of a voice message is the maximum allowed duration, the radius of the message bubble gradually decreases to zero when playback is triggered, so that the first tape reel is fully displayed and covers the message bubble. The maximum allowed duration can be configured according to the actual application scenario. For example, the maximum allowed duration could be one minute.
[0162] In this embodiment, when the duration of a voice message is the upper limit of the message duration, the first tape reel completely covers the message bubble when the voice message is triggered to play, thus enabling the display of the corresponding first tape reel when the message duration is the upper limit of the message duration.
[0163] In one embodiment, the voice message-based interaction method further includes:
[0164] During the playback of a voice message, a voice playback icon that partially covers the identity icon is added to the identity icon and displayed. In response to the end of the voice message playback event, the voice playback icon is removed from display.
[0165] The voice playback icon is an icon that indicates that a voice message is being played. For example, the voice playback icon can be an ear icon, indicating that the voice interaction object is listening to a voice message.
[0166] Specifically, such as Figure 20 As shown, during the playback of a voice message, the terminal adds a voice playback icon that covers part of the identity icon to the identity icon. The voice playback icon is displayed to indicate that the voice message is playing. When the voice message playback ends, in response to the voice message playback end event, the voice playback icon is removed to indicate that the voice message playback has ended.
[0167] In this embodiment, by adding a voice playback icon that covers part of the identity icon on the identity icon during the playback of the voice message, the playback of the voice message can be intuitively shown to be in progress. By canceling the display of the voice playback icon in response to the end event of the voice message playback, the playback of the voice message can be intuitively shown to be finished.
[0168] In one embodiment, the voice message-based interaction method further includes:
[0169] Display a numerical icon corresponding to the duration of the voice message in the message bubble;
[0170] During the playback of the voice message, a number icon is displayed that changes in number, and the number within the number icon gradually decreases as the voice message progresses.
[0171] Specifically, before a voice message is played, the terminal displays a numerical icon corresponding to the message duration in the message bubble. The number in the icon is positively correlated with the message duration. During the playback of the voice message, the terminal displays a changing numerical icon, with the number gradually decreasing as the playback progresses. In practical applications, when the message duration is below the maximum duration, the displayed numerical icon shows the same number as the message duration; when the message duration reaches the maximum duration, the displayed numerical icon shows the same number as the maximum duration.
[0172] In a specific application, such as Figure 21 As shown, before the voice message is played, a number icon corresponding to the duration of the voice message will be displayed in the message bubble. During the playback of the voice message, the terminal will display a number icon that changes in number, and the number in the number icon will gradually decrease as the playback progresses. That is, the greater the playback progress, the smaller the number in the number icon. In this way, the playback countdown is realized through the number in the number icon.
[0173] In this embodiment, by displaying a number icon that changes in number, and the number within the changing number icon gradually decreases as the voice message plays, a countdown to the voice playback can be achieved through the number within the changing number icon, allowing the voice interaction object to intuitively perceive the playback progress of the voice message.
[0174] In one embodiment, the playback trigger event includes a speed-up playback event; responding to the playback trigger event of the voice message, displaying the first tape reel at the message bubble and triggering the playback of the voice message includes:
[0175] In response to a playback speed event of a voice message, the first tape reel is displayed in the message bubble, and the voice message is played at the corresponding playback speed according to the playback speed event.
[0176] The "play speed adjustment" event refers to the event that triggers the playback of a voice message at an increased speed, which can be achieved through operations on the message bubble. For example, the play speed adjustment event can be achieved by clicking, long-pressing, or double-tapping the message bubble.
[0177] Specifically, the terminal will monitor the playback speed of voice messages in real time. When a playback speed event is detected, the terminal will respond to the playback speed event by displaying the first tape reel in the message bubble and playing the voice message at the corresponding playback speed event.
[0178] In this embodiment, the system can respond to the speed-up playback event and enable the playback of voice messages at a faster speed.
[0179] In one embodiment, the voice message-based interaction method further includes:
[0180] During the playback of a voice message, in response to the playback speed increase event of the voice message, the first tape reel is displayed at the message bubble, and the voice message is played at the corresponding playback speed increase event.
[0181] Specifically, during the playback of voice messages, the terminal will also monitor the playback speed of voice messages in real time. When a playback speed event is detected, the terminal will respond to the playback speed event by displaying the first tape reel in the message bubble and playing the voice message at the corresponding playback speed event.
[0182] In this embodiment, the system can respond to a speed-up playback event during the playback of voice messages to enable speed-up playback of voice messages.
[0183] In one embodiment, responding to a playback speed-up event of a voice message, displaying a first tape reel at the message bubble, and playing the voice message at the corresponding playback speed-up event includes:
[0184] In response to the playback speed increase event of a voice message, the first tape reel is displayed in the message bubble, and the callback function of the playback speed increase event is called to modify the voice playback speed attribute through the callback function.
[0185] The voice message will be played at the appropriate speed according to the modified voice playback speed attribute.
[0186] In this context, a callback function is a function passed as a parameter, typically implemented using a function pointer. Callback functions allow a pointer to a function to be called to be passed as an argument, enabling the function to flexibly use different methods when handling similar events. Specifically, the party providing the function implementation registers the callback function's pointer with the caller during initialization. When a specific event or condition occurs, the caller uses the function pointer to invoke the callback function to handle the event. In this embodiment, the callback function's pointer is registered with the terminal. When the playback speed adjustment event occurs, the terminal uses the function pointer to invoke the callback function to handle the playback speed adjustment event.
[0187] Specifically, in response to the playback speed adjustment event of a voice message, the terminal displays the first tape reel in the message bubble and calls the callback function of the playback speed adjustment event. The callback function modifies the voice playback speed attribute to adjust the playback speed, and the voice message is played at the corresponding speed according to the modified attribute. In practical applications, the playback speed adjustment event can be a 2x speed event, a 3x speed event, a 0.5x speed event, etc. This embodiment does not specifically limit the speed of the playback speed adjustment event.
[0188] In a specific application, the playback speed event can be a double-speed playback event. When the terminal responds to the double-speed playback event of the voice message, it displays the first tape reel in the message bubble and calls the callback function of the playback speed event. The callback function modifies the voice playback speed attribute playbackRate to 2 so that the voice message is played at double speed.
[0189] In this embodiment, the callback function of the speed-up playback event is called, and the voice playback speed attribute is modified through the callback function, so that the voice message can be played at the corresponding playback speed according to the modified voice playback speed attribute.
[0190] In one embodiment, the playback trigger event includes a voice location event. Responding to the playback trigger event of the voice message, displaying the first tape reel at the message bubble and triggering the playback of the voice message includes:
[0191] In response to a voice location event in a voice message, the first tape reel and the current playback progress are displayed in the message bubble;
[0192] In response to a playback progress adjustment event for a voice message, display the location playback progress indicated by the playback progress adjustment event in the message bubble;
[0193] Trigger playback of the voice message starting from the location playback progress.
[0194] Voice location events refer to events that locate and play voice messages, which can be triggered by operations on message bubbles. For example, operations on message bubbles can specifically include clicking, long-pressing, and double-tapping. Playback progress adjustment events refer to events that adjust the playback progress of voice messages. For example, a playback progress adjustment event can specifically adjust the playback progress forward, i.e., play the part that has not yet been played. Alternatively, a playback progress adjustment event can specifically adjust the playback progress backward, i.e., play the part that has already been played. For example, when the current playback progress is 0″, the playback progress adjustment event can only be an event that adjusts the playback progress forward; when the current playback progress is not 0″, the playback progress adjustment event can be an event that adjusts the playback progress forward or backward.
[0195] Specifically, the terminal will monitor the voice location event of the voice message in real time. When the voice location event of the voice message is detected, the terminal will display the first tape reel and the current playback progress in the message bubble in response to the voice location event. In response to the playback progress adjustment event of the voice message, the terminal will display the location playback progress indicated by the playback progress adjustment event in the message bubble, and trigger the playback of the voice message from the location playback progress of the voice message.
[0196] In specific applications, such as Figure 22 As shown, before playing a voice message, when a voice location event of the voice message is detected, the terminal responds to the voice location event by displaying the first tape reel and the current playback progress (i.e., ...) in the message bubble. Figure 22 In response to a playback progress adjustment event for a voice message, the 0″ in the message bubble indicates the current playback progress (i.e., the position of the playback progress as indicated by the playback progress adjustment event). Figure 22 (2.5″) triggers the playback of the voice message from the location playback progress.
[0197] In this embodiment, in response to the voice positioning event of the voice message, the first tape reel and the current playback progress are displayed in the message bubble, which allows the voice interaction object to intuitively perceive the current playback progress and make adjustments from the current playback progress. By responding to the playback progress adjustment event of the voice message, the positioning playback progress indicated by the playback progress adjustment event is displayed in the message bubble, which allows the voice interaction object to intuitively perceive the positioning playback progress. By triggering the playback of the voice message from the positioning playback progress of the voice message, the positioning playback of the voice message can be realized.
[0198] In one embodiment, the voice message-based interaction method further includes:
[0199] During the playback of a voice message, in response to the voice location event of the voice message, the first tape reel and the current playback progress are displayed in the message bubble;
[0200] In response to a playback progress adjustment event for a voice message, display the location playback progress indicated by the playback progress adjustment event in the message bubble;
[0201] Trigger playback of the voice message starting from the location playback progress.
[0202] Specifically, during the playback of a voice message, the terminal monitors the voice location event of the voice message in real time. When a voice location event is detected, the terminal displays the first tape reel and the current playback progress in the message bubble in response to the voice location event. In response to the playback progress adjustment event of the voice message, the terminal displays the location playback progress indicated by the playback progress adjustment event in the message bubble, triggering the playback of the voice message from the location playback progress of the voice message.
[0203] In one embodiment, the voice message-based interaction method further includes:
[0204] In response to touch events on message bubbles, record the trigger duration of the corresponding touch point;
[0205] When the trigger duration reaches the duration threshold, and the touch point remains stationary within the trigger duration, the voice location event of the voice message is triggered.
[0206] Specifically, the terminal monitors touch events targeting message bubbles in real time. When a touch event is detected, it begins recording the trigger duration of the corresponding touch point. When the trigger duration reaches a threshold, and the touch point remains stationary (i.e., there is no movement) within that duration, a voice location event for the voice message is triggered. The duration threshold can be configured according to the actual application scenario.
[0207] In practical applications, the terminal responds to the touch event of the message bubble, marks the touch start state as true, and records the first current timestamp startTime, which marks the start of recording the touch duration of the touch point corresponding to the touch event. When the trigger duration reaches a duration threshold (i.e., the duration difference between the second current timestamp nowTime and the first current timestamp startTime reaches the duration threshold), and the touch point remains stationary within the trigger duration (i.e., no touch movement event is detected), then the voice location event of the voice message is triggered. In a specific application, the terminal has a pre-configured callback function for the corresponding voice location event. The terminal can trigger the voice location event of the voice message by calling the corresponding callback function.
[0208] In this embodiment, by responding to a touch event on a message bubble and recording the trigger duration of the corresponding touch point, accurate triggering of the voice location event for the voice message can be achieved when the trigger duration reaches a duration threshold and the touch point remains stationary within the trigger duration.
[0209] In one embodiment, in response to a playback progress adjustment event for a voice message, displaying the positioning playback progress indicated by the playback progress adjustment event at the message bubble includes:
[0210] In response to a playback progress adjustment event for a voice message, obtain the progress adjustment position;
[0211] Based on the initial position corresponding to the current playback progress, the center point position of the message bubble, and the progress adjustment position, obtain the movement angle of the progress adjustment position relative to the initial position;
[0212] The location playback progress of the playback progress adjustment event indicator is determined based on the movement angle and the duration of the voice message.
[0213] The playback progress is displayed in the message bubble, indicating the location of the playback progress adjustment event.
[0214] Here, "progress adjustment position" refers to the location of the progress adjustment point, "initial position" refers to the current playback progress position, and "center point position" refers to the center of the message bubble. All these positions are relative to the pre-configured origin. The pre-configured origin can be configured according to the actual application scenario. For example, the pre-configured origin can be the top left corner of the terminal display interface. "Movement angle" refers to the actual adjustment angle of the progress adjustment position relative to the initial position, centered on the center point, and corresponds to the playback progress adjustment event.
[0215] Specifically, in response to a playback progress adjustment event for a voice message, the terminal obtains the position of the progress adjustment touch point (i.e., the progress adjustment position) based on a pre-configured origin, and obtains the initial position and the center position of the message bubble corresponding to the current playback progress based on the pre-configured origin. Based on the initial position, the center position of the message bubble, and the progress adjustment position, the terminal calculates the movement angle of the progress adjustment position relative to the initial position. According to the movement angle and the duration of the voice message, the terminal determines the location playback progress indicated by the playback progress adjustment event and displays the location playback progress indicated by the playback progress adjustment event at the message bubble.
[0216] In a specific application, such as Figure 23 As shown, when the pre-configured origin is the top left corner of the terminal display interface, the progress adjustment position (x1, y1), the initial position of the current playback progress (x2, y2), and the center point position of the message bubble (x3, y3) can be obtained based on the pre-configured origin.
[0217] In this embodiment, by responding to the playback progress adjustment event of the voice message, the progress adjustment position is obtained. Based on the initial position corresponding to the current playback progress, the center point position of the message bubble, and the progress adjustment position, the movement angle of the progress adjustment position relative to the initial position can be obtained. Then, based on the movement angle and the message duration of the voice message, the positioning playback progress indicated by the playback progress adjustment event can be determined, so that the positioning playback progress indicated by the playback progress adjustment event can be displayed at the message bubble.
[0218] In one embodiment, in response to a playback progress adjustment event for a voice message, obtaining the progress adjustment position includes:
[0219] In response to a playback progress adjustment event for a voice message, record the corresponding touch point movement trajectory.
[0220] In response to the end of the progress adjustment event for a voice message, the last touch point in the touch point movement trajectory is used as the progress adjustment position.
[0221] Specifically, in response to a playback progress adjustment event for a voice message, the terminal begins recording the corresponding touch point movement trajectory. In response to a completion event for the playback progress adjustment, the last touch point in the trajectory is used as the adjustment position. In a specific application, during playback progress adjustment, the voice interaction object drags a message bubble on the terminal, and the terminal begins recording the corresponding touch point movement trajectory, using the last touch point as the adjustment position. In a specific application, when the current playback progress is 0″, the voice interaction object can drag the message bubble clockwise; that is, the playback progress adjustment event can only adjust the playback progress forward. When the current playback progress is not 0″, the voice interaction object can drag the message bubble clockwise or counterclockwise; that is, the playback progress adjustment event can adjust the playback progress forward or backward.
[0222] In this embodiment, by responding to the playback progress adjustment event of the voice message and recording the corresponding touch point movement trajectory, the last touch point in the touch point movement trajectory can be used as the progress adjustment position when the progress adjustment ends, thereby determining the progress adjustment position.
[0223] In one embodiment, obtaining the movement angle of the progress adjustment position relative to the initial position based on the current playback progress's initial position, the center point position of the message bubble, and the progress adjustment position includes:
[0224] Based on the initial position corresponding to the current playback progress, the center point position of the message bubble, and the progress adjustment position, obtain the relative angle of the progress adjustment position relative to the initial position;
[0225] Compare the first coordinate of the center point position with the second coordinate of the progress adjustment position to determine the quadrant in which the progress adjustment position is located, with the center point position as the center of the quadrant.
[0226] Based on the quadrant and relative angle of the progress adjustment position, the angle of movement of the progress adjustment position relative to the initial position is obtained.
[0227] The relative angle refers to the angular difference between the progress adjustment position and the initial position, with the center point as the center. Specifically, it's the angular difference between the first line connecting the initial position and the center point, and the second line connecting the center point and the progress adjustment position. The first coordinate of the center point refers to the coordinates of the center point determined based on the pre-configured origin, including coordinates along two axes (horizontal and vertical). The second coordinate of the progress adjustment position refers to the coordinates of the progress adjustment position determined based on the pre-configured origin, including coordinates along two axes (horizontal and vertical).
[0228] In a Cartesian coordinate system, quadrants are four regions divided by the horizontal and vertical axes. Each region is called a quadrant. The origin is the center of each quadrant, and the x and y axes are the dividing lines. The upper right quadrant is called the first quadrant, the upper left quadrant the second quadrant, the lower left quadrant the third quadrant, and the lower right quadrant the fourth quadrant. In this embodiment, the quadrant is determined by the center point, with the x and y axes extending from the center point as the dividing lines.
[0229] Specifically, the terminal calculates the relative angle of the progress adjustment position with respect to the initial position based on the current playback progress, the center point position of the message bubble, and the progress adjustment position using the law of cosines. Then, it compares the coordinates of the same axis in the first coordinate of the center point position and the second coordinate of the progress adjustment position to obtain the comparison result. Based on the comparison result, it determines the quadrant in which the progress adjustment position is located. Finally, based on the quadrant in which the progress adjustment position is located and the relative angle, it obtains the movement angle of the progress adjustment position relative to the initial position.
[0230] In practical applications, the first coordinate includes a first horizontal coordinate and a first vertical coordinate, and the second coordinate includes a second horizontal coordinate and a second vertical coordinate. The terminal compares the first horizontal coordinate and the second horizontal coordinate, as well as the first vertical coordinate and the second vertical coordinate, to obtain the comparison results. Based on the comparison results, the quadrant in which the progress adjustment position is located can be determined.
[0231] In a specific application, such as Figure 24As shown, when the first x-coordinate is less than the second x-coordinate and the first y-coordinate is greater than the second y-coordinate, the quadrant where the schedule adjustment is located can be determined as the first quadrant. When the first x-coordinate is greater than the second x-coordinate and the first y-coordinate is greater than the second y-coordinate, the quadrant where the schedule adjustment is located can be determined as the second quadrant. When the first x-coordinate is greater than the second x-coordinate and the first y-coordinate is less than the second y-coordinate, the quadrant where the schedule adjustment is located can be determined as the third quadrant. When the first x-coordinate is less than the second x-coordinate and the first y-coordinate is less than the second y-coordinate, the quadrant where the schedule adjustment is located can be determined as the fourth quadrant.
[0232] In this embodiment, based on the initial position corresponding to the current playback progress, the center point position of the message bubble, and the progress adjustment position, the relative angle of the progress adjustment position relative to the initial position can be obtained. By comparing the first coordinate of the center point position and the second coordinate of the progress adjustment position, the quadrant in which the progress adjustment position is located can be determined. Then, by combining the quadrant in which the progress adjustment position is located and the relative angle, the accurate determination of the movement angle of the progress adjustment position relative to the initial position can be achieved.
[0233] In one embodiment, obtaining the relative angle of the progress adjustment position relative to the initial position based on the current playback progress's initial position, the center point position of the message bubble, and the progress adjustment position includes:
[0234] Obtain the first distance between the initial position corresponding to the current playback progress and the center point of the message bubble, the second distance between the progress adjustment position and the center point, and the third distance between the progress adjustment position and the initial position;
[0235] Based on the first distance, the second distance, and the third distance, the relative angle between the progress adjustment position and the initial position is obtained.
[0236] Specifically, the terminal obtains the first distance between the initial position corresponding to the current playback progress and the center point of the message bubble, the second distance between the progress adjustment position and the center point, and the third distance between the progress adjustment position and the initial position. Based on the first, second, and third distances and the law of cosines, it obtains the relative angle between the progress adjustment position and the initial position. The law of cosines is a mathematical theorem describing the relationship between the lengths of the three sides of a triangle and the cosine of an angle. That is, for any triangle, the square of any side is equal to the sum of the squares of the other two sides minus twice the product of those two sides and the cosine of the angle between them.
[0237] In practical applications, the terminal can obtain the first distance between the initial position and the center point of the message bubble, the second distance between the progress adjustment position and the center point, and the third distance between the progress adjustment position and the initial position, based on the first coordinate of the center point, the second coordinate of the progress adjustment position, and the third coordinate of the initial position. In a specific application, such as... Figure 25 As shown in the figure, the first coordinate is (cen[0], cen[1]), the second coordinate is (end[0], end[1]), and the third coordinate is (start[0], start[1]). It can be seen from the figure that the first distance Where f_c_x = start[0] - cen[0], f_c_y = cen[1] - start[1]. Second distance Where s_c_x = end[0] - cen[0], s_c_y = cen[1] - end[1], and the third distance
[0238] In practical applications, the relative angle is the cosine angle that needs to be calculated. It is the angle difference between the first line connecting the initial position and the center point position, and the second line connecting the center point position and the progress adjustment position. The terminal will determine the calculation formula for the relative angle based on the law of cosines, and then substitute the first, second, and third distances into the formula to obtain the relative angle. In a specific application, such as... Figure 25 As shown, the first distance is a, the second distance is b, and the third distance is c. The relative angle θ is the angle between a and b. The formula for calculating the corresponding relative angle is: By substituting the formulas for calculating the first, second, and third distances and simplifying them, we can obtain the formula for calculating the relative angle as θ = Math.acos((f_c_x*s_c_x+f_c_y*s_c_y) / d), where d = Math.sqrt(f_c_x*f_c_x+f_c_y*f_c_y)*Math.sqrt(s_c_x*s_c_x+s_c_y*s_c_y), and Math.acos() represents the inverse cosine function.
[0239] In this embodiment, by obtaining the first distance, the second distance, and the third distance, the relative angle of the progress adjustment position relative to the initial position can be calculated based on the first distance, the second distance, and the third distance.
[0240] In one embodiment, obtaining the movement angle of the progress adjustment position relative to the initial position based on the quadrant and relative angle of the progress adjustment position includes:
[0241] When the progress adjustment position is located in the first or fourth quadrant, the relative angle is used as the movement angle of the progress adjustment position relative to the initial position.
[0242] Specifically, when the progress adjustment position is located in the first or fourth quadrant, the terminal will directly use the relative angle as the movement angle of the progress adjustment position relative to the initial position.
[0243] In one embodiment, obtaining the movement angle of the progress adjustment position relative to the initial position based on the quadrant and relative angle of the progress adjustment position includes:
[0244] When the progress adjustment position is located in the second or third quadrant, the angle difference between the pre-configured angle and the relative angle is used as the movement angle of the progress adjustment position relative to the initial position.
[0245] Specifically, when the progress adjustment position is located in the second or third quadrant, the terminal will use the angle difference between the pre-configured angle and the relative angle as the movement angle of the progress adjustment position relative to the initial position. The pre-configured angle is 2π.
[0246] In one embodiment, the voice message-based interaction method further includes:
[0247] During the playback of a voice message, in response to a playback interruption event, an identity icon and a first tape reel are displayed, and the thickness of the first tape reel is positively correlated with the duration of the voice message, triggering the cessation of voice message playback.
[0248] The playback interruption event refers to the event where the terminal plays a voice message, which can be triggered by operations on the message bubble. For example, operations on the message bubble can specifically refer to one of the following: a click operation, a long press operation, or a double-click operation.
[0249] Specifically, during the playback of voice messages, the terminal monitors for playback interruption events in real time. When an interruption event is detected, the terminal displays an identity icon and a first tape reel in response. The thickness of the first tape reel is positively correlated with the duration of the voice message, and playback of the voice message is stopped. In practical applications, the thickness of the first tape reel is linearly positively correlated with the duration of the voice message.
[0250] In this embodiment, during the playback of a voice message, in response to an interruption event, an identity icon and a first tape reel are displayed, and the thickness of the first tape reel is positively correlated with the duration of the voice message. This simulates the initial state of the voice message playback, allowing the voice interaction object to intuitively perceive that the voice message playback has been interrupted and has returned to the initial state of the voice message playback.
[0251] In one embodiment, in response to a playback interruption event of a voice message, displaying an identification icon and a first tape reel, wherein the thickness of the first tape reel is positively correlated with the message duration of the voice message, and triggering a halt to voice message playback includes:
[0252] In response to a playback interruption event of a voice message, at least one of the identity icon or the first tape reel is displayed to rotate, and the thickness of the first tape reel gradually increases, and the degree of increase in the thickness of the first tape reel is positively correlated with the playback progress of the voice message, and triggers the stopping of playback of the voice message.
[0253] In response to an interruption event of a voice message, the first end of the first tape segment is shown to move from the identification icon toward the first tape reel;
[0254] When the first end of the first tape segment moves to the first tape reel, the first tape reel is displayed, and the thickness of the first tape reel is positively correlated with the message duration of the voice message.
[0255] Specifically, in response to a playback interruption event of a voice message, the terminal will display either an identity icon or at least one of the first tape reel rotating, and the thickness of the first tape reel will gradually increase. The degree of increase in the thickness of the first tape reel is positively correlated with the playback progress of the voice message; that is, the longer the playback progress of the voice message, the greater the thickness of the first tape reel. This will trigger a halt to the playback of the voice message. In response to a voice message interruption end event, the terminal will display the first end of the first tape segment moving from the identity icon toward the first tape reel. When the first end of the first tape reel moves to the first tape reel, the first tape reel will be displayed, and the thickness of the first tape reel is positively correlated with the message duration of the voice message.
[0256] In practical applications, the terminal will display a rotating identity icon while the first tape reel remains stationary. The rotation direction of the identity icon can be pre-configured according to the actual application scenario; for example, the rotation direction can be clockwise or counterclockwise. Alternatively, the terminal will display a static identity icon while the first tape reel rotates. The rotation direction of the first tape reel can be pre-configured according to the actual application scenario; for example, the rotation direction can be clockwise or counterclockwise.
[0257] In practical applications, the terminal will display an identity icon and the first tape reel rotating simultaneously. The rotation directions of the identity icon and the first tape reel can be pre-configured according to the actual application scenario; they can be the same or different. For example, when the identity icon and the first tape reel rotate simultaneously, the rotation method can be that the identity icon rotates clockwise and the first tape reel rotates counterclockwise, or the identity icon rotates counterclockwise and the first tape reel rotates clockwise.
[0258] In a specific application, such as Figure 26 As shown, in response to a playback interruption event of a voice message, the terminal displays a rotating identity icon, and the thickness of the first tape reel gradually increases. The degree of increase in the thickness of the first tape reel is positively correlated with the playback progress of the voice message. In response to a playback interruption event of a voice message, the terminal displays the first end of the first tape segment moving from the identity icon towards the first tape reel. When the first end of the first tape reel moves to the first tape reel position, the first tape reel is displayed, and the thickness of the first tape reel is positively correlated with the message duration of the voice message.
[0259] In this embodiment, by rotating at least one of the identity icon or the first tape reel, and the thickness of the first tape reel gradually increases, and the degree of increase in the thickness of the first tape reel is positively correlated with the playback progress of the voice message, in response to the interruption event of the voice message, the first end of the first tape segment is displayed moving from the identity icon to the first tape reel. When the first end of the first tape segment moves to the first tape reel, the first tape reel is displayed, and the thickness of the first tape reel is positively correlated with the message duration of the voice message. This can simulate the first tape reel playing in reverse, gradually restoring to the initial state of the voice message playback, so that the voice interaction object can intuitively perceive the interruption of the voice message playback and the gradual restoration to the initial state of the voice message playback.
[0260] In one embodiment, the voice message-based interaction method of this application is illustrated by applying it to a communication application, with the application of the method to a terminal as an example.
[0261] During the voice message recording stage, such as Figure 27As shown, in response to a voice message recording event, the terminal displays an identity icon and a recording bubble, shows the first end of the second tape segment connected to the identity icon, shows the second end of the second tape segment moving from the identity icon to the recording bubble, and triggers voice message recording. When the second end of the second tape segment connects to the recording bubble, a second tape reel is displayed at the recording bubble, and voice message recording is triggered again. During voice message recording, at least one of the second tape reel or the identity icon rotates, and the thickness of the second tape reel gradually increases as the voice message recording progresses. For at least a portion of the recording process, the second tape segment connecting the identity icon and the second tape reel is displayed. In response to a voice message recording end event, the first end of the second tape segment moves from the identity icon to the second tape reel. When the first end of the second tape segment reaches the second tape reel, the second tape reel is dedisplayed, and a voice message bubble is displayed. During voice message recording, the terminal adds a voice recording icon covering a portion of the identity icon, displays the voice recording icon, and dedisplays the voice recording icon in response to the voice message recording end event. During voice message recording, the terminal displays a number icon that changes in size, with the number within the icon gradually increasing as the recording progresses. Furthermore, for example... Figure 27 As shown, during the recording of a voice message, the terminal adds a voice recording icon that covers part of the identity icon to the identity icon and displays the voice recording icon. In response to the voice message recording end event, the voice recording icon is removed from display.
[0262] In a specific application, such as Figure 28 As shown, in response to a voice message recording event, the terminal displays an identity icon and a recording bubble. Figure 28 Add a voice recording icon that covers part of the identity icon (a circular bubble with a 0" in the center). Figure 28 The terminal displays a lip icon, a voice recording icon, and indicates that the second end of the second tape segment moves from the identification icon to the recording bubble, triggering the recording of a voice message. During the recording process, the terminal displays a number icon with changing numbers, and the numbers within the changing number icon gradually increase as the recording progresses (e.g., ...). Figure 28 As shown, as the recording progresses, the number icons change to 2″, 16″, and 60″ respectively. The terminal displays at least one of the second tape reel or the identification icon rotating, and the thickness of the second tape reel gradually increases as the recording progresses (e.g., ...). Figure 28As shown, the thickness of the second tape reel gradually increases as the recording progresses to 2″, 16″, and 60″, and the second tape segment of the second tape reel (e.g., connected to the identification icon) is displayed for at least a portion of the recording process. Figure 28 As shown, when the recording progress is 2″ and 16″, the connection identification icon and the second tape segment of the second tape reel will be displayed, in response to the voice message recording end event (such as...). Figure 28 As shown, when the message duration of a voice message reaches the maximum limit of 60″, the terminal will display the first end of the second tape segment moving from the identity icon to the second tape reel. When the first end of the second tape segment moves to the second tape reel, the second tape reel will be de-displayed, and a message bubble for the voice message will be displayed. Figure 28 (Not shown in the image). During the voice message playback phase, such as... Figure 29 As shown, in response to a voice message playback trigger event, the terminal displays a first tape reel in the message bubble, showing the second end of a first tape segment connected to the first tape reel, and the first end of the first tape segment moving towards the identity icon, triggering the playback of the voice message. During the playback of the voice message, at least one of the first tape reel or the identity icon rotates, and the thickness of the first tape reel gradually decreases as the playback progresses. For at least a portion of the playback time, the first tape segment connecting the identity icon and the first tape reel is displayed. In response to a voice message playback end event, the display of the first tape reel is canceled. As the first tape reel is canceled, the second end of the first tape segment moves from the first tape reel towards the identity icon until the second end of the first tape segment reaches the identity icon. Then, the first tape segment is canceled again, and the message bubble is displayed again. Before the voice message begins playback, the terminal displays a numerical icon corresponding to the message duration of the voice message in the message bubble. During the playback of the voice message, a changing numerical icon is displayed, and the number within the changing numerical icon gradually decreases as the playback progresses. Further, as... Figure 29 As shown, during the playback of a voice message, the terminal adds a voice playback icon that covers part of the identity icon to the identity icon and displays the voice playback icon. In response to the end of voice message playback, the voice playback icon is removed from display.
[0263] In a specific application, such as Figure 30 As shown, the terminal displays a message bubble for the voice message and the corresponding avatar (i.e., identity icon). The message bubble also displays a numerical icon corresponding to the duration of the voice message (i.e.,...). Figure 30(9″ in the original text). In response to a voice message playback trigger event (clicking the message bubble to play), the terminal displays the first tape reel at the message bubble, shows the second end of the first tape segment connected to the first tape reel, shows the first end of the first tape segment moving towards the avatar, and triggers the playback of the voice message. During the playback of the voice message, the terminal displays a number icon with changing numbers, and the numbers within the changing number icon gradually decrease as the voice message playback progresses (e.g., ...). Figure 30 As shown, a voice message originally with a duration of 9″ gradually changes its remaining playback time as the playback progresses, with the numbers in the icon changing to 8″, 4″, and 0″. During playback, the message bubble drives the avatar to rotate, simulating a rotating magnetic tape. This means both the displayed first magnetic tape reel and the avatar rotate in the same direction, towards the recipient of the voice message. The thickness of the displayed first magnetic tape reel gradually decreases as playback progresses, indicating that the demagnetization rate of the tape is linearly related to the message duration (from...). Figure 30 It can be seen that the thickness of the first tape reel when the remaining playback time is 8″ is greater than the thickness of the first tape reel when the remaining playback time is 4″. Specifically, the terminal displays the first tape segment connecting the avatar and the first tape reel (e.g., ...) for at least a portion of the playback process. Figure 30 When the remaining playback time is 4″, the first tape segment connecting the avatar and the first tape reel will be displayed. In response to the end of the voice message playback event, the first tape reel will be dedisplayed. As the first tape reel is dedisplayed, the second end of the first tape segment will move from the first tape reel toward the avatar, indicating that the voice message playback has ended and the tape tail disappears. Once the second end of the first tape segment moves to the avatar, the first tape segment will be dedisplayed, the message bubble will be restored, and the system will return to the initial stage of displaying the voice message bubble and the corresponding avatar.
[0264] In specific applications, playback trigger events include speed-up playback events. The terminal can respond to the speed-up playback event both before and during the playback of a voice message. This involves displaying the first tape reel in the message bubble and calling the callback function for the speed-up playback event. The callback function modifies the voice playback speed attribute, and the voice message is played at the corresponding speed after the modification. In a specific application, such as... Figure 31 As shown, the playback speed event can specifically be a 2x playback speed event (…). Figure 31The text describes a process called "2x >>" (represented by double-clicking) and the terminal's response to a 2x speed playback event for a voice message. This response displays the first tape reel in the message bubble and calls the callback function for the 2x speed playback event. The callback function modifies the voice playback speed attribute, and the voice message is played at the modified speed. During playback, the terminal adds a voice playback icon (i.e., a portion of the identity icon) to the identity icon. Figure 31 The icon (representing the ear for listening) will display the voice playback icon, and will be removed in response to the end of a voice message playback event.
[0265] In practical applications, playback trigger events include voice location events. The terminal can respond to voice location events both before and during the playback of a voice message. In one specific application, the terminal responds to touch events on message bubbles, recording the trigger duration of the corresponding touch point. When the trigger duration reaches a threshold, and the touch point remains stationary within that duration, the voice location event for the voice message is triggered. In another specific application, in response to a voice location event, the terminal displays the first tape reel and the current playback progress on the message bubble. In response to a playback progress adjustment event, the terminal displays the playback progress indicated by the adjustment event on the message bubble, triggering playback of the voice message from the specified playback progress.
[0266] In a specific application, the terminal responds to a playback progress adjustment event for a voice message by recording the corresponding touch point movement trajectory. Upon responding to a playback progress adjustment end event, it uses the last touch point in the movement trajectory as the progress adjustment position. It then obtains the first distance between the initial position and the center point of the message bubble, the second distance between the progress adjustment position and the center point, and the third distance between the progress adjustment position and the initial position. Based on these distances, it obtains the relative angle of the progress adjustment position relative to the initial position. By comparing the first coordinate of the center point with the second coordinate of the progress adjustment position, it determines the quadrant in which the progress adjustment position is located. The quadrant is centered on the center point. Based on the quadrant and the relative angle, it obtains the movement angle of the progress adjustment position relative to the initial position. Based on the movement angle and the duration of the voice message, it determines the playback progress indicated by the playback progress adjustment event and displays this indicated playback progress in the message bubble. Specifically, when the progress adjustment position is located in the first or fourth quadrant, the terminal uses the relative angle as the movement angle of the progress adjustment position relative to the initial position. When the progress adjustment position is located in the second or third quadrant, the terminal will use the angle difference between the pre-configured angle and the relative angle as the movement angle of the progress adjustment position relative to the initial position.
[0267] In specific applications, such as Figure 26 As shown, when a playback interruption event of a voice message is detected, the terminal will respond to the playback interruption event by displaying at least one of the identity icon or the first tape reel rotating, and the thickness of the first tape reel gradually increasing, and the degree of increase in the thickness of the first tape reel being positively correlated with the playback progress of the voice message, and triggering the cessation of voice message playback. In response to the interruption end event of the voice message, the terminal will display the first end of the first tape segment moving from the identity icon to the first tape reel. When the first end of the first tape segment moves to the first tape reel, the terminal will display the first tape reel, and the thickness of the first tape reel being positively correlated with the message duration of the voice message.
[0268] In a specific application, such as Figure 32As shown, the terminal responds to a voice message playback trigger event (clicking the message bubble to play) by triggering the playback of the voice message. During the playback of the voice message, if a playback interruption event is detected (clicking the bubble again to interrupt during playback), the terminal responds to the playback interruption event by triggering a stop playback of the voice message. In response to the voice message interruption end event, the terminal displays the first end of the first tape segment moving from the identification icon towards the first tape reel. When the first end of the first tape segment moves to the first tape reel, the terminal displays the first tape reel, and the thickness of the first tape reel is positively correlated with the message duration of the voice message (this part is not shown in the diagram). Figure 32 (as shown in the image).
[0269] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.
[0270] The inventors believe that traditional voice messages use speech bubbles of varying lengths during playback, which is inefficient for screen rendering. This application standardizes the style, allowing the length of the voice message to be indicated simply by numbers, eliminating the need to draw speech bubbles of different lengths. Furthermore, this application introduces a simulated magnetic tape effect, making the listening experience more intuitively align with the user's perception. During recording, the user can also intuitively perceive the progress of the voice message recording by observing the tape thickness and the user's state. Specifically, this application simulates the recording and playback of voice messages by incorporating the effects of adding and removing magnetic tape in real time and using multiple layers of overlay rendering, thus better matching the user's intuitive perception and allowing them to directly perceive the progress of playback or recording.
[0271] Based on the same inventive concept, this application also provides a voice message-based interaction device for implementing the above-mentioned voice message-based interaction method. The solution provided by this device is similar to the implementation described in the above method; therefore, the specific limitations in one or more voice message-based interaction device embodiments provided below can be found in the limitations of the voice message-based interaction method described above, and will not be repeated here.
[0272] In one embodiment, such as Figure 33 As shown, an interactive device based on voice messages is provided, including: a voice message display module 3302, a magnetic tape reel display module 3304, a voice playback display module 3306, and a processing module 3308, wherein:
[0273] The voice message display module 3302 is used to display message bubbles and corresponding identity icons for voice messages;
[0274] The tape reel display module 3304 is used to display the first tape reel in the message bubble and trigger the playback of the voice message in response to the playback trigger event of the voice message;
[0275] The voice playback display module 3306 is used to display, during the playback of a voice message, at least one of a first tape reel or an identification icon rotating, and the thickness of the first tape reel gradually decreases as the playback progress of the voice message, and displays a first tape segment connecting the identification icon and the first tape reel for at least a portion of the playback process.
[0276] The processing module 3308 is used to cancel the display of the first tape reel in response to the end of playback of the voice message.
[0277] The aforementioned voice message-based interactive device displays a message bubble and a corresponding identity icon for the voice message. In response to a voice message playback trigger event, it displays a first magnetic tape reel at the message bubble and triggers the playback of the voice message. This enriches the display format of voice message playback. During playback, the first magnetic tape segment displays the first magnetic tape reel rotating along with the identity icon. The thickness of the first magnetic tape reel gradually decreases as the playback progresses, indicating the sender of the voice message. The change in thickness during the tape reel's rotation simulates the playback progress, allowing the user to intuitively perceive the playback progress without needing to repeatedly listen to the voice message. This reduces the number of times the voice message is listened to repeatedly, avoids continuous resource consumption, and improves resource utilization.
[0278] In one embodiment, the voice message display module is further configured to, in response to a voice message recording event, display an identity icon and a second tape reel, and trigger voice message recording. During the recording of the voice message, at least one of the second tape reel or the identity icon is shown to rotate, and the thickness of the second tape reel gradually increases as the recording progresses. A second tape segment connecting the identity icon and the second tape reel is displayed for at least a portion of the recording process. In response to a voice message recording end event, the display of the second tape reel is canceled, and a message bubble for the voice message is displayed.
[0279] In one embodiment, the voice message display module is further configured to respond to a voice message recording event by displaying an identity icon and a recording bubble, displaying that the first end of the second tape segment is connected to the identity icon, displaying that the second end of the second tape segment moves from the identity icon to the recording bubble, and triggering the recording of a voice message; and when the second end of the second tape segment is connected to the recording bubble, displaying the second tape reel at the recording bubble.
[0280] In one embodiment, the voice message display module is further configured to, in response to a voice message recording end event, display the first end of the second tape segment moving from the identification icon to the second tape reel; when the first end of the second tape segment moves to the second tape reel, cancel the display of the second tape reel and display a message bubble for the voice message.
[0281] In one embodiment, during the recording of a voice message, the outer contour of the second tape reel is consistent with the outer contour of the recording bubble, a portion of the recording bubble is displayed inside the second tape reel, and the displayed portion of the recording bubble gradually decreases as the recording progresses.
[0282] In one embodiment, both the second tape reel and the recording bubble are circular, and the center of the second tape reel coincides with the center of the recording bubble. Before the voice message recording begins, the second tape reel is covered by the recording bubble and is invisible. When the second end of the second tape segment is connected to the recording bubble, the radius of the recording bubble gradually decreases as the voice message recording progresses, and the second tape reel becomes visible.
[0283] In one embodiment, during the recording of a voice message, the center of the second tape reel coincides with the center of the recording bubble, and the outer contour of the second tape reel gradually expands toward the outer contour of the recording bubble as the recording progresses.
[0284] In one embodiment, the voice message display module is further configured to add a voice recording icon covering a portion of the identity icon on the identity icon during the voice message recording process, display the voice recording icon, and cancel the display of the voice recording icon in response to a voice message recording end event.
[0285] In one embodiment, the voice message display module is also used to trigger a voice message recording end event when the recorded voice message reaches the message limit duration and the second tape reel completely covers the recording bubble.
[0286] In one embodiment, the tape reel display module is further configured to, in response to a playback trigger event of a voice message, display a first tape reel at a message bubble, display a second end of a first tape segment connected to the first tape reel, display a first end of the first tape segment moving toward an identity icon, and trigger the playback of a voice message.
[0287] In one embodiment, the processing module is further configured to respond to a playback end event of a voice message, and as the first tape reel is dedisplayed, the second end of the first tape segment is moved from the first tape reel toward the identity icon until the second end of the first tape segment moves to the identity icon, at which point the first tape segment is dedisplayed.
[0288] In one embodiment, during the playback of a voice message, the outer contour of the first tape reel is consistent with the outer contour of the message bubble, a portion of the message bubble is displayed inside the first tape reel, and the displayed portion of the message bubble gradually increases in size as the playback progresses.
[0289] In one embodiment, both the first tape reel and the message bubble are circular, and the center of the first tape reel coincides with the center of the message bubble; when the first tape reel is displayed at the message bubble, the radius of the message bubble gradually decreases, and the degree of decrease in the radius of the message bubble is positively correlated with the message duration of the voice message; when the first end of the first tape segment is connected to the identity icon, the radius of the message bubble gradually increases as the playback progress of the voice message continues.
[0290] In one embodiment, during the playback of a voice message, the center of the first tape reel coincides with the center of the message bubble, and the outer contour of the first tape reel gradually shrinks toward the center of the message bubble as the playback progresses.
[0291] In one embodiment, when a voice message is triggered to play, the thickness of the first magnetic tape reel is linearly positively correlated with the duration of the voice message.
[0292] In one embodiment, when the duration of a voice message is the maximum message duration, the first tape reel completely covers the message bubble when the playback of the voice message is triggered.
[0293] In one embodiment, the voice message display module is further configured to add a voice playback icon covering a portion of the identity icon on the identity icon during the playback of the voice message, display the voice playback icon, and cancel the display of the voice playback icon in response to the end of voice message playback event.
[0294] In one embodiment, the voice message-based interactive device further includes a digital icon display module, which is used to display a digital icon corresponding to the duration of the voice message at the message bubble of the voice message. During the playback of the voice message, the digital icon with changing numbers is displayed, and the numbers in the changing digital icon gradually decrease as the playback progress of the voice message.
[0295] In one embodiment, the playback trigger event includes a speed-up playback event, and the tape reel display module includes a speed-up playback unit. The speed-up playback unit is used to respond to the speed-up playback event of the voice message, display the first tape reel at the message bubble, and play the voice message at the corresponding speed-up playback event.
[0296] In one embodiment, the speed-up playback unit is further configured to, during the playback of a voice message, in response to a speed-up playback event of the voice message, display a first tape reel at a message bubble and play the voice message at the speed-up corresponding to the speed-up playback event.
[0297] In one embodiment, the speed-up playback unit is further configured to respond to a speed-up playback event of a voice message, display a first tape reel at the message bubble, and call a callback function for the speed-up playback event, modify the voice playback speed attribute through the callback function, and play the voice message at the corresponding playback speed according to the modified voice playback speed attribute.
[0298] In one embodiment, the playback trigger event includes a voice positioning event, and the tape reel display module includes a voice positioning unit. The voice positioning unit is used to display the first tape reel and the current playback progress at the message bubble in response to the voice positioning event of the voice message, and to display the positioning playback progress indicated by the playback progress adjustment event at the message bubble in response to the playback progress adjustment event of the voice message, thereby triggering the playback of the voice message from the positioning playback progress of the voice message.
[0299] In one embodiment, the voice positioning unit is further configured to, during the playback of a voice message, display the first tape reel and the current playback progress in a message bubble in response to a voice positioning event of the voice message, and display the positioning playback progress indicated by the playback progress adjustment event in a message bubble in response to a playback progress adjustment event of the voice message, thereby triggering the playback of the voice message from the positioning playback progress of the voice message.
[0300] In one embodiment, the voice positioning unit is further configured to respond to a touch event for a message bubble by recording the trigger duration of the touch point corresponding to the touch event. When the trigger duration reaches a duration threshold and the touch point is stationary within the trigger duration, a voice positioning event for the voice message is triggered.
[0301] In one embodiment, the voice positioning unit is further configured to, in response to a playback progress adjustment event of a voice message, obtain the progress adjustment position, obtain the movement angle of the progress adjustment position relative to the initial position based on the current playback progress corresponding to the initial position, the center point position of the message bubble, and the progress adjustment position, determine the positioning playback progress indicated by the playback progress adjustment event based on the movement angle and the message duration of the voice message, and display the positioning playback progress indicated by the playback progress adjustment event at the message bubble.
[0302] In one embodiment, the voice positioning unit is further configured to, in response to a playback progress adjustment event of a voice message, record the touch point movement trajectory corresponding to the playback progress adjustment event, and in response to a progress adjustment end event of a voice message, use the last touch point in the touch point movement trajectory as the progress adjustment position.
[0303] In one embodiment, the voice positioning unit is further configured to obtain the relative angle of the progress adjustment position relative to the initial position based on the initial position corresponding to the current playback progress, the center point position of the message bubble, and the progress adjustment position; compare the first coordinate of the center point position with the second coordinate of the progress adjustment position to determine the quadrant in which the progress adjustment position is located, with the quadrant centered on the center point position; and obtain the movement angle of the progress adjustment position relative to the initial position based on the quadrant in which the progress adjustment position is located and the relative angle.
[0304] In one embodiment, the voice positioning unit is further configured to obtain a first distance between the initial position corresponding to the current playback progress and the center point position of the message bubble, a second distance between the progress adjustment position and the center point position, and a third distance between the progress adjustment position and the initial position, and to obtain the relative angle of the progress adjustment position relative to the initial position based on the first distance, the second distance and the third distance.
[0305] In one embodiment, the voice positioning unit is further configured to use the relative angle as the movement angle of the progress adjustment position relative to the initial position when the quadrant in which the progress adjustment position is located is the first quadrant or the fourth quadrant.
[0306] In one embodiment, the voice positioning unit is further configured to use the angle difference between the pre-configured angle and the relative angle as the movement angle of the progress adjustment position relative to the initial position when the quadrant in which the progress adjustment position is located is the second quadrant or the third quadrant.
[0307] In one embodiment, the voice message-based interactive device further includes a playback interruption processing module, which is used to display an identity icon and a first magnetic tape reel in response to a playback interruption event during the playback of the voice message, wherein the thickness of the first magnetic tape reel is positively correlated with the message duration of the voice message, and triggers the cessation of playback of the voice message.
[0308] In one embodiment, the playback interruption processing module is further configured to, in response to a playback interruption event of a voice message, display at least one of the identity icon or the first tape reel rotating, and the thickness of the first tape reel gradually increasing, and the degree of increase in the thickness of the first tape reel being positively correlated with the playback progress of the voice message, and trigger a stop playback of the voice message; in response to an interruption end event of a voice message, display the first end of the first tape segment moving from the identity icon toward the first tape reel; when the first end of the first tape segment moves to the first tape reel, display the first tape reel, and the thickness of the first tape reel being positively correlated with the message duration of the voice message.
[0309] The modules in the aforementioned voice message-based interactive device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the operations corresponding to each module.
[0310] In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 34 As shown, the computer device includes a processor, memory, input / output interfaces, a communication interface, a display unit, and an input device. The processor, memory, and input / output interfaces are connected via a system bus, and the communication interface, display unit, and input device are also connected to the system bus via the input / output interfaces. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The input / output interfaces are used for exchanging information between the processor and external devices. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, NFC (Near Field Communication), or other technologies. When the computer program is executed by the processor, it implements a voice message-based interactive method. The display unit of the computer device is used to form a visually visible image. It can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be an LCD screen or an e-ink screen. The input device of the computer device can be a touch layer covering the display screen, or buttons, trackballs, or touchpads set on the casing of the computer device, or external keyboards, touchpads, or mice, etc.
[0311] Those skilled in the art will understand that Figure 34The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.
[0312] In one embodiment, a computer device is also provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above method embodiments.
[0313] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements the steps in the above method embodiments.
[0314] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above method embodiments.
[0315] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.
[0316] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0317] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.
Claims
1. A voice message based interaction method, characterized by, The method includes: Displays a message bubble containing the voice message and the corresponding identity icon; In response to the playback trigger event of the voice message, a first tape reel is displayed at the message bubble, the second end of the first tape segment is connected to the first tape reel, the first end of the first tape segment moves toward the identity icon, and the playback of the voice message is triggered. During the playback of the voice message, at least one of the first tape reel or the identity icon is shown to rotate, and the thickness of the first tape reel gradually decreases as the playback progress of the voice message, and a first tape segment connecting the identity icon and the first tape reel is displayed for at least a portion of the playback process. In response to the end of playback of the voice message, the first tape reel is de-displayed.
2. The method of claim 1, wherein, The message bubble displaying the voice message and the corresponding identity icon include: In response to a voice message recording event, an identity icon and a second tape reel are displayed, and recording of the voice message is triggered. During the recording of the voice message, at least one of the second tape reel or the identity icon is shown to rotate, and the thickness of the second tape reel gradually increases as the recording of the voice message progresses. During at least a portion of the recording process, a second tape segment connecting the identity icon and the second tape reel is displayed. In response to the voice message recording end event, the display of the second tape reel is canceled, and the message bubble of the voice message is displayed.
3. The method of claim 2, wherein, The step of displaying an identity icon and a second tape reel in response to a voice message recording event, and triggering the recording of the voice message, includes: In response to a voice message recording event, an identity icon and a recording bubble are displayed, the first end of the second tape segment is connected to the identity icon, the second end of the second tape segment moves from the identity icon to the recording bubble, and the recording of the voice message is triggered. When the second end of the second tape segment is connected to the recording bubble, the second tape reel is displayed at the recording bubble.
4. The method of claim 2, wherein, The step of canceling the display of the second tape reel and displaying the message bubble of the voice message in response to the end of voice message recording includes: In response to a voice message recording end event, it is shown that the first end of the second tape segment moves from the identity icon toward the second tape reel; When the first end of the second tape segment moves to the second tape reel, the second tape reel is de-displayed, and a message bubble for the voice message is displayed.
5. The method according to claim 3 or 4, characterized in that, During the recording of the voice message, the outer contour of the second tape reel is consistent with the outer contour of the recording bubble, a portion of the recording bubble is displayed inside the second tape reel, and the displayed portion of the recording bubble gradually decreases as the recording progresses.
6. The method of claim 5, wherein, Both the second tape reel and the recording bubble are circular, and the center of the second tape reel coincides with the center of the recording bubble. Before the voice message begins recording, the second tape reel is covered by the recording bubble and is invisible. When the second end of the second tape segment is connected to the recording bubble, the radius of the recording bubble gradually decreases as the voice message recording progresses, and the second tape reel becomes visible.
7. The method of claim 1, wherein, The method further includes: In response to the end of playback of the voice message, as the first tape reel is dedisplayed, the second end of the first tape segment is moved from the first tape reel toward the identity icon until the second end of the first tape segment moves to the identity icon, at which point the first tape segment is dedisplayed.
8. The method of claim 1, wherein, During the playback of the voice message, the outer contour of the first tape reel is consistent with the outer contour of the message bubble, a portion of the message bubble is displayed inside the first tape reel, and the displayed portion of the message bubble gradually increases in size as the playback progresses.
9. The method of claim 8, wherein, Both the first tape reel and the message bubble are circular, and the center of the first tape reel and the center of the message bubble are the same. When the first tape reel is displayed at the message bubble, the radius of the message bubble gradually decreases, and the degree of decrease in the radius of the message bubble is positively correlated with the duration of the voice message. When the first end of the first tape segment is connected to the identity icon, the radius of the message bubble gradually increases as the playback progress of the voice message continues.
10. The method of claim 1, wherein, The method further includes: Display a numerical icon corresponding to the duration of the voice message in the message bubble of the voice message; During the playback of the voice message, a number icon with changing numbers is displayed, and the number within the number icon gradually decreases as the playback progresses.
11. The method of claim 1, wherein, The playback trigger events include playback speed adjustment events; The step of displaying the first tape reel at the message bubble and triggering playback of the voice message in response to the playback trigger event of the voice message includes: In response to the playback speed event of the voice message, a first tape reel is displayed at the message bubble, and the voice message is played at the corresponding playback speed according to the playback speed event.
12. The method of claim 1, wherein, The method further includes: During the playback of the voice message, in response to the playback speed event of the voice message, a first tape reel is displayed at the message bubble, and the voice message is played at the corresponding playback speed according to the playback speed event.
13. The method of claim 1, wherein, The playback trigger event includes a voice location event. The playback trigger event, responding to the voice message, displays the first tape reel at the message bubble and triggers the playback of the voice message, including: In response to the voice location event of the voice message, the first tape reel and the current playback progress are displayed at the message bubble; In response to a playback progress adjustment event for the voice message, the location playback progress indicated by the playback progress adjustment event is displayed at the message bubble; The playback of the voice message is triggered from the location playback progress of the voice message.
14. The method of claim 1, wherein, The method further includes: During the playback of the voice message, in response to the voice positioning event of the voice message, the first tape reel and the current playback progress are displayed at the message bubble; In response to a playback progress adjustment event for the voice message, the location playback progress indicated by the playback progress adjustment event is displayed at the message bubble; The playback of the voice message is triggered from the location playback progress of the voice message.
15. The method according to claim 13 or 14, characterized in that, The method further includes: In response to a touch event on the message bubble, the trigger duration of the corresponding touch point is recorded; When the trigger duration reaches the duration threshold, and the touch point is in a stationary state within the trigger duration, the voice location event of the voice message is triggered.
16. The method of claim 13 or 14, wherein, The step of displaying the playback progress indicated by the playback progress adjustment event at the message bubble in response to the playback progress adjustment event includes: In response to a playback progress adjustment event of the voice message, obtain the progress adjustment position; Based on the initial position corresponding to the current playback progress, the center point position of the message bubble, and the progress adjustment position, the movement angle of the progress adjustment position relative to the initial position is obtained; The positioning playback progress of the playback progress adjustment event indication is determined based on the movement angle and the message duration of the voice message. The playback progress is displayed in the message bubble, indicating the playback progress adjustment event.
17. The method of claim 16, wherein, The step of obtaining the movement angle of the progress adjustment position relative to the initial position based on the current playback progress, the center point position of the message bubble, and the progress adjustment position includes: Based on the initial position corresponding to the current playback progress, the center point position of the message bubble, and the progress adjustment position, the relative angle of the progress adjustment position relative to the initial position is obtained; By comparing the first coordinates of the center point position and the second coordinates of the progress adjustment position, the quadrant in which the progress adjustment position is located is determined, with the center point position as the center; The movement angle of the progress adjustment position relative to the initial position is obtained based on the quadrant in which the progress adjustment position is located and the relative angle.
18. The method according to claim 17, characterized in that, The step of obtaining the relative angle between the progress adjustment position and the initial position based on the current playback progress, the center position of the message bubble, and the progress adjustment position includes: Obtain the first distance between the initial position corresponding to the current playback progress and the center point position of the message bubble, the second distance between the progress adjustment position and the center point position, and the third distance between the progress adjustment position and the initial position; Based on the first distance, the second distance, and the third distance, the relative angle between the progress adjustment position and the initial position is obtained.
19. The method according to claim 1, characterized in that, The method further includes: During the playback of the voice message, in response to the playback interruption event of the voice message, the identity icon and the first tape reel are displayed, and the thickness of the first tape reel is positively correlated with the message duration of the voice message, and the playback of the voice message is stopped.
20. The method according to claim 19, characterized in that, The response to the playback interruption event of the voice message, displaying the identity icon and the first tape reel, wherein the thickness of the first tape reel is positively correlated with the message duration of the voice message, and triggering the cessation of playback of the voice message includes: In response to the interruption of the playback of the voice message, at least one of the identity icon or the first tape reel is displayed to rotate, and the thickness of the first tape reel gradually increases, and the degree of increase in the thickness of the first tape reel is positively correlated with the playback progress of the voice message, and the playback of the voice message is stopped. In response to the interruption event of the voice message, the first end of the first tape segment is shown to move from the identity icon toward the first tape reel; When the first end of the first tape segment moves to the first tape reel, the first tape reel is displayed, and the thickness of the first tape reel is positively correlated with the message duration of the voice message.
21. An interactive device based on voice messages, characterized in that, The device includes: The voice message display module is used to display message bubbles and corresponding identity icons for voice messages; A magnetic tape reel display module is used to respond to the playback trigger event of the voice message by displaying a first magnetic tape reel at the message bubble, displaying a second end of a first tape segment connected to the first magnetic tape reel, displaying a first end of the first tape segment moving toward the identity icon, and triggering the playback of the voice message. The voice playback display module is used to display, during the playback of the voice message, at least one of the first tape reel or the identification icon is rotating, and the thickness of the first tape reel gradually decreases as the playback progress of the voice message, and displays a first tape segment connecting the identification icon and the first tape reel during at least a part of the playback process. The processing module is configured to cancel the display of the first tape reel in response to the playback end event of the voice message.
22. The apparatus according to claim 21, characterized in that, The voice message display module is further configured to respond to a voice message recording event by displaying an identity icon and a second tape reel, and triggering the recording of the voice message. During the recording of the voice message, at least one of the second tape reel or the identity icon is shown to rotate, and the thickness of the second tape reel gradually increases as the recording progresses. During at least a portion of the recording process, a second tape segment connecting the identity icon and the second tape reel is displayed. In response to a voice message recording end event, the display of the second tape reel is canceled, and a message bubble of the voice message is displayed.
23. The apparatus according to claim 22, characterized in that, The voice message display module is also used to respond to a voice message recording event by displaying an identity icon and a recording bubble, displaying that the first end of the second tape segment is connected to the identity icon, displaying that the second end of the second tape segment moves from the identity icon to the recording bubble and triggers the recording of the voice message, and when the second end of the second tape segment is connected to the recording bubble, displaying the second tape reel at the recording bubble.
24. The apparatus according to claim 22, characterized in that, The voice message display module is also used to respond to a voice message recording end event by displaying the first end of the second tape segment moving from the identity icon to the second tape reel. When the first end of the second tape segment moves to the second tape reel, the display of the second tape reel is canceled, and the message bubble of the voice message is displayed.
25. The apparatus according to claim 23 or 24, characterized in that, During the recording of the voice message, the outer contour of the second tape reel is consistent with the outer contour of the recording bubble, a portion of the recording bubble is displayed inside the second tape reel, and the displayed portion of the recording bubble gradually decreases as the recording progresses.
26. The apparatus according to claim 25, characterized in that, Both the second tape reel and the recording bubble are circular, and the center of the second tape reel coincides with the center of the recording bubble. Before the voice message begins recording, the second tape reel is covered by the recording bubble and is invisible. When the second end of the second tape segment is connected to the recording bubble, the radius of the recording bubble gradually decreases as the voice message recording progresses, and the second tape reel becomes visible.
27. The apparatus according to claim 21, characterized in that, The processing module is also configured to respond to the playback end event of the voice message, and as the first tape reel is canceled from display, the second end of the first tape segment is moved from the first tape reel to the identity icon until the second end of the first tape segment moves to the identity icon, and then the first tape segment is canceled from display.
28. The apparatus according to claim 21, characterized in that, During the playback of the voice message, the outer contour of the first tape reel is consistent with the outer contour of the message bubble, a portion of the message bubble is displayed inside the first tape reel, and the displayed portion of the message bubble gradually increases in size as the playback progresses.
29. The apparatus according to claim 28, characterized in that, Both the first tape reel and the message bubble are circular, and the center of the first tape reel and the center of the message bubble are the same. When the first tape reel is displayed at the message bubble, the radius of the message bubble gradually decreases, and the degree of decrease in the radius of the message bubble is positively correlated with the duration of the voice message. When the first end of the first tape segment is connected to the identity icon, the radius of the message bubble gradually increases as the playback progress of the voice message continues.
30. The apparatus according to claim 21, characterized in that, The device also includes a digital icon display module, which is used to display a digital icon corresponding to the duration of the voice message at the message bubble of the voice message. During the playback of the voice message, the digital icon displays a changing number, and the number in the changing digital icon gradually decreases as the playback progress of the voice message.
31. The apparatus according to claim 21, characterized in that, The playback trigger event includes a speed-up playback event; the tape reel display module includes a speed-up playback unit, which is used to respond to the speed-up playback event of the voice message, display the first tape reel at the message bubble, and play the voice message at the corresponding speed-up playback event.
32. The apparatus according to claim 21, characterized in that, The magnetic tape reel display module includes a speed-up playback unit, which is used to display a first magnetic tape reel at the message bubble in response to a speed-up playback event of the voice message during the playback of the voice message, and play the voice message at the speed-up corresponding to the speed-up playback event.
33. The apparatus according to claim 21, characterized in that, The playback trigger event includes a voice positioning event. The tape reel display module includes a voice positioning unit. The voice positioning unit is used to respond to the voice positioning event of the voice message, display the first tape reel and the current playback progress at the message bubble, and respond to the playback progress adjustment event of the voice message, display the positioning playback progress indicated by the playback progress adjustment event at the message bubble, and trigger the playback of the voice message from the positioning playback progress of the voice message.
34. The apparatus according to claim 21, characterized in that, The tape reel display module includes a voice positioning unit. During the playback of the voice message, in response to a voice positioning event of the voice message, the voice positioning unit displays the first tape reel and the current playback progress at the message bubble. In response to a playback progress adjustment event of the voice message, the voice positioning unit displays the positioning playback progress indicated by the playback progress adjustment event at the message bubble, and triggers the playback of the voice message from the positioning playback progress of the voice message.
35. The apparatus according to claim 33 or 34, characterized in that, The voice positioning unit is also used to respond to a touch event of the message bubble, record the trigger duration of the touch point corresponding to the touch event, and when the trigger duration reaches a duration threshold and the touch point is in a stationary state within the trigger duration, then the voice positioning event of the voice message is triggered.
36. The apparatus according to claim 33 or 34, characterized in that, The voice positioning unit is further configured to respond to a playback progress adjustment event of the voice message, obtain the progress adjustment position, obtain the movement angle of the progress adjustment position relative to the initial position based on the current playback progress corresponding to the initial position, the center point position of the message bubble, and the progress adjustment position, determine the positioning playback progress indicated by the playback progress adjustment event according to the movement angle and the message duration of the voice message, and display the positioning playback progress indicated by the playback progress adjustment event at the message bubble.
37. The apparatus according to claim 36, characterized in that, The voice positioning unit is further configured to obtain the relative angle of the progress adjustment position relative to the initial position based on the current playback progress, the center point position of the message bubble, and the progress adjustment position; compare the first coordinate of the center point position with the second coordinate of the progress adjustment position to determine the quadrant in which the progress adjustment position is located; the quadrant is centered on the center point position; and based on the quadrant in which the progress adjustment position is located and the relative angle, obtain the movement angle of the progress adjustment position relative to the initial position.
38. The apparatus according to claim 37, characterized in that, The voice positioning unit is also used to obtain a first distance between the initial position corresponding to the current playback progress and the center point position of the message bubble, a second distance between the progress adjustment position and the center point position, and a third distance between the progress adjustment position and the initial position, and to obtain the relative angle of the progress adjustment position relative to the initial position based on the first distance, the second distance and the third distance.
39. The apparatus according to claim 21, characterized in that, The device further includes a playback interruption processing module, which is used to display the identity icon and the first tape reel in response to a playback interruption event of the voice message during playback of the voice message, wherein the thickness of the first tape reel is positively correlated with the message duration of the voice message, and triggers the cessation of playback of the voice message.
40. The apparatus according to claim 39, characterized in that, The playback interruption handling module is further configured to, in response to a playback interruption event of the voice message, display that at least one of the identity icon or the first tape reel rotates, and the thickness of the first tape reel gradually increases, and the degree of increase in the thickness of the first tape reel is positively correlated with the playback progress of the voice message, and trigger a stop playback of the voice message; in response to an interruption end event of the voice message, display that the first end of the first tape segment moves from the identity icon toward the first tape reel; when the first end of the first tape segment moves to the first tape reel, display the first tape reel, and the thickness of the first tape reel is positively correlated with the message duration of the voice message.
41. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 20.
42. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 20.
43. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 20.
Citation Information
Patent Citations
Method, client and system for displaying playing progress of audio information
CN102831912A
Message display method
CN112583695A
