Method, device, computer-readable medium and electronic device for information processing

By responding to recording and stop instructions in the instant communication tool, breakpoint recording of instant audio/video information and independent processing of other tasks are achieved, the problems of recording interruptions and task coupling in the prior art are solved, and communication efficiency and resource utilization are improved.

CN112203134BActive Publication Date: 2025-03-04TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202011056741.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-09-30
Publication Date
2025-03-04
Estimated Expiration
2040-09-30

AI Technical Summary

Technical Problem

When recording voice or video information, existing instant communication tools cannot continue recording after interruption, and cannot handle other tasks independently, resulting in inefficient communication and waste of resources.

Method used

By responding to the recording command and the stop recording command, instant audio/video information are recorded and stopped respectively, and after stopping the recording, the information of different paragraphs is combined into combined instant audio/video information, supporting breakpoint re-recording and independently processing other tasks.

Benefits of technology

It realizes that the real-time audio/video information can be continued to be recorded after interruption, and other tasks are processed independently, which improves communication efficiency, reduces resource consumption and reduces costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112203134B_ABST
    Figure CN112203134B_ABST
Patent Text Reader

Abstract

Embodiments of the present invention provide a method, device, computer-readable medium, and electronic device for information processing. The method for information processing includes: recording and storing first instant audio / video information in response to a first recording instruction; stopping recording the first instant audio / video information in response to a first stop recording instruction; recording and storing second instant audio / video information in response to a second recording instruction; and synthesizing the first instant audio / video information and the second instant audio / video information into combined instant audio / video information in response to stopping recording the second instant audio / video information. The embodiments of the present invention effectively improve communication efficiency, reduce unnecessary resource consumption, and reduce costs by storing the first and second instant audio / video information and combining the two.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present invention generally relate to the technical field of information processing, and more particularly to a method, apparatus, computer-readable medium, and electronic device for real-time audio / video information recording. Background Art

[0002] With the development of instant messaging technology, most instant messaging tools have voice messaging capabilities, and a large number of users choose to communicate with each other using voice messaging. In addition, the number of users who communicate with each other using video messaging has also increased significantly.

[0003] Figure 1 The present invention shows a user interface for sending voice information from the user's perspective in the prior art. Figure 2 FIG. 2 shows a schematic flow chart of sending voice information in the prior art. Figure 1 and Figure 2 As shown, in existing instant messaging tools, after the user presses and holds to speak, the communication tool starts recording a voice message. When the voice message is less than 60 seconds, after the voice recording is completed, you can directly drag it to convert it into text or delete it, or the voice message will be sent out after the user releases it. When the voice message reaches 60 seconds, the voice message will be automatically sent out.

[0004] However, if Figure 1 and Figure 2 As shown, in existing instant messaging tools, voice messages and video messages can only be recorded and sent once. During the recording of the message, other matters cannot be processed, the message cannot be saved, and the message cannot be recorded at a breakpoint. In a scenario, if a text message needs to be sent or other tasks need to be completed in the middle of sending a voice message, the voice message needs to be divided into two parts and sent, or the voice message needs to be re-recorded. For example, when replying to A by voice, and a picture or video needs to be sent to B at this time, it is necessary to reply to A before sending it, or reply to A half of the voice message first, then send B's picture or video, and then continue to reply to A. Therefore, when sending instant voice messages or instant video messages, if a text message needs to be sent or other tasks need to be completed in the middle, the message needs to be divided into two parts and sent, or the message needs to be re-recorded. This seriously affects communication efficiency and consumes a lot of unnecessary resources and costs. Summary of the invention

[0005] In view of this, embodiments of the present invention provide a method, apparatus, computer-readable medium and electronic device for information processing in order to alleviate, mitigate or even eliminate the above-mentioned problems.

[0006] According to a first aspect of an embodiment of the present invention, a method for information processing is provided, comprising: in response to a first recording instruction, recording and storing first real-time audio / video information; in response to a first stop recording instruction, stopping recording the first real-time audio / video information; in response to a second recording instruction, recording and storing second real-time audio / video information; and in response to stopping recording the second real-time audio / video information, synthesizing the first real-time audio / video information and the second real-time audio / video information into combined real-time audio / video information.

[0007] According to a second aspect of an embodiment of the present invention, a method for recording audio / video information is provided, comprising: recording audio / video information in response to a first recording instruction; stopping recording the audio / video information in response to a first stop recording instruction; continuing to record the audio / video information on the basis of the audio / video information in an interface for stopping recording the audio / video information in response to a second recording instruction; performing any of the following operations on the audio / video information in response to stopping recording the audio / video information: converting voice information in the audio / video information into text, and sending or deleting the text, deleting the audio / video information, and sending the audio / video information.

[0008] According to a third aspect of an embodiment of the present invention, a device for information processing is provided, including: an instant audio / video information generation module, used to: record and store first instant audio / video information in response to a first recording instruction; stop recording the first instant audio / video information in response to a first stop recording instruction; and record and store second instant audio / video information in response to a second recording instruction; and a synthesis module, used to: synthesize the first instant audio / video information and the second instant audio / video information into combined instant audio / video information in response to stopping recording the second instant audio / video information.

[0009] In some embodiments, based on the aforementioned solution, the instant audio / video information generation module is further used to: create an audio / video storage box with a predefined storage space, wherein the first instant audio / video information is stored in the audio / video storage box.

[0010] In some embodiments, based on the aforementioned solution, the instant audio / video information generation module is further used to: in response to stopping recording of the first instant audio / video information, calculate the remaining available audio / video information storage space of the audio / video storage box.

[0011] In some embodiments, based on the aforementioned scheme, the real-time audio / video information generation module is further used to: store the second real-time audio / video information in the remaining available audio / video information storage space; if the second real-time audio / video information does not fill the remaining available audio / video information storage space, continue to record the second real-time audio / video information until the recording of the second real-time audio / video information is stopped in response to a second stop recording instruction; and if the second real-time audio / video information fills the remaining available audio / video information storage space, stop recording the second real-time audio / video information.

[0012] In some embodiments, based on the aforementioned solution, the first stop recording instruction and the second stop recording instruction are generated based on a user's operation instruction or based on a response to an event.

[0013] In some embodiments, based on the aforementioned scheme, the device also includes: a disposal module, which is used to: perform any of the following operations on the combined instant audio / video information: convert the voice information in the combined instant audio / video information into text, and send or delete the text, delete the combined instant audio / video information, and send the combined instant audio / video information.

[0014] In some embodiments, based on the aforementioned solution, the processing module is further used to: remove the remaining unrecorded space in the audio / video storage box before sending the combined instant audio / video information.

[0015] In some embodiments, based on the aforementioned scheme, the disposal module is also used to: in response to synthesizing the first instant audio / video information and the second instant audio / video information into the combined instant audio / video information, if the second instant audio / video information fills the remaining available audio / video information storage space, automatically sending the combined instant audio / video information.

[0016] In some embodiments, based on the aforementioned scheme, the real-time audio / video information generation module is also used to: in response to synthesizing the first real-time audio / video information and the second real-time audio / video information into the combined real-time audio / video information, if the second real-time audio / video information does not fill the remaining available audio / video information storage space, then in response to an additional recording instruction, record additional real-time audio / video information and store the additional real-time audio / video information in the audio / video storage box, and the synthesis module is also used to: in response to stopping recording the additional real-time audio / video information, synthesize the additional real-time audio / video information with the combined real-time audio / video information.

[0017] In some embodiments, based on the aforementioned solution, the first instant audio / video information and the second instant audio / video information are stored in the audio / video storage box at predefined intervals.

[0018] In some embodiments, based on the aforementioned scheme, the instant audio / video information generation module is further used to: create multiple audio / video storage boxes with predefined storage space, wherein each of the multiple audio / video storage boxes is respectively associated with different sessions and / or associated with different objects in the same session.

[0019] According to a fourth aspect of an embodiment of the present invention, a computer-readable medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the processor executes the method for information processing as described in the above-mentioned embodiment of the invention.

[0020] According to a fifth aspect of an embodiment of the present invention, there is provided an electronic device, comprising: a storage device for storing a program; and a processor configured to execute the program to perform the method for information processing as described in the above-mentioned embodiment of the invention.

[0021] The embodiments of the present invention may have the following beneficial effects:

[0022] In the technical solutions provided by some embodiments of the present invention, by recording and storing the first instant audio / video information and the second instant audio / video information, and synthesizing the first instant audio / video information and the second instant audio / video information into a combined instant audio / video information, the instant audio / video information function can be independent and not coupled with other functions; when recording information, other tasks can be paused, and recording can be continued after returning; information recording supports local storage capabilities. Therefore, the embodiments of the present invention can effectively avoid the need to repeatedly record audio / video information or send audio / video information in two segments in instant messaging, thereby improving communication efficiency, reducing unnecessary resource consumption and reducing costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, exemplary embodiments will be described below in conjunction with the accompanying drawings. Obviously, the drawings in the following description are only some embodiments of the present invention. In the drawings:

[0024] Figure 1 The user interface for sending voice information from the user's perspective in the prior art is shown;

[0025] Figure 2 A schematic flow chart of sending voice information in the prior art is shown;

[0026] Figure 3An exemplary system architecture according to an embodiment of the present invention is shown;

[0027] Figure 4 A flowchart of a method for recording instant audio / video information according to an embodiment of the present invention is schematically illustrated;

[0028] Figure 5 Shows Figure 4 A schematic flow chart of the step of recording and storing the second audio / video information in the instant audio / video information recording method shown;

[0029] Figure 6 An exemplary schematic diagram of processing instant audio / video information in an audio / video storage box according to an embodiment of the present invention is shown;

[0030] Figure 7 An exemplary structural block diagram of a device for continuing to record instant audio / video information according to an embodiment of the present invention is shown;

[0031] Figure 8 An example flow chart of an application scenario according to an embodiment of the present invention is shown;

[0032] Figure 9a-9h A user interface for resuming recording instant audio / video information from a user's perspective according to an embodiment of the present invention is shown;

[0033] Figure 10a-10j A user interface for continuing to record instant audio / video information from a user's perspective according to another embodiment of the present invention is shown;

[0034] Fig.11 A schematic block diagram of a computing device according to an embodiment of the present invention is shown.

[0035] It should be understood that those skilled in the art can also obtain other drawings based on these drawings. DETAILED DESCRIPTION

[0036] The preferred embodiments of the present invention are described below in conjunction with the drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention. In addition, the embodiments of the present invention and the features in the embodiments may be combined with each other if there is no conflict.

[0037] The described features, structures or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present invention. However, those skilled in the art will appreciate that the technical solutions of the present invention may be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known methods, devices, implementations or operations are not shown or described in detail to avoid blurring various aspects of the present invention.

[0038] The blocks shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0039] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0040] In particular, according to an embodiment of the present invention, the process described below with reference to the flowchart can be implemented as a computer program. For example, an embodiment of the present invention provides a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains a program code for executing at least one step in the method embodiment of the present disclosure.

[0041] Before describing the embodiments of the present invention in detail, some related concepts are first explained:

[0042] 1. Instant messaging: Instant messaging (English: instant message, abbreviation: IM) refers to the ability to send and receive Internet messages instantly, allowing two or more people to use the Internet to transmit text messages, files, voice and video communications in real time.

[0043] 2. Instant audio / video information: Instantly recorded audio or video information transmitted in instant messaging.

[0044] 3. Audio / video storage box: In instant messaging, a storage device that stores instant audio / video information.

[0045] Figure 3 The exemplary system architecture 300 of the instant audio / video information recording method or instant audio / video information recording device according to the embodiment of the present invention is shown, and various methods described herein can be implemented in the system. Figure 3As shown, the system architecture 300 includes a server 310 , a network 340 , and one or more terminal devices 350 .

[0046] The server 310 stores and runs instructions that can execute the various methods described herein, and it can be a single server or a server cluster. It should be understood that the server mentioned herein is typically a server computer with a large amount of memory and processor resources, but other embodiments are also possible.

[0047] Examples of network 340 include a local area network (LAN), a wide area network (WAN), a personal area network (PAN), and / or a combination of communication networks such as the Internet. Each of the server 310 and the one or more terminal devices 350 may include at least one communication interface (not shown) capable of communicating through the network 340. Such a communication interface may be one or more of the following: any type of network interface (e.g., a network interface card (NIC)), a wired or wireless (such as an IEEE 802.11 wireless LAN (WLAN)) wireless interface, a Worldwide Interoperability for Microwave Access (Wi-MAX) interface, an Ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a Bluetooth™ interface, a near field communication (NFC) interface, etc. Additional examples of communication interfaces are described elsewhere herein.

[0048] Terminal device 350 may be any type of mobile computing device, including a mobile computer or a mobile computing device (e.g., devices, personal digital assistants (PDAs), laptop computers, notebook computers, tablet computers such as the Apple iPad™, netbooks, etc.), mobile phones (e.g., cellular phones, such as Microsoft Smartphones, Apple iPhones, Android TM Operating system phone, equipment, devices, etc.), wearable computing devices (e.g. smart watches, head-mounted devices, including smart glasses, such as Glass TM , etc.) or other types of mobile devices. In some embodiments, the terminal device 350 may also be a fixed computing device. In addition, when the system includes multiple terminal devices 350, the multiple terminal devices 350 may be computing devices of the same or different types.

[0049] The terminal device 350 may include a display screen 351 and a terminal application 352 that can interact with a terminal user via the display screen 351. The terminal device 350 may, for example, interact with the server 310 via the network 340, for example, send data to it or receive data from it. The terminal application 352 may be a local application, a web page (Web) application, or a small program (LiteApp) as a lightweight application. In the case where the terminal application 352 is a local application that needs to be installed, the terminal application 352 may be installed in the user terminal 350. In the case where the terminal application 352 is a Web application, the terminal application 352 may be accessed through a browser. In the case where the terminal application 352 is a small program, the terminal application 352 may be directly opened on the user terminal 350 by searching for relevant information of the terminal application 352 (such as the name of the terminal application 352, etc.), scanning a graphic code (such as a barcode, a QR code, etc.) of the terminal application 352, etc., without installing the terminal application 352.

[0050] In an application scenario of the embodiment of the present disclosure, a user can use a user terminal 350 to send an instant message to a server 310 via a network 340. Other user terminals 350 can receive the instant message from the server 310 via the network 340. In the case of group instant messaging, the instant messages sent by different user terminal devices 350 can be synchronized through the server 310 to ensure that different user terminals 310 in the same instant messaging group can receive the instant message.

[0051] It should be understood that Figure 3 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0052] Figure 4 A flowchart 400 of a method for recording instant audio / video information according to an embodiment of the present invention is schematically illustrated. First, in step 410, in response to a first recording instruction, the first instant audio / video information is recorded and stored. In one embodiment, the first recording instruction may include a user action instruction, such as pressing and holding to speak or pressing and holding to shoot a video, double-clicking to start, and may also include user action instructions defined in other ways. In another embodiment, the first recording instruction may also include instructions input by the user, such as voice instructions, text instructions, etc. In one embodiment, the first instant audio / video information may be stored locally or remotely stored in the cloud or server.

[0053] In one embodiment, step 410 may include the step of creating an audio / video storage box with a predefined storage space, wherein in this audio / video storage box, the first instant audio / video information is stored. In one embodiment, the metric of the predefined storage space may include time length. In an alternative embodiment, the predefined storage space may include other suitable metrics, such as byte size etc. In one embodiment, this audio / video storage box is set up in local background or is set up in server or the cloud, and it should be noted that, even if this audio / video storage box is set up in local background, closing background does not affect the use of this function. In one example, the audio / video storage box may have a predefined space of 60s time length.

[0054] Instant messaging allows a user to communicate with multiple other users using real-time audio and / or video information over the Internet. For example, different sessions can be used to perform instant messaging with different objects, or different objects can be used in the same session (e.g., in an instant messaging group). In one embodiment, the session is a chat window of an instant messaging software. Therefore, embodiments of the present invention can be used for instant messaging with multiple different objects.

[0055] As stated previously, the embodiment of the present invention can be used for instant messaging for multiple different objects. Therefore, in one embodiment, step 410 may include creating multiple audio / video storage boxes with predefined storage space, wherein each audio / video storage box is associated with different sessions. For example, when a user performs instant messaging with other objects in different sessions A and B, an audio / video storage box associated with session A may be created for session A, and an audio / video storage box associated with session B may also be created for session B. The audio / video storage boxes for different sessions are independent of each other. Therefore, the embodiment of the present invention can simultaneously implement the continuation of instant audio / video information for different sessions. In an application scenario, a user may first record a voice message for object A in chat window A. When recording halfway, the recording may be paused, and a new chat window B may be opened to record a voice message for object B. When recording halfway for B, the user may return to chat window A, and based on the previously recorded voice message, the other half of the voice message may be recorded and sent for A. Then the user may return to chat window B, and based on the previously recorded voice message, the other half of the voice message may be recorded and sent for B.

[0056] In another embodiment, step 410 may include creating multiple audio / video storage boxes with predefined storage space, wherein each audio / video storage box is associated with different objects of the same session. For example, when a user simultaneously carries out instant communication with object A and object B in the same session (for example, in an instant messaging group), an audio / video storage box associated with object A can be created for object A, and an audio / video storage box associated with object B can also be created for object B. The audio / video storage boxes for different objects are independent of each other. Therefore, the embodiment of the present invention can simultaneously realize the continuation of instant audio / video information for different objects in the same session. In an application scenario, a user can record a voice message (for example, "@A") for object A in a chat group. When recording halfway, the user can pause recording the voice message for object A, and record the voice message (for example, "@B") for object B. When recording the voice message for B halfway, the user can pause recording the voice message for object B. Then you can switch to the conversation with object A again (for example, "@A" again), and based on the previously recorded voice message for object A, continue to record the other half of the voice message for object A, and after the recording is completed, combine the two voice messages for object A into one voice message and send it. Then you can switch to the conversation with object B (for example, "@B" again), and based on the previously recorded voice message for object B, continue to record the other half of the voice message for object B, and after the recording is completed, combine the two voice messages for object B into one voice message and send it. Figure 10a-10j The present embodiment has been described in detail, and thus will not be described in detail here.

[0057] In yet another embodiment, step 410 may include creating multiple audio / video storage boxes with predefined storage space, wherein each audio / video storage box is associated with different sessions and is associated with different objects in the same session. For example, when a user carries out instant communication with different objects A, B, C in different sessions A and B (communicating with object A in session A, communicating with objects B and C in session B), an audio / video storage box associated with session A can be created for session A, while an audio / video storage box associated with object B and object C can also be created for different objects B and C in session B. The audio / video storage boxes for different objects in different sessions and the same session are independent of each other. Therefore, the embodiment of the present invention can simultaneously realize the continuation of instant audio / video information for different objects in different sessions and the same session. In an application scenario, a user can first record a voice message for object A in chat window A. When recording is halfway through, you can pause the recording, open a new group chat window B, and record a voice message for object B in group B (for example, "@B"). When recording is halfway through, pause recording the voice message for object B in group chat window B, and record a voice message for object C in the group chat window B (for example, "@C"). When recording for object C is halfway through, pause recording the voice message for object C. Return to chat window A and, based on the previously recorded voice message, record and send the other half of the voice message for A. Then return to group chat window B and switch to object B (for example, "@B" again). Based on the previously recorded voice message, record and send the other half of the voice message for B. Then switch to object C in group chat window B again (for example, "@C" again). Based on the previously recorded voice message, record and send the other half of the voice message for C.

[0058] It should be understood that the above application scenarios are intended to illustrate the embodiments of the present invention rather than to limit the embodiments of the present invention. For the sake of clarity and ease of understanding, the embodiments of the present invention are explained in the following steps by taking the instant messaging with the same object in the same session as an example. Based on the following description, those skilled in the art can implement instant messaging for multiple objects.

[0059] In step 420, in response to the first stop recording instruction, the first instant audio / video information is stopped from being recorded. In one embodiment, the first stop recording instruction may be generated based on a user's operation instruction (e.g., a user's action, a voice instruction), for example, the first stop recording instruction is generated based on the user releasing the hand. In another embodiment, the first stop recording instruction may be generated based on a response to an event, for example, the first stop recording instruction is automatically generated when a call reminder is received.

[0060] In one embodiment, method 400 may further include the following steps: in response to stopping recording the first instant audio / video information, calculating the remaining available audio / video information storage space of the audio / video storage box. In an example where the audio / video storage box has a time length of 60s, when the first instant audio / video information is 12s, the remaining available audio / video information storage space is 60s-12s=48s.

[0061] In step 430, in response to the second recording instruction, the second instant audio / video information is recorded and stored. In one embodiment, the second recording instruction may also include various types of instructions, such as various gesture instructions, voice instructions, etc. In one embodiment, the second recording instruction is the same instruction as the first recording instruction, for example, both may be gesture instructions (such as a press and hold recording instruction), etc. In another embodiment, the second recording instruction is a different instruction from the first recording instruction, for example, the first recording instruction is a gesture instruction (such as a press and hold recording instruction), and the second recording instruction may be a voice instruction, etc.

[0062] Figure 5 Shows Figure 4 The schematic flow chart of recording and storing the second audio / video information (ie, step 430 in method 400 ) in the instant audio / video information recording method is shown.

[0063] In one embodiment, in step 431, in response to the second recording instruction, the second instant audio / video information is recorded, and the second instant audio / video information is stored in the remaining available audio / video information storage space. In one embodiment, the first instant audio / video information and the second instant audio / video information are stored in the audio / video storage box with a default interval (e.g., 0.5s), and adding an interval can make the instant audio / video information combined later more natural, and can also avoid aliasing of two sections of information. In another embodiment, there is no interval between the first instant audio / video information and the second instant audio / video information, and storing information in this way can save the space of the storage box, record and store more information. In one embodiment, the second instant audio / video information is stored after the first instant audio / video information.

[0064] In step 432, it is determined whether the second instant audio / video information occupies the remaining available audio / video information storage space. In the example where the audio / video storage box has a time length of 60 seconds, determining whether the second instant audio / video information occupies the remaining available audio / video information storage space is to determine whether the length of the second instant audio / video information reaches 48 seconds.

[0065] If the second instant audio / video information occupies the remaining available audio / video information storage space (for example, the second instant audio / video information length reaches 48 seconds), jump to step 435, in which the recording of the second instant audio / video information is stopped.

[0066] If the second instant audio / video information does not fill up the remaining available audio / video information storage space (e.g., the second instant audio / video information length does not reach 48s), the second instant audio / video information is continued to be recorded until the second instant audio / video information is stopped in response to the second stop recording instruction (step 433, step 434). Similar to the first stop recording instruction, the second stop recording instruction can be generated based on the user's operation instruction (e.g., the user's action, voice instruction), for example, based on the user letting go and generating the second stop recording instruction. The second stop recording instruction can also be generated based on a response to an event, such as automatically generating a second stop recording instruction when receiving an incoming call reminder. In one embodiment, the second stop recording instruction can be the same as the first stop recording instruction, for example, both are generated based on user instructions. In another embodiment, the second stop recording instruction can be different from the first stop recording instruction, for example, one is generated based on a user instruction and the other is generated based on a response to an event.

[0067] Back to Figure 4 In step 440, in response to stopping recording the second instant audio / video information, the first instant audio / video information and the second instant audio / video information are synthesized into combined instant audio / video information.

[0068] In one embodiment, method 400 may also include step 450, and the instant audio / video information of the combination is operated. In one embodiment, step 450 may include: in response to synthesizing the first instant audio / video information and the second instant audio / video information into the instant audio / video information of the combination, if the second instant audio / video information fills up the remaining available audio / video information storage space, the instant audio / video information of the combination may be automatically sent. In another alternative embodiment, step 450 may include, in response to synthesizing the first instant audio / video information and the second instant audio / video information into the instant audio / video information of the combination, if the second instant audio / video information fills up the remaining available audio / video information storage space, prompt information may also be displayed to prompt the user to process the instant audio / video information of the combination. In response to the received user input, the instant audio / video information of the combination is subjected to any of the following operations: converting the voice information in the instant audio / video information of the combination into text and sending or deleting, deleting the instant audio / video information of the combination, and sending the instant audio / video information of the combination. Processing the combined instant audio / video information in this way can enable the user to process information that may not be fully recorded. The user can send or delete the information as needed to avoid sending incomplete information and thus avoid repeated recording and sending, which can improve communication efficiency and save costs. In this embodiment, user input may include: user gesture instructions, such as dragging, clicking, etc.; user voice input; user text input; and any other suitable user input. In another embodiment, a prompt message can also be displayed to prompt the user that the audio / video storage box is full. The prompt message may, for example, include "Prompt: The information has exceeded the maximum capacity." In another embodiment, a prompt message can also be displayed when the second instant audio / video information is about to fill up the remaining available audio / video information storage space to remind the user that recording is about to stop, such as displaying "Stop recording after 5s."

[0069] In another embodiment, step 450 may include: in response to synthesizing the first instant audio / video information and the second instant audio / video information into a combined instant audio / video information, if the second instant audio / video information fills the remaining available audio / video information storage space, then display a prompt message to prompt the user to process the combined instant audio / video information. In response to the received user input, the combined instant audio / video information is subjected to any of the following operations: converting the voice information in the combined instant audio / video information into text and sending or deleting it, deleting the combined instant audio / video information, and sending the combined instant audio / video information. In this embodiment, when the combined instant audio / video information is sent in step 450, the remaining unrecorded space in the audio / video storage box can be removed. Continuing the example that the audio / video storage box has a time length of 60s, if the second instant audio / video information is 17s long, then 60s-12s-17s=31s of unrecorded space is removed, and an instant audio / video information with a length of 29s is sent. It should be noted that if there is a gap (eg, 0.5 s) between the first instant audio / video information and the second instant audio / video information, the unrecorded space is 60s-12s-17s-0.5s=30.5s, and the instant audio / video information with a length of 29.5s is sent.

[0070] In one embodiment, method 400 may further include the following steps: in response to synthesizing the first instant audio / video information and the second instant audio / video information into the combined instant audio / video information, if the second instant audio / video information does not fill the remaining available audio / video information storage space, then in response to an additional recording instruction, record the additional instant audio / video information and store the additional instant audio / video information in the audio / video storage box, and in response to stopping recording the additional instant audio / video information, synthesize the additional instant audio / video information with the combined instant audio / video information. In this embodiment, the recording, storage and synthesis of the additional instant audio / video information are similar to the recording, storage and synthesis of the second instant audio / video information, so it is not repeated here. It should be noted that if there is an interval (e.g., 0.5s) between the first instant audio / video information and the second instant audio / video information, the interval needs to be included in the calculation of the remaining available audio / video information storage space. For example, in the example where the above audio / video storage box has a time length of 60s, the remaining available audio / video information storage space is 60s-12s-17s-0.5s=30.5s. In one application scenario, after combining the first and second instant audio / video information, if there is still available audio / video information storage space, one or more additional instant audio / video information can be recorded, stored, and combined in sequence until receiving a user's send, delete, etc. instruction or until the storage space of the audio / video information box is full. Figure 4 The method steps for recording, storing, and combining the second instant audio / video information described in are similar.

[0071] It should be understood that when recording and storing the first instant audio / video information (i.e., step 410), the same Figure 5 The operation shown in the figure is similar to the operation shown in the figure, and whether to continue recording is determined by judging whether the first instant audio / video information occupies the entire instant audio / video storage box. Furthermore, whether the second instant audio / video information can be continued to be recorded and stored is determined based on whether the first instant audio / video information occupies the entire instant audio / video storage box.

[0072] Figure 6 An exemplary schematic diagram of processing instant audio / video information in an audio / video storage box according to an embodiment of the present invention is shown.

[0073] like Figure 6As shown, when receiving the instruction (i.e., the first recording instruction) from the client to start recording information, the first instant audio / video information is stored in the created storage box. When receiving the pause command (i.e., the first stop recording instruction), the first instant audio / video information of 12s has been stored in the created 60s audio / video storage box. When receiving the continue recording command (i.e., the second recording instruction), the second instant audio / video information can be stored at intervals of 0.5s, and when the recording is paused again, the length of the second instant audio / video information is 17s (601). In response to the pause recording command again (i.e., stop recording the second instant audio / video information), the first instant audio / video information and the second instant audio / video information in the audio / video storage box are synthesized into a combined instant audio / video information of 29.5s in length (602). When receiving the continue recording command (i.e., the third recording instruction) again, the third instant audio / video information can be stored at intervals of 0.5s, and when the recording is paused again, the length of the third instant audio / video information is 8s (603). In response to the pause recording command (i.e. stop recording the third instant audio / video information) again, the two sections of audio / video information previously combined in the audio / video storage box and the third instant audio / video information are synthesized into the instant audio / video information (604) of the new combination of 38s in length. When sending the instant audio / video information of this new combination, the unrecorded part (i.e. the shaded part, the length is 22s) in the audio / video storage box is removed, and the instant audio / video information (605) of the combination of 38s in length is finally sent.

[0074] Figure 7 FIG. 7 shows an exemplary structural block diagram of an apparatus 700 for continuing to record instant audio / video information according to an embodiment of the present invention. Figure 7 As shown, the device 700 includes a real-time audio / video information generating module 701 and a synthesizing module 702 .

[0075] The instant audio / video information generation module 701 is used to: record and store the first instant audio / video information in response to the first recording instruction; stop recording the first instant audio / video information in response to the first stop recording instruction; and record and store the second instant audio / video information in response to the second recording instruction. The first recording instruction and the second recording instruction may include user action instructions (such as pressing and speaking, dragging) and user input instructions (such as voice input instructions). The first recording instruction and the second recording instruction may be the same instruction or different instructions. In one embodiment, the first stop recording instruction may be generated based on the user's operation instruction (such as the user's action, voice instruction), for example, the first stop recording instruction is generated based on the user's release. In another embodiment, the first stop recording instruction may be generated based on a response to an event, for example, the first stop recording instruction is automatically generated when a call reminder is received.

[0076] Synthesizing module 702 is used for: in response to stopping recording the second instant audio / video information, the first instant audio / video information and the second instant audio / video information are synthesized into the instant audio / video information of combination. In one embodiment, the second instant audio / video information can be stopped in response to the user's instruction. In another embodiment, some events can also trigger the stopping recording of the second instant audio / video information.

[0077] In one embodiment, instant audio / video information generation module 701 is also used to create an audio / video storage box with predefined storage space, wherein the first instant audio / video information is stored in the audio / video storage box. The metric of the predefined storage space can include time length, for example, the audio / video storage box can have a predefined space of 60s time length. The predefined storage space can include other appropriate metrics, such as byte size etc.

[0078] In one embodiment, the instant audio / video information generation module 701 is also used to calculate the remaining available audio / video information storage space of the audio / video storage box in response to stopping recording the first instant audio / video information, and store the second instant audio / video information in the remaining available audio / video information storage space, wherein there may be an interval between the first instant audio / video information and the second instant audio / video information, or there may not be an interval. If the second instant audio / video information fills up the remaining available audio / video information storage space, stop recording the second instant audio / video information. If the second instant audio / video information does not fill up the remaining available audio / video information storage space, continue recording the second instant audio / video information until the second instant audio / video information is stopped in response to the second stop recording instruction. The second stop recording instruction can be generated based on the user's operation instruction (such as the user's action, voice instruction), for example, based on the user letting go and generating the second stop recording instruction. The second stop recording instruction can also be generated based on a response to an event, such as automatically generating a second stop recording instruction when receiving a call reminder. The second stop recording instruction can be the same as the first stop recording instruction, or it can be different from the first stop recording instruction.

[0079] In one embodiment, instant audio / video information generation module 701 is also used for responding to synthesizing the instant audio / video information of the first instant audio / video information and the second instant audio / video information into the instant audio / video information of the combination, if the second instant audio / video information does not fill up the remaining available audio / video information storage space, then responding to an additional recording instruction, recording additional instant audio / video information and storing additional instant audio / video information in the audio / video storage box. Synthesizing module 702 is also used for responding to stopping recording additional instant audio / video information, synthesizing the additional instant audio / video information with the instant audio / video information of the combination.

[0080] In one embodiment, the instant audio / video information generation module 701 is also used to create multiple audio / video storage boxes with predefined storage space, wherein each of the multiple audio / video storage boxes is respectively associated with a different instant messaging session and / or associated with different objects in the same instant messaging session.

[0081] In one embodiment, the device 700 may also include a processing module 703, which is used to perform any of the following operations on the combined instant audio / video information: converting the voice information in the combined instant audio / video information into text and sending or deleting it, deleting the combined instant audio / video information, and sending the combined instant audio / video information. In one embodiment, when sending the combined instant audio / video information, the remaining unrecorded space in the audio / video storage box can be removed.

[0082] In one embodiment, the handling module 703 is also used to automatically send the combined instant audio / video information in response to synthesizing the first instant audio / video information and the second instant audio / video information into a combined instant audio / video information if the second instant audio / video information fills the remaining available audio / video information storage space.

[0083] Above about Figure 7 The modules described can be implemented in hardware or in hardware in combination with software and / or firmware. For example, these modules can be implemented as computer program codes / instructions, which are configured to be executed in one or more processors and stored in a computer-readable storage medium. Alternatively, these modules can be implemented as hardware logic / circuits. For example, in an embodiment, one or more of the instant audio / video information generation module 701, the synthesis module 702, and the disposal module 703 can be implemented together in a system on a chip (SoC). SoC may include an integrated circuit chip (which includes a processor (e.g., a central processing unit (CPU), a microcontroller, a microprocessor, a digital signal processor (DSP)), a memory, one or more communication interfaces, and / or one or more components in other circuits), and may optionally execute the received program code and / or include embedded firmware to perform functions. The features of the technology described herein are carrier-independent, meaning that these technologies can be implemented on various computing platforms with various processors.

[0084] Although specific functions are discussed above with reference to specific modules, it should be noted that the functions of the various modules discussed herein may be divided into multiple modules, and / or at least some functions of multiple modules may be combined into a single module. In addition, the specific module discussed herein performing an action includes the specific module itself performing the action, or alternatively the specific module calling or otherwise accessing another component or module that performs the action (or performing the action in conjunction with the specific module). Therefore, the specific module that performs an action may include the specific module itself that performs the action and / or another module that the specific module that performs the action calls or otherwise accesses.

[0085] Figure 8 An example flow chart of an application scenario according to an embodiment of the present invention is shown. Figure 8 The application scenarios shown are merely exemplary and not restrictive. Figure 8 As shown, in step 801, the user turns on the voice message function in the instant messaging tool. In step 802, the user starts to press and speak. In step 803, in response to the user starting to press and speak, the instant messaging tool starts recording voice. The recorded voice is directly stored in the created voice storage box, which can store up to 60 seconds of voice. In step 804, after recording 15 seconds of voice information, the user lets go to stop recording, and processes other functional operations in step 805. In step 805, the user can process other functional operations in the current chat window, such as sending text messages, sending pictures, or if the current chat window is a group chat window, the user can record information for other users. The user can also switch to other chat windows to process other functional operations, such as switching to another chat window to chat with others, transfer files, etc. The user can also close the instant messaging tool and process other functional operations in other applications, such as making and receiving calls, browsing news in other applications, etc. In step 806, after the user completes other tasks, he returns to the voice message function of the instant messaging tool and continues to press and speak in step 807. In step 808, in response to the user continuing to speak, the instant messaging tool starts recording voice. At this moment, the recorded information continues to be stored after the first paragraph of information in the voice storage box. During this period, if the voice message length reaches 60s, then stop recording, jump to step 809, and automatically send the voice message. As previously mentioned, it is also possible to provide a choice to the user, and process the voice message based on the user output. If the voice message length is less than 60s, then continue to record the voice message, until the user lets go and stops recording (step 810). After the user lets go, the information in the voice storage box is combined, and the user can move the voice message to text to send the combined voice message text, can click to confirm that the voice message is sent, and can also move the voice message to delete to delete the voice message.

[0086] Figure 9a-9h FIG. 1 shows a user interface for recording instant audio / video information from a user's perspective according to an embodiment of the present invention. Figure 9a-9h The method according to the embodiment of the present invention is described. Figure 9a As shown, the user turns on the voice message function in the conversation, and the microphone icon 901 is displayed, and a prompt of "press and speak" is displayed. Then, in one embodiment, in response to the first recording instruction, the audio / video information is recorded. For example, in Figure 9b In the example, the user presses and holds the generated microphone icon 901 to speak (i.e., the first recording instruction) to start recording audio information. In one embodiment, when recording audio / video information, operation options may be displayed to the user to prompt the user to perform operations. In one embodiment, when recording audio / video information, the length of the audio / video information may be displayed. For example, in Figure 9b After pressing and holding the speech button, three icons 902 appear, representing text conversion, deletion, and sending, respectively, and the length of the recorded audio can be displayed. Then, in one embodiment, in response to the first stop recording instruction, the recording of the audio / video information is stopped. Fig.9c As shown, the user releases the microphone icon and pauses recording. In one embodiment, a prompt may be displayed to remind the user that the audio / video information has been stored. For example, Figure 9d In the example, there may be a reminder mark at the voice message function icon 903 to remind that there was a previously recorded voice. The reminder mark may include any appropriate mark such as a red dot, a box, etc. After pausing the recording, other tasks can be performed. For example, in one application scenario, when the user is recording an audio / video message, he may need to talk to others. At this time, the user can release the microphone icon to pause the recording of the audio / video message and start talking to others. In another application scenario, such as Figure 9d-9e As shown, after pausing the recording of the audio / video information, the user can send a message in the input box. After completing other tasks (for example, after finishing the conversation with others or sending a text message), the reminder mark still exists. After completing other tasks, the user can return to the interface where the recording of the audio / video information was previously stopped, and operate the audio / video information. In one embodiment, the audio / video information can be deleted or sent, and the voice information in the audio / video information can be converted into text and sent or deleted. In another embodiment, the audio / video information can be continued to be recorded based on the previous audio / video information in response to a second recording instruction. For example, as Figure 9f and Figure 9gAs shown, the user can return to the voice message function, click delete to delete the previous voice content, and continue to press and hold the microphone icon 901 to continue recording the audio information based on the audio information. In one embodiment, in response to stopping the recording of the audio / video information, after receiving the user input, any of the following operations is performed on the audio / video information: converting the voice information in the audio / video information into text and sending or deleting the text, deleting the audio / video information, and sending the audio / video information. For example, Figure 9h As shown, the user releases the microphone icon to end recording the voice message, as shown in icon 904. Then the user clicks send to send the voice message, as shown in Figure 9h shown.

[0087] Figure 10a-10j FIG. 2 shows a user interface for recording instant audio / video information from a user's perspective according to another embodiment of the present invention. As mentioned above, the embodiment of the present invention can be used to perform instant messaging with different objects in the same session (e.g., in an instant messaging group). Figures 10a-10j This embodiment is described in detail. Fig.10a As shown, the user opens a multi-person communication session (e.g., a communication group) and enters a first object selection instruction to select a communication object in the session. For example, the user enters "@nigelcheng" in the input box 1001 of the communication group to select a user named "nigelcheng" as the first object for communication. In response to the first object selection instruction, the device can create an instant audio / video storage box associated with the first object for the first object. Then Fig.10b In the example, the user turns on the voice message function, and a microphone icon 1002 is displayed, and a prompt "press and speak" is displayed. In addition, the "@nigelcheng" mark 1003 can also be displayed in the interface to prompt that an instant audio message will be recorded for the first object. Fig.10c In the example, in response to a first recording instruction for a first object (ie, "nigelcheng"), a first instant audio message is recorded for the first object. Fig.10c Interface diagram and Figure 9b Similar, I will not repeat it here, the difference is, Fig.10cThe interface displays the "@nigelcheng" tag to prompt that the first instant audio message is being recorded for the first object "nigelcheng". After recording a segment of instant audio message, the recording of the first instant audio message for the first object can be paused in response to a pause recording instruction for the first object. Then, in response to a second object selection instruction (for example, entering "@dobbycheng" in the input box of the communication group), an instant audio / video storage box associated with the second object is created for the second object ("dobbycheng"). Then, the first instant audio message for the second object can be recorded for the second object in the same session. Figure 10d to Figure 10f An interface diagram is shown in which a second object in the same conversation is selected and a first instant audio message for the second object is recorded for the second object. Figure 10d-10f and Figure 10a-Figure 10c The only difference is that the user name of the communication partner becomes "dobbycheng". Therefore, I will not go into details here. Figure 10d-10f Then, in response to the pause recording instruction for the second object, the recording of the first instant audio information for the second object can be paused. Then, in response to the first object selection instruction, the communication object can be switched back to the first object "nigelcheng". For example, the user can re-enter "@nigelcheng" in the input box 1001 in the same session to switch back to the communication for the first object "nigelcheng", such as Figure 10g In one embodiment, when switching back to the first object, a reminder mark may be present to remind that there is audio information recorded for the first object. Figure 10h-Figure 10i An interface diagram showing the recording of a second instant audio message after the first instant audio message for the first object "nigelcheng" is shown. Figure 10h-Figure 10i and Figure 9f-9g Similar, except that Figure 10h-Figure 10i The "@nigelcheng" label is displayed in the interface to indicate that the instant audio information is currently being recorded for the first object "nigelcheng". Fig.10j As shown, in response to the user releasing the microphone icon, the first instant audio information and the second instant audio information for the first object "nigelcheng" are synthesized into a combined instant audio information. Then, in response to the user's selection, the combined instant audio information is sent. The steps and user interface for continuing the audio information for the second object "dobbycheng" are similar to those for the first object "nigelcheng", so they are not repeated here.

[0088] It should be understood that although the application scenario of recording voice information is mainly described above, the technical solution of the embodiment of the present invention can be used to record video information. For example, in one application scenario, video information can be recorded in the video message function. When the user records the video message, it may be necessary to talk to others or handle other tasks. At this time, the user can pause recording the video message and talk to others or perform other tasks. After completing other tasks (for example, after finishing talking with others or sending text messages), the user can return to the interface where the video message was previously stopped, and continue recording the video message based on the previous video message. After the recording is completed, the video message can be sent. It should be understood that any other embodiments and application scenarios for audio information recording described previously can be used for video information recording, and therefore will not be repeated here.

[0089] Fig.11 A schematic block diagram of a computing device 1100 according to an embodiment of the present invention is shown. The computing device 1000 is a device for executing the instant audio / video recording method according to an embodiment of the present invention.

[0090] Computing device 1100 may be a variety of different types of devices, such as a server computer, a device associated with a client (eg, a client device), a system on a chip, and / or any other suitable computing device or computing system.

[0091] The computing device 1100 may include at least one processor 1102, memory 1104, communication interface(s) 1106, a display device 1108, other input / output (I / O) devices 1110, and one or more mass storage devices 1112 that can communicate with each other, such as via a system bus 1114 or other appropriate connection.

[0092] Processor 1102 can be a single processing unit or multiple processing units, and all processing units can include single or multiple computing units or multiple cores. Processor 1102 can be implemented as one or more microprocessors, microcomputers, microcontrollers, digital signal processors, central processing units, state machines, logic circuits and / or any device that manipulates signals based on operating instructions. In addition to other capabilities, processor 1102 can be configured to obtain and execute computer-readable instructions stored in memory 1104, mass storage device 1112 or other computer-readable media, such as program codes of operating system 1116, program codes of application programs 1118, program codes of other programs 1120, etc., to implement the instant audio / video information recording method provided in an embodiment of the present invention.

[0093] The memory 1104 and the mass storage device 1112 are examples of computer storage media for storing instructions that are executed by the processor 1102 to implement the various functions described above. For example, the memory 1104 may generally include both volatile memory and non-volatile memory (e.g., RAM, ROM, etc.). In addition, the mass storage device 1112 may generally include a hard drive, a solid-state drive, a removable medium, including external and removable drives, a memory card, a flash memory, a floppy disk, an optical disk (e.g., a CD, a DVD), a storage array, a network attached storage, a storage area network, etc. The memory 1104 and the mass storage device 1112 may all be collectively referred to herein as memory or computer storage media, and may be a non-transitory medium capable of storing computer-readable, processor-executable program instructions as computer program code, which may be executed by the processor 1102 as a specific machine configured to implement the operations and functions described in the examples herein.

[0094] A plurality of program modules may be stored on a mass storage device 1112. These programs include an operating system 1116, one or more application programs 1118, other programs 1120, and program data 1122, and they may be loaded into the memory 1104 for execution. Examples of such application programs or program modules may include, for example, computer program logic (e.g., computer program code or instructions) for implementing the following components / functions: instant audio / video information generation module 701, synthesis module 702, disposal module 703, and / or other embodiments described herein. In some embodiments, these program modules may be distributed in different physical locations.

[0095] Although in Fig.11 1100, but modules 1116, 1118, 1120, and 1122, or portions thereof, may be implemented using any form of computer-readable media accessible by the computing device 1100. As used herein, "computer-readable media" includes at least two types of computer-readable media, namely, computer storage media and communication media.

[0096] Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented by any method or technology for storage of information, such as computer readable instructions, data structures, program modules or other data. Computer storage media includes but is not limited to RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD), or other optical storage devices, magnetic cassettes, magnetic tapes, magnetic disk storage devices or other magnetic storage devices, or any other non-transmission media that can be used to store information for access by a computing device.

[0097] In contrast, communication media may embody computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism. Computer storage media as defined herein does not include communication media.

[0098] The computing device 1100 may also include one or more communication interfaces 1106 for exchanging data with other devices, such as through a network, direct connection, etc. The communication interfaces 1106 may facilitate communications within a variety of network and protocol types, including wired networks (e.g., LAN, cable, etc.) and wireless networks (e.g., WLAN, cellular, satellite, etc.), the Internet, etc. The communication interfaces 1106 may also provide for communications with external storage devices (not shown), such as in a storage array, network attached storage, storage area network, etc.

[0099] In some examples, a display device 1108 such as a display may be included for displaying information and images. Other I / O devices 1110 may be devices that receive various inputs from a user and provide various outputs to a user, and may include a touch input device, a gesture input device, a camera, a keyboard, a remote control, a mouse, a printer, an audio input / output device, and the like.

[0100] It will be understood that although the first, second, third, etc. terms may be used to describe various devices, elements, or parts in this article, these devices, elements, or parts should not be limited by these terms. These terms are only used to distinguish one device, element, or part from another device, element, or part.

[0101] It should be understood that the reference to "one embodiment" throughout the specification means that the specific features, structures or characteristics associated with the embodiment are included in at least one embodiment of the present invention. Therefore, the "in one embodiment" that appears throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner.

[0102] In this document, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, or apparatus that includes a list of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements that are inherent to such process, method, or apparatus.

[0103] Although embodiments of the present invention have been described in conjunction with some embodiments, it is not intended to be limited to the specific form set forth herein. On the contrary, the scope of embodiments of the present invention is limited only by the appended claims. Additionally, although individual features may be included in different claims, these may possibly be advantageously combined, and the inclusion in different claims does not imply that the combination of features is not feasible and / or advantageous. The order of features in the claims does not imply any specific order in which the features must work. In addition, in the claims, the word "comprising" does not exclude other elements, and the indefinite article "one" or "an" does not exclude a plurality. The figure marks in the claims are provided only as clear examples and should not be interpreted as limiting the scope of the claims in any way.

Claims

1. A method for information processing, characterized in that The method comprises: In response to a first recording instruction inputted to the microphone icon, creating an audio / video storage box having a predefined storage space, and recording and storing first instant audio / video information, wherein the measurement of storing the first instant audio / video information and the predefined storage space in the audio / video storage box includes a length of time; In response to a first stop recording instruction of releasing the microphone icon, stopping recording the first instant audio / video information and calculating the remaining available audio / video information storage space of the audio / video storage box; Displaying a prompt message corresponding to the voice message function icon on the conversation interface to remind that the first instant audio / video message has been stored; Perform other tasks different from the current session; After completing the other tasks, and in response to the first instant audio / video information not occupying the entire instant audio / video storage box and receiving a second recording instruction input for the microphone icon, recording and storing the second instant audio / video information; and In response to the second instant audio / video information filling up the remaining available audio / video information storage space or receiving a second stop recording instruction, combining the first instant audio / video information and the second instant audio / video information into combined instant audio / video information; in response to a sending instruction, sending the combined instant audio / video information; The first instant audio / video information and the second instant audio / video information are stored in the audio / video storage box at predefined intervals.

2. The method according to claim 1, characterized in that In response to a second recording instruction inputted to the microphone icon, recording and storing the second instant audio / video information includes: Storing the second instant audio / video information in the remaining available audio / video information storage space; If the second instant audio / video information does not occupy the remaining available audio / video information storage space, continue recording the second instant audio / video information until the recording of the second instant audio / video information is stopped in response to a second stop recording instruction; and If the second instant audio / video information fills up the remaining available audio / video information storage space, the recording of the second instant audio / video information is stopped.

3. The method according to claim 2, characterized in that The first stop recording instruction and the second stop recording instruction are generated based on a user's operation instruction or based on a response to an event.

4. The method according to any one of claims 1 to 3, characterized in that The method further comprises: Perform any of the following operations on the combined instant audio / video information: converting the voice information in the combined instant audio / video information into text, and sending or deleting the text, deleting the combined instant audio / video information, and Send the combined instant audio / video information.

5. The method according to claim 4, characterized in that The method further comprises: Before sending the combined instant audio / video information, the remaining unrecorded space in the audio / video storage box is removed.

6. The method according to claim 2 or 3, characterized in that: The method further comprises: In response to combining the first instant audio / video information and the second instant audio / video information into the combined instant audio / video information, if the second instant audio / video information fills up the remaining available audio / video information storage space, the combined instant audio / video information is automatically sent.

7. The method according to claim 2 or 3, characterized in that: The method further comprises: In response to combining the first instant audio / video information and the second instant audio / video information into the combined instant audio / video information, if the second instant audio / video information does not occupy the remaining available audio / video information storage space, then: In response to the additional recording instruction, recording additional instant audio / video information and storing the additional instant audio / video information in the audio / video storage box, and In response to stopping recording the additional real-time audio / video information, the additional real-time audio / video information is synthesized with the combined real-time audio / video information.

8. The method according to claim 1, characterized in that In response to a first recording instruction inputted to the microphone icon, recording and storing the first instant audio / video information includes: A plurality of audio / video storage boxes with predefined storage space are created, wherein each of the plurality of audio / video storage boxes is respectively associated with a different session and / or associated with a different object in the same session.

9. A device for information processing, characterized in that: Applicable to performing instant communication with different objects in the same session, the device comprises: Real-time audio / video information generation module, used for: In response to a first recording instruction inputted to the microphone icon, creating an audio / video storage box having a predefined storage space, and recording and storing first instant audio / video information, wherein the measurement of storing the first instant audio / video information and the predefined storage space in the audio / video storage box includes a length of time; In response to a first stop recording instruction of releasing the microphone icon, stopping recording the first instant audio / video information and calculating the remaining available audio / video information storage space of the audio / video storage box; and Displaying a prompt message corresponding to the voice message function icon on the conversation interface to remind that the first instant audio / video message has been stored; performing other tasks different from the current conversation; After completing the other tasks, and in response to the first instant audio / video information not occupying the entire instant audio / video storage box and receiving a second recording instruction input for the microphone icon, recording and storing the second instant audio / video information; and Synthesis modules for: In response to the second instant audio / video information filling up the remaining available audio / video information storage space or receiving a second stop recording instruction, combining the first instant audio / video information and the second instant audio / video information into combined instant audio / video information; In response to the sending instruction, sending the combined instant audio / video information; The first instant audio / video information and the second instant audio / video information are stored in the audio / video storage box at predefined intervals.

10. A computer readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the processor is caused to perform the method according to any one of claims 1 to 8.

11. An electronic device, characterized in that: include: A storage device, the storage device is used to store a program; A processor, wherein the processor is configured to execute the program to perform the method according to any one of claims 1 to 8.

Citation Information

Patent Citations

  • Video releasing method and device, equipment and storage medium

    CN108900791A

  • Message pop-up window voice editing method and device, computer equipment and storage medium

    CN109801648A