Video calling method and device

By identifying and prioritizing unread audio information and playing it in video calls, the problem of users ignoring audio information is solved, and the information acquisition effect of video calls is improved.

JP7628615B2Active Publication Date: 2025-02-10VIVO MOBILE COMM CO LTD
View PDF 13 Cites 0 Cited by

Patent Information

Application Number
JP2023538824
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-12-25
Filing Date
2021-12-21
Publication Date
2025-02-10
Estimated Expiration
2041-12-21

AI Technical Summary

Technical Problem

During video calls, users are prone to ignore the received audio information, resulting in the missing important information.

Method used

By identifying unread audio information, determining its priority, and playing the highest priority audio information during video calls, synchronizing or switching audio channel playback methods are used to ensure that important audio information is not ignored.

Benefits of technology

It effectively avoids the phenomenon of ignoring important audio information during video calls, and improves user interaction experience and information acquisition efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007628615000001
    Figure 0007628615000001
  • Figure 0007628615000002
    Figure 0007628615000002
  • Figure 0007628615000003
    Figure 0007628615000003
Patent Text Reader

Abstract

The present application provides a video call method and apparatus, which includes: recognizing at least one unread voice information in instant messaging content during a video call; determining a priority of each unread voice information among the at least one unread voice information; determining target voice information, which is the unread voice information with the highest priority among the at least one unread voice information, based on the priority of each unread voice information; and playing the target voice information in a target sound channel.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] (CROSS REFERENCE TO RELATED APPLICATIONS) This application claims priority to Chinese Patent Application No. 202011558968.8, filed in China on December 25, 2020, the entire contents of which are incorporated herein by reference.

[0002] The present application relates to the field of communication technology, and in particular to a video calling method and device. [Background technology]

[0003] With the widespread use of electronic devices, the functions of electronic devices are becoming more and more advanced, and users can use electronic devices to make video calls. In the process of realizing the present application, the inventors have discovered that in the prior art, at least when a user uses an electronic device to make a video call, the user is likely to ignore received voice information, which may result in the user missing important information. Summary of the Invention [Problem to be solved by the invention]

[0004] The embodiments of the present application provide a video calling method and device that can solve a problem in the prior art in that when a user makes a video call using an electronic device, the user is likely to ignore received audio information, which may result in the user missing important information. [Means for solving the problem]

[0005] In order to solve the above technical problems, the present invention is realized as follows.

[0006] According to a first aspect, an embodiment of the present application provides a video calling method, the method comprising: Recognizing at least one unread voice information in the instant messaging content during the video call; determining a priority of each piece of unread voice information among the at least one piece of unread voice information; determining target voice information, which is unread voice information having the highest priority among the at least one piece of unread voice information, based on the priority of each piece of unread voice information; and playing the target audio information in a target sound channel.

[0007] According to a second aspect, an embodiment of the present application provides a video calling device, the device comprising: a recognition module for recognizing at least one unread voice information in the instant messaging content during the video call; a first determination module for determining a priority of each piece of unread audio information among the at least one piece of unread audio information; a second determination module for determining a target voice information, which is the unread voice information having the highest priority among the at least one unread voice information, according to the priority of each of the unread voice information; and a playback module for playing back the target audio information in a target sound channel.

[0008] According to a third aspect, an embodiment of the present application provides an electronic device, the electronic device including a processor, a memory, and a program or instructions stored in the memory and operable to run on the processor, the program or instructions being operable to implement steps in the video calling method described in the first aspect when executed by the processor.

[0009] According to a fourth aspect, an embodiment of the present application provides a readable storage medium having a program or instructions stored thereon, the program or instructions, when executed by a processor, implementing steps in the video calling method according to the first aspect.

[0010] According to a fifth aspect, an embodiment of the present application provides a chip, the chip comprising a processor and a communication interface, the communication interface being coupled to the processor, the processor running a program or instructions and used to implement the method according to the first aspect.

[0011] According to a sixth aspect, there is provided a computer program product stored on a non-transitory storage medium, the computer program product being operable, when executed by at least one processor, to implement the method according to the first aspect.

[0012] According to a seventh aspect, there is provided an electronic device arranged to perform the method according to the first aspect. Effect of the Invention

[0013] In an embodiment of the present application, in the process of making a video call, at least one unread voice information in the instant messaging content is recognized, a priority of each unread voice information among the at least one unread voice information is determined, and a target voice information, which is the unread voice information with the highest priority among the at least one unread voice information, is determined based on the priority of each unread voice information, and the target voice information is played in a target sound channel. In this way, the target voice information is played in the target sound channel during the video call, so that the ignoring of important voice information received during the video call can be avoided without affecting the video call. [Brief description of the drawings]

[0014] [Figure 1] 1 is a flowchart of a video calling method according to an embodiment of the present application. [Diagram 2] FIG. 2 is a schematic diagram of an interface display of an electronic device according to an embodiment of the present application. [Diagram 3] FIG. 2 is a second schematic diagram of an interface display of an electronic device according to an embodiment of the present application. [Figure 4]FIG. 3 is a third schematic diagram of an interface display of an electronic device according to an embodiment of the present application. [Diagram 5] 1 is a structural schematic diagram of a video calling device according to an embodiment of the present application; [Figure 6] FIG. 2 is a second schematic structural diagram of a video chat device according to an embodiment of the present application; [Figure 7] FIG. 3 is a third structural schematic diagram of a video chat device according to an embodiment of the present application. [Figure 8] 1 is a structural schematic diagram of an electronic device according to an embodiment of the present application; [Figure 9] FIG. 2 is a second schematic structural diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] The following clearly and completely describes the technical solutions in the embodiments of the present application in conjunction with the drawings in the embodiments of the present application, and obviously, the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by those skilled in the art on the basis of the embodiments of the present application without any creative efforts are within the scope of protection of the present application.

[0016] The terms "first," "second," etc. in the specification and claims of the present application are intended to distinguish between similar objects and are not intended to describe a particular order or sequence. It is to be understood that data so used are interchangeable where appropriate, such that the embodiments of the present application may be performed in an order other than that shown or described herein, and that the objects distinguished by "first," "second," etc. are generally of the same type and are not limited in number, e.g., the first object may be one or more. Note that "and / or" in the specification and claims refers to at least one of the objects connected, and the character " / " generally refers to an "or" relationship between the related objects.

[0017] The following describes in detail the video calling method according to the embodiment of the present application through specific embodiments and application scenarios in conjunction with the drawings.

[0018] Please refer to FIG. 1, which is a flowchart of a video calling method according to an embodiment of the present application, as shown in FIG. 1, the method includes the following steps:

[0019] Step 101: during a video call, at least one unread voice message in an instant messaging content is recognized.

[0020] Here, the instant messaging content may be communication content received by an instant messaging application program. The application program for initiating the video call and the application program for receiving the at least one unread voice information may be the same application program or different application programs. For example, a video call may be made by chat tool A, and at least one unread voice information may be received by chat tool A during the video call. Furthermore, voice information sent by chat target C may be received by chat tool A during the video call with target B by chat tool A.

[0021] Step 102, determining a priority of each piece of the at least one piece of unread voice information.

[0022] Here, the priority of the unread voice information may include a first priority, a second priority, a third priority, etc., the first priority being the highest, or may further include a high priority, a medium priority, a low priority, etc., the high priority being the highest, and this embodiment does not limit the expression format of the priority.

[0023] Also, each piece of unread voice information among the at least one piece of unread voice information may be converted into text information, key information in the text information may be extracted, and the priority of each piece of unread voice information may be determined based on the key information, or the priority of each piece of unread voice information may be determined based on the transmission target of the unread voice information, for example, the priority of the unread voice information transmitted by the reader may be set as the first priority, or the priority of the unread voice information may be determined based on the transmission frequency of the unread voice information, for example, when the same transmission target transmits multiple pieces of voice information in a short period of time, the priority of the multiple pieces of unread voice information may be set as the first priority, or the priority of the unread voice information may be determined based on the time length of the unread voice information, for example, the priority of the unread voice information whose time length exceeds a preset time length may be determined as the first priority. This embodiment does not limit the method of determining the priority of the unread voice information.

[0024] Step 103: determining a target voice information, which is the unread voice information with the highest priority among the at least one unread voice information, according to the priority of each of the unread voice information.

[0025] Here, taking as an example a case where the priority of unread audio information includes a first priority, a second priority, and a third priority, the target audio information may be unread audio information having a first priority, and taking as an example a case where the priority of unread audio information includes a high priority, a medium priority, and a low priority, the target audio information may be unread audio information having a high priority.

[0026] Step 104, playing the target audio information in a target sound channel.

[0027] Here, the target sound channel may be the left sound channel or the right sound channel, and when the current playback mode is a first playback mode, the target audio information is played on the right sound channel and the audio content of the video call is played on the left sound channel, thereby realizing the playback of the target audio information while playing the audio content of the video call; when the current playback mode is a second playback mode, the playback of the audio content of the video call is stopped and the target audio information is played on the left sound channel or the right sound channel, and when the playback of the target audio information is completed, the playback of the audio content of the video call on the first sound channel is restored.

[0028] Exemplarily, a current playback mode can be determined, and if the current playback mode is a first playback mode, the audio content of the video call is played on the right sound channel and the target audio information is played on the left sound channel. If the current playback mode is a second playback mode, the playback of the audio content of the video call is stopped on the right sound channel and the target audio information is played on the left sound channel, and when the playback of the target audio information is finished, the playback of the audio content of the video call is resumed.

[0029] Wherein, the first playback mode may be a synchronous sound channel playback mode for synchronously playing a video sound channel and an audio sound channel. The second playback mode may be a switched sound channel playback mode for pausing a video sound channel and playing an audio sound channel. As shown in FIG. 2, after setting the "sound channel playback mode" option in the setting interface and clicking "sound channel playback mode", a playback mode selection interface is entered, and as shown in FIG. 3, the playback mode selection interface displays "synchronously playing a video sound channel and an audio sound channel" and "pausing a video call sound channel and playing an audio sound channel", which can be used for the user to select the playback mode.

[0030] In addition, by playing the target audio information simultaneously with the audio content of the video call, the audio content of the video call can be played in the left sound channel and the target audio information can be played in the right sound channel, or the audio content of the video call can be played in the right sound channel and the target audio information can be played in the left sound channel.

[0031] It should be noted that in the synchronous sound channel playback mode, audio from multiple audio sources can be played simultaneously, for example, the audio content of a video call can be played and the target audio information can be played at the same time; in the switched sound channel playback mode, playback is switched between multiple audio sources, and when there are multiple audio sources, one of the audio sources can be temporarily turned off and another audio source can be played; for example, when playing the target audio information, the video call sound channel can be temporarily turned off and switched to the audio sound channel, and after the playback of the target audio information is finished, the video call sound channel can be switched to play.

[0032] In this way, by setting different playback ways in different playback modes, the user can select to play the target audio information simultaneously while playing the audio content of the video call, or the user can select to stop playing the audio content of the video call and play the target audio information, thereby avoiding the problem that the user misses important audio information due to being unable to play audio information during a video call; and the user can further set the playback mode according to his or her own preferences or habits, so as to play audio information in a relatively appropriate manner during a video call, thereby improving the effect of the video call.

[0033] It should be noted that by determining a priority of each unread voice information and playing the voice information with a relatively high priority as target voice information while maintaining the video call, the electronic device can automatically screen the received voice information, select potentially important voice information from the received voice information, and play this potentially important voice information during the video call, thereby avoiding ignoring the received voice information during the video call and reducing the possibility that the user misses important voice information.

[0034] In the prior art, when a user is making a video call and receives voice information during the video call, when the user clicks on the received voice information, the message "This function is not available during a video call" is displayed, so that the user cannot play the voice information during the video call. If the user finds that the received voice information is relatively important voice information and needs to check and reply in a timely manner, the user can only choose to turn off the video call and play the voice information, which greatly affects the user's interaction experience.

[0035] In this embodiment, target audio information can be selected from at least one unread audio information, and the target audio information can be played back while maintaining the video call, thereby selectively playing back relatively important audio information according to the importance of the audio information during the video call, thereby realizing that relatively important and urgent audio information will not be missed.

[0036] In an embodiment of the present application, during a video call, at least one unread voice information is received, target voice information is determined from the at least one unread voice information, and the target voice information is played while maintaining the video call. In this way, by playing the target voice information during the video call, it is possible to avoid ignoring important voice information received during the video call, and to play potentially important voice information, thereby improving the effect of the video call.

[0037] Optionally, playing the target audio information in a target sound channel further comprises: determining a first volume value for playing the target audio information based on a priority of the video call and a priority of the target audio information; playing the target audio information at the first volume value in a target sound channel; When the priority of the video call is higher than the priority of the target voice information, the first volume value is made smaller than the second volume value of the video call; If the priority of the video call is lower than the priority of the target audio information, the first volume value is made larger than the second volume value of the video call.

[0038] Wherein, when the priority of the video call is equal to the priority of the target voice information, the first volume value may be equal to the second volume value of the video call. Prior to determining the second volume value for playing the voice content of the video call, the priority of the video call may be determined. The priority of the video call may include a first priority, a second priority, a third priority, etc., or may further include a high priority, a medium priority, a low priority, etc., and the priority of the video call and the priority of the unread voice information may be expressed in the same format.

[0039] In addition, the priority of the video call can be determined based on the target of the video call, for example, if the target of the video call is a leader, the priority of the video call can be high priority, and if the target of the video call is a family member, the priority of the video call can be medium priority, or the priority of the video call can be determined based on the content of the video call, for example, the content of the video call can be recognized, and if the content of the video call is work-related, the priority of the video call can be high priority, and if the content of the video call is not work-related, the priority of the video call can be low priority.

[0040] In this embodiment, based on the priority of the video call and the priority of the target audio information, content with a relatively high priority is played at a relatively high volume. When the audio content of the video call and the target audio information are played simultaneously, the volume of the audio content of the video call and the volume of the target audio information are automatically adjusted, so that the user can effectively focus on relatively important content among the contents currently being played by the electronic device, and the user experience is relatively good.

[0041] Optionally, determining a priority of each piece of unread audio information among the at least one piece of unread audio information further comprises: converting each piece of unread audio information among the at least one piece of unread audio information into text information; extracting key information from the text information; and determining a priority of each of the unread voice information based on the key information.

[0042] Here, the key information may include time information, such as tomorrow, afternoon, 10 minutes later, etc., or may include object information, such as leader, boss, father, grandmother, etc., or may further include action information, such as meeting, shopping, going out, etc. The text information may be matched with a preset keyword to determine key information contained in the text information, or the key information may be extracted by a key information extraction model, which may be a neural network model, and the key information in the text information may be extracted by training the key information extraction model with big data. For example, the preset keywords may include immediately, immediately, meeting, leader, etc., and the matched preset keywords may be used as key information of the text information.

[0043] Also, the priority may be different for different key information. For example, when time information is matched with "immediately", the priority may be high, when time information is matched with "tomorrow", the priority may be low, when time information is matched with "afternoon", the priority may be "medium", when target information is matched with "leader", the priority may be high, and when target information is matched with "father", the priority may be low. When text information includes multiple preset keywords, the highest priority corresponding to the included preset keywords may be set as the priority of the text information.

[0044] In this embodiment, each piece of unread voice information among the at least one piece of unread voice information is converted into text information, key information in the text information is extracted, and a priority of each piece of unread voice information is determined based on the key information. In this way, by determining the priority of each piece of unread voice information based on the key information in the text information, the content carried in the unread voice information can be recognized to determine the priority of the unread voice information, important voice information can be determined relatively accurately, and the possibility that the user will miss important voice information can be reduced.

[0045] Optionally, after playing the target audio information in the target sound channel, the method further comprises: displaying a volume adjustment identifier for adjusting a volume value for playing the audio content of the video call and a volume value for playing the target audio information; receiving a first input for the volume adjustment identifier; The method further includes adjusting, in response to the first input, a volume value for playing audio content of the video call and a volume value for playing the target audio information.

[0046] Here, the volume adjustment identifier may include a slide block and a slide bar matching the slide block, the slide block can be moved between both ends of the slide bar, and the first input may be an operation of sliding the slide block, such as sliding the slide block to the left or sliding the slide block to the right. Take the left end of the slide bar as an example, where the left end of the slide bar represents the audio sound channel, the right end of the slide bar represents the video sound channel, and the audio content of the video call is played on the right sound channel and the target audio information is played on the left sound channel. When the slide block moves to the left end of the slide bar, the volume of the left sound channel is increased, i.e., the playback volume of the target audio information is increased, and when the slide block moves to the right end of the slide bar, the volume of the right sound channel is increased, i.e., the playback volume of the audio content of the video call is increased. By default, the slide block may be set to a 1 / 3 position, i.e., the playback volume of the target audio information is twice as high as the playback volume of the audio content of the video call.

[0047] It should be noted that the adjustment identifier for adjusting the volume value of playing the audio content of the video call and the volume value of playing the target audio information can both be the volume adjustment identifier, and the embodiment does not limit the specific expression form of the volume adjustment identifier. When recognizing the simultaneous playing of the audio content of the video call and the target audio information, the volume adjustment identifier can be displayed. According to the actual volume size of the target audio information and personal needs, the user can appropriately adjust the volume of the audio and video sound channels. If the volume of the audio sound channel is too low and thus buried in the video sound channel, the sliding block can be slid to the appropriate position to the left, and if the volume of the audio sound channel is too high, the sliding block can be slid to the appropriate position to the right.

[0048] In practical application, during a video call, after determining the target voice information from the at least one unread voice information, displaying presentation information corresponding to the target voice information, when receiving a user's click on the presentation information, the call interface of the video call is reduced, and the user enters into a chat interface of the target voice information, and the volume adjustment identifier 201 can be displayed in the chat interface of the target voice information, as shown in FIG. 4.

[0049] It should be explained that, after setting the "Sound Channel Settings" option in the setting interface and clicking the "Sound Channel Settings" option, the user enters the sound channel settings interface, and a "Turn on video audio volume adjustment mode" button can be displayed in the sound channel settings interface, so that when the "Turn on video audio volume adjustment mode" button is turned on, the volume adjustment identifier can be displayed, and when the "Turn on video audio volume adjustment mode" button is turned off, the display of the volume adjustment identifier can be canceled.

[0050] In this embodiment, by setting a volume adjustment identifier, when the audio content of the video call is played and the target audio information is played, the user can manually adjust the volume value of playing the audio content of the video call and the volume value of playing the target audio information, so that the user can adjust the volume adjustment identifier according to actual needs, and the user experience is relatively good.

[0051] Optionally, prior to playing the target audio information in the target sound channel, the method further comprises: displaying the target audio information; and displaying a playback identifier of the target audio information, the playback identifier being used to indicate a playback progress of the target audio information; After playing the target audio information in the target sound channel, the method further comprises: In the process of reproducing the target audio information, updating the reproduction identifier based on a progress of reproduction of the target audio information; receiving a second input for the playback identifier; and adjusting a progress of the reproduction of the target audio information in response to the second input.

[0052] Here, the call interface of the video call can be displayed in a reduced size, a chat interface of the target voice information can be displayed, and the target voice information can be displayed on the chat interface of the target voice information. The playback identifier can include a playback progress bar, and the playback progress of the target voice information can be determined according to the position of the playback progress bar. The second input can be an input for moving the playback progress bar in the playback identifier, for example, an operation for moving the playback progress bar to a 1 / 2 position, or an operation for moving the playback progress bar to a 1 / 4 position, etc. After adjusting the playback progress of the target voice information, the target voice information can be played back with the adjusted playback progress.

[0053] In this embodiment, by setting a playback identifier, the playback progress of the target audio information can be displayed in real time, and the user can adjust the playback progress of the target audio information according to the playback identifier, so that when the user wants to check important content in the target audio information again, the user can easily drag the playback identifier to find the important content, and the problem that the repeated playback of the target audio information affects the video call effect due to the relatively large amount of audio content carried in the target audio information can be avoided, thereby further improving the video call effect.

[0054] It should be noted that in the video calling method according to the embodiment of the present application, the execution body can be a video calling device or a control module for executing and loading the video calling method in the video calling device. In the embodiment of the present application, the video calling device according to the embodiment of the present application is taken as an example to execute and load the video calling method by the video calling device.

[0055] Referring to FIG. 5, FIG. 5 is a structural schematic diagram of a video calling device according to an embodiment of the present application. As shown in FIG. 5, the video calling device 300 includes: A recognition module 301 for recognizing at least one unread voice information in the instant messaging content during the video call; a first determination module 302 for determining a priority of each unread audio information of the at least one unread audio information; a second determination module 303 for determining a target voice information, which is the unread voice information having the highest priority among the at least one unread voice information, according to the priority of each of the unread voice information; and a playback module 304 for playing the target audio information in a target sound channel.

[0056] In an embodiment of the present application, the recognition module recognizes at least one unread voice information in the instant messaging content during the video call, the first determination module determines the priority of each unread voice information among the at least one unread voice information, the second determination module determines the target voice information, which is the unread voice information with the highest priority among the at least one unread voice information, according to the priority of each unread voice information, and the playback module plays the target voice information in a target sound channel. In this way, the target voice information is played during the video call, so that the ignoring of important voice information received during the video call can be avoided without affecting the video call.

[0057] Optionally, the playback module 304 specifically includes: determining a first volume value for playing the target audio information based on the priority of the video call and the priority of the target audio information; playing the target audio information at the first volume value in a target sound channel; If the priority of the video call is higher than the priority of the target voice information, the first volume value is made smaller than the second volume value of the video call; If the priority of the video call is lower than the priority of the target audio information, the first volume value is used to be louder than the second volume value of the video call.

[0058] Optionally, the first determination module 302 specifically: converting each piece of the at least one piece of unread voice information into text information; Extracting key information from the text information; The key information is used to determine the priority of each piece of unread voice information.

[0059] Optionally, as shown in FIG. 6, the video calling device 300: a first display module 305 for displaying a volume adjustment identifier for adjusting a volume value for playing the audio content of the video call and a volume value for playing the target audio information; a first receiving module 306 for receiving a first input for the volume adjustment identifier; and a first adjusting module 307 for adjusting a volume value for playing the audio content of the video call and a volume value for playing the target audio information in response to the first input.

[0060] Optionally, as shown in FIG. 7, the video calling device 300: a second display module 308 for displaying the target audio information and displaying a playback identifier of the target audio information, the playback identifier being used to indicate a playback progress of the target audio information; an update module 309 for updating the playback identifier according to a progress of playing the target audio information during the process of playing the target audio information; a second receiving module 310 for receiving a second input for the playback identifier; and a second adjustment module 311 for adjusting the reproduction progress of the target audio information in response to the second input.

[0061] The video calling device in the embodiment of the present application may be a device, or may be a component, integrated circuit, or chip in a terminal. The device may be a mobile electronic device or a non-mobile electronic device. For example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palmtop computer, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), and the non-mobile electronic device may be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a deposit machine, or a self-service machine, and the embodiment of the present application is not specifically limited.

[0062] The video calling device in the embodiment of the present application may be a device having an operating system, which may be the Android operating system, the iOS operating system, or other possible operating systems, and the embodiment of the present application is not specifically limited.

[0063] The video calling device according to the embodiment of the present application can implement each process implemented by the embodiment of the method of FIG. 1, and will not be further described here to avoid repetition.

[0064] Optionally, as shown in Fig. 8, the embodiment of the present application further provides an electronic device 400, including a processor 401, a memory 402, and a program or instruction stored in the memory 402 and operable on the processor 401, which can realize each process of the embodiment of the above-mentioned video calling method and achieve the same technical effect when executed by the processor 401. In order to avoid repetition, no further description will be given here.

[0065] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices described above.

[0066] FIG. 9 is a schematic diagram of the hardware structure of an electronic device for implementing an embodiment of the present application.

[0067] The electronic device 500 includes components such as, but not limited to, a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, a display unit 506, a user input unit 507, an interface unit 508, a memory 509, and a processor 510.

[0068] As can be understood by those skilled in the art, the electronic device 500 may further include a power source (e.g., a battery) for powering each component, and the power source may be logically connected to the processor 510 by a power management system, so that the power management system can realize functions such as charge / discharge management and power consumption management. The electronic device structure shown in FIG. 9 does not constitute a limitation on the electronic device, and the electronic device may include more or less components than the number of components shown, or a combination of some components, or a different arrangement of components, which will not be further described here.

[0069] Wherein, the processor 510 is used for recognizing at least one unread voice information in the instant messaging content during the video call; The processor 510 is further adapted to determine a priority of each piece of unread audio information among the at least one piece of unread audio information; The processor 510 is further adapted to determine a target voice information, which is the unread voice information having the highest priority among the at least one unread voice information, according to the priority of each of the unread voice information; The audio output unit 503 is used for playing the target audio information in a target sound channel.

[0070] In an embodiment of the present application, the processor 510 recognizes at least one unread voice information in the instant messaging content during the video call, the processor 510 determines a priority of each unread voice information among the at least one unread voice information, the processor 510 determines target voice information, which is the unread voice information with the highest priority among the at least one unread voice information, according to the priority of each unread voice information, and the audio output unit 503 plays the target voice information in a target sound channel. In this way, by playing the target voice information during the video call, it is possible to avoid ignoring important voice information received during the video call without affecting the video call.

[0071] Optionally, the processor 510 is further adapted to determine a first volume value for playing the target audio information based on a priority of the video call and a priority of the target audio information; an audio output unit 503 for playing the target audio information at the first volume value in a target sound channel; If the priority of the video call is higher than the priority of the target voice information, the first volume value is made smaller than the second volume value of the video call; If the priority of the video call is lower than the priority of the target audio information, the first volume value is used to be louder than the second volume value of the video call.

[0072] Optionally, the processor 510 further comprises: converting each piece of the at least one piece of unread voice information into text information; Extracting key information from the text information; The key information is used to determine the priority of each piece of unread voice information.

[0073] Optionally, the display unit 506 is used to display a volume adjustment identifier for adjusting a volume value for playing the audio content of the video call and a volume value for playing the target audio information; a user input unit 507 for receiving a first input for the volume adjustment identifier; Processor 510 is further adapted to adjust, in response to the first input, a volume value for playing audio content of the video call and a volume value for playing the target audio information.

[0074] Optionally, the display unit 506 is further used for displaying the target audio information and displaying a playback identifier of the target audio information, the playback identifier being used to indicate a playback progress of the target audio information; The processor 510 is further configured to update the playback identifier according to a progress of playing the target audio information during the process of playing the target audio information; The user input unit 507 is further adapted to receive a second input for the playback identifier; The processor 510 is further adapted to adjust the progress of the reproduction of the target audio information in response to the second input.

[0075] It should be understood that in the embodiment of the present application, the input unit 504 may include a graphics processor (Graphics Processing Unit, GPU) 5041 and a microphone 5042, and the graphics processor 5041 processes image data of still or video images obtained by an image capture device (e.g., a camera) in a video capture mode or an image capture mode. The display unit 506 may include a display panel 5061, and the display panel 5061 may be arranged in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 507 includes a touch panel 5071 and other input devices 5072. The touch panel 5071 is also called a touch screen. The touch panel 5071 may include two parts: a touch detection device and a touch controller. The other input devices 5072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control buttons, switch buttons, etc.), a trackball, a mouse, and a control lever, which will not be described further herein. The memory 509 may be used to store software programs and various data, including but not limited to application programs and an operating system. The processor 510 may integrate an application processor and a modem processor, where the application processor is mainly for processing the operating system, the user interface, and the application programs, etc., and the modem processor is mainly for processing wireless communication. As can be understood, the modem processor may not be integrated into the processor 510.

[0076] The embodiments of the present application further provide a readable storage medium, which may be non-volatile or volatile, and a program or instruction is stored on the readable storage medium, which, when executed by a processor, can realize each process of the above-mentioned video calling method embodiment and achieve the same technical effect. In order to avoid repetition, no further description will be given here.

[0077] Here, the processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0078] The embodiment of the present application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, the processor runs a program or instruction, and is used to realize each process of the embodiment of the above video calling method, and can achieve the same technical effect. In order to avoid repetition, no further description will be given here.

[0079] It should be understood that the chips referred to in the embodiments of the present application may be referred to as system level chips, system chips, chip systems, or systems on chips.

[0080] An embodiment of the present application further provides a computer program product, where the computer program product is stored in a non-transitory readable storage medium, and the computer program product can be executed by at least one processor to realize each process in the above embodiment of the video calling method and achieve the same technical effect. In order to avoid repetition of description, no further description will be given here.

[0081] It should be explained that in this specification, the terms "comprise", "include", or any other variants thereof are intended to cover the non-exclusive "comprise", whereby a process, method, article, or apparatus that includes a set of elements includes not only those elements, but also other elements not expressly listed or inherent to such process, method, article, or apparatus. In the absence of further limitations, an element limited by the phrase "comprises a" does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes this element. It should be pointed out that the scope of the method and apparatus in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may include performing functions in an essentially simultaneous manner or in reverse order based on the functions involved, for example, the described method can be performed in a different order than described, and various steps can be added, omitted, or combined. Also, features described with reference to some examples can be combined in other examples.

[0082] From the above description of the embodiments, it is clear to those skilled in the art that the methods of the above embodiments can be realized in the form of software and a necessary general-purpose hardware platform. Of course, they can also be realized in hardware, but in many cases the former is a more preferred embodiment. Based on this understanding, the technical solution of the present application may be substantially or in part embodied in the form of a software product. The computer software product is stored in a storage medium (e.g., ROM / RAM, magnetic disk, optical disk) and includes some instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0083] The above describes the embodiments of the present application in conjunction with the drawings, but the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not limiting. Those skilled in the art can take the suggestions of this application and make many forms without departing from the spirit and scope of the claims of this application, all of which belong to the protection scope of this application.

Claims

1. A video calling method, comprising: identifying at least one unread voice message in the instant messaging content during the video call; determining a priority of each unread voice message among the at least one unread voice message; determining a target voice message, which is an unread voice message having a highest priority among the at least one unread voice message, based on a priority of each of the unread voice messages; playing the target audio message in a target sound channel; Determining a priority of each unread voice message among the at least one unread voice message includes: converting each unread voice message of the at least one unread voice message into text information; extracting key information from the text information; determining a priority of each of the unread voice messages based on the key information.

2. said playing said target audio message in said target sound channel further comprising: determining a first volume value for playing the target voice message based on a priority of the video call and a priority of the target voice message; playing the target voice message at the first volume value in a target sound channel; If the priority of the video call is higher than the priority of the target voice message, the first volume value is smaller than the second volume value of the video call; 2. The video calling method of claim 1, further comprising: making the first volume value higher than the second volume value of the video call if the priority of the video call is lower than the priority of the target voice message.

3. After playing the target voice message in the target sound channel, the video call method includes: displaying a volume adjustment identifier for adjusting a volume value for playing the audio content of the video call and a volume value for playing the target audio message; receiving a first input for the volume adjustment identifier; 2. The method of claim 1, further comprising: adjusting, in response to the first input, a volume value at which audio content of the video call is played and a volume value at which the target audio message is played.

4. Before playing the target voice message in the target sound channel, the video calling method includes: displaying the target voice message; and displaying a playback identifier of the target voice message, the playback identifier being used to indicate a playback progress of the target voice message; After playing the target voice message in the target sound channel, the video call method includes: In the process of playing the target voice message, updating the playback identifier according to a progress of playing the target voice message; receiving a second input for the playback identifier; The video calling method of claim 1 , further comprising: adjusting a progress of playing the target voice message in response to the second input.

5. A video calling device, an identification module for identifying at least one unread voice message in the instant messaging content during the video call; a first determination module for determining a priority of each unread voice message among the at least one unread voice message; a second determination module for determining a target voice message, which is an unread voice message having a highest priority among the at least one unread voice message, based on a priority of each of the unread voice messages; a playback module for playing the target voice message in a target sound channel; The first determination module specifically includes: converting each unread voice message of the at least one unread voice message into text information; Extracting key information from the text information; The video calling device is adapted to determine a priority of each of the unread voice messages based on the key information.

6. The playback module specifically includes: determining a first volume value for playing the target voice message based on a priority of the video call and a priority of the target voice message; playing the target voice message at the first volume value in a target sound channel; If the priority of the video call is higher than the priority of the target voice message, the first volume value is lower than the second volume value of the video call; 6. The video calling device of claim 5, wherein the first volume value is used to be larger than the second volume value of the video call when the priority of the video call is lower than the priority of the target voice message.

7. The video calling device includes: a first display module for displaying a volume adjustment identifier for adjusting a volume value for playing the audio content of the video call and a volume value for playing the target audio message; a first receiving module for receiving a first input for the volume adjustment identifier; 6. The video calling device of claim 5, further comprising: a first adjustment module for adjusting a volume value for playing audio content of the video call and a volume value for playing the target audio message in response to the first input.

8. The video calling device includes: a second display module for displaying the target voice message and displaying a playback identifier of the target voice message, the playback identifier being used to indicate a playback progress of the target voice message; an update module for updating the playback identifier according to a progress of playing the target voice message during the process of playing the target voice message; a second receiving module for receiving a second input for the playback identifier; The video calling apparatus of claim 5, further comprising: a second adjustment module responsive to the second input for adjusting a progress of playing the target voice message.

9. 5. An electronic device comprising a processor, a memory, and a program or instructions stored in the memory and operable on the processor, wherein the program or instructions, when executed by the processor, implement the steps in the video calling method of any one of claims 1 to 4.

10. A computer-readable storage medium having stored thereon a program or instructions, which, when executed by a processor, implements the steps in the video calling method of any one of claims 1 to 4.

11. A chip including a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor runs a program or instructions and is used to implement steps in the video calling method of any one of claims 1 to 4.

12. A computer program stored on a non-transitory storage medium, the computer program being configured to, when executed by at least one processor, implement the steps of the video calling method according to any one of claims 1 to 4.

Citation Information

Patent Citations

  • Positioning and obtaining method and device for unread messages

    CN104123324A

  • Instant message reminding method and device, and user terminal

    CN107104887A

  • Dual-channel audio processing method and device and computer readable storage medium

    CN110278402A

  • Working mode control method, electronic equipment and storage medium

    CN111491058A

  • Multi-channel call voice control method and device

    CN111835922A