Call method and device, and storage medium

Abstract

The invention provides a call method and device and a storage medium, and the method comprises the steps: obtaining first information of a second user corresponding to a second device, the first information comprising at least one of audio information or video information; acquiring second information of a third user corresponding to third equipment, wherein the second information comprises at least one of audio information or video information; determining display positions of a video picture of the second user and a video picture of the third user on a multi-party video call interface in the first equipment according to the first information and the second information; and displaying the video picture of the second user and the video picture of the third user according to the determined display position. According to the method provided by the invention, the video call experience of the user can be improved.

Description

Technical Field

[0001] The present application relates to the field of intelligent terminals, and in particular to a communication method, device and storage medium. Background Art

[0002] A multi-party call is a call where multiple users can participate in the same call. Usually, a multi-party call can include services such as video and audio.

[0003] Currently, in a multi-party video call scenario, when there are many participating users, multiple users may be displayed in pages, so that the main interface can only display the video images of some users. When a user is making a video call with other participants, the user may need to turn pages to see the video images of other participants, which reduces the user experience. Summary of the invention

[0004] The present application provides a calling method, device and storage medium, which are helpful to improve the user's video calling experience.

[0005] A first aspect provides a calling method, which is applied to a first device, wherein the first device conducts a multi-party video call with a second device and a third device, including: obtaining first information of a second user corresponding to the second device, the first information including at least one of audio information or video information; obtaining second information of a third user corresponding to the third device, the second information including at least one of audio information or video information; determining a display position of the video screen of the second user and the video screen of the third user on the multi-party video call interface in the first device according to the first information and the second information; and displaying the video screen of the second user and the video screen of the third user according to the determined display position.

[0006] In the present application, by obtaining the audio and video information of the participants, the video images of the participants are sorted and displayed on the homepage of the current user's device based on the audio and video information of the participants, so that the video image of the desired object can be displayed on the homepage of the current user, thereby improving the user experience.

[0007] In one possible implementation, determining the display positions of the second user's video screen and the third user's video screen on the multi-party video call interface in the first device according to the first information and the second information includes: determining the priority of the second user's video screen and the priority of the third user's video screen according to the first information and the second information; determining the display positions of the second user's video screen and the third user's video screen on the multi-party video call interface in the first device according to the priority of the second user's video screen and the priority of the third user's video screen.

[0008] In one possible implementation, determining the display positions of the second user's video screen and the third user's video screen on the multi-party video call interface in the first device according to the priority of the second user's video screen and the priority of the third user's video screen includes: if the priority of the second user's video screen is higher than the priority of the third user's video screen, displaying the second user's video screen on the home page of the multi-party video call interface in the first device, and displaying the third user's video screen on other pages of the multi-party video call interface; or, if the priority of the second user's video screen is higher than the priority of the third user's video screen, displaying the second user's video screen in the first area of ​​the home page of the multi-party video call interface in the first device, and displaying the third user's video screen in the second area, wherein the home page includes the first area and the second area, and the size of the first area is larger than the size of the second area.

[0009] In one possible implementation, the video information in the first information includes the posture of the second user, and the video information in the second information includes the posture of the third user; or, the audio information in the first information includes the volume of the second user, and the audio information in the second information includes the volume of the third user.

[0010] In one possible implementation, the volume of the second user is determined by multiple sampling values ​​in the audio stream of the second user collected by the second device, and the volume of the third user is determined by multiple sampling values ​​in the audio stream of the third user collected by the third device.

[0011] In one possible implementation manner, the audio information in the first information includes the speech content of the second user, and the audio information in the second information includes the speech content of the third user.

[0012] In one possible implementation, determining the priority of the second user's video image and the priority of the third user's video image based on the first information and the second information includes: determining whether the speech content of the second user and the speech content of the third user contain the first user corresponding to the first device; if the speech content of the second user contains the first user, and the speech content of the third user does not contain the first user, the priority of the second user's video image is higher than the priority of the third user's video image; or, if the speech content of the third user contains the first user, and the speech content of the second user does not contain the first user, the priority of the third user's video image is higher than the priority of the second user's video image.

[0013] In one possible implementation, determining the priority of the second user's video screen and the priority of the third user's video screen based on the first information and the second information includes: matching the speech content of the first user corresponding to the first device with the speech content of the second user and the speech content of the third user, respectively; if the matching degree between the speech content of the first user and the speech content of the second user is higher than the matching degree between the speech content of the first user and the speech content of the third user, the priority of the second user's video screen is higher than the priority of the third user's video screen; or, if the matching degree between the speech content of the first user and the speech content of the third user is higher than the matching degree between the speech content of the first user and the speech content of the second user, the priority of the third user's video screen is higher than the priority of the second user's video screen.

[0014] In one possible implementation manner, the method also includes: determining a target object in the speech content of a first user corresponding to the first device; if the target object in the speech content of the first user is the second user, the priority of the video image of the second user is higher than the priority of the video image of the third user; or, if the target object in the speech content of the first user is the third user, the priority of the video image of the third user is higher than the priority of the video image of the second user.

[0015] A second aspect provides a communication device, comprising one or more functional modules, wherein the one or more functional modules are used to implement the communication method as described in the first aspect.

[0016] The third aspect provides a device, comprising: a processor and a memory, wherein the memory is used to store a program; and the processor is used to run the program to implement the calling method as described in the first aspect.

[0017] A fourth aspect provides a readable storage medium, in which a program is stored. When the program is executed on a device, the device implements the calling method as described in the first aspect.

[0018] The fifth aspect provides a program, which, when executed on a processor of a device, enables the device to execute the calling method as described in the first aspect.

[0019] In one possible design, the program in the fifth aspect may be stored in whole or in part on a storage medium packaged together with the processor, or may be stored in whole or in part on a memory not packaged together with the processor. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 A schematic diagram of the structure of the device provided in the embodiment of the present application;

[0021] Figure 2 A schematic diagram of an application scenario provided for an embodiment of the present application;

[0022] Figure 3 A flowchart of an embodiment of a calling method provided by the present application;

[0023] Figure 4a and Figure 4b A schematic diagram of video screen display provided in an embodiment of the present application;

[0024] Figure 5 A flowchart of another embodiment of the calling method provided by the present application;

[0025] Figure 6 A schematic diagram of the structure of an embodiment of a communication device provided in the present application. DETAILED DESCRIPTION

[0026] In the embodiments of the present application, unless otherwise specified, the character " / " indicates that the objects before and after the association are in an or relationship. For example, A / B can represent A or B. "And / or" describes the association relationship of the associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone.

[0027] It should be pointed out that the words "first", "second", etc. involved in the embodiments of the present application are only used to distinguish the description purpose, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated, nor can they be understood as indicating or implying order.

[0028] In the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. In addition, "at least one of the following" or similar expressions refers to any combination of these items, which may include any combination of single items or plural items. For example, at least one of A, B, or C may represent: A, B, C, A and B, A and C, B and C, or A, B and C. Among them, each of A, B, and C may be an element itself, or a set containing one or more elements.

[0029] In the embodiments of the present application, "exemplary", "in some embodiments", "in another embodiment", etc. are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of the word "exemplary" is intended to present concepts in a concrete way.

[0030] In the embodiments of the present application, "of", "corresponding", and "corresponding" can sometimes be used interchangeably. It should be noted that when the distinction between them is not emphasized, the meanings to be expressed are consistent. In the embodiments of the present application, communication and transmission can sometimes be used interchangeably. It should be noted that when the distinction between them is not emphasized, the meanings to be expressed are consistent. For example, transmission can include sending and / or receiving, which can be a noun or a verb.

[0031] The equal to involved in the embodiments of the present application can be used in conjunction with greater than, and is applicable to the technical solution adopted when greater than, and can also be used in conjunction with less than, and is applicable to the technical solution adopted when less than. It should be noted that when equal to is used in conjunction with greater than, it cannot be used in conjunction with less than; when equal to is used in conjunction with less than, it cannot be used in conjunction with greater than.

[0032] A multi-party call is a call where multiple users can participate in the same call. Usually, a multi-party call can include services such as video and audio.

[0033] Currently, in a multi-party video call scenario, when there are many participating users, multiple users may be displayed in pages, so that the main interface can only display the video images of some users. When a user is making a video call with other participants, the user may need to turn pages to see the video images of other participants, which reduces the user experience.

[0034] Based on the above problems, an embodiment of the present application proposes a calling method, which is applied to a device to help improve the user's video calling experience.

[0035] The device has a display screen, a camera, a speaker and a microphone. Among them, the display screen is used to display video images. The camera is used to collect user equipment including but not limited to: smart screens, desktop computers, laptops, mobile phones, tablets, vehicle-mounted terminals, user equipment (User Equipment, UE), access terminals, user units, user stations, mobile stations, mobile stations, remote stations, remote terminals, mobile devices, user terminals, terminals, wireless communication equipment, user agents, user devices, vehicle-mounted equipment, Internet of Vehicles terminals, handheld communication equipment, handheld computing devices, satellite wireless equipment, and other equipment for communicating on wireless systems.

[0036] Figure 1 First, a schematic structural diagram of the device 100 is shown as an example.

[0037] The device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0038] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the device 100. In other embodiments of the present application, the device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0039] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0040] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0041] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0042] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0043] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the device 100. In other embodiments of the present application, the device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0044] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input through a wireless charging coil of the device 100. While the charging management module 140 is charging the battery 142, it can also power the terminal device through the power management module 141.

[0045] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0046] The wireless communication function of the device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0047] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas.

[0048] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied on the device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0049] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0050] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0051] In some embodiments, antenna 1 of device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that device 100 can communicate with the network and other devices through wireless communication technology.

[0052] The device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0053] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments, the device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0054] The device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0055] The ISP is used to process data fed back by the camera 193. For example, when taking a photo, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, and the light signal is converted into an electrical signal. The camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye.

[0056] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element converts the optical signal into an electrical signal, which is then transmitted to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0057] The digital signal processor is used to process digital signals, and in addition to processing digital image signals, it can also process other digital signals. For example, when the device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0058] Video codecs are used to compress or decompress digital videos. Device 100 may support one or more video codecs. Thus, device 100 may play or record videos in multiple coding formats.

[0059] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of device 100 can be realized, such as image recognition, face recognition, voice recognition, etc.

[0060] The external memory interface 120 can be used to connect an external memory card, such as a MicroSD card, to expand the storage capacity of the device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0061] The internal memory 121 can be used to store executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, etc.), etc. The data storage area may store data (such as audio data) created during the use of the device 100, etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device. The processor 110 executes various functional applications and data processing of the device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0062] The device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor.

[0063] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0064] Speaker 170A, also called "speaker", is used to convert audio electrical signals into sound signals. Device 100 can listen to music or listen to hands-free calls through speaker 170A. Receiver 170B, also called "earpiece", is used to convert audio electrical signals into sound signals. When device 100 answers a call or voice message, the voice can be answered by placing receiver 170B close to the human ear. Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. Headphone jack 170D is used to connect wired headphones. Pressure sensor 180A is used to sense pressure signals and can convert pressure signals into electrical signals. Gyroscope sensor 180B can be used to determine the motion posture of device 100. Air pressure sensor 180C is used to measure air pressure. Magnetic sensor 180D includes Hall sensor. Acceleration sensor 180E can detect the magnitude of acceleration of device 100 in various directions (generally three axes). Distance sensor 180F is used to measure distance. The device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the device 100 can use the distance sensor 180F to measure the distance to achieve fast focus. The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The ambient light sensor 180L is used to sense the brightness of the ambient light. The fingerprint sensor 180H is used to collect fingerprints. The temperature sensor 180J is used to detect the temperature. The touch sensor 180K, also known as a "touch device". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also known as a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. The bone conduction sensor 180M can obtain a vibration signal. The button 190 includes a power button, a volume button, etc. The motor 191 can generate a vibration prompt. The indicator 192 may be an indicator light, which may be used to indicate the charging status, power change, messages, missed calls, notifications, etc. The SIM card interface 195 is used to connect a SIM card.

[0065] Now combined Figure 2 - Figure 4 illustrates the calling method provided in the embodiment of the present application.

[0066] Figure 2 This is an application scenario architecture diagram of the call method provided in the embodiment of the present application. Figure 2 , the application scenario may include a first device, a second device and a third device.

[0067] The number of the second device and the third device may be one or more, and the first device, the second device, and the third device may form a multi-party video call scenario. In the multi-party video call scenario, a connection may be pre-established between the first device and the second device and the third device. It is understood that the above connection may be connected in a wired manner or in a wireless manner, and the embodiments of the present application do not specifically limit this.

[0068] A connection can also be established between the second device and the third device ( Figure 2 (not shown), the connection method between the second device and the third device can refer to the connection method between the first device and the second device and the third device, which will not be repeated here.

[0069] The first device may be a device used by a user, and the second device and the third device may be devices used by other participants. The first device, the second device and the third device may be the above-mentioned device 100.

[0070] It is understandable that the second device and the third device are relative to the first device, that is, for any one of the devices, the device can be the first device. From the perspective of the first device, the user using the first device can be the main user, and the users using other devices (for example, the second device and the third device) are participants. For all users in a multi-party video call scenario, each user can be the main user. For the convenience of explanation, the user using the first device will be referred to as the "first user", the user using the second device will be referred to as the "second user", and the user using the third device will be referred to as the "third user".

[0071] During use, the first device can obtain the information collected by the second device and the third device, and can display the video images of each participant in order according to the information collected by the second device and the third device, so that the participant currently speaking is displayed on the main interface, and the user can watch the video image of the participant currently speaking without manually turning pages, thereby improving the user's video call experience. Among them, the information collected by the second device and the third device may include posture information of the participants (for example, the second user and the third user), the volume of the participants, the speech content of the participants, etc.

[0072] Combined with the following Figure 3 4 and 5 illustrate an exemplary method for making a call provided in an embodiment of the present application.

[0073] like Figure 3 The figure is a flow chart of an embodiment of the calling method provided by the present application. Figure 3 In the illustrated embodiment, the first device may display the video images of the participants in order according to the user posture information collected by the second device and the third device, specifically including the following steps:

[0074] Step 301: The second device recognizes the gesture of the second user, and the third device recognizes the gesture of the third user.

[0075] Specifically, the second device may capture an image of the second user through a camera, and recognize the second user's posture based on the image of the second user. The third device may capture an image of the third user through a camera, and recognize the third user's posture based on the image of the third user. The second user's posture may be used to determine the probability of whether the second user is speaking, and the third user's posture may be used to determine the probability of whether the third user is speaking.

[0076] Exemplarily, the gestures of the second user may include the following: the second user does not appear in the screen, the second user appears in the screen, the second user faces the camera, the second user speaks to the camera, and the second user waves to the camera, etc. Similarly, the gestures of the third user may also include the following: the third user does not appear in the screen, the third user appears in the screen, the third user faces the camera, the third user speaks to the camera, and the third user waves to the camera, etc.

[0077] It can be understood that the above user gestures are merely exemplary and do not constitute a limitation on the embodiments of the present application. In some embodiments, other types of user gestures may also be included.

[0078] The postures of the second user and the third user may be recognized by a preset image recognition algorithm, and the embodiment of the present application does not specifically limit the preset image recognition algorithm.

[0079] In some optional embodiments, the second device may continuously recognize the gesture of the second user, and the third device may continuously recognize the gesture of the third user.

[0080] In some optional embodiments, since the recognition of gestures requires power consumption and computing power, in order to save power consumption and computing power of the second device and the third device, the second device may periodically recognize the gestures of the second user, and the third device may periodically recognize the gestures of the third user. The period may be preset, or may be manually adjusted by the user, and the embodiments of the present application do not specifically limit this.

[0081] In some optional embodiments, in order to save power consumption and computing power of the second device and the third device, the second device can recognize the posture of the second user when detecting the second user's voice; the third device can recognize the posture of the third user when detecting the third user's voice.

[0082] It can be understood that the first device can also recognize the posture of the first user, wherein the way in which the first device recognizes the posture of the first user can specifically refer to the way in which the second device recognizes the posture of the second user or the way in which the third device recognizes the posture of the third user in the above embodiment, which will not be repeated here.

[0083] Step 302: The second device sends the gesture of the second user to the first device, and the third device sends the gesture of the third user to the first device. Correspondingly, the first device receives the gesture of the second user and the gesture of the third user.

[0084] Specifically, after recognizing the gesture of the second user, the second device may send the gesture of the second user to the first device; after recognizing the gesture of the third user, the third device may send the gesture of the third user to the first device.

[0085] It can be understood that since the second device, the third device and the first device are in a multi-party call scenario, the second device can send the second user's gesture to the third device at the same time as sending the second user's gesture to the first device, thereby allowing the third device to sort and display the video images of the participants; or, the third device can send the third user's gesture to the second device at the same time as sending the third user's gesture to the first device, thereby allowing the second device to sort and display the video images of the participants.

[0086] Likewise, the first device may also send the gesture of the first user to the second device and the third device.

[0087] It is understandable that when the second device sends the gesture of the second user, it can also carry the identification number of the second device corresponding to the gesture, wherein the identification number of the second device is used to uniquely identify the identity of the second device, so that after the first device receives the gesture of the second user, it can determine which device sent the gesture of the second user. When the third device sends the gesture of the third user, it can also carry the identification number of the third device corresponding to the gesture, wherein the identification number of the third device is used to uniquely identify the identity of the third device, so that after the first device receives the gesture of the third user, it can determine which device sent the gesture of the third user.

[0088] Step 303: The first device determines display positions of the second user's video screen and the third user's video screen on the multi-party video call interface in the first device based on the second user's posture and the third user's posture.

[0089] Specifically, after the first device receives the gesture of the second user sent by the second device and the gesture of the third user sent by the third device, it can determine the display position of the second user's video screen and the third user's video screen on the multi-party video call interface in the first device based on the gesture of the second user and the gesture of the third user. As an implementation method, the display position of the second user's video screen and the third user's video screen on the multi-party video call interface in the first device can be determined according to the priority of the second user's video screen and the third user's video screen.

[0090] For example, assuming that the priority of the video screen of the second user is higher than that of the video screen of the third user, the video screen of the second user with high priority can be displayed preferentially on the home page (i.e., the main interface) of the first device, and the video screen of the third user with low priority can be displayed on other pages. As an implementation method, the other page is the page displayed after the user slides or performs other operations on the home page. For example, the other page can be the second page, the third page, etc.

[0091] It is understandable that the above three pages are merely exemplary illustrations and do not constitute a limitation on the embodiments of the present application. In some embodiments, more or fewer pages may be included.

[0092] The priority may be determined according to the gesture of the second user and the gesture of the third user.

[0093] For example, the postures of the second user include the second user not appearing in the screen, the second user appearing in the screen, the second user facing the camera, the second user talking to the camera, and the second user waving to the camera; and the postures of the third user include the third user not appearing in the screen, the third user appearing in the screen, the third user facing the camera, the third user talking to the camera, and the third user waving to the camera.

[0094] If the first device determines that the second user's gesture is the second user waving at the camera, and / or the third user's gesture is that the third user does not appear in the screen, it can be determined that the second user's video image has a higher priority than the third user's video image, that is, the second user's video image can be displayed on the homepage first, and the third user's video image can be displayed on a later page, such as the second page, the third page, etc. Or,

[0095] If the first device determines that the second user's posture is that the second user does not appear in the screen, and / or the third user's posture is that the third user is waving to the camera, it can be determined that the priority of the third user's video screen is higher than that of the second user's video screen. In other words, the third user's video screen can be displayed on the homepage first, and the second user's video screen can be displayed on a later page, for example, the second page, the third page, etc.

[0096] It can be understood that after the second device receives the gestures of the users of the first device and the third device, it can also determine the display positions of the video screen of the first user and the video screen of the third user on the multi-party video call interface in the second device, or, after the third device receives the gestures of the users of the first device and the second device, it can also determine the display positions of the video screen of the first user and the video screen of the second user on the multi-party video call interface in the third device.

[0097] Among them, the method for determining the display positions of the first user's video screen and the third user's video screen on the multi-party video call interface in the second device, and the method for determining the display positions of the first user's video screen and the second user's video screen on the multi-party video call interface in the third device, can be specifically referred to the method for determining the display positions of the second user's video screen and the third user's video screen on the multi-party video call interface in the first device, and will not be repeated here.

[0098] In some optional embodiments, multiple users' pictures can be displayed in one page. The multiple pictures can be pictures of multiple different sizes. Exemplarily, assuming that the priority of the second user's video picture is higher than that of the third user's video picture, the video picture of the second user with higher priority can be displayed in a picture with a larger size, and the video picture of the third user with lower priority can be displayed in a picture with a smaller size, or, assuming that the priority of the third user's video picture is higher than that of the second user's video picture, the video picture of the third user with higher priority can be displayed in a picture with a larger size, and the video picture of the second user with lower priority can be displayed in a picture with a smaller size.

[0099] Step 304: The first device displays the video picture of the second user and the video picture of the third user according to the determined display position.

[0100] Figure 4a and Figure 4b A schematic diagram showing the order of video frames.

[0101] Figure 4a A schematic diagram of an embodiment of a video picture sorting and displaying method. Figure 4aAssuming that the priority of the second user's video screen is higher than that of the third user's video screen, the first device's homepage may display the second user's video screen with a higher priority, for example, the homepage displays the video screen of the second user A. The first device's second page may display the third user's video screen with a lower priority, for example, the second page displays the video screen of the third user B, wherein the second page is the page displayed after the user slides or performs other operations on the homepage.

[0102] Figure 4b A schematic diagram of another embodiment of a video picture sorting and displaying method. Figure 4b , assuming that the priority of the second user's video screen is higher than that of the third user's video screen, the second user's video screen with higher priority can be displayed in the first area of ​​the homepage of the first device, and the third user's video screen with lower priority can be displayed in the second area of ​​the homepage of the first device. The size of the first area is larger than the second area. In this way, the first user can watch the user he is talking to on the main interface, improving the user experience.

[0103] like Figure 5 FIG. 1 is a flow chart of another embodiment of the calling method provided by the present application. Figure 5 In the illustrated embodiment, the first device may display the video images of the participants in order according to the user volume and / or speech content collected by the second device and the user volume and / or speech content collected by the third device, specifically including the following steps:

[0104] Step 501: The second device collects the voice of the second user, and the third device collects the voice of the third user.

[0105] Specifically, when the second user is speaking, the second device can collect the second user's voice through the microphone; when the third user is speaking, the third device can collect the third user's voice through the microphone.

[0106] Step 502: The second device sends the audio stream of the second user to the first device, and the third device sends the audio stream of the third user to the first device. Accordingly, the first device receives the audio stream of the second user sent by the second device and the audio stream of the third user sent by the third device.

[0107] Specifically, after collecting the voice of the second user, the second device can send the audio stream of the second user to the first device; after collecting the voice of the third user, the third device can send the audio stream of the third user to the first device.

[0108] Step 503: The first device obtains the volume and / or speech content of the second user based on the received audio stream of the second user, and obtains the volume and / or speech content of the third user based on the received audio stream of the third user.

[0109] Specifically, after the first device receives the audio stream of the second user sent by the second device, it can obtain the corresponding volume and / or speech content based on the received audio stream of the second user. After receiving the audio stream of the third user sent by the third device, it can obtain the corresponding volume and / or speech content based on the received audio stream of the third user.

[0110] The volume may represent the decibel of the user's speech.

[0111] Exemplarily, the first device may randomly sample once in the audio stream of the second user and use the sampled value as the volume of the second user; or, the first device may randomly sample once in the audio stream of the third user and use the sampled value as the volume of the third user.

[0112] In some optional embodiments, in order to reduce errors, multiple sampling may be performed in the audio stream, and the average value of the multiple samplings may be used as the volume of the corresponding user. Exemplarily, the first device may perform multiple sampling in the audio stream of the second user, and use the average value of the multiple sampling values ​​as the volume of the second user; or the first device may perform multiple sampling in the audio stream of the third user, and use the average value of the multiple sampling values ​​as the volume of the third user.

[0113] It is understandable that the spoken content can be obtained after voice recognition based on a preset voice recognition algorithm, wherein the present application does not specifically limit the preset voice recognition algorithm. After receiving the audio stream sent by the second device or the third device, the first device can recognize the spoken content of the second user or the third user based on the preset voice recognition algorithm.

[0114] Step 504: The first device determines the display positions of the second user's video screen and the third user's video screen on the multi-party video call interface in the first device based on the second user's volume and / or speech content and the third user's volume and / or speech content.

[0115] Specifically, after the first device obtains the volume and / or speech content of the second user, as well as the volume and / or speech content of the third user, the display position of the second user's video screen and the third user's video screen on the multi-party video call interface in the first device can be determined in the following manner.

[0116] Exemplarily, the first device may determine the display positions of the second user's video screen and the third user's video screen on the multi-party video call interface in the first device based on the volume of the second user and the volume of the third user.

[0117] After obtaining the volume of the second user and the third user, the first device can prioritize the video screen of the second user and the video screen of the third user according to the volume of the second user and the third user, and can determine the display position of the video screen of the second user and the video screen of the third user on the multi-party video call interface of the first device according to the priority. For example, the louder the volume, the higher the priority, that is, the video screen of the user with a high volume can be preferentially displayed on the home page, and the video screen of the user with a low volume can be displayed on other pages, such as the second page, the third page, etc.

[0118] In some optional embodiments, multiple users' pictures may be displayed in one page. The manner in which multiple pictures in one page are sequenced to display video pictures of users with different priorities may be specifically referred to the relevant description in the above embodiment, which will not be repeated here.

[0119] In some optional embodiments, the first device may determine the display positions of the second user's video screen and the third user's video screen on the multi-party video call interface in the first device based on the second user's speech content and the third user's speech content.

[0120] After obtaining the speech content of the second user and the speech content of the third user, the first device can prioritize the second user's video screen and the third user's video screen according to the speech content of the second user and the speech content of the third user, and can determine the display positions of the second user's video screen and the third user's video screen on the multi-party video call interface in the first device according to the priorities of the second user's video screen and the third user's video screen.

[0121] Among them, the method of determining the priority of the user video screen according to the speech content of the second user and the third user can be that the first device can judge whether the first user is being called according to the speech content of the second user and the speech content of the third user, and the user who calls the first user has a higher priority, and the user who does not call the first user has a lower priority.

[0122] For example, if a second user wants to speak, he can say "Xiao Wu, let me tell you my thoughts", where Xiao Wu can be the first user. At this time, the second user who is currently speaking has a higher priority, and the video screen of the second user can be displayed on the homepage. Alternatively, the video screen of the second user can be displayed in a larger size screen on the homepage.

[0123] In some optional embodiments, the first device may determine the display positions of the second user's video screen and the third user's video screen on the multi-party video call interface in the first device based on the speech content of the first user.

[0124] After obtaining the speech content of the first user, the first device can prioritize the video images of the second user and the video images of the third user according to the speech content of the first user, and can determine the display positions of the video images of the second user and the video images of the third user on the multi-party video call interface in the first device according to the priorities of the video images of the second user and the video images of the third user.

[0125] The specific method for the first device to identify the speech content of the first user can refer to the method for the first device to identify the speech content of the second user or the third user, which will not be repeated here. The method for determining the priority of the user video screen according to the speech content of the first user can be that the first device can determine the called object according to the speech content of the first user, and the priority of the user corresponding to the called object is higher, and the priority of the user who does not correspond to the called object is lower.

[0126] For example, when the first user actively calls the second user Xiao Wang, he can say "Xiao Wang, please speak". At this time, Xiao Wang, as the second user, has a higher priority, and Xiao Wang's video screen can be displayed on the homepage. Alternatively, Xiao Wang's video screen can be displayed in a larger size screen on the homepage.

[0127] In some optional embodiments, when the first device cannot determine a clear called object in the speech of the first user, the speech of the first user can be matched with the speech of the second user and the speech of the third user to determine whether the speech of the second user has a higher degree of match with the first user or the speech of the third user has a higher degree of match with the first user, so as to display the video of the user with a higher degree of match on the home page first. Alternatively, the video of the user with a higher degree of match is displayed on a larger screen on the home page first.

[0128] Among them, the way to match the speech content of the first user with the speech content of the second user and the speech content of the third user can be: the semantics of the first user is identified by a preset semantic recognition algorithm, and then the number of words with the same or similar semantics as the first user can be counted in the speech content of the second user and the speech content of the third user. The more words with the same or similar semantics as the first user, the more the speech content of the first user matches the speech content of this user, which means that the priority of this user is higher.

[0129] Alternatively, the semantics of the first user and the semantics of the second user and the third user may be respectively identified through a preset semantic recognition algorithm, and then the similarity between the semantics of the first user and the semantics of the second user and the semantics of the third user may be calculated. The higher the similarity, the more the speech content of the first user matches the speech content of this user, which means that the priority of this user is higher.

[0130] It can be understood that the above matching method is only an exemplary description and does not constitute a limitation on the embodiments of the present application. In some embodiments, other matching methods may also be used.

[0131] In some optional embodiments, the first device may first determine the priority of the second user and the third user based on the volume of the second user and the volume of the third user. If the second user and the third user have the same priority, it may determine which user's speech content of the second user and the third user is more matched with the speech content of the first user, and the priority of the user whose speech content is more matched may be higher than that of the user whose speech content is not matched. The method of determining the priority based on the volume and the method of matching based on the speech content can refer to the relevant description in the above embodiments, which will not be repeated here.

[0132] In some optional embodiments, the first device may first determine the priority of the second user and the third user based on the speech content of the first user, the speech content of the second user, and the speech content of the third user. If the second user and the third user have the same priority, it may be determined which user has a higher volume between the second user and the third user, and the priority of the user with a higher volume may be higher than that of the user with a lower volume.

[0133] Step 505: The first device displays the video picture of the second user and the video picture of the third user according to the determined display position.

[0134] Specifically, the display method of the video screen can refer to the relevant description in the above embodiment, which will not be repeated here.

[0135] Figure 6 This is a schematic diagram of the structure of an embodiment of the communication device of the present application. Figure 6 As shown, the above-mentioned call device 60 is applied to a first device, and the first device performs a multi-party video call with a second device and a third device. The call device 60 may include: an acquisition module 61, a determination module 62 and a display module 63; wherein,

[0136] The acquisition module 61 is configured to acquire first information of a second user corresponding to the second device, wherein the first information includes at least one of audio information or video information; and acquire second information of a third user corresponding to the third device, wherein the second information includes at least one of audio information or video information.

[0137] A determination module 62, configured to determine display positions of the video screen of the second user and the video screen of the third user on the multi-party video call interface of the first device according to the first information and the second information;

[0138] The display module 63 is configured to display the video picture of the second user and the video picture of the third user according to the determined display position.

[0139] In one possible implementation, the determination module 62 is further configured to determine the priority of the video picture of the second user and the priority of the video picture of the third user according to the first information and the second information;

[0140] The display positions of the second user's video picture and the third user's video picture on the multi-party video call interface in the first device are determined according to the priority of the second user's video picture and the priority of the third user's video picture.

[0141] In one possible implementation, the determination module 62 is further configured to display the video image of the second user on the home page of the multi-party video call interface in the first device, and display the video image of the third user on other pages of the multi-party video call interface if the priority of the video image of the second user is higher than the priority of the video image of the third user; or

[0142] If the priority of the video screen of the second user is higher than the priority of the video screen of the third user, the video screen of the second user is displayed in the first area of ​​the home page on the multi-party video call interface in the first device, and the video screen of the third user is displayed in the second area, wherein the home page includes the first area and the second area, and the size of the first area is larger than the size of the second area.

[0143] In one possible implementation manner, the video information in the first information includes the posture of the second user, and the video information in the second information includes the posture of the third user; or,

[0144] The audio information in the first information includes the volume of the second user, and the audio information in the second information includes the volume of the third user.

[0145] In one possible implementation, the volume of the second user is determined by multiple sampling values ​​in the audio stream of the second user collected by the second device, and the volume of the third user is determined by multiple sampling values ​​in the audio stream of the third user collected by the third device.

[0146] In one possible implementation manner, the audio information in the first information includes the speech content of the second user, and the audio information in the second information includes the speech content of the third user.

[0147] In one possible implementation, the determination module 62 is further configured to determine whether the speech content of the second user and the speech content of the third user include the first user corresponding to the first device;

[0148] If the second user's speech includes the first user, and the third user's speech does not include the first user, the priority of the second user's video is higher than that of the third user's video; or

[0149] If the speech of the third user includes the first user, and the speech of the second user does not include the first user, the priority of the video image of the third user is higher than the priority of the video image of the second user.

[0150] In one possible implementation, the determination module 62 is further configured to match the speech content of the first user corresponding to the first device with the speech content of the second user and the speech content of the third user respectively;

[0151] If the matching degree between the speech content of the first user and the speech content of the second user is higher than the matching degree between the speech content of the first user and the speech content of the third user, the priority of the video image of the second user is higher than the priority of the video image of the third user; or

[0152] If the matching degree between the speech content of the first user and the speech content of the third user is higher than the matching degree between the speech content of the first user and the speech content of the second user, the priority of the video picture of the third user is higher than the priority of the video picture of the second user.

[0153] In one possible implementation, the determining module 62 is further configured to:

[0154] Determine a target object in a speech content of a first user corresponding to the first device;

[0155] If the target object in the speech content of the first user is the second user, the priority of the video screen of the second user is higher than the priority of the video screen of the third user; or,

[0156] If the target object in the speech content of the first user is the third user, the priority of the video picture of the third user is higher than the priority of the video picture of the second user.

[0157] Figure 6 The communication device 60 provided in the illustrated embodiment can be used to execute the technical solution of the method embodiment illustrated in the present application. Its implementation principle and technical effects can be further referred to the relevant description in the method embodiment.

[0158] It should be understood that the above Figure 6 The division of the various modules of the communication device 60 shown is only a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or they can be physically separated. And these modules can all be implemented in the form of software calling through processing elements; they can also be all implemented in the form of hardware; some modules can also be implemented in the form of software calling through processing elements, and some modules can be implemented in the form of hardware. For example, the detection module can be a separately established processing element, or it can be integrated in a chip of the device. The implementation of other modules is similar. In addition, these modules can be fully or partially integrated together, or they can be implemented independently. In the implementation process, each step of the above method or each of the above modules can be completed by the hardware integrated logic circuit in the processor element or the instructions in the form of software.

[0159] For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as one or more application specific integrated circuits (ASIC), or one or more microprocessors (DSP), or one or more field programmable gate arrays (FPGA). For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).

[0160] In the above embodiments, the processor involved may include, for example, a CPU, a DSP, a microcontroller or a digital signal processor, and may also include a GPU, an embedded neural network processor (Neural-network Process Units; hereinafter referred to as: NPU) and an image signal processor (Image Signal Processing; hereinafter referred to as: ISP). The processor may also include necessary hardware accelerators or logic processing hardware circuits, such as ASIC, or one or more integrated circuits for controlling the execution of the program of the technical solution of the present application. In addition, the processor may have the function of operating one or more software programs, and the software programs may be stored in a storage medium.

[0161] An embodiment of the present application also provides a readable storage medium, in which a program is stored. When the program is run on a device, the device executes the method provided by the embodiment shown in the present application.

[0162] The embodiment of the present application also provides a program, which, when executed on a device, enables the device to execute the method provided by the embodiment shown in the present application.

[0163] Those of ordinary skill in the art will appreciate that the various units and algorithm steps described in the embodiments disclosed herein can be implemented in a combination of electronic hardware, computer software, and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0164] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0165] In several embodiments provided in the present application, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a device to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory; hereinafter referred to as: ROM), random access memory (Random Access Memory; hereinafter referred to as: RAM), disk or optical disk and other media that can store program codes.

[0166] The above is only a specific implementation of the present application. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. The protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for making a call, characterized in that: Applied to a first device, the first device performs a multi-party video call with a second device and a third device, and the method includes: Acquire first information of a second user corresponding to the second device, where the first information includes at least one of audio information or video information; Acquire second information of a third user corresponding to the third device, where the second information includes at least one of audio information or video information; Determine, according to the first information and the second information, display positions of the video screen of the second user and the video screen of the third user on the multi-party video call interface of the first device; The video screen of the second user and the video screen of the third user are displayed according to the determined display positions.

2. The method according to claim 1, characterized in that Determining the display positions of the second user's video screen and the third user's video screen on the multi-party video call interface in the first device according to the first information and the second information includes: Determining the priority of the video picture of the second user and the priority of the video picture of the third user according to the first information and the second information; The display positions of the second user's video picture and the third user's video picture on the multi-party video call interface in the first device are determined according to the priority of the second user's video picture and the priority of the third user's video picture.

3. The method according to claim 2, characterized in that The determining, according to the priority of the video picture of the second user and the priority of the video picture of the third user, the display positions of the video picture of the second user and the video picture of the third user on the multi-party video call interface of the first device comprises: If the priority of the second user's video image is higher than the priority of the third user's video image, the second user's video image is displayed on the home page of the multi-party video call interface in the first device, and the third user's video image is displayed on other pages of the multi-party video call interface; or, If the priority of the video screen of the second user is higher than the priority of the video screen of the third user, the video screen of the second user is displayed in the first area of ​​the home page on the multi-party video call interface in the first device, and the video screen of the third user is displayed in the second area, wherein the home page includes the first area and the second area, and the size of the first area is larger than the size of the second area.

4. The method according to any one of claims 1 to 3, characterized in that: The video information in the first information includes the gesture of the second user, and the video information in the second information includes the gesture of the third user; or, The audio information in the first information includes the volume of the second user, and the audio information in the second information includes the volume of the third user.

5. The method according to claim 4, characterized in that The volume of the second user is determined by a plurality of sampling values ​​in the audio stream of the second user collected by the second device, and the volume of the third user is determined by a plurality of sampling values ​​in the audio stream of the third user collected by the third device.

6. The method according to claim 2 or 3, characterized in that: The audio information in the first information includes the speech content of the second user, and the audio information in the second information includes the speech content of the third user.

7. The method according to claim 6, characterized in that The determining the priority of the video picture of the second user and the priority of the video picture of the third user according to the first information and the second information comprises: Determine whether the speech content of the second user and the speech content of the third user include the first user corresponding to the first device; If the second user's speech includes the first user, and the third user's speech does not include the first user, the priority of the second user's video is higher than that of the third user's video; or, If the speech of the third user includes the first user, and the speech of the second user does not include the first user, the priority of the video image of the third user is higher than the priority of the video image of the second user.

8. The method according to claim 6, characterized in that The determining the priority of the video picture of the second user and the priority of the video picture of the third user according to the first information and the second information includes: Matching the speech content of the first user corresponding to the first device with the speech content of the second user and the speech content of the third user respectively; If the matching degree between the speech content of the first user and the speech content of the second user is higher than the matching degree between the speech content of the first user and the speech content of the third user, the priority of the video image of the second user is higher than the priority of the video image of the third user; or If the matching degree between the speech content of the first user and the speech content of the third user is higher than the matching degree between the speech content of the first user and the speech content of the second user, the priority of the video picture of the third user is higher than the priority of the video picture of the second user.

9. The method according to any one of claims 1 to 8, characterized in that: The method further comprises: Determine a target object in a speech content of a first user corresponding to the first device; If the target object in the speech content of the first user is the second user, the priority of the video image of the second user is higher than the priority of the video image of the third user; or, If the target object in the speech content of the first user is the third user, the priority of the video picture of the third user is higher than the priority of the video picture of the second user.

10. A device, characterized in that: include: A processor and a memory, wherein the memory is used to store a program; and the processor is used to run the program to implement the calling method as described in any one of claims 1 to 9.

11. A readable storage medium, characterized in that: The readable storage medium stores a program, and when the program is executed on a device, the calling method according to any one of claims 1 to 9 is implemented.

Images