Communication system, communication method, electronic device, and storage medium

Abstract

The application relates to the communication technology field, and relates to a communication system, a communication method, an electronic device and a storage medium. The system comprises a first communication end and a second communication end. The first communication end comprises multiple communication participants. The first communication end is provided with a first master control device, an image acquisition device and a voice acquisition device. Each communication participant corresponds to a voice acquisition device. The second communication end is provided with a second master control device. The image acquisition device acquires a first image containing the multiple communication participants. The voice acquisition device acquires a voice signal of the communication participant corresponding to the voice acquisition device. The first master control device acquires the first image and each voice signal, determines a first image position of a target communication participant in the first image according to the voice signal, and sends a second image corresponding to the first image position to the second master control device. The second master control device receives the second image and displays the second image of the target communication participant. The application can improve the communication effect.

Description

Technical Field

[0001] This application relates to the field of communication technology, and more specifically, to a communication system, communication method, electronic device, and storage medium. Background Technology

[0002] In meeting settings, conference rooms are typically equipped with a large display screen, with a panoramic camera positioned above it to achieve a face-to-face communication effect. However, when there are too many participants, it becomes difficult for the other party to accurately identify which participant is speaking, hindering effective communication. Summary of the Invention

[0003] This application provides a communication system, communication method, electronic device, and storage medium. The solution provided by this application can display the image of the speaking participant to the other party, greatly facilitating smooth communication between the two parties.

[0004] In a first aspect, this embodiment provides a communication system, including: a first communication terminal and a second communication terminal. The first communication terminal includes multiple communication participants and is equipped with a first master control device, an image acquisition device, and a voice acquisition device, with each communication participant corresponding to one voice acquisition device. The second communication terminal is equipped with a second master control device.

[0005] The image acquisition device is used to acquire a first image containing the plurality of communication participants;

[0006] The voice acquisition device is used to acquire the voice signal of the communication participant corresponding to the voice acquisition device;

[0007] The first master control device is used to acquire the first image and each of the voice signals, determine the first image position of the target communication participant in the first image based on the voice signals, and send the second image corresponding to the first image position to the second master control device; wherein, the target communication participant is the communication participant who is speaking;

[0008] The second master control device is used to receive the second image and display the second image of the target communication participant.

[0009] Optionally, the first master control device has the following functions:

[0010] Obtain the energy value of the voice signal of each of the communication participants;

[0011] The second image position of the communication participant in the first image corresponding to the voice signal with the largest energy value is taken as the first image position of the target communication participant in the first image.

[0012] Optionally, the first master control device has the following functions:

[0013] Based on the voice signal, the target calibration angle of the target communication participant in the first image is determined; wherein, the target calibration angle is the angle between the line segment formed by the image position of the target communication participant and the calibration point and the calibration line where the calibration point is located;

[0014] The position of the first image is determined based on the target calibration angle.

[0015] Optionally, the first image has a first resolution, the second image has a second resolution, and the first main control device is further configured to:

[0016] The third image corresponding to the position of the first image is cropped from the first image at the first resolution;

[0017] Adjust the resolution of the third image to obtain the second image with a second resolution.

[0018] Optionally, the third image includes an image of the target communication participant and an image of at least one other communication participant, wherein the other communication participant is a communication participant other than the target communication participant among the plurality of communication participants, and the first master control device is further configured to:

[0019] The second image is obtained by performing feature highlighting processing on the image of the target communication participant in the third image.

[0020] Optionally, the first master control device is specifically used for:

[0021] In response to the activation of the communication device at the first communication terminal, a first image containing multiple communication participants from the first communication terminal and the voice signal of each of the communication participants are acquired.

[0022] Optionally, the first master control device is further configured to:

[0023] In the case of acquiring the first image, determine the second image position of each of the communication participants in the first image;

[0024] Associate the second image location with the device identifier of the voice acquisition device corresponding to the communication participant;

[0025] Upon acquiring the voice signal, the voice signal is associated with the device identifier of the voice acquisition device corresponding to the communication participant;

[0026] Based on each of the aforementioned voice signals, determine the target device identifier of the target voice acquisition device corresponding to the target communication participant;

[0027] The first image location corresponding to the target communication participant is determined based on the target device identifier.

[0028] Secondly, this embodiment provides a communication method, including:

[0029] Acquire a first image of the first communication terminal containing multiple communication participants and the voice signal of each of the communication participants;

[0030] Based on the voice signal, the first image position of the target communication participant in the first image is determined; wherein, the target communication participant is the communication participant who is speaking.

[0031] Send the second image corresponding to the first image location to the second communication terminal, so that the second communication terminal displays the second image of the target communication participant.

[0032] Thirdly, this embodiment provides an electronic device, including a memory and a processor.

[0033] The memory is used to store computer instructions, and the processor is used to retrieve the computer instructions from the memory to perform the method as described in the second aspect.

[0034] Fourthly, this embodiment provides a non-volatile computer-readable storage medium having computer program instructions stored thereon, which, when executed by a processor, implement the method described in the second aspect.

[0035] This application embodiment acquires a first image containing multiple communication participants and the voice signal of each participant from a first communication terminal; determines the position of the currently speaking participant in the first image based on the voice signal of each participant; and sends a second image corresponding to the first image position to a second communication terminal, so that the second communication terminal displays the second image of the currently speaking participant. The solution of this application embodiment can display the image corresponding to the currently speaking participant to the other party, greatly facilitating smooth communication between the two parties.

[0036] Other features and advantages of this application will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0037] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments of the present application and, together with their description, serve to explain the principles of the present application.

[0038] Figure 1 A schematic block diagram of a communication system provided in an embodiment of this application is shown.

[0039] Figure 2 A schematic diagram of the first communication terminal provided in an embodiment of this application is shown.

[0040] Figure 3 A schematic diagram of a first image provided in an embodiment of this application is shown.

[0041] Figure 4 A schematic diagram of the calibrated angle in the first image provided in the embodiment of this application is shown.

[0042] Figure 5 A schematic diagram of a second image provided in an embodiment of this application is shown.

[0043] Figure 6 A schematic flowchart of the communication method provided in an embodiment of this application is shown.

[0044] Figure 7 A schematic block diagram of an electronic device provided in an embodiment of this application is shown. Detailed Implementation

[0045] Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of the present application.

[0046] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit the scope of this application and its application or use.

[0047] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and equipment should be considered part of the specification.

[0048] In all the examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0049] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0050] In meeting settings, conference rooms are typically equipped with a large display screen, with a panoramic camera positioned above it to achieve a face-to-face communication effect. However, when there are too many participants, it becomes difficult for the other party to accurately identify which participant is speaking, hindering effective communication.

[0051] Analysis revealed that existing solutions fail to accurately capture participants who are speaking because current communication systems only output the panoramic view containing all participants. Therefore, this application provides a communication system applicable to remote communication scenarios, such as remote conferencing and remote video calls.

[0052] like Figure 1 As shown, the communication system 1000 may include a first communication terminal and a second communication terminal. The first communication terminal and the second communication terminal correspond to two parties in the communication, such as two parties in a conference or a video call. The first communication terminal includes multiple communication participants, such as multiple attendees.

[0053] The first communication terminal is equipped with a first main control device 1110, an image acquisition device 1120, and a voice acquisition device. Each communication participant corresponds to a voice acquisition device (e.g., ...). Figure 1 (Any one of 1130-1 to 1130-n shown). The second communication terminal is equipped with a second master control device 1210.

[0054] The first master control device 1110 can be a master control display device with display function, such as a display screen with master control function. The first master control device 1110 can display the image from the second communication terminal. The installation location of the first master control device 1110 is not limited. Taking a remote conferencing scenario as an example, the first master control device 1110 can be installed directly in front of the conference table in the conference room.

[0055] Image acquisition device 1120 can be, for example, a panoramic camera. The installation location of image acquisition device 1120 is not limited. Taking a remote conferencing scenario as an example, image acquisition device 1120 can be installed directly in front of the conference table in a meeting room. In one example, such as... Figure 2 As shown, the image acquisition device 1120 can be installed above the first main control device 1110. The image acquisition device 1120 can be used to acquire a first image containing multiple communication participants (such as...). Figure 3 (As shown). The multiple communication participants are all communication participants of the first communication terminal, such as all participants in a meeting. The image acquisition device 1120 can be connected to the first main control device 1110 and send the first image it acquires to the first main control device 1110 for analysis and processing.

[0056] The voice acquisition device can be a wearable device, with each communication participant equipped with one (such as AR glasses). The voice acquisition device can be used to collect the voice signals of the communication participant corresponding to the voice acquisition device. As an example, such as... Figure 2 As shown, voice acquisition device 1130-1 acquires the voice signal of communication participant No. 1, voice acquisition device 1130-2 acquires the voice signal of communication participant No. 2, voice acquisition device 1130-3 acquires the voice signal of communication participant No. 3, and so on.

[0057] In some examples, the voice acquisition device may have a voice module. This voice module performs voice signal acquisition and / or related audio algorithm functions. For example, voice signals are acquired via a built-in microphone in the voice module. This voice signal can be analog or digital. In some examples, the voice module is an analog signal module, acquiring analog voice signals. In other examples, the voice module is a digital signal module, acquiring digital voice signals, such as PDM (Pulse Density Modulation) signals. Furthermore, the built-in audio algorithm functions in the voice module analyze multiple acquired signals to determine the voice signal generated by the corresponding communication participant.

[0058] In other examples, the voice acquisition device may also have a wireless communication module, such as a Bluetooth module. The voice acquisition device can communicate with the first master control device 1110 via its wireless communication function, transmitting the acquired voice signal to the first master control device 1110. In this example, the voice signal transmitted to the first master control device 1110 can be a digital signal. If the voice module of the voice acquisition device acquires an analog signal, it performs analog-to-digital conversion on the analog signal to obtain a digital signal, and then transmits the digital signal to the first master control device 1110.

[0059] In other examples, the voice acquisition device may also have a main control module. This main control module controls the various functional modules of the voice acquisition device. For example, it can analyze multiple signals acquired by the voice module to determine the voice signal generated by the corresponding communication participant. Or, it can control the wireless communication module to transmit data.

[0060] The first master control device 1110 can be used to acquire a first image containing multiple communication participants acquired by the image acquisition device 1120, and to acquire voice signals acquired by each voice acquisition device. The first master control device 1110 can also be used to determine the first image position of the target communication participant in the first image based on the voice signals acquired by each voice acquisition device, and send a second image corresponding to the first image position to the second master control device 1210.

[0061] In this embodiment, the target communication participant is the one currently speaking. In this embodiment, the first image position can be the pixel region corresponding to the bounding box of the target communication participant's image in the first image, the pixel position corresponding to the center point of the target communication participant's image in the first image, or the pixel position of the target communication participant in the first image determined by speech segmentation. In some examples, the first image position can be represented using relative coordinates, such as normalized coordinates, so that even if the first image is scaled, the image position of the target communication participant will not be affected.

[0062] In some examples, after acquiring the first image, the first master control device 1110 can scale the first image by a set ratio. For example, it can scale the first image from a first resolution to a second resolution. This adapts to the second resolution requirements of the second master control device 1210 for displaying the image. Optionally, the first master control device 1110 can scale and / or crop the first image based on the image position of each communication participant to reduce the background area of ​​the conference room and display the communication participant's image in the center of the image. In this way, the second communication terminal can clearly see the target communication participant who is currently speaking.

[0063] In this example, after scaling the first image, the position of the target communication participant can be determined from the scaled first image, and the second image corresponding to the first image position can be sent to the second master control device 1210.

[0064] The second master control device 1210 can also be a master control display device with display function, such as a display screen with master control function. The second master control device 1210 can display the image screen of the first communication terminal. The second master control device 1210 can be used to receive the second image corresponding to the first image position sent by the first master control device 1110 and display the second image of the target communication participant.

[0065] In some cases, the second communication terminal may also have image acquisition devices and / or voice acquisition devices, just like the first communication terminal. The specific structure and functions can be referred to the first communication terminal, and will not be elaborated here.

[0066] In this embodiment, when the target communication participant changes, the corresponding second image also changes, and the screen displayed to the second communication terminal also changes accordingly.

[0067] This application embodiment acquires a first image containing multiple communication participants and the voice signal of each participant from a first communication terminal; determines the position of the currently speaking participant in the first image based on the voice signal of each participant; and sends a second image corresponding to the first image position to a second communication terminal, so that the second communication terminal displays the second image of the currently speaking participant. The solution of this application embodiment can display the image corresponding to the currently speaking participant to the other party, greatly facilitating smooth communication between the two parties. Furthermore, by determining the image position of the target communication participant in the first image using the voice signal acquired by the voice acquisition device corresponding to each communication participant, the target communication participant can be accurately located, and the image of the target communication participant can be accurately displayed to the other party.

[0068] In some embodiments, the first master control device 1110 is configured to: acquire the energy value of the voice signal of each communication participant; and use the second image position of the communication participant in the first image corresponding to the voice signal with the largest energy value as the first image position of the target communication participant in the first image. That is, from the energy values ​​of all acquired voice signals, the largest energy value is selected, and the voice signal with the largest energy value is used as the target voice signal. This target voice signal is the voice signal acquired by the voice acquisition device of the currently speaking target communication participant. The target communication participant can be identified through this voice signal, and thus, the image position of the target communication participant in the first image can be determined.

[0069] In some examples, the energy value of a speech signal can be its intensity, such as its decibel value. In some scenarios, a speech acquisition device can acquire multiple speech signals simultaneously. In this embodiment, the energy value of the speech signal can be, for example, the highest energy value among the multiple speech signal energy values, or it can be the average energy value of the multiple speech signals.

[0070] Considering the directional and angular nature of voice signals, in some embodiments, the voice angle of each communication participant can be calibrated to identify the target communication participant through the calibrated angle corresponding to the voice signal.

[0071] Optionally, the calibration angle can be pre-calibrated. After the angle is calibrated, it can be stored in the first master control device in advance, so that no calibration is required after each communication starts, which can improve the efficiency of the communication system.

[0072] Optionally, the calibration angle can also be calibrated in real time based on the position of each communication participant in the first image at the first communication end, which can improve the accuracy of target communication participant positioning. In this example, the calibration angle can be the angle between the line segment formed by the image position of the communication participant and the calibration point, and the calibration line containing that calibration point. As an example, such as... Figure 4 The calibration point for the first image shown can be the midpoint O of the top border of the first image, and the calibration line can be the top border line of the first image. For ease of explanation, Figure 4 The middle arrow points upwards from the first image. For example... Figure 4 As shown, the target calibration angle of communication participant 1 is 30°, the target calibration angle of communication participant 2 is 150°, the target calibration angle of communication participant 3 is 45°, the target calibration angle of communication participant 2 is 135°, and so on.

[0073] In this embodiment, the main control device can also be used to: determine the target calibration angle of the target communication participant in the first image based on the voice signal corresponding to each voice acquisition device; and determine the first image position of the target communication participant in the first image based on the target calibration angle.

[0074] In this example, the target calibration angle can be the angle between the line segment formed by the image position of the target communication participant and the calibration point, and the calibration line where the calibration point is located.

[0075] In this embodiment, the calibration angle of each communication participant in the first image can be associated with the device identifier of the voice acquisition device corresponding to the communication participant. In this way, the device identifier of the voice acquisition device can be determined through the voice signal, and thus the calibration angle can be determined.

[0076] In some embodiments, the resolution of the first image can be a first resolution, and the resolution of the second image can be a second resolution. In this embodiment, the first master control device 1110 can also be used to: crop out a third image corresponding to the position of the first image from the first image at the first resolution; and adjust the resolution of the third image to obtain a second image at the second resolution. This allows for flexible adaptation to the display requirements of the second master control device at the second communication end.

[0077] The third image corresponding to the first image location can be an image at the first image location, such as an image that only includes the target communication participant. As an example, the third image could be a facial image of the target communication participant.

[0078] The third image corresponding to the first image location can also be an image within a defined range at the first image location, for example, including an image of the target communication participant and an image of at least one other communication participant. The other communication participants are those other than the target communication participant among a plurality of communication participants. As an example, the third image may include an image of the target communication participant and images of communication participants adjacent to the target communication participant.

[0079] In this example, the first master control device 1110 can also be used to: perform feature highlighting processing on the image of the target communication participant in the third image to obtain a second image. Feature highlighting processing can be, for example, highlighting or magnifying. As an example, the second image can be as follows: Figure 5 As shown, the highlighted communication participant number 3 is the target communication participant.

[0080] In some embodiments, the first master control device 1110 may further be used to: in response to the activation of the communication device of the first communication terminal, acquire a first image containing multiple communication participants of the first communication terminal and the voice signal of each communication participant. Taking a remote conferencing scenario as an example, in response to the activation of the image acquisition device of the first communication terminal, acquire a first image containing multiple communication participants of the first communication terminal; in response to the activation of the voice acquisition device of the first communication terminal, acquire the voice signal of each communication participant.

[0081] In some embodiments, the first master control device 1110 may further be used to: determine the second image position of each communication participant in the first image when the first image is acquired; associate the second image position with the device identifier of the voice acquisition device corresponding to the communication participant; associate the voice signal with the device identifier of the voice acquisition device corresponding to the communication participant when the voice signal is acquired; determine the target device identifier of the target voice acquisition device corresponding to the target communication participant based on each voice signal; and determine the first image position corresponding to the target communication participant based on the target device identifier.

[0082] As an example, the voice signal with the highest energy value is identified from each voice signal. Then, the device identifier of the voice acquisition device associated with the voice signal with the highest energy value is found, and the target communication participant is identified based on the device identifier, thereby determining the image location corresponding to the target communication participant.

[0083] In some embodiments, the first master control device may be specifically used to: acquire a first image containing multiple communication participants and the calibration angle of each communication participant in the first image, and acquire the voice signal acquired by the voice acquisition device corresponding to each communication participant; determine the target calibration angle of the target communication participant in the first image based on the energy value of each voice signal, and determine the first image position of the target communication participant in the first image based on the target calibration angle; crop a third image corresponding to the first image position from the first image with a first resolution; adjust the resolution of the third image to obtain a second image with a second resolution, and perform feature highlighting processing on the image of the target communication participant in the third image to obtain a second image with a second resolution after feature highlighting processing; and send the second image with a second resolution after feature highlighting processing to the second master control device.

[0084] This application also provides a communication method. This communication method can be applied to a first master control device at a first communication end. For example... Figure 6 As shown, the communication method may include steps S110 to S130.

[0085] Step S110: Obtain a first image of the first communication terminal containing multiple communication participants and the voice signal of each communication participant.

[0086] Step S120: Determine the first image position of the target communication participant in the first image based on the voice signal of each communication participant.

[0087] The target communication participant is the communication participant who is currently speaking.

[0088] Step S130: Send the second image corresponding to the first image position to the second communication terminal, so that the second communication terminal displays the second image of the target communication participant.

[0089] This application embodiment acquires a first image containing multiple communication participants and the voice signal of each participant from a first communication terminal; determines the position of the currently speaking participant in the first image based on the voice signal of each participant; and sends a second image corresponding to the first image position to a second communication terminal, so that the second communication terminal displays the second image of the currently speaking participant. The solution of this application embodiment can display the image corresponding to the currently speaking participant to the other party, greatly facilitating smooth communication between the two parties. Furthermore, by determining the image position of the target communication participant in the first image using the voice signal acquired by the voice acquisition device corresponding to each communication participant, the target communication participant can be accurately located, and the image of the target communication participant can be accurately displayed to the other party.

[0090] The specific implementation of the steps in the method embodiments of this application can be found in the system embodiments, and will not be repeated here.

[0091] This application also provides an electronic device. For example... Figure 7 As shown, the electronic device 2000 includes a memory 2100 and a processor 2200. The memory 2100 is used to store computer instructions, and the processor 2200 is used to call the computer instructions from the memory 2100 to execute the method described in the above embodiments.

[0092] This application also provides a non-volatile computer-readable storage medium storing computer program instructions thereon, which, when executed by a processor, implement the methods described in the above embodiments.

[0093] This application may be a system, method, and / or computer program product. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of this application.

[0094] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination of the foregoing. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0095] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0096] The computer program instructions used to perform the operations of this application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuits, such as programmable logic circuits, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), are personalized by utilizing the status information of the computer-readable program instructions. These electronic circuits can execute the computer-readable program instructions to implement various aspects of this application.

[0097] Various aspects of this application are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0098] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0099] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0100] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions. It will be well known to those skilled in the art that implementation in hardware, implementation in software, and implementation using a combination of software and hardware are equivalent.

[0101] The various embodiments of this application have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or improvement of the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein. The scope of this application is defined by the appended claims.

Claims

1. A communication system, characterized in that, include: A first communication terminal and a second communication terminal. The first communication terminal includes multiple communication participants and is equipped with a first main control device, an image acquisition device, and a voice acquisition device. Each communication participant corresponds to one voice acquisition device, and the voice acquisition device is a wearable device. The second communication terminal is equipped with a second main control device. The image acquisition device is used to acquire a first image containing the plurality of communication participants; The voice acquisition device is used to acquire the voice signal of the communication participant corresponding to the voice acquisition device; The first master control device is configured to acquire the first image and each of the voice signals, determine the target communication participant and the first image position of the target communication participant in the first image based on the voice signals, and send the second image corresponding to the first image position to the second master control device; wherein, the target communication participant is the communication participant who is speaking. The second master control device is used to receive the second image and display the second image of the target communication participant; Specifically, the first main control device is used for: Based on the voice signal, the target calibration angle of the target communication participant in the first image is determined; wherein, the target calibration angle is the angle between the line segment formed by the image position of the target communication participant and the calibration point and the calibration line where the calibration point is located; The position of the first image is determined based on the target calibration angle; The first main control device is also used for: Obtain the energy value of the voice signal of each of the communication participants; The second image position of the communication participant in the first image corresponding to the voice signal with the largest energy value is taken as the first image position of the target communication participant in the first image.

2. The system according to claim 1, characterized in that, The first image has a first resolution, the second image has a second resolution, and the first main control device is further configured to: The third image corresponding to the position of the first image is cropped from the first image at the first resolution; Adjust the resolution of the third image to obtain the second image with a second resolution.

3. The system according to claim 2, characterized in that, The third image includes an image of the target communication participant and an image of at least one other communication participant, wherein the other communication participant is a communication participant other than the target communication participant among the plurality of communication participants, and the first master control device is further configured to: The second image is obtained by performing feature highlighting processing on the image of the target communication participant in the third image.

4. The system according to claim 1, characterized in that, The first main control device is specifically used for: In response to the activation of the communication device at the first communication terminal, a first image containing multiple communication participants from the first communication terminal and the voice signal of each of the communication participants are acquired.

5. The system according to claim 1, characterized in that, The first main control device is also used for: Given the first image, determine the second image position of each of the communication participants within the first image; Associate the second image location with the device identifier of the voice acquisition device corresponding to the communication participant; Upon acquiring the voice signal, the voice signal is associated with the device identifier of the voice acquisition device corresponding to the communication participant; Based on each of the aforementioned voice signals, determine the target device identifier of the target voice acquisition device corresponding to the target communication participant; The first image location corresponding to the target communication participant is determined based on the target device identifier.

6. A communication method, characterized in that, include: Acquire a first image of a first communication terminal containing multiple communication participants and a voice signal of each of the communication participants; wherein the voice signal is acquired by a wearable device; Based on the voice signal, the target communication participant and the target communication participant's first image position in the first image are determined; wherein, the target communication participant is the communication participant who is speaking. Send the second image corresponding to the first image location to the second communication terminal, so that the second communication terminal displays the second image of the target communication participant; The step of determining the target communication participant and the target communication participant's first image position in the first image based on the voice signal includes: Based on the voice signal, the target calibration angle of the target communication participant in the first image is determined; wherein, the target calibration angle is the angle between the line segment formed by the image position of the target communication participant and the calibration point and the calibration line where the calibration point is located; The position of the first image is determined based on the target calibration angle; Obtain the energy value of the voice signal of each of the communication participants; The second image position of the communication participant in the first image corresponding to the voice signal with the largest energy value is taken as the first image position of the target communication participant in the first image.

7. An electronic device, characterized in that, Including memory and processor, The memory is used to store computer instructions, and the processor is used to retrieve the computer instructions from the memory to execute the method as described in claim 6.

8. A non-volatile computer-readable storage medium storing computer program instructions thereon, characterized in that, When the computer program instructions are executed by the processor, they implement the method of claim 6.

Images