Control method, device, electronic device and storage medium of video conference system

Abstract

The present application discloses a control method, device, electronic device and storage medium of a video conference system, belonging to the field of video conference technology. The control method of the video conference system includes: collecting a first image in the environment where the video conference system is located, the first image including a first object and a second object; determining the distance data between the first object and the second object according to the first image; determining the audio parameters and display parameters of the video conference system according to the distance data; and controlling the video conference system to operate according to the audio parameters and display parameters.

Description

Technical Field

[0001] The present application belongs to the technical field of video conferencing, and specifically relates to a control method, device, electronic device and storage medium of a video conferencing system. Background Art

[0002] With the development of communication technology and the needs of the times, video conferencing is a way to enable participants from different regions to visit and communicate face to face at the same time. Due to its convenience, it has gradually become an internal and external communication tool for schools, enterprises, etc.

[0003] During a video conference, participants need to manually adjust the volume of their microphones and speakers, as well as the size of the display screen, causing them to miss important meeting content. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a control method, a control device, an electronic device and a storage medium for a video conferencing system, which eliminates the need for users to make manual adjustments during a video conference, thereby ensuring that users can clearly listen to and view the conference content during the conference.

[0005] In a first aspect, an embodiment of the present application provides a method for controlling a video conferencing system, comprising: acquiring a first image in an environment in which the video conferencing system is located, the first image including a first object and a second object; determining distance data between the first object and the second object based on the first image; determining audio parameters and display parameters of the video conferencing system based on the distance data; and controlling the video conferencing system to operate according to the audio parameters and display parameters.

[0006] In a second aspect, an embodiment of the present application provides a control device for a video conferencing system, including: a collection module, used to collect a first image in an environment where the video conferencing system is located, the first image including a first object and a second object; a determination module, used to determine distance data between the first object and the second object according to the first image;

[0007] The determination module is also used to determine the audio parameters and display parameters of the video conferencing system according to the distance data; the control module is used to control the video conferencing system to operate according to the audio parameters and display parameters.

[0008] In a third aspect, an embodiment of the present application provides an electronic device, including a processor and a memory, wherein the memory can be a program or instruction running on the processor, and when the program or instruction is executed by the processor, the steps of the method of the first aspect are implemented.

[0009] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method of the first aspect are implemented.

[0010] In a fifth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the steps of the method of the first aspect.

[0011] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method of the first aspect.

[0012] In an embodiment of the present application, a video conferencing system is deployed in a conference room, and after the participants enter the conference room, the video conferencing system is turned on. The acquisition device in the video conferencing system can acquire a first image including the participants. The distance data between the first object (the participant) and the second object (the display device) can be determined by identifying and analyzing the first image. The audio parameters and display parameters of the video conferencing system can be determined based on the distance data, and the operation of the video conferencing system can be controlled based on the audio parameters and the display parameters.

[0013] In an embodiment of the present application, before the video conference begins, the conference room image is collected and recognized, and the distance data between the participants and the display device can be determined. The audio parameters and display parameters of the video conferencing system are automatically adjusted accordingly, without the need for the user to manually adjust them during the video conference. This ensures that the user can clearly listen to and view the meeting content during the meeting, simplifies the user's operation, and enables the user to focus more on the preparation of the meeting content, greatly improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 A schematic diagram showing a flow chart of a method for controlling a video conferencing system provided in an embodiment of the present application is shown;

[0015] Figure 2 A schematic diagram showing a capture device in an embodiment of the present application acquiring a preset image;

[0016] Figure 3 The imaging curve of the CCD camera in the embodiment of the present application is shown;

[0017] Figure 4 A schematic diagram showing a first image acquired by a collection device according to an embodiment of the present application is shown;

[0018] Figure 5 A structural block diagram of a control device for a video conferencing system provided in an embodiment of the present application is shown;

[0019] Figure 6 A structural block diagram of an electronic device provided in an embodiment of the present application is shown;

[0020] Figure 7A schematic diagram of the hardware structure of an electronic device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0021] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0022] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0023] The following is combined with Figures 1 to 7 , the control method, control device, electronic device and storage medium of the video conferencing system provided in the embodiments of the present application are described in detail through specific embodiments and their application scenarios.

[0024] In an embodiment of the present application, a method for controlling a video conferencing system is provided. Figure 1 A schematic diagram of a control method of a video conferencing system provided in an embodiment of the present application is shown. Figure 1 As shown, the control method of the video conferencing system includes:

[0025] Step 102, capturing a first image in an environment where the video conferencing system is located, where the first image includes a first object and a second object;

[0026] The video conferencing system is deployed in an indoor environment, and includes a collection device capable of collecting a first image corresponding to the environment. The collection device includes a charge coupled device (CCD) camera and a laser emission device. The laser emission device can scan the indoor environment, and the CCD camera can capture an image of the indoor environment.

[0027] Specifically, before the video conference starts, a first image including a first object and a second object is captured by a capture device. The first object may be a participant, and the second object may be a display device in the video conference system.

[0028] Step 104, determining distance data between the first object and a second object in the video conferencing system according to the first image;

[0029] Step 106, determining audio parameters and display parameters of the video conferencing system according to the distance data;

[0030] It is worth noting that the video conferencing system also includes an audio output device, an audio receiving device and a display device. Among them, the display device includes but is not limited to a display screen, a projector, etc. The audio parameters include the output parameters of the audio output device and the receiving parameters of the audio receiving device. The display parameters include the display parameters of the display device.

[0031] Step 108, controlling the video conferencing system to operate according to the audio parameters and display parameters.

[0032] In an embodiment of the present application, a video conferencing system is deployed in a conference room, and after the participants enter the conference room, the video conferencing system is turned on. The acquisition device in the video conferencing system can acquire a first image including the participants. The distance data between the first object (the participant) and the second object (the display device) can be determined by identifying and analyzing the first image. The audio parameters and display parameters of the video conferencing system can be determined based on the distance data, and the operation of the video conferencing system can be controlled based on the audio parameters and the display parameters.

[0033] In some possible implementations, the first object is selected as a participant in a video conference system, and the second object is selected as a display device in the video conference system. A first correspondence between distance data and audio parameters, and a second correspondence between distance data and display parameters are stored in the video conference system. After determining the distance data between the first object and the second object, the audio parameters in the video conference system can be determined based on the distance data and the first correspondence. The display parameters in the video conference system can be determined based on the distance data and the second correspondence.

[0034] In some other possible implementations, the first object is selected as a participant in a video conferencing system, and the second object is selected as a display device in the video conferencing system. A third correspondence between distance data and an adjustment amount of an audio parameter, and a fourth correspondence between distance data and an adjustment amount of a display parameter are stored in the video conferencing system. After determining the distance data between the first object and the second object, the initial audio parameters and initial display parameters of the video conferencing system during the current video conference are obtained, and based on the distance data and the third correspondence, and the fourth correspondence, the adjustment amount for adjusting the initial audio parameters and the adjustment amount for adjusting the initial display parameters are determined. The initial audio parameters and initial display parameters are adjusted respectively by the determined adjustment amounts.

[0035] It is worth noting that audio parameters include not only audio intensity, but also audio output channels, such as mono, dual, quad, etc. Display parameters include not only display size, but also display brightness, display contrast, etc. Audio parameters include not only audio output parameters, but also audio reception parameters. Setting audio reception parameters based on distance data ensures that the video conferencing system can clearly receive the voices of participants and output the voices.

[0036] For example, if the distance between the detected participant and the display device is far, the audio output volume and the audio receiving volume are increased, and the display size of the content displayed by the display device is increased. If the distance between the detected participant and the display device is close, the audio output volume and the audio receiving volume are decreased, and the display size of the content displayed by the display device is decreased to ensure that the participant can clearly hear the audio and view the video.

[0037] In an embodiment of the present application, before the video conference begins, the conference room image is collected and recognized, and the distance data between the participants and the display device can be determined. The audio parameters and display parameters of the video conferencing system are automatically adjusted accordingly, without the need for the user to manually adjust them during the video conference. This ensures that the user can clearly listen to and view the meeting content during the meeting, simplifies the user's operation, and enables the user to focus more on the preparation of the meeting content, greatly improving the user experience.

[0038] In some embodiments of the present application, determining distance data between a first object and a second object according to a first image includes:

[0039] Determine, according to the first image and the preset image, position information of the first object in the environment where the video conferencing system is located;

[0040] According to the position information, distance data between the first object and the second object is determined.

[0041] In the embodiment of the present application, the first image and the preset image are both collected by the collection device, the preset image is the image data corresponding to the empty conference room, and the first image is the image data corresponding to the conference room with participants before the meeting. By comparing and analyzing the above two images, the position information of the first object (participant) in the conference room can be determined, thereby determining the distance between the first object and the second object (display device).

[0042] It is worth noting that, when the video conferencing system is deployed in an indoor environment, the video conferencing system can obtain a preset image, which is an image that does not include the first object, that is, an image of the indoor environment without any conference participants.

[0043] Figure 2FIG. 1 is a schematic diagram showing a collection device according to an embodiment of the present application acquiring a preset image. Figure 2 As shown, the acquisition device 200 includes: a laser emitting device 202 and a CCD camera 204. The distribution of the conference room is calibrated by the laser emitting device 202 and the CCD camera 204, and the conference room includes a ground 206 and a desktop 208. The laser emitting angle of the laser emitting device is adjusted to scan the conference room. During the scanning process, the CCD camera collects image data and objects at different heights are displayed on the CCD camera. Figure 3 The imaging curve of the CCD camera in the embodiment of the present application is shown in FIG. Figure 3 As shown, y1 represents the ground and y2 represents the desktop.

[0044] In a possible implementation, the second object (display device) is fixedly installed in the video conferencing system, that is, the position of the second object is fixed. The video conferencing system records the location information of the second object, and the distance data is determined according to the location information of the first object and the location information of the second object.

[0045] In another possible implementation, the second object (display device) is movably arranged in the video conferencing system, that is, the position of the second object is not fixed. The video conferencing system determines the location information of the second object based on the first image and the preset image, and determines the distance data based on the location information of the first object and the location information of the second object.

[0046] In the embodiment of the present application, by comparing and analyzing the actually collected first image including the first object and the second object, and the preset image not including the first object, the position information of the first object in the video conferencing system can be accurately located, thereby improving the accuracy of the distance data determined according to the position information and improving the accuracy of the adjustment of the audio parameters and display parameters.

[0047] In some embodiments of the present application, determining distance data between a first object and a second object according to the position information includes:

[0048] Determine angle data according to the position information of the first object and the preset position information corresponding to the acquisition device in the video conferencing system, where the angle data is the angle between the acquisition device and the second object;

[0049] The distance data is determined based on the angle data and the environmental dimension data, and the environmental dimension data corresponds to the environment in which the video conferencing system is located.

[0050] It is worth noting that after the video conferencing system is deployed in the indoor conference room, the environmental dimension parameters of the indoor conference room need to be input into the video conferencing system. The environmental dimension parameters include but are not limited to the dimensions of the acquisition device relative to the indoor walls and the ground.

[0051] In an embodiment of the present application, based on the preset position information of the laser emitting device and the position information of the first object, the angle data between the acquisition end and the second object (display device) can be determined when the acquisition end of the acquisition device is facing the first object (participant). The size parameters of the acquisition device relative to the indoor ground are searched in the local database. When the angle data between the acquisition end and the second object and the size parameters of the acquisition end from the indoor ground are known. The distance data between the first object and the second object can be obtained by calculation.

[0052] Figure 4 A schematic diagram showing a first image acquired by a collection device according to an embodiment of the present application is shown. Figure 4 As shown, the acquisition device 400 includes: a laser emitting device 402 and a CCD camera 404. The first image of the conference room including the first object 406 is acquired by the laser emitting device 402 and the CCD camera 404. The conference room also includes the ground 408 and the desktop 410. When the laser emitting device 402 scans the first object 406, the laser emission angle is θ. And the height of the laser emitting device 402 from the ground is h, then the calculated distance data of the first object 406 from the second object is Y=h / tanθ.

[0053] In some possible implementations, the acquisition device 200 includes N laser emitting devices, each of which has a measurable distance of L, and the measurable ranges of the N laser emitting devices are evenly distributed, that is, the length of the conference room is N×L. In the direction from one end of the conference room where the second object is placed to the other end of the conference room, when the Kth laser emitting device scans the first object, and the laser emitting angle of the Kth laser emitting device is θ, the distance data of the first object from the second object calculated is X=h / tanθ+K·L.

[0054] In the embodiment of the present application, by pre-stored size parameters of the conference room and detecting the angle between the sampling end of the acquisition device and the second object (display device), the distance data between the first object (participant) and the second object can be accurately calculated.

[0055] In some embodiments of the present application, there are multiple first objects, and the distance data is an average value of multiple distance values ​​between the multiple first objects and the second object.

[0056] In the embodiment of the present application, when there are multiple first objects in the video conferencing system, the distance value between each first object and the second object is determined respectively. Then, the average of the multiple distance values ​​corresponding to the multiple first objects is calculated, and the calculated average value is used as the distance data of the first object from the second object.

[0057] Specifically, before the video conference starts, when the acquisition device detects that there are multiple participants in the environment where the video conference system is located, the acquisition device determines the distance value between each participant and the second object, and calculates the average of the multiple distance values ​​to obtain distance data.

[0058] It is understandable that when there are multiple participants in the conference room, it is necessary to ensure that each participant can listen to the audio and watch the video as much as possible. Therefore, this application takes the average value of the distance values ​​between multiple participants and the display device as the distance data, and adjusts the audio parameters and display parameters accordingly, which can improve the audio-visual effects of multiple participants during the video conference.

[0059] In an embodiment of the present application, when multiple people participate in a video conference, the distance between multiple first objects (participants) and second objects (display devices) ensures that each participant can clearly and accurately view the displayed content and listen to the played content.

[0060] In some embodiments of the present application, determining audio parameters of a video conferencing system according to distance data includes:

[0061] determining audio parameters based on the distance data and a preset audio intensity range, the preset audio intensity range being associated with an environmental parameter of an environment in which the video conferencing system is located;

[0062] The audio parameter includes one or a combination of the following: audio output strength and audio receiving strength.

[0063] It is worth noting that after the video conferencing system is deployed in an indoor conference room, the environmental parameters of the indoor conference room need to be obtained. The environmental parameters include but are not limited to the location information of the sound source, the number of people in the conference room, the environmental noise, the indoor temperature, etc.

[0064] In the embodiment of the present application, the preset audio intensity range in the video conferencing system can be determined according to the environmental parameters. The audio parameters are calculated according to the distance data and the preset audio intensity range, as follows:

[0065]

[0066] Among them, db is an audio parameter, DBmax is the maximum value of the preset audio intensity range, DBmin is the minimum value of the preset audio intensity range, W is the length of the conference room, and △Xn is the distance data.

[0067] Specifically, the preset audio intensity range can be determined by the environmental parameters. For example, according to the sound source location information of the conference room, the number of people in the conference room, the indoor temperature and other parameters, the appropriate audio intensity range of the current conference room can be determined as DB min To DBmax . When the ambient noise of the current conference room is detected to be δ db , then the preset audio intensity range is determined to be DB min +δ db To DB max +δ db .

[0068] In some possible implementations, a correspondence between environmental parameters and preset audio intensity ranges is stored in the video conferencing system, and the corresponding preset audio intensity range can be queried according to the environmental parameters.

[0069] It is understandable that the audio parameters include not only the audio output intensity but also the audio receiving intensity. The audio output intensity is the output intensity of the audio playback device in the video conferencing system, that is, the audio playback device is controlled to play the audio at the audio output intensity. The audio receiving intensity is the receiving intensity of the audio receiving device in the video conferencing system, that is, the audio receiving device is controlled to receive audio above the audio receiving intensity.

[0070] In an embodiment of the present application, a preset audio intensity range is determined based on the environmental parameters of the conference room, and the audio parameters can be accurately adjusted based on the preset audio intensity range and distance data, so that participants can clearly and accurately listen to the audio played by the video conferencing system.

[0071] In some embodiments of the present application, the display parameters include a target display size, and the display parameters of the video conferencing system are determined according to the distance data, including:

[0072] Determine a scaling factor for a preset display size based on the distance data and the preset viewing distance;

[0073] The target display size is determined according to the preset display size and the display zoom factor.

[0074] In the embodiment of the present application, the display parameters of the display device in the video conferencing system include a target display size, that is, by adjusting the target display size, the participants can clearly view the display content of the display device.

[0075] Specifically, before the meeting starts, the preset viewing distance is determined according to the environmental parameters. The preset viewing distance is the optimal viewing distance for the participants when the display device displays the relevant content at the preset display size. The scaling factor for the preset display size can be determined based on the distance data and the preset data; the target display size can be calculated by the scaling factor and the preset display size. The display device is controlled to display the display content at the target display size. Where the distance data is △X, the preset viewing distance is dX, and the scaling factor a=△X / dX is calculated.

[0076] In an embodiment of the present application, a method for adaptively scaling display content in a video conferencing system is provided, which determines a preset viewing distance based on environmental parameters, and determines a zoom factor based on distance data between participants and a display device, and scales the display size of the display content by the zoom factor, eliminating the need for users to manually adjust the display size of the display content, thereby improving user experience.

[0077] The control method of the video conference system provided in the embodiment of the present application can be executed by the control device of the video conference system. In the embodiment of the present application, the control device of the video conference system performing the control method of the video conference system is taken as an example to illustrate the control device of the video conference system provided in the embodiment of the present application.

[0078] In some embodiments of the present application, a control device for a video conferencing system is provided. Figure 5 The structure block diagram of the control device of the video conferencing system provided by the embodiment of the present application is shown as follows: Figure 5 As shown, the control device 500 of the video conferencing system includes:

[0079] A collection module 502 is used to collect a first image in the environment where the video conferencing system is located, where the first image includes a first object and a second object;

[0080] A determination module 504, configured to determine distance data between the first object and the second object according to the first image;

[0081] The determination module 504 is further used to determine the audio parameters and display parameters of the video conferencing system according to the distance data;

[0082] The control module 506 is used to control the video conferencing system to operate according to the audio parameters and display parameters.

[0083] In an embodiment of the present application, before the video conference begins, the conference room image is collected and recognized, and the distance data between the participants and the display device can be determined. The audio parameters and display parameters of the video conferencing system are automatically adjusted accordingly, without the need for the user to manually adjust them during the video conference. This ensures that the user can clearly listen to and view the meeting content during the meeting, simplifies the user's operation, and enables the user to focus more on the preparation of the meeting content, greatly improving the user experience.

[0084] In some embodiments of the present application, the determination module 504 is further configured to determine the position information of the first object in the environment where the video conferencing system is located according to the first image and the preset image;

[0085] The determination module 504 is further configured to determine the distance data between the first object and the second object according to the position information.

[0086] In the embodiment of the present application, by comparing and analyzing the actually collected first image including the first object and the second object, and the preset image not including the first object, the position information of the first object in the video conferencing system can be accurately located, thereby improving the accuracy of the distance data determined according to the position information and improving the accuracy of the adjustment of the audio parameters and display parameters.

[0087] In some embodiments of the present application, the determination module 504 is further used to determine angle data according to the position information of the first object and the preset position information corresponding to the acquisition device in the video conferencing system, where the angle data is the angle between the acquisition device and the second object;

[0088] The determination module 504 is further used to determine the distance data according to the angle data and the environmental dimension data, where the environmental dimension data corresponds to the environment in which the video conferencing system is located.

[0089] In the embodiment of the present application, by pre-stored size parameters of the conference room and detecting the angle between the sampling end of the acquisition device and the second object (display device), the distance data between the first object (participant) and the second object can be accurately calculated.

[0090] In some embodiments of the present application, there are multiple first objects, and the distance data is an average value of multiple distance values ​​between the multiple first objects and the second object.

[0091] In an embodiment of the present application, when multiple people participate in a video conference, the distance between multiple first objects (participants) and second objects (display devices) ensures that each participant can clearly and accurately view the displayed content and listen to the played content.

[0092] In some embodiments of the present application, the determination module 504 is further configured to determine an audio parameter based on the distance data and a preset audio intensity range, where the preset audio intensity range is associated with an environmental parameter of an environment in which the video conferencing system is located;

[0093] The audio parameter includes one or a combination of the following: audio output strength and audio receiving strength.

[0094] In an embodiment of the present application, a preset audio intensity range is determined based on the environmental parameters of the conference room, and the audio parameters can be accurately adjusted based on the preset audio intensity range and distance data, so that participants can clearly and accurately listen to the audio played by the video conferencing system.

[0095] In some embodiments of the present application, the display parameters include a target display size;

[0096] The determination module 504 is further used to determine a scaling factor for a preset display size according to the distance data and the preset viewing distance;

[0097] The determination module 504 is further configured to determine a target display size according to a preset display size and a zoom factor.

[0098] In an embodiment of the present application, a method for adaptively scaling display content in a video conferencing system is provided, which determines a preset viewing distance based on environmental parameters, and determines a zoom factor based on distance data between participants and a display device, and scales the display size of the display content by the zoom factor, eliminating the need for users to manually adjust the display size of the display content, thereby improving user experience.

[0099] The control device of the video conferencing system in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0100] The control device of the video conferencing system in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0101] The control device of the video conferencing system provided in the embodiment of the present application can implement each process implemented in the above method embodiment, and will not be described again here to avoid repetition.

[0102] Optionally, an embodiment of the present application further provides an electronic device, which includes a control device for a video conferencing system as in any of the above embodiments, and thus has all the beneficial effects of the control device for a video conferencing system in any of the embodiments, which will not be elaborated upon herein.

[0103] Optionally, an embodiment of the present application further provides an electronic device, Figure 6 A structural block diagram of an electronic device according to an embodiment of the present application is shown. Figure 6 As shown, the electronic device 600 includes a processor 602, a memory 604, and a program or instruction stored in the memory 604 and executable on the processor 602. When the program or instruction is executed by the processor 602, each process of the control method embodiment of the above-mentioned video conferencing system is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0104] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0105] Figure 7 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0106] The electronic device 700 includes but is not limited to: a radio frequency unit 701, a network module 702, an audio output unit 703, an input unit 704, a sensor 705, a display unit 706, a user input unit 707, an interface unit 708, a memory 709, and a processor 710.

[0107] Those skilled in the art will appreciate that the electronic device 700 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 710 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 7 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0108] The processor 710 is used to capture a first image in an environment where the video conferencing system is located, where the first image includes a first object and a second object;

[0109] The processor 710 is configured to determine distance data between the first object and the second object according to the first image;

[0110] The processor 710 is further configured to determine audio parameters and display parameters of the video conferencing system according to the distance data;

[0111] Processor 710 is used to control the video conferencing system to operate according to audio parameters and display parameters.

[0112] In an embodiment of the present application, before the video conference begins, the conference room image is collected and recognized, and the distance data between the participants and the display device can be determined. The audio parameters and display parameters of the video conferencing system are automatically adjusted accordingly, without the need for the user to manually adjust them during the video conference. This ensures that the user can clearly listen to and view the meeting content during the meeting, simplifies the user's operation, and enables the user to focus more on the preparation of the meeting content, greatly improving the user experience.

[0113] Further, the processor 710 is further configured to determine the position information of the first object in the environment where the video conferencing system is located according to the first image and the preset image;

[0114] The processor 710 is further configured to determine distance data between the first object and the second object according to the position information.

[0115] In the embodiment of the present application, by comparing and analyzing the actually collected first image including the first object and the second object, and the preset image not including the first object, the position information of the first object in the video conferencing system can be accurately located, thereby improving the accuracy of the distance data determined according to the position information and improving the accuracy of the adjustment of the audio parameters and display parameters.

[0116] Further, the processor 710 is further configured to determine angle data according to the position information of the first object and the preset position information corresponding to the acquisition device in the video conferencing system, where the angle data is the angle between the acquisition device and the second object;

[0117] The processor 710 is further configured to determine the distance data according to the angle data and the environmental dimension data, where the environmental dimension data corresponds to the environment in which the video conferencing system is located.

[0118] In the embodiment of the present application, the distance data between the first object (participant) and the second object can be accurately calculated by using the pre-stored size parameters of the conference room and the angle between the sampling end of the acquisition device that detects the first object and the second object (display device).

[0119] Furthermore, there are multiple first objects, and the distance data is an average value of multiple distance values ​​between the multiple first objects and the second object.

[0120] In the embodiment of the present application, when multiple people participate in a video conference, based on the distance between the multiple participants and the second object, it is ensured that each participant can clearly and accurately view the displayed content and listen to the played content.

[0121] Further, the processor 710 is further configured to determine an audio parameter based on the distance data and a preset audio intensity range, wherein the preset audio intensity range is associated with an environmental parameter of an environment in which the video conferencing system is located;

[0122] The audio parameter includes one or a combination of the following: audio output strength and audio receiving strength.

[0123] In an embodiment of the present application, a preset audio intensity range is determined based on the environmental parameters of the conference room, and the audio parameters can be accurately adjusted based on the preset audio intensity range and distance data, so that participants can clearly and accurately listen to the audio played by the video conferencing system.

[0124] Furthermore, the display parameters include a target display size,

[0125] The processor 710 is further configured to determine a scaling factor for a preset display size according to the distance data and a preset viewing distance;

[0126] The processor 710 is further configured to determine a target display size according to a preset display size and a zoom factor.

[0127] In an embodiment of the present application, a method for adaptively scaling display content in a video conferencing system is provided, which determines a preset viewing distance based on environmental parameters, and determines a zoom factor based on distance data between participants and a display device, and scales the display size of the display content by the zoom factor, eliminating the need for users to manually adjust the display size of the display content, thereby improving user experience.

[0128] It should be understood that in the embodiment of the present application, the input unit 704 may include a graphics processor (Graphics Processing Unit, GPU) 7041 and a microphone 7042, and the graphics processor 7041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 706 may include a display panel 7061, and the display panel 7061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 707 includes a touch panel 7071 and at least one of other input devices 7072. The touch panel 7071 is also called a touch screen. The touch panel 7071 may include two parts: a touch detection device and a touch controller. Other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0129] The memory 709 can be used to store software programs and various data. The memory 709 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 709 may include a volatile memory or a non-volatile memory, or the memory 709 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 709 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0130] The processor 710 may include one or more processing units; optionally, the processor 710 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 710.

[0131] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0132] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0133] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned video conferencing system control method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0134] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0135] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the control method embodiment of the video conferencing system as described above, and can achieve the same technical effect. To avoid repetition, it will not be described here.

[0136] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0137] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods of each embodiment of the present application.

[0138] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A method for controlling a video conferencing system, characterized in that: include: Capturing a first image in an environment where the video conferencing system is located, wherein the first image includes a first object and a second object; determining distance data between the first object and the second object according to the first image; Determining audio parameters and display parameters of the video conferencing system according to the distance data; Controlling the video conferencing system to operate according to the audio parameters and the display parameters; The determining, according to the first image, distance data between the first object and the second object comprises: Determining, according to the first image and the preset image, position information of the first object in the environment where the video conferencing system is located; Determine the distance data between the first object and the second object according to the position information; The preset image is an image that does not include the first object; The first object is a participant in the video conferencing system, and the second object is a display device in the video conferencing system.

2. The control method of the video conferencing system according to claim 1, characterized in that: Determining the distance data between the first object and the second object according to the position information includes: Determine angle data according to the position information of the first object and the preset position information corresponding to the acquisition device in the video conferencing system, where the angle data is the angle between the acquisition device and the second object; The distance data is determined according to the angle data and the environmental dimension data, and the environmental dimension data corresponds to the environment in which the video conferencing system is located.

3. The control method of the video conferencing system according to claim 1 or 2, characterized in that: The number of the first objects is multiple; The distance data is an average value of a plurality of distance values ​​between a plurality of the first objects and the second objects.

4. The control method of the video conferencing system according to claim 1 or 2, characterized in that: Determining the audio parameters of the video conferencing system according to the distance data includes: determining the audio parameter according to the distance data and a preset audio intensity range, wherein the preset audio intensity range is associated with an environmental parameter of an environment in which the video conferencing system is located; The audio parameter includes one or a combination of the following: audio output intensity or audio reception intensity.

5. The control method of the video conference system according to claim 1 or 2, characterized in that: The display parameters include a target display size, and determining the display parameters of the video conferencing system according to the distance data includes: Determining a scaling factor for a preset display size according to the distance data and a preset viewing distance; The target display size is determined according to the preset display size and the scaling factor.

6. A control device for a video conferencing system, characterized in that: include: A collection module, used for collecting a first image in the environment where the video conferencing system is located, wherein the first image includes a first object and a second object; a determination module, configured to determine distance data between the first object and the second object according to the first image; The determination module is further used to determine the audio parameters and display parameters of the video conferencing system according to the distance data; A control module, used for controlling the video conferencing system to operate according to the audio parameters and the display parameters; The determination module is further used to determine the position information of the first object in the environment where the video conferencing system is located according to the first image and the preset image; The determining module is further used to determine the distance data between the first object and the second object according to the position information; The preset image is an image that does not include the first object; The first object is a participant in the video conferencing system, and the second object is a display device in the video conferencing system.

7. The control device of the video conference system according to claim 6, characterized in that: The determination module is further used to determine angle data according to the position information of the first object and the preset position information corresponding to the acquisition device in the video conferencing system, wherein the angle data is the angle between the acquisition device and the second object; The determination module is further used to determine the distance data according to the angle data and the environmental dimension data, and the environmental dimension data corresponds to the environment in which the video conferencing system is located.

8. The control device of the video conference system according to claim 6 or 7, characterized in that: The number of the first objects is multiple; The distance data is an average value of a plurality of distance values ​​between a plurality of the first objects and the second objects.

9. The control device of the video conference system according to claim 6 or 7, characterized in that: The determination module is further configured to determine the audio parameter based on the distance data and a preset audio intensity range, wherein the preset audio intensity range is associated with an environmental parameter of an environment in which the video conferencing system is located; The audio parameter includes one or a combination of the following: audio output intensity or audio reception intensity.

10. The control device of the video conference system according to claim 6 or 7, characterized in that: The display parameters include a target display size; The determination module is further used to determine a scaling factor for a preset display size according to the distance data and a preset viewing distance; The determination module is further configured to determine the target display size according to the preset display size and the scaling factor.

11. An electronic device, characterized in that: include: A memory on which programs or instructions are stored; A processor, configured to implement the steps of the method for controlling a video conferencing system as described in any one of claims 1 to 5 when executing the program or instruction.

12. A readable storage medium having a program or instruction stored thereon, characterized in that: When the program or instruction is executed by a processor, the steps of the method for controlling a video conferencing system according to any one of claims 1 to 5 are implemented.

Images