Screen calibration method and system

Abstract

Disclosed in the present invention is a screen calibration method. The method comprises: connecting a panoramic video conference machine to a screen; enabling a screen calibration function of the panoramic video conference machine; the panoramic video conference machine sending a calibration picture video to the screen, and acquiring a panoramic video by means of a panoramic camera, wherein the panoramic video comprises the calibration picture video; and the panoramic video conference machine processing the panoramic video acquired by means of the panoramic camera, so as to calibrate the position of the screen. Further disclosed in the present invention is a screen calibration system.

Description

Screen calibration method and system Technical Field

[0001] The present invention relates to image processing technology, and in particular to a screen calibration method and system. Background Art

[0002] To meet the demand for simultaneous multi-person meetings in diverse locations, various video conferencing devices offering video conferencing capabilities are constantly being developed. However, unlike traditional video conferencing equipment, panoramic video conferencing devices are equipped with panoramic cameras that capture a 360-degree panoramic view, presenting a comprehensive view of the meeting scene. Furthermore, panoramic video conferencing devices can fully identify all participants in the meeting and display close-ups of them on the conference screen, providing more detailed information and interaction. While panoramic video conferencing devices offer advantages in the meeting experience, they also create new challenges. For example, in conference scenarios, a screen is typically used to display the video conference screen. Since panoramic video conferencing devices capture 360-degree facial information, this also includes the faces on the screen. As shown in Figure 1, local participants A, B, C, D, E, F, G, and H are shown on the screen, while remote participants I and J are displayed. In this case, the panoramic video conferencing device captures facial information for both local and remote participants, and displays all recognized facial information on the local computer. However, remote participants are not suitable to be displayed in close-up shots of local participants. This is because, under normal circumstances, as shown in Figure 2, the local participants and remote participants can be distinguished in the local participant screen and the remote participant screen displayed by the local computer. But if the remote participants I and J are displayed in the close-up shot of the local participants, the remote participants I and J are regarded as local participants, and the remote participants displayed by the remote computer include the local participants I and J. At this time, the remote computer will display the local participants I and J and the remote participants including the local participants I and J, so that the remote participants I and J appear in both the local participant screen and the remote participant screen, resulting in a very confusing screen. Therefore, this requires the panoramic video conferencing machine to be able to effectively identify the screen area and block the facial information appearing therein to solve the problems existing in the existing technology. Technical issues

[0003] The present invention provides a screen calibration method and system for solving the problem that existing panoramic video conferencing machines cannot effectively identify screen areas and display close-up shots of other participants during video conferencing.

[0004] To achieve the purpose of the present invention, the present invention provides a screen calibration method for calibrating the screen of a panoramic video conferencing machine in a conference scene. The panoramic video conferencing machine includes a machine body and a panoramic camera provided on the machine body. The screen calibration method includes:

[0005] Connect the panoramic video conferencing machine to the screen;

[0006] Turning on the screen calibration function of the panoramic video conferencing machine;

[0007] The panoramic video conferencing machine sends the calibration screen video to the screen, and obtains the panoramic video through the panoramic camera; wherein the panoramic video includes the calibration screen video;

[0008] The panoramic video conferencing machine processes the panoramic video acquired by the panoramic camera to calibrate the position of the screen.

[0009] The present invention also provides a screen calibration system method for calibrating a screen of a panoramic video conferencing machine in a conference scene. The panoramic video conferencing machine includes a machine body and a panoramic camera provided on the machine body. The screen calibration method includes:

[0010] Connect the panoramic video conferencing machine to the screen;

[0011] Turning on the screen calibration function of the panoramic video conferencing machine;

[0012] The panoramic video conferencing machine sends a static calibration picture video to the screen and obtains a panoramic video through the panoramic camera; wherein the panoramic video includes the static calibration picture video, and the static calibration picture video includes a plurality of pure color pictures, each of which has a different color; the panoramic video conferencing machine calculates the position of each pure color picture based on the obtained panoramic video, and then obtains the intersection of the positions of all the pure color pictures to obtain the position of the screen; and / or

[0013] The panoramic video conferencing machine generates and sends a dynamic calibration picture video to the screen, and obtains a panoramic video through the panoramic camera; wherein the panoramic video includes the dynamic calibration picture video, wherein the dynamic calibration picture video includes a conference picture with a watermark pattern; the watermark pattern is set at the four end corners of the conference picture; the panoramic video conferencing machine calculates the position of each watermark pattern based on the obtained panoramic video, and then obtains the enclosed area of ​​all watermark patterns to obtain the position of the screen.

[0014] The present invention also provides a screen calibration system, which is provided in a panoramic video conferencing machine and connected to a screen, and is used for calibrating the screen of the panoramic video conferencing machine in a conference scene. The screen calibration system includes:

[0015] Panoramic camera, used to shoot panoramic video;

[0016] Display module, used to enable screen calibration function;

[0017] The control module is connected to the panoramic camera, the display module and the screen respectively, and is used to send the calibration picture video to the screen, control the panoramic camera to obtain the panoramic video including the calibration picture video, and calculate the screen position according to the panoramic video obtained by the panoramic camera.

[0018] The present invention provides the following beneficial effects: A panoramic video conferencing system transmits a calibration video to a screen, and a panoramic camera captures a panoramic video containing the calibration video. The panoramic video conferencing system processes the captured panoramic video to determine the screen position, thereby achieving accurate screen calibration. Once the screen position is calibrated, the panoramic video conferencing system can mask facial information within the calibrated screen to meet the needs of conference participants.

[0019] In addition, screen calibration can be performed using either a static or dynamic calibration screen, depending on the scenario. Before a meeting begins, the panoramic video conferencing system calibrates the screen using the static calibration screen, which not only provides high accuracy and wide adaptability, but also covers most usage scenarios. During a meeting, the panoramic video conferencing system calibrates the screen using the dynamic calibration screen, enabling dynamic calibration without interrupting the meeting, making the calibration process more flexible and convenient. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] FIG1 is a diagram of an existing panoramic video conferencing scene.

[0021] Figure 2 is the screen displayed on the local computer.

[0022] FIG3 is a flow chart of the method according to embodiment 1 of the present invention.

[0023] FIG4 is a scene diagram of embodiment 1 of the present invention.

[0024] FIG5 is a flow chart of a method according to embodiment 2 of the present invention.

[0025] FIG6 is a scene diagram of embodiment 2 of the present invention.

[0026] FIG7 is a flow chart of a method according to embodiment 3 of the present invention.

[0027] FIG8 is a system block diagram of embodiment 4 of the present invention. Best Mode for Carrying Out the Invention

[0028] The technical solutions of the present invention will be described clearly and completely below with reference to the accompanying drawings and specific embodiments. It is obvious that the embodiments described are only some embodiments of the present invention, not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative work shall fall within the scope of protection of the present invention. Example

[0029] The screen calibration method of the present invention is used for calibrating the screen of a panoramic video conferencing machine in a conference scene, thereby achieving the purpose of shielding facial information on the screen and meeting the needs of video conferencing.

[0030] Referring to FIG3 , the screen calibration method of this embodiment includes the following steps:

[0031] S101. Connect the panoramic video conferencing machine to the screen.

[0032] In this step, the panoramic video conferencing device includes a device and a panoramic camera mounted thereon. When the panoramic video conferencing device is connected to a screen, the device can transmit information to the screen for display. In this embodiment, the screen can be a television screen, a projection screen, or other screen capable of displaying images or videos, without limitation.

[0033] S102: Enable the screen calibration function of the panoramic video conferencing machine.

[0034] S103. The panoramic video conferencing machine sends the calibration image video to the screen and obtains the panoramic video through the panoramic camera.

[0035] In this step, the panoramic video conferencing system generates and transmits a static calibration video to the screen, while the panoramic camera captures the panoramic video. The static calibration video includes multiple solid-color images, each with a different color. This distinguishes the calibration video from the colors of other objects in the conference scene, thus avoiding calibration errors. In this embodiment, the static calibration video includes a pure red image, a pure green image, and a pure blue image. Of course, in actual use, the colors of the pure-color images are not limited to red, green, and blue, and the number of colors is not limited to three. Specifically, as shown in Figure 4, the static calibration video transmitted to the screen by the panoramic video conferencing system may include a pure red image held for a certain period of time, a pure green image held for a certain period of time, and a pure blue image held for a certain period of time, to ensure that the panoramic camera can capture each pure-color image. Simultaneously, the panoramic camera captures the panoramic video and transmits it to the panoramic video conferencing system, including the static calibration video. In this embodiment, the panoramic camera can capture a 360-degree panoramic view.

[0036] S104: The panoramic video conferencing machine processes the panoramic video acquired by the panoramic camera to calibrate the screen position.

[0037] In this step, the panoramic video conferencing machine receives the panoramic video sent by the panoramic camera, processes the received panoramic video, and then determines the screen position based on the processing result. Specifically, the panoramic video conferencing machine calculates the position of each pure color picture based on the acquired panoramic video, and then obtains the intersection of the positions of all pure color pictures to obtain the position of the screen. In this embodiment, the panoramic video conferencing machine calculates the positions of the pure red picture, pure green picture, and pure blue picture in the panoramic video based on the panoramic video acquired by the panoramic camera, and then obtains the intersection of the positions of the three pure color pictures. The obtained intersection is the position of the current screen. For example, the panoramic video area that displays a pure red picture in the first display time, a pure green picture in the second display time, and a pure blue picture in the third display time is set as the position of the current screen.

[0038] This embodiment calibrates the screen through a static calibration picture, and has the characteristics of high screen calibration accuracy, wide adaptability, and the ability to cover most usage scenarios. It should be noted that this screen calibration method is only suitable for the case where the panoramic video conferencing machine and the screen do not move. If the position of the panoramic video conferencing machine or the screen changes during the meeting, it is necessary to interrupt the meeting process and repeat steps S101 to S104 to recalibrate the screen. After the screen position is determined, the panoramic video conferencing machine can shield the facial information in the calibrated screen to meet the needs of the participants. Example

[0039] The screen calibration method of the present invention is used for calibrating the screen of a panoramic video conferencing machine in a conference scene, thereby shielding facial information on the screen and meeting the needs of video conferencing.

[0040] Referring to FIG5 , the screen calibration method of this embodiment includes the following steps:

[0041] S201. Connect the panoramic video conferencing machine to the screen.

[0042] In this step, the panoramic video conferencing device includes a device and a panoramic camera mounted thereon. When the panoramic video conferencing device is connected to a screen, the device can transmit information to the screen for display. In this embodiment, the screen can be a television screen, a projection screen, or other screen capable of displaying images or videos, without limitation.

[0043] S202: Enable the screen calibration function of the panoramic video conferencing machine.

[0044] S203. The panoramic video conferencing machine sends the calibration screen video to the screen and obtains the panoramic video through the panoramic camera.

[0045] In this step, the panoramic video conferencing machine generates and sends a dynamic calibration screen video to the screen, and obtains the panoramic video through the panoramic camera. The dynamic calibration screen video includes a conference screen with a watermark pattern, and the watermark pattern is set at the four corners of the conference screen. The watermark pattern can be a pattern pre-set by the user, which does not overlap with the panoramic screen. Specifically, as shown in Figure 6, the panoramic video conferencing machine generates a dynamic calibration screen video containing a watermark pattern, and superimposes the watermark pattern on the four corners of the conference screen respectively, and the watermark pattern is maintained for a certain period of time so that the panoramic camera can obtain the screen video of the four watermark patterns. Of course, the watermark pattern generated by the panoramic video conferencing machine can also be maintained until the end of the meeting. At the same time, the panoramic camera obtains the panoramic video and sends the obtained panoramic video to the panoramic video conferencing machine. The panoramic video contains the conference screen with four watermark patterns. The panoramic camera can capture a 360-degree panoramic view. It should be noted that, in this embodiment, the screen and the panoramic video conferencing machine must be within a reasonable distance range to ensure that the watermark pattern sent by the panoramic video conferencing machine to the screen is clear enough, thereby improving the accuracy of watermark detection and further improving the accuracy of screen calibration.

[0046] S204: The panoramic video conferencing machine processes the panoramic video acquired by the panoramic camera to calibrate the position of the screen.

[0047] In this step, the panoramic video conferencing machine receives and processes the panoramic video from the panoramic camera, and determines the screen position based on the processing results. Specifically, the panoramic video conferencing machine calculates the position of each watermark pattern based on the panoramic video captured by the panoramic camera, and then obtains the enclosed area of ​​all watermark patterns. The enclosed area is the screen position.

[0048] In this embodiment, when the position of the panoramic video conferencing machine or screen changes during a meeting, it is only necessary to repeat steps S202 to S204 to recalibrate the screen, thereby enabling dynamic screen calibration without interrupting the meeting process, making screen calibration more flexible and convenient. Example

[0049] The screen calibration method of the present invention is used for calibrating the screen of a panoramic video conferencing machine in a conference scene, thereby shielding facial information on the screen and meeting the needs of video conferencing.

[0050] Referring to FIG. 7 , the screen calibration method of this embodiment includes the following steps:

[0051] S301. Before the meeting starts, connect the panoramic video conferencing machine to the screen.

[0052] In this step, the panoramic video conferencing device includes a device and a panoramic camera mounted thereon. When the panoramic video conferencing device is connected to a screen, the device can transmit information to the screen for display. In this embodiment, the screen can be a television screen, a projection screen, or other screen capable of displaying images or videos, without limitation.

[0053] S302: Enable the screen calibration function of the panoramic video conferencing machine.

[0054] S303: The panoramic video conferencing machine sends the calibration image video to the screen and obtains the panoramic video through the panoramic camera.

[0055] In this step, the panoramic video conferencing machine generates and sends a static calibration video to the screen, while also capturing panoramic video via the panoramic camera. The static calibration video includes multiple solid-color images, each with a different color. This distinguishes the calibration video from the colors of other objects in the conference scene, thus avoiding calibration errors. In this embodiment, the static calibration video includes a pure red image, a pure green image, and a pure blue image. Of course, in actual use, the colors of the pure-color images are not limited to red, green, and blue, and the number of colors is not limited to three. Specifically, the static calibration video sent to the screen by the panoramic video conferencing machine may include a pure red image held for a certain period of time, a pure green image held for a certain period of time, and a pure blue image held for a certain period of time, to ensure that the panoramic camera can capture each pure-color image. Simultaneously, the panoramic camera captures the panoramic video and sends it to the panoramic video conferencing machine, including the static calibration video. In this embodiment, the panoramic camera can capture a 360-degree panoramic view.

[0056] S304: The panoramic video conferencing machine processes the panoramic video acquired by the panoramic camera to calibrate the screen position.

[0057] In this step, the panoramic video conferencing machine receives the panoramic video sent by the panoramic camera, processes the received panoramic video, and then determines the screen position based on the processing result. Specifically, the panoramic video conferencing machine calculates the position of each pure color picture based on the acquired panoramic video, and then obtains the intersection of the positions of all pure color pictures to obtain the position of the screen. In this embodiment, the panoramic video conferencing machine calculates the positions of the pure red picture, pure green picture, and pure blue picture in the panoramic video based on the panoramic video acquired by the panoramic camera, and then obtains the intersection of the positions of the three pure color pictures. The obtained intersection is the position of the current screen. For example, the panoramic video area that displays a pure red picture in the first display time, a pure green picture in the second display time, and a pure blue picture in the third display time is set as the position of the current screen.

[0058] S305: During the conference, the panoramic video conferencing machine automatically detects whether the screen position has changed according to a preset time interval.

[0059] During this step, the panoramic video conferencing system or screen may change position for some reason during the conference. In this case, the screen position calibrated by the panoramic video conferencing system will change, so the screen needs to be recalibrated. The panoramic video conferencing system automatically detects the screen position at preset intervals to avoid inconsistencies with the calibrated screen position due to changes in the screen position.

[0060] The panoramic video conferencing machine sends a dynamic calibration screen video to the screen according to a preset time interval, and obtains a panoramic video through the panoramic camera. The dynamic calibration screen video includes a conference screen with a watermark pattern, and the watermark pattern is set at the four corners of the conference screen. The watermark pattern can be a pattern pre-set by the user, which does not overlap with the panoramic screen. The time interval is set according to actual needs. For example, it can be set to detect once every 5 minutes. Specifically, the panoramic video conferencing machine generates a dynamic calibration screen video containing a watermark pattern, and superimposes the watermark pattern on the four corners of the conference screen respectively. The watermark pattern is maintained for a certain period of time so that the panoramic camera can obtain the screen video of the four watermark patterns. Of course, the watermark pattern generated by the panoramic video conferencing machine can also be maintained until the end of the meeting. At the same time, the panoramic camera obtains the panoramic video and sends the obtained panoramic video to the panoramic video conferencing machine, wherein the panoramic video includes the dynamic calibration screen video. The panoramic video conferencing machine calculates the position of each watermark pattern based on the panoramic video, and compares each calculated watermark pattern with the four end corners of the previous screen position. If they are consistent, the screen position remains unchanged and step S305 is repeated; if they are inconsistent, the screen position is changed and step S306 is executed.

[0061] It should be noted that when the watermark pattern remains for a certain period of time, the panoramic video conferencing machine needs to resend the dynamic calibration video to the screen when it performs the next screen detection. However, if the watermark pattern remains until the end of the meeting, when the panoramic video conferencing machine detects the screen, it does not need to send the dynamic calibration video to the screen. The position of each watermark pattern is directly calculated based on the panoramic video captured by the panoramic camera, and each calculated watermark pattern is compared with the four end corners of the previous screen position. In this embodiment, the screen and the panoramic video conferencing machine must be within a reasonable distance to ensure that the watermark pattern sent to the screen by the panoramic video conferencing machine is clear enough, thereby improving the accuracy of watermark detection and, in turn, the accuracy of screen calibration.

[0062] S306: The panoramic video conferencing machine processes the panoramic video acquired by the panoramic camera to recalibrate the position of the screen.

[0063] In this step, the panoramic video conferencing machine obtains the enclosed area of ​​all watermark patterns according to the position of each watermark pattern, and the obtained enclosed area is the position of the current screen.

[0064] In this embodiment, before a meeting begins, the panoramic video conferencing system calibrates the screen using a static calibration screen. This not only provides high screen calibration accuracy and wide adaptability, but also covers most usage scenarios. During the meeting, the panoramic video conferencing system automatically detects the screen position using dynamic calibration screens at preset intervals. If a change in the screen position is detected, the system recalibrates the screen. This dynamic calibration process, performed without interrupting the meeting, ensures reliable calibration and makes the calibration process more flexible and convenient. Example 4

[0065] The screen calibration system of this embodiment is provided in the panoramic video conferencing machine, which is connected to the screen and is used for calibrating the screen of the panoramic video conferencing machine in the conference scene, thereby shielding the facial information on the screen and meeting the needs of video conferencing.

[0066] As shown in Figure 8, the screen calibration system includes a panoramic camera 10, a display module 20 and a control module 30. The panoramic camera 10 and the display module 20 are connected to the control module 30 respectively.

[0067] As shown in Figure 6, the panoramic camera 10 is used to shoot panoramic picture videos and send the shot picture videos to the control module 30. Among them, the panoramic camera 10 can shoot a 360-degree panoramic view. The display module 20 is used to turn on the screen calibration function, which can be a touch screen display, and it can also display other parameter information, which is not limited here. The control module 30 is connected to the panoramic camera 10 and the display module 20 respectively, and is used to send the calibration picture video to the screen, control the panoramic camera 10 to obtain the panoramic video, and calculate the screen position according to the panoramic video obtained by the panoramic camera. In this embodiment, static screen calibration or dynamic screen calibration can be achieved by changing the calibration picture video sent to the screen by the control module 30.

[0068] Specifically, before or during a meeting, if the position of the panoramic video conferencing system and the screen remains unchanged, static screen calibration can be performed. In this case, the control module 30 sends a static calibration video to the screen. This static calibration video includes multiple solid-color images, each with a different color. This distinguishes the calibration video from the colors of other objects in the meeting scene, thus avoiding calibration errors. In this embodiment, the static calibration video includes a pure red image, a pure green image, and a pure blue image. Of course, in actual use, the colors of the solid-color images are not limited to red, green, and blue, and the number of colors is not limited to three. The static calibration video can include a solid red image remaining for a certain period of time, a solid green image remaining for a certain period of time, and a solid blue image remaining for a certain period of time, to ensure that the panoramic camera 10 can capture each solid-color image. Simultaneously, the panoramic camera 10 captures the panoramic video and sends it to the control module 30. The control module 30 receives the panoramic video sent by the panoramic camera 10, processes it, and determines the screen position based on the processing results. Specifically, the control module 30 calculates the position of each pure-color image based on the panoramic video captured by the panoramic camera 10, and then obtains the intersection of the positions of all pure-color images to determine the position of the screen. In this embodiment, the control module 30 calculates the positions of the pure red, pure green, and pure blue images in the panoramic video captured by the panoramic camera 10, and then obtains the intersection of the positions of the three pure-color images. The obtained intersection is the current screen position. For example, the panoramic video area showing the pure red image in the first display time, the pure green image in the second display time, and the pure blue image in the third display time is set as the current screen position. It should be noted that this static screen calibration is only suitable for situations where neither the panoramic video conferencing machine nor the screen moves. If the position of the panoramic video conferencing machine or the screen changes during a meeting, the meeting needs to be interrupted and the screen recalibrated. After the screen position is calibrated, the control module 30 can mask facial information within the calibrated screen to meet the needs of the participants.

[0069] When the position of the panoramic video conferencing machine or screen changes before or during a meeting, dynamic screen calibration can be used. In this case, the calibration screen video sent to the screen by the control module 30 is a dynamic calibration screen video. The dynamic calibration screen video includes a conference screen with a watermark pattern, and the watermark pattern is set at the four corners of the conference screen. The watermark pattern can be a pattern pre-set by the user, which does not overlap with the panoramic screen. Specifically, the control module 30 generates a dynamic calibration screen video containing a watermark pattern, and superimposes the watermark pattern on the four corners of the conference screen respectively. The watermark pattern is maintained for a certain period of time so that the panoramic camera 10 can obtain the screen video of the four watermark patterns. Of course, the watermark pattern generated by the control module 30 can also be maintained until the end of the meeting. At the same time, the panoramic camera 10 obtains a panoramic video and sends the obtained panoramic video to the control module 30. The panoramic video contains the conference screen with the four watermark patterns. The panoramic camera can capture a 360-degree panoramic view. It should be noted that, in this embodiment, the screen and the panoramic video conferencing machine must be within a reasonable distance range to ensure that the watermark pattern sent by the control module 30 to the screen is clear enough, thereby improving the accuracy of watermark detection. The control module 30 receives the panoramic video sent by the panoramic camera 10, processes the received panoramic video, and determines the screen position based on the processing results. Specifically, the control module 30 calculates the position of each watermark pattern based on the panoramic video obtained by the panoramic camera, and then obtains the enclosed area of ​​all watermark patterns. The obtained enclosed area is the position of the screen. Through dynamic screen calibration, when the position of the panoramic video conferencing machine or the screen changes during the meeting, the screen calibration can be performed dynamically without interrupting the meeting process, making screen calibration more flexible and simple.

[0070] Furthermore, during a conference, the panoramic video conferencing machine or screen may change position for some reason. In this case, the screen position calibrated by the panoramic video conferencing machine will change, necessitating recalibration of the screen. Automatically detecting the screen position at preset intervals by the control module 30 can prevent inconsistencies with the calibrated screen position due to changes in the screen position.

[0071] The control module 30 sends a dynamic calibration picture video to the screen according to a preset time interval, and obtains a panoramic video through the panoramic camera. The dynamic calibration picture video includes a conference picture with a watermark pattern, and the watermark pattern is set at the four corners of the conference picture. The watermark pattern can be a pattern pre-set by the user, which does not overlap with the panoramic picture. The time interval is set according to actual needs. For example, it can be set to detect once every 5 minutes. Specifically, the control module 30 generates a dynamic calibration picture video containing a watermark pattern, and superimposes the watermark pattern on the four corners of the conference picture respectively, and the watermark pattern is maintained for a certain period of time so that the panoramic camera 10 can obtain the picture video of the four watermark patterns. Of course, the watermark pattern generated by the panoramic video conferencing machine can also be maintained until the end of the meeting. At the same time, the panoramic camera 10 obtains the panoramic video and sends the obtained panoramic video to the control module 30, wherein the panoramic video includes the dynamic calibration picture video. The control module 30 calculates the position of each watermark pattern based on the panoramic video, and compares each calculated watermark pattern with the four end corners of the previous screen position. If they are consistent, the screen position has not changed, and the screen detection process is repeated; if they are inconsistent, the screen position has changed, and the control module 30 obtains the enclosed area of ​​all watermark patterns based on the position of each watermark pattern. The obtained enclosed area is the current screen position.

[0072] It should be noted that when the watermark pattern remains for a certain period of time, the control module 30 needs to re-send the dynamic calibration screen video to the screen when it performs the next detection on the screen; if the watermark pattern remains until the end of the meeting, when the control module 30 detects the screen, there is no need to send the dynamic calibration screen video to the screen. The position of each watermark pattern can be directly calculated based on the panoramic video obtained by the panoramic camera 10, and each calculated watermark pattern can be compared with the four end corners of the previous screen position.

[0073] In this embodiment, the control module 30 sends a static or dynamic calibration video to the screen, and the panoramic camera 10 captures a panoramic video containing the calibration video. The control module 30 processes the captured panoramic video to determine the screen position, thereby achieving accurate screen calibration. Once the screen position is calibrated, the panoramic video conferencing system can mask facial information within the calibrated screen to meet the needs of conference participants.

[0074] In addition, you can choose to calibrate the screen using either a static or dynamic calibration screen. Before a meeting, calibrating the screen using the static calibration screen not only provides high accuracy and wide adaptability, but also covers most usage scenarios. During a meeting, calibrating the screen using the dynamic calibration screen allows for dynamic calibration without interrupting the meeting, making the calibration process more flexible and convenient.

[0075] Although the present invention is disclosed through the above embodiments, the protection scope of the present invention is not limited thereto. Without departing from the concept of the present invention, any deformation or replacement of the above components shall fall within the scope of the claims of the present invention.

Claims

1. A screen calibration method for calibrating a screen of a panoramic video conferencing system in a conference scene, wherein the panoramic video conferencing system includes a body and a panoramic camera disposed on the body, wherein the screen calibration method comprises: Connect the panoramic video conferencing machine to the screen; Turning on the screen calibration function of the panoramic video conferencing machine; The panoramic video conferencing machine sends a static calibration picture video to the screen and obtains a panoramic video through the panoramic camera; wherein the panoramic video includes the static calibration picture video, and the static calibration picture video includes multiple pure color pictures, each pure color picture has a different color; the panoramic video conferencing machine calculates the position of each pure color picture based on the obtained panoramic video, and then obtains the intersection of the positions of all the pure color pictures to obtain the position of the screen; and / or The panoramic video conferencing machine generates and sends a dynamic calibration picture video to the screen, and obtains a panoramic video through the panoramic camera; wherein the panoramic video includes the dynamic calibration picture video, wherein the dynamic calibration picture video includes a conference picture with a watermark pattern; the watermark pattern is set at the four end corners of the conference picture; the panoramic video conferencing machine calculates the position of each watermark pattern based on the obtained panoramic video, and then obtains the enclosed area of ​​all watermark patterns to obtain the position of the screen.

2. The screen calibration method as described in claim 1, wherein before the meeting starts, the panoramic video conferencing machine calibrates the screen through a static calibration picture; during the meeting, the panoramic video conferencing machine automatically detects whether the screen position has changed according to a preset time interval. If a change in the screen position is detected, the panoramic video conferencing machine calibrates the screen through a dynamic calibration picture.

3. The screen calibration method according to claim 1, wherein the step of automatically detecting whether the screen position has changed according to a preset time interval comprises: The panoramic video conferencing machine sends a dynamic calibration screen video to the screen according to a preset time interval, and obtains a panoramic video through the panoramic camera, and then compares each watermark pattern in the panoramic video with the four end corners of the previous screen position. If they are consistent, the screen position has not changed; If they are inconsistent, the screen position changes.

4. The screen calibration method as described in claim 3, wherein when the panoramic video conferencing machine detects the screen position, the watermark pattern sent by the panoramic video conferencing machine to the screen remains at the four end corners of the conference screen or stays at the four end corners of the conference screen for a certain period of time.

5. A screen calibration method for calibrating a screen of a panoramic video conferencing system in a conference scene, wherein the panoramic video conferencing system includes a body and a panoramic camera disposed on the body, wherein the screen calibration method comprises: Connect the panoramic video conferencing machine to the screen; Turning on the screen calibration function of the panoramic video conferencing machine; The panoramic video conferencing machine sends the calibration screen video to the screen, and obtains the panoramic video through the panoramic camera; wherein the panoramic video includes the calibration screen video; The panoramic video conferencing machine processes the panoramic video acquired by the panoramic camera to calibrate the position of the screen.

6. The screen calibration method according to claim 5, wherein the step of the panoramic video conferencing machine sending a calibration video to the screen and acquiring a panoramic video through the panoramic camera comprises: The panoramic video conferencing machine generates and sends a static calibration picture video to the screen, wherein the static calibration picture video includes a plurality of pure color pictures, and the color of each pure color picture is different.

7. The screen calibration method according to claim 6, wherein the step of the panoramic video conferencing machine processing the panoramic video acquired by the panoramic camera comprises: The panoramic video conferencing machine calculates the position of each pure color picture based on the acquired panoramic video, and then obtains the intersection of the positions of all pure color pictures to obtain the position of the screen.

8. The screen calibration method according to claim 6, wherein the static calibration video image comprises a pure red image, a pure green image, and a pure blue image.

9. The screen calibration method according to claim 5, wherein the step of the panoramic video conferencing machine sending a calibration video to the screen and acquiring a panoramic video through the panoramic camera comprises: The panoramic video conferencing machine generates and sends a dynamic calibration screen video to the screen, wherein the dynamic calibration screen video includes a conference screen with a watermark pattern; the watermark pattern is set at the four end corners of the conference screen.

10. The screen calibration method according to claim 9, wherein the step of processing the panoramic video acquired by the panoramic camera by the panoramic video conferencing machine is as follows: The panoramic video conferencing machine calculates the position of each watermark pattern based on the acquired panoramic video, and then obtains the enclosed area of ​​all watermark patterns to obtain the position of the screen.

11. A screen calibration system, provided in a panoramic video conferencing machine and connected to a screen, for calibrating the screen of the panoramic video conferencing machine in a conference scene, wherein the screen calibration system comprises: Panoramic camera, used to shoot panoramic video; Display module, used to enable screen calibration function; The control module is connected to the panoramic camera, the display module and the screen respectively, and is used to send the calibration picture video to the screen, control the panoramic camera to obtain the panoramic video including the calibration picture video, and calculate the screen position according to the panoramic video obtained by the panoramic camera.

Images