Geometric correction method of projection image and projection equipment
By projecting the correction border line on the projection screen and moving the points to be corrected, the projection image distortion problem caused by uneven projection screen is solved, and the perfect adaptation between the projection image and the projection screen is achieved.
Patent Information
- Application Number
- CN202311178863.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-09-13
- Publication Date
- 2025-03-14
AI Technical Summary
When the projection screen is uneven, the correction effect of the projection image based on the correction APP is not good, and the projection image cannot be fully adapted to the projection screen, resulting in concave or convex distortion in the image boundary.
By projecting multiple correction border lines one by one with the boundary of the projected image on the projection screen, the movable correction points to be corrected on these border lines are controlled to move in the target movement direction until the projected image is adapted to the projection screen.
The geometric correction of the projection image when the projection screen is uneven is realized, so that the projection image is fully adapted to the projection screen, and avoiding the concave or convex distortion of the image boundary.
Smart Images
Figure CN119629321A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of projection display technology, and in particular to a method for geometrically correcting a projected image and a projection device. Background Art
[0002] Laser TV is a high-end TV product. Compared with traditional projection equipment, laser TV uses ultra-short-throw projection to project a larger display screen in a short distance. During the projection process, in order to make the projected image match the projection screen, the projected image needs to be debugged. Calibration of the projected image through the calibration APP (Application) installed on the terminal device is a common debugging method.
[0003] However, when the projection screen is uneven, the correction effect of the projected image based on the correction APP is not good, and the projected image cannot be fully adapted to the projection screen. For example, the boundary of the projected image becomes concave or convex, causing the projected image to be distorted.
[0004] Therefore, how to correct the projected image when the projection screen is uneven so that the projected image is fully adapted to the projection screen is an urgent problem to be solved. Summary of the invention
[0005] In order to solve or at least partially solve the above-mentioned technical problems, the present disclosure provides a method and a projection device for geometric correction of a projected image, which corrects the image boundary of the projected image by projecting a plurality of correction border lines corresponding one-to-one to the image boundary of the projected image on a projection screen, wherein the correction border lines have a plurality of movable points to be corrected, and a target correction point among the plurality of points to be corrected is controlled to move in a target moving direction until the image boundary of the projected image is matched with the projection screen, thereby solving the problem of incompatibility between the projected image and the projection screen.
[0006] In a first aspect, the present disclosure provides a method for geometric correction of a projected image, comprising:
[0007] Projecting a projection image on a projection screen, and projecting a plurality of correction frame lines corresponding to the image boundaries of the projection image one by one; wherein the correction frame lines are used to correct the image boundaries corresponding to the correction frame lines, and each correction frame line has a plurality of movable points to be corrected, and the plurality of points to be corrected include: two end points of the correction frame line and at least one interval point, and the at least one interval point is not on the same straight line as the two end points;
[0008] In response to a configuration operation input by a user for a target correction frame line, determining a target correction point and a target displacement among a plurality of points to be corrected of the target correction frame line;
[0009] Determining a target moving direction according to a deformation direction of an image boundary corresponding to the target correction frame line and the target correction point;
[0010] According to the target displacement, the target correction point is controlled to move along the target movement direction until the projection image is adapted to the projection screen.
[0011] As an optional implementation manner of the present disclosure, controlling the target correction point to move along the target movement direction according to the target displacement until the projection image is adapted to the projection screen includes:
[0012] The target correction point is controlled to move at least once along the target moving direction until the projection image is adapted to the projection screen; wherein, in the at least one movement of the target correction point, the displacement of each movement of the target correction point is the target displacement.
[0013] As an optional implementation of the present disclosure, the method further includes:
[0014] In response to a selection operation input by a user for the plurality of correction border lines, a correction border line selected by the user is determined as the target correction border line.
[0015] As an optional implementation manner of the present disclosure, the deformation direction of the image boundary corresponding to the target correction border line is a direction away from the first reference screen boundary and close to the second reference screen boundary, the first reference screen boundary is a projection screen boundary corresponding to the target correction border line, and the first reference screen boundary is opposite to the second reference screen boundary;
[0016] The step of determining the target moving direction according to the deformation direction of the image boundary corresponding to the target correction frame line and the target correction point includes:
[0017] If the target correction points are two end points on the target correction border line, the deformation direction is determined as the target movement direction.
[0018] As an optional implementation manner of the present disclosure, controlling the target correction point to move along the target movement direction according to the target displacement until the projection image is adapted to the projection screen includes:
[0019] receiving a user's movement operation on a target interval point on the target correction border line, and if the movement direction of the movement operation is opposite to the target movement direction, controlling the target interval point to remain stationary, so that the target correction point moves along the target movement direction until the projection image is adapted to the projection screen;
[0020] The target interval point is the interval point farthest from the straight line where the target correction point is located among the at least one interval point.
[0021] As an optional implementation manner of the present disclosure, the deformation direction of the image boundary corresponding to the target correction border line is a direction away from the first reference screen boundary and away from the second reference screen boundary, the first reference screen boundary is a projection screen boundary corresponding to the target correction border line, and the first reference screen boundary is opposite to the second reference screen boundary;
[0022] The step of determining the target moving direction according to the deformation direction of the image boundary corresponding to the target correction frame line and the target correction point includes:
[0023] If the target correction point is a target interval point on the target correction border line, the opposite direction of the deformation direction is determined as the target movement direction, and the target interval point is the interval point farthest from the straight line where the two endpoints are located among the at least one interval point.
[0024] As an optional implementation manner of the present disclosure, controlling the target correction point to move along the target movement direction according to the target displacement until the projection image is adapted to the projection screen includes:
[0025] A moving operation of the user on the target interval point is received, and if the moving direction of the moving operation is the target moving direction, the target interval point is controlled to move along the target moving direction until the projection image is adapted to the projection screen.
[0026] As an optional implementation of the present disclosure, in response to a configuration operation input by a user for a target correction border line, determining a target correction point and a target displacement among a plurality of to-be-corrected points of the target correction border line includes:
[0027] Displaying a user interface, wherein the user interface includes a target correction point configuration option and a movement displacement configuration option;
[0028] The target correction point and the target displacement are determined according to a configuration operation of the target correction point configuration option and the movement displacement configuration option input by the user based on the user interface.
[0029] As an optional implementation manner of the present disclosure, the projecting of a plurality of correction frame lines corresponding one-to-one to the image boundaries of the projection image includes:
[0030] In response to a geometric correction instruction input by a user for the projected image, displaying geometric correction confirmation information on the projection screen;
[0031] In response to a confirmation instruction input by a user for the geometric correction confirmation information, a plurality of correction frame lines corresponding one-to-one to image boundaries of the projection image are projected on the projection screen.
[0032] In a second aspect, an embodiment of the present disclosure provides a projection device, comprising: a digital light processor, wherein the digital light processor is configured to: project a projection image on a projection screen, and project a plurality of correction frame lines corresponding one-to-one to the image boundaries of the projection image; wherein the correction frame lines are used to correct the image boundaries corresponding to the correction frame lines, and each correction frame line has a plurality of movable points to be corrected, and the plurality of points to be corrected include: two endpoints and at least one interval point of the correction frame line, and the at least one interval point is not on the same straight line as the two endpoints;
[0033] In response to a configuration operation input by a user for a target correction frame line, determining a target correction point and a target displacement among a plurality of points to be corrected of the target correction frame line;
[0034] Determining a target moving direction according to a deformation direction of an image boundary corresponding to the target correction frame line and the target correction point;
[0035] According to the target displacement, the target correction point is controlled to move along the target movement direction until the projection image is adapted to the projection screen.
[0036] In a third aspect, an embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method for geometric correction of a projection image as described in the first aspect.
[0037] Compared with the prior art, the technical solution provided by the embodiments of the present disclosure has the following advantages:
[0038] The geometric correction method of a projected image provided in an embodiment of the present application includes: projecting a projected image on a projection screen, and projecting a plurality of correction frame lines corresponding one-to-one to the image boundary of the projected image; wherein the correction frame lines are used to correct the image boundary corresponding to the correction frame lines, and each correction frame line has a plurality of movable points to be corrected, and the plurality of points to be corrected include: two endpoints and at least one interval point of the correction frame line, and the at least one interval point is not on the same straight line as the two endpoints; in response to a configuration operation input by a user for a target correction frame line, determining a target correction point and a target displacement among the plurality of points to be corrected of the target correction frame line; determining a target movement direction according to the deformation direction of the image boundary corresponding to the target correction frame line and the target correction point; and according to the target displacement, controlling the target correction point to move along the target movement direction until the projected image is adapted to the projection screen. In an embodiment of the present application, a correction border line will be projected on the projection screen. Each correction border line has multiple movable points to be corrected. There is no need to calibrate the APP. The geometric correction of the projected image is achieved by moving the target moving point among the multiple points to be corrected. In the case that the projection screen is uneven, the projected image can be adapted to the projection screen through geometric correction. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0040] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0041] Figure 1 A schematic diagram of an application scenario of a method for geometric correction of a projection image provided according to one or more embodiments of the present disclosure;
[0042] Figure 2A is a hardware configuration block diagram of a control device 100 according to one or more embodiments of the present disclosure;
[0043] Figure 2B is a hardware configuration block diagram of a projection device 200 according to one or more embodiments of the present disclosure;
[0044] Figure 2C A schematic diagram of software configuration in a projection device 200 according to one or more embodiments of the present disclosure;
[0045] Figure 3is a flow chart of a method for geometric correction of a projection image according to one or more embodiments of the present disclosure;
[0046] Figure 4 A schematic diagram of a correction frame line provided for one or more embodiments of the present disclosure;
[0047] Figure 5 A schematic diagram of a projection image and a projection screen that are not compatible with each other according to one or more embodiments of the present disclosure;
[0048] Figure 6 A schematic diagram of a projection image after geometric correction provided by one or more embodiments of the present disclosure;
[0049] Figure 7 A schematic diagram of a coordinate system of a target calibration point provided for one or more embodiments of the present disclosure;
[0050] Figure 8 A schematic diagram of the position of a target calibration point after movement in one or more embodiments of the present disclosure;
[0051] Fig. 9 A schematic diagram showing that a projection image provided by one or more embodiments of the present disclosure is not compatible with a projection screen. DETAILED DESCRIPTION
[0052] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.
[0053] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.
[0054] The terms "first" and "second" in this disclosure are used to distinguish different objects rather than to describe a specific order of objects. For example, a first processing result and a second processing result are used to distinguish different processing results rather than to describe a specific order of processing results.
[0055] First, the application scenarios of the present disclosure are illustrated. As a high-end TV product, laser TV can project a screen of more than 100 inches in a short distance, giving the audience a better visual enjoyment and bringing a cinema-like TV viewing experience. However, laser TV is an ultra-short-throw projection, and it is a bottom-up projection method. In order to make the picture coincide with the screen, a cumbersome debugging and correction process is required. The commonly used correction method is to correct the projected image through the correction APP (Application) installed on the terminal device, for example, take a photo of the projected image and the projection screen through the correction APP installed on the mobile phone, and send the obtained picture to the TV SoC (System on Chip, chip and system) of the TV host. The TV SoC recognizes the image and calculates the correction parameters through the automatic geometric correction algorithm, and outputs the pixel coordinate data required by the geometric correction execution module to realize the correction function. However, the correction APP has certain limitations. When the projection screen is uneven, the correction effect is not good. For example, the corrected projection image appears concave, including: the upper boundary of the projection image is concave downward, the lower boundary of the projection image is concave upward, the left boundary of the projection image is concave to the right, and the right boundary of the projection image is concave to the left.
[0056] Based on this, an embodiment of the present disclosure provides a method for geometric correction of a projected image, which corrects the image boundary of the projected image by projecting multiple correction border lines corresponding one-to-one to the image boundary of the projected image on the projection screen. The correction border lines have multiple movable points to be corrected. By controlling a target correction point among the multiple points to be corrected to move in a target moving direction until the image boundary of the projected image is adapted to the projection screen, the problem of incompatibility between the projected image and the projection screen is solved.
[0057] The control device in the embodiment of the present disclosure may be a remote control or a mobile device such as a mobile phone, and the embodiment of the present disclosure is not specifically limited. The projection device includes a TV SoC and a digital light processor (DLP), and the method provided in the embodiment of the present disclosure may be executed by the DLP.
[0058] For example, refer to Figure 1 As shown, Figure 1 Schematic diagram of an application scenario of a method for geometric correction of a projected image according to an embodiment of the present disclosure. The control device 100 can communicate with the TV SoC and the DLP respectively based on the IIC communication protocol. For example, the control device 100 can send a control signal to the DLP, and the TV SoC determines the configuration parameters based on the instructions sent by the control device 100. The configuration parameters may include the target displacement in the embodiment of the present disclosure. In some embodiments, the control device 100 can be a remote control, and the user can input user instructions through buttons on the remote control, voice input, control panel input, etc. to control the geometric correction of the projected image on the projection screen.
[0059] In some embodiments, the projection device 200 also communicates data with the server. The projection device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server may provide various content and interactions to the projection device 200. The server may be a cluster or multiple clusters, and may include one or more types of servers.
[0060] Figure 2A In FIG. 1 , a configuration block diagram of the control device 100 is exemplarily shown. Figure 2A As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive input operation instructions from the user, and convert the operation instructions into instructions that the projection device 200 can recognize and respond to, and play an interactive intermediary role between the user and the projection device 200.
[0061] Figure 2B The hardware configuration block diagram of the projection device 200 is shown in FIG. Figure 2B As shown, the projection device 200 includes at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface (i.e., a user input interface) 280. The controller 250 includes a central processing unit, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input / output. The display 260 can be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and can also be a projection device and a projection screen. The tuner 210 receives broadcast television signals by wired or wireless reception, and demodulates audio and video signals from multiple wireless or wired broadcast television signals, such as and EPG data signals. The communicator 220 is a component for communicating with an external device or server according to various communication protocol types. For example: the communicator can include other network communication protocol chips or near field communication protocol chips such as Wifi modules, Bluetooth modules, wired Ethernet modules, and at least one of infrared receivers. The projection device 200 can establish the transmission and reception of control signals and data signals with the external control device 100 or the server through the communicator 220. The detector 230 is used to collect signals of the external environment or the external interaction. The first controller 250 and the tuner-demodulator 210 can be located in different split devices, that is, the tuner-demodulator 210 can also be in an external device of the main device where the first controller 250 is located, such as an external set-top box. The user interface 280 can be used to receive control operations of a control device (such as a keyboard, etc.).
[0062] In some embodiments, the controller 250 controls the operation of the projection device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the projection device 200. The user can input a user command in a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user can input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.
[0063] In some embodiments, "user interface" is a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The commonly used form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an interface element such as an icon, window, and control displayed on the display screen of an electronic device, where the control can include at least one of the visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc.
[0064] Figure 2C FIG. 1 is a schematic diagram of software configuration in a projection device 200 according to one or more embodiments of the present disclosure. Figure 2C As shown in the figure, the system is divided into four layers, from top to bottom, namely the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the Android runtime (Android runtime) and system library layer (referred to as "system runtime library layer"), and the kernel layer.
[0065] In some embodiments, at least one application is running in the application layer, and these applications may be window programs, system settings programs, clock programs, etc. provided by the operating system, or applications developed by third-party developers. In specific implementations, the applications in the application layer include but are not limited to the above examples.
[0066] In some embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.
[0067] In some embodiments, the kernel layer is a layer between hardware and software, and includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.
[0068] The geometric correction method of the projection image provided by the present disclosure is applied to projection equipment, such as laser TV. The geometric correction method of the projection image provided by the present disclosure will be exemplified by specific embodiments below.
[0069] Reference Figure 3 As shown, Figure 3 A schematic flow chart of a method for geometric correction of a projection image provided in an embodiment of the present disclosure, the method for geometric correction of a projection image specifically includes the following steps S310 to S340.
[0070] S310, projecting a projection image onto a projection screen, and projecting a plurality of correction frame lines corresponding one-to-one to image boundaries of the projection image.
[0071] Among them, the correction border line is used to correct the image boundary corresponding to the correction border line, and each correction border line has multiple movable points to be corrected, and the multiple points to be corrected include: two endpoints of the correction border line and at least one interval point, and the at least one interval point is not on the same straight line as the two endpoints.
[0072] Exemplarily, a conventional projection screen is a rectangle with four sides, namely, top, bottom, left, and right. The projection frame lines are four frame lines corresponding to the four sides of the rectangular projection screen, respectively, and the four frame lines constitute a quadrilateral.
[0073] Among them, the correction border line can be adapted to the corresponding image boundary. For example, when the upper image boundary of the projected image is concave downward, the correction border line corresponding to the upper image boundary is also concave downward; when the upper image boundary of the projected image is convex upward, the correction border line corresponding to the upper image boundary is also convex upward; the correction border line can also be adapted to the screen boundary of the corresponding projection screen, that is, the correction border line is parallel to and coincides with the screen boundary of the corresponding projection screen, which is not specifically limited in the embodiments of the present application.
[0074] Exemplarily, each correction border line has at least three points to be corrected, including two endpoints and an interval point of the correction border line, each endpoint can be shared by two adjacent correction border lines, that is, each endpoint can be used as a point to be corrected for two adjacent correction border lines, and each correction border line can have multiple interval points or one interval point. The interval point can be the midpoint of the correction border line or any point on the correction border line that does not coincide with the two endpoints. Exemplarily, refer to Figure 4As shown, Figure 4 This is a schematic diagram for correcting the border line. Figure 4 For example, each correction frame line includes an interval point, and the interval point is the midpoint of the correction frame line. Figure 4 The quadrilateral correction border line shown includes a total of 8 points to be corrected, namely four endpoints A, B, C, and D, and four midpoints E, F, G, and H, wherein each point to be corrected is adjustable in two directions, for example, the midpoints E and F are adjustable in the up and down directions, the midpoints G and H are adjustable in the left and right directions, the endpoint A is adjustable in the right or downward direction, the endpoint B is adjustable in the left or downward direction, the endpoint C is adjustable in the upward or right direction, and the endpoint D is adjustable in the upward or left direction.
[0075] In some embodiments of the present application, after the projection image is projected on the projection screen, a plurality of correction frame lines corresponding to the image boundaries of the projection image are projected by default, so that the user can perform geometric correction on the projection image.
[0076] In some embodiments of the present application, after the projection image is projected on the projection screen, if a geometric correction instruction input by the user is received, geometric correction confirmation information is displayed on the projection screen in response to the geometric correction instruction input by the user for the projection image; in response to a confirmation instruction input by the user for the geometric correction confirmation information, a plurality of correction border lines corresponding one-to-one to the image boundaries of the projection image are projected on the projection screen.
[0077] Exemplarily, the user sends a geometric correction instruction to the DLP based on the control device, and geometric correction confirmation information is displayed on the projection screen, such as displaying a geometric correction confirmation information of "Confirm geometric correction" and operation options of "Exit" and "Confirm". If a confirmation instruction input by the user based on the "Confirm" operation option is received, a plurality of correction border lines corresponding to the image boundaries of the projection image are projected on the projection screen. If an exit instruction input by the user based on the "Exit" operation option is received, the correction border lines are not displayed on the projection screen, and only the projection image is displayed.
[0078] The user can determine whether to send a geometric correction instruction based on his or her visual experience. When it is determined that the projected image is not compatible with the projection screen, in order to improve the visual experience, a geometric correction instruction can be sent to the DLP to perform geometric correction on the projected image. Exemplarily, when any one or more image boundaries of the projected image are not compatible with the corresponding projection screen boundaries, the projected image is considered to be not compatible with the projection screen.
[0079] Reference Figure 5 As shown, Figure 5A schematic diagram of a projected image that is incompatible with a projection screen is provided in an embodiment of the present disclosure, wherein the upper image boundary of the projected image is concave, that is, the midpoint of the upper boundary is not on the straight line where the two endpoints are located, and is displaced in the direction of the upper image boundary of the projected image. Figure 5 This is merely an example of a possible situation where the projected image is not compatible with the projection screen and does not constitute any limitation.
[0080] In response to a selection operation input by a user for the plurality of correction border lines, a correction border line selected by the user is determined as the target correction border line.
[0081] Exemplarily, the user may select a correction frame line corresponding to the image boundary to be corrected based on the control device. For example, if the user selects an upper correction frame line, the upper correction frame line is determined as the target correction frame line.
[0082] It should be noted that when the mismatch between the projected image and the projection screen includes more than two image boundaries, corrections need to be performed one by one. Among multiple correction border lines, multiple target correction border lines can be determined in sequence, and the image boundaries corresponding to the multiple target correction border lines can be corrected. Exemplarily, if the target correction border line first determined by the user is the upper correction border line, after correcting the upper image boundary based on the upper correction border line, if the left correction border line is then selected as the target correction border line, the left image boundary can then be corrected based on the left correction border line.
[0083] S320: In response to a configuration operation input by the user for a target correction frame line, determine a target correction point and a target displacement among a plurality of points to be corrected of the target correction frame line.
[0084] The user can select the direction and displacement of the point to be adjusted on the DLP UI interface, and transmit it to the control device through the IIC protocol. The control device then converts it into the movement displacement of each adjustment point, and then receives the control signal sent by the control device for control.
[0085] The multiple points to be corrected on the target correction border line are movable. It is necessary to determine the target correction point among the multiple points to be corrected, and correct the corresponding image boundary based on the movement of the target correction point. One possible way to determine the target correction point includes:
[0086] Displaying a user interface, the user interface including a target correction point configuration option and a movement displacement configuration option; determining the target correction point and the target displacement according to a configuration operation for the target correction point configuration option and the movement displacement configuration option input by a user based on the user interface.
[0087] Exemplarily, if the user enters an endpoint identifier in the target correction point configuration option, the endpoint is determined as the target correction point. If the user enters an interval point identifier in the target correction point configuration option, the interval point corresponding to the identifier is determined as the target correction point. The moving displacement configuration option allows the user to enter a moving displacement, which can be the displacement corresponding to each moving operation.
[0088] S330: Determine a target moving direction according to a deformation direction of an image boundary corresponding to the target correction frame line and the target correction point.
[0089] The following is an explanation of several situations: In the following exemplary cases, the first reference screen boundary and the second reference screen boundary are relative screen boundaries, such as when the upper screen boundary is the first reference screen boundary, the lower screen boundary is the second reference screen boundary, when the lower screen boundary is the first reference screen boundary, the upper screen boundary is the second reference screen boundary, when the left screen boundary is the first reference screen boundary, the right screen boundary is the second reference screen boundary, and when the right screen boundary is the first reference screen boundary, the left screen boundary is the second reference screen boundary.
[0090] In the first case, the deformation direction of the image boundary corresponding to the target correction frame line is the direction away from the first reference screen boundary and close to the second reference screen boundary, the first reference screen boundary is the projection screen boundary corresponding to the target correction frame line, and the first reference screen boundary is opposite to the second reference screen boundary. That is, the target correction frame line is the upper correction frame line, and the upper image boundary is deformed downward, or, the target correction frame line is the lower correction frame line, and the lower image boundary is deformed upward, or, the target correction frame line is the left correction frame line, and the left image boundary is deformed to the right, or, the target correction frame line is the right correction frame line, and the right image boundary is deformed to the left, etc., and the concave deformation occurs.
[0091] In the first case, the image boundary undergoes a concave deformation, and the target movement direction is determined based on the deformation direction of the image boundary corresponding to the target correction border line and the target correction point, including: if the target correction point is the two endpoints on the target correction border line, then the deformation direction is determined as the target movement direction.
[0092] That is, when the target correction border line is the upper correction border line, when the upper image boundary is deformed downward, the downward direction is determined as the target movement direction; when the target correction border line is the lower correction border line, when the lower image boundary is deformed upward, the upward direction is determined as the target movement direction; when the target correction border line is the left correction border line, when the left image boundary is deformed to the right, the right direction is determined as the target movement direction; when the target correction border line is the right correction border line, when the right image boundary is deformed to the left, the left direction is determined as the target movement direction.
[0093] In the second case, the deformation direction of the image boundary corresponding to the target correction border line is away from the first reference screen boundary and away from the second reference screen boundary, the first reference screen boundary is the projection screen boundary corresponding to the target correction border line, and the first reference screen boundary is opposite to the second reference screen boundary; that is, the target correction border line is the upper correction border line, and the upper image boundary is deformed upward, or, the target correction border line is the lower correction border line, and the lower image boundary is deformed downward, or, the target correction border line is the left correction border line, and the left image boundary is deformed to the left, or the target correction border line is the right correction border line, and the right image boundary is deformed to the right, etc., and convex deformations occur.
[0094] In the second case, the image boundary undergoes an outward convex deformation. If the target correction point is a target interval point on the target correction border line, the opposite direction of the deformation direction is determined as the target movement direction. The target interval point is the interval point among the at least one interval point that is farthest from the straight line where the two endpoints are located.
[0095] That is, when the target correction border line is the upper correction border line, when the upper image boundary is deformed upward, the downward direction is determined as the target moving direction; when the target correction border line is the lower correction border line, when the lower image boundary is deformed downward, the upward direction is determined as the target moving direction; when the target correction border line is the left correction border line, when the left image boundary is deformed to the left, the right direction is determined as the target moving direction; when the target correction border line is the right correction border line, when the right image boundary is deformed to the right, the left direction is determined as the target moving direction.
[0096] That is, determining the adjustment direction of the image boundary as the direction of reducing the size of the projected image can ensure that the projected image does not overflow at the DMD end, thereby improving the user experience.
[0097] S340: According to the target displacement, control the target correction point to move along the target moving direction until the projection image is adapted to the projection screen.
[0098] The adaptation of the projection image to the projection screen includes: an image boundary of the projection image is parallel to or coincides with a corresponding screen boundary, or a deformation degree of the image boundary of the projection image relative to the corresponding screen boundary is less than a preset deformation threshold.
[0099] In some embodiments of the present application, the target correction point is controlled to move at least once along the target movement direction until the projection image is adapted to the projection screen; wherein, in the at least one movement of the target correction point, the displacement of each movement of the target correction point is the target displacement.
[0100] Among them, one movement operation of the user corresponds to one movement of the target correction point. For example, the user moves the target correction point based on the up button on the control device. Each time the up button is pressed, the displacement of the target correction point is the target displacement.
[0101] For the first case mentioned above, the deformation direction of the image boundary corresponding to the target correction border line is the direction away from the first reference screen boundary and close to the second reference screen boundary, the first reference screen boundary is the projection screen boundary corresponding to the target correction border line, the first reference screen boundary is opposite to the second reference screen boundary, the target correction point is the two endpoints of the target correction border line, and when the deformation direction is the target moving direction, the user's moving operation on the target interval point on the target correction border line is received, if the moving direction of the moving operation is the opposite direction of the target moving direction, the target interval point is controlled to remain stationary, so that the target correction point moves along the target moving direction until the projected image is adapted to the projection screen; wherein, the target interval point is the interval point farthest from the straight line where the target correction point is located among the at least one interval point.
[0102] If the moving direction of the moving operation is the target moving direction, the target interval point and the target correction point are controlled to remain stationary and not respond to the moving operation.
[0103] Exemplary, combined Figure 5 As shown, Figure 5 The upper image boundary shown in is corrected, and the left and right endpoints are the target correction points. If the user moves the target interval point based on the down button on the control device, the movement operation is not responded to; if the user moves the target interval point based on the up button on the control device, the target interval point is controlled to remain stationary, so that the target correction point (two endpoints) moves downward until the upper image boundary of the projected image is adapted to the upper screen boundary of the projection screen. The adjustment effect is referenced Figure 6 shown.
[0104] In the process of the user moving the target interval point based on the up button on the control device, the pixel points at the target interval point are not moved, but the pixel points near the two end points are moved. Exemplarily, the coordinates of the pixel blocks near the two end points are determined, and the two end points are linearly interpolated to control the movement of the pixel blocks on the image boundary to be corrected.
[0105] For example, establish Figure 7 In the coordinate system shown, the coordinate of point B before moving is (1920, 1080). Combined with the above description, when the display range of the projection screen DMD is 3840*2160 pixels, when the user moves point E upward based on the control device, the position of point E remains unchanged, and points A and B move downward. When point E moves upward by a displacement of m, the position of point E actually does not change. The displacement of points A and B is -m, the coordinate of the sampling point on the X axis remains unchanged, and the offset on the Y axis is 0. Since the trajectory of each point is a parabola, let the displacement of the pixel block in the i-th row and j-th column be Δy=A*x_((ij)) 2 +B, substituting the coordinates of point A (-1920, 0) we can get A = (-m) / 1920 2 The positions of point A and point B after moving are as follows Figure 7 shown.
[0106] As point E moves upward, A and B move downward, and the opening of the parabola becomes smaller and smaller, linear interpolation is performed on A and B respectively to obtain the displacement:
[0107]
[0108] Among them, x (ij) ,y (ij) represents the coordinates of the pixel block in the i-th row and j-th column, Δy represents the distance that the pixel block in the i-th row and j-th column needs to move on the Y axis, and the boundary diagram after the move is shown in Figure 8 As shown, based on Figure 8 The positions of the points shown are Figure 5 The projected image shown is compensated to obtain Figure 6 The corrected projection image shown has an upper boundary parallel to the upper boundary of the projection screen, a lower boundary parallel to the lower boundary of the projection screen, a left boundary parallel to the left boundary of the projection screen, and a right boundary parallel to the right boundary of the projection screen, that is, the projection image is adapted to the projection screen.
[0109] That is, in the case where the image boundary of the projection image is concavely deformed, the pixel points near the endpoints of the image boundary are moved based on the movement operation of the target interval points, and the pixel points at the target interval points do not actually move, so that the projection image is adapted to the projection screen, ensuring that the projection image does not overflow the display range of the DMD and that the complete projection image is displayed on the projection screen.
[0110] The correction of the lower image boundary, the right image boundary, and the left image boundary is similar to the above process and will not be described in detail here.
[0111] For the second case above, the deformation direction of the image boundary corresponding to the target correction border line is a direction away from the first reference screen boundary and the second reference screen boundary, the target correction point is a target interval point on the target correction border line, the opposite direction of the deformation direction is the target movement direction, the target interval point is the interval point farthest from the straight line where the target correction point is located among the at least one interval point, and according to the target displacement, controlling the target correction point to move along the target movement direction until the projected image is adapted to the projection screen, including:
[0112] Receive a user's moving operation on the target interval point. If the moving direction of the moving operation is the target moving direction, control the target interval point to move along the target moving direction until the projection image is adapted to the projection screen; if the moving direction of the moving operation is in the opposite direction of the target moving direction, control the target interval point and the target correction point to remain stationary and not respond to the moving operation.
[0113] For example, refer to Fig. 9 As shown, in Fig. 9 In the above figure, the upper boundary of the projected image is deformed upward. Fig. 9 The upper image boundary shown is corrected, and the target interval point is the target correction point. If the user moves the target interval point based on the up button on the control device, the movement operation is not responded to; if the user moves the target interval point based on the down button on the control device, the target interval point is controlled to move downward until the upper image boundary of the projected image is adapted to the upper screen boundary of the projection screen.
[0114] That is, in the case where the image boundary of the projection image undergoes outward convex deformation, the pixel points near the target interval points of the projection image are moved based on the movement operation of the target interval points, and the pixel points at the endpoints do not actually move, so that the projection image is adapted to the projection screen, ensuring that the projection image does not overflow the display range of the DMD and that the complete projection image is displayed on the projection screen.
[0115] The embodiment of the present application will not elaborate on the situation where the lower image boundary, the right image boundary, and the left image boundary undergo convex deformation, and the details can be found in the above examples.
[0116] An embodiment of the present application provides a method for geometric correction of a projected image, comprising: projecting a projected image on a projection screen, and projecting a plurality of correction frame lines corresponding one-to-one to the image boundary of the projected image; wherein the correction frame lines are used to correct the image boundary corresponding to the correction frame lines, and each correction frame line has a plurality of movable points to be corrected, and the plurality of points to be corrected include: two endpoints and at least one interval point of the correction frame line, and the at least one interval point is not on the same straight line as the two endpoints; in response to a configuration operation input by a user for a target correction frame line, determining a target correction point and a target displacement among the plurality of points to be corrected of the target correction frame line; determining a target movement direction according to the deformation direction of the image boundary corresponding to the target correction frame line and the target correction point; and according to the target displacement, controlling the target correction point to move along the target movement direction until the projected image is adapted to the projection screen. In an embodiment of the present application, a correction border line will be projected on the projection screen. Each correction border line has multiple movable points to be corrected. There is no need to calibrate the APP. The geometric correction of the projected image is achieved by moving the target moving point among the multiple points to be corrected. In the case that the projection screen is uneven, the projected image can be adapted to the projection screen through geometric correction.
[0117] This embodiment provides an electronic device, including: a memory and a processor, the memory is used to store a computer program; the processor is used to execute the steps in the geometric correction method of the projection image provided by the above method embodiment when calling the computer program. Its implementation principle and technical effect are similar and will not be repeated here.
[0118] An embodiment of the present disclosure provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the above-mentioned virtual conference scene display method are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0119] The computer readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.
[0120] The present disclosure provides a computer program product, including: when the computer program product is run on a computer, the computer is enabled to implement the above-mentioned virtual conference scene display method.
[0121] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above discussion in some embodiments is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. According to the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.
Claims
1. A method for geometric correction of a projected image, characterized in that: Applied to a projection device, the method comprises: Projecting a projection image on a projection screen, and projecting a plurality of correction frame lines corresponding to the image boundaries of the projection image one by one; wherein the correction frame lines are used to correct the image boundaries corresponding to the correction frame lines, and each correction frame line has a plurality of movable points to be corrected, and the plurality of points to be corrected include: two end points of the correction frame line and at least one interval point, and the at least one interval point is not on the same straight line as the two end points; In response to a configuration operation input by a user for a target correction frame line, determining a target correction point and a target displacement among a plurality of points to be corrected of the target correction frame line; Determining a target moving direction according to a deformation direction of an image boundary corresponding to the target correction frame line and the target correction point; According to the target displacement, the target correction point is controlled to move along the target movement direction until the projection image is adapted to the projection screen.
2. The method according to claim 1, characterized in that The step of controlling the target correction point to move along the target movement direction according to the target displacement until the projection image is adapted to the projection screen comprises: The target correction point is controlled to move at least once along the target moving direction until the projection image is adapted to the projection screen; wherein, in the at least one movement of the target correction point, the displacement of each movement of the target correction point is the target displacement.
3. The method according to claim 1, characterized in that: The method further comprises: In response to a selection operation input by a user for the plurality of correction border lines, a correction border line selected by the user is determined as the target correction border line.
4. The method according to claim 3, characterized in that The deformation direction of the image boundary corresponding to the target correction frame line is a direction away from the first reference screen boundary and close to the second reference screen boundary, the first reference screen boundary is the projection screen boundary corresponding to the target correction frame line, and the first reference screen boundary is opposite to the second reference screen boundary; The step of determining the target moving direction according to the deformation direction of the image boundary corresponding to the target correction frame line and the target correction point includes: If the target correction points are two end points on the target correction border line, the deformation direction is determined as the target movement direction.
5. The method according to claim 4, characterized in that The step of controlling the target correction point to move along the target movement direction according to the target displacement until the projection image is adapted to the projection screen comprises: receiving a user's movement operation on a target interval point on the target correction border line, and if the movement direction of the movement operation is opposite to the target movement direction, controlling the target interval point to remain stationary, so that the target correction point moves along the target movement direction until the projection image is adapted to the projection screen; The target interval point is the interval point farthest from the straight line where the target correction point is located among the at least one interval point.
6. The method according to claim 3, characterized in that: The deformation direction of the image boundary corresponding to the target correction frame line is a direction away from the first reference screen boundary and away from the second reference screen boundary, the first reference screen boundary is the projection screen boundary corresponding to the target correction frame line, and the first reference screen boundary is opposite to the second reference screen boundary; The step of determining the target moving direction according to the deformation direction of the image boundary corresponding to the target correction frame line and the target correction point includes: If the target correction point is a target interval point on the target correction border line, the opposite direction of the deformation direction is determined as the target movement direction, and the target interval point is the interval point farthest from the straight line where the two endpoints are located among the at least one interval point.
7. The method according to claim 6, characterized in that The step of controlling the target correction point to move along the target movement direction according to the target displacement until the projection image is adapted to the projection screen comprises: A moving operation of the user on the target interval point is received, and if the moving direction of the moving operation is the target moving direction, the target interval point is controlled to move along the target moving direction until the projection image is adapted to the projection screen.
8. The method according to claim 1, characterized in that: The step of determining a target correction point and a target displacement among a plurality of to-be-corrected points of the target correction border line in response to a configuration operation input by a user for the target correction border line comprises: Displaying a user interface, wherein the user interface includes a target correction point configuration option and a movement displacement configuration option; The target correction point and the target displacement are determined according to a configuration operation of the target correction point configuration option and the movement displacement configuration option input by the user based on the user interface.
9. The method according to claim 1, characterized in that: The projecting of a plurality of correction frame lines corresponding one-to-one to the image boundaries of the projected image comprises: In response to a geometric correction instruction input by a user for the projected image, displaying geometric correction confirmation information on the projection screen; In response to a confirmation instruction input by a user for the geometric correction confirmation information, a plurality of correction frame lines corresponding one-to-one to image boundaries of the projection image are projected on the projection screen.
10. A projection device, characterized in that: include: Digital light processor; The digital light processor is configured to: project a projection image on a projection screen, and project a plurality of correction frame lines corresponding to image boundaries of the projection image one by one; wherein the correction frame lines are used to correct image boundaries corresponding to the correction frame lines, and each correction frame line has a plurality of movable points to be corrected, and the plurality of points to be corrected include: two endpoints of the correction frame line and at least one interval point, and the at least one interval point is not on the same straight line as the two endpoints; In response to a configuration operation input by a user for a target correction frame line, determining a target correction point and a target displacement among a plurality of points to be corrected of the target correction frame line; Determining a target moving direction according to a deformation direction of an image boundary corresponding to the target correction frame line and the target correction point; According to the target displacement, the target correction point is controlled to move along the target movement direction until the projection image is adapted to the projection screen.