A method and system for intelligent correction of distortion of a fusion projection system

Abstract

The application discloses a kind of distortion intelligent correction method and system of fusion projection system, real-time projection picture is collected by light sensing camera, and non-linear mapping relationship is obtained by comparing from the video frame in projection unit, the correlation coefficient of the non-linear mapping relationship is obtained by Bezier surface technology, the pixel points in the video frame are rearranged by the coefficient, and new video frame is obtained to output, not only can real-time picture distortion be corrected in time, but also when projection picture area is larger, picture definition can be adjusted by the reasonable arrangement of pixel points, the actual experience of user's actual experience can not feel abrupt, and bowl screen and spherical screen and the like heteromorphous screen adjustment can be perfectly supported.

Description

TECHNICAL FIELD

[0001] The application belongs to the field of projection distortion correction, and particularly relates to a distortion intelligent correction method and system of a fusion projection system. BACKGROUND

[0002] With the development of projection technology, projectors have gradually been applied in various industries, and in some exhibitions, the picture projected by the projector is not a flat and square picture. In the current playing media, the picture is embedded with a digital watermark to add correction information to the projector so that the picture of the projector is corrected, and the projection picture can better fit the projection screen. However, this requires setting the projection picture data and the projector before projection, and cannot correct the projection picture in real time, which also affects the actual visual effect. In addition, in some large exhibitions, the area of the projection screen or wall is relatively large, which will reduce the clarity of the picture, which is difficult for users to accept. Therefore, a new solution is needed. SUMMARY

[0003] The application aims to provide a distortion intelligent correction method and system of a fusion projection system to solve one or more technical problems in the prior art and at least provide a beneficial choice or create conditions.

[0004] A distortion intelligent correction method and system of a fusion projection system, the method comprising the following steps:

[0005] S100: collecting the projection condition of the projection picture through a camera;

[0006] S200: obtaining a nonlinear mapping relationship between the projection picture and a video frame in a projection unit according to the distortion condition of the projection picture;

[0007] S300: obtaining the position of a corrected pixel point by using a Bezier curve through the nonlinear mapping relationship, and constructing a matrix;

[0008] S400: mapping the pixel points in the matrix to a polar coordinate system after correction;

[0009] S500: arranging the pixel points into a projection picture suitable for a special-shaped screen through the polar coordinates for projection.

[0010] Further, in the step S100, a light-sensitive camera is used to collect the projection picture of the projector, obtain a video frame of the projection picture, construct a rectangular coordinate system in the video frame, take the pixel points in the video frame as coordinate points in the rectangular coordinate system, and draw the distortion shape of the projection picture in the rectangular coordinate system.

[0011] Further, in the step S200, a rectangular coordinate system is constructed based on the video frame projected in the projection unit, and the pixel points in the video frame in the projection unit are taken as coordinate points in the coordinate system. The pixel points in the video frame of the projection picture are compared with the corresponding pixel points in the video frame in the projection unit, and a non-linear mapping relationship is obtained.

[0012] Further, in the step S300, the Bezier curve is used to correct the position of the pixel point obtained from the non-linear relationship, and the specific steps are as follows:

[0013] S301: The linear pixel points obtained by comparing the pixel points in the video frame of the projection picture with the corresponding pixel points in the video frame in the projection unit are composed into a set X, and the non-linear pixel points are composed into a set F. The pixel points in the set F are coincided with the corresponding pixel points in the video frame in the projection unit, and the Euclidean distance between the pixel points in the set F and the corresponding pixel points in the video frame in the projection unit is calculated by using the Bezier curve, which is named as the offset value of the pixel point. A matrix is constructed by using the offset value.

[0014] S302: In the matrix, the offset value of the pixel point is represented as r, and the relationship between the offset value r of the pixel point and the control point variation is determined. The control point variation is a limited variation value of the projection picture projected on the projection screen, which is used to ensure that the projection picture is projected on the projection screen. The control point variation is represented as Δp. The offset value r of the pixel point is compared with Δp. If r>Δp, the pixel point is marked as a first correction point, the first correction point is rearranged, and the RGB value of the pixel point is changed. If r<Δp, the pixel point is marked as a second correction point, and the second correction point is displaced by the offset value.

[0015] Further, in the step S400, the second correction point in the matrix is mapped into the polar coordinate system by the offset angle, wherein the second correction point is represented as (r, θ) in the polar coordinate system, wherein θ is the offset angle of the second correction point, the position of each pixel point is determined by the polar coordinate point and the offset angle, the second correction point is displaced by the trajectory of the quadratic Bezier curve, and the P2 point of the quadratic Bezier curve is the terminal position of the displacement, wherein the expression of the quadratic Bezier curve is: B(t) = (1-t)²P0+2t(1-t)P1+t²P2, t∈[0, 1], the P0 is the pixel point in the corresponding video frame, the P1 is the pixel point in the projection picture, and the P2 is the terminal position of the displacement of the pixel point in the corresponding video frame, for the first correction point, the Euclidean distance between the P0 and the P2 is L, the distance L is judged, and compared with the Euclidean distance J of the pixel point in the set X, if L>J, the first correction point is added between the second correction points, and the RGB values of the first correction point and the nearest pixel point are adjusted to be consistent, and if LJ, the position of the second correction point meets the condition.

[0016] Further, in the step S500, the pixel points in the corresponding video frame are rearranged in the polar coordinate system to obtain a first correction video frame, and the correction method in the first correction video frame is used in the next frame of the output video frame to obtain a second correction video frame, and the second correction video frame is output.

[0017] Further, a distortion intelligent correction method and system of a fusion projection system, characterized by a distortion intelligent correction system of a fusion projection system, comprising a projector processor, a projection lens, a light sensing camera, a projection unit, a pixel point correction unit and a storage unit, the projection unit, the pixel point correction unit and the storage unit running in the computer program of the projector processor, and the processor executes the computer program to realize the steps in any one of the distortion intelligent correction methods of the fusion projection system.

[0018] The present application has the following advantages: by using the Bezier surface technology to compare the projection picture with the projected video frame, a nonlinear relationship is obtained, the video frame is corrected through the nonlinear relationship, a new video frame projection is obtained, the distorted picture can be corrected in real time, and for a large area of nonlinear mapping picture, the clarity problem of the projection picture can be effectively solved by rearranging the pixel points of the video frame. BRIEF DESCRIPTION OF DRAWINGS

[0019] The above and other features of the present application will become more apparent by describing in detail the embodiments thereof with reference to the attached drawings in which:

[0020] Figure 1 A system flow chart of a distortion intelligent correction method and system of a fusion projection system;

[0021] Figure 2 A system flow chart of a distortion intelligent correction method and system of a fusion projection system. DETAILED DESCRIPTION

[0022] The concept, specific structure and generated technical effects of the present application will be described clearly and completely below in combination with embodiments and drawings to fully understand the purpose, scheme and effects of the present application. It should be noted that the embodiments in the present application and the features in the embodiments can be combined with each other without conflict.

[0023] In the description of the present application, one or more is meant to be one or more, more than two is meant to be two or more, greater than, less than, more than, etc. are understood to not include the number, above, below, within, etc. are understood to include the number. If it is described as first, second, it is only used to distinguish technical features for the purpose, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features or implicitly indicating the sequence of indicated technical features.

[0024] A distortion intelligent correction method and system of a fusion projection system, the method comprising the following steps:

[0025] As shown in a distortion intelligent correction method and system of a fusion projection system, the method comprising the following steps: Figure 1

[0026] S100: acquiring the projection situation of the projection picture by the camera;

[0027] S200: obtaining the nonlinear mapping relationship between the projection picture and the video frame in the projection unit according to the distortion condition of the projection picture;

[0028] S300: obtaining the position of the corrected pixel point by the Bezier curve through the nonlinear mapping relationship, and constructing a matrix;

[0029] S400: mapping the pixel point in the matrix to the polar coordinate system after correction;

[0030] ​S500: arranging the pixel points into a projection picture suitable for the special-shaped screen by polar coordinates.

[0031] Further, in the step S100, the video frame of the projection picture projected by the projector is collected by the light-sensing camera, a rectangular coordinate system is constructed in the video frame, the pixel points in the video frame are taken as coordinate points in the rectangular coordinate system, and the distorted shape of the projection picture is drawn in the rectangular coordinate system.

[0032] Further, in the step S200, a rectangular coordinate system is constructed in the video frame projected by the projection unit, the pixel points in the video frame of the projection unit are taken as coordinate points in the rectangular coordinate system, the pixel points in the video frame of the projection picture are compared with the corresponding pixel points in the video frame of the projection unit, and a nonlinear mapping relationship is obtained.

[0033] Further, in the step S300, the position of the corrected pixel point is obtained by using the Bezier curve, and the specific steps are as follows:

[0034] S301: the linear pixel points obtained by comparing the pixel points in the video frame of the projection picture with the corresponding pixel points in the video frame of the projection unit are composed into a set X, the nonlinear pixel points are composed into a set F, the pixel points in the set F are coincided with the corresponding pixel points in the video frame of the projection unit, the Euclidean distance between the pixel points in the set F and the corresponding pixel points in the video frame of the projection unit is calculated by using the Bezier curve, which is named as the offset value of the pixel point, and a matrix is constructed by using the offset value;

[0035] S302: in the matrix, the offset value of the pixel point is represented as r, the relationship between the offset value r of the pixel point and the control point variation is determined, the control point variation is the limited variation value of the projection picture projected on the projection screen, which is used to ensure that the projection picture is projected on the projection screen, the control point variation is represented as Δp, the offset value r of the pixel point is compared with Δp, if r>Δp, the pixel point is marked as a first correction point, the first correction point is rearranged, and the RGB value of the pixel point is changed, if r<Δp, the pixel point is marked as a second correction point, and the second correction point is displaced by the offset value.

[0036] Further, in the step S400, the second correction point in the matrix is mapped into the polar coordinate system by the offset angle, wherein the second correction point is expressed as (r, θ) in the polar coordinate system, wherein θ is the offset angle of the second correction point, the position of each pixel point is determined by the polar coordinate point and the offset angle, the second correction point is displaced by the trajectory of the quadratic Bezier curve, and the P2 point of the quadratic Bezier curve is the terminal position of the displacement, wherein the expression of the quadratic Bezier curve is: B(t) = (1-t)2P0+2t(1-t)P1+t2P2, t ∈ [0, 1], the P0 is the pixel point in the corresponding video frame, the P1 is the pixel point in the projection picture, and the P2 is the terminal position of the displacement of the pixel point in the corresponding video frame, for the first correction point, the Euclidean distance between the P0 and the P2 is L, the distance L is judged, and compared with the Euclidean distance J of the pixel point in the set X, if L > J, the first correction point is added between the second correction points, and the RGB values of the first correction point and the nearest pixel point are adjusted to be consistent, if L < J, the position of the second correction point meets the condition.

[0037] Further, in the step S500, the pixel points in the corresponding video frame are rearranged in the polar coordinate system to obtain a first correction video frame, and the correction method in the first correction video frame is used in the next frame of the output video frame to obtain a second correction video frame, and the second correction video frame is output.

[0038] Further, an intelligent correction method and system for distortion of a fusion projection system, characterized in that an intelligent correction system for distortion of a fusion projection system comprises a projector processor, a projection lens, a light-sensitive camera, a projection unit, a pixel point correction unit and a storage unit, the projection unit, the pixel point correction unit and the storage unit run in the computer program of the projector processor, and the processor executes the computer program to realize the steps of any one of the intelligent correction methods for distortion of the fusion projection system described above, and those skilled in the art can understand that the example is only an example of the intelligent correction method and system for distortion of the fusion projection system, and does not constitute a limitation on the intelligent correction method and system for distortion of the fusion projection system, which can include more or fewer components, or combine certain components, or different components, for example, the intelligent correction method and system for distortion of the fusion projection system can also include input and output devices, network access devices, buses, etc.

[0039] As Figure 2As shown, the system comprises a projector processor, a projection lens, a light sensing camera, a projection unit, a pixel point correction unit and a storage unit, the units in the program running of the computer comprise:

[0040] The projection unit is configured to output the video frame in the storage unit to the outside through the projection lens.

[0041] The pixel point correction unit is configured to rearrange the pixel points of the distorted projection picture.

[0042] The storage unit is configured to store the video frame in the video resource and the projection picture collected by the light sensing camera.

[0043] Although the description of the present application has been quite detailed and particularly described with respect to several embodiments, it is not intended to be limited to any of these details or embodiments or any special embodiment, so as to effectively cover the intended scope of the present application. In addition, the present application is described above in the embodiments that the inventor can foresee, and the purpose is to provide a useful description, and those non-essential modifications to the present application that have not yet been foreseen can still represent equivalent modifications of the present application.

[0044] In the description of the present application, the description of the terms "one embodiment", "some embodiments", "exemplary embodiment", "example", "specific example" or "some examples" means that the specific features, structures, materials or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. In the present application, the exemplary description of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner.

Claims

1. A method for intelligent correction of distortion of a fusion projection system, characterized in that, The method comprises the following steps: S100: collecting the projection situation of the projection picture by the camera; S200: obtaining the non-linear mapping relationship between the projection picture and the video frame in the projection unit according to the distortion condition of the projection picture; S300: obtaining the position of the corrected pixel point by the non-linear mapping relationship and the Bezier curve, and constructing a matrix; S400: mapping the pixel points in the matrix to the polar coordinate system after correction; S500: arranging the pixel points in the polar coordinate system into a projection picture suitable for the special-shaped screen for projection; In the step S300, the position of the corrected pixel point is obtained by the non-linear mapping relationship and the Bezier curve, and the specific steps are as follows: S301: comparing the linear pixel points obtained by comparing the pixel points in the video frame of the projection picture with the corresponding pixel points in the video frame of the projection unit to form a set X, and comparing the non-linear pixel points to form a set F, and superimposing the pixel points in the set F with the corresponding pixel points in the video frame of the projection unit, calculating the Euclidean distance between the pixel points in the set F and the corresponding pixel points in the video frame of the projection unit by using the Bezier curve, and naming the offset value of the pixel point, and constructing a matrix by using the offset value; S302: in the matrix, the offset value is represented by r, the relationship between the offset value r of the pixel point and the control point variation is determined, the control point variation is the limited variation value of the projection picture projected on the projection screen, which is used to ensure that the projection picture is projected on the projection screen, the control point variation is represented by Δp, the offset value r of the pixel point is compared with Δp, if r> Δp, the pixel point is marked as a first correction point, the first correction point is rearranged, and the RGB value of the pixel point is changed, if r< Δp, the pixel point is marked as a second correction point, and the second correction point is displaced by the size of the offset value. In the step S400, the second correction point in the matrix is mapped into the polar coordinate system by the offset value and the angle of the offset, wherein the second correction point is represented as (r, θ) in the polar coordinate system, wherein θ is the angle of the offset of the second correction point, the position of each pixel point is determined by the polar coordinate point and the offset angle, the second correction point is displaced by the trajectory of the quadratic Bezier curve, and the P2 point of the quadratic Bezier curve is the endpoint position of the displacement, wherein the expression of the quadratic Bezier curve is: B(t) = (1-t)²P0+2t(1-t)P1+t²P2, t∈[0, 1], the P0 is the pixel point in the corresponding video frame, the P1 is the pixel point in the projection picture, and the P2 is the endpoint position of the displacement of the pixel point in the corresponding video frame, for the first correction point, the Euclidean distance between the P0 and the P2 is L, the distance L is judged, and the Euclidean distance J of the pixel point in the set X is compared, if L>J, the first correction point is added between the second correction points, and the RGB values of the first correction point and the nearest pixel point are adjusted to be consistent, if LJ, the position of the second correction point meets the condition.

2. The method of claim 1, wherein, In the step S100, the video frame of the projection picture of the projector is obtained by the light sensing camera, a rectangular coordinate system is constructed in the video frame, the pixel points in the video frame are taken as the coordinate points in the rectangular coordinate system, and the distorted shape of the projection picture is drawn in the rectangular coordinate system.

3. The method of claim 1, wherein the method further comprises: In the step S200, a rectangular coordinate system is constructed for the video frame projected by the projection unit, the pixel points in the video frame of the projection unit are taken as the coordinate points in the coordinate system, the pixel points in the video frame of the projection picture are compared with the corresponding pixel points in the video frame of the projection unit, and a nonlinear mapping relationship is obtained.

4. The method of claim 1, wherein, In the step S500, the pixel points in the corresponding video frame are rearranged in the polar coordinate system to obtain a first correction video frame, the correction method in the first correction video frame is used in the next frame of output video frame to obtain a second correction video frame, and the second correction video frame is output.

5. A distortion intelligent correction system of a fusion projection system, characterized in that, An intelligent correction system for the distortion of a fusion projection system includes a projector processor, a projection lens, a light sensing camera, a projection unit, a pixel point correction unit, and a storage unit, the projection unit, the pixel point correction unit, and the storage unit run in the computer program of the projector processor, and the processor implements the steps in any one of the intelligent correction methods for the distortion of the fusion projection system in claims 1-4 when executing the computer program.

Images