Transparent screen insertion method, projection equipment and computer storage medium

By projecting the detection image containing feature patterns to the transparent screen and adjusting the projected image according to the feature coordinates of the captured image, the problem of inaccurate entry of the existing projection equipment on the transparent screen is solved, and the convenience and accuracy of automatic entry of the screen is achieved.

CN116320333BActive Publication Date: 2025-08-29深圳市当智科技有限公司
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310046930.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-01-31
Publication Date
2025-08-29
Estimated Expiration
2043-01-31

AI Technical Summary

Technical Problem

It is difficult for existing projection devices to accurately enter the screen on transparent screens, especially for transparent screens with fully transparent frames. The camera cannot recognize the edge of the screen and needs to manually adjust the four corners of the image to enter the screen.

Method used

The preset detection image is projected to the transparent screen, and the detection image includes the first feature pattern of the intermediate area and a plurality of second feature patterns of the peripheral area. By acquiring the captured image and feature coordinates of the transparent screen, the pattern coordinates of the target second feature pattern in the detection image are determined, and the target projected image to be projected is adjusted according to the pattern coordinates.

Benefits of technology

The automatic entry of the transparent screen is realized, which avoids manual adjustments and improves the convenience and accuracy of entry into the screen.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116320333B_ABST
    Figure CN116320333B_ABST
Patent Text Reader

Abstract

The present application provides a method for entering a transparent screen, a projection device, and a computer storage medium, the method comprising: projecting a preset detection image onto the transparent screen, wherein the detection image comprises a first characteristic pattern in a middle area and multiple second characteristic patterns in a peripheral area, and the first characteristic pattern and each of the second characteristic patterns in the detection image have a determined relative positional relationship; acquiring a captured image of the transparent screen; determining, based on the relative positional relationship and the characteristic coordinates of the first characteristic pattern and the target second characteristic pattern in the captured image, the pattern coordinates of the target second characteristic pattern in the detection image, wherein the target second characteristic pattern belongs to the second characteristic pattern of the transparent screen border; adjusting the target projection image to be projected according to the pattern coordinates; and realizing automatic entry into the transparent screen in an embodiment of the present application, making entry into the transparent screen more convenient and accurate.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of projection technology, and in particular to a method for inserting a transparent screen, a projection device, and a computer storage medium (computer-readable storage medium). Background Art

[0002] The HUD (full name in English: Head Up Display, full name in Chinese: Head-up Display) system essentially projects the information to be displayed onto a transparent medium in front of the driver, allowing the driver to see the surrounding scene and the display information projected onto the transparent medium at the same time through the transparent medium.

[0003] With the development of projection technology, HUD systems are gradually being applied to ordinary home and commercial projection systems. For example, ordinary transparent screens are replaced with transparent screens with special microstructures to achieve a semi-transparent and semi-reflective effect. This allows the scene behind the transparent screen and the projected information to be displayed, allowing users to experience augmented reality. In most cases, it is difficult for the projected image of the projection device to be completely located on the screen. Especially for transparent screens with completely transparent borders, the camera cannot recognize the screen edges for automatic inclusion, and manual adjustment of the four corners of the image is often required to achieve inclusion. Summary of the Invention

[0004] The present application provides a transparent screen insertion method, a projection device and a computer storage medium, which are used to solve the technical problems that the current projection device insertion operation is relatively troublesome and cannot be accurately inserted into the screen.

[0005] In a first aspect, the present application provides a method for entering a transparent screen, the method comprising:

[0006] Projecting a preset detection image onto a transparent screen, wherein the detection image includes a first characteristic pattern in a central area and a plurality of second characteristic patterns in a peripheral area, and the first characteristic pattern and each of the second characteristic patterns in the detection image have a determined relative positional relationship;

[0007] Acquiring a captured image of the transparent screen;

[0008] Determining, based on the relative positional relationship and the characteristic coordinates of the first characteristic pattern and the target second characteristic pattern in the captured image, the pattern coordinates of the target second characteristic pattern in the detected image, wherein the target second characteristic pattern belongs to the second characteristic pattern displayed on the outermost periphery of the transparent screen;

[0009] The target projection image to be projected is adjusted according to the pattern coordinates.

[0010] In some embodiments of the present application, determining the pattern coordinates of the target second characteristic pattern in the detection image based on the characteristic coordinates of the first characteristic pattern and the target second characteristic pattern in the captured image and the relative positional relationship includes:

[0011] calculating a target coordinate ratio between a first feature coordinate of the first feature pattern and a second feature coordinate of the target second feature pattern in the captured image;

[0012] The relative position relationship is queried to determine the second characteristic pattern corresponding to the target coordinate ratio in the relative position relationship, so as to obtain the pattern coordinates of the target second characteristic pattern in the detection image.

[0013] In some embodiments of the present application, the step of calculating the target coordinate ratio between the first feature coordinates of the first feature pattern in the captured image and the second feature coordinates of the target second feature pattern includes one of the following:

[0014] Acquire a first characteristic coordinate of the first characteristic pattern and a second characteristic coordinate of the target second characteristic pattern;

[0015] Obtaining a target coordinate ratio according to a ratio of a horizontal coordinate difference to a vertical coordinate difference between the first characteristic coordinate and the second characteristic coordinate; or

[0016] Acquire the two first characteristic coordinates of the first characteristic pattern and the second characteristic coordinates of the target second characteristic pattern;

[0017] The target coordinate ratio is obtained according to the ratio of the difference between the second characteristic coordinate and the abscissa or ordinate of one first characteristic coordinate, and the difference between the second characteristic coordinate and the abscissa or ordinate of another first characteristic coordinate.

[0018] In some embodiments of the present application, the relative position relationship is determined by the following method:

[0019] Acquire a first relative coordinate of a first characteristic pattern in the detection image, and a second relative coordinate of each of the second characteristic patterns in the detection image;

[0020] respectively calculating the coordinate ratios between the first relative coordinates and each of the second relative coordinates;

[0021] For each of the second characteristic patterns, the pattern number of the second characteristic pattern, the pattern coordinates of the second characteristic pattern, and the coordinate ratio corresponding to the second characteristic pattern are associated to obtain a relative position relationship.

[0022] In some embodiments of the present application, the number of the first characteristic pattern in the detection image is one, and the first characteristic pattern includes: at least one of a QR code, a barcode, and a calibration pattern;

[0023] The number of the second characteristic patterns in the detection image is at least four, and the plurality of second characteristic patterns are symmetrically distributed in the detection image and surround the first characteristic pattern. The plurality of second characteristic patterns constitute at least one of a characteristic dot matrix, an array-arranged polygonal pattern, and an interval-arranged strip pattern.

[0024] In some embodiments of the present application, the target second characteristic pattern is determined by the following method:

[0025] In the captured image, four second characteristic patterns with the smallest x coordinate and the smallest y coordinate, the smallest x coordinate and the largest y coordinate, the largest x coordinate and the smallest y coordinate, and the largest x coordinate and the largest y coordinate are determined as the second characteristic patterns displayed on the outermost periphery of the transparent screen.

[0026] In some embodiments of the present application, adjusting the target projection image to be projected according to the pattern coordinates of the target second characteristic pattern, and projecting the adjusted target projection image onto the transparent screen, includes:

[0027] Acquiring pattern coordinates of the second characteristic pattern of the target, and determining a scaling ratio according to the pattern coordinates and size information of the target projection image to be projected;

[0028] The target projection image is adjusted according to the scaling ratio, and the adjusted target projection image is projected onto the transparent screen.

[0029] In some embodiments of the present application, before projecting the preset detection image onto the transparent screen, the method includes:

[0030] Projecting a preset calibration image onto a transparent screen, and photographing the transparent screen onto which the preset calibration image is projected to obtain a calibration photographed image;

[0031] Establishing a homography matrix according to the first coordinates of the calibration pattern in the preset calibration image and the second coordinates of the calibration pattern in the calibration captured image;

[0032] The preset detection image is subjected to trapezoidal correction according to the homography matrix, so as to project the detection image after the trapezoidal correction onto the transparent screen.

[0033] In some embodiments of the present application, before the step of projecting the preset detection image onto the transparent screen and the step of acquiring the captured image of the transparent screen, the method further includes:

[0034] Shooting the transparent screen on which the preset detection image is projected to obtain a calibration shot image;

[0035] Establishing a homography matrix according to a plurality of corresponding coordinates of the first feature map in the detection image and the calibration captured image;

[0036] The preset detection image is subjected to trapezoidal correction according to the homography matrix, so as to project the detection image after the trapezoidal correction onto the transparent screen.

[0037] In some embodiments of the present application, after the step of performing trapezoidal correction on the preset detection image according to the homography matrix, the method further includes:

[0038] Acquire a first relative coordinate of the first characteristic pattern and a second relative coordinate of each of the second characteristic patterns in the detection image after trapezoidal correction;

[0039] Calculating coordinate ratios between the first relative coordinates and each of the second relative coordinates to obtain coordinate ratio associations between each of the second characteristic patterns and the first characteristic pattern;

[0040] Based on the coordinate scale association, the relative position relationship is updated.

[0041] On the other hand, an embodiment of the present application provides a transparent screen entry device;

[0042] The transparent screen entry device includes:

[0043] a projection module, configured to project a preset detection image onto a transparent screen, wherein the detection image comprises a first characteristic pattern in a central area and a plurality of second characteristic patterns in a peripheral area, and a predetermined relative positional relationship exists between the first characteristic pattern and each of the second characteristic patterns in the detection image;

[0044] An acquisition module, configured to acquire a photographed image of the transparent screen;

[0045] a determination module, configured to determine, based on the relative positional relationship and the characteristic coordinates of the first characteristic pattern and the target second characteristic pattern in the captured image, the pattern coordinates of the target second characteristic pattern in the detected image, wherein the target second characteristic pattern belongs to the second characteristic pattern displayed most peripherally on the transparent screen;

[0046] The screen entry module is used to adjust the target projection image to be projected according to the pattern coordinates.

[0047] On the other hand, an embodiment of the present application also provides a projection device, which includes a participant and an initiator. The projection device is provided with a processor and a memory, and the memory stores a computer program corresponding to the entry of a transparent screen, and the transparent screen entry program can be run on the processor. The processor executes the transparent screen entry program to implement the steps in the above-mentioned transparent screen entry method.

[0048] On the other hand, an embodiment of the present application also provides a computer-readable storage medium, which stores multiple instructions suitable for loading by a processor. The computer-readable storage medium stores a transparent screen entry program, which is executed by the processor to implement the steps in the above-mentioned transparent screen entry method.

[0049] From the above content, it can be concluded that this application has the following beneficial effects:

[0050] The present application provides a method for projecting a transparent screen, a projection device, and a computer storage medium. The method comprises: projecting a preset detection image onto the transparent screen, wherein the detection image includes a first characteristic pattern in a central area and multiple second characteristic patterns in a peripheral area, and the first characteristic pattern and each of the second characteristic patterns in the detection image have a determined relative positional relationship; acquiring a captured image of the transparent screen; determining pattern coordinates of the target second characteristic pattern in the detection image based on the relative positional relationship and characteristic coordinates of the first characteristic pattern and a target second characteristic pattern in the captured image, wherein the target second characteristic pattern belongs to the second characteristic pattern displayed most peripherally on the transparent screen; adjusting a target projection image to be projected according to the pattern coordinates; and projecting the adjusted target projection image onto the transparent screen. In an embodiment of the present application, the detection image is projected onto the transparent screen, and pattern coordinates of the second characteristic pattern displayed most peripherally on the transparent screen are obtained according to the relative positional relationship between the first characteristic pattern and the second characteristic pattern in the detection image, thereby determining a screen border of the transparent screen. Then, the target projection image to be projected is adjusted according to the screen border to achieve automatic screen projecting, eliminating the need for manual adjustment and making transparent screen projecting more convenient and accurate. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0052] Figure 1Schematic diagram of a scene of a transparent screen entry method provided by an embodiment of the present application;

[0053] Figure 2 This is a flow chart of an embodiment of a method for entering a transparent screen in an embodiment of the present application;

[0054] Figure 3 A schematic diagram of a scene of an embodiment of detecting an image in a method for entering a transparent screen in an embodiment of the present application;

[0055] Figure 4 This is a schematic diagram of a scene of an embodiment of the method for capturing an image in a transparent screen according to an embodiment of the present application;

[0056] Figure 5 A schematic diagram of a scene of an embodiment of determining a frame of a captured image in a method for entering a transparent screen in an embodiment of the present application;

[0057] Figure 6 This is a schematic flow chart of an embodiment of determining pattern coordinates in a method for entering a transparent screen in an embodiment of the present application;

[0058] Figure 7 Schematic diagram of the relative position relationship in the method of inserting a transparent screen in an embodiment of the present application;

[0059] Figure 8 This is a flow chart of an embodiment of the trapezoidal correction in the method for entering a transparent screen provided in an embodiment of the present application;

[0060] Figure 9 This is a flow chart of an embodiment of a method for entering a transparent screen provided in an embodiment of the present application;

[0061] Figure 10 1 is a schematic structural diagram of an embodiment of a transparent screen entry device provided in an embodiment of the present application;

[0062] Figure 11 It is a schematic structural diagram of an embodiment of the projection device provided in the embodiments of the present application. DETAILED DESCRIPTION

[0063] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative efforts are within the scope of the present invention.

[0064] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like indicate positions or coordinate relationships based on the positions or coordinate relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific position, be constructed and operated in a specific position, and therefore cannot be understood as limiting the present invention. In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the said features. In the description of the present invention, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.

[0065] In this application, the word "exemplary" is used to mean "serving as an example, illustration, or illustration." Any embodiment described in this application as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments. The following description is given to enable any person skilled in the art to make and use the invention. In the following description, details are listed for the purpose of explanation. It should be understood that one of ordinary skill in the art will recognize that the invention can be practiced without these specific details. In other instances, well-known structures and processes are not described in detail to avoid obscuring the description of the invention with unnecessary detail. Therefore, the present invention is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.

[0066] In the embodiments of the present application, a method, device, and computer storage medium for entering a transparent screen are provided, which are described in detail below.

[0067] The transparent screen entry method in the embodiment of the present invention is applied to the transparent screen entry device, and the transparent screen entry device is arranged in the projection device, and the projection device is provided with one or more processors, memories, and one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the transparent screen entry method; the projection device can be a terminal, such as a mobile phone or a tablet computer, and the projection device can also be a server, or a service cluster composed of multiple servers.

[0068] like Figure 1 As shown, Figure 1This is a scene diagram of the transparent screen entry method in an embodiment of the present application. The transparent screen entry scene in the embodiment of the present invention includes a projection device 100 (a transparent screen entry device is integrated in the projection device 100), and a computer storage medium corresponding to the transparent screen entry is run in the projection device 100 to execute the transparent screen entry steps.

[0069] It is understandable that Figure 1 The projection device in the scene of the transparent screen entering the screen, or the devices included in the projection device, does not constitute a limitation on the embodiments of the present invention. That is, the number of devices and types of devices included in the scene of the transparent screen entering the screen, or the number and types of devices included in each device, do not affect the overall implementation of the technical solution in the embodiment of the present invention, and can all be regarded as equivalent replacements or derivatives of the technical solution claimed to be protected in the embodiment of the present invention.

[0070] In an embodiment of the present invention, the projection device 100 is mainly used to: project a preset detection image onto a transparent screen, wherein the detection image includes a first characteristic pattern in a middle area and multiple second characteristic patterns in a peripheral area, and the first characteristic pattern and each second characteristic pattern in the detection image have a determined relative position relationship; obtain a captured image of the transparent screen; based on the relative position relationship and the characteristic coordinates of the first characteristic pattern and the target second characteristic pattern in the captured image, determine the pattern coordinates of the target second characteristic pattern in the detection image, and the target second characteristic pattern belongs to the second characteristic pattern displayed on the outermost periphery of the transparent screen; and adjust the target projection image to be projected according to the pattern coordinates.

[0071] In the embodiments of the present invention, the projection device 100 may be a standalone projection device, or a projection device grid or projection device cluster composed of projection devices. For example, the projection device 100 described in the embodiments of the present invention includes, but is not limited to, a computer, a grid host, a single grid projection device, a set of multiple grid projection devices, or a cloud projection device composed of multiple projection devices. A cloud projection device is composed of a large number of computers or grid projection devices based on cloud computing.

[0072] Those skilled in the art will understand that Figure 1 The application environment shown in the figure is only one application scenario of the present application solution and does not constitute a limitation on the application scenario of the present application solution. Other application environments may also include Figure 1 More or fewer projection devices as shown in , or the projection device grid connection relationship, such as Figure 1 Only one projection device is shown in the figure. It can be understood that the scene of the transparent screen can also include one or more other projection devices, which are not limited here. The projection device 100 can also include a memory.

[0073] In addition, in the scenario of the transparent screen entering the screen of the present application, the projection device 100 can be provided with a display device, or the projection device 100 is not provided with a display device and is in communication with an external display device 200, and the display device 200 is used to output the result of the execution of the transparent screen entering the screen method in the projection device. The projection device 100 can access a backend database 300 (the backend database can be in the local memory of the projection device, or the backend database can also be set in the cloud), and the backend database 300 stores information related to the transparent screen entering the screen.

[0074] It should be noted that Figure 1 The scene diagram of the transparent screen entry method shown is only an example. The scene of the transparent screen entry described in the embodiment of the present invention is to more clearly illustrate the technical solution of the embodiment of the present invention, and does not constitute a limitation on the technical solution provided by the embodiment of the present invention.

[0075] Based on the above-mentioned scenario of a transparent screen entering a screen, an embodiment of a method for a transparent screen entering a screen is proposed.

[0076] like Figure 2 As shown, Figure 2 This is a flow chart of an embodiment of a method for entering a transparent screen in an embodiment of the present application. The method for entering a transparent screen includes steps 201-204:

[0077] 201. Projecting a preset detection image onto a transparent screen, wherein the detection image includes a first characteristic pattern in a central area and a plurality of second characteristic patterns in a peripheral area, and a predetermined relative positional relationship exists between the first characteristic pattern and each of the second characteristic patterns in the detection image;

[0078] The transparent screen entry method in this embodiment is applied to a projection device, and a detection image is preset in the projection device, and the detection image includes a first characteristic pattern and a second characteristic pattern. The first characteristic pattern is unique, and the coordinates such as the vertices of the corresponding orientation of the first characteristic pattern are easy to identify; the number of the second characteristic patterns is large, and each second characteristic pattern has a unique pattern number, and these second characteristic patterns are located in the peripheral area of ​​the detection image. The pattern coordinates of the second characteristic pattern with each pattern number in the detection image have a determined and unique relative position relationship with the first characteristic pattern. The relative position relationship can feedback the spatial position between the first characteristic pattern and each second characteristic pattern. For example, the relative position relationship is that a second characteristic image is 10 cm away from the first characteristic pattern at 45 degrees to the upper right corner of the first characteristic pattern.

[0079] like Figure 3 As shown, Figure 3A schematic diagram of a scene of an embodiment of detecting an image in a method for entering a transparent screen in an embodiment of the present application; Figure 3 The number of first characteristic patterns in the detection image is one, and the first characteristic pattern includes: at least one of a QR code, a barcode, and a calibration pattern; the number of second characteristic patterns in the detection image is at least four, and each corner point of the first characteristic pattern corresponds to a second characteristic pattern along the diagonal direction. Preferably, at least one second characteristic pattern is distributed in each of the four diagonal directions of the first characteristic pattern, and the rectangle formed by these four second characteristic patterns can enclose the first characteristic pattern. Multiple second characteristic patterns are symmetrically distributed in the detection image and surround the first characteristic pattern. In addition, the first characteristic pattern does not need to be strictly located in the central area of ​​the detection image, but can also be across the edge of the central area or outside the area. Multiple second characteristic patterns constitute at least one of a characteristic dot matrix, an array-arranged polygonal pattern, and an interval-arranged bar pattern.

[0080] The projection device projects a preset detection image onto the transparent screen.

[0081] 202. Acquire a captured image of the transparent screen.

[0082] The projecting device is provided with a preset acquisition device, and the structure of the preset acquisition device is not limited. For example, the preset acquisition device is a camera module. After the projecting device projects the preset detection image onto the transparent screen, the projecting device controls the preset acquisition device to shoot the transparent screen on which the detection image is projected, and obtains a captured image. Figure 4 As shown, Figure 4 This is a scene diagram of an embodiment of capturing images in a method for entering a transparent screen in an embodiment of the present application.

[0083] The projection device performs image recognition on the captured image, wherein the method of image recognition is not specifically limited. For example, an image recognition model is preset in the projection device, and the projection device recognizes the captured image through the image recognition model to obtain a first characteristic pattern and a second characteristic pattern in the captured image. Furthermore, the projection device obtains a first characteristic coordinate of the first characteristic pattern in the captured image, and a second characteristic coordinate of the second characteristic pattern in the captured image.

[0084] 203. Based on the relative position relationship and the characteristic coordinates of the first characteristic pattern and the target second characteristic pattern in the captured image, determine the pattern coordinates of the target second characteristic pattern in the detection image, and the target second characteristic pattern belongs to the second characteristic pattern displayed on the outermost periphery of the transparent screen.

[0085] The projection device determines the screen frame of the transparent screen by using the relative position relationship, the characteristic coordinates of the first characteristic pattern in the captured image, and the characteristic coordinates of the target second characteristic pattern in the captured image. Before step 203, the projection device pre-sets the relative position relationship. The relative position relationship is the coordinate ratio relationship between the second relative coordinates of each second characteristic pattern in the detected image and the first relative coordinates of the first characteristic pattern in the detected image. The relative position relationship includes the ratio of the second characteristic patterns at different positions to the corresponding target coordinates. The relative position relationship setting method is not limited. The second characteristic pattern at each position corresponds to a target coordinate ratio. In this embodiment, a relative position relationship setting method is provided, including:

[0086] 1. Acquire a first relative coordinate of a first characteristic pattern in the detection image, and a second relative coordinate of each of the second characteristic patterns in the detection image;

[0087] 2. Calculate the coordinate ratios between the first relative coordinates and each of the second relative coordinates respectively;

[0088] 3. For each of the second characteristic patterns, associate the pattern number of the second characteristic pattern, the pattern coordinates of the second characteristic pattern, and the coordinate ratio corresponding to the second characteristic pattern to obtain a relative position relationship.

[0089] That is, the projection device obtains the first relative coordinates of the first characteristic pattern in the detection image, and the second relative coordinates of each second characteristic pattern in the detection image; the projection device respectively calculates the coordinate ratio between the first relative coordinate and each second relative coordinate; for each of the second characteristic patterns, the projection device associates the pattern coordinates of the second characteristic pattern with the coordinate ratio corresponding to the second characteristic pattern to obtain a relative position relationship.

[0090] After the projection device obtains the captured image of the transparent screen, the projection device obtains the first characteristic coordinates of the first characteristic pattern in the captured image, and the projection device obtains the second characteristic coordinates of the target second characteristic pattern in the captured image, wherein the target second characteristic pattern belongs to the second characteristic pattern displayed on the outermost periphery of the transparent screen. The projection device calculates the target coordinate ratio between the first characteristic coordinates and the second characteristic coordinates. The relative position relationship is pre-stored in the projection device. The projection device queries the pre-stored relative position relationship to obtain the target second characteristic pattern corresponding to the target coordinate ratio, as well as the pattern coordinates of the target second characteristic pattern in the detection image.

[0091] 204 : Adjust the target projection image to be projected according to the pattern coordinates.

[0092] like Figure 5 As shown, Figure 5This is a scene diagram of an embodiment of the transparent screen entry method for determining the frame of the captured image in the embodiment of the present application; the projection device determines the screen frame of the transparent screen based on the pattern coordinates; the projection device adjusts the target projection image to be projected based on the screen frame, and the detection image in the projection device and the image to be projected are the same size. The projection device determines the pattern coordinates of the target second characteristic pattern, and then moves the four vertices of the image to be projected to the corresponding pattern coordinates, so that the screen entry can be achieved. In addition, the projection device can also determine the screen frame of the projection screen based on the pattern coordinates of the target second characteristic pattern to obtain the screen size, thereby automatically entering the screen, specifically including:

[0093] 1. Obtaining pattern coordinates of the second characteristic pattern of the target, and determining a scaling ratio based on the pattern coordinates and size information of the target projection image to be projected;

[0094] 2. Adjusting the target projection image according to the scaling ratio, and projecting the adjusted target projection image onto the transparent screen.

[0095] That is, in this embodiment, the projection device obtains the pattern coordinates of the second characteristic pattern of the target in the detection image, the projection device sets the pattern coordinates as the frame position of the screen frame of the transparent screen, the projection device determines the screen size of the transparent screen according to the screen frame, and the projection device determines the scaling ratio according to the screen size of the transparent screen and the size information of the target projection image to be projected; the projection device adjusts the target projection image according to the scaling ratio, and projects the adjusted target projection image onto the transparent screen.

[0096] In another embodiment, the captured image is a planar image having x-axis and y-axis coordinates. Four second characteristic patterns are determined in the captured image, each having a minimum x-coordinate and a minimum y-coordinate, a minimum x-coordinate and a maximum y-coordinate, a maximum x-coordinate and a minimum y-coordinate, and a maximum x-coordinate and a maximum y-coordinate. These four second characteristic patterns are used as the outermost second characteristic patterns displayed on the transparent screen, i.e., the target second characteristic patterns. Subsequently, the coordinates of these four target second characteristic patterns in the detection image are determined based on step 203. Finally, the coordinates of the four vertices of the target projection image to be projected are adjusted to be consistent with the coordinates of the four target second characteristic patterns, so that the adjusted target projection image can be fully projected onto the transparent screen, thereby achieving the projection image being projected onto the screen.

[0097] In the embodiment of the present application, a detection image is projected onto a transparent screen, and the pattern coordinates of the second characteristic pattern displayed on the outermost edge of the transparent screen are obtained based on the relative positional relationship between the first characteristic pattern and the second characteristic pattern in the detection image, thereby determining the screen border of the transparent screen. Then, the target projection image to be projected is adjusted according to the screen border to achieve automatic screen entry without the need for manual adjustment, making transparent screen entry more convenient and accurate.

[0098] like Figure 6 As shown, Figure 6 This is a flow chart of an embodiment of determining pattern coordinates in a method for entering a transparent screen according to an embodiment of the present application. The method for entering a transparent screen includes steps 301-302:

[0099] 301 : Calculate a target coordinate ratio between a first feature coordinate of the first feature pattern and a second feature coordinate of the target second feature pattern in the captured image.

[0100] The projection device calculates the target coordinate ratio between the first feature coordinates of the first feature pattern in the captured image and the second feature coordinates of the target second feature pattern in the captured image. In this embodiment, the method for the projection device to determine the target coordinate ratio is not specifically limited. For example,

[0101] Implementation method 1: The projection device obtains the first characteristic coordinates of the first characteristic pattern and the second characteristic coordinates of the target second characteristic pattern; the projection device obtains the target coordinate ratio based on the ratio of the horizontal coordinate difference and the vertical coordinate difference between the first characteristic coordinate and the second characteristic coordinate.

[0102] Implementation method two: The projection device obtains the two first characteristic coordinates of the first characteristic pattern and the second characteristic coordinate of the target second characteristic pattern; the projection device obtains the target coordinate ratio based on the ratio of the difference between the second characteristic coordinate and the horizontal coordinate or vertical coordinate of one first characteristic coordinate, and the ratio of the difference between the second characteristic coordinate and the horizontal coordinate or vertical coordinate of another first characteristic coordinate.

[0103] 302 : Query the relative position relationship, determine the second characteristic pattern corresponding to the target coordinate ratio in the relative position relationship, and obtain pattern coordinates of the target second characteristic pattern in the detection image.

[0104] like Figure 7 As shown, Figure 7 This is a schematic diagram of an embodiment of the relative position relationship generated in the method for entering a transparent screen in an embodiment of the present application; the relative position relationship in the embodiment of the present application is not specifically limited, and the relative position relationship may include a first relative position relationship and / or a second relative position relationship, wherein,

[0105] The first relative position relationship is set as follows: the projection device obtains a first relative coordinate (such as coordinate a in the figure) of a first characteristic pattern in the detection image, and obtains a second characteristic coordinate (such as coordinate ak in the figure) of each second characteristic pattern in the detection image; the projection device obtains a target coordinate ratio (such as △x1 / △y1) based on the ratio of the abscissa difference and ordinate difference (such as △x1 or △y1 in the figure) between the first characteristic coordinate and each second characteristic coordinate; for each second characteristic pattern, the projection device assigns a pattern number to the second characteristic pattern, and associates the pattern coordinates of each second characteristic pattern with the target coordinate ratio corresponding to the second characteristic pattern to obtain the first relative position relationship, where second characteristic patterns with different numbers in the first relative position relationship correspond to different target coordinate ratio values;

[0106] The second relative position relationship is set as follows: the projection device obtains the two first feature coordinates of the first feature pattern in the detection image (such as the coordinates of a and c in the figure), and the projection feature obtains the second feature coordinates of each second feature pattern in the detection image (such as the coordinates of ak in the figure); the projection device obtains the target coordinate ratio based on the ratio of the difference between the second feature coordinate and the horizontal coordinate or vertical coordinate of one first feature coordinate (such as △x1 or △y1 in the figure), and the difference between the horizontal coordinate or vertical coordinate of another first feature coordinate (such as △x1+△x0 or △y1+△y0 in the figure), so as to obtain the △x1 / (△x1+△x0) and / or △y1 / (△y1+△y0) values ​​of the coordinates of each second feature pattern relative to the coordinates of points a and c. For each second feature pattern, the projection device assigns a pattern number to the second feature pattern, and the pattern coordinates of each second feature pattern are associated with the target coordinate ratio corresponding to the second feature pattern to obtain the second relative position relationship. In the second relative position relationship, second feature patterns with different pattern numbers correspond to different target coordinate ratio values. For example Figure 7 The last figure shows a detection image containing 8 second feature patterns, wherein each second feature pattern has a unique corresponding target coordinate ratio value relative to the coordinates in the first feature pattern.

[0107] Based on the method for generating the target coordinate ratio between the first characteristic coordinates and the second characteristic coordinates of the target second characteristic pattern, the projection device searches for a relative position relationship generated in the same manner as the target coordinate ratio, determines the target second characteristic pattern corresponding to the target coordinate ratio in the relative position relationship, and obtains the pattern coordinates of the target second characteristic pattern in the detection image. This accurately determines the screen border of the transparent screen, enabling automatic screen insertion, making transparent screen insertion more convenient and accurate.

[0108] Reference Figure 8 , Figure 8 It is a flow chart of an embodiment of trapezoidal correction in the method for entering a transparent screen provided in an embodiment of the present application.

[0109] In some embodiments of the present application, before step 201 projects the preset detection image onto the transparent screen, steps 401-403 are included:

[0110] 401, projecting a preset calibration image onto a transparent screen, and photographing the transparent screen projecting the preset calibration image to obtain a calibration photographed image;

[0111] 402, establishing a homography matrix according to the first coordinates of the calibration pattern in the preset calibration image and the second coordinates of the calibration pattern in the calibration captured image;

[0112] 403 : Perform trapezoidal correction on the preset detection image according to the homography matrix, so as to project the detection image after the trapezoidal correction onto the transparent screen.

[0113] In this embodiment, a projection device projects a preset calibration image onto a transparent screen. The preset calibration image includes a regularly arranged calibration pattern, such as a checkerboard. The projection device captures the transparent screen onto which the preset calibration image is projected, obtaining a captured calibration image. The projection device establishes a homography matrix based on the first coordinates of the calibration pattern in the preset calibration image and the second coordinates of the calibration pattern in the captured calibration image. The projection device then performs trapezoidal correction on the preset detection image based on the homography matrix, projecting the trapezoidal-corrected detection image onto the transparent screen. Pre-performing trapezoidal correction in this embodiment allows for more accurate determination of the transparent screen's border.

[0114] Reference Figure 9 , Figure 9 It is a flow chart of an embodiment of the method for entering a transparent screen provided in the embodiment of the present application.

[0115] In some embodiments of the present application, the specific implementation scenario of the projecting device updating the relative position relationship further includes steps 501-506:

[0116] 501, photographing the transparent screen on which the preset detection image is projected to obtain a calibration photographed image;

[0117] 502, establishing a homography matrix according to a plurality of corresponding coordinates of the first feature map in the detection image and the calibration captured image;

[0118] 503 , performing trapezoidal correction on the preset detection image according to the homography matrix, so as to project the detection image after the trapezoidal correction onto the transparent screen.

[0119] In this embodiment, the projection device controls the preset acquisition device to shoot the transparent screen on which the preset detection image is projected to obtain a calibrated captured image; the projection device establishes a homography matrix based on multiple corresponding coordinates of the first feature map in the detection image and the calibrated captured image; the projection device performs trapezoidal correction on the preset detection image according to the homography matrix to project the trapezoidal-corrected detection image onto the transparent screen to accurately determine the screen border of the transparent screen.

[0120] In the embodiment of the present application, the first characteristic pattern in the detection image is used as the calibration image, so that only one detection image is used, and there is no need to pre-set an additional calibration image. During trapezoidal correction and screen entry, the user sees changes in the same image, rather than switching between two images with large differences. This can improve the user experience. At the same time, the resolution of the original detection image and the detection image after trapezoidal correction are consistent, and the resolution of the original target projection image to be projected is generally consistent with the resolution of the original detection image.

[0121] 504, obtaining a first relative coordinate of the first characteristic pattern and a second relative coordinate of each of the second characteristic patterns in the detection image after trapezoidal correction;

[0122] 505, respectively calculating the coordinate ratios between the first relative coordinates and each of the second relative coordinates to obtain a coordinate ratio association between each of the second characteristic patterns and the first characteristic pattern;

[0123] 506. Update the relative position relationship based on the coordinate scale association.

[0124] Furthermore, the projection device obtains the first relative coordinates of the first characteristic pattern and the second relative coordinates of each second characteristic pattern in the detection image after trapezoidal correction; the projection device calculates the coordinate ratio between the first relative coordinate and each second relative coordinate, and obtains the coordinate ratio association between each second characteristic pattern and the first characteristic pattern; the projection device updates the relative position relationship based on the coordinate ratio association. In the embodiment of the present application, after the detection image is subjected to a trapezoidal change, its inherent original relative position relationship will change, that is, the original coordinate ratio association of each second characteristic pattern relative to the first characteristic pattern changes, so the relative position relationship needs to be updated in a targeted manner. This can make the screen border of the determined transparent screen more accurate.

[0125] like Figure 10 As shown, Figure 10 This is a schematic structural diagram of an embodiment of a transparent screen entry device provided in an embodiment of the present application.

[0126] In order to better implement the transparent screen entry method in the embodiment of the present application, based on the transparent screen entry method, the embodiment of the present application further provides a transparent screen entry device, the transparent screen entry device comprising:

[0127] A projection module 601 is configured to project a preset detection image onto a transparent screen, wherein the detection image includes a first characteristic pattern in a central area and a plurality of second characteristic patterns in a peripheral area, and the first characteristic pattern and each of the second characteristic patterns in the detection image have a determined relative positional relationship;

[0128] An acquisition module 602 is configured to acquire a captured image of the transparent screen;

[0129] a determination module 603, configured to determine, based on the relative positional relationship and the characteristic coordinates of the first characteristic pattern and the target second characteristic pattern in the captured image, the pattern coordinates of the target second characteristic pattern in the detected image, wherein the target second characteristic pattern belongs to the second characteristic pattern displayed most peripherally on the transparent screen;

[0130] The adjustment module 604 is configured to adjust the target projection image to be projected according to the pattern coordinates.

[0131] In some embodiments of the present application, the determining module 603 is further configured to:

[0132] calculating a target coordinate ratio between a first feature coordinate of the first feature pattern and a second feature coordinate of the target second feature pattern in the captured image;

[0133] The relative position relationship is queried to determine the second characteristic pattern corresponding to the target coordinate ratio in the relative position relationship, so as to obtain the pattern coordinates of the target second characteristic pattern in the detection image.

[0134] In some embodiments of the present application, the determining module 603 performs the calculation of the target coordinate ratio between the first feature coordinates of the first feature pattern in the captured image and the second feature coordinates of the target second feature pattern, including one of the following:

[0135] Obtaining a first characteristic coordinate of the first characteristic pattern and a second characteristic coordinate of the target second characteristic pattern; obtaining a target coordinate ratio based on a ratio of a horizontal coordinate difference and a vertical coordinate difference between the first characteristic coordinate and the second characteristic coordinate; or

[0136] Obtain two first feature coordinates of the first feature pattern and the second feature coordinate of the target second feature pattern; obtain the target coordinate ratio according to the ratio of the difference between the second feature coordinate and the horizontal coordinate or vertical coordinate of one first feature coordinate, and the difference between the second feature coordinate and the horizontal coordinate or vertical coordinate of another first feature coordinate.

[0137] In some embodiments of the present application, the relative position relationship is determined by:

[0138] Acquire a first relative coordinate of a first characteristic pattern in the detection image, and a second relative coordinate of each of the second characteristic patterns in the detection image;

[0139] respectively calculating the coordinate ratios between the first relative coordinates and each of the second relative coordinates;

[0140] For each of the second characteristic patterns, the pattern number of the second characteristic pattern, the pattern coordinates of the second characteristic pattern, and the coordinate ratio corresponding to the second characteristic pattern are associated to obtain a relative position relationship.

[0141] In some embodiments of the present application, the transparent screen entry device includes:

[0142] The number of the first characteristic pattern in the detection image is one, and the first characteristic pattern includes: at least one of a QR code, a barcode, and a calibration pattern;

[0143] The number of the second characteristic patterns in the detection image is at least four, and the plurality of second characteristic patterns are symmetrically distributed in the detection image and surround the first characteristic pattern. The plurality of second characteristic patterns constitute at least one of a characteristic dot matrix, an array-arranged polygonal pattern, and an interval-arranged strip pattern.

[0144] In some embodiments of the present application, the transparent screen entry device adjustment module 604 includes:

[0145] Acquiring pattern coordinates of the second characteristic pattern of the target, and determining a scaling ratio according to the pattern coordinates and size information of the target projection image to be projected;

[0146] The target projection image is adjusted according to the scaling ratio, and the adjusted target projection image is projected onto the transparent screen.

[0147] In some embodiments of the present application, the transparent screen entry device is further used to:

[0148] Projecting a preset calibration image onto a transparent screen, and photographing the transparent screen onto which the preset calibration image is projected to obtain a calibration photographed image;

[0149] Establishing a homography matrix according to the first coordinates of the calibration pattern in the preset calibration image and the second coordinates of the calibration pattern in the calibration captured image;

[0150] Performing trapezoidal correction on the preset detection image according to the homography matrix to project the detection image after trapezoidal correction onto the transparent screen

[0151] In some embodiments of the present application, the transparent screen entry device is further used to:

[0152] Shooting the transparent screen on which the preset detection image is projected to obtain a calibration shot image;

[0153] Establishing a homography matrix according to a plurality of corresponding coordinates of the first feature map in the detection image and the calibration captured image;

[0154] The preset detection image is subjected to trapezoidal correction according to the homography matrix, so as to project the detection image after the trapezoidal correction onto the transparent screen.

[0155] In some embodiments of the present application, the transparent screen entry device is further used to:

[0156] Acquire a first relative coordinate of the first characteristic pattern and a second relative coordinate of each of the second characteristic patterns in the detection image after trapezoidal correction;

[0157] Calculating coordinate ratios between the first relative coordinates and each of the second relative coordinates to obtain coordinate ratio associations between each of the second characteristic patterns and the first characteristic pattern;

[0158] Based on the coordinate scale association, the relative position relationship is updated.

[0159] The present application provides a transparent screen entry device, comprising: projecting a preset detection image onto the transparent screen, wherein the detection image includes a first characteristic pattern in a central area and multiple second characteristic patterns in a peripheral area, and a determined relative positional relationship exists between the first characteristic pattern and each of the second characteristic patterns in the detection image; acquiring a captured image of the transparent screen; determining pattern coordinates of the target second characteristic pattern in the detection image based on the relative positional relationship and characteristic coordinates of the first characteristic pattern and the target second characteristic pattern in the captured image, wherein the target second characteristic pattern belongs to the second characteristic pattern displayed most peripherally on the transparent screen; adjusting a target projection image to be projected according to the pattern coordinates; and projecting the adjusted target projection image onto the transparent screen. In an embodiment of the present application, the detection image is projected onto the transparent screen, and the pattern coordinates of the second characteristic pattern displayed most peripherally on the transparent screen are obtained according to the relative positional relationship between the first characteristic pattern and the second characteristic pattern in the detection image, thereby determining a screen border of the transparent screen. Then, the target projection image to be projected is adjusted according to the screen border to achieve automatic screen entry without the need for manual adjustment, thereby making transparent screen entry more convenient and accurate.

[0160] The embodiment of the present invention further provides a projection device, such as Figure 11 As shown, Figure 11 It is a schematic structural diagram of an embodiment of the projection device provided in the embodiments of the present application.

[0161] The projection device integrates any one of the transparent screen entry devices provided in the embodiments of the present invention, and the projection device includes:

[0162] one or more processors;

[0163] Memory; and

[0164] One or more applications, wherein the one or more applications are stored in the memory and are configured so that the processor executes the steps of the transparent screen entry method described in any of the above-mentioned transparent screen entry method embodiments.

[0165] Specifically, the projection device may include one or more processing core processors 701, one or more computer storage media memories 702, a power supply 703, an input unit 704 and other components. Those skilled in the art will understand that Figure 11 The projection device structure shown in the figure does not constitute a limitation on the projection device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0166] Processor 701 is the control center of the projection device. It connects all components of the projection device using various interfaces and circuits. By running or executing software programs and / or modules stored in memory 702 and accessing data stored in memory 702, it performs various functions of the projection device and processes data, thereby providing overall monitoring of the projection device. Optionally, processor 701 may include one or more processing cores. Preferably, processor 701 integrates an application processor and a modem processor. The application processor primarily handles the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into processor 701.

[0167] Memory 702 can be used to store software programs and modules. Processor 701 executes various functional applications and data processing by running the software programs and modules stored in memory 702. Memory 702 may primarily include a program storage area and a data storage area. The program storage area may store an operating system and at least one application required for a function (such as sound playback or image playback). The data storage area may store data generated during the use of the projection device. Memory 702 may also include high-speed random access memory (RAM) and non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state memory device. Accordingly, memory 702 may also include a memory controller to provide processor 701 with access to memory 702.

[0168] The projection device also includes a power supply 703 for supplying power to various components. Preferably, the power supply 703 can be logically connected to the processor 701 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The power supply 703 can also include one or more DC or AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and other arbitrary components.

[0169] The projection device may further include an input unit 704, which may be configured to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

[0170] Although not shown, the projection device may further include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 701 in the projection device will load the executable files corresponding to one or more application processes into the memory 702 according to the following instructions, and the processor 701 will run the application stored in the memory 702 to implement various functions as follows:

[0171] Projecting a preset detection image onto a transparent screen, wherein the detection image includes a first characteristic pattern in a central area and a plurality of second characteristic patterns in a peripheral area, and the first characteristic pattern and each of the second characteristic patterns in the detection image have a determined relative positional relationship;

[0172] Acquiring a captured image of the transparent screen;

[0173] Determining, based on the relative positional relationship and the characteristic coordinates of the first characteristic pattern and the target second characteristic pattern in the captured image, the pattern coordinates of the target second characteristic pattern in the detected image, wherein the target second characteristic pattern belongs to the second characteristic pattern displayed on the outermost periphery of the transparent screen;

[0174] The target projection image to be projected is adjusted according to the pattern coordinates.

[0175] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be accomplished by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer storage medium and loaded and executed by a processor.

[0176] To this end, an embodiment of the present invention provides a computer storage medium, which may include a read-only memory (ROM), random access memory (RAM), a disk, or an optical disk. A computer program is stored on the computer storage medium, which is loaded by a processor to execute the steps of any of the transparent screen entry methods provided in the embodiments of the present invention. For example, the computer program loaded by the processor may execute the following steps:

[0177] Projecting a preset detection image onto a transparent screen, wherein the detection image includes a first characteristic pattern in a central area and a plurality of second characteristic patterns in a peripheral area, and the first characteristic pattern and each of the second characteristic patterns in the detection image have a determined relative positional relationship;

[0178] Acquiring a captured image of the transparent screen;

[0179] Determining, based on the relative positional relationship and the characteristic coordinates of the first characteristic pattern and the target second characteristic pattern in the captured image, the pattern coordinates of the target second characteristic pattern in the detected image, wherein the target second characteristic pattern belongs to the second characteristic pattern displayed on the outermost periphery of the transparent screen;

[0180] The target projection image to be projected is adjusted according to the pattern coordinates.

[0181] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, please refer to the detailed description of other embodiments above and will not be repeated here.

[0182] In specific implementation, the above units or structures can be implemented as independent entities, or can be arbitrarily combined to implement as the same or several entities. The specific implementation of the above units or structures can refer to the previous method embodiments and will not be repeated here.

[0183] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.

[0184] The above is a detailed introduction to the transparent screen entry method, projection equipment, computer storage medium, and computer storage medium provided by the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for those skilled in the art, based on the ideas of the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting the present application.

Claims

1. A method for inserting a transparent screen, characterized in that: The method comprises: Projecting a preset detection image onto a transparent screen, wherein the detection image includes a first characteristic pattern in a central area and a plurality of second characteristic patterns in a peripheral area, and the first characteristic pattern and each of the second characteristic patterns in the detection image have a determined relative positional relationship; Acquiring a captured image of the transparent screen; Determining, based on the relative positional relationship and the characteristic coordinates of the first characteristic pattern and the target second characteristic pattern in the captured image, the pattern coordinates of the target second characteristic pattern in the detected image, wherein the target second characteristic pattern belongs to the second characteristic pattern displayed on the outermost periphery of the transparent screen; Adjusting the target projection image to be projected according to the pattern coordinates; The determining, based on the feature coordinates of the first feature pattern and the target second feature pattern in the captured image and the relative positional relationship, the pattern coordinates of the target second feature pattern in the detected image includes: calculating a target coordinate ratio between a first feature coordinate of the first feature pattern and a second feature coordinate of the target second feature pattern in the captured image; The relative position relationship is queried to determine the second characteristic pattern corresponding to the target coordinate ratio in the relative position relationship, so as to obtain the pattern coordinates of the target second characteristic pattern in the detection image.

2. The method for inserting a transparent screen according to claim 1, wherein: The step of calculating the target coordinate ratio between the first feature coordinates of the first feature pattern in the captured image and the second feature coordinates of the target second feature pattern includes one of the following: Acquire a first characteristic coordinate of the first characteristic pattern and a second characteristic coordinate of the target second characteristic pattern; Obtaining a target coordinate ratio according to a ratio of a horizontal coordinate difference to a vertical coordinate difference between the first characteristic coordinate and the second characteristic coordinate; or Acquire the two first characteristic coordinates of the first characteristic pattern and the second characteristic coordinates of the target second characteristic pattern; The target coordinate ratio is obtained according to the ratio of the difference between the second characteristic coordinate and the abscissa or ordinate of one first characteristic coordinate, and the difference between the second characteristic coordinate and the abscissa or ordinate of another first characteristic coordinate.

3. The method for inserting a transparent screen according to claim 1, wherein: The number of the first characteristic pattern in the detection image is one, and the first characteristic pattern includes: at least one of a QR code, a barcode, and a calibration pattern; The number of the second characteristic patterns in the detection image is at least four, and the plurality of second characteristic patterns are symmetrically distributed in the detection image and surround the first characteristic pattern. The plurality of second characteristic patterns constitute at least one of a characteristic dot matrix, an array-arranged polygonal pattern, and an interval-arranged strip pattern.

4. The method for inserting a transparent screen according to claim 1, wherein: The target second characteristic pattern is determined by the following method: In the captured image, four second characteristic patterns with the smallest x coordinate and the smallest y coordinate, the smallest x coordinate and the largest y coordinate, the largest x coordinate and the smallest y coordinate, and the largest x coordinate and the largest y coordinate are determined as the second characteristic patterns displayed on the outermost periphery of the transparent screen.

5. The method for inserting a transparent screen according to claim 1, characterized in that: Before projecting the preset detection image onto the transparent screen, the method includes: Projecting a preset calibration image onto a transparent screen, and photographing the transparent screen onto which the preset calibration image is projected to obtain a calibration photographed image; Establishing a homography matrix according to the first coordinates of the calibration pattern in the preset calibration image and the second coordinates of the calibration pattern in the calibration captured image; performing trapezoidal correction on the preset detection image according to the homography matrix, so as to project the detection image after the trapezoidal correction onto the transparent screen; Alternatively, before the step of acquiring the photographed image of the transparent screen, the method further includes: Shooting the transparent screen on which the preset detection image is projected to obtain a calibration shot image; Establishing a homography matrix according to a plurality of corresponding coordinates of the first characteristic pattern in the detection image and the calibration captured image; The preset detection image is subjected to trapezoidal correction according to the homography matrix, so as to project the detection image after the trapezoidal correction onto the transparent screen.

6. The method for inserting a transparent screen according to claim 5, characterized in that: After the step of performing trapezoidal correction on the preset detection image according to the homography matrix, the method further includes: Acquire a first relative coordinate of the first characteristic pattern and a second relative coordinate of each of the second characteristic patterns in the detection image after trapezoidal correction; Calculating coordinate ratios between the first relative coordinates and each of the second relative coordinates to obtain coordinate ratio associations between each of the second characteristic patterns and the first characteristic pattern; Based on the coordinate scale association, the relative position relationship is updated.

7. A method for inserting a transparent screen, characterized in that: The method comprises: Projecting a preset detection image onto a transparent screen, wherein the detection image includes a first characteristic pattern in a central area and a plurality of second characteristic patterns in a peripheral area, and the first characteristic pattern and each of the second characteristic patterns in the detection image have a determined relative positional relationship; Acquiring a captured image of the transparent screen; Determining, based on the relative positional relationship and the characteristic coordinates of the first characteristic pattern and the target second characteristic pattern in the captured image, the pattern coordinates of the target second characteristic pattern in the detected image, wherein the target second characteristic pattern belongs to the second characteristic pattern displayed on the outermost periphery of the transparent screen; Adjusting the target projection image to be projected according to the pattern coordinates; The relative position relationship is determined by the following method: Acquire a first relative coordinate of a first characteristic pattern in the detection image, and a second relative coordinate of each of the second characteristic patterns in the detection image; respectively calculating the coordinate ratios between the first relative coordinates and each of the second relative coordinates; For each second characteristic pattern, the pattern number of the second characteristic pattern, the pattern coordinates of the second characteristic pattern, and the coordinate ratio corresponding to the second characteristic pattern are associated to obtain a relative position relationship.

8. A projection device, characterized in that: The projection device comprises: one or more processors; Memory; and One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the steps in the transparent screen entry method according to any one of claims 1 to 7.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the steps in the method for inserting a transparent screen according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Intelligent shooting projection system with frame self-adaptive function and projection method thereof

    CN101697056A

  • Projection method and device, projection equipment and computer storage medium

    CN114827562A