A projection device and a projection method

Abstract

The application provides a projection device and a projection method. The method comprises: obtaining vertex coordinates of a projection area of the projection device, obtaining a light engine image in a light emitting assembly and light engine image coordinates corresponding to the light engine image; calculating a homography matrix of target image coordinates and the light engine image coordinates according to the vertex coordinates and the light engine image coordinates; obtaining corner point coordinates of a corner point of a projection medium covered by the projection area; calculating target light engine image coordinates corresponding to the corner point of the projection medium in the light emitting assembly according to the homography matrix and the corner point coordinates; and controlling the light emitting assembly to project and play content to the projection medium according to the target light engine image coordinates. The method can quickly and accurately identify the corner point of the blocked part in combination with the white border function, is suitable for not only conventional projection media but also unconventional projection media, can improve the adaptability to different projection media, improve the success rate of entering a scene under a complex scene, and solve the problems of automatic entering a scene failure or inaccurate entering a scene of the projection device.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of projection equipment, and particularly relates to a projection equipment and a projection method. BACKGROUND

[0002] The projection equipment is a display equipment which can project images or videos onto a screen. The projection equipment can project laser light of a specific color onto the screen to form specific images through refraction of an optical assembly. During the projection process, a certain distance needs to be kept between the projection equipment and the screen, so that the images formed on the screen can conform to the focal length range of the optical assembly, to obtain clear images.

[0003] During the projection process, considering that the process of adjusting the projection equipment by the user is relatively cumbersome, the projection equipment can have an automatic curtain entering function. The automatic curtain entering function refers to that the projection equipment can automatically determine a projection area in a projection medium, and project the image to be projected into the projection area, thereby avoiding manual adjustment of the angle and position of the projection equipment by the user, to improve the use experience of the user. The projection equipment can be provided with an automatic curtain entering mode, and the user can send an automatic curtain entering instruction to the projection equipment, so that the projection equipment enters the automatic curtain entering mode, thereby enabling the projection equipment to start the automatic curtain entering function.

[0004] Taking a curtain as an example, the curtain can have various specifications and types. For different curtains, the projection equipment needs to be adjusted accordingly before projection, to ensure that the content to be projected can be accurately projected onto the curtain. However, for some regular curtains such as four-side curtains, the projection equipment can easily determine the area where the curtain is located, to project the content to be projected onto the curtain. For some irregular curtains such as double-side curtains, the projection equipment can not quickly and accurately determine the position of the curtain, thereby affecting the projection accuracy of the projection equipment, and causing problems such as automatic curtain entering failure or inaccurate curtain entering of the projection equipment. SUMMARY

[0005] Some embodiments of the present application provide a projection equipment and a projection method, to solve the problems of slow automatic curtain entering speed, automatic curtain entering failure or inaccurate automatic curtain entering of the projection equipment.

[0006] In a first aspect, some embodiments of the present application provide a projection equipment, comprising:

[0007] An outlight assembly configured to project and play content to a projection medium;

[0008] An image acquisition device configured to capture an image of the projection content;

[0009] A controller configured to:

[0010] obtaining vertex coordinates of a projection area of a projection device, and obtaining a light engine image in a light emitting assembly and light engine image coordinates corresponding to the light engine image;

[0011] calculating a homography matrix of target image coordinates and the light engine image coordinates according to the vertex coordinates and the light engine image coordinates; the target image is a projection content image captured after adding a white border to the projection area;

[0012] obtaining corner point coordinates of a projection medium corner point covered by the projection area;

[0013] calculating target light engine image coordinates corresponding to the projection medium corner point in the light emitting assembly according to the homography matrix and the corner point coordinates;

[0014] controlling the light emitting assembly to project a play content to the projection medium according to the target light engine image coordinates.

[0015] In a second aspect, some embodiments of the present application provide a projection method, which can be applied to the projection device of the first aspect, the projection device comprising a light emitting assembly, an image acquisition device and a controller, and the projection method comprising:

[0016] obtaining vertex coordinates of a projection area of a projection device, and obtaining a light engine image in a light emitting assembly and light engine image coordinates corresponding to the light engine image;

[0017] calculating a homography matrix of target image coordinates and the light engine image coordinates according to the vertex coordinates and the light engine image coordinates; the target image is a projection content image captured after adding a white border to the projection area;

[0018] obtaining corner point coordinates of a projection medium corner point covered by the projection area;

[0019] calculating target light engine image coordinates corresponding to the projection medium corner point in the light emitting assembly according to the homography matrix and the corner point coordinates;

[0020] controlling the light emitting assembly to project a play content to the projection medium according to the target light engine image coordinates.

[0021] According to the technical solutions, some embodiments of the present application provide a projection device and a projection method. The method comprises: obtaining vertex coordinates of a projection area of the projection device, and obtaining a light engine image in a light emitting assembly and light engine image coordinates corresponding to the light engine image; calculating a homography matrix of target image coordinates and the light engine image coordinates according to the vertex coordinates and the light engine image coordinates; obtaining corner point coordinates of corner points of a projection medium covered by the projection area; calculating target light engine image coordinates of the corner points of the projection medium in the light emitting assembly according to the homography matrix and the corner point coordinates; and finally controlling the light emitting assembly to project and play content to the projection medium according to the target light engine image coordinates. The method can quickly and accurately identify the corner points of the blocked part in combination with the white border function to perform the curtain-in function. The method is not only suitable for conventional projection media, but also suitable for unconventional projection media, and therefore can improve the curtain-in speed, improve the curtain-in speed, improve the adaptability to different projection media, improve the success rate of curtain-in in a complex scene, and solve the problems of slow automatic curtain-in speed, curtain-in failure or inaccurate curtain-in of the projection device. BRIEF DESCRIPTION OF DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed in the embodiments will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0023] Figure 1 A projection device projection placement state schematic diagram is provided for some embodiments of the present application.

[0024] Figure 2 A projection device light path schematic diagram is provided for some embodiments of the present application.

[0025] Figure 3 A projection device circuit architecture schematic diagram is provided for some embodiments of the present application.

[0026] Figure 4 A projection device structure schematic diagram is provided for some embodiments of the present application.

[0027] Figure 5 A projection device lens structure schematic diagram is provided for some embodiments of the present application.

[0028] Figure 6 A projection device distance sensor and image acquisition device structure schematic diagram is provided for some embodiments of the present application.

[0029] Figure 7 A projection device system framework schematic diagram for realizing display control is provided for some embodiments of the present application.

[0030] Figure 8 A schematic diagram of a four-sided curtain provided for some embodiments of the present application;

[0031] Figure 9 A schematic diagram of a two-sided curtain provided for some embodiments of the present application;

[0032] Figure 10 A flowchart of a projection method performed by a projection device provided for some embodiments of the present application;

[0033] Figure 11 A timing diagram of a curtain entry performed by a projection device provided for some embodiments of the present application;

[0034] Figure 12 A scene diagram of a four-sided curtain projection area vertex and curtain corner point provided for some embodiments of the present application;

[0035] Figure 13 A scene diagram of a two-sided curtain projection area vertex and curtain corner point provided for some embodiments of the present application;

[0036] Figure 14 A flowchart of a projection device detecting a projection medium area corner point coordinate and a projection area vertex coordinate provided for some embodiments of the present application. DETAILED DESCRIPTION

[0037] In order to make the purpose and implementation of the present application more clear, the following will combine the drawings in the exemplary embodiments of the present application to clearly and completely describe the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only some of the embodiments of the present application, but not all of the embodiments.

[0038] It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the following described embodiments, and is not intended to limit the embodiments of the present application. Unless otherwise specified, these terms should be understood according to their ordinary and general meanings.

[0039] The terms "first", "second", "third", etc. in the specification and claims of the present application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit the specific order or sequence, unless otherwise specified. It should be understood that the terms used in this way can be interchanged under appropriate circumstances.

[0040] The terms "include" and "have" and any variations thereof are intended to cover but not exclusive inclusion, for example, a product or device including a series of components does not necessarily limit to all components clearly listed, but can include other components not clearly listed or inherent to these products or devices.

[0041] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software codes that can perform the function related to the element.

[0042] The embodiments of the present application can be applied to various types of projection devices. Hereinafter, the projection device and the automatic focusing method will be described by taking the projection device as an example.

[0043] The projection device is a device that can project an image or a video onto a screen. The projection device can be connected to a computer, a broadcast network, the Internet, a VCD (Video Compact Disc), a DVD (Digital Versatile Disc Recordable), a game machine, a DV, etc. through different interfaces to play corresponding video signals. The projection device is widely used in families, offices, schools, and entertainment places, etc.

[0044] Figure 1 The projection device provided by some embodiments of the present application is shown in the following projection placement state diagram, Figure 2 The optical path diagram of the projection device provided by some embodiments of the present application is shown in the following figure.

[0045] In some embodiments, referring to Figures 1-2 The projection device provided by the present application includes a projection screen 1 and a projection device 2. The projection screen 1 is fixed at a first position, and the projection device 2 is placed at a second position so that the projected picture coincides with the projection screen 1. The projection device includes a light source 100, a light output assembly 200, a lens 300, and a projection surface 400. The light source 100 provides illumination for the light output assembly 200. The light output assembly 200 modulates the light beam of the light source and outputs it to the lens 300 for imaging, and projects it to the projection surface 400 to form a projection picture.

[0046] In some embodiments, the light source 100 of the projection device 2 includes a light output component 110 and an optical lens component 120. The light beam emitted by the light output component 110 can pass through the optical lens component 120 to provide illumination for the light output assembly 200.

[0047] It should be noted that in the embodiments of the present application, the light source 100 can be a laser light source, an LED light source, or a Liquid Crystal Display (LCD) light source, which is not limited in the present application. For example, taking the light source 100 as a laser light source as an example, when the light source 100 is a laser light source, in some embodiments, the light output assembly 200 of the projection device 2 can be implemented to include a blue light output assembly, a green light output assembly, and a red light output assembly, and can further include a heat dissipation system, a circuit control system, etc. Figure 3A circuit architecture schematic diagram of a projection device is provided for some embodiments of the present application. In some embodiments, the projection device 2 can include a display control circuit 10, a light source 100, at least one light driving component 30, and at least one brightness sensor 40. When the light source 100 is a laser light source, the light source 100 can include at least one laser corresponding to the at least one light driving component 30.

[0048] Based on the circuit architecture, the projection device 2 can achieve adaptive adjustment. For example, by arranging the brightness sensor 40 in the light output path of the light source 100, the brightness sensor 40 can detect the first brightness value of the laser light source and send the first brightness value to the display control circuit 10.

[0049] The display control circuit 10 can obtain the second brightness value corresponding to the driving current of each laser, and determine that the COD fault occurs in the laser when the difference between the second brightness value of the laser and the first brightness value of the laser is greater than a difference threshold. The display control circuit can adjust the current control signal of the corresponding laser driving component of the laser until the difference is less than or equal to the difference threshold, thereby eliminating the COD fault of the blue laser. The projection device 2 can timely eliminate the COD fault of the laser, reduce the damage rate of the laser, and improve the image display effect of the projection device 2.

[0050] Figure 4 A projection device structure schematic diagram is provided for some embodiments of the present application.

[0051] In some embodiments, still taking the light source 100 as a laser light source as an example, the light source 100 in the projection device 2 can include independently arranged blue lasers 101, red lasers 102, and green lasers 103. When the light source 100 is a laser light source, the projection device 2 can also be referred to as a three-color projection device. The blue lasers 101, the red lasers 102, and the green lasers 103 are all module lightweight (Mirai Console Loader, MCL) packaged lasers, which have small volumes and are beneficial to compact arrangement of the optical path. It can be understood that the above is only exemplarily described by taking the light source 100 as a laser light source as an example, and the light source 100 is not limited to a laser light source, but can also be an LED light source, an LCD light source, and other forms of light sources.

[0052] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a RAM (random access memory), a ROM (read-only memory), a first interface to an n-th interface for input / output, a communication bus, and the like.

[0053] In some embodiments, the projection device 2 can directly enter the display interface of the last selected signal source after starting, or a signal source selection interface, where the signal source can be at least one of a preset video on demand program, an HDMI interface, a live television interface, and the like. After the user selects a different signal source, the projector can display the content obtained from the different signal source.

[0054] In some embodiments, the projection device 2 can be configured with an image acquisition device 700 such as a camera for cooperative operation with the projection device 2 to achieve adjustment and control of the projection process. For example, the camera configured by the projection device 2 can be embodied as a 3D camera or a binocular camera. When the camera is embodied as a binocular camera, it specifically includes a left camera and a right camera. The binocular camera can obtain the image and the playing content presented by the projection medium corresponding to the projection device 2, i.e., the projection surface 400, which is projected by the light emitting assembly 200 built in the projection device 2.

[0055] The image acquisition device can be used to capture the image displayed in the projection surface 400, which can be a camera. The camera can include a lens assembly, and the lens assembly is provided with a photosensitive element and a lens. The lens refracts the light of the image of the scene through a plurality of lenses, so that the light of the image of the scene can be irradiated on the photosensitive element.

[0056] Figure 5 The lens structure of the projection device provided for some embodiments of the present application is shown in the schematic view. In order to support the automatic focusing process of the projection device 2, as shown in Figure 5 The lens 300 of the projection device 2 can further include an optical assembly 310 and a driving motor 320. The optical assembly 310 is a lens group composed of one or more lenses, which can refract the light emitted by the light emitting assembly 200, so that the light emitted by the light emitting assembly 200 can be transmitted to the projection surface 400 to form a transmitted content image.

[0057] The optical assembly 310 can include a lens barrel and a plurality of lenses arranged in the lens barrel. According to whether the positions of the lenses can be moved, the lenses in the optical assembly 310 can be divided into movable lenses 311 and fixed lenses 312. By changing the positions of the movable lenses 311, the distance between the movable lenses 311 and the fixed lenses 312 is adjusted, and the overall focal length of the optical assembly 310 is changed. Therefore, the driving motor 320 can drive the movable lenses 311 to move in position by connecting the movable lenses 311 in the optical assembly 310, so as to realize the automatic focusing function.

[0058] It should be noted that the focusing process described in some embodiments of the present application refers to changing the position of the movable lenses 311 by the driving motor 320, so as to adjust the distance between the movable lenses 311 and the fixed lenses 312, that is, to adjust the image plane position. Therefore, the imaging principle of the lens combination in the optical assembly 310 is that the focal length adjustment is actually the image distance adjustment, but in terms of the overall structure of the optical assembly 310, adjusting the position of the movable lenses 311 is equivalent to adjusting the overall focal length of the optical assembly 310.

[0059] When the projection device 2 is at different distances from the projection surface 400, the lens of the projection device 2 needs to adjust different focal lengths to transmit clear images on the projection surface 400. During the projection process, the interval distance between the projection device 2 and the projection surface 400 needs to be different due to different user placement positions, and different focal lengths are required. Therefore, in order to adapt to different use scenarios, the projection device 2 needs to adjust the focal length of the optical assembly 310.

[0060] Figure 6 The distance sensor and the image acquisition device structure schematic diagram of the projection device provided by some embodiments of the present application are shown in FIG. 6. Figure 6 As shown in FIG. 6, the projection device 2 can also be built-in or externally connected with the image acquisition device 700. The image acquisition device 700 can capture images of the projection content image projected by the projection device 2. The distance sensor 600 is configured to detect the interval distance between the projection surface 400 and the light-emitting assembly 200. The projection device 2 determines whether the current lens focal length is appropriate by detecting the clarity of the projection content image, and adjusts the focal length when it is inappropriate. When the automatic focusing is based on the projection content image captured by the image acquisition device 700, the projection device 2 can continuously adjust the lens position and take pictures, and find the focusing position by comparing the clarity of the front and rear position pictures, so as to adjust the movable lenses 311 in the optical assembly to the appropriate position.

[0061] Figure 7 The system framework schematic diagram for realizing display control of the projection device provided by some embodiments of the present application is shown in FIG. 7.

[0062] In some embodiments, the projection device 2 has the characteristics of long-focus micro projection, and the controller thereof can control the display of the projected light image through a preset algorithm to realize functions such as automatic trapezoidal correction, automatic entry into the screen, automatic obstacle avoidance, automatic focusing, and anti-eye shooting.

[0063] In some embodiments, the projection device 2 is configured with a gyroscope sensor; during movement, the gyroscope sensor can sense the position movement and actively collect movement data; then the collected data is sent to the application service layer through the system framework layer, to support the application data required in the user interface interaction and application interaction process, and the collected data can also be used for data calling of the controller in the algorithm service implementation.

[0064] In some embodiments, the projection device 2 is configured with a time-of-flight sensor, and after the time-of-flight sensor collects corresponding data, the data is sent to the corresponding time-of-flight service in the service layer; after the time-of-flight service obtains the data, the collected data is sent to the application service layer through the process communication framework, and the data is used for data calling of the controller, user interface, program application, and the like.

[0065] In some embodiments, the image collection device 700 configured in the projection device 2 can be a binocular camera, a depth camera, or a 3D camera, etc.; the image collection device 700 collects data and sends it to the camera service, and then the camera service sends the collected image data to the process communication framework and / or the projection device correction service; the projection device correction service can receive the camera collection data sent by the camera service, and the controller can call the corresponding control algorithm in the algorithm library for different functions to be implemented.

[0066] In some embodiments, data interaction is performed between the process communication framework and the application service, and then the calculation result is fed back to the correction service through the process communication framework; the correction service sends the obtained calculation result to the operating system of the projection device 2 to generate control signaling, and sends the control signaling to the control drive of the light emitting assembly 200 to control the working condition of the light emitting assembly 200 and realize automatic correction of the display image.

[0067] In some embodiments, when an image correction instruction is detected, the projection device 2 can correct the projected image. For the correction of the projected image, a correlation between the distance, the horizontal included angle, and the offset angle can be created in advance. Then the controller in the projection device 2 determines the included angle between the light emitting assembly 200 and the projection surface 400 at this moment by obtaining the current distance from the light emitting assembly 200 to the projection surface 400, in combination with the correlation, to realize the correction of the projected image. The included angle is specifically the included angle between the axis in the light emitting assembly 200 and the projection surface 400.

[0068] In some embodiments, the projection device 2 automatically completes the correction and refocuses, the controller will detect whether the automatic focusing function is turned on; when the automatic focusing function is not turned on, the controller will end the automatic focusing service; when the automatic focusing function is turned on, the projection device 2 will obtain the detection distance of the time-of-flight sensor through the middleware to calculate.

[0069] The controller queries the preset mapping table according to the obtained distance to obtain the focal length of the projection device 2; then the middleware sets the focal length to the light emitting assembly 200 of the projection device 2; wherein the middleware is a series of application programs related to the focusing control process. After the light emitting assembly 200 emits laser light at the above-mentioned focal length, the camera will execute the photographing instruction; the controller determines whether the focusing process of the projection device 2 is completed according to the obtained photographed image and the evaluation function.

[0070] If the determination result meets the preset completion condition, the automatic focusing process is ended; if the determination result does not meet the preset completion condition, the middleware fine tunes the focal length parameter of the light emitting assembly 200 of the projection device 2, for example, the focal length can be gradually fine tuned by a preset step, and the adjusted focal length parameter is set to the light emitting assembly 200 again; thereby realizing repeated photographing and clarity evaluation steps, and finally finding the optimal focal length through clarity comparison to complete the automatic focusing.

[0071] In some embodiments, when the user turns on the projection device 2, the projection device 2 can project the content previously set by the user into the projection surface 400, which can be a wall surface or other projection medium such as a curtain. The projection surface 400 can display a projection image for the user to view.

[0072] In some embodiments, taking a curtain as an example, the curtain can have various specifications and types. For different curtains, the projection device 2 needs to make corresponding adjustments before projection to ensure that the to-be-projected content can be accurately projected to the curtain. Figure 8 A schematic diagram of a four-sided curtain provided by some embodiments of the present application is shown in FIG. 21. Figure 8 As shown in FIG. 21, the curtain 21 can include a projection area 211 and an edge line 212. The projection area 211 is used to display the to-be-projected projection content, such as images, videos, etc. The curtain 21 can set different edge lines 212 according to actual needs. Figure 8 In some embodiments, the curtain 21 has a dark edge line 212 at the edge position of each side, for example, the four edge lines 212 of the curtain 21 can all be black. The dark edge line 212 can have a certain width, so the edge line 212 can also be referred to as an edge band. For Figure 8A screen 21 with four edge bands can be referred to as a four-sided screen. Because the edges of a four-sided screen have relatively distinct edge lines 212, the projection device 2 can utilize this characteristic to stably, efficiently, and accurately identify the four-sided screen in the environment, thereby enabling the projection device 2 to quickly enter the screen. It is understood that even if the projection device 2 moves, it can quickly locate the position of the four-sided screen, thus achieving rapid screen entry. It should be noted that this application only uses a screen as an example of a projection medium and is not limited to a screen; other projection media can also be used, and this application does not specifically limit them.

[0073] In addition to four-sided screens, there are other types of screens 21. Figure 9 A schematic diagram of a double-sided screen provided for some embodiments of this application, such as... Figure 9 As shown, two edges of the double-sided curtain have dark edge lines 212, while the other two edges do not. For example, in Figure 9 In the double-sided screen, the top and bottom edges may each have a black edge line 212 of a certain width, while the left and right edges do not have a dark edge line 212. Therefore, the four edges of the double-sided screen cannot form a closed quadrilateral, for example, a rectangle. As a result, the projection device 2 may not be able to accurately identify the position of the double-sided screen when projecting, or the projection device 2 may identify the double-sided screen as an obstacle, thus failing to accurately project the content to be projected onto the screen 21.

[0074] It should be noted that the double-sided screen can also have any two edges with dark edge lines, while the other two edges do not have dark edge lines. This application does not limit this. For example, the left and right edges of the double-sided screen have black edge lines 212 of a certain width, while the top and bottom edges do not have edge lines. In this scenario, the top and bottom edges of the double-sided screen cannot be accurately identified.

[0075] In other words, for some conventional screens, such as four-sided screens, the projection device 2 can easily determine the area where the screen is located in order to project the content to be projected onto the screen. However, for some unconventional screens, such as two-sided screens, the projection device 2 may not be able to quickly and accurately determine the position of the screen, thus affecting the accuracy of the projection and causing problems such as the projection device 2 failing to automatically enter the screen or entering the screen inaccurately.

[0076] For example, if one side of the four-sided curtain is blocked or a plant is placed in one corner of the curtain, the curtain cannot be positioned by the image gray value and closed contour method due to the blockage, so it is considered that there is no curtain, resulting in a failure to enter the curtain, but in fact, there is a curtain, and the failure to enter the curtain is caused only because of the blockage.

[0077] To solve the problem of automatic curtain entering failure or inaccurate curtain entering of the projection device 2, some embodiments of the present application provide a projection device 2, which can include a light output assembly 200, an image acquisition device 700, and a controller 500. The light output assembly 200 is configured to project and play content to a projection medium, the image acquisition device 700 is configured to capture an image of the projection content, and the controller 500 is configured to execute a projection method. The projection device 2 provided in the embodiments of the present application can quickly and accurately identify the corner points of the blocked part in combination with the white border function to execute the curtain entering function. Not only is the curtain entering speed fast, but it is also suitable for conventional projection media and unconventional projection media, so that the curtain entering speed can be improved, the adaptability to different projection media can be improved, the success rate of curtain entering in a complex scene can be improved, and the problems of slow automatic curtain entering speed, curtain entering failure, or inaccurate curtain entering of the projection device can be solved.

[0078] To facilitate the understanding of the technical solutions in some embodiments of the present application, the following describes each step in detail in combination with some specific embodiments and the accompanying drawings. Figure 10 The flowchart of the projection method executed by the projection device provided in some embodiments of the present application is shown in FIG. 2. Figure 10 As shown in FIG. 2, the projection device 2 can include the following steps S1-S5 when executing the projection method, and the specific content is as follows.

[0079] Step S1: Obtain the vertex coordinates of the projection area of the projection device 2, and obtain the light engine image in the light output assembly 200 and the light engine image coordinates corresponding to the light engine image.

[0080] To realize the in-screen function of the projection device 2, in some embodiments, the projection device 2 can be provided with a plurality of functional modules. For example, an in-screen calling module can be provided, in which a switch for controlling the in-screen can be configured, and the in-screen function can be triggered only after the in-screen switch is called. The projection device 2 can also be provided with an in-screen module, in which a logic control thread and a corresponding algorithm related to the in-screen function can be arranged. The projection device 2 can also be provided with an optical engine image coordinate detection module, which can be the output of the in-screen module, for calculating and outputting the optical engine image coordinates corresponding to the optical engine image. A projection medium detection module can also be provided, which can be used to detect whether there is a projection medium in the projection content image captured by the image acquisition device 700 in the projection environment, so as to set different subsequent processes according to different existence states thereof. It should be noted that the above functional modules are only exemplary, and other modules can also be provided in the projection device 2, which are not limited in the present application.

[0081] Figure 11 The timing diagram for the projection device provided by some embodiments of the present application to perform in-screen is shown in FIG. 8, in which Figure 11 after the image acquisition device 700 captures the projection content image, the projection device 2 can acquire the projection content image and detect the medium existence state of the projection medium according to the projection content image, wherein the medium existence state can include a medium existing state and a medium non-existing state. Then the following judgment can be made, in response to the medium existence state being the medium existing state, the projection device 2 can control the light emitting assembly 200 to project and play the content to the projection medium according to the target optical engine image coordinates, and the specific projection method will be described in detail later. In response to the medium existence state being the medium non-existing state, the projection device 2 can generate a correction instruction and correct the position of the projection device 2 according to the correction instruction.

[0082] For example, after the projection device 2 calls the camera in the image acquisition device 700 to take a picture, it can analyze whether there is a projection medium in the picture area according to the projection content image captured thereby. Taking a screen as an example, the projection device 2 can analyze whether there is a screen in the projection content image. If the medium existence state is the medium non-existing state, for example, there is no screen in the picture area, the projection device 2 can perform other processes other than in-screen, for example, a correction instruction can be generated, and the position of the projection device 2 can be corrected according to the correction instruction. If the medium existence state is the medium existing state, the projection device 2 can perform the in-screen process.

[0083] To accurately identify the projection area, in some embodiments, the projection device 2 can identify the projection medium in the projection area, and if there is a projection medium in the projection area, a white border can be added to the projection area, and the image acquisition device 700 can be controlled to capture a target image containing the white border.

[0084] For example, see [link to example]. Figure 11 Once the analysis confirms the presence of a screen in the projected image, it can be verified that a projection medium exists in the projection area. In this scenario, projection device 2 can add a white border to the projection area. Figure 12 This is a scene diagram showing the vertices of the quadrilateral projection area and the corner points of the screen, provided in some embodiments of this application. Figure 13 This is a scene diagram showing the vertices of the double-sided screen projection area and the corner points of the screen, provided in some embodiments of this application. Figure 12 and Figure 13 As shown, after triggering the projection function, if it is determined that a projection medium such as a screen exists, a projection area can be added as follows: Figure 12 , Figure 13 The white border shown in the figure has four vertices with coordinates W1, W2, W3, and W4, and four corner points of the screen with coordinates C1, C2, C3, and C4. In other words, in this embodiment, the projection device 2 adds a white border to the four sides of the largest projection area. This allows the projection device 2 to clearly identify the projection area, even for double-sided screens that are difficult to identify. Thus, adding a white border improves the adaptability of the projection device 2 to complex scenes.

[0085] After adding a white border to the projection area, the projection device 2 can calculate the vertex coordinates of the projection area. For example, the vertex coordinates of the projection area can be obtained through a corner detection network. At the same time, the projection device 2 can acquire the optical engine image in the optical component 200 and calculate the corresponding optical engine image coordinates, providing data for subsequent calculations. After step S1 is completed, step S2 can be executed.

[0086] Step S2: Projection device 2 calculates the homography matrix of the target image coordinates and the optical-mechanical image coordinates based on the vertex coordinates and the optical-mechanical image coordinates.

[0087] After obtaining the vertex coordinates of the projection area and the corresponding optomechanical image coordinates in step S1, the projection device 2 can calculate the homography matrix between the target image coordinates and the optomechanical image coordinates based on the vertex coordinates and the optomechanical image coordinates. The target image is the image of the projected content captured after adding a white border to the projection area.

[0088] For example, when calculating the homography matrix between the target image coordinates and the optomechanical image coordinates, the correspondence between the target image coordinates and the optomechanical image coordinates can be calculated based on the coordinates of the four vertices of the white border and the coordinates of the four vertices of the optomechanical image. After step S2 is completed, step S3 can be executed.

[0089] Step S3: Projection device 2 obtains the corner coordinates of the corner points of the projection medium covered by the projection area.

[0090] To calculate the vertex coordinates of the projection area and the corner point coordinates of the projection medium area, in some embodiments, continuing to refer to Figure 11 Before calculating the homography matrix of the target image coordinates and the light machine image coordinates, the projection device 2 can also perform the function of corner point detection. First, the projection device 2 can obtain the target image taken after adding a white frame to the projection area, then can parse the target image to identify the projection area and the projection medium area in the target image, and finally output the vertex coordinates of the projection area and the corner point coordinates of the projection medium area based on an artificial intelligence algorithm.

[0091] For example, after obtaining the target image, the key point detection technology in computer vision can be used to detect the coordinates of the four vertices of the projection area and the coordinates of the four corner points of the projection medium such as the curtain covered by the projection area. When the projection medium is a curtain, it can include a four-sided curtain and a two-sided curtain. According to the coordinates of the four vertices of the projection area and the coordinates of the four vertices of the known light machine image, taking a 2K light machine as an example, the four vertex coordinates of the light machine image can be (0, 0), (0, 1919), (1079, 0), and (1919, 1079), respectively. Homography calculation is performed on the vertex coordinates of the projection area to obtain the corresponding relationship between the target image coordinates and the light machine image coordinates. Then, the coordinates of the corner points of the projection medium, such as the corner point coordinates of the curtain, are calculated through homography calculation to obtain the coordinates of the four corner points of the curtain in the light machine image. The specific calculation method will be introduced later.

[0092] That is, in the embodiments of the present application, the corner point detection method in computer vision can be used to detect the coordinates of the four vertices of the projection area and the corner point coordinates of the four-sided curtain or the two-sided curtain. For example, the corner point coordinates of the corner points of the projection medium covered by the projection area can also be obtained through the corner point detection network, and the image coordinates of the four corner points of the projection medium such as the curtain in the light machine can be calculated through the homography matrix of the light machine image coordinates and the target image, thereby realizing the function of entering the curtain. It should be noted that in the embodiments of the present application, the corner point detection function is performed by using an artificial intelligence algorithm such as an AI neural network, which can quickly identify the corner point coordinates of the corner points of the projection medium, thereby improving the speed of entering the curtain. According to experimental data detection, the corner point detection using the AI neural network has an entering curtain time of less than 1 second, thereby realizing the function of entering the curtain without feeling.

[0093] In some embodiments, the projection device 2 can also perform the following functions. The projection device 2 can detect the shooting state of the target image, where the shooting state can include a shooting completion state and a shooting incomplete state. In response to the shooting state being the shooting completion state, the projection device 2 can delete the white border. In response to the shooting state being the shooting incomplete state, the projection device 2 can retain the white border. That is, in the process of entering the screen, only a short white border needs to be displayed for the four sides of the projection area when taking a photo. After the photo is taken, the white border is deleted, and the original projection picture is restored to achieve a seamless entry into the screen.

[0094] In order to improve the accuracy of the projection of the projection device 2 and ensure that the projection content can be projected onto the projection medium, in some embodiments, continuing to refer to Figure 11 , after calculating the vertex coordinates of the projection area and the corner point coordinates of the projection medium, the display device 200 can perform the following functions before calculating the homography matrix of the light machine image coordinates and the target image. Figure 14 The flowchart for the projection device provided by some embodiments of the present application to detect the position relationship between the corner point coordinates of the projection medium area and the vertex coordinates of the projection area is shown in Figure 14 , the projection device 2 can detect the position relationship between the four corner point coordinates of the projection medium area and the four vertex coordinates of the projection area. The position relationship includes a corner point inside the vertex relationship and a corner point not inside the vertex relationship. If the position relationship is the corner point inside the vertex relationship, the projection device 2 can control the light emitting assembly 200 to project and play content according to the target light machine image coordinates. If the position relationship is the corner point not inside the vertex relationship, the projection device 2 can generate a device movement instruction to move the position of the projection device 2 according to the device movement instruction.

[0095] For example, the four vertexes of the projection area are the four vertexes of the white border, and the coordinates are W1, W2, W3, and W4, respectively. The corner point coordinates of the projection medium are C1, C2, C3, and C4. The process of detecting the position relationship between the corner point coordinates of the projection medium area and the vertex coordinates of the projection area is to determine whether C1, C2, C3, and C4 fall inside W1, W2, W3, and W4. That is, to determine whether the four corner points of the projection medium are inside the four vertexes of the white border, whether the projection area covers the full projection medium, and whether the projection area covers the full screen. If yes, the subsequent process can be performed. If not, the instruction to move the position of the projection device can be triggered. After step S3 is performed, the following step S4 can be performed.

[0096] Step S4: The projection device 2 calculates the target light machine image coordinates corresponding to the corner points of the projection medium in the light emitting assembly 200 according to the homography matrix and the corner point coordinates.

[0097] After the homography matrix and the corner point coordinates of the projection medium are calculated, the projection device 2 can calculate the corresponding target light machine image coordinates of the corner points of the projection medium in the light emitting assembly 200 according to the homography matrix and the corner point coordinates. In the calculation of the target light machine image coordinates, the projection device 2 can first obtain the corner point coordinates and the light machine image coordinates, then map the corner point coordinates to the light machine image coordinates to generate a mapping transformation relationship, and finally calculate the corresponding target light machine image coordinates of the four corner points of the projection medium in the light emitting assembly according to the mapping transformation relationship.

[0098] For example, when the four corner points of the projection medium are mapped to the light machine image coordinates, if the calculated homography matrix is H and the four corner point coordinates of the projection medium are C, the corresponding target light machine image coordinates P of the four corner points of the projection medium in the light emitting assembly are calculated as P = H * C, and P is the corresponding target light machine image coordinates of the corner points of the projection medium in the light emitting assembly 200. After step S4 is executed, the following step S5 can be executed.

[0099] Step S5: The projection device 2 controls the light emitting assembly 200 to project and play the content to the projection medium according to the target light machine image coordinates.

[0100] After the target light machine image coordinates are calculated, the projection device 2 can control the light emitting assembly 200 to project and play the content to the projection medium according to the target light machine image coordinates. First, the projection device 2 can traverse the target light machine image coordinates, then determine the target projection position according to the target light machine image coordinates, and determine the region composed of the target projection position as the target curtain area of the projection medium, and finally perform the curtain-in of the projection device according to the target curtain area. Still taking the projection medium as the curtain as an example, that is, the region composed of the target light machine image coordinates is the region of the curtain 21.

[0101] In some embodiments, when the projection device 2 performs the curtain-in function, it can first receive a curtain-in instruction for curtain-in, then identify the closed rectangular region in the target image in response to the curtain-in instruction, and finally control the light emitting assembly 200 to project and play the content to the closed rectangular region according to the curtain-in mode based on an artificial intelligence algorithm.

[0102] For example, after the curtain-in function is triggered, if the selected curtain-in mode is no-sense curtain-in, the projection device 2 can achieve no-sense curtain-in based on an artificial intelligence algorithm. In some embodiments, the artificial intelligence algorithm has been trained with a large amount of data and can quickly and accurately identify the corner points of the occluded part in combination with the white border function to perform the curtain-in function. Not only is the curtain-in speed fast, but it is also suitable for conventional projection media and unconventional projection media, so as to improve the curtain-in speed, improve the adaptability to different projection media, improve the success rate of curtain-in in complex scenes, and solve the problems of slow automatic curtain-in speed, curtain-in failure or inaccurate curtain-in of the projection device.

[0103] From the above technical solutions, the above embodiment provides a projection device, which first acquires vertex coordinates of a projection area of the projection device, and acquires a light engine image in a light emitting assembly and light engine image coordinates corresponding to the light engine image; and calculates a homography matrix of target image coordinates and the light engine image coordinates according to the vertex coordinates and the light engine image coordinates; wherein the target image is a projection content image photographed after adding a white border to the projection area; simultaneously acquires corner point coordinates of a corner point of a projection medium covered by the projection area; and calculates target light engine image coordinates corresponding to the corner point of the projection medium in the light emitting assembly according to the homography matrix and the corner point coordinates; finally controls the light emitting assembly to project and play content to the projection medium according to the target light engine image coordinates. The projection device can quickly and accurately identify the corner point of the blocked part in combination with the white border function to perform the curtain-in function. Not only is the curtain-in speed fast, but it is also suitable for conventional projection media and also suitable for unconventional projection media, so that the curtain-in speed can be improved, the adaptability to different projection media can be improved, the success rate of curtain-in under a complex scene can be improved, and the problems of slow automatic curtain-in speed, curtain-in failure or inaccurate curtain-in of the projection device are solved.

[0104] Based on the projection device 2 in the above embodiment, some embodiments of the present application further provide a projection method, which can be applied to the projection device 2 in the above embodiment. In some embodiments, the method can include the following contents:

[0105] Acquire vertex coordinates of a projection area of the projection device 2, and acquire a light engine image in a light emitting assembly 200 and light engine image coordinates corresponding to the light engine image.

[0106] In some embodiments, after the image acquisition device 700 photographs the projection content image, the projection device 2 can acquire the projection content image, and detect a medium existence state of the projection medium according to the projection content image, wherein the medium existence state can include a medium existing state and a medium non-existing state. Then the following judgment can be made, in response to the medium existence state being the medium existing state, the projection device 2 can control the light emitting assembly 200 to project and play content to the projection medium according to the target light engine image coordinates, and the specific projection method will be described in detail later. In response to the medium existence state being the medium non-existing state, the projection device 2 can generate a correction instruction, and correct the position of the projection device 2 according to the correction instruction.

[0107] The projection device 2 calculates a homography matrix of target image coordinates and light engine image coordinates according to vertex coordinates and light engine image coordinates; the target image is a projection content image photographed after adding a white border to the projection area.

[0108] After obtaining the vertex coordinates of the projection area and the light machine image coordinates corresponding to the light machine image in step S1, the projection device 2 can calculate the homography matrix of the target image coordinates and the light machine image coordinates according to the vertex coordinates and the light machine image coordinates. The target image is the projection content image captured after adding a white border to the projection area.

[0109] For example, when calculating the homography matrix of the target image coordinates and the light machine image coordinates, the correspondence between the target image coordinates and the light machine image coordinates can be calculated according to the coordinates of the four vertices of the white border and the coordinates of the four vertices of the light machine image.

[0110] The projection device 2 obtains the corner point coordinates of the corner points of the projection medium covered by the projection area.

[0111] Before calculating the homography matrix of the target image coordinates and the light machine image coordinates, the projection device 2 can also perform the function of corner point detection. First, the projection device 2 can obtain the target image captured after adding a white border to the projection area, then it can analyze the target image to identify the projection area and the projection medium area in the target image, and finally output the vertex coordinates of the projection area and the corner point coordinates of the projection medium area based on an artificial intelligence algorithm.

[0112] The projection device 2 calculates the target light machine image coordinates corresponding to the corner points of the projection medium in the light emitting assembly 200 according to the homography matrix and the corner point coordinates.

[0113] After the homography matrix and the corner point coordinates of the projection medium are calculated, the projection device 2 can calculate the target light machine image coordinates corresponding to the corner points of the projection medium in the light emitting assembly 200 according to the homography matrix and the corner point coordinates. When calculating the target light machine image coordinates, the projection device 2 can first obtain the corner point coordinates and the light machine image coordinates, then map the corner point coordinates to the light machine image coordinates to generate a mapping transformation relationship, and finally calculate the target light machine image coordinates corresponding to the four corner points of the projection medium in the light emitting assembly according to the mapping transformation relationship.

[0114] The projection device 2 controls the light emitting assembly 200 to project and play the content to the projection medium according to the target light machine image coordinates.

[0115] After the target light machine image coordinates are calculated, the projection device 2 can control the light emitting assembly 200 to project and play the content to the projection medium according to the target light machine image coordinates. First, the projection device 2 can traverse the target light machine image coordinates, then determine the target projection position according to the target light machine image coordinates, and determine the region composed of the target projection position as the target curtain area of the projection medium, and finally perform the curtain-in of the projection device according to the target curtain area. Still taking the projection medium as the curtain as an example, that is, the region composed of the target light machine image coordinates is the region of the curtain 21.

[0116] From the above technical solutions, the projection method provided by the above embodiment can quickly and accurately identify the corner points of the blocked part in combination with the white border function, and execute the curtain-in function. Not only is the curtain-in speed fast, but it is also suitable for conventional projection media and unconventional projection media, so that the curtain-in speed can be improved, the adaptability to different projection media can be improved, the success rate of curtain-in in a complex scene can be improved, and the problems of slow automatic curtain-in speed, curtain-in failure or inaccurate curtain-in of the projection device can be solved.

[0117] The same and similar parts among various embodiments in the specification can be referred to each other, and will not be described here.

[0118] Those skilled in the art can clearly understand that the technologies in the embodiments of the present application can be realized by means of software and necessary general hardware platforms. Based on such understanding, the technical solutions in the embodiments of the present application can be embodied in the form of a software product, which can be stored in a storage medium, such as a ROM / RAM, a magnetic disk, an optical disk, etc., and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the method of various embodiments or some parts of the embodiments of the present application.

[0119] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

[0120] In order to facilitate explanation, the above description has been made in combination with specific embodiments. However, the above exemplary discussion is not intended to exhaust or limit the embodiments to the specific forms disclosed above. Various modifications and variations can be derived according to the above teachings. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different modified embodiments suitable for specific use considerations.

Claims

1. A projection device, characterized in that, include: The light-emitting component is configured to project the playback content onto the projection medium; An image acquisition device is configured to capture images of the projected content; The controller is configured as follows: Obtain the vertex coordinates of the projection area of ​​the projection device, and obtain the optical engine image in the light output component and the corresponding optical engine image coordinates; The homography matrix between the target image coordinates and the optical-mechanical image coordinates is calculated based on the vertex coordinates and the optical-mechanical image coordinates; the target image is a projection content image captured after adding a white border to the projection area; Detect the shooting status of the target image; the shooting status includes a shooting completed state and a shooting incomplete state; In response to the shooting state being the shooting completed state, the white border is deleted; In response to the shooting state being incomplete, the white border is retained; Obtain the corner coordinates of the corner points of the projection medium covered by the projection area; Calculate the target optomechanical image coordinates of the corner points of the projection medium in the light-emitting component based on the homography matrix and the corner point coordinates; The light-emitting component is controlled to project the playback content onto the projection medium according to the target optical engine image coordinates.

2. The projection device according to claim 1, characterized in that, The controller is further configured to: Acquire the image of the projected content; The existence state of the projection medium is detected based on the projected content image, and the existence state of the medium includes a medium presence state and a medium absence state. In response to the existence state of the medium being the existence medium state, the light-emitting component is controlled to project the playback content onto the projection medium according to the target optical engine image coordinates; In response to the medium presence state being the absence of medium state, a correction command is generated, and the position of the projection device is corrected according to the correction command.

3. The projection device according to claim 2, characterized in that, The controller is further configured to: Identify the projection medium in the projection area; If the projection medium is present in the projection area, a white border is added to the projection area, and the image acquisition device is controlled to capture a target image containing the white border.

4. The projection device according to claim 3, characterized in that, The controller is further configured to: Acquire the target image; The target image is analyzed to identify the projection region and the projection medium region in the target image; The coordinates of the vertex of the projection area and the coordinates of the corner of the projection medium area are output based on artificial intelligence algorithms.

5. The projection device according to claim 4, characterized in that, The controller is further configured to: The positional relationship between the coordinates of the four corner points of the projection medium region and the coordinates of the four vertices of the projection region is detected; the positional relationship includes the relationship where the corner points are inside the vertices and the relationship where the corner points are not inside the vertices. If the positional relationship is such that the corner point is inside the vertex, the light-emitting component is controlled to project the playback content onto the projection medium according to the target optical engine image coordinates; If the positional relationship is such that the corner point is not inside the vertex, a device movement command is generated to cause the projection device to move its position according to the device movement command.

6. The projection device according to claim 5, characterized in that, The controller, which performs the step of calculating the target optomechanical image coordinates of the corner points of the projection medium in the light-emitting component based on the homography matrix and the corner coordinates, is further configured to: Obtain the corner coordinates and the optomechanical image coordinates; The corner point coordinates are mapped to the optomechanical image coordinates to generate a mapping transformation relationship; The target optical-mechanical image coordinates corresponding to the four corner points of the projection medium in the light-emitting component are calculated based on the mapping transformation relationship.

7. The projection device according to claim 1, characterized in that, The controller is further configured to: Traverse the target optomechanical image coordinates; The target projection position is determined based on the target optical-mechanical image coordinates; The area formed by the target projection positions is defined as the target entrance area of ​​the projection medium; The projection device will enter the screen according to the target screen entry area.

8. The projection device according to claim 1, characterized in that, The controller is further configured to: Receive the entry command for entering the curtain; In response to the screen entry command, a closed rectangular region in the target image is identified; The method of receiving the entrance; The light-emitting component is controlled by an artificial intelligence algorithm to project the playback content onto the closed rectangular area according to the screen entry method.

9. A projection method applied to the projection device according to any one of claims 1-8, the projection device comprising a light-emitting component, an image acquisition device, and a controller, characterized in that, The projection method includes: Obtain the vertex coordinates of the projection area of ​​the projection device, and obtain the optical engine image in the light output component and the corresponding optical engine image coordinates; The homography matrix between the target image coordinates and the optical-mechanical image coordinates is calculated based on the vertex coordinates and the optical-mechanical image coordinates; the target image is a projection content image captured after adding a white border to the projection area; Detect the shooting status of the target image; the shooting status includes a shooting completed state and a shooting incomplete state; In response to the shooting state being the shooting completed state, the white border is deleted; In response to the shooting state being incomplete, the white border is retained; Obtain the corner coordinates of the corner points of the projection medium covered by the projection area; Calculate the target optomechanical image coordinates of the corner points of the projection medium in the light-emitting component based on the homography matrix and the corner point coordinates; The light-emitting component is controlled to project the playback content onto the projection medium according to the target optical engine image coordinates.

Images