Projection equipment and projection method

Abstract

The invention provides projection equipment and a projection method, and the method comprises the steps: obtaining a vertex coordinate of a projection region of the projection equipment, and obtaining a light machine image in a light-emitting assembly and a light machine image coordinate corresponding to the light machine image; calculating a homography matrix of the target image coordinate and the ray machine image coordinate according to the vertex coordinate and the ray machine image coordinate; acquiring angular point coordinates of projection medium angular points covered by the projection area; according to the homography matrix and the angular point coordinate, calculating a target ray machine image coordinate corresponding to the angular point of the projection medium in the light emitting assembly; and controlling the light emitting assembly to project the playing content to the projection medium according to the target light machine image coordinate. The method can quickly and accurately identify the angular point of the shielded part in combination with a white frame function, is not only suitable for a conventional projection medium, but also suitable for an unconventional projection medium, can improve the adaptability to different projection media, improves the success rate of screen entering in a complex scene, and improves the user experience. The problem that automatic screen entering of the projection equipment fails or is inaccurate is solved.

Description

Technical Field

[0001] The present application relates to the technical field of projection equipment, and in particular to a projection equipment and a projection method. Background Art

[0002] A projection device is a display device that can project images or videos onto a screen. The projection device can project laser light of a specific color onto the screen through the refraction of optical components to form a specific image. During the projection process, it is necessary to keep a certain distance between the projection device and the screen so that the image formed on the screen can meet the focal length range of the optical components to obtain a clear image.

[0003] During the projection process, considering that it is cumbersome for the user to adjust the projection device by himself, the projection device can have an automatic screen entry function. The automatic screen entry function means that the projection device can automatically determine the projection area in the projection medium and project the image to be projected into the projection area, thereby avoiding the user's manual adjustment of the angle and position of the projection device to improve the user experience. The projection device can be set with an automatic screen entry mode, and the user can send an automatic screen entry command to the projection device, so that the projection device enters the automatic screen entry mode, thereby enabling the projection device to turn on the automatic screen entry function.

[0004] Taking the projection medium as a screen as an example, the screen can have various specifications and types. For different screens, the projection device needs to be adjusted accordingly before projection to ensure that the content to be projected can be projected onto the screen more accurately. However, for some conventional screens such as four-sided screens, the projection device can easily determine the area where the screen is located to project the content to be projected onto the screen. For some unconventional screens such as double-sided screens, the projection device may not be able to quickly and accurately determine the position of the screen, thereby affecting the accuracy of the projection device projection, resulting in the problem of the projection device failing to automatically enter the screen or inaccurately entering the screen. Summary of the invention

[0005] Some embodiments of the present application provide a projection device and a projection method to solve the problem that the projection device has a slow automatic screen entry speed, fails to enter the screen, or is inaccurately enters the screen.

[0006] In a first aspect, some embodiments of the present application provide a projection device, including:

[0007] A light emitting component is configured to project the playback content onto a projection medium;

[0008] An image acquisition device, configured to capture an image of the projection content;

[0009] The controller is configured as:

[0010] Acquire the vertex coordinates of the projection area of ​​the projection device, and acquire the optomechanical image in the light output component and the optomechanical image coordinates corresponding to the optomechanical image;

[0011] Calculate the homography matrix of the target image coordinates and the optomechanical image coordinates according to the vertex coordinates and the optomechanical image coordinates; the target image is a projection content image taken after adding a white border to the projection area;

[0012] Obtaining the coordinates of the corner points of the projection medium covered by the projection area;

[0013] Calculate the target optical-mechanical image coordinates corresponding to the corner points of the projection medium in the light output component according to the homography matrix and the corner point coordinates;

[0014] The light emitting component is controlled to project the playback content onto a projection medium according to the target optical-mechanical image coordinates.

[0015] In a second aspect, some embodiments of the present application provide a projection method, which can be applied to the projection device of the first aspect, the projection device comprising a light output component, an image acquisition device and a controller, and the projection method comprises:

[0016] Acquire the vertex coordinates of the projection area of ​​the projection device, and acquire the optomechanical image in the light output component and the optomechanical image coordinates corresponding to the optomechanical image;

[0017] Calculate the homography matrix of the target image coordinates and the optomechanical image coordinates according to the vertex coordinates and the optomechanical image coordinates; the target image is a projection content image taken after adding a white border to the projection area;

[0018] Obtaining the coordinates of the corner points of the projection medium covered by the projection area;

[0019] Calculate the target optical-mechanical image coordinates corresponding to the corner points of the projection medium in the light output component according to the homography matrix and the corner point coordinates;

[0020] The light emitting component is controlled to project the playback content onto a projection medium according to the target optical-mechanical image coordinates.

[0021] It can be seen from the above technical solutions that some embodiments of the present application provide a projection device and a projection method, the method comprising: obtaining the vertex coordinates of the projection area of ​​the projection device, and obtaining the optical-mechanical image in the light-emitting component and the optical-mechanical image coordinates corresponding to the optical-mechanical image; and calculating the homography matrix of the target image coordinates and the optical-mechanical image coordinates according to the vertex coordinates and the optical-mechanical image coordinates; at the same time, obtaining the corner point coordinates of the corner points of the projection medium covered by the projection area; and calculating the target optical-mechanical image coordinates corresponding to the corner points of the projection medium in the light-emitting component according to the homography matrix and the corner point coordinates; and finally controlling the light-emitting component to project the playback content to the projection medium according to the target optical-mechanical image coordinates. The method can be combined with the white border function to quickly and accurately identify the corner points of the obscured part and execute the screen entry function. Not only is the fast screen entry speed suitable for conventional projection media, but it is also suitable for unconventional projection media. Therefore, the screen entry speed can be improved, the screen entry speed can be improved, the adaptability to different projection media can be improved, and the success rate of screen entry in complex scenes can be improved, so as to solve the problems of slow automatic screen entry speed, screen entry failure or inaccurate screen entry of the projection device. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate some embodiments of the present application or technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0023] Figure 1 A schematic diagram of the projection placement state of a projection device provided in some embodiments of the present application;

[0024] Figure 2 A schematic diagram of the optical path of a projection device provided in some embodiments of the present application;

[0025] Figure 3 A schematic diagram of the circuit architecture of a projection device provided in some embodiments of the present application;

[0026] Figure 4 A schematic diagram of the structure of a projection device provided in some embodiments of the present application;

[0027] Figure 5 A schematic diagram of the lens structure of a projection device provided in some embodiments of the present application;

[0028] Figure 6 A schematic diagram of the structure of a distance sensor and an image acquisition device for a projection device provided in some embodiments of the present application;

[0029] Figure 7 A schematic diagram of a system framework for implementing display control for a projection device provided in some embodiments of the present application;

[0030] Figure 8 A schematic diagram of a four-sided curtain provided in some embodiments of the present application;

[0031] Fig. 9 A schematic diagram of a double-sided curtain provided in some embodiments of the present application;

[0032] Fig.10 A schematic diagram of a flow chart of a projection method executed by a projection device provided in some embodiments of the present application;

[0033] Fig.11 A schematic diagram of the timing of the projection device executing the screen entry provided in some embodiments of the present application;

[0034] Fig.12 A schematic diagram of a scene of vertices of the four-sided screen projection area and screen corner points provided in some embodiments of the present application;

[0035] Fig.13 A schematic diagram of a scene of the vertices of the double-sided screen projection area and the screen corner points provided in some embodiments of the present application;

[0036] Fig.14 A schematic diagram of a process for a projection device to detect the coordinates of corner points of a projection medium area and the coordinates of vertices of a projection area provided in some embodiments of the present application. DETAILED DESCRIPTION

[0037] In order to make the purpose and implementation method of the present application clearer, the exemplary implementation method of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, rather than all the embodiments.

[0038] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0039] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0040] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0041] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0042] The embodiments of the present application can be applied to various types of projection devices. The following will take the projection device as an example to explain the projection device and the automatic focusing method.

[0043] Projection equipment is a device that can project images or videos onto a screen. Projection equipment can be connected to computers, broadcasting networks, the Internet, VCD (Video Compact Disc), DVD (Digital Versatile Disc Recordable), game consoles, DV, etc. through different interfaces to play corresponding video signals. Projection equipment is widely used in homes, offices, schools, and entertainment venues.

[0044] Figure 1 A schematic diagram of the projection placement state of the projection device provided in some embodiments of the present application, Figure 2 A schematic diagram of the optical path of a projection device provided in some embodiments of the present application.

[0045] In some embodiments, reference Figure 1-2 A projection device provided in the present application includes a projection screen 1 and a projection device 2. The projection screen 1 is fixed at a first position, and the projection device 2 is placed at a second position, so that the image projected by the projection device 2 matches the projection screen 1. The projection device includes a light source 100, a light output component 200, a lens 300, and a projection surface 400. The light source 100 provides illumination for the light output component 200, and the light output component 200 modulates the light beam of the light source and outputs it to the lens 300 for imaging, which is projected onto the projection surface 400 to form a projection image.

[0046] In some embodiments, the light source 100 of the projection device 2 includes a light output component 110 and an optical lens component 120 . The light beam emitted by the light output component 110 can pass through the optical lens component 120 to provide lighting for the light output component 200 .

[0047] It should be noted that in the embodiment of the present application, the light source 100 may be a laser light source, an LED light source, or a Liquid Crystal Display (LCD) light source, and the present application does not specifically limit this. For example, taking the light source 100 as a laser light source as an example, when the light source 100 is a laser light source, in some embodiments, the light emitting component 200 of the projection device 2 may be implemented to include a blue light emitting component, a green light emitting component, and a red light emitting component, and may also include a heat dissipation system, a circuit control system, etc. Figure 3A schematic diagram of the circuit architecture of a projection device provided in some embodiments of the present application. In some embodiments, the projection device 2 may include a display control circuit 10, a light source 100, at least one light driving component 30, and at least one brightness sensor 40. Taking the light source 100 as a laser light source as an example, when the light source 100 is a laser light source, the light source 100 may include at least one laser corresponding to the at least one light driving component 30.

[0048] Based on the circuit architecture, the projection device 2 can achieve adaptive adjustment. For example, by setting a brightness sensor 40 in the light output path of the light source 100 , the brightness sensor 40 can detect the first brightness value of the laser light source and send the first brightness value to the display control circuit 10 .

[0049] The display control circuit 10 can obtain the second brightness value corresponding to the driving current of each laser, and when it is determined that the difference between the second brightness value of the laser and the first brightness value of the laser is greater than the difference threshold, it is determined that a COD fault occurs in the laser; the display control circuit can adjust the current control signal of the laser driving component corresponding to the laser until the difference is less than or equal to the difference threshold, thereby eliminating the COD fault of the blue laser; the projection device 2 can eliminate the COD fault of the laser in time, reduce the damage rate of the laser, and improve the image display effect of the projection device 2.

[0050] Figure 4 A schematic diagram of the structure of a projection device provided in some embodiments of the present application.

[0051] In some embodiments, still taking the light source 100 as a laser light source as an example, the light source 100 in the projection device 2 may include independently arranged blue laser 101, red laser 102 and green laser 103. When the light source 100 is a laser light source, the projection device 2 may also be called a three-color projection device. The blue laser 101, the red laser 102 and the green laser 103 are all module lightweight (Mirai Console Loader, MCL) packaged lasers, which are small in size and are conducive to the compact arrangement of the optical path. It is understandable that the above is only illustrative of the light source 100 as a laser light source, and the light source 100 is not limited to a laser light source, but may also be an LED light source, an LCD light source and other forms of light sources.

[0052] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory, ROM), a first interface to an nth interface for input / output, a communication bus (Bus), etc.

[0053] In some embodiments, after the projection device 2 is started, it can directly enter the display interface of the last selected signal source, or the signal source selection interface, where the signal source can be a preset video on demand program, or at least one of an HDMI interface, a live TV interface, etc. After the user selects a different signal source, the projector can display the content obtained from different signal sources.

[0054] In some embodiments, the projection device 2 may be configured with an image acquisition device 700 such as a camera, which is used to work in conjunction with the projection device 2 to achieve adjustment and control of the projection process. For example, the camera configured with the projection device 2 may be specifically implemented as a 3D camera or a binocular camera; when the camera is implemented as a binocular camera, it specifically includes a left camera and a right camera; the binocular camera may obtain the projection medium corresponding to the projection device 2, such as a curtain, that is, the image and playback content presented by the projection surface 400, and the image or playback content is projected by the light emitting component 200 built into the projection device 2.

[0055] The image acquisition device can be used to capture the image displayed on the projection surface 400, and can be a camera. The camera can include a lens assembly, in which a photosensitive element and a lens are provided. The lens refracts light through a plurality of lenses, so that the light of the image of the scene can be irradiated on the photosensitive element.

[0056] Figure 5 Schematic diagram of the lens structure of the projection device provided in some embodiments of the present application. In order to support the automatic focusing process of the projection device 2, such as Figure 5 As shown, the lens 300 of the projection device 2 may further include an optical component 310 and a drive motor 320. The optical component 310 is a lens group composed of one or more lenses, which can refract the light emitted by the light emitting component 200 so that the light emitted by the light emitting component 200 can be transmitted to the projection surface 400 to form a transmission content image.

[0057] The optical assembly 310 may include a lens barrel and a plurality of lenses disposed in the lens barrel. Depending on whether the position of the lens can be moved, the lens in the optical assembly 310 may be divided into a movable lens 311 and a fixed lens 312. By changing the position of the movable lens 311 and adjusting the distance between the movable lens 311 and the fixed lens 312, the overall focal length of the optical assembly 310 may be changed. Therefore, the driving motor 320 may drive the movable lens 311 to move its position by connecting to the movable lens 311 in the optical assembly 310, thereby realizing an automatic focusing function.

[0058] It should be noted that the focusing process described in some embodiments of the present application refers to changing the position of the movable lens 311 by driving the motor 320, thereby adjusting the distance between the movable lens 311 and the fixed lens 312, that is, adjusting the image plane position. Therefore, the imaging principle of the lens combination in the optical component 310, the adjustment of the focal length is actually adjusting the image distance, but in terms of the overall structure of the optical component 310, adjusting the position of the movable lens 311 is equivalent to adjusting the overall focal length of the optical component 310.

[0059] When the distance between the projection device 2 and the projection surface 400 is different, the lens of the projection device 2 needs to adjust different focal lengths to project a clear image on the projection surface 400. During the projection process, the distance between the projection device 2 and the projection surface 400 will require different focal lengths depending on the placement of the user. Therefore, in order to adapt to different usage scenarios, the projection device 2 needs to adjust the focal length of the optical component 310.

[0060] Figure 6 This is a schematic diagram of the distance sensor and image acquisition device structure of the projection device provided in some embodiments of the present application. Figure 6 As shown, the projection device 2 may also have a built-in or external image acquisition device 700, and the image acquisition device 700 may capture the image projected by the projection device 2 to obtain the projection content image. The distance sensor 600 is configured to detect the interval distance between the projection surface 400 and the light output component 200. The projection device 2 then determines whether the current lens focal length is appropriate by performing a clarity detection on the projection content image, and adjusts the focal length if it is not appropriate. When automatically focusing based on the projection content image captured by the image acquisition device 700, the projection device 2 may find the focusing position by continuously adjusting the lens position and taking pictures, and by comparing the clarity of the pictures of the front and back positions, thereby adjusting the movable lens 311 in the optical component to a suitable position.

[0061] Figure 7 A schematic diagram of a system framework for implementing display control for a projection device provided in some embodiments of the present application.

[0062] In some embodiments, the projection device 2 has the characteristics of a telephoto micro-projector, and its controller can control the display of the projection light image through a preset algorithm to achieve functions such as automatic trapezoidal correction of the display screen, automatic screen entry, automatic obstacle avoidance, automatic focusing, and anti-eye-shooting.

[0063] In some embodiments, the projection device 2 is configured with a gyroscope sensor; when the device is moving, the gyroscope sensor can sense the position movement and actively collect movement data; then the collected data is sent to the application service layer through the system framework layer to support the application data required during the user interface interaction and application interaction process. The collected data can also be used for data calls by the controller in the algorithm service implementation.

[0064] In some embodiments, the projection device 2 is configured with a time-of-flight sensor. After the time-of-flight sensor collects corresponding data, the data will be sent to the corresponding time-of-flight service of the service layer; after the above-mentioned time-of-flight service obtains the data, it will send the collected data to the application service layer through the process communication framework, and the data will be used for interactive use such as controller data calls, user interfaces, and program applications.

[0065] In some embodiments, the image acquisition device 700 configured for the projection device 2 can be a binocular camera, a depth camera or a 3D camera, etc.; the image acquisition device 700 collects data and sends it to the camera service, and then the camera service sends the collected image data to the process communication framework and / or the projection device correction service; the projection device correction service can receive the camera acquisition data sent by the camera service, and the controller can call the corresponding control algorithm in the algorithm library according to the different functions to be implemented.

[0066] In some embodiments, data is interacted with the application service through the process communication framework, and then the calculation results are fed back to the correction service through the process communication framework; the correction service sends the obtained calculation results to the projection device 2 operating system to generate control signals, and sends the control signals to the light emitting component 200 control drive to control the working condition of the light emitting component 200 and realize automatic correction of the displayed image.

[0067] In some embodiments, when an image correction instruction is detected, the projection device 2 can correct the projected image. For the correction of the projected image, an association relationship between the distance, the horizontal angle, and the offset angle can be created in advance. Then the controller in the projection device 2 obtains the current distance from the light emitting component 200 to the projection surface 400, and determines the angle between the light emitting component 200 and the projection surface 400 at this moment in combination with the associated relationship, thereby achieving projection image correction. Among them, the angle is specifically implemented as the angle between the central axis of the light emitting component 200 and the projection surface 400.

[0068] In some embodiments, the projection device 2 automatically completes the calibration and refocuses, and the controller will detect whether the automatic focus function is turned on; when the automatic focus function is not turned on, the controller will end the automatic focus service; when the automatic focus function is turned on, the projection device 2 will obtain the detection distance of the time-of-flight sensor through the middleware for calculation.

[0069] The controller queries the preset mapping table according to the acquired distance to obtain the focal length of the projection device 2; then the middleware sets the acquired focal length to the light emitting component 200 of the projection device 2; wherein the middleware is a series of applications for the focus control process. After the light emitting component 200 emits laser light at the above focal length, the camera will execute the photo taking instruction; the controller determines whether the focus adjustment process of the projection device 2 is completed according to the acquired captured image and the evaluation function.

[0070] If the judgment result meets the preset completion conditions, the control of the automatic focusing process ends; if the judgment result does not meet the preset completion conditions, the middleware will fine-tune the focal length parameters of the light-emitting component 200 of the projection device 2, for example, the focal length can be gradually fine-tuned with a preset step length, and the adjusted focal length parameters will be set to the light-emitting component 200 again; thereby achieving repeated photo taking and clarity evaluation steps, and finally completing automatic focusing by finding the optimal focal length through clarity comparison.

[0071] In some embodiments, when the user turns on the projection device 2, the projection device 2 can project the content pre-set by the user onto the projection surface 400. The projection surface 400 can be a wall or other projection media such as a screen. The projection image can be displayed on the projection surface 400 for the user to watch.

[0072] In some embodiments, taking the projection medium as a screen as an example, the screen may have various specifications and types. For different screens, the projection device 2 needs to be adjusted accordingly before projection to ensure that the content to be projected can be projected onto the screen more accurately. Figure 8 A schematic diagram of a four-sided curtain provided in some embodiments of the present application, such as Figure 8 As shown, the screen 21 may include a projection area 211 and an edge line 212. The projection area 211 is used to display the projection content to be projected, such as images, videos, etc. The screen 21 may be provided with different edge lines 212 according to actual needs. Figure 8 In the embodiment, the edges of the curtain 21 are all provided with dark edge lines 212. For example, the four edge lines 212 of the curtain 21 can all be black. The dark edge lines 212 can have a certain width, so the edge lines 212 can also be called edge bands. Figure 8The curtain 21 with four edge bands can be called a four-sided curtain. Since the edges of the four-sided curtain have relatively obvious edge lines 212, the projection device 2 can use this feature to stably, efficiently and accurately identify the four-sided curtain in the environment, so that the projection device 2 can quickly enter the curtain. It can be understood that even after the projection device 2 moves, it can quickly locate the position of the four-sided curtain, so as to achieve rapid entry. It should be noted that the present application only uses the curtain as the projection medium for explanation, and is not limited to the curtain, but can also be other projection media, which is not specifically limited in the present application.

[0073] In addition to four-sided curtains, there are other types of curtains 21. Fig. 9 A schematic diagram of a double-sided curtain provided in some embodiments of the present application, such as Fig. 9 As shown, two edge positions of the double-sided curtain have dark edge lines 212, and the other two edges do not have dark edge lines 212. Fig. 9 In the double-sided screen, the upper and lower edges may have black edge lines 212 of a certain width, while the left and right edges do not have dark edge lines 212. Therefore, the four edges of the double-sided screen cannot form a closed quadrilateral, for example, a rectangle, so that the projection device 2 may not accurately identify the position of the double-sided screen when projecting, or the projection device 2 may identify the double-sided screen as an obstacle, thereby failing to accurately project the content to be projected onto the screen 21.

[0074] It should be noted that any two edges of the double-sided screen may have dark edge lines, and the other two edges except these two edges may not have dark edge lines, and this application does not limit this. For example, the left and right edges of the double-sided screen may have black edge lines 212 of a certain width, while the upper and lower edges may not have edge lines. In this scenario, the upper and lower edge positions of the double-sided screen may not be accurately identified.

[0075] That is to say, for some conventional screens such as four-sided screens, the projection device 2 can easily determine the area where the screen is located to project the content to be projected onto the screen. However, for some unconventional screens such as double-sided screens, the projection device 2 may not be able to quickly and accurately determine the position of the screen, thereby affecting the accuracy of the projection of the projection device 2, resulting in the problem that the projection device 2 fails to automatically enter the screen or enters the screen inaccurately.

[0076] Exemplarily, in some embodiments, when performing laser micro-projection, the corners of the screen can be located by calculating the grayscale value of the image and determining the closed contour. However, this method performs well in simple environments such as when there is no obstruction. In complex environments, such as when the edges of the four sides of the screen are obstructed, the edges of the screen are damaged, one corner of the screen is blocked by green plants, or the double-sided screen is placed on a dark background, etc., the screen entry may fail or the screen entry deviation may be large. For example, if one of the four sides of the screen is blocked or green plants are placed in a corner of the screen, when locating the screen by using the grayscale value of the image and determining the closed contour, a closed rectangle may not be obtained due to the obstruction, and it is believed that there is no screen, resulting in a failure to enter the screen. In fact, the screen does exist, and it is only because of the obstruction that the screen entry fails.

[0077] In order to solve the problem that the projection device 2 fails to enter the screen automatically or enters the screen inaccurately, some embodiments of the present application provide a projection device 2, and the projection device 2 may include a light output component 200, an image acquisition device 700 and a controller 500. Among them, the light output component 200 is configured to project the playback content to the projection medium, the image acquisition device 700 is configured to capture the projection content image, and the controller 500 is configured to execute the projection method. The projection device 2 proposed in the embodiment of the present application can combine the white border function to quickly and accurately identify the corner points of the obscured part and execute the entry function. Not only is the entry speed fast and suitable for conventional projection media, but it is also suitable for unconventional projection media. Therefore, it can improve the entry speed, improve the adaptability to different projection media, and improve the success rate of entry in complex scenes, thereby solving the problem that the projection device automatically enters the screen slowly, fails to enter the screen, or enters the screen inaccurately.

[0078] In order to facilitate the understanding of the technical solutions in some embodiments of the present application, each step is described in detail below in conjunction with some specific embodiments and drawings. Fig.10 A schematic diagram of a flow chart of a projection method performed by a projection device provided in some embodiments of the present application, such as Fig.10 As shown, when the projection device 2 executes the projection method, the following steps S1-S5 may be included, and the specific contents are as follows:

[0079] Step S1: obtaining the vertex coordinates of the projection area of ​​the projection device 2, and obtaining the optomechanical image in the light output component 200 and the optomechanical image coordinates corresponding to the optomechanical image.

[0080] In order to realize the entry function of the projection device 2, in some embodiments, the projection device 2 may be provided with a plurality of functional modules. For example, a screen entry calling module may be provided, in which a switch for controlling the entry of the screen may be configured, and the entry function may be triggered only after the entry switch is called. The projection device 2 may also be provided with a screen entry module, in which a logic control thread and a corresponding algorithm related to the entry function may be provided. The projection device 2 may also be provided with an optical-mechanical image coordinate detection module, which may be the output of the screen entry module, and is used to calculate and output the optical-mechanical image coordinates corresponding to the optical-mechanical image. A projection medium detection module may also be provided, which may be used to detect whether there is a projection medium in the projection environment, for example, in the projection content image captured by the image acquisition device 700, so as to set different subsequent processes according to its different existence states. It should be noted that the above functional modules are only exemplary descriptions, and other modules may also be provided in the projection device 2, and this application does not make specific limitations on this.

[0081] Fig.11 A schematic diagram of the timing of the projection device executing the screen entry provided in some embodiments of the present application, such as Fig.11 As shown, in some embodiments, after the image acquisition device 700 captures the projection content image, the projection device 2 can obtain the projection content image and detect the medium existence state of the projection medium according to the projection content image, wherein the medium existence state may include the medium existence state and the medium non-existence state. Then, the following judgment can be made. In response to the medium existence state being the medium existence state, the projection device 2 can control the light output component 200 to project the playback content to the projection medium according to the target optical machine image coordinates. The specific projection method will be described in detail later. In response to the medium existence state being the medium non-existence state, the projection device 2 can generate a correction instruction and correct the position of the projection device 2 according to the correction instruction.

[0082] Exemplarily, after the projection device 2 calls the camera in the image acquisition device 700 to take a photo, it can analyze whether there is a projection medium in the photo shooting area according to the projection content image taken by it. Taking the projection medium as a screen as an example, the projection device 2 can analyze whether there is a screen in the projection content image. If the medium existence state is a medium non-existence state, such as there is no screen in the shooting area, the projection device 2 can perform other processes other than entering the screen, for example, a correction instruction can be generated, and the position of the projection device 2 can be corrected according to the correction instruction. If the medium existence state is a medium existence state, the projection device 2 can perform the screen entry process.

[0083] In order to accurately identify the projection area, in some embodiments, the projection device 2 can identify the projection medium in the projection area. If there is a projection medium in the projection area, a white border can be added to the projection area, and the image acquisition device 700 can be controlled to capture the target image containing the white border.

[0084] For example, see Fig.11 After analyzing that there is a curtain in the projection content image, it can be confirmed that there is a projection medium in the projection area. For this scenario, the projection device 2 can add a white border to the projection area. Fig.12 A schematic diagram of a scene of vertices of the four-sided screen projection area and screen corner points provided in some embodiments of the present application, Fig.13 A schematic diagram of a scene of the vertices of the double-sided screen projection area and the screen corner points provided in some embodiments of the present application, such as Fig.12 and Fig.13 As shown, after the entry function is triggered, if it is determined that there is a projection medium such as a screen, the projection area can be added as follows Fig.12 , Fig.13 As shown in the white border, the coordinates of the four vertices in the figure are W1, W2, W3, and W4, and the coordinates of the four corner points of the screen are C1, C2, C3, and C4, that is, in the embodiment of the present application, the projection device 2 will add white borders on the four sides of the maximum projection area, so that the projection device 2 can clearly identify the projection area, and even a double-sided screen that is difficult to identify can be accurately identified, thereby improving the adaptability of the projection device 2 to complex scenes by adding white borders.

[0085] After adding a white border to the projection area, the projection device 2 can calculate the vertex coordinates of the projection area. For example, the vertex coordinates of the projection area can be obtained through the corner point detection network. At the same time, the projection device 2 can obtain the optical image in the light output component 200 and calculate the optical image coordinates corresponding to the optical image, providing data basis for subsequent calculations. After step S1 is executed, the following step S2 can be executed.

[0086] Step S2: the projection device 2 calculates the homography matrix of the target image coordinates and the optomechanical image coordinates according to the vertex coordinates and the optomechanical image coordinates.

[0087] After obtaining the vertex coordinates of the projection area and the optomechanical image coordinates corresponding to the optomechanical image in step S1, the projection device 2 can calculate the homography matrix of the target image coordinates and the optomechanical image coordinates according to the vertex coordinates and the optomechanical image coordinates. The target image is the projection content image captured after adding a white border to the projection area.

[0088] Exemplarily, when calculating the homography matrix of the target image coordinates and the optomechanical image coordinates, the corresponding relationship between the target image coordinates and the optomechanical image coordinates can be calculated according to the coordinates of the four vertices of the white border and the coordinates of the four vertices of the optomechanical image. After step S2 is executed, the following step S3 can be executed.

[0089] Step S3: the projection device 2 obtains the corner point coordinates of the corner points of the projection medium covered by the projection area.

[0090] In order to calculate the vertex coordinates of the projection area and the corner coordinates of the projection medium area, in some embodiments, continue to refer to Fig.11 Before calculating the homography matrix of the target image coordinates and the optical-mechanical image coordinates, the projection device 2 can also perform the function of corner point detection. First, the projection device 2 can obtain the target image taken after adding a white border to the projection area, and then analyze the target image to identify the projection area and the projection medium area in the target image, and finally output the vertex coordinates of the projection area and the corner coordinates of the projection medium area based on the artificial intelligence algorithm.

[0091] Exemplarily, after acquiring the target image, the key point detection technology in computer vision can be used to detect the coordinates of the four vertices of the projection area and the coordinates of the four corner points of the projection medium covered by the projection area, such as a screen. When the projection medium is a screen, it can include a four-sided screen and a double-sided screen. According to the coordinates of the four vertices of the projection area and the four vertex coordinates of the known optical machine image, taking a 2K optical machine as an example, the four-point coordinates of the vertices of the optical machine image can be (0, 0), (0, 1919), (1079, 0) and (1919, 1079), respectively. The corresponding relationship between the coordinates of the target image and the coordinates of the optical machine image can be obtained by performing homography calculation with the vertex coordinates of the projection area. Then, the coordinates of the corner points of the projection medium, such as the corner points of the screen, can be calculated by homography to obtain the coordinate values ​​of the four corner points of the screen in the optical machine image. The specific calculation method will be introduced later.

[0092] That is to say, in the embodiment of the present application, the corner point detection method in computer vision can be used to detect the coordinates of the four vertices of the projection area and the corner point coordinates of the four-sided curtain or the double-sided curtain. For example, the corner point coordinates of the corner points of the projection medium covered by the projection area can also be obtained through the corner point detection network, and then by calculating the optical machine image coordinates and the homography matrix of the target image, the image coordinates of the four-point coordinates of the projection medium such as the curtain under the optical machine are calculated, thereby realizing the function of entering the curtain. It should be noted that in the embodiment of the present application, the corner point detection function is performed by using an artificial intelligence algorithm such as an AI neural network, which can quickly identify the corner point coordinates of the corner points of the projection medium, thereby improving the speed of entering the curtain. According to experimental data detection, the corner point detection method using an AI neural network can achieve an entry time of less than 1 second, thereby achieving a senseless entry into the curtain.

[0093] In some embodiments, the projection device 2 may also perform the following functions. The projection device 2 may detect the shooting status of the target image, wherein the shooting status may include a shooting completion status and an unfinished shooting status. In response to the shooting status being the shooting completion status, the projection device 2 may delete the white border, and in response to the shooting status being the unfinished shooting status, the projection device 2 may retain the white border. In other words, during the process of entering the screen, it is only necessary to display the white borders for a short time on the four sides of the projection area when taking pictures. After the shooting is completed, the white borders will be deleted and the original projection picture will be restored to achieve a seamless entry into the screen.

[0094] In order to improve the accuracy of projection by the projection device 2 and ensure that the projection content can be projected onto the projection medium, in some embodiments, Fig.11 After calculating the vertex coordinates of the projection area and the corner coordinates of the projection medium and before calculating the homography matrix of the optical-mechanical image coordinates and the target image, the display device 200 can also perform the following functions. Fig.14 A schematic diagram of a process for a projection device to detect the coordinates of the corner points of a projection medium area and the coordinates of the vertices of a projection area provided in some embodiments of the present application, such as Fig.14 As shown, the projection device 2 can detect the positional relationship between the coordinates of the four corner points of the projection medium area and the coordinates of the four vertices of the projection area, wherein the positional relationship includes the relationship that the corner point is inside the vertex and the relationship that the corner point is not inside the vertex. If the positional relationship is the relationship that the corner point is inside the vertex, the projection device 2 can control the light output component 200 to project the playback content to the projection medium according to the target optical machine image coordinates; if the positional relationship is the relationship that the corner point is not inside the vertex, the projection device 2 can generate a device movement instruction to enable the projection device 2 to move the position of the projection device according to the device movement instruction.

[0095] Exemplarily, the four vertices of the projection area are the four vertices of the white frame, and their coordinates are W1, W2, W3, and W4 respectively. The coordinates of the corner points of the projection medium are C1, C2, C3, and C4. The process of detecting the coordinates of the corner points of the projection medium area and the coordinates of the vertices of the projection area is to see whether C1, C2, C3, and C4 fall inside W1, W2, W3, and W4. That is, it is determined whether the four corner points of the projection medium are within the four vertices of the white frame, and whether the projection area covers the entire projection medium, such as whether the projection area covers the entire screen. If covered, the subsequent process can be executed. If not covered, the instruction to move the position of the projection device can be triggered. After step S3 is executed, the following step S4 can be executed.

[0096] Step S4: the projection device 2 calculates the target optical-mechanical image coordinates corresponding to the corner points of the projection medium in the light output component 200 according to the homography matrix and the corner point coordinates.

[0097] After the homography matrix and the corner point coordinates of the projection medium are calculated, the projection device 2 can calculate the target optical-mechanical image coordinates corresponding to the corner points of the projection medium in the light output component 200 according to the homography matrix and the corner point coordinates. When calculating the target optical-mechanical image coordinates, the projection device 2 can first obtain the corner point coordinates and the optical-mechanical image coordinates, then homograph the corner point coordinates to the optical-mechanical image coordinates, generate a mapping transformation relationship, and then calculate the target optical-mechanical image coordinates corresponding to the four corner points of the projection medium in the light output component according to the mapping transformation relationship.

[0098] Exemplarily, when the four corner points of the projection medium are homographed to the optical-mechanical image coordinates, if the calculated homography matrix is ​​H, and the coordinates of the four corner points of the projection medium are represented by C, then the target optical-mechanical image coordinates P=H*C corresponding to the projection medium in the light output component are calculated, where P is the target optical-mechanical image coordinates corresponding to the corner points of the projection medium in the light output component 200. After step S4 is executed, the following step S5 may be executed.

[0099] Step S5: the projection device 2 controls the light output component 200 to project the playback content onto the projection medium according to the target optical-mechanical image coordinates.

[0100] After the target optical-mechanical image coordinates are calculated, the projection device 2 can control the light-emitting component 200 to project the playback content to the projection medium according to the target optical-mechanical image coordinates. First, the projection device 2 can traverse the target optical-mechanical image coordinates, and then determine the target projection position according to the target optical-mechanical image coordinates, and determine the area composed of the target projection position as the target screen entry area of ​​the projection medium, and finally execute the screen entry of the projection device according to the target screen entry area. Still taking the projection medium as a curtain as an example, that is to say, the area composed of the target optical-mechanical image coordinates is the area of ​​the curtain 21.

[0101] In some embodiments, when the projection device 2 executes the entry function, it can first receive an entry instruction for entering the screen, then respond to the entry instruction, identify the closed rectangular area in the target image, and receive the entry method of entering the screen, and finally control the light output component 200 based on the artificial intelligence algorithm to project the playback content to the closed rectangular area according to the entry method.

[0102] Exemplarily, after the entry function is triggered, if the selected entry method is seamless entry, the projection device 2 can achieve seamless entry based on an artificial intelligence algorithm. In some embodiments, the artificial intelligence algorithm has been trained with a large amount of data, and can be combined with the white border function to quickly and accurately identify the corner points of the obscured part to execute the entry function. Not only is the entry speed fast and suitable for conventional projection media, but it is also suitable for unconventional projection media. Therefore, it can improve the entry speed, improve the adaptability to different projection media, and improve the success rate of entry in complex scenes, solving the problems of slow automatic entry speed, failed entry, or inaccurate entry of the projection device.

[0103] It can be seen from the above technical scheme that the above embodiment provides a projection device, the projection device first obtains the vertex coordinates of the projection area of ​​the projection device, and obtains the optomechanical image in the light-emitting component and the optomechanical image coordinates corresponding to the optomechanical image; and calculates the homography matrix of the target image coordinates and the optomechanical image coordinates according to the vertex coordinates and the optomechanical image coordinates; wherein the target image is the projection content image taken after adding a white border to the projection area; and at the same time, obtains the corner point coordinates of the corner points of the projection medium covered by the projection area; and calculates the target optomechanical image coordinates corresponding to the corner points of the projection medium in the light-emitting component according to the homography matrix and the corner point coordinates; finally, controls the light-emitting component to project the playback content to the projection medium according to the target optomechanical image coordinates. The projection device can combine the white border function to quickly and accurately identify the corner points of the obscured part and execute the screen entry function. Not only is the screen entry speed fast and suitable for conventional projection media, but it is also suitable for unconventional projection media. Therefore, it can improve the screen entry speed, improve the adaptability to different projection media, and improve the success rate of screen entry in complex scenes, solving the problems of slow automatic screen entry speed, screen entry failure or inaccurate screen entry of the projection device.

[0104] Based on the projection device 2 in the above embodiment, some embodiments of the present application also provide a projection method, which can be applied to the projection device 2 in the above embodiment. In some embodiments, the method may include the following contents:

[0105] The vertex coordinates of the projection area of ​​the projection device 2 are obtained, and the optomechanical image in the light output component 200 and the optomechanical image coordinates corresponding to the optomechanical image are obtained.

[0106] In some embodiments, after the image acquisition device 700 captures the projection content image, the projection device 2 can obtain the projection content image and detect the medium existence state of the projection medium according to the projection content image, wherein the medium existence state may include the medium existence state and the medium non-existence state. Then, the following judgment can be made. In response to the medium existence state being the medium existence state, the projection device 2 can control the light output component 200 to project the playback content to the projection medium according to the target optical machine image coordinates. The specific projection method will be described in detail later. In response to the medium existence state being the medium non-existence state, the projection device 2 can generate a correction instruction and correct the position of the projection device 2 according to the correction instruction.

[0107] The projection device 2 calculates the homography matrix of the target image coordinates and the optomechanical image coordinates according to the vertex coordinates and the optomechanical image coordinates; the target image is the projection content image captured after adding a white border to the projection area.

[0108] After obtaining the vertex coordinates of the projection area and the optomechanical image coordinates corresponding to the optomechanical image in step S1, the projection device 2 can calculate the homography matrix of the target image coordinates and the optomechanical image coordinates according to the vertex coordinates and the optomechanical image coordinates. The target image is the projection content image captured after adding a white border to the projection area.

[0109] Exemplarily, when calculating the homography matrix of the target image coordinates and the optomechanical image coordinates, the correspondence between the target image coordinates and the optomechanical image coordinates may be calculated based on the coordinates of the four vertices of the white border and the coordinates of the four vertices of the optomechanical image.

[0110] The projection device 2 obtains the corner point coordinates of the corner points of the projection medium covered by the projection area.

[0111] Before calculating the homography matrix of the target image coordinates and the optical-mechanical image coordinates, the projection device 2 can also perform the function of corner point detection. First, the projection device 2 can obtain the target image taken after adding a white border to the projection area, and then analyze the target image to identify the projection area and the projection medium area in the target image, and finally output the vertex coordinates of the projection area and the corner point coordinates of the projection medium area based on the artificial intelligence algorithm.

[0112] The projection device 2 calculates the target optical-mechanical image coordinates corresponding to the corner points of the projection medium in the light output component 200 according to the homography matrix and the corner point coordinates.

[0113] After the homography matrix and the corner point coordinates of the projection medium are calculated, the projection device 2 can calculate the target optical-mechanical image coordinates corresponding to the corner points of the projection medium in the light output component 200 according to the homography matrix and the corner point coordinates. When calculating the target optical-mechanical image coordinates, the projection device 2 can first obtain the corner point coordinates and the optical-mechanical image coordinates, then homograph the corner point coordinates to the optical-mechanical image coordinates, generate a mapping transformation relationship, and then calculate the target optical-mechanical image coordinates corresponding to the four corner points of the projection medium in the light output component according to the mapping transformation relationship.

[0114] The projection device 2 controls the light output component 200 to project the playback content onto the projection medium according to the target optical-mechanical image coordinates.

[0115] After the target optical-mechanical image coordinates are calculated, the projection device 2 can control the light-emitting component 200 to project the playback content to the projection medium according to the target optical-mechanical image coordinates. First, the projection device 2 can traverse the target optical-mechanical image coordinates, and then determine the target projection position according to the target optical-mechanical image coordinates, and determine the area composed of the target projection position as the target screen entry area of ​​the projection medium, and finally execute the screen entry of the projection device according to the target screen entry area. Still taking the projection medium as a curtain as an example, that is to say, the area composed of the target optical-mechanical image coordinates is the area of ​​the curtain 21.

[0116] It can be seen from the above technical solution that the above embodiment provides a projection method, which can combine the white border function to quickly and accurately identify the corner points of the blocked part and perform the screen entry function. Not only is the screen entry speed fast and applicable to conventional projection media, but it is also applicable to unconventional projection media. Therefore, it can improve the screen entry speed, improve the adaptability to different projection media, and improve the success rate of screen entry in complex scenes, solving the problem of slow automatic screen entry speed, screen entry failure or inaccurate screen entry of the projection device.

[0117] The same and similar parts between the various embodiments in this specification can be referenced to each other and will not be described again here.

[0118] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of various embodiments of the present invention or certain parts of the embodiments.

[0119] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0120] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A projection device, characterized in that: include: A light emitting component is configured to project the playback content onto a projection medium; An image acquisition device, configured to capture an image of the projection content; The controller is configured as: Acquire the vertex coordinates of the projection area of ​​the projection device, and acquire the optomechanical image in the light output component and the optomechanical image coordinates corresponding to the optomechanical image; Calculate the homography matrix of the target image coordinates and the optomechanical image coordinates according to the vertex coordinates and the optomechanical image coordinates; the target image is a projection content image taken after adding a white border to the projection area; Obtaining the coordinates of the corner points of the projection medium covered by the projection area; Calculate the target optical-mechanical image coordinates corresponding to the corner points of the projection medium in the light output component according to the homography matrix and the corner point coordinates; The light emitting component is controlled to project the playback content onto a projection medium according to the target optical-mechanical image coordinates.

2. The projection device according to claim 1, characterized in that: The controller is further configured to: Acquire the projection content image; Detecting a medium presence state of a projection medium according to the projection content image, wherein the medium presence state includes a medium presence state and a medium absence state; In response to the medium existence state being the medium existence state, controlling the light output component to project the playback content onto the projection medium according to the target optical-mechanical image coordinates; In response to the medium presence state being the medium absence state, a correction instruction is generated, and the position of the projection device is corrected according to the correction instruction.

3. The projection device according to claim 2, characterized in that: The controller is further configured to: identifying a projection medium in the projection area; If the projection medium exists in the projection area, a white border is added to the projection area, and the image acquisition device is controlled to capture a target image containing the white border.

4. The projection device according to claim 3, characterized in that: The controller is further configured to: Acquire the target image; parsing the target image to identify the projection area and the projection medium area in the target image; The vertex coordinates of the projection area and the corner point coordinates of the projection medium area are output based on an artificial intelligence algorithm.

5. The projection device according to claim 3, characterized in that: The controller is further configured to: Detecting the shooting status of the target image; the shooting status includes a shooting completed state and a shooting incomplete state; In response to the shooting status being the shooting completion status, deleting the white border; In response to the shooting status being the shooting incomplete state, the white frame is retained.

6. The projection device according to claim 4, characterized in that: The controller is further configured to: Detecting the positional relationship between the coordinates of four corner points of the projection medium area and the coordinates of four vertices of the projection area; the positional relationship includes the relationship that the corner point is inside the vertex and the relationship that the corner point is not inside the vertex; If the positional relationship is a relationship in which the corner point is inside a vertex, controlling the light emitting component to project the playback content onto a projection medium according to the target optical-mechanical image coordinates; If the positional relationship is that the corner point is not inside the vertex, a device movement instruction is generated to enable the projection device to move the position of the projection device according to the device movement instruction.

7. The projection device according to claim 6, characterized in that: The controller performs the step of calculating the target optical-mechanical image coordinates corresponding to the corner points of the projection medium in the light output component according to the homography matrix and the corner point coordinates, and is further configured as follows: Obtaining the corner point coordinates and the optical-mechanical image coordinates; Homographing the corner point coordinates to the optical-mechanical image coordinates to generate a mapping transformation relationship; The target optical-mechanical image coordinates corresponding to the four corner points of the projection medium in the light output component are calculated according to the mapping transformation relationship.

8. The projection device according to claim 1, characterized in that: The controller is further configured to: Traversing the target optical-mechanical image coordinates; Determine the target projection position according to the target optical-mechanical image coordinates; Determine the area formed by the target projection positions as the target screen entry area of ​​the projection medium; The projection device is executed to enter the screen according to the target entry screen area.

9. The projection device according to claim 1, characterized in that: The controller is further configured to: receiving a curtain entry instruction for curtain entry; In response to the screen entry instruction, identifying a closed rectangular area in the target image; Receive the entry method of the entry; Based on an artificial intelligence algorithm, the light emitting component is controlled to project the playback content onto the closed rectangular area according to the screen entry method.

10. A projection method, applied to the projection device according to any one of claims 1 to 9, wherein the projection device comprises a light output component, an image acquisition device and a controller, wherein: The projection method comprises: Acquire the vertex coordinates of the projection area of ​​the projection device, and acquire the optomechanical image in the light output component and the optomechanical image coordinates corresponding to the optomechanical image; Calculate the homography matrix of the target image coordinates and the optomechanical image coordinates according to the vertex coordinates and the optomechanical image coordinates; the target image is a projection content image taken after adding a white border to the projection area; Obtaining the coordinates of the corner points of the projection medium covered by the projection area; Calculate the target optical-mechanical image coordinates corresponding to the corner points of the projection medium in the light output component according to the homography matrix and the corner point coordinates; The light emitting component is controlled to project the playback content onto a projection medium according to the target optical-mechanical image coordinates.

Images