Projection device and projection control method

Abstract

Some embodiments of the present application provide a projection device and a projection control method. In the projection process, the projection device can detect the projected picture content to determine the valid content area and the invalid content area in the picture content. When the picture content includes the valid content area and the invalid content area, the projection device can convert the coordinates of the valid content area to the spatial coordinates, and detect the intersection of the human body area and the valid content area under the spatial coordinates. Based on detecting that the human body area and the valid content area under the spatial coordinates exist intersection, the anti-eye shooting process is executed. Based on detecting that the human body area and the valid content area under the spatial coordinates do not exist intersection, the anti-eye shooting process is not executed. Thus, when the user does not enter the valid content area, the projection device will not always interrupt the projection process, so as to improve the user's viewing experience.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of projection equipment, and in particular to a projection equipment and a projection control method. BACKGROUND

[0002] The projection equipment is a display equipment that can project an image or a video onto a screen. The projection equipment can project laser light of a specific color through the refraction of an optical lens assembly to a projection area and form a specific image. Based on the portability of the projection equipment, a user can move the projection equipment during projection to project the image or the video to different directions.

[0003] The projection equipment can project picture content into a projection surface for a user to view the picture content. During projection, the user can enter a light source emission area of the projection equipment, causing the projection light source of the projection equipment to directly shine into the user's eyes and cause harm to the user's eyes. Therefore, the projection equipment is provided with an anti-eye-shooting function. When a human body is detected in the light source emission area, the projection equipment can turn off the light source until no human body is detected in the light source emission area, and then turn on the light source, to protect the user in the light source emission area.

[0004] However, in some special scenarios such as a projection scenario, the size of the light source emission area and the effective image content in the picture content can be different, that is, only part of the area in the light source emission area displays effective content. When the user enters the light source emission area but does not enter the effective content area, the projection light source does not cause harm to the user's eyes at this time, but the projection equipment still triggers the anti-eye-shooting function, causing the viewing process of other users to be interrupted and affecting the viewing experience of the users. SUMMARY

[0005] The present application provides a projection equipment and a projection control method to solve the problem that in the related art, when a user enters a light source emission area but does not enter an effective content area, a projection equipment triggers an anti-eye-shooting function, causing the viewing process of the user to be interrupted.

[0006] In a first aspect, some embodiments of the present application provide a projection equipment, comprising an out-light assembly, an image acquisition device, and a controller. The out-light assembly is configured to project picture content to a projection surface; the image acquisition device is configured to acquire a target image of the projection surface; and the controller is configured to:

[0007] In a case where the picture content includes an effective content area and an ineffective content area detected by a first image detection algorithm, the coordinates of the effective content area are converted to spatial coordinates; wherein the gray value or pixel value of the continuous row and / or continuous column pixel points in the ineffective content area is the same, and the gray value or pixel value of the pixel points is lower than a first threshold value;

[0008] if the first human body detection algorithm detects that the human body region and the effective content region under the spatial coordinates in the target image have an intersection, an anti-eye shooting process is performed;

[0009] if the first human body detection algorithm detects that the human body region and the effective content region under the spatial coordinates in the target image have no intersection, the anti-eye shooting process is not performed.

[0010] The above technical solution has the following beneficial effects: During the projection process of the projection device, the projected picture content can be detected to determine the effective content region and the ineffective content region in the picture content. When the picture content includes the effective content region and the ineffective content region, the projection device can convert the coordinates of the effective content region to the spatial coordinates, and detect the intersection of the human body region and the effective content region under the spatial coordinates. If it is detected that the human body region and the effective content region under the spatial coordinates have an intersection, the anti-eye shooting process is performed. If it is detected that the human body region and the effective content region under the spatial coordinates have no intersection, the anti-eye shooting process is not performed. Thus, when the user does not enter the effective content region, the projection device will not be interrupted during the projection process, thereby improving the user's viewing experience.

[0011] In some embodiments, before the controller converts the coordinates of the effective content region to the spatial coordinates in the case where the picture content includes the effective content region and the ineffective content region detected by the first image detection algorithm, the controller is further configured to:

[0012] detect the gray value or pixel value of the pixel point in the picture content;

[0013] if it is detected that the gray value or pixel value of at least a first number of consecutive rows and / or at least a first number of consecutive columns of pixel points is the same, and the gray value or pixel value of the pixel point is lower than a first threshold value, mark the at least first number of consecutive rows and / or at least first number of consecutive columns of pixel points as the ineffective content region;

[0014] mark the region other than the ineffective content region in the picture content as the effective content region.

[0015] The above technical solution has the following beneficial effects: The black border detection process is performed on the picture content to detect the ineffective content region and the effective content region.

[0016] In some embodiments, based on the detection that the picture content does not include the ineffective content region, the controller is further configured to:

[0017] convert the coordinates of the picture content to the spatial coordinates;

[0018] if it is detected that the human body region and the picture content under the spatial coordinates in the target image have an intersection, an anti-eye shooting process is performed;

[0019] If it is detected that the human region in the target image and the picture content under the spatial coordinates have no intersection, the anti-eye shooting process is not performed.

[0020] The above technical solution has the following beneficial effects: the picture content is all effective content region, and whether the anti-eye shooting is performed is determined by detecting whether the user enters the picture content.

[0021] In some embodiments, the spatial coordinates include first spatial coordinates under a first coordinate system corresponding to the image acquisition device. After the controller performs the coordinate conversion of the effective content region to the spatial coordinates, the controller is further configured to:

[0022] Performing image binarization processing on the target image to obtain a binarized image;

[0023] Detecting a human region in the binarized image;

[0024] Based on the detection that there is no human region in the binarized image, it is marked that there is no intersection between the human region in the target image and the effective content region under the first spatial coordinates;

[0025] Based on the detection that there is a human region in the binarized image, first position information of the human region is obtained; and based on the first position information and the first spatial coordinates, intersection conditions of the human region in the target image and the effective content region under the first spatial coordinates are detected.

[0026] The above technical solution has the following beneficial effects: by performing binarization and contour detection on the image, the user region in the image is determined, so as to detect whether the user enters the effective content region.

[0027] In some embodiments, a distance sensor is further included, configured to acquire a distance image of the projection surface; and the spatial coordinates further include second spatial coordinates under a second coordinate system corresponding to the distance sensor.

[0028] After the controller performs the coordinate conversion of the effective content region to the spatial coordinates, the controller is further configured to:

[0029] Detecting intersection conditions of the human region in the distance image and the effective content region under the second spatial coordinates;

[0030] Based on the detection that the human region in the target image and the effective content region under the first spatial coordinates have intersection, and / or the human region in the distance image and the effective content region under the second spatial coordinates have intersection, the anti-eye shooting process is performed.

[0031] based on detecting that there is no intersection between the human body region in the target image and the valid content region under the first spatial coordinate, and there is no intersection between the human body region in the distance image and the valid content region under the second spatial coordinate, the anti-eye shooting process is not executed.

[0032] In some embodiments, the distance sensor is configured to detect a separation distance between the projection device and the user.

[0033] based on detecting that there is no intersection between the human body region in the target image and the valid content region under the first spatial coordinate, the controller is further configured to:

[0034] detect an intersection between the human body region in the distance image and the valid content region under the second spatial coordinate;

[0035] based on detecting that there is no intersection between the human body region in the distance image and the valid content region under the second spatial coordinate, the anti-eye shooting process is not executed.

[0036] based on detecting that there is an intersection between the human body region in the distance image and the valid content region under the second spatial coordinate, the separation distance is obtained.

[0037] if the separation distance is less than or equal to a distance threshold, the anti-eye shooting process is executed; if the separation distance is greater than the distance threshold, the anti-eye shooting process is not executed.

[0038] The above technical solution has the following beneficial effects: a distance threshold is set in advance to determine the detection reliability of the distance sensor. When the object distance is greater than the distance threshold, it is considered that the distance sensor has not detected the user.

[0039] In some embodiments, the controller that detects the intersection between the human body region in the distance image and the valid content region under the second spatial coordinate is specifically configured to:

[0040] obtain an initial distance image; the initial distance image is a distance image collected by the distance sensor after the projection device is powered on;

[0041] perform background frame difference processing on the distance image collected by the distance sensor and the initial distance image to obtain a foreground image;

[0042] detect a human body region in the foreground image;

[0043] based on detecting that there is no human body region in the foreground image, it is marked that there is no intersection between the human body region in the distance image and the valid content region under the second spatial coordinate.

[0044] Based on detecting that there is a human body region in the foreground image, second position information of the human body region is acquired, and intersection of the human body region and an effective content region under the second spatial coordinate in the distance image is detected according to the second position information.

[0045] The technical solution has the beneficial effects that: by performing background frame difference processing on two distance images, whether a user enters a detection range of a distance sensor compared with an initial state is detected, so as to detect whether the user enters an effective content region.

[0046] In some embodiments, the controller is further configured to:

[0047] Detect a projection mode of the projection device;

[0048] If the projection mode is a screen projection mode, the step of detecting the gray value or pixel value of the pixel point in the picture content is performed.

[0049] The technical solution has the beneficial effects that: the projection device detects the effective content region and the ineffective content region of the projection region in the screen projection mode, so that the anti-eye shooting function is adaptively started according to the effective picture content

[0050] In a second aspect, some embodiments of the present application provide a projection control method applied to the projection device, and the method comprises:

[0051] In a case where the picture content includes the effective content region and the ineffective content region detected by the first image detection algorithm, coordinates of the effective content region are converted to spatial coordinates; wherein the gray value or pixel value of the continuous row and / or continuous column pixel points in the ineffective content region is the same, and the gray value or pixel value of the pixel points is lower than a first threshold value;

[0052] Based on the first human body detection algorithm detecting that there is intersection between the human body region in the target image collected by the image collection device and the effective content region under the spatial coordinate, an anti-eye shooting process is performed;

[0053] Based on the first human body detection algorithm detecting that there is no intersection between the human body region in the target image and the effective content region under the spatial coordinate, the anti-eye shooting process is not performed. BRIEF DESCRIPTION OF DRAWINGS

[0054] In order to more clearly illustrate the technical solutions of the present application, the drawings needed in the embodiments will be briefly introduced as follows: obviously, other drawings can also be obtained by those skilled in the art without creative labor.

[0055] Figure 1 A projection scene schematic diagram of the projection device in some embodiments is shown.

[0056] Figure 2 A light path schematic diagram of the projection device in some embodiments is shown.

[0057] Figure 3 A circuit architecture schematic diagram of the projection device provided by some embodiments is shown.

[0058] Figure 4 A structure schematic diagram of the projection device provided by some embodiments is shown.

[0059] Figure 5 A lens structure schematic diagram of the projection device provided by some embodiments is shown.

[0060] Figure 6 A distance sensor and image acquisition device structure schematic diagram of the projection device provided by some embodiments is shown.

[0061] Figure 7 A system framework schematic diagram of the projection device implementing display control provided by some embodiments is shown.

[0062] Figure 8 A schematic diagram of the effective content area in some embodiments is shown.

[0063] Figure 9 An interaction flowchart of the components of the projection device in some embodiments is shown.

[0064] Figure 10 A schematic diagram of the checkerboard graph card in some embodiments is shown.

[0065] Figure 11 A schematic diagram of the circular ring graph card in some embodiments is shown.

[0066] Figure 12 A flowchart of obtaining the mapping relationship in some embodiments is shown.

[0067] Figure 13 A schematic diagram of the user area and the projection area in some embodiments is shown.

[0068] Figure 14 A schematic diagram of the user area and the projection area in some embodiments is shown.

[0069] Figure 15 A schematic diagram of the user area and the projection area in some embodiments is shown. DETAILED DESCRIPTION

[0070] Embodiments will be described in detail below with reference to examples illustrated in the accompanying drawings. When the description below refers to the drawings, unless otherwise noted, like numbers in different drawings refer to like or similar elements. The embodiments described in the following examples do not represent all of the implementations consistent with the present application. Rather, they are merely examples of systems and methods consistent with some aspects of the present application as detailed in the appended claims.

[0071] It should be noted that the brief description of terms in the present application is only for the convenience of understanding the following described embodiments, and is not intended to limit the embodiments of the present application. Unless otherwise specified, these terms should be understood according to their ordinary and common meanings.

[0072] The terms "first", "second", "third", and the like in the specification and claims of the present application and the above-described drawings are used to distinguish similar or like objects or entities, and do not necessarily mean a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchanged under appropriate circumstances.

[0073] The terms "include" and "have" and any variations thereof are intended to cover but not exclusive inclusion, for example, a product or device including a series of components does not necessarily limit to all components clearly listed, but can include other components not clearly listed or inherent to these products or devices.

[0074] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or / and software code capable of performing a function associated with that element.

[0075] Embodiments of the present application can be applied to various types of projection devices. The projection device is a projection device that can project an image or video onto a screen. The projection device can project a specific color of laser light through the refraction of the optical assembly to form a specific image on the screen. During the projection process, a certain distance can be maintained between the projection device and the screen, so that the image formed on the screen can conform to the focal length range of the optical assembly to obtain a clear image. In the following, a projector will be taken as an example to describe the projection device and the projection control method.

[0076] The projector can be connected to a computer, a broadcast network, the Internet, a VCD (Video Compact Disc), a DVD (Digital Versatile Disc Recordable), a game console, a DV, etc. through different interfaces to play corresponding video signals. The projector is widely used in homes, offices, schools and entertainment places, etc.

[0077] Figure 1Schematic diagrams of projection scenarios using projection devices in some embodiments are shown. For example... Figure 1 As shown, the projection scenario provided in this application includes a projection screen 1 and a projection device 2. The projection screen 1 is fixed at a first position on the projection surface; for example, a wall can be used as the projection surface, and a screen can be fixed at the first position on the projection surface. The projection device 2 is placed at a second position so that the image it projects matches the projection screen 1.

[0078] Figure 2 A schematic diagram of the optical path of a projection device in some embodiments is shown. For example... Figure 2 As shown, the projection device 2 includes a light source 100, an optical engine 200, and a lens 300. The light source 100 provides illumination to the optical engine 200, which modulates the light beam and outputs it to the lens 300 for imaging, projecting it onto the projection surface 400 to form a projected image. Since the light source 100, optical engine 200, and lens 300 are used together to emit projection light to project the image, in some embodiments of this application, the light source 100, optical engine 200, and lens 300 are collectively referred to as the light-emitting assembly.

[0079] In some embodiments, the light source 100 of the projection device 2 includes a light emitter assembly 110 and an optical lens assembly 120. The light beam emitted by the light emitter assembly 110 can pass through the optical lens assembly 120 to provide illumination for the optical engine 200.

[0080] It should be noted that in the embodiments of this application, the light source 100 can be a laser light source, an LED light source, or a Liquid Crystal Display (LCD) light source; this application does not specifically limit this. For example, taking the light source 100 as a laser light source, in some embodiments, the optical engine 200 of the projection device 2 can be implemented to include a blue optical engine, a green optical engine, a red optical engine, and may also include a heat dissipation system, a circuit control system, etc.

[0081] Figure 3 A schematic diagram of the circuit architecture of a projection device provided in some embodiments is shown. For example... Figure 3 As shown, the projection device 2 may include a display control circuit 10, a light source 100, at least one light driving component 30, and at least one brightness sensor 40. Taking the light source 100 as a laser light source as an example, when the light source 100 is a laser light source, the light source 100 may include at least one laser corresponding to at least one light driving component 30.

[0082] Based on this circuit architecture, the projection device 2 can achieve adaptive adjustment. For example, by setting a brightness sensor 40 in the light output path of the light source 100, the brightness sensor 40 can detect the first brightness value of the laser light source and send the first brightness value to the display control circuit 10.

[0083] The display control circuit 10 can acquire the second brightness value corresponding to the driving current of each laser, and determine that the laser has a COD fault when the difference between the second brightness value and the first brightness value of the laser is greater than the difference threshold. Then the display control circuit can adjust the current control signal of the corresponding laser driving component until the difference is less than or equal to the difference threshold, thereby eliminating the COD fault of the blue laser. The projection device 2 can eliminate the COD fault of the laser in a timely manner, reduce the damage rate of the laser, and improve the image display effect of the projection device 2.

[0084] Figure 4 Schematic diagrams of projection devices provided in some embodiments are shown. For example... Figure 4 As shown, taking the light source 100 in the projection device 2 as a laser light source as an example, the laser light source may include independently configured blue laser 101, red laser 102, and green laser 103. The projection device 2 can also be called a three-color projection device. The blue laser 101, red laser 102, and green laser 103 are all modular lightweight (Mirai Console Loader, MCL) packaged lasers, which are small in size and facilitate compact optical path arrangement. It is understood that the above description uses the light source 100 as an example of a laser light source, and does not limit the light source 100 to a laser light source; it can also be an LED light source, an LCD light source, or other forms of light source.

[0085] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM (random access memory), ROM (read-only memory), a first to an nth interface for input / output, a communication bus, etc.

[0086] In some embodiments, after the projection device 2 is started, it can directly enter the display interface of the previously selected signal source or the signal source selection interface. The signal source can be a preset video-on-demand program, or at least one of an HDMI interface, a live TV interface, etc. After the user selects different signal sources, the projector can display content obtained from different signal sources.

[0087] In some embodiments, the projection device 2 can be configured with an image acquisition device 700, such as a camera, to work in conjunction with the projection device 2 to achieve the adjustment control of the projection process. For example, the camera configured by the projection device 2 can be implemented as a 3D camera, or a binocular camera; when the camera is implemented as a binocular camera, it specifically includes a left camera and a right camera; the binocular camera can obtain the image and the playing content presented by the projection medium corresponding to the projection device 2, such as the screen, i.e. the projection surface 400, which is projected by the optical engine 200 built in the projection device 2.

[0088] The image acquisition device can be used to capture the image displayed on the projection surface 400, and can be a camera. The camera can include a lens assembly, and the lens assembly is provided with a photosensitive element and a lens. The lens can make the light of the image of the scene be able to irradiate on the photosensitive element through the refraction of a plurality of lenses.

[0089] Figure 5 The lens structure schematic diagram of the projection device provided by some embodiments is shown. In order to support the automatic focusing process of the projection device 2, as shown in Figure 5 The lens 300 of the projection device 2 can also include an optical assembly 310 and a driving motor 320. The optical assembly 310 is a lens group composed of one or more lenses, which can refract the light emitted by the optical engine 200, so that the light emitted by the optical engine 200 can be transmitted to the projection surface 400 to form a transmitted content image.

[0090] The optical assembly 310 can include a lens barrel and a plurality of lenses arranged in the lens barrel. According to whether the position of the lens can be moved, the lenses in the optical assembly 310 can be divided into moving lenses 311 and fixed lenses 312. By changing the position of the moving lenses 311, the distance between the moving lenses 311 and the fixed lenses 312 is adjusted, and the overall focal length of the optical assembly 310 is changed. Therefore, the driving motor 320 can drive the moving lenses 311 to move by connecting the moving lenses 311 in the optical assembly 310, so as to realize the automatic focusing function.

[0091] It should be noted that the focusing process described in some embodiments of the present application refers to changing the position of the moving lenses 311 by the driving motor 320, so as to adjust the distance between the moving lenses 311 and the fixed lenses 312, i.e. adjust the image plane position, and therefore the imaging principle of the lens combination in the optical assembly 310. The adjustment of the focal length is actually the adjustment of the image distance, but in terms of the overall structure of the optical assembly 310, adjusting the position of the moving lenses 311 is equivalent to adjusting the overall focal length of the optical assembly 310.

[0092] When the projection device 2 is at different distances from the projection surface 400, the lens of the projection device 2 needs to adjust different focal lengths to transmit clear images on the projection surface 400. During the projection process, the interval distance between the projection device 2 and the projection surface 400 needs to be different due to the different placement positions of the user, and different focal lengths are required. Therefore, in order to adapt to different use scenarios, the projection device 2 needs to adjust the focal length of the optical assembly 310.

[0093] Figure 6 The distance sensor and image acquisition device structure of the projection device provided by some embodiments are shown. As shown in Figure 6 The projection device 2 can also be built-in or externally connected with the image acquisition device 700, which can be a camera and can capture images of the picture content projected by the projection device 2 to obtain picture content images. The projection device can determine whether the current lens focal length is appropriate by detecting the clarity of the projected content image, and adjust the focal length when it is not appropriate. When automatic focusing is based on the picture content image captured by the camera 700, the projection device can continuously adjust the lens position and take pictures, and find the focusing position by comparing the clarity of the front and rear position pictures, so as to adjust the moving mirror 311 in the optical assembly to the appropriate position. For example, the controller 500 can first control the driving motor 320 to gradually move the moving mirror 311 from the focusing start position to the focusing end position, and continuously acquire picture content images by the camera during this period. Then, the clarity of a plurality of picture content images is detected to determine the position with the highest clarity, and finally the driving motor 320 is controlled to adjust the moving mirror 311 from the focusing end to the position with the highest clarity, and the automatic focusing is completed.

[0094] The distance sensor 600 can be a sensor device based on the Time of Flight (TOF) principle, such as a laser radar, an infrared radar, etc., which can detect the target distance, and can detect the interval distance between the projection surface 400 and the light machine 200. The distance sensor 600 can be arranged at the position of the light machine 200, including a signal transmitting end and a receiving end. During the interval distance detection process, the transmitting end of the distance sensor 600 can emit a wireless signal in the direction of the projection surface, and the wireless signal will be reflected back to the receiving end of the distance sensor 600 after contacting the projection surface, so as to calculate the signal flight time according to the time when the signal is emitted by the transmitting end and the time when the signal is received by the receiving end, and then the actual flight distance of the wireless signal can be obtained by combining the flight speed.

[0095] Figure 7 The system framework diagram for implementing display control of the projection device provided by some embodiments is shown. As shown in Figure 7As shown, the projection device 2 has the characteristics of long-focus micro projection, and the controller can control the display of the projected light image through a preset algorithm to realize functions such as automatic trapezoidal correction, automatic entering, automatic obstacle avoidance, automatic focusing, and anti-eye shooting.

[0096] In some embodiments, the projection device 2 is configured with a gyroscope sensor; during movement, the gyroscope sensor can sense the position movement and actively collect movement data; then the collected data is sent to the application service layer through the system framework layer, supporting the application data required in the user interface interaction and application interaction process, and the collected data can also be used for data calling of the controller in the algorithm service implementation.

[0097] In some embodiments, the projection device 2 is configured with a time-of-flight sensor, and after the time-of-flight sensor collects corresponding data, the data will be sent to the corresponding time-of-flight service in the service layer; after the time-of-flight service obtains the data, the collected data will be sent to the application service layer through the process communication framework, and the data will be used for data calling of the controller, user interface, program application, etc.

[0098] In some embodiments, the image acquisition device 700 configured in the projection device 2 can be a binocular camera, a depth camera, or a 3D camera, etc.; the image acquisition device 700 collects data and sends it to the camera service, and then the camera service sends the collected image data to the process communication framework and / or the projection device correction service; the projection device correction service can receive the camera collected data sent by the camera service, and the controller can call the corresponding control algorithm in the algorithm library for different functions to be implemented.

[0099] In some embodiments, data interaction is performed between the process communication framework and the application service, and then the calculation result is fed back to the correction service through the process communication framework; the correction service sends the obtained calculation result to the operating system of the projection device 2 to generate control signaling, and sends the control signaling to the optical engine 200 control driver to control the working condition of the optical engine 200 and realize automatic correction of the display image.

[0100] In some embodiments, when an image correction instruction is detected, the projection device 2 can correct the projected image. For the correction of the projected image, a correlation between the distance, the horizontal included angle, and the offset angle can be created in advance. Then the controller in the projection device 2 determines the included angle between the optical engine 200 and the projection surface 400 at this moment by obtaining the current distance from the optical engine 200 to the projection surface 400, in combination with the correlation, to realize the correction of the projected image. The included angle is specifically the included angle between the axis in the optical engine 200 and the projection surface 400.

[0101] In some embodiments, the projection device 2 automatically completes the correction and refocuses, and the controller detects whether the automatic focusing function is turned on; when the automatic focusing function is not turned on, the controller ends the automatic focusing service; when the automatic focusing function is turned on, the projection device 2 obtains the detection distance of the time-of-flight sensor through the middleware for calculation.

[0102] The controller queries a preset mapping table according to the obtained distance to obtain the focal length of the projection device 2; then the middleware sets the focal length to the optical engine 200 of the projection device 2; wherein the middleware is a series of application programs related to the focusing control process. After the optical engine 200 emits laser light at the above-mentioned focal length, the camera will execute the photographing instruction; the controller determines whether the focusing process of the projection device 2 is completed according to the obtained photographed image and the evaluation function.

[0103] If the determination result meets the preset completion condition, the automatic focusing process is ended; if the determination result does not meet the preset completion condition, the middleware fine-tunes the focal length parameter of the optical engine 200 of the projection device 2, for example, the focal length can be gradually fine-tuned at a preset step, and the adjusted focal length parameter is set to the optical engine 200 again; thereby realizing repeated photographing, clarity evaluation steps, and finally finding the optimal focal length through clarity comparison to complete the automatic focusing.

[0104] In some embodiments, the projection device 2 can project the picture content into the projection surface for the user to watch the picture content. For example, the user can pre-set the picture content, such as media images, and the user can control the projection device 2 to project the media images, and the projection device 2 can project the media images into the projection surface, which can be a curtain or a wall surface in front of the projection device 2, etc.

[0105] When there is an obstacle between the projection device 2 and the projection surface, the content projected by the projection device 2 can be blocked by the obstruction, resulting in that the complete image cannot be displayed in the projection surface, which seriously affects the user's viewing experience. Therefore, in order to ensure that the complete image can be displayed in the projection surface, it is necessary to ensure that there is no obstruction between the projection device 2 and the projection surface.

[0106] The obstruction can be a fixedly placed article, for example, other articles placed on the desktop by the user or articles between the desktop and the projection surface, which can block the light source of the projection device 2, and the user needs to move these articles. The obstruction can also be a user, for example, there can be a user passing through the area between the projection device 2 and the projection surface during the projection process, thereby entering the light source emission area of the projection device 2, and thereby blocking the image projected by the projection device 2.

[0107] It should be noted that when the user enters the light source emission area of the projection device 2, the projection light source of the projection device 2 can directly irradiate the user's eyes, and the high-power projection light source can cause damage to the user's eyes. Therefore, the projection device 2 can be provided with an anti-eye shooting function to protect the user's eyes.

[0108] During the projection process, the projection device 2 can perform human body detection on the projection area. The projection device 2 can take a photo of the projection area through the camera, perform human body target detection according to the image data collected by the camera, and determine whether there is a human body target intrusion in the light source emission area between the projection surface and the projection device 2. When there is a human body target intrusion, the projection device 2 can start the anti-eye shooting function, and when there is no human body target intrusion, the projection device 2 can close the anti-eye shooting function. The anti-eye shooting function can turn off the operation of the light source of the light emitting component. Until it is detected that there is no human body in the light source emission area, the projection device 2 can close the anti-eye shooting function, thereby protecting the user in the light source emission area

[0109] It should be noted that in some special scenarios such as a projection scenario, the projection device can receive a projection image sent by another device and project it into the projection area. However, the projection image sent by the other device may not be completely valid image content, but may also have invalid content outside the image content, such as a black border area.

[0110] Therefore, in the picture that the projection device needs to project, the size of the valid image content and the light source emission area may be different, that is, only part of the light source emission area on the projection surface displays valid image content. Figure 8 A schematic diagram of the valid content area in some embodiments is shown. As Figure 8 shown, only part of the light source emission area on the projection surface displays image content, which is referred to as a valid content area in the embodiments of the present application, and the other area that does not display valid content is referred to as an invalid content area, and no image content is displayed in the invalid content area. Wherein Y is the valid content area, and W1 and W2 are the invalid content areas.

[0111] When the user enters the invalid content area in the light source emission area but does not enter the valid content area, the projection light source will not cause damage to the user's eyes at this time, but the projection device will still trigger the anti-eye shooting function, and the projection device turns off the light source, causing the projection process to be interrupted. The user who is not in the light source emission area may be watching the picture content, and triggering the anti-eye shooting function will interrupt the watching process of this part of the user, affecting the user's watching experience.

[0112] To this end, the projection device provided in some embodiments of the present application can adaptively protect the user in the light source emission area according to the content of the projected picture. During projection, the projection device can detect the content of the projected picture to determine the valid content area and the invalid content area in the picture content. When the picture content includes the valid content area and the invalid content area, the projection device can convert the coordinates of the valid content area to spatial coordinates and detect the intersection of the human body area and the valid content area in the spatial coordinates. Based on the detection that the human body area and the valid content area in the spatial coordinates have an intersection, the anti-eye shooting process is performed. Based on the detection that the human body area and the valid content area in the spatial coordinates have no intersection, the anti-eye shooting process is not performed. Thus, when the user does not enter the valid content area, the projection device will not interrupt the projection process, thereby improving the user's viewing experience.

[0113] Figure 9 A flowchart showing the interaction of the components of the projection device in some embodiments is shown, including the following steps:

[0114] S901, in the case where the valid content area and the invalid content area are detected in the picture content by the first image detection algorithm, the coordinates of the valid content area are converted to spatial coordinates; wherein the gray scale values or pixel values of the continuous rows and / or continuous columns of pixel points in the invalid content area are the same, and the gray scale values or pixel values of the pixel points are lower than a first threshold value.

[0115] S902, based on the detection by the first human body detection algorithm that the human body area and the valid content area in the spatial coordinates have an intersection in the target image, the anti-eye shooting process is performed.

[0116] Based on the detection by the first human body detection algorithm that the human body area and the valid content area in the spatial coordinates have no intersection in the target image, the anti-eye shooting process is not performed.

[0117] In some embodiments, the user can input a projection instruction to the projection device 2 to instruct the projection device 2 to project the image content set by the user. In the embodiments of the present application, the content specified by the user for the projection device to project is referred to as picture content.

[0118] In response to the projection instruction, the controller of the projection device 2 can control the light emitting assembly to project the picture content to the projection area in the projection surface 400. In the embodiments of the present application, the area in the projection surface 400 displaying the picture content is referred to as the projection area, and the projection area is the light source emission area in the projection surface 400 projected by the projection device 2.

[0119] In some embodiments, the projection area can be a pre-set area. For example, the projection area can be a certain area of a wall or a curtain placed by the user in advance, in which the complete picture content can be displayed for the user to view.

[0120] The user can manually adjust the position and projection angle of the projection device 2 so that the picture content is completely in the projection area, but this manual adjustment is tedious and less accurate. Therefore, the projection device 2 provided by the embodiments of the present application can be provided with an automatic curtain entering function. The automatic curtain entering function means that the projection device 2 can automatically determine the projection area in the projection surface 400 and project the picture content into the projection area, thereby avoiding the user manually adjusting the angle and position of the projection device 2 to improve the user experience.

[0121] When performing the automatic curtain entering, the controller can first construct a conversion matrix of the world coordinate system and the optical-mechanical coordinate system based on the binocular camera, which can represent the homography relationship between the picture content in the projection surface 400 and the playing card played by the optical-mechanical machine. Using the homography relationship can realize any projection conversion between the picture content and the playing card.

[0122] The controller can first control the light-emitting assembly to project a first card into the projection surface 400. The first card can contain a plurality of feature points, so the first image captured by the camera will also contain all the feature points in the first card. The position information of the projection surface 400 can be determined by the feature points. It should be noted that for a plane, when the positions of three points in the plane are determined, the position information of the plane can be determined. Therefore, in order to determine the position information of the projection surface 400, the positions of at least three points in the projection surface 400 need to be determined, that is, at least three feature points need to be included in the first card.

[0123] In some embodiments, the first card can contain a pattern and color feature pre-set by the user. Figure 10 A schematic diagram of a checkerboard card in some embodiments is shown. As shown in Figure 10 The first card can be a checkerboard card, which is set as a black and white checkerboard. The feature points contained in the checkerboard card are the corner points of the rectangles. Figure 11 A schematic diagram of a circular ring card in some embodiments is shown. As shown in Figure 11 The first card can also be set as a circular ring card, and the feature points contained in the circular ring card are the corresponding solid points on the circular rings. In some embodiments, the first card can also be set as a combination of the above two types of patterns, or as other patterns with identifiable feature points.

[0124] Figure 12 A flowchart for obtaining the mapping relationship in some embodiments is shown.

[0125] In some embodiments, the controller can control the camera to capture the first card displayed on the projection surface 400 to obtain a first image, and obtain the position of the feature point in the first image. The camera can be a binocular camera, by which the first card is captured, and one image is captured by the left camera and another image is captured by the right camera.

[0126] The controller can perform image recognition processing on the two images to obtain the first coordinates of the feature point in the image. The first coordinates refer to the coordinate information of the feature point in the image coordinate system corresponding to the first image.

[0127] For the same feature point, its position in the image captured by the left camera and its position in the image captured by the right camera can be different. The coordinates of the feature point in the camera coordinate system of any one of the left and right cameras can be determined by the two positions of the feature point in the two images. In the embodiments of the present application, the second coordinates are used to represent the coordinate information of the feature point in the camera coordinate system.

[0128] According to the position information of the same feature point in the two images captured by the left and right cameras, the controller can obtain the second coordinates of the feature point in the camera coordinate system of any one camera. The controller can convert the second coordinates into third coordinates. In the embodiments of the present application, the third coordinates refer to the coordinate information of the feature point in the optical-mechanical coordinate system.

[0129] It should be noted that the optical-mechanical coordinate system and the camera coordinate system can be converted to each other, so the coordinates of the feature point in the camera coordinate system can be converted to the coordinates in the optical-mechanical coordinate system. According to the extrinsic parameters between the optical-mechanical camera, the conversion relationship between the optical-mechanical coordinate system and the camera coordinate system can be determined, and the third coordinates of the feature point in the optical-mechanical coordinate system are obtained.

[0130] The controller can obtain the projection surface 400 equation of the projection surface 400 in the optical-mechanical coordinate system according to the third coordinates of the feature point in the optical-mechanical coordinate system. The controller can obtain the third coordinates of at least three feature points in the first image in the optical-mechanical coordinate system, and fit the third coordinates to obtain the projection surface 400 equation of the projection surface 400 in the optical-mechanical coordinate system.

[0131] The controller can obtain the conversion matrix of the optical-mechanical coordinate system and the world coordinate system according to the projection surface 400 equation, which represents the projection relationship between the card projected by the optical-mechanical camera and the projection surface 400, so as to realize the conversion of the coordinates of a certain point between the world coordinate system and the optical-mechanical coordinate system.

[0132] For the projection area in the projection surface 400 that has been determined, a coordinate representation of the projection area in the world coordinate system can be determined, and the controller can obtain the position information of the projection area in the optical engine coordinate system according to the conversion matrix, so as to project the image to the projection area.

[0133] In some embodiments, the controller can control the light emitting assembly to project the picture content to the projection area in the projection surface 400. It is considered that in some special cases, for example, in the projection mode, the picture content can not be completely valid image content, and there can be invalid content such as black borders.

[0134] Therefore, the controller can detect the valid content area and the invalid content area in the picture content. It should be noted that all areas of the image projected by the projection device can be valid image content (also referred to as valid content), or only part of the area can display valid content. In the embodiments of the present application, the area displaying valid image content is referred to as a valid content area, and the area not displaying valid content is referred to as an invalid content area.

[0135] In some embodiments, the controller can detect the valid content area and the invalid content area in the picture content by using a first image detection algorithm. The invalid content area can be a black border area, and the pixel points in the invalid content area can all be black pixel points. Therefore, the first image detection algorithm can use a black border detection algorithm.

[0136] Each pixel point in the black border area is black, so the gray value and the pixel value of the pixel point are both values corresponding to black. Therefore, the controller can detect the gray value or the pixel value of the pixel point in the picture content. The pixel value refers to the color value of the pixel point, such as the RGB value.

[0137] When detecting the black border of the picture content, each row of pixel points and each column of pixel points in the picture content can be detected to determine whether each row or each column is in a black border state.

[0138] For the picture content, there can be black borders in the vertical direction on the left and right sides, there can be black borders in the horizontal direction on the top and bottom sides, or both. Therefore, the pixel points in each row and each column can be detected, so that the black border area can be completely detected.

[0139] The controller can detect a row of pixel points and a column of pixel points in the picture content to determine whether each pixel point in the row or the column is black. It should be noted that there can be a certain error in the color of the pixel points in the picture content. A proportion threshold, for example, 95%, can be preset. If the color of the pixel points exceeding the proportion threshold in the row or the column is black, it is considered that all the pixel points in the row or the column are black.

[0140] It should be noted that in the valid content, there can also be a row or a column of pixels that are all black. Therefore, if there is only one row or one column of pixels that are black, it cannot be determined as a black border. A quantity threshold, referred to as a first quantity in the embodiments of the present application, can be set in advance. If more than the first quantity of rows or columns of pixels are black, and these rows or columns are arranged continuously in position, then these continuously arranged rows or columns are considered as a black border region.

[0141] Considering that the black border in the image source when generating the picture content can not be a pure black region, there can be a deviation. A threshold, referred to as a first threshold in the embodiments of the present application, can be set in advance. When the gray value or pixel value of a pixel is lower than the first threshold, it is considered as a black pixel. For example, the black pixel value is (0, 0, 0), and the first threshold corresponding to the pixel value can be set as (10, 10, 10). For the pixel whose pixel value is less than the first threshold, it can be considered as a black pixel.

[0142] Therefore, based on the detection that the gray value or pixel value of at least a first quantity of continuous rows and / or at least a first quantity of continuous columns of pixels is the same, and the gray value or pixel value of the pixel is lower than the first threshold, the controller can mark the at least first quantity of continuous rows and / or at least first quantity of continuous columns of pixels as an invalid content region.

[0143] The controller can mark the region in the picture content other than the invalid content region as a valid content region.

[0144] It should be noted that the picture content can contain both valid content regions and invalid content regions, or all of them can be valid content regions without invalid content regions.

[0145] If no region meeting the above conditions is detected in the picture content, the controller can mark the picture content excluding the invalid content region.

[0146] In some embodiments, the valid content region and the invalid content region can also be detected by methods such as contour detection. The controller can first detect the closed contour region in the picture content.

[0147] The controller can perform a contour detection process on the picture content to obtain at least one closed contour region. The controller can use a preset contour detection algorithm, such as a Sobel algorithm, a Canny edge detection algorithm, or the like. Through the contour detection algorithm, various closed contours in the image can be obtained, which are referred to as closed contour regions in the embodiments of the present application. The contour detection can be performed on the gray value of each pixel point in the image, and the extreme value point of the change in the gray value is determined, and the pixel point corresponding to the extreme value point is the pixel point of the closed contour. After all the extreme value points are counted, the pixel points corresponding to the extreme value points with the same gray value can be determined as a closed contour.

[0148] The gray values of all the pixel points in the invalid content region are the same, and the pixel values of all the pixel points are also the same, which are all black corresponding values. Whether the pixel points are black can be detected through the gray value or the pixel value of the pixel points. A threshold value, referred to as a second threshold value in the embodiments of the present application, can be preset to represent whether the pixel points are invalid content. The second threshold value can include a second gray value threshold and a second pixel value threshold.

[0149] The controller can detect the gray value of the pixel point. If the gray values of all the pixel points in a closed contour region are the same, and the gray values of all the pixel points are lower than the second gray value threshold, it is indicated that all the pixel points in the closed contour region are black pixel points, and therefore the controller can mark the closed contour region as an invalid content region.

[0150] The controller can also detect the pixel value of the pixel point. If the pixel values of all the pixel points in a closed contour region are the same, and the pixel values of all the pixel points are lower than the second pixel value threshold, it is indicated that all the pixel points in the closed contour region are black pixel points, and therefore the controller can mark the closed contour region as an invalid content region.

[0151] The valid content region displays image content. The image content can be a picture of a pure color or an image with various pictures.

[0152] For the valid content with pictures, the gray values or the pixel values of all the pixel points are not completely the same, but there are differences. For the picture of a pure color, the gray values of all the pixel points are the same, and the pixel values of all the pixel points are also the same. It should be noted that when the projection device projects a picture of pure black, it will not harm the user, and therefore the anti-eye shooting function does not need to be performed. Therefore, for the picture of pure black, it can be determined as invalid content.

[0153] For the valid content with a picture, it can contain black pixels, can not contain black pixels, but will contain black pixels other than black. For the picture of other colors other than black, all pixels are not black pixels. Therefore, when a certain number of pixels other than black are present in a closed contour region, it means that the closed contour region contains valid content, and the certain number is referred to as a second number in the embodiment of the application.

[0154] The controller can detect the gray value of the pixel. If the gray value of more than the second number of pixels in a closed contour region is higher than a second gray value threshold, it means that the closed contour region contains valid content, and therefore the controller can mark the closed contour region as a valid content region.

[0155] Alternatively, the controller can detect the pixel value of the pixel. If the pixel value of more than the second number of pixels in a closed contour region is higher than a second pixel value threshold, it means that the closed contour region contains valid content, and therefore the controller can mark the closed contour region as a valid content region.

[0156] It should be noted that the size of each closed contour region can be different, that is, the number of pixels in the closed contour region can be different. Therefore, different closed contour regions can be set with different first numbers. For example, a ratio can be preset, and the controller can detect the number of pixels in the closed contour region and take the product of the number of pixels and the preset ratio as the second number.

[0157] In some embodiments, after detecting that the picture content includes valid content regions and invalid content regions by the first image detection algorithm, the controller can control the light emitting component to project the picture content into the projection region of the projection surface to perform the anti-eye shooting detection.

[0158] After the controller detects the valid content region, the position information of the valid content region, such as coordinates, can be obtained. The controller can detect whether the user enters the valid content region to determine whether the anti-eye shooting function needs to be turned on.

[0159] The controller can collect image data of the projection surface 400 through the image collection device. The controller can control the image collection device to collect image data of the projection surface 400 according to a first collection period. The image collection device can collect image data in real time after the projection device 2 is turned on. In the embodiment of the application, the image collected by the image collection device is referred to as a target image. The image collection device can be a camera, and the image data captured by the camera can be RGB image data, but is not limited to YUV or other formats of data, and is not limited to the size of the resolution.

[0160] It should be noted that the coordinates of the effective content region are coordinates in the light engine coordinate system corresponding to the light engine assembly, i.e., coordinates in the light engine coordinate system. The controller can convert the coordinates of the effective content region into spatial coordinates in a coordinate system corresponding to the image acquisition device, which is referred to as the first coordinate system, i.e., coordinates in the camera coordinate system.

[0161] Through the foregoing description of the conversion matrix, it can be known that the light engine coordinate system and the camera coordinate system can be converted into each other. Therefore, the controller can convert the coordinates of the effective content region in the light engine coordinate system into spatial coordinates in the first coordinate system, which is also referred to as the first spatial coordinates in the embodiments of the present application.

[0162] In some embodiments, the controller can execute a first human body detection algorithm to detect a human body region in the target image and detect intersection conditions of the human body region and the effective content region. The first human body detection algorithm can be a human body contour detection algorithm. The technical solutions of the present application are described by taking a human body target as an example in the embodiments of the present application. It should be understood that the technical solutions provided by the embodiments of the present application are not limited to human body targets, and other targets can also be detected according to actual needs.

[0163] When the human body region in the target image is detected, the controller can first perform image binarization processing on the target image to obtain a binarized image. Image binarization is to set the pixel grayscale value of the image to 0 or 255, so that the entire image presents a clear black and white effect.

[0164] A grayscale value threshold can be pre-set in the projection device 2. The controller can detect each pixel in the target image, and if the grayscale value of the pixel is higher than the grayscale value threshold, the grayscale value of the pixel is updated to 255. If the grayscale value of the pixel is not higher than the grayscale value threshold, the grayscale value of the pixel is updated to 0.

[0165] The controller can detect the human body region in the binarized image. The controller can perform human body contour detection processing on the binarized image, for example, can use a Canny edge detection algorithm to process the binarized image to detect the human body contour in the binarized image. When performing contour detection, the position information of the contour can also be obtained.

[0166] Based on the detection that there is no human body region in the binarized image, it is indicated that there is no user in the target image, and the controller can mark that there is no intersection between the human body region in the target image and the effective content region in the first spatial coordinates.

[0167] Based on detecting that there is a human body region in the binary image, the controller can obtain position information of the human body region, referred to as first position information in the embodiments of the application. The controller can detect intersection conditions of the human body region and the effective content region under the first spatial coordinates in the target image according to the first position information of the human body region and the first spatial coordinates of the effective content region.

[0168] The first position information of the human body region is the coordinates of the human body region, so the controller can detect whether there is the same coordinate between the first spatial coordinates and the first position information. If there is the same coordinate, it means that there is intersection between the human body region and the effective content region under the first spatial coordinates in the target image. If there is no same coordinate, it means that there is no intersection.

[0169] In some embodiments, the first human body detection algorithm can adopt a human body recognition algorithm. The controller can extract image features of the target image and analyze them to determine whether there is a human body in the image. The controller can input the target image into a pre-constructed mask model to detect the target. The mask model is an encoder and decoder based on recognizing the target contour of a pixel point. The encoder and the decoder refer to an image processing process, that is, the original image is encoded into a vector array with abstract features by the encoder, and then the vector array is decoded into another form of image by the decoder.

[0170] Based on the mask model, the target contour in the target image can be recognized, so that the mask image output by the mask model is obtained. The mask image includes a first pixel value and a second pixel value, the first pixel value is used to represent the target, and the second pixel value is used to represent the non-target. The region of the first pixel value is extracted in the mask image to obtain the target mask. For example, the mask image can be a gray-scale image marking the human body target, and the image matrix of the gray-scale image includes two data 0 / 1 or 0 / 255, 0 represents a non-human body target (background), and 1 or 255 represents a human body target. The region of data 1 or 255 is the target mask. The target mask can be recognized and segmented by the encoder and the decoder, so that the human body region is determined.

[0171] For each pixel of the image, it can be determined whether it is a human target, so that when a non-human target such as a chair or clothes enters the projection area, no protection is performed, and only when a human target enters the projection area can protection be performed, and part of the human target (such as a finger, half a face, or the like) entering the projection area can also be detected, thereby protecting the user. It should be noted that the encoder and decoder described in the embodiments of the present application can also be implemented using image feature extraction calculation methods, such as SIFT (Scale Invariant Feature Transform), HOG (Histogram of Oriented Gradients), or the like. Matrix operations using SVM (Support Vector Machine) can also be used. Convolutional neural networks or Transformer calculation methods can also be used. The present application does not make specific limitations in this regard.

[0172] In some embodiments, based on the first human body detection algorithm detecting that the human body region in the target image and the valid content region under the spatial coordinates exist an intersection, the controller can perform the anti-eye shooting process.

[0173] Based on the first human body detection algorithm detecting that the human body region in the target image and the valid content region under the spatial coordinates do not exist an intersection, the controller does not perform the anti-eye shooting process.

[0174] It should be noted that the intersection of the human body region and the valid content region includes two cases: the human body region is in the valid content region but not in the invalid content region, and the human body region is in both the valid content region and the invalid content region.

[0175] Figure 13 A schematic diagram of the human body region and the projection region in some embodiments is shown. As shown in Figure 13 , a part of the human body region T is in the valid content region, and another part is in the invalid content region.

[0176] Figure 14 A schematic diagram of the human body region and the projection region in some embodiments is shown. As shown in Figure 14 , the human body region T is entirely in the valid content region.

[0177] For the above two cases, the controller performs the anti-eye shooting process.

[0178] If the human body region and the valid content region do not exist an intersection, and the human body region and the invalid content region exist an intersection, it indicates that the user enters the invalid content region but does not enter the valid content region. Figure 15 A schematic diagram of the human body region and the projection region in some embodiments is shown. As shown in Figure 15 , the human body region T is entirely in the invalid content region, and does not exist a part in the valid content region. At this time, the controller does not perform the anti-eye shooting process.

[0179] In some embodiments, the projection device 2 can also detect the human body region through the distance sensor. During the projection process of the projection device 2, the controller can control the distance sensor to collect distance image data of the projection surface 400 according to a second collection period. The distance sensor can collect distance image data in real time after the projection device 2 is turned on. The first collection period and the second collection period can be the same or different.

[0180] The controller can obtain the distance image collected by the distance sensor, and detect the intersection condition of the human body region and the effective content region according to the distance image.

[0181] The coordinates of the effective content region are coordinates in the coordinate system corresponding to the light-emitting assembly, that is, coordinates in the optical-mechanical coordinate system. The controller can convert the coordinates of the effective content region into spatial coordinates, which are referred to as second spatial coordinates in the embodiments of the present application. The second spatial coordinates refer to coordinates in a second coordinate system corresponding to the distance sensor.

[0182] The controller can detect the intersection condition of the human body region and the effective content region in the second spatial coordinates in the distance image through a second image detection algorithm. The second image detection algorithm can include the following steps:

[0183] The controller can first obtain an initial distance image. The initial distance image is a distance image collected by the distance sensor after the projection device 2 is turned on. That is, after the projection device 2 is turned on, the distance sensor is controlled to collect an initial image.

[0184] The controller can perform background frame difference processing on the distance image currently collected by the distance sensor and the initial distance image to obtain a foreground image. It should be noted that when there is no user, the space between the projection surface 400 and the projection device 2 will not change, that is, the distance image collected by the distance sensor at this time is the same as the initial distance image. When there is a user, the user will be in the space between the projection surface 400 and the projection device 2, resulting in that the distance image collected by the distance sensor at this time is different from the initial distance image.

[0185] In the embodiments of the present application, the initial distance image is taken as a background image. If a user enters the space between the projection surface 400 and the projection device 2, the user is equivalent to foreground content in front of the background image. The controller can obtain the foreground image in front of the background image by performing background frame difference processing on the currently collected distance image and the initial distance image. By detecting whether the user exists in the foreground image, it can be determined whether the user enters the space between the projection surface 400 and the projection device 2.

[0186] The controller can detect the human body contour in the foreground image. The foreground image is a distance image after background frame difference processing, and records the detection value corresponding to each pixel point in the distance image. When the detection value is a number greater than 0, it can be considered that the pixel point is a human body of the user.

[0187] Based on detecting that there is no human body region in the foreground image, it indicates that there is no user in the distance image, and the controller can mark that there is no intersection between the human body region in the distance image and the valid content region under the second spatial coordinate.

[0188] Based on detecting that there is a human body region in the foreground image, the controller can obtain the position information of the human body region, which is referred to as second position information in the embodiment of the application. The controller can detect the intersection condition of the human body region in the distance image and the valid content region under the second spatial coordinate according to the second position information.

[0189] The second position information is the coordinate of the human body region in the distance image, so the controller can detect whether there is the same coordinate between the second spatial coordinate and the second position information. If there is the same coordinate, it indicates that there is an intersection between the human body region in the distance image and the valid content region under the second spatial coordinate. If there is no same coordinate, it indicates that there is no intersection.

[0190] In some embodiments, based on detecting that there is an intersection between the human body region in the target image and the valid content region under the first spatial coordinate, and / or, there is an intersection between the human body region in the distance image and the valid content region under the second spatial coordinate, the controller performs the anti-eye shooting process.

[0191] Based on detecting that there is no intersection between the human body region in the target image and the valid content region under the first spatial coordinate, and there is no intersection between the human body region in the distance image and the valid content region under the second spatial coordinate, the controller does not perform the anti-eye shooting process.

[0192] In some embodiments, the distance sensor can also detect the interval distance between the projection device 2 and the object to be measured (for example, the user) in the process of collecting the distance image. Considering the measurement accuracy of the distance sensor, when the measurement result exceeds a certain distance, it can be unreliable. Therefore, a distance threshold can be pre-set in the projection device 2.

[0193] The controller can first detect the intersection condition of the human body region in the target image and the valid content region under the first spatial coordinate. Based on detecting that there is no intersection between the human body region in the target image and the valid content region under the first spatial coordinate, the controller can detect the intersection condition of the human body region in the distance image and the valid content region under the second spatial coordinate.

[0194] Based on detecting that there is no intersection between the human body region in the distance image and the valid content region under the second spatial coordinate, the controller can not perform the anti-eye shooting process.

[0195] Based on detecting that the human body region in the target image and the picture content under the space coordinates exist intersection, the controller can execute the anti-eye shooting process. Based on detecting that the human body region in the target image and the picture content under the space coordinates do not exist intersection, the controller does not execute the anti-eye shooting process.

[0196] In some embodiments, if all the picture content is the valid content region, and there is no invalid content region, the controller can detect whether the user enters the picture content, and execute the anti-eye shooting function after the user enters the picture content.

[0197] The controller can convert the coordinates of the picture content to the space coordinates.

[0198] Based on detecting that the human body region in the target image and the picture content under the space coordinates exist intersection, the controller can execute the anti-eye shooting process. Based on detecting that the human body region in the target image and the picture content under the space coordinates do not exist intersection, the controller does not execute the anti-eye shooting process.

[0199] It should be noted that the scheme of detecting whether the human body region and the picture content under the space coordinates exist intersection can refer to the steps of the valid content region described above, which will not be described here.

[0200] In some embodiments, considering that the image acquisition device and the distance sensor acquire images at different frequencies, the detection process described above can be performed once every time the image acquisition device or the distance sensor acquires an image to confirm whether the user enters the valid content region. If one of the image acquisition device and the distance sensor acquires a new image, but the other device does not acquire a new image at present, the image acquired by the other device last time is used as the current image for detection.

[0201] In some embodiments, after the projection device is turned on, the controller can detect the projection mode of the projection device 2. If the projection mode of the projection device 2 is the projection mode, the controller can detect the gray value or pixel value of the pixel point in the picture content to detect the valid content region and the invalid content region of the projection region.

[0202] The controller can detect whether the user enters the valid content region to determine whether to execute the anti-eye shooting process.

[0203] If the projection mode of the projection device 2 is not the projection mode, the controller can detect whether the user enters the picture content to determine whether to execute the anti-eye shooting process.

[0204] In some embodiments, the projection device 2 can set three models: a standard mode, a follow protection mode and a screen-off protection mode. Among them, the standard mode does not protect the user. In the follow protection mode, the user's eyes are protected by generating a shielding image. The projection device 2 can set a shielding image in the detected user area and generate new picture content according to the shielding image and the picture content, wherein the shielding image is displayed on the upper layer of the picture content, and the projection device 2 projects the new picture content to the projection area. The shielding image has low brightness, so as to cover the user by the projected shielding image, thereby achieving the effect of protecting the user. In the screen-off protection mode, the projection device 2 can directly turn off the light source.

[0205] In the standard mode, the projection device 2 does not perform the anti-eye shooting function, so it does not need to perform the above-mentioned user detection process.

[0206] In the follow protection mode and the screen-off protection mode, when performing the anti-eye shooting function, the controller can obtain the current mode of the projection device 2. If the projection device 2 is in the follow protection mode, the controller can obtain the user area according to the target image, so as to generate a shielding image to protect the user by using the shielding image. If the projection device 2 is in the screen-off protection mode, the controller can control the light emitting assembly to stop projecting the content to the projection surface 400, and turn off the light source.

[0207] The embodiments of the present application also provide a projection control method applied to a projection device, and the method comprises:

[0208] In step 901, when it is detected by a first image detection algorithm that the picture content includes an effective content area and an ineffective content area, the coordinates of the effective content area are converted to spatial coordinates; wherein the gray scale values or pixel values of the continuous rows and / or continuous columns of pixel points in the ineffective content area are the same, and the gray scale values or pixel values of the pixel points are lower than a first threshold value.

[0209] In step 902, when it is detected by a first human body detection algorithm that there is an intersection between the human body area in the target image and the effective content area under the spatial coordinates, an anti-eye shooting process is performed.

[0210] When it is detected by the first human body detection algorithm that there is no intersection between the human body area in the target image and the effective content area under the spatial coordinates, the anti-eye shooting process is not performed.

[0211] The same and similar parts among the various embodiments in the present specification can be referred to each other, which will not be described here again.

[0212] Those skilled in the art can clearly understand that the technical solutions in the embodiments of the present application can be implemented by means of software plus necessary universal hardware platforms. Based on such understanding, the technical solutions in the embodiments of the present application can be embodied in the form of a software product, and the computer software product can be stored in a storage medium, such as a ROM / RAM, a magnetic disk, an optical disk, and the like, and includes a plurality of instructions to cause a computer device (which can be a personal computer, a server, or a network device, and the like) to execute the methods of the various embodiments or some parts of the embodiments of the present application.

[0213] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement for part or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

[0214] For the convenience of explanation, the above description has been made in combination with specific embodiments. However, the above exemplary discussion is not intended to exhaust or limit the embodiments to the specific forms disclosed above. Various modifications and variations can be derived according to the above teachings. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different modified embodiments suitable for specific use considerations.

Claims

1. A projection device, characterized by The application relates to a light-emitting component configured to project picture content to a projection surface, an image acquisition device configured to acquire a target image of the projection surface, and a controller configured to: in a case where the picture content is detected to include a valid content region and an invalid content region by a first image detection algorithm, convert coordinates of the valid content region to spatial coordinates; wherein the invalid content region has the same gray scale value or pixel value of continuous rows and / or continuous columns of pixel points, and the gray scale value or pixel value of the pixel points is lower than a first threshold value; based on the human body region in the target image and the valid content region under the spatial coordinates being detected to have an intersection by a first human body detection algorithm, execute an anti-eye shooting process; and based on the human body region in the target image and the valid content region under the spatial coordinates being detected to have no intersection by the first human body detection algorithm, not execute the anti-eye shooting process. The controller is further configured to, before the conversion of the coordinates of the valid content region to the spatial coordinates in the case where the picture content is detected to include the valid content region and the invalid content region by the first image detection algorithm, detect the gray scale value or pixel value of the pixel points in the picture content, mark at least a first number of continuous rows and / or at least a first number of continuous columns of pixel points as the invalid content region based on the detection that the gray scale value or pixel value of the at least first number of continuous rows and / or at least first number of continuous columns of pixel points is the same, and the gray scale value or pixel value of the pixel points is lower than the first threshold value, and mark a region other than the invalid content region in the picture content as the valid content region. The controller is further configured to, based on the detection that the picture content does not include the invalid content region, convert the coordinates of the picture content to the spatial coordinates, execute the anti-eye shooting process based on the detection that the human body region in the target image and the picture content under the spatial coordinates have an intersection, and not execute the anti-eye shooting process based on the detection that the human body region in the target image and the picture content under the spatial coordinates have no intersection. The spatial coordinates include first spatial coordinates in a first coordinate system corresponding to the image acquisition device, and the controller is further configured to, after the conversion of the coordinates of the valid content region to the spatial coordinates, perform image binarization processing on the target image to obtain a binarized image, detect the human body region in the binarized image, mark that the human body region in the target image and the valid content region under the first spatial coordinates have no intersection based on the detection that there is no human body region in the binarized image, obtain first position information of the human body region based on the detection that there is a human body region in the binarized image, and detect the intersection of the human body region in the target image and the valid content region under the first spatial coordinates according to the first position information and the first spatial coordinates. The application further relates to a distance sensor configured to acquire a distance image of the projection surface, and the spatial coordinates further include second spatial coordinates in a second coordinate system corresponding to the distance sensor. The controller is further configured to, after the conversion of the coordinates of the valid content region to the spatial coordinates, ​ 2. The projection device according to claim 1, characterized in that, ​ ​ ​ ​ 3. The projection device according to claim 2, characterized in that, ​ ​ ​ ​ 4. The projection apparatus according to claim 1, wherein, ​ ​ ​ ​ ​ ​ 5. The projection device according to claim 4, characterized in that, ​ ​ ​ detecting intersection of the human body region in the distance image and the valid content region under the second spatial coordinates; performing the anti-eye shooting process based on detection of intersection of the human body region in the target image and the valid content region under the first spatial coordinates, and / or intersection of the human body region in the distance image and the valid content region under the second spatial coordinates; not performing the anti-eye shooting process based on detection of non-intersection of the human body region in the target image and the valid content region under the first spatial coordinates, and non-intersection of the human body region in the distance image and the valid content region under the second spatial coordinates.

6. The projection apparatus according to claim 4, wherein, Further comprising: a distance sensor configured to capture a distance image of the projection surface and detect a separation distance between the projection device and the user; the spatial coordinates further comprise second spatial coordinates under a second coordinate system corresponding to the distance sensor; based on detection of non-intersection of the human body region in the target image and the valid content region under the first spatial coordinates, the controller is further configured to: detect intersection of the human body region in the distance image and the valid content region under the second spatial coordinates; not perform the anti-eye shooting process based on detection of non-intersection of the human body region in the distance image and the valid content region under the second spatial coordinates; based on detection of intersection of the human body region in the distance image and the valid content region under the second spatial coordinates, obtain the separation distance; if the separation distance is less than or equal to a distance threshold, perform the anti-eye shooting process; if the separation distance is greater than the distance threshold, not perform the anti-eye shooting process.

7. The projection device according to claim 5 or 6, characterized in that, the controller performing detection of intersection of the human body region in the distance image and the valid content region under the second spatial coordinates is specifically configured to: obtain an initial distance image; the initial distance image is a distance image captured by the distance sensor after the projection device is powered on; perform background frame difference processing on the distance image captured by the distance sensor and the initial distance image to obtain a foreground image; detect a human body region in the foreground image; based on detection of non-existence of the human body region in the foreground image, mark non-intersection of the human body region in the distance image and the valid content region under the second spatial coordinates; based on detection of existence of the human body region in the foreground image, obtain second position information of the human body region, and detect intersection of the human body region in the distance image and the valid content region under the second spatial coordinates according to the second position information.

8. The projection apparatus according to claim 2, wherein, the controller is further configured to: detect a projection mode of the projection device; if the projection mode is a screen projection mode, perform the step of detecting the gray value or pixel value of the pixel point in the picture content.

9. A projection control method characterized by comprising: The method is applied to the projection device of any one of claims 1-8, and the method comprises: in a case where the picture content includes a valid content region and an invalid content region detected by the first image detection algorithm, converting coordinates of the valid content region to spatial coordinates; wherein the gray value or pixel value of the continuous row and / or continuous column pixel points in the invalid content region is the same, and the gray value or pixel value of the pixel point is lower than a first threshold value; If the first human body detection algorithm detects that the human body region in the target image collected by the image collection device and the effective content region under the spatial coordinates have an intersection, an anti-eye shooting process is performed; If the first human body detection algorithm detects that the human body region in the target image and the effective content region under the spatial coordinates have no intersection, the anti-eye shooting process is not performed.

10. The projection control method according to claim 9, characterized by, The controller is further configured to, before converting the coordinates of the effective content region to the spatial coordinates in the case that the first image detection algorithm detects that the picture content includes the effective content region and the ineffective content region: detect the gray value or pixel value of the pixel point in the picture content; based on detecting that the gray value or pixel value of at least a first number of continuous row and / or at least a first number of continuous column pixel points is the same, and the gray value or pixel value of the pixel point is lower than a first threshold value, mark the at least first number of continuous row and / or at least first number of continuous column pixel points as the ineffective content region; mark the region other than the ineffective content region in the picture content as the effective content region.

Images