Projection device and projection control method

Abstract

Some embodiments of the present application provide a projection device and a projection control method. During projection, the projection device can acquire a target image through an image acquisition device and detect a user state. After detecting that the user exists in the image, the projection device can acquire a user parameter and generate a shielding image capable of shielding the user according to the user parameter. The projection device can superimpose the original picture content and the shielding image to generate new picture content, and project the new picture content to a projection surface, so as to shield the user in the light source emission area by using the shielding image to protect the user's eyes, continue to project the original image without interrupting the viewing process of other users, and improve the user experience.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of projection equipment, and in particular to a projection equipment and a projection control method. BACKGROUND

[0002] The projection equipment is a display equipment that can project an image or a video onto a screen. The projection equipment can project laser light of a specific color through the refraction of an optical lens assembly to a projection area and form a specific image. Based on the portability of the projection equipment, a user can move the projection equipment during projection to project the image or the video to different directions.

[0003] The projection equipment can project the content of a picture onto a projection surface for a user to view the content of the picture. To ensure that the projection surface can display a complete image, it is necessary to ensure that there is no obstruction between the projection equipment and the projection surface, so that the projection equipment can project a complete image onto the projection surface. During projection, a user can enter a light source emission area of the projection equipment, causing the projection light source of the projection equipment to directly shine into the user's eyes and cause harm to the user's eyes. Therefore, the projection equipment can perform human body detection on the light source emission area during projection. When a human body is detected in the light source emission area, the projection equipment can turn off the light source, and then turn on the light source again when no human body is detected in the light source emission area, so as to protect the user in the light source emission area.

[0004] However, the projection equipment will interrupt the projection process when the light source is turned off, and at this time, the projection area will also not display the content of the picture. For users who are not in the light source emission area, they may be watching the content of the picture, and if the projection process is interrupted by turning off the light source, these users will not be able to see the content of the picture, which will interrupt the viewing process of the users and affect the viewing experience of the users. SUMMARY

[0005] The present application provides a projection equipment and a projection control method to solve the problem that the projection process is interrupted when the light source of the projection equipment is turned off in the related art, and the users cannot see the content of the picture, which interrupts the viewing process of the users.

[0006] In a first aspect, some embodiments of the present application provide a projection equipment, comprising an out-light assembly, an image acquisition device, and a controller. The out-light assembly is configured to project the content of a picture onto a projection surface. The image acquisition device is configured to acquire a target image of the projection surface according to a first acquisition period. The controller is configured to:

[0007] In response to a projection instruction, control the out-light assembly to project initial picture content onto the projection surface;

[0008] acquire the target image acquired by the image acquisition device, and detect a user state in the target image;

[0009] obtaining user parameters according to the target image based on detecting that there is a user in the target image; the user parameters include user size information and user position information;

[0010] generating a blocking image according to the user size information and the user position information; the blocking image includes a blocking image for blocking a user;

[0011] In the process of controlling the light-emitting assembly to project the initial picture content to the projection surface, the light-emitting assembly is controlled to project the blocking image to the projection surface.

[0012] The above technical solution has the following beneficial effects: After detecting that there is a user in the image, the projection device can obtain user parameters and generate a blocking image that can block the user according to the user parameters. The projection device can project the blocking image to the projection surface while maintaining the projection of the original image, thereby achieving the use of the blocking image to block the user in the light-emitting area to protect the user's eyes, and maintaining the projection of the original image without interrupting the viewing process of other users, thereby improving the user's experience.

[0013] In some embodiments, the controller, after controlling the light-emitting assembly to project the first picture content to the projection surface, is further configured to:

[0014] obtain a current target image collected by the image collection device, and detect a user state in the current target image;

[0015] based on not detecting that there is a user in the current target image, control the light-emitting assembly to stop projecting the first picture content, and control the light-emitting assembly to project the initial picture content to the projection surface;

[0016] based on detecting that there is a user in the current target image, obtain current user parameters;

[0017] if the current user parameters are the same as the user parameters of the previous target image, control the light-emitting assembly to continue projecting the first picture content to the projection surface;

[0018] if the current user parameters are different from the user parameters of the previous target image, generate a current blocking image according to the current user parameters, and control the light-emitting assembly to project second picture content to the projection surface; the second picture content includes the initial picture content and the current blocking image, and the current blocking image is located on the upper layer of the initial picture content.

[0019] In some embodiments, the controller, when generating a blocking image according to the user size information and the user position information, is specifically configured to:

[0020] acquire an image position of the occlusion image according to the user position information and the user size information;

[0021] acquire an image size of the occlusion image according to the user size information;

[0022] generate the occlusion image based on the image size and the image position.

[0023] The above technical solution has the following beneficial effects: the size and position of the occlusion image are respectively acquired according to user parameters, and the occlusion image is generated to protect the eyes of the user.

[0024] In some embodiments, the user position information includes a center point position of a user head; and the user size information includes a user head width and a user head height.

[0025] The controller is specifically configured to acquire the image position of the occlusion image according to the user position information and the user size information.

[0026] calculate a first adjustment ratio according to the user head width and a preset adjustment coefficient, and acquire an adjustment width according to the user head width and the first adjustment ratio;

[0027] calculate a second adjustment ratio according to the user head height and the preset adjustment coefficient, and acquire an adjustment height according to the user head height and the second adjustment ratio;

[0028] acquire a region vertex position of the occlusion image; wherein a horizontal coordinate of the region vertex is calculated according to a horizontal coordinate of a center point of the user head and the adjustment width, and a vertical coordinate of the region vertex is calculated according to a vertical coordinate of the center point of the user head and the adjustment height.

[0029] In some embodiments, the user size information further includes a user width and a user height.

[0030] The controller is specifically configured to acquire the image size of the occlusion image according to the user size information.

[0031] calculate a width adjustment ratio according to the user width, and calculate a height adjustment ratio according to the user height; the width adjustment ratio is a ratio of the user width and a preset adjustment coefficient, and the height adjustment ratio is a ratio of the user height and the preset adjustment coefficient;

[0032] calculate a region width and a region height of the occlusion image; the region width is a product of the user head width and the width adjustment ratio, and the region height is a product of the user head height and the height adjustment ratio.

[0033] In some embodiments, the projection device further comprises a distance sensor configured to detect a first interval distance between the projection device and the user and a second interval distance between the projection device and the projection surface according to a second acquisition cycle.

[0034] The controller is configured to acquire an image size of the occlusion image according to the user size information, specifically configured to:

[0035] acquire a first interval distance between the projection device and the user and a second interval distance between the projection device and the projection surface;

[0036] calculate a distance ratio and acquire a user area size according to the user size information and the distance ratio; the distance ratio is a ratio of the second interval distance and the first interval distance; the user area size is a size of a user area formed by the user occlusion in the projection surface;

[0037] set the image size of the occlusion image according to the user area size.

[0038] The above technical solution has the following beneficial effects: the distance sensor measures the interval distance between the user and the projection device, so as to accurately acquire the user area size projected by the user on the projection surface, thereby ensuring that the occlusion image can completely occlude the user and improving the protection of the user.

[0039] In some embodiments, the controller is configured to generate the occlusion image based on the image size and the image position, and further configured to:

[0040] acquire an initial image based on the image size and the image position;

[0041] add occlusion content in the initial image to generate the occlusion image.

[0042] The above technical solution has the following beneficial effects: the dark occlusion content is set in the occlusion image, thereby ensuring that the occlusion image can protect the eyes of the user.

[0043] In some embodiments, the controller is configured to add the occlusion content in the initial image, and further configured to:

[0044] acquire a first user feature of the target image and a second user feature of a previous target image;

[0045] if the first user feature and the second user feature are the same, add first occlusion content in the initial image; the first occlusion content is occlusion content in the occlusion image corresponding to the previous target image;

[0046] if the first user feature and the second user feature are different, add second occlusion content in the initial image.

[0047] In some embodiments, based on detecting that there is a user in the target image, the controller is further configured to:

[0048] obtaining a current user protection mode of the projection device;

[0049] if the projection device is in the first protection mode, performing the step of obtaining the user parameter according to the target image;

[0050] if the projection device is in the second protection mode, controlling the light-emitting component to stop projecting the content to the projection surface.

[0051] In a second aspect, some embodiments of the present application provide a projection control method applied to the projection device described above, and the method comprises:

[0052] in response to a projection instruction, controlling the light-emitting component to project an initial picture content to the projection surface;

[0053] obtaining a target image collected by the image collection device, and detecting a user state in the target image;

[0054] based on detecting that there is a user in the target image, obtaining a user parameter according to the target image; the user parameter comprises user size information and user position information;

[0055] generating a shielding image according to the user size information and the user position information;

[0056] controlling the light-emitting component to project a first picture content to the projection surface; the first picture content comprises the initial picture content and the shielding image, and the shielding image is located on the upper layer of the initial picture content. BRIEF DESCRIPTION OF DRAWINGS

[0057] In order to more clearly illustrate the technical solutions of the present application, the drawings required in the embodiments will be briefly introduced below, and obviously, other drawings can also be obtained by those of ordinary skill in the art without creative labor.

[0058] Figure 1 a projection scene schematic diagram of the projection device in some embodiments is shown;

[0059] Figure 2 a light path schematic diagram of the projection device in some embodiments is shown;

[0060] Figure 3 a circuit architecture schematic diagram of the projection device provided by some embodiments is shown;

[0061] Figure 4 a projection device structure schematic diagram provided by some embodiments is shown;

[0062] Figure 5 A schematic diagram of a lens structure of a projection device is shown according to some embodiments;

[0063] Figure 6 A schematic diagram of a distance sensor and image acquisition device structure of a projection device is shown according to some embodiments;

[0064] Figure 7 A schematic diagram of a system framework for display control of a projection device is shown according to some embodiments;

[0065] Figure 8 A flowchart of interactions between components of a projection device is shown according to some embodiments;

[0066] Figure 9 A schematic diagram of a checkerboard image card is shown according to some embodiments;

[0067] Figure 10 A schematic diagram of a circular ring image card is shown according to some embodiments;

[0068] Figure 11 A flowchart of obtaining a mapping relationship is shown according to some embodiments;

[0069] Figure 12 A flowchart of image correction by a projection device is shown according to some embodiments;

[0070] Figure 13 A schematic diagram of an image coordinate system corresponding to a target image is shown according to some embodiments;

[0071] Figure 14 A schematic diagram of a projection scene is shown according to some embodiments;

[0072] Figure 15 A schematic diagram of an occlusion image is shown according to some embodiments;

[0073] Figure 16 A schematic diagram of multiple occlusion contents is shown according to some embodiments. DETAILED DESCRIPTION

[0074] The embodiments will be described in detail with reference to the drawings, wherein the same reference numerals refer to the same or similar elements throughout. The following detailed description is not intended to represent all embodiments in accordance with the present disclosure. Rather, the following description is intended only to represent examples of systems and methods consistent with some aspects of the present disclosure as detailed in the claims.

[0075] It should be noted that the brief description of the terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of the application. Unless otherwise specified, these terms should be understood according to their ordinary and general meanings.

[0076] The terms "first", "second", "third", and the like in the specification and claims of this application and the above-described drawings are used to distinguish similar or like objects or entities, and do not necessarily mean a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchanged under appropriate circumstances.

[0077] The terms "include" and "have" and any variations thereof are intended to cover but not exclusive inclusion, for example, a product or device including a series of components does not have to be limited to all components clearly listed, but can include other components not clearly listed or inherent to these products or devices.

[0078] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or a combination of hardware or / and software code capable of performing functions related to the element.

[0079] The embodiments of the present application can be applied to various types of projection devices. The projection device is a projection device that can project an image or a video onto a screen. The projection device can project a specific color of laser light onto the screen to form a specific image through the refraction of the optical assembly. During the projection process, a certain distance can be maintained between the projection device and the screen, so that the image formed on the screen can conform to the focal length range of the optical assembly to obtain a clear image. In the following, the projection device and the projection control method will be described taking a projector as an example.

[0080] The projector can be connected to a computer, a broadcast network, the Internet, a VCD (Video Compact Disc), a DVD (Digital Versatile Disc Recordable), a game console, a DV, etc. through different interfaces to play corresponding video signals. The projector is widely used in homes, offices, schools, and entertainment venues, etc.

[0081] Figure 1 A schematic diagram of a projection scene of the projection device in some embodiments is shown. As shown in Figure 1 The projection scene provided by the present application includes a projection screen 1 and a projection device 2. The projection screen 1 is fixed at a first position of the projection surface, for example, a wall can be used as the projection surface, and a curtain can be used as the projection screen and fixed at the first position of the projection surface. The projection device 2 is placed at a second position, so that the image projected by the projection device 2 matches the projection screen 1.

[0082] Figure 2 A light path schematic diagram of the projection device in some embodiments is shown. As shown in Figure 2 the projection device 2 includes a light source 100, an optical engine 200 and a lens 300. Among them, the light source 100 provides illumination for the optical engine 200, the optical engine 200 modulates the light beam of the light source and outputs to the lens 300 for imaging, and projects to the projection surface 400 to form a projection picture. Since the light source 100, the optical engine 200 and the lens 300 are used together to emit projection light to project a projection picture, in some embodiments of the present application, the light source 100, the optical engine 200 and the lens 300 are collectively referred to as a light-emitting assembly.

[0083] In some embodiments, the light source 100 of the projection device 2 includes a light-emitting component 110 and an optical lens component 120, and the light beam emitted by the light-emitting component 110 can pass through the optical lens component 120 to provide illumination for the optical engine 200.

[0084] It should be noted that in the embodiments of the present application, the light source 100 can be a laser light source, an LED light source or a Liquid Crystal Display (LCD) light source, which is not limited in the present application. For example, taking the light source 100 as a laser light source as an example, when the light source 100 is a laser light source, in some embodiments, the optical engine 200 of the projection device 2 can be implemented to include a blue optical engine, a green optical engine and a red optical engine, and can also include a heat dissipation system, a circuit control system, etc.

[0085] Figure 3 A circuit architecture schematic diagram of the projection device provided in some embodiments is shown. As shown in Figure 3 the projection device 2 can include a display control circuit 10, a light source 100, at least one light driving component 30 and at least one brightness sensor 40. Still taking the light source 100 as a laser light source as an example, when the light source 100 is a laser light source, the light source 100 can include at least one laser corresponding to at least one light driving component 30.

[0086] Based on the circuit architecture, the projection device 2 can realize adaptive adjustment. For example, by arranging the brightness sensor 40 in the light-emitting path of the light source 100, the brightness sensor 40 can detect the first brightness value of the laser light source and send the first brightness value to the display control circuit 10.

[0087] The display control circuit 10 can obtain the second brightness value corresponding to the driving current of each laser, and determine that the COD fault occurs in the laser when the difference between the second brightness value of the laser and the first brightness value of the laser is greater than the difference threshold value; then the display control circuit can adjust the current control signal of the corresponding laser driving component of the laser until the difference is less than or equal to the difference threshold value, thereby eliminating the COD fault of the blue laser; the projection device 2 can eliminate the COD fault of the laser in time, reduce the damage rate of the laser, and improve the image display effect of the projection device 2.

[0088] Figure 4 A structure schematic diagram of a projection device provided by some embodiments is shown. As shown in Figure 4 The light source 100 in the projection device 2 is taken as a laser light source for example, the laser light source can include independently arranged blue laser 101, red laser 102 and green laser 103, the projection device 2 can also be called a three-color projection device, the blue laser 101, the red laser 102 and the green laser 103 are all module lightweight (Mirai Console Loader, MCL) packaged lasers, which are small in size and conducive to compact arrangement of the optical path. It can be understood that the above is only exemplarily described by taking the light source 100 as a laser light source for example, and the light source 100 is not limited to a laser light source, but can also be an LED light source, an LCD light source and other forms of light sources.

[0089] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a RAM (Random Access Memory), a ROM (Read-Only Memory), a first interface to an n-th interface for input / output, a communication bus, and the like.

[0090] In some embodiments, the projection device 2 can directly enter the display interface of the last selected signal source or the signal source selection interface after starting, wherein the signal source can be at least one of a preset video on demand program, an HDMI interface, a live television interface, and the like, and the projector can display the content obtained from different signal sources after the user selects different signal sources.

[0091] In some embodiments, the projection device 2 can be configured with an image acquisition device 700, such as a camera, to work in conjunction with the projection device 2 to achieve the adjustment control of the projection process. For example, the camera configured by the projection device 2 can be implemented as a 3D camera, or a binocular camera; when the camera is implemented as a binocular camera, it specifically includes a left camera and a right camera; the binocular camera can obtain the image and the playing content presented by the projection medium corresponding to the projection device 2, such as the screen, i.e. the projection surface 400, which is projected by the optical engine 200 built in the projection device 2.

[0092] The image acquisition device can be used to capture the image displayed on the projection surface 400, which can be a camera. The camera can include a lens assembly, which is provided with a photosensitive element and a lens. The lens can make the light of the image of the scene be able to irradiate on the photosensitive element through the refraction of multiple lenses.

[0093] Figure 5 The lens structure schematic diagram of the projection device provided by some embodiments is shown. In order to support the automatic focusing process of the projection device 2, as shown in Figure 5 The lens 300 of the projection device 2 can also include an optical assembly 310 and a driving motor 320. The optical assembly 310 is a lens group composed of one or more lenses, which can refract the light emitted by the optical engine 200, so that the light emitted by the optical engine 200 can be transmitted to the projection surface 400 to form a transmitted content image.

[0094] The optical assembly 310 can include a lens barrel and multiple lenses arranged in the lens barrel. According to whether the position of the lens can be moved, the lenses in the optical assembly 310 can be divided into moving lenses 311 and fixed lenses 312. By changing the position of the moving lenses 311, the distance between the moving lenses 311 and the fixed lenses 312 is adjusted, and the overall focal length of the optical assembly 310 is changed. Therefore, the driving motor 320 can drive the moving lenses 311 to move by connecting the moving lenses 311 in the optical assembly 310, so as to realize the automatic focusing function.

[0095] It should be noted that the focusing process described in some embodiments of the present application refers to changing the position of the moving lenses 311 by the driving motor 320, so as to adjust the distance between the moving lenses 311 and the fixed lenses 312, i.e. adjust the image plane position, and therefore the imaging principle of the lens combination in the optical assembly 310. The adjustment of the focal length is actually the adjustment of the image distance, but in terms of the overall structure of the optical assembly 310, adjusting the position of the moving lenses 311 is equivalent to adjusting the overall focal length of the optical assembly 310.

[0096] When the distance between the projection device 2 and the projection surface 400 varies, the lens of the projection device 2 needs to be adjusted to different focal lengths to project a clear image onto the projection surface 400. During projection, the distance between the projection device 2 and the projection surface 400 will vary depending on the user's placement, requiring different focal lengths. Therefore, to adapt to different usage scenarios, the projection device 2 needs to adjust the focal length of the optical component 310.

[0097] Figure 6 Schematic diagrams of the distance sensor and image acquisition device structures of projection devices provided in some embodiments are shown. For example... Figure 6 As shown, the projection device 2 can also have a built-in or external image acquisition device 700. The image acquisition device 700 can be a camera, capable of capturing images of the screen projected by the projection device 2 to obtain images of the screen content. The projection device determines whether the current lens focal length is suitable by performing a sharpness detection on the projected image content, and adjusts the focal length if it is not suitable. When automatically focusing based on the image content captured by the camera 700, the projection device can continuously adjust the lens position and take pictures, and find the focus position by comparing the sharpness of the images before and after, thereby adjusting the moving lens 311 in the optical component to a suitable position. For example, the controller 500 can first control the drive motor 320 to gradually move the moving lens 311 from the focusing starting position to the focusing ending position, continuously acquiring images of the screen content through the camera during this period. Then, by performing a sharpness detection on multiple images of the screen content, the position with the highest sharpness is determined, and finally the drive motor 320 is controlled to adjust the moving lens 311 from the focusing end position to the position with the highest sharpness, completing the automatic focusing.

[0098] The distance sensor 600 can be a time-of-flight (TOF) based sensor device such as lidar or infrared radar, capable of detecting target distances. It can detect the distance between the projection surface 400 and the optical engine 200. The distance sensor 600 can be positioned at the optical engine 200, including a signal transmitter and a receiver. During distance detection, the transmitter of the distance sensor 600 can emit a wireless signal towards the projection surface. After contacting the projection surface, the wireless signal is reflected back to the receiver of the distance sensor 600. The signal flight time is calculated based on the time it takes for the transmitter to emit the signal and the time it takes for the receiver to receive the signal. Combined with the flight speed, the actual flight distance of the wireless signal can be obtained.

[0099] Figure 7 A schematic diagram of a system framework for display control using a projection device provided in some embodiments is shown. For example... Figure 7As shown, the projection device 2 has the characteristics of long-focus micro projection, and the controller can control the display of the projected light image through a preset algorithm to realize functions such as automatic trapezoidal correction, automatic entering, automatic obstacle avoidance, automatic focusing, and anti-eye shooting.

[0100] In some embodiments, the projection device 2 is configured with a gyroscope sensor; during movement, the gyroscope sensor can sense the position movement and actively collect movement data; then the collected data is sent to the application service layer through the system framework layer, supporting the application data required in the user interface interaction and application interaction process, and the collected data can also be used for data calling of the controller in the algorithm service implementation.

[0101] In some embodiments, the projection device 2 is configured with a time-of-flight sensor, and after the time-of-flight sensor collects corresponding data, the data will be sent to the corresponding time-of-flight service in the service layer; after the time-of-flight service obtains the data, the collected data will be sent to the application service layer through the process communication framework, and the data will be used for data calling of the controller, user interface, program application, etc.

[0102] In some embodiments, the image acquisition device 700 configured in the projection device 2 can be a binocular camera, a depth camera, or a 3D camera, etc.; the image acquisition device 700 collects data and sends it to the camera service, and then the camera service sends the collected image data to the process communication framework and / or the projection device correction service; the projection device correction service can receive the camera collected data sent by the camera service, and the controller can call the corresponding control algorithm in the algorithm library for different functions to be implemented.

[0103] In some embodiments, data interaction is performed between the process communication framework and the application service, and then the calculation result is fed back to the correction service through the process communication framework; the correction service sends the obtained calculation result to the operating system of the projection device 2 to generate control signaling, and sends the control signaling to the optical engine 200 control driver to control the working condition of the optical engine 200 and realize automatic correction of the display image.

[0104] In some embodiments, when an image correction instruction is detected, the projection device 2 can correct the picture content. For the correction of the picture content, a correlation between the distance, the horizontal included angle, and the offset angle can be created in advance. Then the controller in the projection device 2 determines the included angle between the optical engine 200 and the projection surface 400 at this moment by obtaining the current distance from the optical engine 200 to the projection surface 400, in combination with the correlation, to realize the correction of the picture content. The included angle is specifically the included angle between the central axis of the optical engine 200 and the projection surface 400.

[0105] In some embodiments, the projection device 2 automatically completes the correction and refocuses, and the controller detects whether the automatic focusing function is turned on; when the automatic focusing function is not turned on, the controller ends the automatic focusing service; when the automatic focusing function is turned on, the projection device 2 obtains the detection distance of the time-of-flight sensor through the middleware for calculation.

[0106] The controller queries a preset mapping table according to the obtained distance to obtain the focal length of the projection device 2; then the middleware sets the focal length to the optical engine 200 of the projection device 2; wherein the middleware is a series of application programs related to the focusing control process. After the optical engine 200 emits laser light at the above-mentioned focal length, the camera will execute the photographing instruction; the controller determines whether the focusing process of the projection device 2 is completed according to the obtained photographed image and the evaluation function.

[0107] If the determination result meets the preset completion condition, the automatic focusing process is ended; if the determination result does not meet the preset completion condition, the middleware fine-tunes the focal length parameter of the optical engine 200 of the projection device 2, for example, can gradually fine-tune the focal length by a preset step, and sets the adjusted focal length parameter to the optical engine 200 again; thereby realizing repeated photographing and clarity evaluation steps, and finally finding the optimal focal length through clarity comparison to complete the automatic focusing.

[0108] In some embodiments, the projection device can project the picture content into the projection surface for the user to watch the picture content. For example, the user can pre-set the picture content, which can be a media image, and instruct the projection device to project the media image. The projection device can project the media image into the projection surface, which can be a curtain or a wall surface in front of the projection device, etc.

[0109] When there is an obstacle between the projection device and the projection surface, the content projected by the projection device can be blocked by the obstruction, resulting in that the complete image cannot be displayed in the projection surface, which seriously affects the user's viewing experience. Therefore, in order to ensure that the complete image can be displayed in the projection surface, it is necessary to ensure that there is no obstruction between the projection device and the projection surface.

[0110] The obstruction can be a fixedly placed article, for example, other articles placed on the desktop by the user or articles between the desktop and the projection surface, which can block the light source of the projection device, and the user needs to move these articles away. The obstruction can also be a user, for example, there can be a user passing through the area between the projection device and the projection surface during the projection process, thereby entering the light source emission area of the projection device, and thereby blocking the image projected by the projection device.

[0111] It should be noted that when the user enters the light source emission area of the projection device, the projection light source of the projection device may directly irradiate the user's eyes, and the high-power projection light source may cause damage to the user's eyes. Therefore, the projection device can be provided with a user protection function to protect the user's eyes.

[0112] In the projection process, the projection device can perform human body detection on the projection area. The projection device can take a photo of the projection area through the camera, perform human target detection according to the image data collected by the camera, and determine whether there is a human target intrusion between the projection surface and the projection device. When there is a human target intrusion, the projection device can start the anti-eye shooting function, and when there is no human target intrusion, the projection device can turn off the anti-eye shooting function. The anti-eye shooting function refers to an operation of triggering the projection device to automatically adjust the projection brightness of the light emitting assembly, including at least one of reducing the projection brightness of the light emitting assembly and adjusting the projection brightness of the light emitting assembly to a preset projection brightness.

[0113] Considering that the sensitivity of each user to the projection light source may be different, some users can adapt to a higher brightness light source, and some users may not adapt to a weaker brightness light source. In order to protect all users, the anti-eye shooting function of the projection device can be set to adjust the projection brightness of the light emitting assembly to 0, that is, when a human body is detected in the light source emission area, the projection device can turn off the light source, and then turn on the light source again when it is detected that there is no human body in the light source emission area, so as to protect the eyes of the user in the light source emission area.

[0114] It should be noted that the projection device will be interrupted after turning off the light source, and at this time, the picture content will not be displayed in the projection area. For users who are not in the light source emission area, they may be watching the picture content. If the projection process is interrupted after the light source is turned off, these users will not be able to see the picture content, thereby interrupting the user's viewing process and affecting the user's viewing experience.

[0115] The projection device provided in some embodiments of the present application can protect the user in the light source emission area while maintaining the projection of the projection device. In the projection process, the projection device can collect a target image through an image collection device and detect the user state. After detecting that there is a user in the image, the projection device can obtain user parameters and generate a shielding image capable of shielding the user according to the user parameters. The projection device can superimpose the original picture content and the shielding image to generate new picture content, and project the new picture content to the projection surface, so as to shield the user in the light source emission area by using the shielding image to protect the user's eyes, and continue to project the original image without interrupting the viewing process of other users, thereby improving the user's experience.

[0116] Figure 8The diagram illustrates the interaction flowcharts of various components of the projection device in some embodiments, including the following steps:

[0117] S801, in response to a projection command, controls the light-emitting component to project the initial image content onto the projection surface;

[0118] S802. Acquire the target image captured by the image acquisition device, and detect the user status in the target image;

[0119] S803. Based on the detection of a user in the target image, obtain user parameters according to the target image; the user parameters include user size information and user location information.

[0120] S804. Generate an occlusion image based on the user size information and the user location information;

[0121] S805, Control the light-emitting component to project the first screen content onto the projection surface; the first screen content includes the initial screen content and the occlusion image, the occlusion image being located on top of the initial screen content.

[0122] In some embodiments, a user can input a projection command to the projection device to instruct the projection device to project image content set by the user. In this embodiment, the content to be projected by the projection device specified by the user is referred to as the initial image content. In response to the projection command, the controller of the projection device can control the light-emitting component to project the initial image content onto the projection surface.

[0123] In some embodiments, the projection device can project an image onto a projection area pre-set by the user. The projection area set by the user can be a certain area of ​​the wall or a screen placed by the user in advance. The projection area can display the complete picture content for the user to view.

[0124] Users can manually adjust the position and projection angle of the projector to ensure the image content is entirely within the projection area. However, this manual adjustment is cumbersome and inaccurate. Therefore, the projector provided in this embodiment can be equipped with an automatic projection area function. This function automatically determines the projection area on the projection surface and projects the image content onto that area, thus avoiding the need for manual adjustment of the projector's angle and position and improving the user experience.

[0125] When performing automatic screen entry, the controller can first construct a transformation matrix between the world coordinate system and the optical engine coordinate system based on the binocular camera. This transformation matrix can represent the homography relationship between the image content on the projection surface and the playback card played by the optical engine. Using this homography relationship, arbitrary projection transformation between the image content and the playback card can be achieved.

[0126] The controller can first control the light-emitting assembly to project the first card into the projection surface. The first card can include a plurality of feature points, and thus the first image captured by the camera can also include all the feature points in the first card. The position information of the projection surface can be determined by the feature points. It should be noted that for a plane, the position information of the plane can be determined after the positions of three points in the plane are determined. Therefore, in order to determine the position information of the projection surface, the positions of at least three points in the projection surface need to be determined, that is, the first card needs to include at least three feature points.

[0127] In some embodiments, the first card can include a pattern and color features preset by the user. Figure 9 A schematic diagram of a checkerboard card in some embodiments is shown. As shown in Figure 9 The first card can be a checkerboard card, which is set as a checkerboard with black and white alternation. The feature points included in the checkerboard card are the corner points of the rectangles. Figure 10 A schematic diagram of a circular ring card in some embodiments is shown. As shown in Figure 10 The first card can also be set as a circular ring card, and the feature points included in the circular ring card are the corresponding solid points on the circular rings. In some embodiments, the first card can also be set as a combination of the above two types of patterns, or as other patterns with identifiable feature points.

[0128] Figure 11 A flowchart of a process for obtaining a mapping relationship in some embodiments is shown.

[0129] In some embodiments, the controller can control the camera to capture the first card displayed by the projection surface to obtain a first image, and obtain the positions of the feature points in the first image. The camera can be a binocular camera. By capturing the first card by the binocular camera, one image is captured by the left camera and another image is captured by the right camera.

[0130] The controller can perform image recognition processing on the two images to obtain first coordinates of the feature points in the images. The first coordinates refer to the coordinate information of the feature points in the image coordinate system corresponding to the first image.

[0131] For the same feature point, its position in the image captured by the left camera can be different from its position in the image captured by the right camera. The coordinates of the feature point in the camera coordinate system of any one of the left and right cameras can be determined by the two positions of the feature point in the two images. In the embodiments of the present application, the second coordinates are used to represent the coordinate information of the feature point in the camera coordinate system.

[0132] According to the position information of the same feature point in the two images captured by the left and right cameras, the controller can obtain a second coordinate of the feature point in the camera coordinate system of any one of the cameras. The controller can convert the second coordinate into a third coordinate. In the embodiments of the present application, the third coordinate refers to the coordinate information of the feature point in the optical-mechanical coordinate system.

[0133] It should be noted that the optical-mechanical coordinate system and the camera coordinate system can be converted to each other, so the coordinates of the feature point in the camera coordinate system can be converted to the coordinates in the optical-mechanical coordinate system. According to the extrinsic parameters between the optical-mechanical camera, the conversion relationship between the optical-mechanical coordinate system and the camera coordinate system can be determined, and the third coordinate of the feature point in the optical-mechanical coordinate system can be obtained.

[0134] The controller can obtain a projection surface equation of the projection surface in the optical-mechanical coordinate system according to the third coordinate of the feature point in the optical-mechanical coordinate system. The controller can obtain the third coordinates of at least three feature points in the first image in the optical-mechanical coordinate system, and fit the third coordinates to obtain the projection surface equation of the projection surface in the optical-mechanical coordinate system.

[0135] The controller can obtain a conversion matrix of the optical-mechanical coordinate system and the world coordinate system according to the projection surface equation, and the conversion matrix can represent the projection relationship between the chart projected by the optical-mechanical projection and the projection surface, so as to realize the conversion of the coordinates of a certain point between the world coordinate system and the optical-mechanical coordinate system.

[0136] For the projection region in the projection surface that has been determined, the coordinate representation of the projection region in the world coordinate system can be determined, and the controller can obtain the position information of the projection region in the optical-mechanical coordinate system according to the conversion matrix, so as to project the image to the projection region.

[0137] In some embodiments, considering that the user may actively move the projection device or accidentally touch the projection device during the use of the projection device, the placement posture or position of the projection device is changed, and the image position projected by the projection device is changed. In order to ensure that the projection continues to the projection region, the projection device can automatically perform image correction.

[0138] The projection device includes a gyroscope sensor, which can detect whether the projection device is displaced during the projection process. Figure 12 A flowchart for image correction of the projection device in some embodiments is shown. As shown in FIG. 6, the projection device can detect whether the projection device is displaced during the projection process. If the projection device is displaced, the projection device can perform image correction. Figure 12As shown, the gyroscope sensor can collect the displacement signal of the projection device, and can send a movement prompt to the controller when detecting movement of the projection device. In response to the movement prompt, the controller can perform image correction on the picture content projected by the light emitting component to the projection surface. The steps of image correction can adopt the aforementioned automatic curtain-in process, which will not be described here. After image correction, the controller controls the light emitting component to adjust the projection information, so as to re-project the picture content to the projection area.

[0139] In some embodiments, there can be no projection area pre-set in the projection surface, and in this case, the projection device can directly project the picture content to the projection surface. To ensure complete display of the image, the projection device can perform obstacle avoidance processing.

[0140] The controller can control the light emitting component to project a white chart to the projection surface, and control the camera to capture the projection surface to perform obstacle detection on the image corresponding to the white chart. In the presence of obstacles, the controller can obtain the projection picture area after avoiding the obstacles, thereby realizing obstacle avoidance of the projection picture.

[0141] In some embodiments, after the projection device projects the initial picture content to the projection surface, the controller can detect the user during the projection process to protect the user's eyes. During the projection process, the controller can control the image acquisition device to collect image data of the projection surface according to a first acquisition period. In the embodiments of the present application, the image collected by the image acquisition device is referred to as a target image. The image acquisition device can be a camera, and the image data captured by the camera can be RGB image data, but is not limited to YUV or other formats of data, nor to the size of the resolution.

[0142] The controller can obtain the target image collected by the image acquisition device, and detect the user state in the target image to determine whether there is a user in the projection area.

[0143] It should be noted that the technical solutions of the present application are described by taking human targets as an example in the embodiments of the present application. It should be understood that the technical solutions provided by the embodiments of the present application are not limited to human targets, and other targets can also be detected according to actual needs.

[0144] The controller can perform human recognition on the target image to determine whether there is a user. The controller can extract the image features of the target image and analyze them to determine whether there is a human in the image.

[0145] In some embodiments, the controller can input the target image into a pre-constructed mask model for detection of the target. The mask model is an encoder and decoder based on pixel point recognition of the target contour. The encoder and decoder refer to an image processing process, that is, the original image is encoded into a vector array with abstract features by the encoder, and then the vector array is decoded into another form of image by the decoder.

[0146] Based on the mask model, the target contour in the target image can be recognized, and a mask image output by the mask model can be obtained. The mask image includes a first pixel value and a second pixel value, the first pixel value is used to represent the target, and the second pixel value is used to represent the non-target. The region of the first pixel value is extracted in the mask image to obtain a target mask. For example, the mask image can be a gray-scale image marking a human target. The image matrix of the gray-scale image includes two data 0 / 1 or 0 / 255, 0 represents a non-human target (background), and 1 or 255 represents a human target. The region of data 1 or 255 is the target mask. The target mask can be recognized and segmented by the encoder and the decoder, so as to determine the human region.

[0147] For each pixel of the image, it can be determined whether it is a human target, so that when a non-human target such as a chair or clothes enters the projection area, no protection is performed, and only when a human target enters the projection area, protection can be performed, and part of the human target (such as a finger, half of the face, etc.) entering the projection area can also be detected, so as to protect the user.

[0148] It should be noted that the encoder and the decoder described in the embodiments of the present application can also be implemented by using image feature extraction calculation methods, such as SIFT (Scale Invariant Feature Transform), HOG (Histogram of Oriented Gradients), or SVM (Support Vector Machine) matrix operations. It can also be implemented by using convolutional neural networks or Transformer calculation methods. The present application does not make specific limitations in this regard.

[0149] In some embodiments, based on detecting that the target image includes a user, the controller can protect the user. The controller can first obtain user parameters according to the target image. The controller can determine a human region in the target image and obtain user parameters corresponding to the human region. The user parameters include user size information and user position information. The user size information is the height and width of the user, and the user position information is the coordinate information of the user in the target image.

[0150] The user size information can be divided into user overall size and user head size. The user overall size includes user width and user height, and the user head size includes user head width and user head height.

[0151] The user position information can include the position of the center point of the user's head. For the target image, an image coordinate system can be constructed, which can take the top-left vertex of the projection area as the origin, the horizontal direction to the right as the X-axis, and the vertical direction downward as the Y-axis. The controller can obtain the coordinates of the center point of the user's head.

[0152] It should be noted that the user can only have part of the body appearing in the projection area, and therefore the target image can not include the complete body area of the user, but only part of the body area. In the embodiments of the present application, the body area not appearing in the target image is not considered, and only the body area present in the target image is used for parameter detection, that is, the parameters of the body area in the image are regarded as the user parameters.

[0153] Figure 13 A schematic diagram of the image coordinate system corresponding to the target image in some embodiments is shown. As shown in Figure 13 the top-left vertex of the target image P is the origin O of the coordinate system. The user's body is detected in the target image, the x-coordinate of the leftmost side of the user's whole body is xz1, the x-coordinate of the rightmost side of the user's whole body is xz2, the y-coordinate of the uppermost end of the user's whole body is yt1, and the y-coordinate of the lowermost end of the user's whole body is y1. Therefore, the detected height of the user is y1-yt1, and the width of the user is xz2-xz1.

[0154] The x-coordinate of the leftmost side of the user's head is xt1, the x-coordinate of the leftmost side of the user's whole body is xt2, and the y-coordinate of the lowermost end of the user's head is yt2. Therefore, the detected width of the user's head is xt2-xt1, and the height of the user's head is yt2-yt1.

[0155] The controller can obtain the coordinates of the center point T of the user's head as (x0, y0).

[0156] In some embodiments, the controller can generate a shielding image according to the user size information and the user position information. The shielding image can be provided with shielding content, and the RGB value at the shielding content is lower than that at other areas where the projection device projects the image. Therefore, the light projected at the shielding content appears darker, which can shield the user. When the projection device projects the shielding image, the light at the shielding image irradiates the user in the light source emitting area, achieving the effect of shielding the user. The brightness and other parameters of the light projected at the shielding content are greatly reduced, so that the brightness of the light irradiating the user's eyes is weak, and the light is dark, thereby achieving the effect of protecting the user's eyes.

[0157] In generating the occlusion image, the controller can obtain an image position of the occlusion image according to the user position information and the user size information, and the controller can obtain an image size of the occlusion image according to the user size information. The controller can generate the occlusion image based on the image size and the image position.

[0158] In the embodiments of the present application, the occlusion image is set as a rectangular region, which can be located in a partial region of the projected image of the projection device, and the image size of the occlusion image includes an image width and an image height. For the rectangular region, the position of the entire region can be determined after the coordinates of a certain point in the region are determined, so when obtaining the image position, the coordinates of a certain vertex of the image can be obtained, and in the embodiments of the present application, the coordinates of the top-left vertex of the occlusion image are taken as an example for illustration.

[0159] After the image size and the image position are determined, the occlusion image can be generated.

[0160] In some embodiments, the controller can obtain the image position of the occlusion image according to the center point position of the user's head and the user's head size.

[0161] The controller can calculate a first adjustment ratio according to the user's head width and a preset adjustment coefficient, and obtain an adjusted width according to the user's head width and the first adjustment ratio. In addition, the controller can calculate a second adjustment ratio according to the user's head height and the preset adjustment coefficient, and obtain an adjusted height according to the user's head height and the second adjustment ratio.

[0162] It should be noted that the user identified through the target image is a user in the real scene, but is not a user region that can be mapped to the projection surface after the light source irradiates the user, and cannot be directly used as an image size parameter of the occlusion image. Therefore, the detected user information needs to be converted to obtain the occlusion image.

[0163] In the embodiments of the present application, the preset adjustment coefficient is set in advance and is used to represent the conversion coefficient of the detected user parameter and the occlusion image. The preset adjustment coefficient can be set to 160. Through multiple tests of the user shielding the light source, the pixel condition of the user's head projected to the light machine can be obtained, and 160 is the pixel value of the head projected to the light machine when an adult stands about 2-2.5 meters away from the light machine, which can be used as an average condition. The preset adjustment coefficient can be adjusted according to the distance between the projection device and the projection surface, and the smaller the distance, the smaller the preset adjustment coefficient.

[0164] The user's head is made into an ellipse, and the user's head width is the horizontal diameter. The controller can first calculate the horizontal radius, which is half of the user's head width. The controller can calculate the ratio of the horizontal radius to the preset adjustment coefficient as a first adjustment ratio. The controller can calculate the product of the first adjustment ratio and the user's head width as an adjusted width.

[0165] The user head height is the longitudinal diameter of the elliptical head. The controller can first calculate the longitudinal radius, which is half of the user head height. The controller can calculate the ratio of the longitudinal radius and the preset adjustment coefficient, and take the ratio as the second adjustment ratio. The controller can calculate the product of the second adjustment ratio and the user head height, and take the product as the adjustment height.

[0166] The controller can calculate the difference between the horizontal coordinate of the center point of the user head and the adjustment width, and take the difference as the horizontal coordinate of the top left vertex of the occlusion image. The controller can calculate the difference between the vertical coordinate of the center point of the user head and the adjustment height, and take the difference as the vertical coordinate of the top left vertex of the occlusion image. The horizontal and vertical coordinates can be used to determine the vertex position of the occlusion image.

[0167] In some embodiments, the controller can obtain the image size of the occlusion image according to the overall size of the user.

[0168] The controller can calculate the width adjustment ratio according to the user width, and take the ratio of the user width and the preset adjustment coefficient as the width adjustment ratio. In addition, the controller can calculate the height adjustment ratio according to the user height, and take the ratio of the user height and the preset adjustment coefficient as the height adjustment ratio.

[0169] The controller can calculate the product of the user head width and the width adjustment ratio, and obtain the image width of the occlusion image. In addition, the controller can calculate the product of the user head height and the height adjustment ratio, and obtain the image height of the occlusion image.

[0170] After the image size and the image vertex position of the occlusion image are known, the position information of the entire occlusion image is determined.

[0171] In some embodiments, the controller can also obtain the image size of the occlusion image through the distance sensor. The distance sensor can detect the distance between the object to be measured and the projection device, including detecting the distance between the user and the projection device, and detecting the distance between the projection surface and the projection device.

[0172] When the projection device is projecting, the controller can control the distance sensor to detect the interval distance between the projection device and the user and the projection surface according to the second acquisition period. Considering that the user needs to be protected after being detected once, that is, the user parameter needs to be calculated once, the first acquisition period and the second acquisition period can be the same.

[0173] The controller can obtain the first interval distance between the projection device and the user, and the second interval distance between the projection device and the projection surface.

[0174] The controller can calculate a distance ratio, and obtain the user area size according to the user size information and the distance ratio. The distance ratio is a ratio of the second interval distance and the first interval distance, and the user area size is a size of a user area formed in the projection surface by the user blocking.

[0175] Figure 14 A projection scene schematic diagram in some embodiments is shown. As shown in the figure, the projection device projects content that is blocked by the user to form a user area in the projection surface, and the user area size is the actual projection size in the figure. Therefore, according to the scene diagram, the following relationship can be obtained: Figure 14

[0176] Second interval distance / first interval distance=actual projection size / user size

[0177] According to the above relationship, the controller can first calculate the distance ratio of the second interval distance and the first interval distance, and then calculate the product of the user size and the distance ratio, to obtain the actual projection size (i.e., the user area size). Therefore, the controller can calculate the product of the user width and the distance ratio as the user area width. The controller can calculate the product of the user height and the distance ratio as the user area height.

[0178] The controller can set the image size of the blocking image according to the user image size. It should be noted that the blocking image generated in the projection device is used for projection by the projection device, but the blocking image itself is not an image of the real scene, and therefore the image size is not the size in the real scene. In order to facilitate calculation, the size of the projection image in the projection device is set to be the same as the size of the image presented in the projection surface (i.e., the projection area size) in the embodiments of the present application.

[0179] In order to protect the user's eyes, it is necessary to ensure that the blocking image can completely block the user, and the image size of the blocking image can be set to be greater than or equal to the user area size. The width of the blocking image is greater than or equal to the width of the user area, and the height of the blocking image is greater than or equal to the height of the user area.

[0180] In some embodiments, the controller can generate the blocking image based on the image size and the image position.

[0181] The controller can obtain an initial image based on the image size and the image position. The initial image can be a colorless chart or a pure white chart.

[0182] ​To ensure that the shielding image can protect the user, the controller can add shielding content in the initial image to generate the shielding image. The shielding content can be preset pattern content, and the shielding content is content of a specific color. A dark color pattern, such as a black pattern, can be drawn in the shielding image. An image RGB threshold value can be preset, and the RGB value of the shielding content is less than or equal to the image RGB threshold value. Considering the viewing experience of the user, the area outside the shielding content in the shielding image can be set to white or colorless.

[0183] When the projection device projects the shielding image, the dark color pattern in the shielding image can achieve the effect of shielding the user. The light source projects dark color light rays at a low brightness at the dark color pattern of the shielding image, and the light rays do not cause harm to the eyes of the user when irradiating on the user, thereby protecting the user in the light source emitting area.

[0184] Figure 15 A schematic diagram of the shielding image in some embodiments is shown. As shown in the diagram, the projected image of the projection device can be a rectangular image A. The shielding image is located in a partial area of the projected image of the projection device, that is, D in the diagram, and the shielding image includes shielding content with a dark color. Figure 15

[0185] In some embodiments, the controller controls the light emitting assembly to project the shielding image to the projection surface in the process of controlling the light emitting assembly to project the initial picture content to the projection surface.

[0186] To ensure that other users can normally view the picture content, while shielding the user in the light source emitting area using the shielding image, the area outside the shielding image in the shielding image should not affect the user's viewing. To this end, the shielding image only occupies part of the size of the projected image of the projection device, and the size of the initial picture content can be the same as the size of the projected image of the projection device. The projection device can project the initial picture content and the shielding image at the same time.

[0187] To project the two types of content to the projection surface at the same time, the controller can superimpose and synthesize the initial picture content and the shielding image to generate first picture content. The shielding image is located on the upper layer of the initial picture content.

[0188] The controller can control the light emitting assembly to project the first picture content to the projection surface. The first picture content includes the initial picture content and the shielding image, and the shielding image is located on the upper layer of the initial picture content.

[0189] Therefore, the projection device can project the shielding image to the projection surface at the same time as projecting the initial picture content, thereby achieving the effect of shielding the user in the light source emitting area using the shielding image to protect the user's eyes, and maintaining the projection process of the initial picture content so as not to interrupt the viewing process of other users.​

[0190] In some embodiments, considering that there can be multiple users in the projection area, the controller can protect multiple users at this time. The controller can obtain user parameters of each user, and generate a shielding image corresponding to each user. Multiple shielding images are set in the same shielding image to protect multiple users.

[0191] In order to increase the interest of the process, the same shielding content can be set for the same user, and different shielding content can be set for different users.

[0192] When adding shielding content in the initial image, the controller can obtain a first user feature of the target image and a second user feature of a previous target image. The projection device obtains the target image at a certain frame rate, and the previous target image in the embodiment of the present application refers to the previous frame of the target image obtained by the projection device.

[0193] If the first user feature and the second user feature are the same, the controller can add first shielding content in the initial image. The first shielding content is the shielding content in the shielding image corresponding to the previous target image, so that the same user uses the same shielding content.

[0194] If the first user feature and the second user feature are not the same, the controller can add second shielding content in the initial image, and the second shielding content is different from the first shielding content.

[0195] Figure 16 A schematic diagram of multiple shielding contents in some embodiments is shown. As shown in Figure 16 For different users, different shielding contents can be used to generate shielding images.

[0196] In some embodiments, the projection device can detect in real time whether there is a user in the projection area, so as to protect the user in real time.

[0197] After the controller controls the light emitting assembly to project the first picture content to the projection surface, the controller can continue to obtain the target image collected by the image collection device, which is referred to as the current target image in the embodiment of the present application. The controller can detect the user state in the current target image to confirm whether there is a user in the current target image.

[0198] Based on the fact that no user is detected in the current target image, it is indicated that there is no longer a user in the light source emission area, and the controller can control the light emitting assembly to stop projecting the first picture content. At the same time, in order to ensure the viewing process of other users, the controller can control the light emitting assembly to continue projecting the initial picture content to the projection surface.

[0199] Based on detecting that there is a user in the current target image, the controller can acquire a current user parameter according to the current target image, and detect the current user parameter and a user parameter of a previous target image.

[0200] If the current user parameter is the same as the user parameter of the previous target image, it indicates that the same user is in the light source emission area and the user does not move, and the controller can control the light-emitting assembly to continue projecting the first picture content to the projection surface.

[0201] If the current user parameter is different from the user parameter of the previous target image, the user in the light source emission area may change or the same user may move, and the controller can generate a new occlusion image according to the current user parameter, which is referred to as a current occlusion image in the embodiment of the application. The controller can superimpose and synthesize the current occlusion image and the initial picture content to obtain second picture content. The second picture content includes the initial picture content and the current occlusion image, and the current occlusion image is located on the upper layer of the initial picture content. The controller can control the light-emitting assembly to project the second picture content to the projection surface.

[0202] In some embodiments, the projection device can set three models: a standard mode, a following protection mode (also referred to as a first protection mode), and a screen-off protection mode (also referred to as a second protection mode). In the standard mode, the user is not protected, in the following protection mode, the user's eyes are protected by generating an occlusion image, and in the screen-off protection mode, the light source is directly turned off.

[0203] Based on detecting that there is a user in the target image, the controller can acquire a current user protection mode of the projection device.

[0204] If the projection device is in the first protection mode, the controller can acquire a user parameter according to the target image, so as to generate an occlusion image.

[0205] If the projection device is in the second protection mode, the controller can control the light-emitting assembly to stop projecting the content to the projection surface, and turn off the light source.

[0206] The embodiment of the application also provides a projection control method applied to a projection device, and the method comprises the following steps:

[0207] In step S801, in response to a projection instruction, an initial picture content is projected to a projection surface by a light-emitting assembly.

[0208] In step S802, a target image collected by an image collection device is acquired, and a user state in the target image is detected.

[0209] Step S803, based on detecting that there is a user in the target image, acquiring user parameters according to the target image; the user parameters include user size information and user position information;

[0210] Step S804, generating a shielding image according to the user size information and the user position information;

[0211] Step S805, controlling the light-emitting assembly to project first picture content to the projection surface; the first picture content includes the initial picture content and the shielding image, and the shielding image is located on the upper layer of the initial picture content.

[0212] The same and similar parts among various embodiments in the specification can be referred to each other, and will not be described here again.

[0213] Those skilled in the art can clearly understand that the technology in the embodiments of the present application can be realized by means of software and necessary general hardware platforms. Based on such understanding, the technical solutions in the embodiments of the present application can be embodied in the form of a software product, which can be stored in a storage medium, such as a ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute the method of various embodiments or some parts of the embodiments of the present application.

[0214] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement for part or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

[0215] In order to facilitate explanation, the above description has been made in combination with specific embodiments. However, the above exemplary discussion is not intended to exhaust or limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained according to the above teachings. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different modified embodiments suitable for specific use considerations.

Claims

1. A projection device, characterized in that, include: The light-emitting component is configured to project the image content onto the projection surface; An image acquisition device is configured to acquire a target image of the projection surface according to a first acquisition cycle; The controller is configured as follows: In response to the projection command, the light-emitting component is controlled to project the initial image content onto the projection surface; Acquire the target image captured by the image acquisition device, and detect the user status in the target image; Based on the detection of a user in the target image, user parameters are obtained from the target image; the user parameters include user size information and user location information. An occlusion image is generated based on the user size information and the user location information; The light-emitting component is controlled to project the first image content onto the projection surface; the first image content includes the initial image content and the occlusion image, and the occlusion image is located on top of the initial image content.

2. The projection device according to claim 1, characterized in that, After the controller executes the control of the light-emitting component to project the content of the first image onto the projection surface, it is also configured to: Acquire the current target image captured by the image acquisition device, and detect the user status in the current target image; Based on the fact that no user is detected in the current target image, the light-emitting component is controlled to stop projecting the first screen content, and the light-emitting component is controlled to project the initial screen content onto the projection surface; Based on the detection of a user in the current target image, the current user parameters are obtained; If the current user parameters are the same as the user parameters of the previous target image, then the light-emitting component is controlled to continue projecting the content of the first image onto the projection surface; If the current user parameters are different from the user parameters of the previous target image, a current occlusion image is generated based on the current user parameters, and the light-emitting component is controlled to project the second screen content onto the projection surface; the second screen content includes the initial screen content and the current occlusion image, and the current occlusion image is located on top of the initial screen content.

3. The projection device according to claim 1, characterized in that, The controller is configured to generate an occlusion image based on the user size information and the user location information, specifically as follows: The image position of the occluded image is obtained based on the user location information and the user size information; The image size of the occluded image is obtained based on the user size information; An occlusion image is generated based on the image size and the image position.

4. The projection device according to claim 3, characterized in that, The user location information includes the center point of the user's head; the user size information includes the width and height of the user's head; the controller executes the process of obtaining the image position of the occluded image based on the user location information and the user size information, specifically configured as follows: Calculate the first adjustment ratio based on the user's head width and the preset adjustment coefficient, and obtain the adjustment width based on the user's head width and the first adjustment ratio; The second adjustment ratio is calculated based on the user's head height and the preset adjustment coefficient, and the adjustment height is obtained based on the user's head height and the second adjustment ratio; Obtain the vertex position of the occluded image region; wherein, the x-coordinate of the region vertex is calculated based on the x-coordinate of the center point of the user's head and the adjusted width, and the y-coordinate of the region vertex is calculated based on the y-coordinate of the center point of the user's head and the adjusted height.

5. The projection device according to claim 4, characterized in that, The user size information also includes the user width and user height; the controller executes the process of obtaining the image size of the occluded image based on the user size information, specifically configured as follows: The width adjustment ratio is calculated based on the user's width, and the height adjustment ratio is calculated based on the user's height; the width adjustment ratio is the ratio of the user's width to a preset adjustment coefficient, and the height adjustment ratio is the ratio of the user's height to a preset adjustment coefficient. Calculate the width and height of the region obscuring the image; the region width is the product of the user's head width and the width adjustment ratio, and the region height is the product of the user's head height and the height adjustment ratio.

6. The projection device according to claim 3, characterized in that, It also includes a distance sensor, configured to detect the interval distance between the projection device and the user and the projection surface respectively according to the second acquisition cycle; The controller is configured to obtain the image size of the occluded image based on the user size information, specifically as follows: Obtain the first distance between the projection device and the user, and the second distance between the projection device and the projection surface; Calculate the distance ratio and obtain the user area size based on the user size information and the distance ratio; the distance ratio is the ratio of the second interval distance to the first interval distance; the user area size is the size of the user area formed by the user's occlusion in the projection plane; Set the image size of the occluded image according to the user area size.

7. The projection device according to claim 3, characterized in that, The controller is configured to generate an occlusion image based on the image size and the image position, specifically as follows: An initial image is obtained based on the image size and the image position; Occlusion content is added to the initial image to generate an occluded image.

8. The projection device according to claim 7, characterized in that, The controller is configured to add occlusion content to the initial image. Obtain the first user feature of the target image and the second user feature of the previous target image; If the first user feature and the second user feature are the same, then a first occlusion content is added to the initial image; the first occlusion content is the occlusion content in the occlusion image corresponding to the previous target image; If the first user feature and the second user feature are not the same, then a second occlusion content is added to the initial image.

9. The projection device according to claim 1, characterized in that, Based on the detection of a user in the target image, the controller is further configured to: Get the current user protection mode of the projection device; If the projection device is in the first protection mode, then the step of obtaining user parameters based on the target image is executed; If the projection device is in the second protection mode, the light output component will stop projecting content onto the projection surface.

10. A projection control method, characterized in that, Applied to the projection device according to any one of claims 1-9, the method comprises: In response to the projection command, the light-emitting component is controlled to project the initial image content onto the projection surface; Acquire the target image captured by the image acquisition device, and detect the user status in the target image; Based on the detection of a user in the target image, user parameters are obtained from the target image; the user parameters include user size information and user location information. An occlusion image is generated based on the user size information and the user location information; The light-emitting component is controlled to project the first image content onto the projection surface; the first image content includes the initial image content and the occlusion image, and the occlusion image is located on top of the initial image content.

Images