Projection apparatus and projection control method

Abstract

The embodiment of the invention provides projection equipment and a projection control method. In the projection process of the projection equipment, the target image can be acquired through the image acquisition device, and the user state is detected. After it is detected that a user exists in the image, the projection device can obtain user parameters and generate a shielding image capable of shielding the user according to the user parameters. The projection equipment can superpose the original picture content and the shielding image to generate the new picture content, and projects the new picture content to the projection surface, so that the user in the light source emission area is shielded by using the shielding image to protect the eyes of the user, the original image is continuously projected without interrupting the watching process of other users, and the use experience of the user is improved.

Description

Technical Field

[0001] The present application relates to the technical field of projection equipment, and in particular to a projection equipment and a projection control method. Background Art

[0002] A projection device is a display device that can project images or videos onto a screen. The projection device can project laser light of a specific color into the projection area and form a specific image through the refraction of an optical lens assembly. Due to the portability of the projection device, users can move it during the projection process to project images or videos in different directions.

[0003] The projection device can project the picture content onto the projection surface for the user to view the picture content. In order to ensure that the complete image can be displayed on the projection surface, it is necessary to ensure that there are no obstructions in the space between the projection device and the projection surface, so that the projection device can project the complete image onto the projection surface. During the projection process, the user may enter the light source emission area of ​​the projection device, causing the projection light source of the projection device to directly hit the user's eyes and cause damage to the user's eyes. To this end, the projection device can perform human body detection in the light source emission area during the projection process. When a human body is detected in the light source emission area, the projection device can turn off the light source, and turn on the light source again when there is no human body in the light source emission area, so as to protect the users in the light source emission area.

[0004] However, when the projection device turns off the light source, the projection process will be interrupted, and the screen content will not be displayed in the projection area. For users who are not in the light emission area, they may be watching the screen content. If the light source is turned off to interrupt the projection process, these users will not be able to see the screen content, resulting in interruption of the user's viewing process and affecting the user's viewing experience. Summary of the invention

[0005] The present application provides a projection device and a projection control method to solve the problem in the related art that the projection process is interrupted after the projection device turns off the light source, the user cannot see the picture content, and the user's viewing process is interrupted.

[0006] In a first aspect, some embodiments of the present application provide a projection device, including a light emitting component, an image acquisition device, and a controller. The light emitting component is configured to project image content onto a projection surface; the image acquisition device is configured to acquire a target image from the projection surface according to a first acquisition cycle; and the controller is configured to:

[0007] In response to the projection instruction, the light emitting component is controlled to project the initial picture content onto the projection surface;

[0008] Acquire a target image acquired by an image acquisition device, and detect a user state in the target image;

[0009] Based on detecting that there is a user in the target image, obtaining user parameters according to the target image; the user parameters include user size information and user position information;

[0010] Generate an occlusion image according to the user size information and the user position information; the occlusion image includes an occlusion image, and the occlusion image is used to occlude the user;

[0011] In the process of controlling the light emitting component to project the initial picture content onto the projection surface, the light emitting component is controlled to project the shielding image onto the projection surface.

[0012] The above technical solution has the following beneficial effects: after detecting the presence of a user in the image, the projection device can obtain the user parameters and generate a blocking image that can block the user according to the user parameters. The projection device can project the blocking image onto the projection surface while maintaining the original image, thereby using the blocking image to block the user in the light source emission area to protect the user's eyes, and maintaining the projection of the original image without interrupting the viewing process of other users, thereby improving the user experience.

[0013] In some embodiments, after the controller controls the light emitting component to project the first picture content onto the projection surface, the controller is further configured to:

[0014] Acquire a current target image acquired by an image acquisition device, and detect a user state in the current target image;

[0015] Based on the fact that no user is detected in the current target image, controlling the light emitting component to stop projecting the first picture content, and controlling the light emitting component to project the initial picture content onto a projection surface;

[0016] Based on detecting that a user exists in the current target image, obtaining current user parameters;

[0017] If the current user parameter is the same as the user parameter of the previous target image, controlling the light emitting component to continue projecting the first picture content onto the projection surface;

[0018] If the current user parameters are different from the user parameters of the previous target image, a current occluded image is generated according to the current user parameters, and the light-emitting component is controlled to project the second picture content onto the projection surface; the second picture content includes the initial picture content and the current occluded image, and the current occluded image is located on an upper layer of the initial picture content.

[0019] In some embodiments, the controller generates an occlusion image according to the user size information and the user position information, and is specifically configured as follows:

[0020] Acquire the image position of the blocked image according to the user position information and the user size information;

[0021] Acquire the image size of the blocked image according to the user size information;

[0022] An occlusion image is generated based on the image size and the image position.

[0023] The above technical solution has the following beneficial effects: the size and position of the occlusion image are respectively obtained according to the user parameters, thereby generating the occlusion image to protect the user's eyes.

[0024] In some embodiments, the user position information includes the center point position of the user's head; the user size information includes the width of the user's head and the height of the user's head.

[0025] The controller executes acquiring the image position of the blocked image according to the user position information and the user size information, and is specifically configured as follows:

[0026] Calculating a first adjustment ratio according to the user head width and a preset adjustment coefficient, and acquiring an adjustment width according to the user head width and the first adjustment ratio;

[0027] Calculating a second adjustment ratio according to the user's head height and a preset adjustment coefficient, and acquiring an adjustment height according to the user's head height and the second adjustment ratio;

[0028] The position of the regional vertices of the occluded image is obtained; wherein the horizontal coordinate of the regional vertex is calculated according to the horizontal coordinate of the center point of the user's head and the adjusted width, and the vertical coordinate of the regional vertex is calculated according to the vertical coordinate of the center point of the user's head and the adjusted height.

[0029] In some embodiments, the user size information also includes user width and user height.

[0030] The controller executes obtaining the image size of the blocked image according to the user size information, and is specifically configured as follows:

[0031] Calculating a width adjustment ratio according to the user width, and calculating a height adjustment ratio according to the user height; the width adjustment ratio is a ratio of the user width to a preset adjustment coefficient, and the height adjustment ratio is a ratio of the user height to a preset adjustment coefficient;

[0032] Calculate the area width and area height of the occluded image; the area width is the product of the user head width and the width adjustment ratio, and the area height is the product of the user head height and the height adjustment ratio.

[0033] In some embodiments, the projection device further includes a distance sensor configured to detect the interval distances between the projection device and the user and the projection surface respectively according to the second acquisition cycle.

[0034] The controller executes obtaining the image size of the blocked image according to the user size information, and is specifically configured as follows:

[0035] Acquire a first spacing distance between the projection device and the user, and a second spacing distance between the projection device and the projection surface;

[0036] Calculating the distance ratio, and acquiring the user area size according to the user size information and the distance ratio; the distance ratio is the ratio of the second interval distance to the first interval distance; the user area size is the size of the user area formed by being blocked by the user on the projection surface;

[0037] The image size of the occlusion image is set according to the size of the user area.

[0038] The above technical solution has the following beneficial effects: by measuring the distance between the user and the projection device through the distance sensor, the size of the user area projected onto the projection surface by the user is accurately obtained to ensure that the blocking image can completely block the user, thereby improving the protection of the user.

[0039] In some embodiments, the controller generates an occlusion image based on the image size and the image position, and is further configured to:

[0040] Acquire an initial image based on the image size and the image position;

[0041] The occlusion content is added to the initial image to generate an occlusion image.

[0042] The above technical solution has the following beneficial effects: by setting dark-colored occluding content in the occluding image, it is ensured that the occluding image can protect the user's eyes.

[0043] In some embodiments, the controller performs adding the occluded content to the initial image, and is further configured to:

[0044] Acquire a first user feature of the target image and a second user feature of a previous target image;

[0045] If the first user feature and the second user feature are the same, adding a first occluded content to the initial image; the first occluded content is an occluded content in an occluded image corresponding to a previous target image;

[0046] If the first user feature and the second user feature are different, then a second occlusion content is added to the initial image.

[0047] In some embodiments, based on detecting that there is a user in the target image, the controller is further configured to:

[0048] Get the current user protection mode of the projection device;

[0049] If the projection device is in the first protection mode, executing the step of acquiring user parameters according to the target image;

[0050] If the projection device is in the second protection mode, the light emitting component is controlled to stop projecting the content onto the projection surface.

[0051] In a second aspect, some embodiments of the present application provide a projection control method, which is applied to the above-mentioned projection device, and the method includes:

[0052] In response to the projection instruction, the light emitting component is controlled to project the initial picture content onto the projection surface;

[0053] Acquire a target image acquired by an image acquisition device, and detect a user state in the target image;

[0054] Based on detecting that there is a user in the target image, obtaining user parameters according to the target image; the user parameters include user size information and user position information;

[0055] generating an occlusion image according to the user size information and the user position information;

[0056] The light emitting component is controlled to project the first picture content onto the projection surface; the first picture content includes the initial picture content and the blocking image, and the blocking image is located on an upper layer of the initial picture content. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] In order to more clearly illustrate the technical solution of the present application, the drawings required for use in the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0058] Figure 1 A schematic diagram of a projection scene of a projection device in some embodiments is shown;

[0059] Figure 2 A schematic diagram of the optical path of a projection device in some embodiments is shown;

[0060] Figure 3 A schematic diagram of a circuit architecture of a projection device provided by some embodiments is shown;

[0061] Figure 4 A schematic diagram of the structure of a projection device provided in some embodiments is shown;

[0062] Figure 5 A schematic diagram of the lens structure of a projection device provided in some embodiments is shown;

[0063] Figure 6 A schematic diagram of the structure of a distance sensor and an image acquisition device of a projection device provided in some embodiments is shown;

[0064] Figure 7 A schematic diagram of a system framework for implementing display control of a projection device provided in some embodiments is shown;

[0065] Figure 8 A flowchart of the interaction of various components of a projection device in some embodiments is shown;

[0066] Fig. 9 A schematic diagram of a checkerboard chart card in some embodiments is shown;

[0067] Fig.10 A schematic diagram of a doughnut chart card in some embodiments is shown;

[0068] Fig.11 A schematic diagram of a process for obtaining a mapping relationship in some embodiments is shown;

[0069] Fig.12 A schematic diagram of a process of image correction performed by a projection device in some embodiments is shown;

[0070] Fig.13 A schematic diagram showing an image coordinate system corresponding to a target image in some embodiments;

[0071] Fig.14 Schematic diagrams of projection scenes in some embodiments are shown;

[0072] Fig.15 shows a schematic diagram of blocking images in some embodiments;

[0073] Fig.16 A schematic diagram showing multiple occlusion contents in some embodiments is shown. DETAILED DESCRIPTION

[0074] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0075] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0076] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0077] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0078] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0079] The embodiments of the present application can be applied to various types of projection devices. A projection device is a projection device that can project an image or video onto a screen. The projection device can project a laser beam of a specific color onto a screen through the refraction of an optical component to form a specific image. During the projection process, a certain distance can be maintained between the projection device and the screen so that the image formed on the screen can conform to the focal length range of the optical component to obtain a clear image. The following will take a projector as an example to describe the projection device and the projection control method.

[0080] Projectors can be connected to computers, broadcasting networks, the Internet, VCD (Video CompactDisc), DVD (Digital Versatile Disc Recordable), game consoles, DV, etc. through different interfaces to play corresponding video signals. Projectors are widely used in homes, offices, schools, and entertainment venues.

[0081] Figure 1 Schematic diagrams of projection scenes of projection devices in some embodiments are shown. Figure 1 As shown, the projection scene provided by the present application includes a projection screen 1 and a projection device 2. The projection screen 1 is fixed at a first position of the projection surface. For example, a wall can be used as the projection surface, and a curtain can be used as the projection screen and fixed at the first position of the projection surface. The projection device 2 is placed at a second position so that the image projected by it matches the projection screen 1.

[0082] Figure 2 Schematic diagram of the optical path of the projection device in some embodiments is shown. Figure 2 As shown, the projection device 2 includes a light source 100, an optical machine 200 and a lens 300. The light source 100 provides illumination for the optical machine 200, and the optical machine 200 modulates the light beam of the light source and outputs it to the lens 300 for imaging, and projects it onto the projection surface 400 to form a projection screen. Since the light source 100, the optical machine 200, and the lens 300 are used together to emit projection light to project the projection screen, in some embodiments of the present application, the light source 100, the optical machine 200, and the lens 300 are collectively referred to as a light output component.

[0083] In some embodiments, the light source 100 of the projection device 2 includes a light emitter component 110 and an optical lens component 120 . The light beam emitted by the light emitter component 110 can pass through the optical lens component 120 to provide lighting for the optical engine 200 .

[0084] It should be noted that in the embodiment of the present application, the light source 100 may be a laser light source, an LED light source, or a Liquid Crystal Display, i.e., a liquid crystal display LCD light source, and the present application does not specifically limit this. For example, taking the light source 100 as a laser light source as an example, when the light source 100 is a laser light source, in some embodiments, the optical machine 200 of the projection device 2 may be implemented to include a blue optical machine, a green optical machine, a red optical machine, and may also include a heat dissipation system, a circuit control system, etc.

[0085] Figure 3 FIG. 1 is a schematic diagram showing a circuit structure of a projection device provided by some embodiments. Figure 3 As shown, the projection device 2 may include a display control circuit 10, a light source 100, at least one light driving component 30 and at least one brightness sensor 40. Taking the light source 100 as a laser light source as an example, when the light source 100 is a laser light source, the light source 100 may include at least one laser corresponding to the at least one light driving component 30.

[0086] Based on the circuit architecture, the projection device 2 can achieve adaptive adjustment. For example, by setting a brightness sensor 40 in the light output path of the light source 100 , the brightness sensor 40 can detect the first brightness value of the laser light source and send the first brightness value to the display control circuit 10 .

[0087] The display control circuit 10 can obtain the second brightness value corresponding to the driving current of each laser, and when it is determined that the difference between the second brightness value of the laser and the first brightness value of the laser is greater than the difference threshold, it is determined that a COD fault occurs in the laser; the display control circuit can adjust the current control signal of the laser driving component corresponding to the laser until the difference is less than or equal to the difference threshold, thereby eliminating the COD fault of the blue laser; the projection device 2 can eliminate the COD fault of the laser in time, reduce the damage rate of the laser, and improve the image display effect of the projection device 2.

[0088] Figure 4 FIG. 1 shows a schematic diagram of the structure of a projection device provided in some embodiments. Figure 4 As shown, taking the light source 100 in the projection device 2 as a laser light source as an example, the laser light source may include independently arranged blue laser 101, red laser 102 and green laser 103, and the projection device 2 may also be called a three-color projection device, and the blue laser 101, the red laser 102 and the green laser 103 are all module lightweight (Mirai Console Loader, MCL) packaged lasers, which are small in size and are conducive to the compact arrangement of the optical path. It can be understood that the above only takes the light source 100 as a laser light source as an example for exemplary description, and does not limit the light source 100 to a laser light source, but may also be an LED light source, an LCD light source and other forms of light sources.

[0089] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory, ROM), a first interface to an nth interface for input / output, a communication bus (Bus), etc.

[0090] In some embodiments, after the projection device 2 is started, it can directly enter the display interface of the last selected signal source, or the signal source selection interface, where the signal source can be a preset video on demand program, or at least one of an HDMI interface, a live TV interface, etc. After the user selects a different signal source, the projector can display the content obtained from different signal sources.

[0091] In some embodiments, the projection device 2 may be configured with an image acquisition device 700 such as a camera, which is used to work in conjunction with the projection device 2 to achieve adjustment and control of the projection process. For example, the camera configured by the projection device 2 may be specifically implemented as a 3D camera or a binocular camera; when the camera is implemented as a binocular camera, it specifically includes a left camera and a right camera; the binocular camera may obtain the projection medium corresponding to the projection device 2, such as a screen, that is, the image and playback content presented by the projection surface 400, and the image or playback content is projected by the built-in optical machine 200 of the projection device 2.

[0092] The image acquisition device can be used to capture the image displayed on the projection surface 400, and can be a camera. The camera can include a lens assembly, in which a photosensitive element and a lens are provided. The lens refracts light through a plurality of lenses, so that the light of the image of the scene can be irradiated on the photosensitive element.

[0093] Figure 5 Schematic diagram of the lens structure of the projection device provided in some embodiments is shown. In order to support the automatic focusing process of the projection device 2, such as Figure 5 As shown, the lens 300 of the projection device 2 may further include an optical component 310 and a drive motor 320. The optical component 310 is a lens group composed of one or more lenses, which can refract the light emitted by the optical machine 200 so that the light emitted by the optical machine 200 can be transmitted to the projection surface 400 to form a transmission content image.

[0094] The optical assembly 310 may include a lens barrel and a plurality of lenses disposed in the lens barrel. Depending on whether the position of the lens can be moved, the lens in the optical assembly 310 may be divided into a movable lens 311 and a fixed lens 312. By changing the position of the movable lens 311 and adjusting the distance between the movable lens 311 and the fixed lens 312, the overall focal length of the optical assembly 310 may be changed. Therefore, the driving motor 320 may drive the movable lens 311 to move its position by connecting to the movable lens 311 in the optical assembly 310, thereby realizing an automatic focusing function.

[0095] It should be noted that the focusing process described in some embodiments of the present application refers to changing the position of the movable lens 311 by driving the motor 320, thereby adjusting the distance between the movable lens 311 and the fixed lens 312, that is, adjusting the image plane position. Therefore, the imaging principle of the lens combination in the optical component 310, the adjustment of the focal length is actually adjusting the image distance, but in terms of the overall structure of the optical component 310, adjusting the position of the movable lens 311 is equivalent to adjusting the overall focal length of the optical component 310.

[0096] When the distance between the projection device 2 and the projection surface 400 is different, the lens of the projection device 2 needs to adjust different focal lengths to project a clear image on the projection surface 400. During the projection process, the distance between the projection device 2 and the projection surface 400 will require different focal lengths depending on the placement of the user. Therefore, in order to adapt to different usage scenarios, the projection device 2 needs to adjust the focal length of the optical component 310.

[0097] Figure 6 The figure shows a schematic diagram of the distance sensor and image acquisition device of the projection device provided by some embodiments. Figure 6 As shown, the projection device 2 may also have a built-in or external image acquisition device 700, which may be a camera that can capture images of the screen projected by the projection device 2 to obtain a screen content image. The projection device determines whether the current lens focal length is appropriate by performing a clarity detection on the projected content image, and adjusts the focal length when it is not appropriate. When automatically focusing based on the screen content image captured by the camera 700, the projection device may continuously adjust the lens position and take pictures, and find the focusing position by comparing the clarity of the front and rear position pictures, thereby adjusting the movable lens 311 in the optical component to a suitable position. For example, the controller 500 may first control the drive motor 320 to gradually move the focus starting position of the movable lens 311 to the focus end position, and continuously obtain the screen content image through the camera during this period. Then, by performing a clarity detection on multiple screen content images, the position with the highest clarity is determined, and finally the drive motor 320 is controlled to adjust the movable lens 311 from the focus terminal to the position with the highest clarity to complete the automatic focusing.

[0098] The distance sensor 600 can be a sensor device based on the principle of Time of Flight (TOF) such as a laser radar or an infrared radar that can detect the distance of the target, and can detect the interval distance between the projection surface 400 and the optical machine 200. The distance sensor 600 can be set at the position of the optical machine 200, including a signal transmitter and a receiver. During the interval distance detection process, the transmitter of the distance sensor 600 can transmit a wireless signal in the direction of the projection surface. After the wireless signal contacts the projection surface, it will be reflected back to the receiving end of the distance sensor 600, so that the signal flight time is calculated according to the time when the transmitter sends the signal and the time when the receiver receives the signal, and the actual flight distance of the wireless signal can be obtained in combination with the flight speed.

[0099] Figure 7 A schematic diagram of a system framework for implementing display control of a projection device provided in some embodiments is shown. Figure 7As shown, the projection device 2 has the characteristics of a telephoto micro-projector, and the controller can control the display of the projection light image through a preset algorithm to achieve functions such as automatic trapezoidal correction of the display screen, automatic screen entry, automatic obstacle avoidance, automatic focusing, and anti-eye-shooting.

[0100] In some embodiments, the projection device 2 is configured with a gyroscope sensor; when the device is moving, the gyroscope sensor can sense the position movement and actively collect movement data; then the collected data is sent to the application service layer through the system framework layer to support the application data required during the user interface interaction and application interaction process. The collected data can also be used for data calls by the controller in the algorithm service implementation.

[0101] In some embodiments, the projection device 2 is configured with a time-of-flight sensor. After the time-of-flight sensor collects corresponding data, the data will be sent to the corresponding time-of-flight service of the service layer; after the above-mentioned time-of-flight service obtains the data, it will send the collected data to the application service layer through the process communication framework, and the data will be used for interactive use such as controller data calls, user interfaces, and program applications.

[0102] In some embodiments, the image acquisition device 700 configured for the projection device 2 can be a binocular camera, a depth camera or a 3D camera, etc.; the image acquisition device 700 collects data and sends it to the camera service, and then the camera service sends the collected image data to the process communication framework and / or the projection device correction service; the projection device correction service can receive the camera acquisition data sent by the camera service, and the controller can call the corresponding control algorithm in the algorithm library according to the different functions to be implemented.

[0103] In some embodiments, data is interacted with the application service through the process communication framework, and then the calculation results are fed back to the correction service through the process communication framework; the correction service sends the obtained calculation results to the projection device 2 operating system to generate control signals, and sends the control signals to the optical machine 200 control drive to control the working condition of the optical machine 200 and realize automatic correction of the displayed image.

[0104] In some embodiments, when an image correction instruction is detected, the projection device 2 can correct the screen content. For the correction of the screen content, an association relationship between the distance, the horizontal angle, and the offset angle can be created in advance. Then the controller in the projection device 2 obtains the current distance from the optical machine 200 to the projection surface 400, and determines the angle between the optical machine 200 and the projection surface 400 at this moment in combination with the associated relationship, thereby achieving screen content correction. Among them, the angle is specifically implemented as the angle between the central axis of the optical machine 200 and the projection surface 400.

[0105] In some embodiments, the projection device 2 automatically completes the calibration and refocuses, and the controller will detect whether the automatic focus function is turned on; when the automatic focus function is not turned on, the controller will end the automatic focus service; when the automatic focus function is turned on, the projection device 2 will obtain the detection distance of the time-of-flight sensor through the middleware for calculation.

[0106] The controller queries the preset mapping table according to the acquired distance to obtain the focal length of the projection device 2; then the middleware sets the acquired focal length to the optical machine 200 of the projection device 2; wherein the middleware is a series of applications for the focus control process. After the optical machine 200 emits laser light at the above focal length, the camera will execute the photo command; the controller determines whether the focus process of the projection device 2 is completed according to the acquired captured image and the evaluation function.

[0107] If the judgment result meets the preset completion conditions, the control of the automatic focusing process ends; if the judgment result does not meet the preset completion conditions, the middleware will fine-tune the focal length parameters of the projection device 2 optical machine 200, for example, the focal length can be gradually fine-tuned with a preset step length, and the adjusted focal length parameters will be set to the optical machine 200 again; thereby achieving repeated photo taking and clarity evaluation steps, and finally finding the optimal focal length through clarity comparison to complete automatic focusing.

[0108] In some embodiments, the projection device can project the screen content onto the projection surface for the user to view the screen content. For example, the user can pre-set the screen content, which can be a media image, and instruct the projection device to project the media image. The projection device can project the media image onto the projection surface, which can be a curtain or wall in front of the projection device.

[0109] When there is an obstacle between the projection device and the projection surface, the content projected by the projection device may be blocked by the obstruction, resulting in the inability to display the complete image on the projection surface, seriously affecting the user's viewing experience. Therefore, in order to ensure that the complete image can be displayed on the projection surface, it is necessary to ensure that there is no obstruction between the projection device and the projection surface.

[0110] The obstruction may be a fixed object. For example, if the user places the projection device on the desktop, other objects placed on the desktop or objects between the desktop and the projection surface may block the light source of the projection device, requiring the user to move these objects away. The obstruction may also be a user. For example, during the projection process, a user may pass through the area between the projection device and the projection surface, and enter the light source emission area of ​​the projection device, thereby blocking the image projected by the projection device.

[0111] It should be noted that when a user enters the light source emission area of ​​the projection device, the projection light source of the projection device may directly shine into the user's eyes, and the high-power projection light source may cause damage to the user's eyes. For this reason, the projection device may be provided with a user protection function to protect the user's eyes.

[0112] During the projection process, the projection device can perform human detection on the projection area. The projection device can take photos of the projection area through a camera, and perform human target detection based on the image data collected by the camera, so as to determine whether there is a human target intruding between the projection surface and the projection device. When there is a human target intruding, the projection device can turn on the anti-radiation eye function, and when there is no human target intruding, the projection device can turn off the anti-radiation eye function. Among them, the anti-radiation eye function refers to the operation of triggering the projection device to automatically adjust the projection brightness of the light emitting component, including reducing the projection brightness of the light emitting component, and adjusting the projection brightness of the light emitting component to at least one of the preset projection brightness.

[0113] Taking into account that each user may have different sensitivities to the projection light source, some users can adapt to light sources with higher brightness, while some users may not adapt to light sources with lower brightness. To protect all users, the projection device's anti-eye function can be set to adjust the projection brightness of the light-emitting component to 0. That is, when a human body is detected in the light source emitting area, the projection device can turn off the light source, and turn on the light source again when it detects that no human body appears in the light source emitting area, so as to protect the eyes of users in the light source emitting area.

[0114] It should be noted that when the projection device turns off the light source, the projection process will be interrupted, and the screen content will not be displayed in the projection area. For users who are not in the light emission area, they may be watching the screen content. If the projection process is interrupted after the light source is turned off, these users will not be able to see the screen content, thereby interrupting the user's viewing process and affecting the user's viewing experience.

[0115] The projection device provided in some embodiments of the present application can protect users in the light source emission area while maintaining the projection device projecting an image. During the projection process, the projection device can capture the target image through the image acquisition device and detect the user status. After detecting the presence of a user in the image, the projection device can obtain user parameters and generate a blocking image that can block the user according to the user parameters. The projection device can superimpose the original screen content and the blocking image to generate a new screen content, and project the new screen content onto the projection surface, so as to use the blocking image to block the user in the light source emission area to protect the user's eyes, and continue to project the original image without interrupting the viewing process of other users, thereby improving the user experience.

[0116] Figure 8A flowchart of the interaction of various components of the projection device in some embodiments is shown, including the following steps:

[0117] S801, in response to a projection instruction, controlling the light emitting component to project the initial picture content onto a projection surface;

[0118] S802, acquiring a target image acquired by an image acquisition device, and detecting a user state in the target image;

[0119] S803, based on detecting that there is a user in the target image, obtaining user parameters according to the target image; the user parameters include user size information and user location information;

[0120] S804, generating an occlusion image according to the user size information and the user position information;

[0121] S805, controlling the light emitting component to project the first picture content onto the projection surface; the first picture content includes the initial picture content and the blocking image, and the blocking image is located on an upper layer of the initial picture content.

[0122] In some embodiments, the user can input a projection instruction to the projection device to instruct the projection device to project the image content set by the user. In the embodiments of the present application, the content that the user specifies the projection device to project is referred to as the initial screen content. In response to the projection instruction, the controller of the projection device can control the light emitting component to project the initial screen content onto the projection surface.

[0123] In some embodiments, the projection device can project the image into a projection area pre-set by the user. The projection area set by the user can be a certain area of ​​the wall or a screen placed in advance by the user. The complete picture content can be displayed in the projection area for the user to watch.

[0124] The user can manually adjust the position and projection angle of the projection device so that the image content is completely in the projection area. However, this manual adjustment method is cumbersome and has poor accuracy. To this end, the projection device provided in the embodiment of the present application can be provided with an automatic entry function. The automatic entry function means that the projection device can automatically determine the projection area in the projection surface and project the image content to be projected into the projection area, thereby avoiding the user manually adjusting the angle and position of the projection device to improve the user experience.

[0125] When executing automatic screen entry, the controller can first construct a transformation matrix between the world coordinate system and the optical machine coordinate system based on the binocular camera. The transformation matrix can represent the homography relationship between the picture content in the projection surface and the playback image card played by the optical machine. The homography relationship can be used to realize any projection transformation between the picture content and the playback image card.

[0126] The controller can first control the light emitting component to project the first image card onto the projection surface. The first image card can contain a number of feature points, so the first image captured by the camera will also contain all the feature points in the first image card, and the position information of the projection surface can be determined through the feature points. It should be noted that for a plane, when the positions of three points in the plane are determined, the position information of the plane can be determined. Therefore, in order to determine the position information of the projection surface, it is necessary to determine the positions of at least three points in the projection surface, that is, the first image card needs to include at least three feature points.

[0127] In some embodiments, the first picture card may include patterns and color features preset by the user. Fig. 9 Schematic diagrams of checkerboard graphics cards in some embodiments are shown. Fig. 9 As shown, the first image card may be a checkerboard image card, the checkerboard image card is set as a black and white checkerboard, and the feature points included in the checkerboard image card are the corner points of a rectangle. Fig.10 Schematic diagrams of donut chart cards in some embodiments are shown. Fig.10 As shown, the first picture card can also be set as a donut picture card, and the characteristic points contained in the donut picture card are corresponding solid points on each circle. In some embodiments, the first picture card can also be set as a combination of the above two types of patterns, or set as other patterns with identifiable characteristic points.

[0128] Fig.11 A schematic diagram of a process for obtaining a mapping relationship in some embodiments is shown.

[0129] In some embodiments, the controller can control the camera to shoot the first image card displayed on the projection surface to obtain a first image, and obtain the position of the feature point in the first image. The camera can be a binocular camera, through which the first image card is shot, the left camera shoots to obtain one image, and the right camera shoots to obtain another image.

[0130] The controller can perform image recognition processing on the two images to obtain the first coordinates of the feature points in the images. The first coordinates refer to the coordinate information of the feature points in the image coordinate system corresponding to the first image.

[0131] For the same feature point, its position in the image captured by the left camera and its position in the image captured by the right camera may be different. The coordinates of the feature point in the camera coordinate system of either the left or right camera can be determined by the two positions of the same feature point in the two images. In the embodiment of the present application, the second coordinate is used to represent the coordinate information of the feature point in the camera coordinate system.

[0132] According to the position information of the same feature point in the two images captured by the left and right cameras, the controller can obtain the second coordinate of the feature point in the camera coordinate system of either camera. The controller can convert the second coordinate into a third coordinate. In the embodiment of the present application, the third coordinate refers to the coordinate information of the feature point in the optical-mechanical coordinate system.

[0133] It should be noted that the optomechanical coordinate system and the camera coordinate system can be converted to each other, so the coordinates of the feature point in the camera coordinate system can be converted to the coordinates in the optomechanical coordinate system. According to the external parameters between the optomechanical camera and the camera, the conversion relationship between the optomechanical coordinate system and the camera coordinate system can be determined, and the third coordinate of the feature point in the optomechanical coordinate system can be obtained.

[0134] The controller may obtain the projection surface equation of the projection surface in the optomechanical coordinate system according to the third coordinate of the feature point in the optomechanical coordinate system. The controller may obtain the third coordinates of at least three feature points in the first image in the optomechanical coordinate system, and fit the third coordinates to obtain the projection surface equation of the projection surface in the optomechanical coordinate system.

[0135] The controller can obtain the transformation matrix between the optomechanical coordinate system and the world coordinate system according to the projection surface equation. The transformation matrix can represent the projection relationship between the optomechanical projection chart and the projection surface, thereby realizing the transformation of the coordinates of a certain point between the world coordinate system and the optomechanical coordinate system.

[0136] For the projection area that has been determined in the projection surface, its coordinate representation in the world coordinate system can be determined, and the controller can obtain the position information of the projection area in the optical-mechanical coordinate system according to the transformation matrix, thereby projecting the image to the projection area.

[0137] In some embodiments, considering that the user may actively move the projection device or accidentally touch the projection device during the use of the projection device, causing the placement posture or position of the projection device to change, the position of the image projected by the projection device will change. In this case, in order to ensure that the projection continues to be projected to the projection area, the projection device can automatically perform image correction.

[0138] The projection device includes a gyroscope sensor, which can detect whether the projection device is displaced during the projection process. Fig.12 FIG. 2 shows a schematic diagram of a process flow of image correction performed by a projection device in some embodiments. Fig.12As shown, the gyroscope sensor can collect the displacement signal of the projection device, and can send movement prompt information to the controller when the movement of the projection device is detected. In response to the movement prompt information, the controller can perform image correction on the picture content projected by the light-emitting component to the projection surface. The image correction step can adopt the aforementioned automatic screen entry process, which will not be repeated here. After image correction, the controller controls the light-emitting component to adjust the projection information, so as to re-project the picture content to the projection area.

[0139] In some embodiments, there may be no pre-set projection area in the projection surface, and the projection device can directly project the image content onto the projection surface. To ensure the complete display of the image, the projection device can perform obstacle avoidance processing.

[0140] The controller can control the light emitting component to project a white card onto the projection surface, and control the camera to shoot the projection surface to detect obstacles in the image corresponding to the white card. In the case of obstacles, the controller can obtain the projection screen area after avoiding the obstacles, thereby achieving obstacle avoidance of the projection screen.

[0141] In some embodiments, after the projection device projects the initial screen content onto the projection surface, the controller may detect the user during the projection process to protect the user's eyes. During the projection process, the controller may control the image acquisition device to acquire image data of the projection surface according to a first acquisition cycle. In the embodiment of the present application, the image acquired by the image acquisition device is referred to as a target image. The image acquisition device may be a camera, and the image data captured by the camera may be RGB image data, but is not limited to data in other formats such as YUV, nor is it limited to the size of the resolution.

[0142] The controller may acquire the target image acquired by the image acquisition device, and detect the user status in the target image to determine whether there is a user in the projection area.

[0143] It should be noted that the technical solution of the present application is described by taking a human target as an example in the embodiments of the present application. It should be understood that the technical solution provided by the embodiments of the present application is not limited to a human target, and other targets can also be detected according to actual needs.

[0144] The controller may perform human body recognition on the target image to determine whether a user is present. The controller may extract image features of the target image and perform analysis to determine whether a human body is present in the image.

[0145] In some embodiments, the controller can input the target image into a pre-built mask model to detect the target. The mask model is an encoder and decoder that recognizes the target contour based on pixels. The encoder and decoder refer to an image processing process, that is, the original image is encoded into a vector array with abstract features through the encoder, and then the vector array is decoded into another form of image through the decoder.

[0146] Based on the mask model, the target outline in the target image can be identified, so as to obtain the mask image output by the mask model. Among them, the mask image includes a first pixel value and a second pixel value, the first pixel value is used to characterize the target, and the second pixel value is used to characterize the non-target. The area of ​​the first pixel value is extracted in the mask image to obtain the target mask. For example. The mask image can be a grayscale image marking a human target, and the image matrix of the grayscale image includes two types of data 0 / 1 or 0 / 255, 0 represents a non-human target (background), 1 or 255 represents a human target, and the area of ​​data 1 or 255 is the target mask. The target mask can be identified and segmented by the encoder and decoder, so as to determine the human area.

[0147] For each pixel of the image, it can be determined whether it is a human target, so that when non-human target interference objects such as chairs and clothes enter the projection area, protection will not be provided. Only when human targets enter the projection area can protection be provided, and part of the human target's body (such as fingers, half of the face, etc.) entering the projection area can also be detected, thereby protecting the user.

[0148] It should be noted that the encoder and decoder described in the embodiments of the present application can also be implemented using image feature extraction calculation methods, such as SIFT (Scale Invariant Feature Transform) and HOG (Histogram of Oriented Gradients). It can also be implemented using matrix operations of SVM (Support Vector Machine). It can also be implemented by the calculation method of convolutional neural network or Transformer. This application does not specifically limit this.

[0149] In some embodiments, based on detecting the presence of a user in the target image, the controller may protect the user. The controller may first obtain user parameters based on the target image. The controller may determine a human body region in the target image and obtain user parameters corresponding to the human body region. The user parameters include user size information and user location information. The user size information is the height and width of the user, and the user location information is the coordinate information of the user in the target image.

[0150] The user size information can be divided into the user's overall size and the user's head size. The user's overall size includes the user's width and the user's height, and the user's head size includes the user's head width and the user's head height.

[0151] The user position information may include the center point of the user's head. For the target image, an image coordinate system may be constructed. The image coordinate system may use the upper left corner vertex of the projection area as the origin, the horizontal direction to the right as the X axis, and the vertical direction downward as the Y axis. The controller may obtain the coordinates of the center point of the user's head.

[0152] It should be noted that only part of the user's body may appear in the projection area, so the target image may not contain the user's complete human body area, but only part of the human body area. In the embodiment of the present application, the human body area that does not appear in the target image is not considered, and only the human body area that exists in the target image is used for parameter detection, that is, the parameters of the human body area in the image are regarded as user parameters.

[0153] Fig.13 Schematic diagram of the image coordinate system corresponding to the target image in some embodiments is shown. Fig.13 As shown, the top left vertex of the target image P is the origin of the coordinate system O. The user's body is detected in the target image, the leftmost x coordinate of the user is xz1, the rightmost x coordinate of the user is xz2, the top y coordinate of the user is yt1, and the bottom y coordinate of the user is y1. Therefore, the detected user height is y1-yt1, and the user width is xz2-xz1.

[0154] The leftmost x-coordinate of the user's head is xt1, the leftmost x-coordinate of the user's entire head is xt2, and the y-coordinate of the bottom of the user's head is yt2. Therefore, the detected width of the user's head is xt2-xt1, and the height of the user's head is yt2-yt1.

[0155] The controller can obtain the coordinates of the center point T of the user's head as (x0, y0).

[0156] In some embodiments, the controller may generate an occlusion image based on the user size information and the user position information. The occlusion image may be provided with occlusion content. Compared with other areas where the projection device projects the image, the RGB value at the occlusion content is lower. Therefore, the light projected at the occlusion content is darker, which can play a role in shielding the user. When the projection device projects the occlusion image, the light at the occlusion image is irradiated on the user in the light source emission area, achieving the effect of shielding the user. Parameters such as the brightness of the light projected at the occlusion content will be greatly reduced, so that the brightness of the light irradiated at the user's eyes is weaker and the light is darker, thereby achieving the effect of protecting the user's eyes.

[0157] When generating the occlusion image, the controller may acquire the image position of the occlusion image according to the user position information and the user size information, and the controller may acquire the image size of the occlusion image according to the user size information. The controller may generate the occlusion image based on the image size and the image position.

[0158] In the embodiment of the present application, the occlusion image is set as a rectangular area, which can be located in a partial area of ​​the image projected by the projection device, and the image size of the occlusion image includes the image width and the image height. For a rectangular area, after determining the coordinates of a point in the area, the position of the entire area can be determined. Therefore, when obtaining the image position, the coordinates of a vertex of the image can be obtained. In the embodiment of the present application, obtaining the coordinates of the upper left corner vertex of the occlusion image is used as an example for explanation.

[0159] After the image size and image position are determined, the occlusion image can be generated.

[0160] In some embodiments, the controller may obtain the image position of the occluded image based on the center point position of the user's head and the size of the user's head.

[0161] The controller may calculate a first adjustment ratio according to the width of the user's head and a preset adjustment coefficient, and obtain an adjustment width according to the width of the user's head and the first adjustment ratio. Also, the controller may calculate a second adjustment ratio according to the height of the user's head and a preset adjustment coefficient, and obtain an adjustment height according to the height of the user's head and the second adjustment ratio.

[0162] It should be noted that the user identified by the target image is a user in the real scene, but it is not the user area that can be mapped to the projection surface after the light source illuminates the user, nor can it be directly used as parameters such as the image size of the occlusion image. Therefore, it is necessary to convert the user information detected to obtain the occlusion image.

[0163] In the embodiment of the present application, an adjustment coefficient is pre-set to characterize the conversion coefficient of the detected user parameters and the occluded image, and the preset adjustment coefficient can be set to 160. After multiple tests of users blocking the light source, the pixel situation projected by the user's head to the light machine can be obtained, where 160 is the pixel value projected by the head of an adult when standing about 2-2.5 meters away from the light machine, which can be expressed as an average situation. The preset adjustment coefficient can be adjusted according to the distance between the projection device and the projection surface. The smaller the distance, the smaller the preset adjustment coefficient can be set.

[0164] The user's head is made into an ellipse, and the width of the user's head is the transverse diameter. The controller can first calculate the transverse radius, which is half of the width of the user's head. The controller can calculate the ratio of the transverse radius and the preset adjustment coefficient as the first adjustment ratio. The controller can calculate the product of the first adjustment ratio and the width of the user's head as the adjustment width.

[0165] The height of the user's head is the longitudinal diameter of the elliptical head. The controller may first calculate the longitudinal radius, which is half of the height of the user's head. The controller may calculate the ratio of the longitudinal radius to the preset adjustment coefficient as the second adjustment ratio. The controller may calculate the product of the second adjustment ratio and the height of the user's head as the adjustment height.

[0166] The controller can calculate the difference between the horizontal coordinate of the center point of the user's head and the adjusted width as the horizontal coordinate of the vertex in the upper left corner of the occluded image. The controller can calculate the difference between the vertical coordinate of the center point of the user's head and the adjusted height as the vertical coordinate of the vertex in the upper left corner of the occluded image. The vertex position of the occluded image can be determined according to the horizontal and vertical coordinates.

[0167] In some embodiments, the controller may obtain the image size of the occluded image according to the overall size of the user.

[0168] The controller may calculate the width adjustment ratio according to the user width, and use the ratio of the user width to the preset adjustment coefficient as the width adjustment ratio. Also, the controller may calculate the height adjustment ratio according to the user height, and use the ratio of the user height to the preset adjustment coefficient as the height adjustment ratio.

[0169] The controller may calculate the product of the width of the user's head and the width adjustment ratio to obtain the image width of the occluded image. Also, the controller may calculate the product of the height of the user's head and the height adjustment ratio to obtain the image height of the occluded image.

[0170] Once the image size and image vertex positions of the occlusion image are known, the position information of the entire occlusion image is determined.

[0171] In some embodiments, the controller may also obtain the image size of the occluded image through a distance sensor. The distance sensor may detect the distance between the object to be measured and the projection device, including detecting the distance between the user and the projection device, and detecting the distance between the projection surface and the projection device.

[0172] When the projection device is projecting, the controller can control the distance sensor to detect the distance between the projection device and the user and the projection surface according to the second acquisition cycle. Considering that the user needs to be protected each time the user is detected, that is, the user parameters need to be calculated once, the first acquisition cycle and the second acquisition cycle can be the same.

[0173] The controller may acquire a first spacing distance between the projection device and the user, and a second spacing distance between the projection device and the projection surface.

[0174] The controller may calculate the distance ratio and obtain the user area size according to the user size information and the distance ratio, wherein the distance ratio is the ratio of the second spacing distance to the first spacing distance, and the user area size is the size of the user area formed by being blocked by the user in the projection surface.

[0175] Fig.14 Schematic diagrams of projection scenes in some embodiments are shown. Fig.14 As shown, when the projection content of the projection device is blocked by the user, a user area will be formed on the projection surface. The size of the user area is the actual projection size in the figure. Therefore, according to the scene graph, the following relationship can be obtained:

[0176] Second spacing distance / first spacing distance=actual projection size / user size;

[0177] According to the above relationship, the controller can first calculate the distance ratio of the second spacing distance to the first spacing distance, and then calculate the product of the user size and the distance ratio to obtain the actual projection size (i.e., the user area size). Therefore, the controller can calculate the product of the user width and the distance ratio as the user area width. The controller can calculate the product of the user height and the distance ratio as the user area height.

[0178] The controller can set the image size of the occlusion image according to the user image size. It should be noted that the occlusion image generated in the projection device is used for projection by the projection device, but the occlusion image itself is not an image of the real scene, so the image size is not the size of the real scene. For the convenience of calculation, the embodiment of the present application sets the size of the projected image in the projection device to be the same as the image size presented in the projection surface (i.e., the projection area size).

[0179] To protect the user's eyes, it is necessary to ensure that the occlusion image can completely block the user, and the image size of the occlusion image can be set to be greater than or equal to the user area size. Among them, the width of the occlusion image is greater than or equal to the width of the user area, and the height of the occlusion image is greater than or equal to the height of the user area.

[0180] In some embodiments, the controller may generate the occlusion image based on the image size and the image position.

[0181] The controller may obtain an initial image based on an image size and an image position. The initial image may be a colorless image card or a pure white image card.

[0182] To ensure that the occluded image can protect the user, the controller can add occluded content to the initial image to generate an occluded image. The occluded content can be a preset pattern content, and the occluded content is a content of a specific color, and a dark pattern, such as a black pattern, can be drawn in the occluded image. The image RGB threshold can be pre-set, and the RGB value of the occluded content is less than or equal to the image RGB threshold. Considering the user's viewing experience, the area outside the occluded content in the occluded image can be set to white or colorless.

[0183] When the projection device projects a blocking image, the dark pattern in the blocking image can achieve the effect of blocking the user. The dark light projected by the light source through the dark pattern of the blocking image has a lower brightness and will not cause damage to the user's eyes when irradiated on the user, thereby protecting the user in the light source emission area.

[0184] Fig.15 Schematic diagrams of blocking images in some embodiments are shown. Fig.15 As shown, the image projected by the projection device may be a rectangular image A. The blocking image is located in a partial area of ​​the image projected by the projection device, namely D in the figure, and the blocking image includes dark-colored blocking content.

[0185] In some embodiments, the controller controls the light emitting component to project the blocked image onto the projection surface while controlling the light emitting component to project the initial picture content onto the projection surface.

[0186] To ensure that other users can view the screen content normally, while using the blocking image to block the users in the light source emission area, it is also necessary to ensure that the area outside the blocking image in the blocking image does not affect the user's viewing. To this end, the blocking image only occupies part of the size of the image projected by the projection device, and the size of the initial screen content can be the same as the size of the image projected by the projection device. The projection device can project the initial screen content and the blocking image at the same time.

[0187] In order to project the two contents onto the projection surface at the same time, the controller may superimpose and synthesize the initial screen content and the occlusion image to generate the first screen content, wherein the occlusion image is located on an upper layer of the initial screen content.

[0188] The controller can control the light emitting component to project the first picture content onto the projection surface, wherein the first picture content includes the initial picture content and the occlusion image, and the occlusion image is located on the upper layer of the initial picture content.

[0189] Therefore, the projection device can project the occlusion image onto the projection surface while maintaining the projection of the initial screen content, thereby utilizing the occlusion image to shield users in the light source emission area to protect the user's eyes, and maintaining the projection process of the initial screen content so as not to interrupt the viewing process of other users.

[0190] In some embodiments, considering that there may be multiple users in the projection area, the controller can protect multiple users. The controller can obtain user parameters of each user and generate a shielding image corresponding to each user. Multiple shielding images are set in the same shielding image to protect multiple users.

[0191] In order to increase the interest of the process, it can be set that the same user uses the same occlusion content, and different users use different occlusion contents.

[0192] When adding occluded content to the initial image, the controller can obtain the first user feature of the target image and the second user feature of the previous target image. The projection device will obtain the target image at a certain frame rate. In the embodiment of the present application, the previous target image refers to the previous frame target image obtained by the projection device.

[0193] If the first user feature and the second user feature are the same, the controller may add a first occlusion content to the initial image. The first occlusion content is an occlusion content in an occlusion image corresponding to a previous target image, so that the same user uses the same occlusion content.

[0194] If the first user feature and the second user feature are different, the controller may add a second occlusion content to the initial image, where the second occlusion content is different from the first occlusion content.

[0195] Fig.16 Schematic diagrams of multiple occlusion contents in some embodiments are shown. Fig.16 As shown, for different users, different occlusion contents can be used to generate occlusion images.

[0196] In some embodiments, the projection device can detect in real time whether there is a user in the projection area, thereby protecting the user in real time.

[0197] After controlling the light emitting component to project the first screen content onto the projection surface, the controller can continue to acquire the target image acquired by the image acquisition device, which is referred to as the current target image in the embodiment of the present application. The controller can detect the user status in the current target image to confirm whether there is a user in the current target image.

[0198] Since no user is detected in the current target image, indicating that there is no user in the light source emission area, the controller can control the light emitting component to stop projecting the first picture content. At the same time, to ensure the viewing process of other users, the controller can control the light emitting component to continue to project the initial picture content to the projection surface.

[0199] Based on detecting that there is a user in the current target image, the controller may obtain current user parameters according to the current target image, and detect the current user parameters and user parameters of a previous target image.

[0200] If the current user parameters are the same as the user parameters of the previous target image, it means that the same user is in the light source emission area and the user has not moved. The controller can control the light emitting component to continue projecting the first picture content onto the projection surface.

[0201] If the current user parameters are different from the user parameters of the previous target image, the user may have changed in the light source emission area, or the same user may have moved. The controller can generate a new occlusion image based on the current user parameters, which is referred to as the current occlusion image in the embodiment of the present application. The controller can superimpose the current occlusion image and the initial screen content to obtain the second screen content. The second screen content includes the initial screen content and the current occlusion image, and the current occlusion image is located on the upper layer of the initial screen content. The controller can control the light emitting component to project the second screen content onto the projection surface.

[0202] In some embodiments, the projection device can be set to three modes: standard mode, follow-up protection mode (also called first protection mode) and screen-off protection mode (also called second protection mode). In the standard mode, no protection is provided to the user, in the follow-up protection mode, a shielding image is generated to protect the user's eyes, and in the screen-off protection mode, the light source is directly turned off.

[0203] After detecting that a user exists in the target image, the controller can obtain the current user protection mode of the projection device.

[0204] If the projection device is in the first protection mode, the controller may obtain user parameters according to the target image, thereby generating a shielding image.

[0205] If the projection device is in the second protection mode, the controller can control the light output component to stop projecting content onto the projection surface and turn off the light source.

[0206] The embodiment of the present application also provides a projection control method, which is applied to a projection device, and the method includes:

[0207] Step S801, in response to a projection instruction, controlling the light emitting component to project the initial picture content onto a projection surface;

[0208] Step S802: acquiring a target image acquired by an image acquisition device, and detecting a user state in the target image;

[0209] Step S803: based on detecting that a user exists in the target image, obtaining user parameters according to the target image; the user parameters include user size information and user position information;

[0210] Step S804: generating an occlusion image according to the user size information and the user position information;

[0211] Step S805, controlling the light emitting component to project the first picture content onto the projection surface; the first picture content includes the initial picture content and the blocking image, and the blocking image is located on an upper layer of the initial picture content.

[0212] The same and similar parts between the various embodiments in this specification can be referenced to each other and will not be described again here.

[0213] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of various embodiments of the present invention or certain parts of the embodiments.

[0214] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0215] For ease of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are intended to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A projection device, characterized in that: include: A light emitting component is configured to project image content onto a projection surface; An image acquisition device, configured to acquire a target image from the projection surface according to a first acquisition cycle; The controller is configured as: In response to the projection instruction, the light emitting component is controlled to project the initial picture content onto the projection surface; Acquire a target image acquired by an image acquisition device, and detect a user state in the target image; Based on detecting that there is a user in the target image, obtaining user parameters according to the target image; the user parameters include user size information and user position information; generating an occlusion image according to the user size information and the user position information; The light emitting component is controlled to project the first picture content onto the projection surface; the first picture content includes the initial picture content and the blocking image, and the blocking image is located on an upper layer of the initial picture content.

2. The projection device according to claim 1, characterized in that: After the controller controls the light emitting component to project the first picture content onto the projection surface, the controller is further configured to: Acquire a current target image acquired by an image acquisition device, and detect a user state in the current target image; Based on the fact that no user is detected in the current target image, controlling the light emitting component to stop projecting the first picture content, and controlling the light emitting component to project the initial picture content onto a projection surface; Based on detecting that a user exists in the current target image, obtaining current user parameters; If the current user parameter is the same as the user parameter of the previous target image, controlling the light emitting component to continue projecting the first picture content onto the projection surface; If the current user parameters are different from the user parameters of the previous target image, a current occluded image is generated according to the current user parameters, and the light-emitting component is controlled to project the second picture content onto the projection surface; the second picture content includes the initial picture content and the current occluded image, and the current occluded image is located on an upper layer of the initial picture content.

3. The projection device according to claim 1, characterized in that: The controller generates an occlusion image according to the user size information and the user position information, and is specifically configured as follows: Acquire the image position of the blocked image according to the user position information and the user size information; Acquire the image size of the blocked image according to the user size information; An occlusion image is generated based on the image size and the image position.

4. The projection device according to claim 3, characterized in that: The user position information includes the center point position of the user's head; the user size information includes the width and height of the user's head; the controller executes the acquisition of the image position of the occluded image according to the user position information and the user size information, and is specifically configured as follows: Calculating a first adjustment ratio according to the user head width and a preset adjustment coefficient, and acquiring an adjustment width according to the user head width and the first adjustment ratio; Calculating a second adjustment ratio according to the user's head height and a preset adjustment coefficient, and acquiring an adjustment height according to the user's head height and the second adjustment ratio; The position of the regional vertices of the occluded image is obtained; wherein the horizontal coordinate of the regional vertex is calculated according to the horizontal coordinate of the center point of the user's head and the adjusted width, and the vertical coordinate of the regional vertex is calculated according to the vertical coordinate of the center point of the user's head and the adjusted height.

5. The projection device according to claim 4, characterized in that: The user size information also includes a user width and a user height; the controller executes acquiring the image size of the occluded image according to the user size information, and is specifically configured as follows: Calculating a width adjustment ratio according to the user width, and calculating a height adjustment ratio according to the user height; the width adjustment ratio is a ratio of the user width to a preset adjustment coefficient, and the height adjustment ratio is a ratio of the user height to a preset adjustment coefficient; Calculate the area width and area height of the occluded image; the area width is the product of the user head width and the width adjustment ratio, and the area height is the product of the user head height and the height adjustment ratio.

6. The projection device according to claim 3, characterized in that: It also includes a distance sensor configured to detect the interval distances between the projection device and the user and the projection surface respectively according to the second acquisition cycle; The controller executes acquiring the image size of the blocked image according to the user size information, and is specifically configured as follows: Acquire a first spacing distance between the projection device and the user, and a second spacing distance between the projection device and the projection surface; Calculating the distance ratio, and acquiring the user area size according to the user size information and the distance ratio; the distance ratio is the ratio of the second interval distance to the first interval distance; the user area size is the size of the user area formed by being blocked by the user on the projection surface; The image size of the occlusion image is set according to the size of the user area.

7. The projection device according to claim 3, characterized in that: The controller generates an occlusion image based on the image size and the image position, and is specifically configured to: Acquire an initial image based on the image size and the image position; The occlusion content is added to the initial image to generate an occlusion image.

8. The projection device according to claim 7, characterized in that: The controller performs adding the occluded content to the initial image, and is specifically configured as follows: Acquire a first user feature of the target image and a second user feature of a previous target image; If the first user feature and the second user feature are the same, adding a first occluded content to the initial image; the first occluded content is an occluded content in an occluded image corresponding to a previous target image; If the first user feature and the second user feature are different, then a second occlusion content is added to the initial image.

9. The projection device according to claim 1, characterized in that: Based on detecting that there is a user in the target image, the controller is further configured to: Get the current user protection mode of the projection device; If the projection device is in the first protection mode, executing the step of acquiring user parameters according to the target image; If the projection device is in the second protection mode, the light emitting component is controlled to stop projecting the content onto the projection surface.

10. A projection control method, characterized in that: Applied to the projection device according to any one of claims 1 to 9, the method comprising: In response to the projection instruction, the light emitting component is controlled to project the initial picture content onto the projection surface; Acquire a target image acquired by an image acquisition device, and detect a user state in the target image; Based on detecting that there is a user in the target image, obtaining user parameters according to the target image; the user parameters include user size information and user position information; generating an occlusion image according to the user size information and the user position information; The light emitting component is controlled to project the first picture content onto the projection surface; the first picture content includes the initial picture content and the blocking image, and the blocking image is located on an upper layer of the initial picture content.

Images