Projection control method and device, equipment and storage medium

Abstract

The embodiment of the invention discloses a projection control method and device, equipment and a storage medium, and the method comprises the steps: obtaining a target image which is obtained by photographing a projection picture when at least part of projection light is shielded; determining a control sub-image formed by shielding at least part of projection light in the target image; determining a projection control instruction corresponding to the control sub-image; and executing the projection control instruction. The projection can be controlled more accurately and conveniently, and the hardware cost of projection control can be reduced.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to vehicle-mounted projection technology, and relate to but are not limited to a projection control method and device, equipment, and storage medium. BACKGROUND

[0002] When a user uses a vehicle for parking entertainment, the user usually performs vehicle viewing, gaming, video / voice calling and other functions based on a vehicle outdoor projection manner.

[0003] In such a scenario, the user usually needs to control the projection content, for example, to perform film switching, volume adjustment and other controls. In related technologies, a technical solution usually controls based on a specific hardware remote control or a vehicle outdoor voice.

[0004] However, the hardware remote control requires additional hardware costs. In addition, the reception effect of the vehicle outdoor voice is poor, which often affects the control effect. SUMMARY

[0005] Therefore, the projection control method and device, equipment, and storage medium provided by embodiments of the present application can more accurately and conveniently realize control of projection, and can reduce the hardware cost of projection control. The projection control method and device, equipment, and storage medium provided by embodiments of the present application are implemented as follows: In an aspect of an embodiment of the present application, a projection control method is provided, which includes: obtaining a target image, the target image being obtained by shooting a projection picture when at least part of projection light is blocked; determining a control sub-image formed by the at least part of the projection light being blocked in the target image; determining a projection control instruction corresponding to the control sub-image; executing the projection control instruction.

[0006] In an embodiment, determining the projection control instruction corresponding to the control sub-image includes: obtaining scene information of the target image, the scene information including a projection type of the projection picture and / or outdoor environment information; determining the projection control instruction corresponding to the control sub-image according to the scene information of the target image.

[0007] In an embodiment, determining the projection control instruction corresponding to the control sub-image according to the scene information of the target image includes: determining the projection control instruction corresponding to the control sub-image according to a first mapping relationship corresponding to the scene information and a shape of the control sub-image; The first mapping relationship is used to represent a corresponding relationship between the shape of the control sub-image and the projection control instruction.

[0008] In an embodiment, before determining the projection control instruction corresponding to the control sub-image, the method further comprises: determining an image detection region corresponding to a preset detection region of the projection picture in the target image; detecting whether the control sub-image is included in the image detection region; determining the projection control instruction corresponding to the control sub-image, comprising: in the case that the control sub-image is included in the image detection region, determining the projection control instruction corresponding to the control sub-image.

[0009] In an embodiment, the control sub-image existing in the detection region of the projection picture in the target image comprises at least one of the following cases: the outline of the control sub-image is within the image detection region; the center position of the control sub-image is within the image detection region; the moving track of the control sub-image is within the image detection region.

[0010] In an embodiment, determining the image detection region corresponding to the preset detection region of the projection picture in the target image comprises: determining the position of the image detection region in the target image according to the position of the projection picture in the target image, and the position of the preset detection region in the projection picture.

[0011] In an embodiment, before determining the position of the image detection region in the target image according to the position of the projection picture in the target image, and the position of the preset detection region in the projection picture, the method further comprises: obtaining the position of an image calibration region in the target image; wherein the image calibration region is a region of a preset shape in the target image; determining the position of the projection picture in the target image according to the position of the image calibration region in the target image, and the position of the preset calibration region in the projection picture.

[0012] In an embodiment, after determining the position of the projection picture in the target image, the method further comprises: outputting guidance information, the guidance information being used to prompt the corresponding relationship between the control sub-image and the projection control instruction.

[0013] In an embodiment, after detecting whether the control sub-image exists in the image detection region, the method further comprises: if the control sub-image is not included in the image detection region, and at least part of the projection light is blocked to form an image in the image detection region, generating projection interaction prompt information, the projection interaction prompt information being used to indicate the position of the preset detection region in the projection picture.

[0014] Another aspect of the embodiments of the present application also provides a projection control device, which comprises an acquisition module, a determination module and an execution module. The acquisition module is configured to acquire a target image, which is obtained by shooting a projection picture when at least part of the projection light is blocked. The determination module is configured to determine a control sub-image formed by the blocking of at least part of the projection light in the target image. The determination module is further configured to determine a projection control instruction corresponding to the control sub-image. The execution module is configured to execute the projection control instruction.

[0015] The vehicle-mounted terminal provided by the embodiments of the present application comprises a memory and a processor, the memory stores a computer program capable of running on the processor, and the processor implements the method of the embodiments of the present application when executing the program.

[0016] The computer readable storage medium provided by the embodiments of the present application stores a computer program, and the computer program is executed by a processor to implement the method provided by the embodiments of the present application.

[0017] The projection control method and device, equipment and storage medium provided by the embodiments of the present application can acquire a target image, which is obtained by shooting a projection picture when at least part of the projection light is blocked; determine a control sub-image formed by the blocking of at least part of the projection light in the target image; determine a projection control instruction corresponding to the control sub-image; and execute the projection control instruction. The control sub-image can be a shadow generated by a user through a body part or a held object in the projection image, different projection interaction instructions can be given through different control sub-images, thus, the projection control can be realized through the control sub-image, and the convenience of the projection control is improved. Moreover, the generation of the control sub-image is relatively simple, and no additional electronic device needs to be set to interact with the vehicle-mounted terminal, thus, the hardware cost of the projection control can be reduced, and the accurate control of the user projection can be realized. BRIEF DESCRIPTION OF DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can also be obtained by those skilled in the art without any creative effort on the basis of these drawings.

[0019] Figure 1 The use scenario provided in the embodiments of the present application is shown in the figure; Figure 2 The flowchart of the projection control method provided in the embodiments of the present application is shown in the figure; Figure 3 This is a flowchart illustrating the process of determining projection control commands provided in the embodiments of this application; Figure 4 This is another flowchart illustrating the determination of projection control commands provided in the embodiments of this application; Figure 5 This is a schematic diagram showing the location of the image detection area provided in the embodiments of this application; Figure 6 This is a logical schematic diagram illustrating the determination of the image detection region location provided in the embodiments of this application; Figure 7 This is a schematic diagram of the process for determining the position of the projected image in the target image according to the embodiments of this application; Figure 8 This is a schematic diagram of the output guidance information provided in the embodiments of this application; Figure 9 This is a schematic diagram of the output prompt information provided in the embodiments of this application; Figure 10 This is a schematic diagram of the projection control device provided in the embodiments of this application; Figure 11 This is a schematic diagram of the structure of the vehicle-mounted terminal provided in the embodiments of this application. Detailed Implementation

[0020] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the specific technical solutions of this application will be further described in detail below with reference to the accompanying drawings of the embodiments of this application. The following embodiments are used to illustrate this application, but are not intended to limit the scope of this application.

[0021] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0022] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0023] It should be noted that the terms "first, second, third" used in the embodiments of this application are used to distinguish similar or different objects and do not represent a specific order of objects. It can be understood that "first, second, third" can be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.

[0024] First, in order to more clearly explain the projection interaction method provided in the embodiments of this application, the application scenarios of the method are described accordingly.

[0025] Figure 1 This is a schematic diagram of the usage scenario provided in the embodiments of this application. Please refer to it. Figure 1 The scene may include a projection device 110 and a projection wall 120.

[0026] The projection device 110 can be any type of projector, such as an outdoor projector, a desktop projector, or a vehicle-mounted projector. If it is a vehicle-mounted projector, it can be implemented by a DLP (Digital Light Processing) vehicle light with intelligent projection function, or it can be implemented by a projector mounted on the outside of the vehicle. No specific restrictions are imposed here.

[0027] The projection wall 120 can be any wall in an outdoor environment, either perpendicular to the ground or at a certain angle. There are no specific restrictions, as long as it allows users to enjoy outdoor viewing.

[0028] In this scenario, the projection device 110 can project the image onto the projection wall 120, thereby displaying the projected image content in all or part of the projection wall 120. Typically, the projected image can be a rectangular area that occupies at least part of the projection wall 120. In actual implementation, the projected image can also be other regular or irregular shapes, etc. There are no specific restrictions here, as long as it can be projected onto the projection wall 120.

[0029] In one embodiment, when using a DLP vehicle headlight for projection, the headlight can be adjusted to project an image onto a wall.

[0030] The core of this headlight lies in its ability to transform a traditional, static car headlight into a high-resolution, programmable projector. This headlight not only provides illumination but also projects clear, dynamic patterns and information onto the road surface or walls.

[0031] DLP automotive lights can feature a DMD (Digital Micromirror Device) chip, densely packed with hundreds of thousands or even millions (e.g., 1.3 million or 2.6 million) tiny reflectors. Each micromirror represents a pixel. During the control of the automotive light, each micromirror can rotate independently and at high speed under the control of electrical signals. By rotating in different directions, the pixel can be turned on or off. For example, when the pixel is on, light is reflected through a lens and projected onto the road surface, creating a bright spot. When the pixel is off, light is reflected onto a light absorber, resulting in a dark spot on the corresponding area of ​​the road surface.

[0032] When the projection device is a vehicle-mounted projection device, the vehicle may include an in-vehicle terminal. The in-vehicle terminal can be installed inside the vehicle, and can be a fixed in-vehicle terminal or can be replaced by other electronic devices. For example, it may include, but is not limited to, mobile phones, wearable devices (such as smartwatches, smart bracelets, smart glasses, etc.), tablets, laptops, in-vehicle terminals, PCs (Personal Computers), etc.

[0033] The function implemented by this method can be achieved by the processor in the vehicle terminal calling program code. Of course, the program code can be stored in computer storage medium. It can be seen that the vehicle terminal includes at least a processor and a storage medium.

[0034] By setting each pixel, the content displayed in the projected image can be controlled, thus enabling projection outside the vehicle.

[0035] When users use their vehicles for in-car entertainment, they typically rely on outdoor projection to enjoy functions such as watching movies, playing games, and making video / voice calls. For example, it can be based on... Figure 1 The scene shown is projected, and the projected content is used for watching movies, playing games, or making video / voice calls.

[0036] In such scenarios, users typically need to control the projected content, such as switching movies or adjusting volume. Related technologies usually employ control methods based on specific hardware remote controls or external voice commands.

[0037] However, hardware remote controls require additional hardware costs; in addition, the sound reception of external voice commands is poor, which often affects the control effect.

[0038] For example, if an additional physical remote control is used for operation, this not only increases the cost of purchasing and carrying the equipment, but the remote control is also easily lost or damaged in outdoor environments. Furthermore, operating the remote control requires the user to hold it, which is extremely inconvenient when other activities are needed, thus disrupting the immersive experience.

[0039] For example, if external voice is used, although some systems support voice command control, the environmental noise interference in the open environment outside the vehicle is severe, which can easily lead to a significant decrease in voice recognition rate or even functional failure, making the interaction process unreliable and the user experience poor.

[0040] For example, a touchscreen control via an in-vehicle terminal might be used. However, in this scenario, users typically need to operate the device outside the vehicle, while the in-vehicle terminal is usually located inside the vehicle. Since operating via the in-vehicle terminal's touchscreen requires users to be close to or enter the vehicle, it cannot achieve immersive interaction from a distance, thus disrupting the continuity of watching movies or other applications.

[0041] In view of the limitations of the above three methods, this application provides a projection control method that can solve the above problems existing in the related technologies. The specific implementation process of this method in actual implementation is explained below: Figure 2 This is a flowchart illustrating the projection control method provided in the embodiments of this application. Please refer to... Figure 2 Projection control methods include: S210: Acquire the target image.

[0042] It should be noted that the subject executing this method can be the aforementioned vehicle-mounted terminal. Figure 1 In the scenario shown, the vehicle-mounted terminal can be installed in the vehicle and can be connected to the projection device 110 to control the projection device to perform projection.

[0043] It should be noted that the vehicle may be equipped with an in-vehicle camera, which can be controlled by an in-vehicle terminal or a server. No specific restrictions are made here. In the implementation scheme of this application, the control of the in-vehicle camera by the in-vehicle terminal is used as an example for explanation.

[0044] The target image can be obtained by capturing images using a vehicle-mounted camera. This camera can be positioned facing the projection wall at an angle (e.g., in front of or to the side of the vehicle), without specific limitations. If the projection wall is in front of the vehicle, the target image can be obtained using the in-vehicle camera at the front; if the projection wall is on the side of the vehicle, the target image can be obtained using the in-vehicle camera on the side.

[0045] The target image is a photograph of the projected image when at least part of the projected light is blocked.

[0046] It should be noted that the projected image can be an image projected onto the projection wall using a projection device. The target image can include all of the projected images. For example, the projected image can be a part of the target image, or all of the content in the target image can be the projected image. No specific restrictions are imposed here.

[0047] If there is an obstruction between the projection device and the projection screen, at least part of the projection light will be blocked. For example, the user's arm, body, or other obstacles are not specifically limited here. Through these obstructions, the projection screen when at least part of the projection light is blocked can be obtained. The target image can be obtained by capturing the projection screen when at least part of the projection light is blocked by the vehicle-mounted camera.

[0048] S220: Determine the control sub-image formed by at least part of the projected light rays in the target image being blocked.

[0049] It should be noted that after obtaining the target image, the control sub-image can be determined from the target image.

[0050] Since the content in the projected image is obtained by projecting through a projection device, and the projected image is obtained by reflecting light off the projection wall, if there is an obstruction in the middle, different colors will be displayed, such as the original color of the wall or black. In this case, the control sub-image formed by at least part of the projected light being obstructed in the target image can be determined by image recognition.

[0051] It should be noted that the shape of the control sub-image can be varied and can be determined based on the projection of the obstacle between the projection screen and the projection device; no specific shape restriction is imposed here.

[0052] In one embodiment, a neural network model can be set up to determine the control sub-image in the target image through image processing. Alternatively, the control sub-image in the target image can be directly identified based on an image recognition algorithm. No specific limitations are imposed here.

[0053] The control sub-image can be a shadow image, such as a hand shadow.

[0054] S230: Determine the projection control command corresponding to the control sub-image.

[0055] In one embodiment, after obtaining the control sub-image, the corresponding projection control instruction can be determined based on the control sub-image. The projection control instruction can be an instruction to control the vehicle terminal to perform the corresponding operation.

[0056] For example, it can be various types of commands such as switching playback content, playing commands, stopping commands, volume adjustment commands, and screen brightness adjustment commands. There are no specific restrictions here, and it can be determined according to the specific content in the projected image.

[0057] For example: If the projected image is a video playback screen, the projection control commands can include video switching commands, video playback commands, video stop commands, etc.; if the projected image is a game screen, the projection control commands can include commands to control characters in the game. Alternatively, they can include volume adjustment commands, screen brightness adjustment commands, etc., for any scenario.

[0058] In one embodiment, multiple projection control commands can be set, and the corresponding projection control command can be determined according to the shape of the control sub-image. The specific mapping relationship is shown in Table 1.

[0059] Table 1 The different images can be different control sub-images, such as control sub-images of different shapes, different sizes, or different positions. Each different control sub-image can correspond to a different instruction, and the different instructions can be any of the instructions in the above examples.

[0060] S240: Execute projection control commands.

[0061] It should be noted that after obtaining the corresponding projection control command from Table 1 above, the projection control command can be executed.

[0062] The projection control command can be executed by the vehicle-mounted terminal, and during the execution process, the corresponding projection image can be projected onto the projection wall in real time through the projection device.

[0063] The projection control method provided in this application embodiment can acquire a target image, which is a photograph of the projection image when at least part of the projection light is blocked; determine a control sub-image formed by the blocking of at least part of the projection light in the target image; determine the projection control command corresponding to the control sub-image; and execute the projection control command. The control sub-image can be a shadow cast in the projection image by the user's body parts or held objects. Different projection interaction commands can be given through different control sub-images. Therefore, projection control can be achieved through control sub-images, improving the convenience of projection control. Furthermore, since the generation of control sub-images is relatively simple and does not require additional electronic equipment to interact with the vehicle terminal, the hardware cost of projection control can be reduced, enabling accurate control of the user's projection.

[0064] The following explains one possible real-time process for determining projection control commands provided in the embodiments of this application.

[0065] Figure 3 This is a flowchart illustrating the process of determining projection control commands as provided in the embodiments of this application. Please refer to... Figure 3 Determine the projection control instructions corresponding to the control sub-image, including: S310: Obtain scene information of the target image.

[0066] The scene information includes: the projection type of the projected image, and / or, outdoor environment information.

[0067] It should be noted that the projection type of the projected image can be determined by the application currently running on the in-vehicle terminal. For example, if the in-vehicle terminal is running video playback software, video content can be projected through the projection device, and the projection type of the projected image is video; if the in-vehicle terminal is running game software, game content can be projected through the projection device, and the projection type of the projected image is game.

[0068] Outdoor environmental information may include, for example, weather and time. Weather refers to sunny, cloudy, or rainy days; time can be daytime or nighttime. Alternatively, outdoor environmental information can be represented by a specific brightness level; no specific restrictions are imposed here.

[0069] For vehicle-mounted terminals, the above-mentioned scenario information can be obtained by accessing a server, or by setting up corresponding sensors on the vehicle. No specific restrictions are imposed here, and one or more methods can be selected to obtain the above-mentioned scenario information according to actual needs.

[0070] For the above scene information, one or more of the projection type of the projected image and outdoor environment information can be used. Alternatively, other scene information can be set based on actual needs, such as the color and material of the projection wall. No specific restrictions are imposed here.

[0071] S320: Determine the projection control command corresponding to the control sub-image based on the scene information of the target image.

[0072] It should be noted that after obtaining the scene information of the target image through the above method, the projection control command corresponding to the control sub-image can be determined based on the scene information.

[0073] As explained above, corresponding mapping relationships can be set for control sub-images and projection control commands, as shown in Table 1 above. Different mapping relationships can be set for different scene information. For example, a mapping table A can be set for game-type projection images, and a mapping table B can be set for video-type projection images. The mapping relationships recorded in mapping table A and mapping table B can be different.

[0074] Furthermore, after determining the scene information of the target image, the projection control command corresponding to the control sub-image can be determined based on the corresponding mapping table.

[0075] Of course, in addition to being based on the shape of the control sub-image, different projection control commands can also be set according to factors such as the position and size of the control sub-image. In this embodiment, shape is used as an example for explanation. In practical applications, any method can be used to establish the relationship between the control sub-image and the projection control command.

[0076] The projection control method provided in this application can acquire scene information of the target image; based on the scene information of the target image, it determines the projection control command corresponding to the control sub-image. By acquiring the scene information of the target image, different methods can be used to determine the projection control command corresponding to the control sub-image for different types of scenes, thus improving the applicability of the solution.

[0077] In one embodiment, determining the projection control instruction corresponding to the control sub-image based on scene information of the target image includes: determining the projection control instruction corresponding to the control sub-image based on a first mapping relationship corresponding to the scene information and the shape of the control sub-image.

[0078] The first mapping relationship is used to characterize the correspondence between the shape of the control sub-image and the projection control command.

[0079] For example, the first mapping relationship can be shown in Table 2:

[0080] Table 2 Table 2 shows the first mapping table set when the projected image type is video. Different mapping tables can be set for other scene information, and no specific restrictions are made here. The mapping relationship between the shape of the control sub-image and the corresponding projection control command can be determined through this first mapping table.

[0081] It should be noted that after determining the shape of the control sub-image, the projection control instruction corresponding to the shape of the control sub-image can be determined by querying the first mapping table mentioned above.

[0082] The shape of the control sub-image can be obtained using image recognition methods, without specific limitations. For example, after acquiring the control sub-image, its outline can be obtained to determine its shape.

[0083] In the projection control method provided in this application embodiment, the projection control command corresponding to the control sub-image can be determined based on the first mapping relationship corresponding to the scene information and the shape of the control sub-image. The first mapping relationship and the shape of the control sub-image allow for quick and accurate acquisition of the corresponding projection control command, thereby improving the accuracy and efficiency of determining the control command.

[0084] The following explains another feasible implementation process for determining projection control instructions provided in the embodiments of this application.

[0085] Figure 4 This is another flowchart illustrating the determination of projection control commands provided in the embodiments of this application. Please refer to... Figure 4 Before determining the projection control command corresponding to the control sub-image, the method further includes: S410: Determine the image detection area corresponding to the preset detection area of ​​the projected image in the target image.

[0086] It should be noted that during the projection process, a preset detection area can be set in the projection screen. The position of the preset detection area can be set according to actual needs. For example, it can be a rectangle set at the four corners of the projection screen, a rectangle set at the bottom of the projection screen, or a rectangle set at the top of the projection screen. There are no specific restrictions here, and any position in the projection screen can be used as the preset detection area.

[0087] After the vehicle-mounted terminal acquires the target image, it can determine the location of the image detection area in the target image based on the location of the preset detection area on the projected screen.

[0088] If all content in the target image is a projection image, and the entire projection image is captured in the target image, then the position of the image detection area in the target image is the position of the preset detection area of ​​the projection image.

[0089] If part of the target image is a projected image, the position of the projected image in the target image can be determined first, and then the position of the detection area in the target image can be determined based on the position of the preset detection area in the projected image.

[0090] S420: Detect whether the detection region of the image includes a control sub-image.

[0091] It should be noted that after determining the image detection region of the target image, it is possible to determine whether the control sub-image is included in that region.

[0092] Specifically, image recognition processing can be performed on the image detection region in the target image to determine whether the image detection region includes a control sub-image.

[0093] It should be noted that if the image detection area does not include the control sub-image, then it can be determined that there is no need to generate the corresponding projection control command.

[0094] Accordingly, the projection control instructions corresponding to the control sub-image are determined, including: S430: When the image detection area includes a control sub-image, determine the projection control command corresponding to the control sub-image.

[0095] In one embodiment, if the image detection region includes a control sub-image, the aforementioned method can be used, for example, Table 1 or Table 2, to determine the projection control instruction corresponding to the control sub-image.

[0096] In one embodiment, a control sub-image exists in the detection area of ​​the projected image in the target image, including at least one of the following situations: the outline of the control sub-image is within the image detection area; the center position of the control sub-image is within the image detection area; the movement trajectory of the control sub-image is within the image detection area.

[0097] The control sub-image can be either a static or dynamic image. If it is a static image, it can be determined whether the outline of the control sub-image is within the image detection area. If it is, it can be determined that the control sub-image exists in the detection area of ​​the projected image in the target image; otherwise, it can be determined that the control sub-image does not exist in the detection area of ​​the projected image in the target image. Alternatively, it can be determined whether the center position of the control sub-image is within the image detection area. If it is, it can be determined that the control sub-image exists in the detection area of ​​the projected image in the target image; otherwise, it can be determined that the control sub-image does not exist in the detection area of ​​the projected image in the target image.

[0098] If it is a dynamic image, multiple control sub-images can be obtained, and it can be determined whether the movement trajectory of the multiple control sub-images is within the image detection area. The movement trajectory can be represented by any position in the control sub-image, such as the edge position, the center position, etc., without specific restrictions.

[0099] The projection control method provided in this application embodiment can determine an image detection region corresponding to a preset detection region of the projected image in the target image; detect whether a control sub-image exists in the image detection region; and determine the projection control command corresponding to the control sub-image if the image detection region includes a control sub-image. By detecting the image detection region, control sub-image detection based on a specific region can be achieved, avoiding erroneous commands caused by user errors and improving the accuracy of generating projection control commands.

[0100] The following explains two feasible ways of setting the image detection area provided in the embodiments of this application.

[0101] Figure 5 This is a schematic diagram showing the location of the image detection area provided in the embodiments of this application. Please refer to... Figure 5 , Figure 5 In sub-image (a), the target image may only include the projected image, and all the contents of the projected image are displayed in the target image. Figure 5 In subgraph (b), the target image may include a projected image and other content.

[0102] It should be noted that, for sub-image (a), the image detection region in the target image is the same as the preset detection region in the projected image; for sub-image (b), the image detection region in the target image can be the region obtained by scaling down the preset detection region in the projected image according to a certain ratio.

[0103] In either of the two cases mentioned above, the image detection region can be determined, and then the control sub-image can be determined within the image detection region.

[0104] It should be noted that, Figure 5 In this example, the preset detection area is a rectangle formed by the four corners of the projected image. Similarly, the image detection area in the target image obtained by proportional scaling can also be four rectangular areas, that is... Figure 5 The area enclosed by the dashed line.

[0105] The following explains one feasible implementation process for determining the location of an image detection region provided in the embodiments of this application.

[0106] Figure 6 This is a logical diagram illustrating the determination of the image detection region location provided in the embodiments of this application. Please refer to... Figure 6 Determining the image detection region corresponding to the preset detection region of the projected image in the target image includes: determining the position of the image detection region in the target image based on the position of the projected image in the target image and the position of the preset detection region in the projected image.

[0107] It should be noted that in the process of determining the image detection area, the position of the projected image in the target image can be obtained first. This process can be achieved by performing image recognition on the target image.

[0108] The location of the preset detection area in the projected image can be a preset location, for example: it could be... Figure 6 The rectangles shown at the four corners of the projected image.

[0109] After obtaining the position of the projected image in the target image and the position of the preset detection area in the projected image, the position of the image detection area can be determined by scaling the projected image, which includes the preset detection area, according to the position of the projected image in the target image.

[0110] The following explains one feasible method for determining the position of the projected image in the target image, as provided in the embodiments of this application.

[0111] The previous section explained how to obtain the position of the projected image in the target image through image recognition. The following section will explain in detail how to obtain the position of the projected image through image recognition.

[0112] Figure 7 This is a flowchart illustrating the process of determining the position of the projected image in the target image, as provided in the embodiments of this application. Please refer to... Figure 7 Before determining the position of the image detection region in the target image based on the position of the projected image in the target image and the position of the preset detection region in the projected image, the method further includes: S710: Obtain the location of the image calibration region in the target image.

[0113] The image calibration area is a region of a preset shape in the target image.

[0114] It should be noted that a region of a preset shape can be identified in the target image through image recognition. This region can be a pre-set image calibration area, which can be used for positioning.

[0115] For example, the size and shape of the image calibration region in the target image can be set, and then image recognition can be performed based on the corresponding size and shape. For example, a rectangular shape of a specific size can be used to obtain the image calibration region.

[0116] S720: Determine the position of the projected image in the target image based on the position of the image calibration area in the target image and the position of the preset calibration area in the projected image.

[0117] After obtaining the image calibration area, the position of the projected image in the target image can be determined based on the position of the image calibration area in the target image and the position of the preset calibration area in the projected image.

[0118] It should be noted that a preset calibration area can be set in the projected image. This preset calibration area is similar to the aforementioned preset detection area and can be set according to actual needs. For example, it can be a rectangle set in the four corners of the projected image, a rectangle set at the bottom of the projected image, or a rectangle set at the top of the projected image. There are no specific restrictions here, and any position in the projected image can be used as the aforementioned preset calibration area.

[0119] In one embodiment, the preset calibration area and the preset detection area can be the same area, for example, both being rectangular areas at the four corners of the projected image. Correspondingly, in the target image, the image calibration area can also be the same area as the image detection area.

[0120] It should be noted that after the image detection area is determined by image recognition, the position of the projected image in the target image can be calculated based on the position of the preset calibration area in the preset projected image, thereby achieving position calibration.

[0121] In one embodiment, after position calibration is performed through the image calibration area, the calibration area can be hidden. For example, it can be calibrated with a special color and projected according to the content of the normally displayed projection screen.

[0122] The above calibration process can be explained using DLP car lights as an example: For example, the DLP headlights project semi-transparent rectangular preset calibration areas into the four corners of the projected image. Each preset calibration area can display a unique gesture outline icon (e.g., displaying finger numbers "1", "2", "3", and "4" representing different functions). These icons not only guide the user, but their unique shapes and fixed corner positions serve more importantly as visual anchor points. Simultaneously, the in-vehicle terminal can control the activation of the in-vehicle camera to continuously capture an image encompassing the entire projection area and the preset calibration areas at its four corners. This image becomes the target image, with the preset calibration areas at the four corners representing the image calibration areas within that target image.

[0123] The projection control method provided in this application embodiment can obtain the position of the image calibration region in the target image; based on the position of the image calibration region in the target image and the position of the preset calibration region in the projected image, the position of the projected image in the target image is determined. This method enables position calibration of the projected image in the target image, thereby allowing for quick and accurate determination of the projected image's position within the target image.

[0124] In one embodiment, if the position of the preset detection area in the projected image is not set accordingly, but rather the pixel points used by the preset detection area in the projected image are set in the pixel coordinates of the vehicle camera, then another method can be used to calculate the position of the image calibration area in the target image: After performing the above steps S710-S720, a second mapping relationship can be established, wherein the second mapping relationship is a precise mapping relationship between the pixel coordinates of the vehicle camera and the coordinates in the target image.

[0125] For the aforementioned image calibration areas, since the world coordinates (positions in the target image) of these four image calibration areas are known, the vehicle terminal can quickly calculate the complete boundary and perspective deformation parameters of the projected image in the camera's two-dimensional image coordinate system using computer vision algorithms (e.g., perspective transformation algorithms), thereby establishing the aforementioned second mapping relationship.

[0126] Since the pixels used in the preset detection area corresponding to the projected image in the pixel coordinates of the vehicle camera are preset, the world coordinates of these pixels in the target image can be calculated through the second mapping relationship mentioned above, so as to accurately determine the position of the image detection area in the target image.

[0127] The following example illustrates the steps performed by the in-vehicle terminal when using DLP headlights for projection: First, when the user activates the vehicle exterior projection function (such as the "Vehicle Exterior Projection" application), the DLP projection application starts running, and the system enters the initial boot and calibration mode.

[0128] The DLP headlights project semi-transparent rectangular preset calibration areas at the four corners of the projected image. Simultaneously, the vehicle terminal can control the activation of the vehicle camera to continuously capture an image containing the entire projection area and the preset calibration areas at its four corners. This image is the target image, and the preset calibration areas at the four corners are the image calibration areas within the target image.

[0129] For the aforementioned image calibration areas, since the world coordinates of these four image calibration areas are known, the vehicle terminal can quickly calculate the complete boundary and perspective distortion parameters of the projected image in the camera's two-dimensional image coordinate system using computer vision algorithms, thereby establishing the aforementioned second mapping relationship.

[0130] Since the pixels used in the preset detection area corresponding to the projected image in the pixel coordinates of the vehicle camera are preset, the world coordinates of these pixels in the target image can be calculated through the second mapping relationship mentioned above, so as to accurately determine the position of the image detection area in the target image.

[0131] After determining the location of the image detection area in the target image, normal viewing mode can be entered, and the vehicle terminal can monitor the image detection area of ​​the target image in real time. When the user places their palm into the light path, causing the resulting hand shadow to occlude the image detection area, a control sub-image will be generated in the target image within the image detection area.

[0132] Based on the second mapping relationship mentioned above, the pixel coordinates obscured by obstacles such as hand shadows can be converted into precise coordinates in the target image, thereby determining whether the control sub-image is in the image detection area.

[0133] If the image detection region includes a control sub-image, the projection control command corresponding to the control sub-image can be determined based on the scene information and the first mapping relationship mentioned above, and the projection control command can be executed.

[0134] In one embodiment, after determining the position of the projected image in the target image, the method further includes: outputting guidance information.

[0135] It should be noted that the guidance information is used to indicate the correspondence between the control sub-image and the projection control command. For example, the mapping relationship of the aforementioned Table 1 or Table 2 can be displayed in the projection screen of the target image in a certain order as icons or text, thereby guiding the user to know the projection control command corresponding to each gesture. Here, the projection control command corresponding to the gesture refers to the projection control command corresponding to the control sub-image formed by the projection of the gesture.

[0136] Figure 8 This is a schematic diagram of the output guidance information provided in the embodiments of this application. Please refer to... Figure 8 ,exist Figure 8 The guide information can be displayed in the middle. Figure 8 The contents of Table 2 above are displayed in text form. In actual implementation, they can also be displayed through images or other means. They can be displayed in the entire projection screen or in the preset detection area of ​​the projection screen. No specific restrictions are made here.

[0137] By outputting guidance information, users can quickly understand the projection control instructions corresponding to different control sub-images, making it easier for them to operate.

[0138] In one embodiment, after detecting whether a control sub-image exists in the image detection region, the method further includes: if the image detection region does not include a control sub-image, and if there is an image formed by at least part of the projected light being blocked in the image detection region, generating projection interaction prompt information.

[0139] Among them, the projection interaction prompt information is used to indicate the position of the preset detection area in the projected image.

[0140] In the above situation, there may be partial occlusion in the image detection area, but this occlusion does not constitute a control sub-image. In this case, it is usually caused by the user not knowing the position of the preset detection area in the projected image.

[0141] To avoid this situation, a preset detection area in the projected image can be displayed by generating interactive projection prompts.

[0142] Figure 9 This is a schematic diagram of the output prompt information provided in the embodiments of this application. Please refer to it. Figure 9 The preset detection area in the projected image can be indicated by arrows or highlights, thereby prompting the user to indicate the location of the preset detection area in the projected image. When the user generates a control sub-image using gestures, the control sub-image is generated in the preset detection area of ​​the projected image, so that the aforementioned control sub-image can be detected in the image detection area of ​​the target image.

[0143] Figure 9 The method used in this implementation to generate interactive projection prompts involves using arrows to indicate preset detection areas on the projected screen. In practice, any method can be used, and it is not limited to one method. Figure 9 The above is shown as a limitation.

[0144] It should be understood that although the steps in the above flowcharts are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the above flowcharts may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the sub-steps or stages of other steps.

[0145] Based on the foregoing embodiments, this application provides a projection control device, which includes various modules and units included in each module, and can be implemented by a processor; of course, it can also be implemented by specific logic circuits; in the implementation process, the processor can be a central processing unit (CPU), microprocessor (MPU), digital signal processor (DSP) or field programmable gate array (FPGA), etc.

[0146] Figure 10 This is a schematic diagram of the projection control device provided in the embodiments of this application. Please refer to... Figure 10 In another aspect of the embodiments of this application, a projection control device is also provided, which includes: an acquisition module 1010, a determination module 1020 and an execution module 1030; The acquisition module 1010 is used to acquire a target image, which is: a photograph of the projected image when at least part of the projected light is blocked; The determining module 1020 is used to determine a control sub-image formed in a target image where at least part of the projected light rays are blocked; The determining module 1020 is also used to determine the projection control command corresponding to the control sub-image; Execution module 1030 is used to execute projection control commands.

[0147] In one embodiment, the determining module 1020 is specifically used to acquire scene information of the target image, the scene information including: the projection type of the projected image, and / or, outdoor environment information; and determine the projection control instruction corresponding to the control sub-image based on the scene information of the target image.

[0148] In one embodiment, the determining module 1020 is specifically used to determine the projection control command corresponding to the control sub-image based on the first mapping relationship corresponding to the scene information and the shape of the control sub-image; wherein, the first mapping relationship is used to characterize the correspondence between the shape of the control sub-image and the projection control command.

[0149] In one embodiment, the determining module 1020 is further configured to determine an image detection region corresponding to a preset detection region of the projected image in the target image; detect whether the image detection region includes a control sub-image; and if the image detection region includes a control sub-image, determine the projection control instruction corresponding to the control sub-image.

[0150] In one embodiment, in the device, a control sub-image exists in the detection area of ​​the projected image in the target image, including at least one of the following situations: the outline of the control sub-image is within the image detection area; the center position of the control sub-image is within the image detection area; the movement trajectory of the control sub-image is within the image detection area.

[0151] In one embodiment, the determining module 1020 is specifically used to determine the position of the image detection area in the target image based on the position of the projected image in the target image and the position of the preset detection area in the projected image.

[0152] In one embodiment, the determining module 1020 is further configured to obtain the position of the image calibration region in the target image; wherein the image calibration region is a region of a preset shape in the target image; and the position of the projected image in the target image is determined based on the position of the image calibration region in the target image and the position of the preset calibration region in the projected image.

[0153] In one embodiment, the execution module 1030 is further configured to output guidance information, which is used to indicate the correspondence between the control sub-image and the projection control command.

[0154] In one embodiment, the execution module 1030 is further configured to generate projection interaction prompt information if the image detection area does not include a control sub-image and there is an image formed by at least part of the projection light being blocked in the image detection area. The projection interaction prompt information is used to indicate the position of the preset detection area in the projected image.

[0155] The projection control device provided in this application embodiment can acquire a target image, which is a photograph of a projection image taken when at least part of the projection light is blocked; determine a control sub-image formed by the blocking of at least part of the projection light in the target image; determine the projection control command corresponding to the control sub-image; and execute the projection control command. The control sub-image can be a shadow cast in the projection image by the user's body parts or held objects. Different projection interaction commands can be given through different control sub-images. Therefore, projection control can be achieved through control sub-images, improving the convenience of projection control. Furthermore, since the generation of control sub-images is relatively simple and does not require additional electronic equipment to interact with the vehicle terminal, the hardware cost of projection control can be reduced, enabling accurate control of the user's projection.

[0156] The description of the above device embodiments is similar to that of the above method embodiments, and has similar beneficial effects. For technical details not disclosed in the device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0157] It should be noted that, in the embodiments of this application... Figure 10 The module division shown in the projection device is illustrative and represents only one logical functional division; in actual implementation, other division methods may be used. Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, exist as separate physical units, or be integrated into one unit with two or more units. The integrated units can be implemented in hardware, as software functional units, or a combination of both.

[0158] It should be noted that, in the embodiments of this application, if the above-described methods are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, or the parts that contribute to related technologies, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause an electronic device to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), magnetic disks, or optical disks. Thus, the embodiments of this application are not limited to any specific hardware and software combination.

[0159] Figure 11 This is a schematic diagram of the structure of the vehicle-mounted terminal provided in the embodiments of this application. Please refer to... Figure 11 The vehicle-mounted terminal includes a processor 1120, a memory, and a network interface 1140 connected via a system bus 1110. The processor 1120 provides computing and control capabilities. The memory includes a non-volatile storage medium 1131 and internal memory 1132. The non-volatile storage medium 1131 stores an operating system, computer programs, and a database. The internal memory 1132 provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium 1131. The database stores data. The network interface 1140 communicates with external terminals via a network connection. When the computer program is executed by the processor 1120, it implements the methods described above. This application provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps of the methods provided in the above embodiments.

[0160] This application provides a computer program product containing instructions that, when run on a computer, cause the computer to perform the steps in the method provided in the above-described method embodiments.

[0161] Those skilled in the art will understand that Figure 11 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0162] In one embodiment, the projection control device provided in this application can be implemented as a computer program, and the computer program can be configured as follows: Figure 11 The device operates on the computer device shown. The memory of the computer device can store the various program modules that make up the above-described apparatus. The computer program, composed of the various program modules, causes the processor to execute the steps of the methods in the various embodiments of this application described in this specification.

[0163] It should be noted that the descriptions of the storage medium and device embodiments above are similar to the descriptions of the method embodiments above, and have similar beneficial effects. For technical details not disclosed in the storage medium, storage medium, and device embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.

[0164] It should be understood that the phrases "one embodiment," "an embodiment," or "some embodiments" mentioned throughout the specification mean that a specific feature, structure, or characteristic related to an embodiment is included in at least one embodiment of this application. Therefore, "in one embodiment," "in one embodiment," or "in some embodiments" appearing throughout the specification do not necessarily refer to the same embodiment. Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. It should be understood that in the various embodiments of this application, the sequence numbers of the above-described processes do not imply a sequential order of execution; the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application. The sequence numbers of the above-described embodiments are merely for descriptive purposes and do not represent the superiority or inferiority of the embodiments. The descriptions of the various embodiments above tend to emphasize the differences between the various embodiments; their similarities or commonalities can be referred to mutually, and for the sake of brevity, they will not be repeated here.

[0165] In this article, the term "and / or" is merely a description of the relationship between related objects, indicating that there can be three kinds of relationships. For example, object A and / or object B can represent three situations: object A exists alone, object A and object B exist simultaneously, and object B exists alone.

[0166] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0167] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The embodiments described above are merely illustrative. For example, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods, such as: multiple modules or components can be combined, or integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the various components shown or discussed can be through some interfaces, and the indirect coupling or communication connection between devices or modules can be electrical, mechanical, or other forms.

[0168] The modules described above as separate components may or may not be physically separate. The components shown as modules may or may not be physical modules. They may be located in one place or distributed across multiple network units. Some or all of the modules may be selected to achieve the purpose of this embodiment according to actual needs.

[0169] In addition, each functional module in the various embodiments of this application can be integrated into one processing unit, or each module can be a separate unit, or two or more modules can be integrated into one unit; the integrated modules can be implemented in hardware or in the form of hardware plus software functional units.

[0170] Those skilled in the art will understand that all or part of the steps of the above method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it performs the steps of the above method embodiments. The aforementioned storage medium includes various media that can store program code, such as mobile storage devices, read-only memory (ROM), magnetic disks, or optical disks.

[0171] Alternatively, if the integrated units described above are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, or the parts that contribute to related technologies, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause an electronic device to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0172] The methods disclosed in the several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

[0173] The features disclosed in the several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0174] The features disclosed in the several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method or device embodiments.

[0175] The above description is merely an embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A projection control method, characterized in that, The method includes: Acquire a target image, wherein the target image is: a photograph of a projected image when at least part of the projected light is blocked; Determine the control sub-image formed by at least a portion of the projected light rays being blocked in the target image; Determine the projection control command corresponding to the control sub-image; Execute the projection control command.

2. The method according to claim 1, characterized in that, The step of determining the projection control command corresponding to the control sub-image includes: Obtain scene information of the target image, the scene information including: the projection type of the projected image, and / or, outdoor environment information; Based on the scene information of the target image, the projection control command corresponding to the control sub-image is determined.

3. The method according to claim 2, characterized in that, The step of determining the projection control command corresponding to the control sub-image based on the scene information of the target image includes: Based on the first mapping relationship corresponding to the scene information and the shape of the control sub-image, the projection control command corresponding to the control sub-image is determined; The first mapping relationship is used to characterize the correspondence between the shape of the control sub-image and the projection control command.

4. The method according to claim 1, characterized in that, Before determining the projection control command corresponding to the control sub-image, the method further includes: Determine the image detection region corresponding to the preset detection region of the projected image in the target image; Detect whether the control sub-image is included in the image detection region; Determining the projection control command corresponding to the control sub-image includes: If the control sub-image is included in the image detection area, the projection control command corresponding to the control sub-image is determined.

5. The method according to claim 4, characterized in that, The control sub-image exists in the detection area of ​​the projected image in the target image, including at least one of the following situations: The outline of the control sub-image is located within the image detection area; The center position of the control sub-image is within the image detection area; The movement trajectory of the control sub-image is within the image detection area.

6. The method according to claim 4, characterized in that, The step of determining the image detection region corresponding to the preset detection region of the projected image in the target image includes: The position of the image detection region in the target image is determined based on the position of the projected image in the target image and the position of the preset detection region in the projected image.

7. The method according to claim 6, characterized in that, Before determining the position of the image detection region in the target image based on the position of the projected image in the target image and the position of the preset detection region in the projected image, the method further includes: Obtain the position of the image calibration region in the target image; wherein, the image calibration region is: a region of a preset shape in the target image; The position of the projected image in the target image is determined based on the position of the image calibration area in the target image and the position of the preset calibration area in the projected image.

8. The method according to claim 7, characterized in that, After determining the position of the projected image in the target image, the method further includes: Output guidance information, which is used to indicate the correspondence between the control sub-image and the projection control command.

9. The method according to claim 4, characterized in that, After detecting whether the control sub-image exists in the image detection region, the method further includes: If the control sub-image is not included in the image detection area, and there is an image formed by at least part of the projected light being blocked in the image detection area, a projection interaction prompt message is generated. The projection interaction prompt message is used to indicate the position of the preset detection area in the projected image.

10. A projection control device, characterized in that, The device includes: an acquisition module, a determination module, and an execution module; The acquisition module is used to acquire a target image, which is: a photograph of a projected image when at least part of the projected light is blocked; The determining module is used to determine the control sub-image formed by at least a portion of the projected light rays being blocked in the target image; The determining module is further configured to determine the projection control command corresponding to the control sub-image; The execution module is used to execute the projection control command.

11. A vehicle-mounted terminal, comprising a memory and a processor, wherein the memory stores a computer program executable on the processor, characterized in that, When the processor executes the program, it implements the steps of the method according to any one of claims 1 to 9.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1 to 9.

Images