Projection control method and device, equipment and storage medium

Abstract

The embodiment of the invention provides a projection control method, device and equipment and a storage medium, the projection control method is applied to a processor of projection equipment, and the projection equipment comprises a remote controller, an image sensor, a rotating mechanism and the processor; the method comprises the following steps: acquiring an image in front of the projection equipment obtained by the image sensor in real time; based on the image, respectively determining position information of a remote control point and position information of a reference point; the remote control point is a remote control signal point sent by the remote controller, and the reference point is a central point of a projection picture of the projection equipment; determining rotation parameters of the rotation mechanism based on the position information of the reference point and the position information of the remote control point; and controlling the rotation mechanism to rotate based on the rotation parameter so as to enable the reference point to coincide with the remote control point.

Description

Technical Field

[0001] The present application relates to the field of projection technology, and the present application relates to but is not limited to a projection control method, device, equipment and storage medium. Background Art

[0002] In the process of using projection equipment, the selection of projection angle and projection area often needs to be adjusted repeatedly. Therefore, how to provide a better and more convenient interactive method to control the projection angle and meet the needs of different users has become a technical problem that needs to be solved urgently. Summary of the invention

[0003] Embodiments of the present application provide a projection control method, apparatus, device and storage medium.

[0004] In a first aspect, an embodiment of the present application provides a projection control method, which is applied to a processor of a projection device, wherein the projection device includes: a remote control, an image sensor, a rotation mechanism and a processor; the method includes: acquiring an image in front of the projection device obtained in real time by the image sensor; based on the image, determining the position information of a remote control point and the position information of a reference point respectively; the remote control point is a remote control signal point emitted by the remote control, and the reference point is a center point of a projection screen of the projection device; based on the position information of the reference point and the position information of the remote control point, determining the rotation parameters of the rotation mechanism; and controlling the rotation of the rotation mechanism based on the rotation parameters so that the reference point coincides with the remote control point.

[0005] In a second aspect, an embodiment of the present application provides a projection control device, comprising: a first acquisition module, used to acquire an image in front of a projection device obtained in real time by an image sensor; a first determination module, used to determine, based on the image, position information of a remote control point and position information of a reference point, respectively; the remote control point is a remote control signal point emitted by a remote controller, and the reference point is a center point of a projection screen of the projection device; a second determination module, used to determine a rotation parameter of a rotation mechanism based on the position information of the reference point and the position information of the remote control point; and a control module, used to control the rotation of the rotation mechanism based on the rotation parameter so that the reference point coincides with the remote control point.

[0006] In a third aspect, an embodiment of the present application provides a projection device, comprising: a remote control, an image sensor, a rotation mechanism, a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, the steps in the above-mentioned method are implemented.

[0007] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, which implements the steps in the above-described method when executed by a processor.

[0008] In the embodiment of the present application, first, an image in front of the projection device obtained in real time by an image sensor is obtained; second, based on the image, the position information of the remote control point and the position information of the reference point are determined respectively; the remote control point is the remote control signal point sent by the remote control, and the reference point is the center point of the projection screen of the projection device; third, based on the position information of the reference point and the position information of the remote control point, the rotation parameters of the rotation mechanism are determined; finally, based on the rotation parameters, the rotation of the rotation mechanism is controlled so that the reference point coincides with the remote control point. In this way, the projection device can move the projection screen to the area pointed by the user with the remote control, thereby reducing user participation and improving the interaction efficiency between the user and the projection device. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In the accompanying drawings (which are not necessarily drawn to scale), like reference numerals may describe similar components in different views. Like reference numerals with different letter suffixes may represent different examples of similar components. The accompanying drawings generally illustrate various embodiments discussed herein by way of example and not limitation.

[0010] Figure 1 A schematic diagram of an implementation flow of a projection control method provided in an embodiment of the present application;

[0011] Figure 2 A schematic diagram of a remote control signal point emitted by a remote controller and a projection screen projected by a projection device provided in an embodiment of the present application;

[0012] Figure 3 A schematic diagram of an image in front of a projection device obtained by an image sensor provided in an embodiment of the present application;

[0013] Figure 4 A schematic diagram of a wall pointed to by a remote control provided in an embodiment of the present application is not a wall projected by a current projection device;

[0014] Figure 5 A schematic diagram of the composition of a projection control device provided in an embodiment of the present application;

[0015] Figure 6 A schematic diagram of a hardware entity of a projection device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0016] The exemplary embodiments disclosed in the present application will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the specific embodiments described herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present application and to fully convey the scope disclosed in the present application to those skilled in the art.

[0017] In the following description, a large number of specific details are given to provide a more thorough understanding of the present application. However, it is obvious to those skilled in the art that the present application can be implemented without one or more of these details. In other examples, in order to avoid confusion with the present application, some technical features known in the art are not described; that is, all features of the actual embodiments are not described here, and well-known functions and structures are not described in detail.

[0018] In the drawings, the sizes of layers, regions, elements and their relative sizes may be exaggerated for clarity. Like reference numerals denote like elements throughout.

[0019] It should be understood that when an element or layer is referred to as "on ...", "adjacent to ...", "connected to" or "coupled to" other elements or layers, it can be directly on, adjacent to, connected to or coupled to other elements or layers, or there can be intervening elements or layers. On the contrary, when an element is referred to as "directly on ...", "directly adjacent to ...", "directly connected to" or "directly coupled to" other elements or layers, there is no intervening element or layer. It should be understood that although the terms first, second, third, etc. can be used to describe various elements, components, regions, layers and / or parts, these elements, components, regions, layers and / or parts should not be limited by these terms. These terms are only used to distinguish one element, component, region, layer or part from another element, component, region, layer or part. Therefore, without departing from the teachings of the present application, the first element, component, region, layer or part discussed below can be represented as the second element, component, region, layer or part. And when the second element, component, region, layer or part is discussed, it does not indicate that the present application necessarily has the first element, component, region, layer or part.

[0020] The purpose of the terms used herein is only to describe specific embodiments and is not intended to be limiting of the present application. When used herein, the singular forms "one", "an" and "said / the" are also intended to include plural forms, unless the context clearly indicates otherwise. It should also be understood that the terms "consisting of" and / or "comprising", when used in this specification, determine the presence of the features, integers, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or groups. When used herein, the term "and / or" includes any and all combinations of the relevant listed items.

[0021] An embodiment of the present application provides a projection control method, which is applied to a processor of a projection device, wherein the projection device includes: a remote controller, an image sensor, a rotation mechanism, and a processor. Figure 1 A schematic diagram of the implementation flow of a projection control method provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the method includes the following steps S101 to S104:

[0022] Step S101: Acquire an image in front of the projection device obtained in real time by the image sensor;

[0023] Here, the image sensor may be a device capable of acquiring an image in front of the projection device, for example, a camera or the like.

[0024] Figure 2 A schematic diagram showing a remote control signal point emitted by a remote controller and a projection screen projected by a projection device provided in an embodiment of the present application is shown. Figure 2 As shown, the projection device 201 projects a projection screen 204 in front of it. When the user uses the remote control 202 and presses the remote control signal transmission button, the remote control 202 will transmit the remote control signal, and a light spot, i.e., the remote control signal point 203, will appear on the wall. The image sensor captures the image in front of the projection device and obtains the following Figure 3 Image shown.

[0025] Step S102: Based on the image, respectively determine the position information of the remote control point and the position information of the reference point; the remote control point is the remote control signal point sent by the remote controller, and the reference point is the center point of the projection screen of the projection device;

[0026] Here, the remote control signal emitted by the remote control may be invisible light, such as infrared light, or visible light. The optical path of visible light is consistent with that of infrared light, so that the user can see the projection area pointed by the remote control, thereby making the interaction more visual. The remote control point may be a light spot emitted by the remote control on the area where the user expects to project infrared light, visible light, or a mixture of infrared and visible light. In implementation, first, the image may be processed by binarization, that is, the grayscale value of the pixel on the image is set to 0 or 255. In this way, the entire image may be presented with a visual effect of only black and white, thereby obtaining a highlighted area; then, based on the highlighted area, the position information of the remote control point is determined, that is, the position information of the remote control point may be determined according to the position information of the center point of the highlighted area; wherein the position information may be represented by the coordinates of the remote control point in the pixel coordinate system, that is, the position information may be pixel coordinates; the position information may also be represented by the coordinates of the remote control point in the image coordinate system. The reference point may be a point preset in the image. Reference Figure 3 , point O may be a remote control point, and point C may be a reference point, wherein the position information of the remote control point O may be (Ox, Oy), and the position information of the reference point C may be (Cx, Cy).

[0027] Step S103: determining the rotation parameters of the rotation mechanism based on the position information of the reference point and the position information of the remote control point;

[0028] Here, there is a certain relationship between the distance between the reference point and the remote control point and the rotation parameter of the rotation mechanism, for example, it can be a linear relationship or a nonlinear relationship, so the rotation parameter of the rotation mechanism can be determined according to the position information of the above two points.

[0029] While determining the rotation parameters of the rotation mechanism, it is also possible to obtain the image in front of the projection device in real time to determine whether the position information of the remote control point has changed. If the position information of the remote control point has changed, the rotation parameters need to be updated in time, so that the projection picture can be moved more accurately to the area pointed by the user with the remote control.

[0030] Step S104: controlling the rotation mechanism to rotate based on the rotation parameter so that the reference point coincides with the remote control point.

[0031] After obtaining the rotation parameters, the processor controls the rotation mechanism to rotate so that the reference point and the remote control point coincide with each other.

[0032] In the embodiment of the present application, first, an image in front of the projection device obtained in real time by an image sensor is obtained; second, based on the image, the position information of the remote control point and the position information of the reference point are determined respectively; the remote control point is the remote control signal point sent by the remote control, and the reference point is the center point of the projection screen of the projection device; third, based on the position information of the reference point and the position information of the remote control point, the rotation parameters of the rotation mechanism are determined; finally, based on the rotation parameters, the rotation of the rotation mechanism is controlled so that the reference point coincides with the remote control point. In this way, the projection device can move the projection screen to the area pointed by the user with the remote control, thereby reducing user participation and improving the interaction efficiency between the user and the projection device.

[0033] In some embodiments, step S103 "determining the rotation parameters of the rotation mechanism based on the position information of the reference point and the position information of the remote control point" may include the following steps S1031 and S1032:

[0034] Step S1031: determining the distance between the reference point and the remote control point based on the position information of the reference point and the position information of the remote control point;

[0035] Here, the distance between the reference point and the remote point can be the distance represented by the number of pixels, that is, the pixel distance; the distance between the reference point and the remote point can also be the measured distance between the two points in the image. The distance between the reference point and the remote point can be divided into the horizontal distance and the vertical distance, where the horizontal distance Dx = Ox-Cx and the vertical distance Dy = Oy-Cy.

[0036] Step S1032: Determine the rotation parameters of the rotation mechanism based on the distance.

[0037] When the distance between the reference point and the remote control point is represented by the number of pixels, the distance represented by the number of pixels can be first converted into a distance in the image coordinate system, and then the rotation parameters of the rotation mechanism are determined according to the distance between the two points in the image coordinate system.

[0038] In some embodiments, the rotation parameter includes a moving direction and a moving amount, the distance includes pixels in the horizontal direction and a distance in the vertical direction, and the moving amount includes a moving amount in the horizontal direction and a moving amount in the vertical direction; step S1032 may include the following steps S1321 to S1323:

[0039] Step S1321: when the distance in the horizontal direction is less than 0, determining that the moving direction is moving to the left, and when the distance in the horizontal direction is greater than 0, determining that the moving direction is moving to the right;

[0040] Step S1322: when the distance in the vertical direction is less than 0, determining that the moving direction is upward movement, and when the distance in the vertical direction is greater than 0, determining that the moving direction is downward movement;

[0041] Step S1323: using a linear relationship or a curve relationship to convert the distance in the horizontal direction and the distance in the vertical direction respectively, and determining the movement amount in the horizontal direction and the movement amount in the vertical direction respectively.

[0042] Here, when the horizontal distance Dx is less than 0, the moving direction of the rotating mechanism is horizontally moving to the left, that is, the projection screen needs to be moved to the left, so that the center point of the projection screen can be moved to the area pointed by the user with the remote control. When the horizontal distance Dx is greater than 0, the moving direction of the rotating mechanism is horizontally moving to the right.

[0043] When the vertical distance Dy is less than 0, the moving direction of the rotating mechanism is vertical upward movement, that is, the projection screen needs to be moved vertically upward, so that the center point of the projection screen can be moved to the area pointed by the user with the remote control. When the vertical distance Dy is greater than 0, the moving direction of the rotating mechanism is vertical downward movement.

[0044] It should be noted that when controlling the rotation mechanism to rotate based on the rotation parameters, the horizontal movement can be performed first, and then the vertical movement; of course, the vertical movement can also be performed first, and then the horizontal movement, and the present application does not limit this.

[0045] When calculating the movement amount, it is necessary to use a conversion relationship to convert the distance into the movement amount of the rotating mechanism. The conversion relationship can be determined according to the devices used in the rotating mechanism. In implementation, the conversion relationship can be a linear relationship or a curve relationship. Taking a linear relationship as an example, the horizontal movement amount Mx = k1*Dx, and the vertical movement amount My = k2*Dy; taking a curve relationship as an example, the vertical movement amount Mx = a1*Dx 2 +b1*Dx+c1, vertical movement My=a2*Dy 2 +b2*Dy+c2. Wherein, k1, k2, a1, b1, c1, a2, b2 and c2 are model parameters for converting the distance between the reference point and the remote control point into the rotation amount of the rotation mechanism, and these parameters may be preset parameters.

[0046] In the embodiment of the present application, by determining whether the horizontal distance is greater than 0 or less than 0, the moving direction can be determined to be rightward or leftward; by determining whether the vertical distance is greater than 0 or less than 0, the moving direction can be determined to be vertically downward or upward; by using a linear relationship or a curve relationship to convert the horizontal distance and the vertical distance, respectively, the horizontal movement amount and the vertical movement amount can be determined respectively. In this way, the rotation mechanism can be controlled to rotate based on the above-mentioned moving direction and moving amount, so that the reference point and the remote control point coincide, that is, the projection screen is moved to the area pointed to by the user with the remote control.

[0047] In some embodiments, the projection control method further includes the following steps S105 and S106:

[0048] Step S105: acquiring a first magnetic field angle when the remote controller points to the target area in the projection image and a second magnetic field angle when the remote controller points to the reference point;

[0049] Here, the projection device also includes a geomagnetic sensor arranged on the remote control. The geomagnetic sensor is a sensor for detecting the earth's magnetic force, also known as an "electronic compass", which can detect the direction by detecting the earth's magnetism. The magnetic field angle refers to the direction angle of the magnetic field in space; the magnetic field angle is usually expressed in a rectangular coordinate system or a polar coordinate system. In a rectangular coordinate system, the magnetic field angle refers to the angle between the magnetic field and the X-axis; in a polar coordinate system, the magnetic field angle refers to the angle between the magnetic field and the polar axis.

[0050] The target display area of ​​the projection picture can be the projection area desired by the user; the second magnetic field angle when the remote control points to the reference point is the magnetic field angle when the remote control is facing the projection wall, that is, when the projection is normal.

[0051] Step S106: Based on the first magnetic field angle and the second magnetic field angle, control the rotation mechanism to rotate so as to adjust the projection picture of the projection device on the projection area.

[0052] Here, the angle difference between the first magnetic field angle and the second magnetic field angle is the user's line of sight angle relative to the front projection. In implementation, the projection picture can be adjusted according to the angle difference between the first magnetic field angle and the second magnetic field angle, so that the picture projected by the projection device is closer to a rectangular picture in the user's line of sight, so that the projection picture is more in line with the user's perspective.

[0053] In some embodiments, step S106 "based on the first magnetic field angle and the second magnetic field angle, controlling the rotation mechanism to rotate to adjust the projection screen of the projection device on the projection area" includes steps S1061 to S1063:

[0054] Step S1061: determining an angle difference between the first magnetic field angle and the second magnetic field angle;

[0055] Step S1062: when the angle difference is greater than zero, controlling the rotation mechanism to rotate so as to increase the length of the right side of the projection image;

[0056] Step S1063: When the angle difference is less than zero, control the rotation mechanism to rotate so as to increase the left side length of the projection image.

[0057] It should be noted that before executing step S1061, the correction position from the current projection picture to the target projection picture may also be determined by a keystone correction module.

[0058] When the angle difference is greater than 0, the projected image is on the right side of the user, otherwise, it is on the left side of the user. When it is on the right side, the right side of the projected image needs to be widened, and when it is on the left side, the left side of the projected image needs to be widened.

[0059] In order to solve the Figure 4 The problem that the wall B pointed to by the remote control 202 is not the wall A currently projected by the projection device 201, in some embodiments, the projection control method further includes step S107 and step S108:

[0060] Step S107: if the remote control point is not included in the image, determining the wall where the projection image of the projection device is located and the wall to which the remote control is pointing;

[0061] An image sensor can be used in advance to capture images of the walls in the space where the projection device is located. The image can be processed to obtain scene features of each wall, where the scene features can be histogram distribution features or corner point features, and each wall is numbered, for example, the wall in the east direction is wall 1, the wall in the south direction is wall 2, the wall in the west direction is wall 3, and the wall in the north direction is wall 4.

[0062] When the image captured by the image sensor does not include the remote control point, it means that the wall pointed to by the remote control and the wall currently projected by the projection device are not the same wall. At this time, the scene features in the image can be analyzed to determine the wall where the projection image projected by the projection device is located. After that, the rotation mechanism is controlled to rotate so that the image sensor obtains the image of the wall where the remote control point is located, and the scene features of the wall are obtained based on the image, thereby obtaining the wall where the remote control point is located.

[0063] Step S108: controlling the rotation mechanism of the projection device to rotate so that the wall where the projection image is located and the wall to which the remote control points are the same wall or the image includes the remote control point.

[0064] When the wall where the projection image is located and the wall to which the remote control points are the same wall or the image includes a remote control point, steps S101 to S104 can be continued to make the center point of the projection image coincide with the remote control point, thereby making the adjustment of the projection image more accurate.

[0065] The embodiment of the present application also provides a projection control method, which emits invisible light through a projection remote control, uses a sensor built into the machine to capture the position of the invisible light, converts it into an instruction for a rotation mechanism of the projection device, and controls the projection device to move to the area pointed by the remote control. The specific scheme is as follows:

[0066] 1) When using the remote control, the user presses the invisible light emission button and points the remote control at the desired projection area. The optional display area is required to be directly in front of the projection device, so that the sensor (i.e., image sensor) installed on the projection device can capture the invisible light (i.e., remote control signal).

[0067] 2) After pressing the invisible light emission button, the remote control sends a command to the projection device at the same time. The device uses a camera to capture the projection image in real time to locate the projection area, and at the same time locates the position of the invisible light spot captured by the sensor.

[0068] 3) Use the invisible light capture sensor to capture the image in front of the projection. The captured image is as follows Figure 3 shown.

[0069] 4) By extracting the highlighted area, the remote control signal position can be located. Figure 3Because the sensor is installed on the projection device, the position information of the projection area in the sensor can be preset in advance, such as Figure 3 As shown in the dotted area in the figure, the center point of the projected image is Figure 3 The reference point C in .

[0070] 5) Next, the projection device mechanism needs to be rotated to make the C point and the O point in the projection image coincide. The specific steps are as follows: first, the coordinates of the C point (Cx, Cy) are known, and the coordinates of the O point (Ox, Oy) are located in real time, and the pixel distance (i.e., the distance between the remote control point and the reference point) and direction of Cx->Ox, Cy->Oy are calculated. Among them, Dx=Ox-Cx, Dy=Oy-Cy; if Dx<0, the projection image needs to be moved horizontally to the left; if Dx>0, the projection image needs to be moved horizontally to the right; if Dy<0, the projection image needs to be moved vertically upward; Dy>0, the projection image needs to be moved vertically downward.

[0071] 6) After calculating the pixel distance Dx and Dy, we need to convert the pixel distance to the rotation amount of the mechanism (i.e. the rotation mechanism). The rotation conversion relationship can be of many kinds depending on the different devices used, such as linear relationship and curve relationship. Taking the linear relationship as an example, Mx=k1*Dx, My=k2*Dy, and the curve relationship Mx=a1*Dx 2 +b1*Dx+c1,My=a2*Dy 2 +b2*Dy+c2.

[0072] 7) Through steps 5) and 6), the rotation instructions of the rotation mechanism can be obtained, such as turning Mx to the left and turning My upward. While calculating and analyzing, the position of point O is photographed in real time to see if there is any change. If there is any change, the values ​​of Mx and My need to be updated.

[0073] 8) In order to make the projected image closer to a rectangular image in the user's line of sight, we can add a geomagnetic sensor to the remote control. When the user is using it, the user is first required to hold the remote control and calibrate it against the wall, and record the magnetic field angle α (the second magnetic field angle) when the remote control is facing the projection wall (that is, the remote control points to the reference point). When in use, the user uses the remote control to point to the target display area of ​​the projection image, and there will be a new magnetic field angle β (the first magnetic field angle). (β-α) (that is, the angle difference between the first magnetic field angle and the second magnetic field angle) is the user's line of sight angle relative to the front projection. Therefore, the projector adjusts the projection image according to (β-α) to make it more in line with the user's perspective.

[0074] The specific adjustment process is as follows: first, we need to calculate the correction position of the projected image based on the existing mature keystone correction module, and then we will adjust the left and right boundary lengths of the projection according to (β-α). For example, if (β-α)>0, the projected image is on the right side of the user's position, otherwise it is on the left side of the user. When it is on the right, the right side of the projection needs to be widened, and when it is on the left, the left side of the projection needs to be widened.

[0075] 9) In order to solve the problem that the wall pointed by the remote control is not the wall currently projected, since we have calibrated the front projection state of the remote control, we can also project the scene features corresponding to each wall based on the device camera. These features can be histogram distributions or corner point features, and the orientations of the projection walls and remote controls are numbered. For example, wall 1 corresponds to the east, wall 2 corresponds to the south, wall 3 corresponds to the west, and wall 4 corresponds to the north. When the wall pointed by the remote control and the projected image are not on the same wall or the projection spot of the remote control exceeds the camera shooting range of the machine, the wall projected by the current camera image positioning projection is obtained, and then the pointing direction of the remote control is obtained, and the projection is controlled to turn to the orientation wall pointed by the remote control. After the projection can capture the remote control spot, call steps 4) to 8) to complete the precise adjustment of the picture.

[0076] The present application also provides a projection control device, referring to Figure 5 , the projection control device 500 comprises:

[0077] A first acquisition module 510 is used to acquire an image in front of the projection device obtained in real time by an image sensor;

[0078] Here, the image sensor may be an infrared camera in the projection device.

[0079] A first determination module 520 is used to determine the position information of the remote control point and the position information of the reference point based on the image; the remote control point is the remote control signal point sent by the remote controller, and the reference point is the center point of the projection screen of the projection device;

[0080] A second determination module 530, configured to determine a rotation parameter of the rotation mechanism based on the position information of the reference point and the position information of the remote control point;

[0081] The control module 540 is used to control the rotation of the rotation mechanism based on the rotation parameter so that the reference point coincides with the remote control point.

[0082] Here, the rotation mechanism may be a general term for components in the projection device for realizing rotation.

[0083] In some embodiments, the second determination module includes: a first determination submodule for determining the distance between the reference point and the remote control point based on the position information of the reference point and the position information of the remote control point;

[0084] The second determination submodule is used to determine the rotation parameter of the rotation mechanism based on the distance.

[0085] In some embodiments, the rotation parameter includes a moving direction and a moving amount, the distance includes a horizontal distance and a vertical distance, and the moving amount includes a horizontal moving amount and a vertical moving amount;

[0086] The second determination submodule includes: a first determination unit, configured to determine that the moving direction is moving to the left when the distance in the horizontal direction is less than 0, and to determine that the moving direction is moving to the right when the distance in the horizontal direction is greater than 0;

[0087] a second determining unit, configured to determine that the moving direction is upward movement when the distance in the vertical direction is less than 0, and to determine that the moving direction is downward movement when the distance in the vertical direction is greater than 0;

[0088] And, a third determining unit is used to convert the distance in the horizontal direction and the distance in the vertical direction respectively by using a linear relationship or a curve relationship, so as to determine the movement amount in the horizontal direction and the movement amount in the vertical direction respectively.

[0089] In some embodiments, the first determination module includes: a third determination submodule, configured to perform binarization processing on the image to determine a highlight area in the image;

[0090] The fourth determination submodule is used to determine the position information of the remote control point based on the highlighted area.

[0091] In some embodiments, the projection control device further includes: a second acquisition module, configured to acquire a first magnetic field angle when the remote controller points to a target area in the projection image and a second magnetic field angle when the remote controller points to the reference point;

[0092] Correspondingly, the control module is further used to control the rotation of the rotating mechanism based on the first magnetic field angle and the second magnetic field angle, so as to adjust the projection picture of the projection device on the projection area.

[0093] In some embodiments, the control module includes: a fifth determination submodule, configured to determine an angle difference between the first magnetic field angle and the second magnetic field angle;

[0094] The first control submodule is used to control the rotation mechanism to rotate so as to increase the right side length of the projection image when the angle difference is greater than zero; and to control the rotation mechanism to rotate so as to increase the left side length of the projection image when the angle difference is less than zero.

[0095] In some embodiments, the projection control device further includes: a third determination module, configured to determine, when the image does not include the remote control point, the wall where the projection image of the projection device is located and the wall to which the remote control is pointing;

[0096] Correspondingly, the control module is also used to control the rotation mechanism of the projection device to rotate so that the wall where the projection image is located and the wall pointed to by the remote control are the same wall or the image includes the remote control point.

[0097] The description of the above device embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. In some embodiments, the functions or modules included in the device provided in the embodiment of the present application can be used to execute the method described in the above method embodiment. For technical details not disclosed in the device embodiment of the present application, please refer to the description of the method embodiment of the present application for understanding.

[0098] It should be noted that in the embodiment of the present application, if the above-mentioned projection control method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application can be essentially or partly reflected in the form of a software product that contributes to the relevant technology. The software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific hardware, software or firmware, or any combination of hardware, software, and firmware.

[0099] An embodiment of the present application also provides a projection device, including a remote control, an image sensor, a rotation mechanism, a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, some or all of the steps in the above method are implemented.

[0100] The embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, some or all of the steps in the above method are implemented. The computer-readable storage medium can be transient or non-transient.

[0101] An embodiment of the present application further provides a computer program, including a computer-readable code. When the computer-readable code is run in a projection device, a processor in the projection device executes some or all of the steps for implementing the above method.

[0102] The present application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and when the computer program is read and executed by a computer, some or all of the steps in the above method are implemented. The computer program product can be implemented specifically by hardware, software, or a combination thereof. In some embodiments, the computer program product is specifically embodied as a computer storage medium, and in other embodiments, the computer program product is specifically embodied as a software product, such as a software development kit (SDK), etc.

[0103] It should be noted here that the description of the various embodiments above tends to emphasize the differences between the various embodiments, and the same or similar aspects can be referenced to each other. The description of the above device, storage medium, computer program and computer program product embodiments is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the embodiments of the device, storage medium, computer program and computer program product of this application, please refer to the description of the method embodiment of this application for understanding.

[0104] It should be noted that Figure 6 is a schematic diagram of a hardware entity of a projection device in an embodiment of the present application, such as Figure 6 As shown, the projection device 600 ( Figure 6 The hardware entity of the projection device (not shown in the figure) includes: a processor 601, a communication interface 602 and a memory 603, wherein:

[0105] The processor 601 generally controls the overall operation of the projection device 600 .

[0106] The communication interface 602 enables the projection device 600 to communicate with other terminals or servers through a network.

[0107] The memory 603 is configured to store instructions and applications executable by the processor 601, and can also cache data to be processed or processed by the processor 601 and each module in the projection device 600 (for example, image data, audio data, voice communication data, and video communication data), which can be implemented by flash memory (FLASH) or random access memory (Random Access Memory, RAM). Data transmission can be performed between the processor 601, the communication interface 602, and the memory 603 through the bus 604.

[0108] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the serial number of each step / process mentioned above does not mean the order of execution, and the execution order of each step / process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The serial numbers of the embodiments of the present application mentioned above are for description only and do not represent the advantages and disadvantages of the embodiments.

[0109] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0110] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0111] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0112] In addition, all functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may be a separate unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0113] A person skilled in the art can understand that all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, etc., various media that can store program codes.

[0114] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can essentially or in other words, the part that contributes to the relevant technology can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0115] The features disclosed in several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.

[0116] The above are only some implementation methods of the embodiments of the present application, but the protection scope of the embodiments of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or replacements within the technical scope disclosed in the embodiments of the present application, which should be included in the protection scope of the embodiments of the present application. Therefore, the protection scope of the embodiments of the present application shall be based on the protection scope of the claims.

Claims

1. A projection control method, characterized in that: A processor applied to a projection device, the projection device comprising: a remote controller, an image sensor, a rotation mechanism and a processor; the method comprising: Acquire an image in front of the projection device obtained in real time by the image sensor; Based on the image, respectively determine the position information of the remote control point and the position information of the reference point; the remote control point is the remote control signal point emitted by the remote controller, and the reference point is the center point of the projection screen of the projection device; Determining a rotation parameter of the rotation mechanism based on the position information of the reference point and the position information of the remote control point; The rotation mechanism is controlled to rotate based on the rotation parameter so that the reference point coincides with the remote control point.

2. The method according to claim 1, characterized in that The step of determining the rotation parameters of the rotation mechanism based on the position information of the reference point and the position information of the remote control point comprises: Determining the distance between the reference point and the remote control point based on the position information of the reference point and the position information of the remote control point; Based on the distance, a rotation parameter of the rotation mechanism is determined.

3. The method according to claim 2, characterized in that The rotation parameters include a moving direction and a moving amount, the distance includes a horizontal distance and a vertical distance, and the moving amount includes a horizontal moving amount and a vertical moving amount; determining the rotation parameters of the rotating mechanism based on the distance includes: When the distance in the horizontal direction is less than 0, the moving direction is determined to be moving to the left, and when the distance in the horizontal direction is greater than 0, the moving direction is determined to be moving to the right; When the distance in the vertical direction is less than 0, the moving direction is determined to be upward movement, and when the distance in the vertical direction is greater than 0, the moving direction is determined to be downward movement; Furthermore, the horizontal distance and the vertical distance are converted respectively using a linear relationship or a curve relationship to determine the horizontal movement amount and the vertical movement amount respectively.

4. The method according to any one of claims 1 to 3, characterized in that: The determining, based on the image, the position information of the remote control point and the position information of the reference point respectively comprises: Performing binarization processing on the image to determine a highlight area in the image; Based on the highlighted area, the position information of the remote control point is determined.

5. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: Acquire a first magnetic field angle when the remote control points to a target area in the projection image and a second magnetic field angle when the remote control points to the reference point; Based on the first magnetic field angle and the second magnetic field angle, the rotation mechanism is controlled to rotate to adjust a projection picture of the projection device on a projection area.

6. The method according to claim 5, characterized in that The controlling the rotation mechanism to rotate based on the first magnetic field angle and the second magnetic field angle to adjust the projection screen of the projection device on the projection area includes: determining an angular difference between the first magnetic field angle and the second magnetic field angle; When the angle difference is greater than zero, the rotating mechanism is controlled to rotate so as to increase the length of the right side of the projection image; When the angle difference is less than zero, the rotating mechanism is controlled to rotate so as to increase the length of the left side of the projection image.

7. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: When the remote control point is not included in the image, determining the wall where the projection image of the projection device is located and the wall to which the remote control is pointing; The rotating mechanism of the projection device is controlled to rotate so that the wall where the projection image is located and the wall to which the remote control points are the same wall or the image includes the remote control point.

8. A projection control device, characterized in that: include: A first acquisition module is used to acquire an image in front of the projection device obtained in real time by an image sensor; A first determination module, used to determine the position information of the remote control point and the position information of the reference point respectively based on the image; The remote control point is the remote control signal point sent by the remote controller, and the reference point is the center point of the projection screen of the projection device; A second determination module, configured to determine a rotation parameter of the rotation mechanism based on the position information of the reference point and the position information of the remote control point; The control module is used to control the rotation of the rotation mechanism based on the rotation parameter so that the reference point coincides with the remote control point.

9. A projection device, characterized in that: include: A remote controller, an image sensor, a rotating mechanism, a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, the steps in the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps in the method according to any one of claims 1 to 7 are implemented.

Images