Projection equipment control method, storage medium and projection equipment
By determining the coordinate information of the target projection point and adjusting the attitude of the projection device, the problem of unstable projection of the projection device in the dynamic projection is solved, and the precise projection of the projection screen follows the user's pointing position is realized, improving the user experience.
Patent Information
- Application Number
- CN202410931215.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2022-05-27
- Publication Date
- 2024-11-15
AI Technical Summary
In dynamic projection application scenarios, existing projection devices are difficult to ensure that the projection screen follows the user's desired direction for precise projection, resulting in unstable projection effect.
By determining the coordinate information of the target projection point, adjusting the posture of the projection device, so that the center point of the projection picture coincides with the target projection point, and achieving accurate projection of the projection picture following the user's pointing position. The specific method includes receiving target position information and spatial position information sent by the remote control device or terminal device, determining intersection coordinate information in combination with a three-dimensional model, adjusting the projection attitude of the projection device, and performing image correction and adjustment of focus parameters based on the captured image.
The projection image projected by the projection device can accurately follow the user's pointing position for projection, improving the stability and user experience of the projection device in the dynamic projection scene.
Smart Images

Figure CN118972528A_ABST
Abstract
Description
[0001] This application claims a divisional of a Chinese patent application filed with the China Patent Office on May 27, 2022, with application number 202210594636.8, and invention name “Projection equipment control method, device, storage medium and projection equipment”, all contents of which are incorporated by reference in this application. Technical Field
[0002] The present disclosure relates to the field of projection technology, and in particular to a projection device control method, a storage medium, and a projection device. Background Art
[0003] With the development of projection technology, users' demands for projection equipment are also changing. For example, the current application of portable projection equipment is also driving users' demands for projection equipment to develop in the direction of miniaturization, mobility and high resolution.
[0004] In the application scenario of dynamic projection, the projection device can perform multi-directional projection. Therefore, how to ensure that the projection image can be projected in the direction expected by the user when the projection device performs dynamic projection becomes a technical problem that needs to be solved urgently. Summary of the invention
[0005] The present disclosure discloses a projection device control method, a storage medium and a projection device, which can realize that a projection picture projected by the projection device follows a target projection point for projection.
[0006] In a first aspect, the present disclosure relates to a projection device control method, comprising:
[0007] Determine first coordinate information of a target projection point on the projection area in the space where the projection area is located;
[0008] Determine a first posture adjustment parameter of the projection device according to the first coordinate information;
[0009] The projection posture of the projection device is adjusted according to the first posture adjustment parameter so that the center point of the projection picture projected by the projection device coincides with the target projection point.
[0010] Optionally, determining first coordinate information of a target projection point on the projection area in a space where the projection area is located includes:
[0011] Receiving target posture information and spatial position information of the remote control device sent by the remote control device;
[0012] Determine the second coordinate information of the intersection between the pointing ray of the remote control device and the three-dimensional model according to the target posture information and the spatial position information, combined with the three-dimensional model corresponding to the space where the projection area is located;
[0013] Determine the second coordinate information of the intersection point as the first coordinate information of the target projection point;
[0014] or,
[0015] Receive first coordinate information of a target projection point sent by a terminal device, wherein the target projection point is determined on a three-dimensional model corresponding to a space where a projection area displayed on the terminal device is located.
[0016] Optionally, the method further comprises:
[0017] Acquire a captured image, wherein the captured image is obtained by projecting a preset image onto a projection area by a projection device in a projection posture corresponding to the first posture adjustment parameter, and capturing the projection area;
[0018] Determine a second posture adjustment parameter according to third coordinate information of an image center point of a preset image in the captured image and fourth coordinate information of a target projection point on the captured image;
[0019] The projection posture of the projection device is adjusted to a projection posture corresponding to the second posture adjustment parameter.
[0020] Optionally, the method further comprises:
[0021] Determine, according to the first coordinate information, a projection correction parameter of the projection device, wherein the projection correction parameter includes an image correction parameter and / or a focus parameter, and the image correction parameter is used to make the projection screen of the projection image corrected by the image correction parameter projected on the projection area appear as a rectangle;
[0022] The projection image projected by the projection device is corrected according to the projection correction parameters.
[0023] Optionally, determining a projection correction parameter of a projection device according to the first coordinate information includes:
[0024] When the projection correction parameters include image correction parameters, determining first position information of the projection device according to the first coordinate information;
[0025] Determine second pose information of the projection image relative to the projection device according to the first pose information and the normal vector of the projection area;
[0026] According to the second posture information, an image correction parameter corresponding to the target projection point is determined.
[0027] Optionally, determining an image correction parameter corresponding to the target projection point according to the second posture information includes:
[0028] Obtaining a target rotation angle, wherein the target rotation angle is a rotation angle of the projection image in a roll angle direction;
[0029] The image correction parameters are determined according to the second posture information and the target rotation angle.
[0030] Optionally, the method further comprises:
[0031] Determine, according to the first coordinate information, whether the projection picture corresponding to the target projection point satisfies a preset condition, wherein the preset condition indicates that the projection picture is located in at least two intersecting planes;
[0032] When the preset conditions are met, the first coordinate information is corrected to obtain the corrected first coordinate information.
[0033] In a second aspect, the present disclosure relates to a projection device control device, comprising:
[0034] A first determination module is configured to determine first coordinate information of a target projection point on the projection area in the space where the projection area is located;
[0035] A second determination module is configured to determine a first posture adjustment parameter of the projection device according to the first coordinate information;
[0036] The adjustment module is configured to adjust the projection posture of the projection device according to the first posture adjustment parameter so that the center point of the projection picture projected by the projection device coincides with the target projection point.
[0037] In a third aspect, the present disclosure relates to a projection device, comprising:
[0038] a storage device having a computer program stored thereon;
[0039] A processing device is used to execute the computer program in the storage device to implement the steps of the method described in the first aspect.
[0040] In a fourth aspect, the present disclosure relates to a computer storage medium, wherein the storage medium stores a computer program, and when the program is executed by a processing device, the steps of the method described in the first aspect are implemented.
[0041] The present disclosure relates to a projection device control method, device, storage medium and projection device. The method determines the first position adjustment parameter of the projection device under the target projection point through the first coordinate information of the target projection point, and adjusts the projection posture of the projection device according to the first position adjustment parameter, so that the center point of the projection picture projected by the projection device after the projection posture adjustment can coincide with the target projection point, so that the projection picture projected by the projection device can be accurately projected following the pointing position of the user. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale. In the drawings:
[0043] Figure 1 It is a schematic structural diagram of a projection device proposed according to an exemplary embodiment.
[0044] Figure 2 It is a schematic diagram of an application scenario of a projection device proposed according to an exemplary embodiment.
[0045] Figure 3 is a flow chart of a method for controlling a projection device according to an exemplary embodiment.
[0046] Figure 4 is a schematic diagram of a target projection point proposed according to an exemplary embodiment.
[0047] Figure 5 It is a schematic diagram of adjusting the projection posture of a projection device according to an exemplary embodiment.
[0048] Figure 6 A flowchart for determining first coordinate information is proposed according to an exemplary embodiment.
[0049] Figure 7 is a schematic diagram of an intersection proposed according to an exemplary embodiment.
[0050] Figure 8 It is a schematic diagram of determining a target projection point on a terminal device according to an exemplary embodiment.
[0051] Fig. 9 is a flow chart of a method for controlling a projection device according to another exemplary embodiment.
[0052] Fig.10 is a flowchart of a method for controlling a projection device according to yet another exemplary embodiment.
[0053] Fig.11 yes Fig.10 A specific flow chart of step 410 is shown.
[0054] Fig.12 is a schematic diagram of a three-dimensional model proposed according to an exemplary embodiment.
[0055] Fig.13 is a schematic diagram of a projection screen on a ceiling according to an exemplary embodiment.
[0056] Fig.14is a schematic diagram of a projection screen on a ceiling according to yet another exemplary embodiment.
[0057] Fig.15 It is a schematic diagram of a projection screen located in at least two intersecting planes according to an exemplary embodiment.
[0058] Fig.16 is a schematic diagram of an adjusted projection picture according to an exemplary embodiment.
[0059] Fig.17 The present invention is a schematic diagram of module connections of a projection device control apparatus according to an exemplary embodiment.
[0060] Fig.18 It is a schematic structural diagram of a projection device proposed according to an exemplary embodiment. DETAILED DESCRIPTION
[0061] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.
[0062] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.
[0063] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.
[0064] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.
[0065] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".
[0066] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.
[0067] Figure 1 FIG. 1 is a schematic diagram of a structure of a projection device according to an exemplary embodiment. Figure 1 As shown, the projection device 100 may at least include a motion control unit 101 and a projection unit 102 , wherein the projection unit 102 is mounted on the motion control unit 101 , and the motion control unit 101 is used to control the projection unit 102 to rotate.
[0068] The motion control unit 101 can control the projection unit 102 to rotate in two or three directions of the horizontal direction, the vertical direction and the rolling angle direction. The motion control unit 101 can be a device such as a pan / tilt platform or a multi-axis motion platform, and the motion control unit 101 can include a rotating shaft, a motor and an encoder. The motor is connected to the rotating shaft and the encoder respectively, and the rotating shaft drives the projection unit 102 to rotate under the action of the motor, and the encoder is used to record the rotation position of the motor.
[0069] The projection unit 102 may be any type of device having a projection function, for example, a long-throw projection device, a short-throw projection device, and the like.
[0070] It should be understood that Figure 1 The partial structure of the projection device 100 is shown. In other implementations, the projection device 100 may also include other structures. For example, the projection device 100 may also include a wireless communication module, a shooting module, a sensor module, etc. for communicating with external devices.
[0071] Figure 2 FIG. 1 is a schematic diagram of an application scenario of a projection device proposed according to an exemplary embodiment. Figure 2 As shown, the application scenario of the projection device includes a projection device 201 and a terminal device 202. The projection device 201 is in communication connection with the terminal device 202, and the terminal device 202 can send a projection direction adjustment instruction to the projection device 201 to adjust the projection direction and projection angle of the projection device 201 according to the projection direction adjustment instruction. Of course, the terminal device 202 can also directly send a motion trajectory to the projection device 201, so that the projection device 201 performs projection according to the motion trajectory.
[0072] It should be understood that Figure 2 The terminal device 202 shown can be a mobile terminal, such as a smart phone. Of course, the terminal device 202 can also be a remote control device that matches the projection device 201, such as an infrared remote control.
[0073] Figure 3 FIG. 1 is a flow chart of a method for controlling a projection device according to an exemplary embodiment. Figure 3 As shown, the embodiment of the present disclosure provides a projection device control method, which can be applied to Figure 1 In the projection device shown, the control can be performed by a projection device control device arranged in the projection device, and the device can be implemented by software and / or hardware and configured in the projection device. Figure 3 As shown, the method may include the following steps.
[0074] In step 110, first coordinate information of a target projection point on the projection area in the space where the projection area is located is determined.
[0075] Here, the projection area refers to a medium for carrying a projection image, and the projection area may be a wall or a screen, etc. The target projection point may be the position of the center point of the projection image desired by the user on the projection area, and the first coordinate information of the target projection point refers to the coordinate information of the target projection point in the spatial coordinate system of the space where the projection area is located.
[0076] Figure 4 is a schematic diagram of a target projection point proposed according to an exemplary embodiment. Figure 4 As shown, in the space including the first projection area 401 and the second projection area 402, the target projection point 403 is located on the second projection area 402, and the first coordinate information of the target projection point 403 is the coordinate information in the space coordinate system XOYZ.
[0077] It should be understood that the above-mentioned spatial coordinate system XOYZ may be a coordinate system used to model the space where the projection area is located in a forward projection state when the projection device is relative to the second projection area 402. Then the Z axis in the spatial coordinate system XOYZ is the direction of the optical center ray of the projection device, and the origin O is the position of the projection device in space.
[0078] In step 120, a first posture adjustment parameter of the projection device is determined according to the first coordinate information.
[0079] Here, the first pose adjustment parameter is used to adjust Figure 1 The parameters controlled by the motion control unit 101 shown in the figure can enable the motion control unit 101 to adjust the projection posture of the projection unit 102 through the first posture adjustment parameter. The first posture adjustment parameter may include at least one of a yaw angle, a pitch angle, and a roll angle.
[0080] In some embodiments, when the first posture adjustment parameter includes a yaw angle and / or a pitch angle, the first posture adjustment parameter corresponding to the first coordinate information can be calculated by the following first preset calculation formula. Wherein, the first preset calculation formula is:
[0081] γ p =arctan(|x2| / z2)
[0082]
[0083] Among them, γ p is the yaw angle, ρ p is the pitch angle, x2 is the coordinate of the first coordinate information on the X-axis, y2 is the coordinate of the first coordinate information on the Y-axis, Z2 is the coordinate of the first coordinate information on the Z-axis, the X-axis is the horizontal direction, the Y-axis is the vertical direction, and the Z-axis is perpendicular to both the Y-axis and the X-axis.
[0084] In step 130, the projection posture of the projection device is adjusted according to the first posture adjustment parameter so that the center point of the projection picture projected by the projection device coincides with the target projection point.
[0085] Here, after obtaining the first posture adjustment parameter, the motion control unit of the projection device controls the projection device to rotate according to the first posture adjustment parameter, so that the center point of the projection picture projected by the projection device can coincide with the target projection point.
[0086] Figure 5 FIG. 1 is a schematic diagram of adjusting the projection posture of a projection device according to an exemplary embodiment. Figure 5 As shown, at the first moment, the first projection screen 501 of the projection device A is located in the first projection area 502. At the second moment in the future, the user needs to adjust the projection screen, and the user expects that the center point of the projection screen can coincide with the target projection point B located in the second projection area 503, then the user indicates the corresponding target projection point B, and the projection device A responds to the projection screen adjustment instruction, calculates the first pose adjustment parameter according to the first coordinate information of the target projection point B, and adjusts the projection posture of the projection device A according to the first pose adjustment parameter, so that the center point of the second projection screen 504 can coincide with the target projection point B.
[0087] Therefore, the first coordinate information of the target projection point is used to determine the first posture adjustment parameter of the projection device at the target projection point, and the projection posture of the projection device is adjusted according to the first posture adjustment parameter, so that the center point of the projection picture projected by the projection device after the projection posture is adjusted can coincide with the target projection point, thereby achieving that the projection picture projected by the projection device can accurately follow the pointing position of the user for projection.
[0088] Figure 6FIG. 1 is a flowchart for determining first coordinate information according to an exemplary embodiment. Figure 6 As shown, in some feasible implementations, the first coordinate information of the target projection point can be determined by the following steps.
[0089] In step 611, target posture information and spatial position information of the remote control device sent by the remote control device are received.
[0090] Here, the target posture information of the remote control device refers to the posture of the remote control device, such as the yaw angle and pitch angle of the remote control device. The spatial position information of the remote control device refers to the geometric position of the remote control device in space, and the spatial position information may include the height information of the remote control device, the distance from the projection area (wall or screen), etc. For example, when the projection device is used indoors, the spatial position information of the remote control device refers to the spatial position of the remote control device in the indoor space, and the spatial position may refer to the height information of the remote control device and the distance information between the remote control device and the wall. For example, it may include the positioning information of the remote control device in the living room and the height of the user holding the remote control device.
[0091] In some embodiments, the spatial location information of the remote control device may be obtained based on a communication module of the remote control device. The spatial location information of the remote control device may be determined based on the communication module of the remote control device in combination with indoor spatial positioning technology. For example, the spatial location information of the remote control device may be calculated using UWB (Ultra Wideband) spatial positioning technology or WiFi 6.0 (a wireless network standard) spatial positioning technology.
[0092] In some embodiments, the target posture information of the remote control device can be obtained by a gyroscope, a gravimeter, a time-of-flight sensor, or the like.
[0093] It should be understood that the remote control device can send a preset instruction to the projection device, which is used to instruct the projection device to enter a mode of projecting following the target projection point indicated by the remote control device. After the projection device enters this mode, the remote control device can send the target posture information and spatial position information to the projection device through a communication connection.
[0094] In step 612, the second coordinate information of the intersection point between the pointing ray of the remote control device and the three-dimensional model is determined based on the target posture information and the spatial position information in combination with the three-dimensional model corresponding to the space where the projection area is located.
[0095] Here, the projection device may perform three-dimensional modeling on the space where the projection area is located to obtain a three-dimensional model of the space where the projection area is located. Exemplarily, the three-dimensional modeling of the space where the projection area is located may specifically be:
[0096] A global coordinate system is established at the starting position of the depth camera, and the image data and point cloud data corresponding to the starting position are collected. Then the depth camera is controlled to rotate and the image data and point cloud data are continuously collected during the rotation process. At the same time, the odometer is tracked based on the image data and point cloud data to obtain the position change information of the depth camera. After the depth camera rotates 360°, the image data and point cloud data collected during the rotation process are fused into the image data and point cloud data in the global coordinate system constructed in the first frame using an incremental method based on the obtained position change information. After the depth camera completes a 360° rotation, all the point cloud data are closed through the loop detection algorithm to obtain a three-dimensional model of the space where the projection device is located.
[0097] It should be understood that a three-dimensional model of the space where the projection area is located is stored on the projection device. When the projection device changes its spatial position and is set in another space, the projection device models the space and stores the corresponding three-dimensional model.
[0098] When the target posture information and spatial position information of the remote control device are obtained, the ray at which the remote control device is pointing is determined based on the target posture information and spatial position information, and then the intersection of the ray and the three-dimensional space is calculated to obtain the second coordinate information of the intersection.
[0099] Figure 7 is a schematic diagram of an intersection proposed according to an exemplary embodiment. Figure 7 As shown, according to the target posture information and spatial position information of the remote control device A in the spatial coordinate system XYZ, the ray 701 where the remote control device is pointing is obtained. Among them, the target posture information includes the yaw angle ∠OAZ and the pitch angle ∠OAB. It should be understood that the ray 701 can be represented by the first equation, which is:
[0100]
[0101] Where P(t) is the point on ray 701, P0 ′ is the coordinate of point A, is the direction vector of ray 701.
[0102] In a three-dimensional model, a plane can be represented by any point on the plane and the plane normal vector passing through the point. Then the plane on the three-dimensional model can be represented by the second equation, which is:
[0103]
[0104] Where P is a plane, P0 is a known point on the plane, is the normal vector through point P0 on the plane.
[0105] when When , it means that the ray is parallel to the plane. , it indicates that the ray is not parallel to the plane. Therefore, by traversing the plane in the three-dimensional model, it can be determined that the ray 701 intersects with the projection area 702. According to the above equation, the second coordinate information of the intersection point B of the ray 701 and the projection area 702 is:
[0106]
[0107] It should be understood that when calculating the intersection of ray 701 and the three-dimensional model, it can also be calculated by other methods, which will not be described one by one here. For example, iteratively increase ray 701 according to the spatial angle to obtain the discrete coordinate point A'(x, y, z) on ray 701, and then substitute A'(x, y, z) into the plane equation in the three-dimensional model to obtain the intersection with the plane.
[0108] In step 613, the second coordinate information of the intersection point is determined as the first coordinate information of the target projection point.
[0109] Here, the intersection is actually the point where the ray pointing to the remote control device is mapped on the projection area (wall or screen), and the intersection reflects the projection area selected by the user. For example, when the remote control device is an infrared remote control device, the intersection refers to the point where the infrared ray irradiates the projection area. Therefore, the second coordinate information of the intersection can be determined as the first coordinate information of the target projection point.
[0110] Therefore, by receiving the target posture information and spatial position information sent by the remote control device, the interaction between the projection device and the remote control device can be realized, and the projection picture projected by the projection device can follow the direction change of the remote control device.
[0111] In some feasible implementations, the projection device may receive first coordinate information of a target projection point sent by a terminal device, wherein the target projection point is determined on a three-dimensional model corresponding to a space where a projection area displayed on the terminal device is located.
[0112] Here, after the projection device performs three-dimensional modeling on the space where the projection area is located, the three-dimensional model is sent to the terminal device. The user can determine the target projection point on the three-dimensional model corresponding to the space where the projection area is located displayed on the terminal device. Since the points on the three-dimensional model correspond one-to-one to the points in the projection area in the real environment, the projection device can determine the first coordinate information of the target projection point.
[0113] Figure 8 is a schematic diagram of determining a target projection point on a terminal device according to an exemplary embodiment. Figure 8As shown, a three-dimensional model 802 is displayed in a terminal device 801 , and then a user selects a target projection point 803 on any projection area on the three-dimensional model 802 .
[0114] Therefore, by determining the target projection point on the terminal device, the user can customize the movement of the projection screen. Moreover, during use, the user only needs to model the space where the projection area is located once to set the projection position of the projection screen at will, which can improve the user experience when using the dynamic projection device.
[0115] It is worth noting that in the above implementation, two methods of obtaining the first coordinate information of the target projection point are illustrated, but in actual application scenarios, the first coordinate information of the target projection point can also be obtained by other methods. For example, the target projection point is displayed on the projection area by infrared rays of a remote control device, and the space of the projection area is photographed by a panoramic shooting device, and the red dot irradiated by infrared rays on the projection area is identified in the captured image, and the first coordinate information of the target projection point is determined according to the coordinates of the red dot on the image.
[0116] Fig. 9 FIG. 1 is a flow chart of a method for controlling a projection device according to another exemplary embodiment. Fig. 9 As shown, in some feasible implementations, after adjusting the projection posture of the projection device according to the first posture adjustment parameter, the following steps may also be included.
[0117] In step 310, a captured image is acquired, wherein the captured image is obtained by projecting a preset image onto a projection area by a projection device in a projection posture corresponding to the first posture adjustment parameter, and capturing the projection area.
[0118] Here, after adjusting the projection posture of the projection device according to the first posture adjustment parameter, the projection device projects a preset image to the projection area under the projection posture corresponding to the first posture adjustment parameter, and then the projection device shoots the projection area through the shooting module to obtain a shot image.
[0119] The preset image may be a pure white image, or the preset image may be an image that is clearly distinguishable from infrared rays.
[0120] In step 320, a second posture adjustment parameter is determined according to the third coordinate information of the image center point of the preset image in the captured image and the fourth coordinate information of the target projection point on the captured image.
[0121] Here, in the captured image, the third coordinate information of the image center point of the preset image is determined. The third coordinate information is the coordinate information of the image center point in the image coordinate system constructed with any point in the captured image as the coordinate origin. It should be understood that the third coordinate information of the image center point can be determined from the captured image according to the pixel grayscale value to all the pixel points belonging to the preset image, and then the image center point is determined according to all the determined pixel points to obtain the third coordinate information. Then, the second posture adjustment parameter is determined according to the difference between the third coordinate information of the image center point and the fourth coordinate information of the target projection point on the captured image. Among them, the concept of the second posture adjustment parameter is consistent with the concept of the first posture adjustment parameter, and will not be described in detail here.
[0122] In some embodiments, when the target projection point is determined based on data sent by the remote control device, the user can continue to point the remote control device at the projection area, and the target projection point mapped by the infrared light emitted by the remote control device will exist in the captured image. Therefore, the fourth coordinate information of the target projection point can be identified in the captured image. The fourth coordinate information is the coordinate information of the target projection point in the image coordinate system.
[0123] In other embodiments, when the target projection point is determined by a terminal device, the first coordinate information of the target projection point in the spatial coordinate system can be converted to the image coordinate system according to the mapping relationship between the spatial coordinate system and the image coordinate system to obtain the fourth coordinate information of the target projection point.
[0124] In step 330, the projection posture of the projection device is adjusted to a projection posture corresponding to the second posture adjustment parameter.
[0125] Here, after obtaining the second posture adjustment parameter, the motion control unit is adjusted according to the second posture adjustment parameter, so that the motion control unit adjusts the projection posture of the projection device to the projection posture corresponding to the second posture adjustment parameter. At this time, in the captured image, the image center point of the preset image coincides with the target projection point.
[0126] It should be understood that in the embodiment of the present disclosure, the projection device adjusts the projection posture of the projection device to the first projection posture according to the first posture adjustment parameter. At this time, ideally, under the first projection posture, the center point of the projection picture projected by the projection device can coincide with the target projection point. By projecting a preset image to the projection area under the first projection posture and acquiring a captured image, the second posture adjustment parameter is determined according to the difference between the image center point of the preset image in the captured image and the target projection point, and the projection posture of the projection device is adjusted from the first projection posture to the second projection posture. At this time, under the second projection posture, the center point of the projection picture can coincide with the target projection point.
[0127] Therefore, through the above implementation, the center point of the projection picture can be made to move closely following the target projection point, thereby realizing the projection picture tracking function.
[0128] Fig.10 FIG. 1 is a flow chart of a method for controlling a projection device according to another exemplary embodiment. Fig.10 As shown, in some practicable implementations, the projection device control method may further include the following steps:
[0129] In step 410, projection correction parameters of the projection device are determined based on the first coordinate information, wherein the projection correction parameters include image correction parameters and / or focus parameters, and the image correction parameters are used to make the projection screen of the projection image corrected by the image correction parameters projected on the projection area appear as a rectangle.
[0130] Here, the image correction parameter refers to a parameter used to correct the projection image, and the image correction parameter may be a perspective transformation matrix. The projection image corrected by the image correction parameter is projected onto the projection area and appears as a rectangle.
[0131] Exemplarily, the image correction parameters may be obtained according to the position information of each vertex of the projection picture projected in the projection area and the coordinate information of the corner points corresponding to the projection image corresponding to the projection picture.
[0132] Focus parameters refer to the projection focal length of the projection device when it is projecting. When the projection device projects to different target projection points, the distance between the optical center of the projection device and the projection area will change, causing the projection image to be blurred. When the projection device performs dynamic projection, the projection focal length of the projection device can be adjusted according to the focus parameters, so that the projection image at any target projection point can also be accurately focused.
[0133] Exemplarily, the focus parameter may be calculated using the following formula.
[0134]
[0135] Among them, d is the focus parameter, x c is the coordinate of the first coordinate information on the X axis, y c is the coordinate of the first coordinate information on the Y axis, z c is the coordinate of the first coordinate information on the Z axis.
[0136] In step 420, the projection image projected by the projection device is corrected according to the projection correction parameters.
[0137] Here, the motion control unit of the projection device controls the projection device to rotate according to the first posture adjustment parameter so that the center point of the projection screen projected by the projection device can coincide with the target projection point. In addition, the projection device corrects the projection image according to the corresponding image correction parameter and / or adjusts the projection focal length according to the focus parameter so that the projection screen corresponding to the target projection point can be presented as a rectangle and / or keep the screen clear.
[0138] Thus, when the center point of the projection screen projected by the projection device can coincide with the target projection point, the projection image can be corrected according to the image correction parameters corresponding to the target projection point so that the projection screen appears as a rectangle, and / or the projection focal length of the projection device can be adjusted according to the focus parameters corresponding to the target projection point so that the projection screen remains clear. In the process of dynamic projection by the projection device, the projection screen projected by the projection device always remains as a rectangle and / or the projection focal length of the projection device always maintains the optimal focal length, so as to improve the projection viewing experience of the user when the projection device performs dynamic projection.
[0139] Fig.11 yes Fig.10 The specific flow chart of step 410 is shown in FIG. Fig.11 As shown, in some achievable implementations, when the projection correction parameters include image correction parameters, the image correction parameters may be determined by the following steps.
[0140] In step 411, the first pose information of the projection device is determined according to the first coordinate information.
[0141] Here, the first posture information of the projection device may include at least one of a yaw angle, a pitch angle, and a roll angle of the projection device.
[0142] Fig.12 is a schematic diagram of a three-dimensional model proposed according to an exemplary embodiment. Fig.12 As shown, in the modeling process, the position of the depth camera when the motor is at zero position is used as the coordinate origin of the spatial coordinate system, the direction of the depth camera is used as the Z axis, and the spatial coordinate system OXYZ is constructed with a right-hand system. The internal and external parameters of the motor, depth camera and projection device are combined to unify the coordinate axes of the depth camera, motor and projection device in the spatial coordinate system, that is, the depth camera, motor and projection device are coaxial in the spatial coordinate system.
[0143] like Fig.12 As shown, the center point of the projection screen 1201 projected by the projection device O in the projection area 1202 coincides with the target projection point B. The first coordinate information of the target projection point B in the spatial coordinate system is determined, assuming that B(x c ,y c ,z c). Since the location of the projection device is the coordinate origin of the spatial coordinate system, at this time, the first position information of the projection device O can be determined according to the first coordinate information of the target projection point B. For example, the first position information is calculated by the following calculation formula.
[0144] γ p =arctan(|x c | / z c )
[0145]
[0146] Among them, γ p is the yaw angle of the projection device, ρ p is the pitch angle of the projection device.
[0147] It is worth noting that when the position of the projection device in the spatial coordinate system changes, that is, when the projection device is not at the coordinate origin of the spatial coordinate system, the first position information can be calculated in combination with the current position information of the projection device.
[0148] In step 412, second pose information of the projection image relative to the projection device is determined according to the first pose information and the normal vector of the projection area.
[0149] Here, the second posture information may include the yaw angle and / or pitch angle of the projection device. When the projection device is projecting in the forward projection state, the projection image on the projection area is not distorted. Therefore, the yaw angle, pitch angle, and roll angle corresponding to the second posture information can be understood as 0°. When the first posture information of the projection device changes, the angle at which the projection image is incident on the projection area will also change, resulting in a change in the projection image on the projection area relative to the posture information of the projection device.
[0150] For example, assuming that the normal vector of the projection area is n(x n ,y n ,z n ), the second posture information can be calculated by the following formula.
[0151] γ in =γ p -arctan(|x n | / z n )
[0152]
[0153] Among them, γ in is the yaw angle of the projected image relative to the projection device, ρ in It is the pitch angle of the projected image relative to the projection device.
[0154] In step 413, the image correction parameters corresponding to the target projection point are determined according to the second posture information.
[0155] Here, after obtaining the second posture information, the second posture information can be used as the image correction parameter corresponding to the target projection point. Alternatively, the coordinate information of each vertex of the projection screen projected by the projection device on the projection area is calculated according to the second posture information, and then the perspective transformation matrix is constructed according to the coordinate information of each corner point of the projection image corresponding to the projection screen in the modulation plane and the coordinate information of each vertex.
[0156] After the perspective transformation matrix is calculated, the maximum inscribed rectangle is calculated in the area of the projection screen according to the coordinate information of each vertex, and the perspective transformation matrix and the maximum inscribed rectangle are used as image correction parameters corresponding to the target trajectory point. Of course, the coordinate parameters of each vertex of the projected image on the modulation plane can also be obtained based on the maximum inscribed rectangle and the perspective transformation matrix, and the coordinate parameters are determined as image correction parameters. When the projection device projects to the target projection point, the image to be projected is corrected according to the coordinate parameters, and the corrected image to be projected is projected.
[0157] It should be understood that when the image correction parameter is the second posture information, the corresponding perspective transformation matrix and the maximum inscribed rectangle are actually calculated according to the above method.
[0158] Thus, the image correction parameters corresponding to the target projection point can be accurately calculated by the first coordinate information of the target projection point and the normal vector of the projection area. With the image correction parameters, when the projection device projects a projection picture to the target projection point, the projected projection picture can be corrected to a rectangle.
[0159] In some embodiments, when the target projection point is located on the top or bottom surface of the three-dimensional model, due to the uncertainty of the user's viewing angle, even if the projection image is corrected to a rectangle, the corrected projection image may still be tilted relative to the user.
[0160] Fig.13 FIG. 1 is a schematic diagram of a projection screen on a ceiling according to an exemplary embodiment. Fig.13 As shown, the projection screen 1301 is located on the ceiling 1302, and in the user's line of sight 1303, the projection screen 1301 appears to be at an inclined angle.
[0161] In some embodiments, when the target projection point is located on the top surface or bottom surface in the three-dimensional model, in step 413, the target rotation angle can be obtained, where the target rotation angle is the rotation angle of the projection image in the roll angle direction, and the image correction parameters are determined based on the second posture information and the target rotation angle.
[0162] Here, the target rotation angle is the angle at which the projection image rotates with the vertical line perpendicular to the projection image as the rotation axis. By calculating the image correction parameters in combination with the target rotation angle, the projection image corrected by the image correction parameters can be presented as a rectangle, and the corrected projection image can also be adapted to the user's viewing angle.
[0163] As an example, the target rotation angle may be sent by a user through a remote control device or a terminal device. Taking the remote control device as an example, the target rotation angle may be sent to the projection device through a direction key set in the remote control device. For example, the left key in the direction key indicates that the projection screen rotates counterclockwise. When the left key is pressed once, the projection screen rotates counterclockwise by 1°.
[0164] As another example, a camera can be used to capture a viewer in the space where the projection area is located, determine the viewer's sight angle through the captured image, and determine the target rotation angle based on the sight angle. The target rotation angle can make the corrected projection image conform to the viewer's sight angle.
[0165] In some embodiments, initial image correction parameters can be obtained based on the second posture information, and the initial image correction parameters can be adjusted according to the target rotation angle to obtain final image correction parameters. For example, the coordinate parameters of each vertex of the projected image on the modulation plane are calculated based on the second posture information, and then the vertices are rotated based on the target rotation angle to obtain the coordinate parameters of each vertex after being rotated by the target rotation angle.
[0166] In other embodiments, the three-dimensional coordinates of the four vertices of the projection screen projected by the projection device to the projection area under the second posture information can be determined based on the second posture information and the three-dimensional model. Then, the three-dimensional coordinates of the four vertices of the projection screen are vector-decomposed according to the target rotation angle to obtain the two-dimensional coordinates of the four vertices.
[0167] When decomposing a vector, the vector composed of the three-dimensional coordinates of the four vertices is generally decomposed into the basis vectors of the horizontal plane. For example, is a pair of basis vectors, is the intersection line between the projection image and the horizontal plane, and is the basis vector of the X axis of the two-dimensional coordinate system. is perpendicular to The basis vector of , as the Y axis of the two-dimensional coordinate system.
[0168] When the projection image needs to be rotated to the target rotation angle, the new basis vector used Obtained through the following calculation formula:
[0169]
[0170] in, is the intersection line between the projection image and the horizontal plane, x is the target rotation angle, for and Normalized vector of cross product.
[0171] Then the new basis vectors The three-dimensional coordinates of the four vertices of the projection screen are vector-decomposed to obtain the two-dimensional coordinates of the four vertices, and the corresponding image correction parameters are determined according to the two-dimensional coordinates of the four vertices.
[0172] Fig.14 FIG. 1 is a schematic diagram of a projection screen on a ceiling according to another exemplary embodiment. Fig.14 As shown, when the projection picture 1301 corrected by the image correction parameters determined according to the two-dimensional coordinates of the four vertices is projected on the ceiling 1302, it can match the user's line of sight angle 1303.
[0173] In some feasible implementations, the projection device control method may further include: determining, based on the first coordinate information, whether the projection picture corresponding to the target projection point satisfies a preset condition, wherein the preset condition indicates that the projection picture is located in at least two intersecting planes, and when the preset condition is met, correcting the first coordinate information to obtain the corrected first coordinate information.
[0174] Here, the preset condition indicates that the projection picture is located in at least two intersecting planes. For example, the projection picture is located at a corner of a wall. Fig.15 FIG. 1 is a schematic diagram of a projection screen located in at least two intersecting planes according to an exemplary embodiment. Fig.15 As shown in Fig.15 In the position shown, the projection screen 1501 is located on the first projection area 1502 and the second projection area 1503.
[0175] The size and position of the projection screen 1501 can be determined based on the second posture information of the projection device, the three-dimensional model, and parameters such as the projection ratio and aspect ratio of the projection device.
[0176] When the preset conditions are met, the projection picture corresponding to the target projection point is located in at least two intersecting planes. At this time, the first coordinate information of the target projection point can be corrected according to the preset adjustment step so that the projection picture corresponding to the corrected first coordinate information can be located in a single plane.
[0177] Fig.16 FIG. 1 is a schematic diagram of an adjusted projection image according to an exemplary embodiment. Fig.16As shown, the projection screen 1501 corresponding to the corrected first coordinate information is located at Fig.16 As shown in the position, the projection screen 1501 is only located in the second projection area 1503 .
[0178] Therefore, by correcting the first coordinate information of the target projection point, the projection picture can be located in a single plane, thereby ensuring the user's viewing experience.
[0179] Fig.17 FIG. 1 is a schematic diagram of module connections of a projection device control device according to an exemplary embodiment. Fig.17 As shown, the present disclosure provides a projection device control device, the device 1700 includes:
[0180] The first determination module 1701 is configured to determine first coordinate information of a target projection point on the projection area in the space where the projection area is located;
[0181] A second determination module 1702 is configured to determine a first posture adjustment parameter of the projection device according to the first coordinate information;
[0182] The adjustment module 1703 is configured to adjust the projection posture of the projection device according to the first posture adjustment parameter so that the center point of the projection picture projected by the projection device coincides with the target projection point.
[0183] Optionally, the first determining module 1701 includes:
[0184] A first receiving unit, configured to receive target posture information and spatial position information of the remote control device sent by the remote control device;
[0185] The first determination subunit is configured to determine the second coordinate information of the intersection point between the pointing ray of the remote control device and the three-dimensional model according to the target posture information and the spatial position information, in combination with the three-dimensional model corresponding to the space where the projection area is located;
[0186] A second determining subunit is configured to determine the second coordinate information of the intersection point as the first coordinate information of the target projection point;
[0187] or,
[0188] The first receiving unit is configured to receive first coordinate information of a target projection point sent by a terminal device, wherein the target projection point is determined on a three-dimensional model corresponding to a space where a projection area displayed on the terminal device is located.
[0189] Optionally, the apparatus 1700 further includes:
[0190] an acquisition module configured to acquire a captured image, wherein the captured image is obtained by projecting a preset image onto a projection area by a projection device in a projection posture corresponding to the first posture adjustment parameter, and capturing the projection area;
[0191] A posture calculation module, configured to determine a second posture adjustment parameter according to third coordinate information of an image center point of a preset image in a captured image and fourth coordinate information of a target projection point on the captured image;
[0192] The posture correction module is configured to adjust the projection posture of the projection device to a projection posture corresponding to the second posture adjustment parameter.
[0193] Optionally, the apparatus 1700 further includes:
[0194] a third determining module configured to determine a projection correction parameter of the projection device according to the first coordinate information, wherein the projection correction parameter includes an image correction parameter and / or a focus parameter, and the image correction parameter is used to make the projection screen of the projection image corrected by the image correction parameter projected on the projection area appear as a rectangle;
[0195] The correction module is configured to correct the projection image projected by the projection device according to the projection correction parameters.
[0196] Optionally, the third determining module includes:
[0197] a first posture subunit, configured to determine first posture information of the projection device according to the first coordinate information when the projection correction parameters include image correction parameters;
[0198] A second posture subunit is configured to determine second posture information of the projection image relative to the projection device according to the first posture information and the normal vector of the projection area;
[0199] The image correction unit is configured to determine the image correction parameters corresponding to the target projection point according to the second posture information.
[0200] Optionally, the image correction unit includes:
[0201] An angle acquisition unit, configured to acquire a target rotation angle, wherein the target rotation angle is a rotation angle of the projection image in a roll angle direction;
[0202] The image adjustment unit is configured to determine image correction parameters according to the second posture information and the target rotation angle.
[0203] Optionally, the apparatus 1700 further includes:
[0204] A judgment module is configured to determine whether a projection picture corresponding to the target projection point satisfies a preset condition according to the first coordinate information, wherein the preset condition indicates that the projection picture is located in at least two intersecting planes;
[0205] The correction module is configured to correct the first coordinate information when a preset condition is met to obtain the corrected first coordinate information.
[0206] The method steps executed by each functional module in the above-mentioned device 1700 have been described in detail in the part about the projection correction method, and will not be repeated here.
[0207] In some embodiments, the present disclosure provides a computer storage medium storing a computer program, which implements the steps of the above-mentioned projection device control method when executed by a processing device.
[0208] In another exemplary embodiment, the present disclosure further proposes a computer program, including a computer-readable code, which, when executed on a computing and processing device, causes the computing and processing device to execute the aforementioned projection device control method.
[0209] Fig.18 is a schematic diagram of the structure of a projection device according to an exemplary embodiment. Fig.18 As shown, the projection device 200 includes a projection unit 210, a driving unit 220 for driving the projection unit 210, and a motion control unit ( Fig.18 The projection unit 210 may form an optical image and project the optical image onto the imaging medium SC.
[0210] The projection unit 210 includes a light source unit 211 , a light modulator 212 , and an optical system 213 . The driving unit 220 includes a light source driving unit 221 and a light modulator driving unit 222 .
[0211] The light source unit 211 may include a solid light source such as a light emitting diode (LED), a laser, a pump lamp, etc. The light source unit 211 may include optical elements such as a lens and a polarizing plate for improving the optical characteristics of the projected light, and a dimming element for adjusting the light flux.
[0212] The light source driving unit 221 can control the light source in the light source unit 211 to operate, including lighting and extinguishing, according to the instruction of the control unit 250 .
[0213] The light modulator 212 includes a display panel 215 , which may be a transmissive liquid crystal display (LCD) panel, a reflective liquid crystal on silicon (LCOS) panel, or a digital micromirror device (DMD).
[0214] The light modulator 212 is driven by a light modulator driving unit 222 , and the light modulator driving unit 222 is connected to the image processing unit 245 .
[0215] The image processing unit 245 inputs image data to the light modulator driving unit 222. The light modulator driving unit 222 converts the input image data into a data signal suitable for the operation of the display panel 215. The light modulator driving unit 222 applies a voltage to each pixel of each display panel 215 according to the converted data signal, and draws an image on the display panel 215.
[0216] The optical system 213 includes a lens or a reflector for forming an image of the incident image light PLA on the imaging medium SC. The optical system 213 may also include a zoom mechanism for magnifying or reducing the image projected on the imaging medium SC and a focus adjustment mechanism for adjusting the focus.
[0217] The projection device 200 further includes an operation unit 231, a signal receiving unit 233, an input interface 235, a storage unit 237, a data interface 241, an interface unit 242, a frame memory 243, an image processing unit 245, and a control unit 250. The input interface 235, the storage unit 237, the data interface 241, the interface unit 242, the image processing unit 245, and the control unit 250 can communicate data with each other via the internal bus 207.
[0218] The operation unit 231 can generate corresponding operation signals according to the operations of various buttons and switches on the housing surface of the projection device 200, and output them to the input interface 235. The input interface 235 includes a circuit that outputs the operation signals input from the operation unit 231 to the control unit 250.
[0219] After receiving a signal (such as an infrared signal or a Bluetooth signal) sent from the control device 5 (such as a remote controller), the signal receiving unit 233 can decode the received signal to generate a corresponding operation signal. The signal receiving unit 233 outputs the generated operation signal to the input interface 235. The input interface 235 outputs the received operation signal to the control unit 250.
[0220] The storage unit 237 may be a magnetic recording device such as a hard disk drive (HDD) or a storage device using a semiconductor storage element such as a flash memory. The storage unit 237 stores programs executed by the control unit 250, data processed by the control unit 250, image data, and the like.
[0221] The data interface 241 includes a connector and an interface circuit, and can be wired to other electronic devices 100. The data interface 241 can be a communication interface for performing communication with other electronic devices 100. The data interface 241 receives image data, sound data, etc. from other electronic devices 100. In this embodiment, the image data can be a content image.
[0222] The interface unit 242 is a communication interface for communicating with other electronic devices 100 according to the Ethernet standard. The interface unit 242 includes a connector and an interface circuit for processing a signal sent by the connector. The interface unit 242 is an interface substrate including a connector and an interface circuit and is connected to the main substrate of the control unit 250, which is a substrate on which a processor 253 and other components are mounted. The connector and the interface circuit constituting the interface unit 242 are mounted on the main substrate of the control unit 250. The interface unit 242 can receive setting information or instruction information sent by other electronic devices 100.
[0223] The control unit 250 includes a memory 251 and a processor 253 .
[0224] The memory 251 is a storage device that stores programs and data executed by the processor 253 in a non-volatile manner. The memory 251 is composed of a semiconductor storage element such as a magnetic storage device, a flash read-only memory (ROM), or other types of non-volatile storage devices. The memory 251 may also include a random access memory (RAM) that constitutes a work area of the processor 253. The memory 251 stores data processed by the control unit 250 and a control program executed by the processor 253.
[0225] The processor 253 may be composed of a single processor or a combination of multiple processing groups. The processor 253 executes a control program to control various parts of the projection device 200. For example, the processor 253 performs corresponding image processing according to the operation signal generated by the operation unit 231, and outputs the parameters used in the image processing (such as parameters for performing trapezoidal correction on the image) to the image processing unit 245. In addition, the processor 253 can control the light source in the light source unit 211 to light up, turn off, or adjust the brightness by controlling the light source driving unit 221.
[0226] The image processing unit 245 and the frame memory 243 may be composed of integrated circuits. Integrated circuits include large-scale integrated circuits (LSI), application-specific integrated circuits (ASIC), and programmable logic devices (PLD), wherein the PLD may include a field-programmable gate array (FPGA). Among them, the integrated circuit may also include a portion of an analog circuit, or a combination of a processor and an integrated circuit. The combination of a processor and an integrated circuit is called a microcontroller unit (MCU), a system on chip (SoC), a system LSI, a chipset, etc.
[0227] The image processing unit 245 may store the image data received from the data interface 241 in the frame memory 243. The frame memory 243 includes a plurality of memory banks, each of which includes a storage capacity that can write image data of one frame. The frame memory 243 may be composed of a synchronous dynamic random access memory (SDRAM) or a dynamic random access memory (DRAM).
[0228] The image processing unit 245 may perform image processing on the image data stored in the frame memory 243 , including resolution conversion, size adjustment, distortion correction, shape correction, digital zoom, image tone adjustment, image brightness adjustment, and the like.
[0229] The image processing unit 245 can also convert the input frame frequency of the vertical synchronization signal into a drawing frequency and generate a vertical synchronization signal having the drawing frequency. The generated vertical synchronization signal is called an output synchronization signal. The image processing unit 245 then outputs the output synchronization signal to the optical modulator driving unit 222.
[0230] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.
[0231] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.
[0232] Although the subject matter has been described in the language of specific method logic actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims. Regarding the device in the above embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Claims
1. A projection device control method, characterized in that: include: Based on the three-dimensional model corresponding to the space where the projection area is located, determine the first coordinate information of the target projection point in the space where the projection area is located; Determine a first posture adjustment parameter of the projection device according to the first coordinate information; The projection posture of the projection device is adjusted according to the first posture adjustment parameter so that the center point of the projection picture projected by the projection device coincides with the target projection point.
2. The method according to claim 1, characterized in that include: Based on the image data and point cloud data collected by the depth camera of the projection device, a three-dimensional model of the space where the projection area is located is obtained.
3. The method according to claim 1, characterized in that The determining, based on the three-dimensional model corresponding to the space where the projection area is located, first coordinate information of the target projection point in the space where the projection area is located includes: Receiving target posture information and spatial position information of the remote control device; Based on the three-dimensional model, determining second coordinate information of an intersection point between the pointing ray of the remote control device and the three-dimensional model according to the target posture information and the spatial position information; Determine the second coordinate information of the intersection point as the first coordinate information of the target projection point; or, Receive first coordinate information of the target projection point sent by a terminal device, wherein the target projection point is determined based on the three-dimensional model displayed on the terminal device.
4. The method according to claim 3, characterized in that The second coordinate information for determining the intersection point between the pointing ray of the remote control device and the three-dimensional model includes: Determine a plane corresponding to the projection area in the three-dimensional model; The second coordinate information is determined according to an intersection point between a pointing ray of the remote control device and a plane corresponding to the projection area in the three-dimensional model.
5. The method according to claim 3, characterized in that: The receiving terminal device sends the first coordinate information of the target projection point, including: The three-dimensional model of the space where the projection area is located is sent to the terminal device, and the first coordinate information of the target projection point sent by the terminal device is received, wherein the terminal device is used to: displaying the three-dimensional model; In response to an operation by a user to determine the target projection point in the three-dimensional model, coordinate information of the target projection point in the three-dimensional model is determined; The coordinate information of the target projection point in the three-dimensional model is used as the first coordinate information, and the first coordinate information is sent to the projection device.
6. The method according to claim 1, characterized in that After the center point of the projection picture projected by the projection device coincides with the target projection point, the method further includes: Determining image correction parameters of the projection screen according to the first coordinate information; The projection picture is corrected according to the projection correction parameters, so that the corrected projection picture appears as a rectangle on the projection area.
7. The method according to claim 6, characterized in that The step of determining the image correction parameters of the projection screen according to the first coordinate information includes: Determine the first pose information of the projection device according to the first coordinate information; Determine second posture information of the projection image relative to the projection device according to the first posture information and the normal vector of the projection area; The image correction parameter is determined based on the second posture information and a target rotation angle, wherein the target rotation angle is a rotation angle of the projection image in a roll angle direction.
8. The method according to claim 1, characterized in that The method further comprises: Determine, according to the first coordinate information, whether the projection picture corresponding to the target projection point satisfies a preset condition, wherein the preset condition indicates that the projection picture is located in at least two intersecting planes; When the preset condition is met, the first coordinate information is corrected to obtain corrected first coordinate information.
9. A projection device, characterized in that: include: a storage device having a computer program stored thereon; A processing device, used to execute the computer program in the storage device to implement the projection device control method according to any one of claims 1 to 8.
10. A computer storage medium, characterized in that: The storage medium stores a computer program, which, when executed by a processing device, implements the projection device control method according to any one of claims 1 to 8.
Citation Information
Cited By
Projection display method and projection display device
WO2026194619A1
