Elevator control method and device based on holographic projection, equipment and storage medium
By setting up a holographic projection module and camera in the elevator and adjusting the projection area using image recognition technology, the problem of easy occupation or accidental touch of virtual buttons in the elevator is solved, and a more efficient elevator operation experience is achieved.
Patent Information
- Application Number
- CN202411136263.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-19
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2044-08-19
AI Technical Summary
When there are many people in the elevator, the virtual buttons are easily occupied or touched by mistake, resulting in inconvenient operation and affecting the passenger experience.
By setting up a holographic projection module and camera in the elevator, using image recognition technology to determine the passenger area and projection boundary, flexibly adjust the projection area to avoid overlapping with the passenger area, and using horizontal or vertical projection methods to ensure the availability of the key array.
It effectively avoids the mistouch of buttons, improves the operating experience of passengers and the reliability of the elevator.
Smart Images

Figure CN119038335A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of intelligent elevator technology, and in particular to an elevator control method, device, equipment, and storage medium based on holographic projection. Background Art
[0002] At present, holographic projection technology has begun to be applied to elevator control. Imaging modules and detection modules are set up in elevators. The imaging module projects three-dimensional virtual buttons in the air, and the detection module captures the hand position and movement of passengers, thereby identifying the passenger's operating intention and realizing elevator control. For example, floor buttons can be projected, and by detecting the click operation of the passenger's hand, the floor closest to the hand is determined as the target floor, and the passenger's operating intention is identified to go to that floor, thereby controlling the elevator to go up and down.
[0003] However, the existing solution is to project a virtual button array of a fixed size in a fixed area. The space in the elevator car is limited. When there are many people in the elevator, it is easy for the projection area to be occupied by passengers, resulting in the virtual buttons being unable to be used normally or being triggered by mistake, affecting the passenger experience. Summary of the invention
[0004] The present invention aims to solve at least one of the technical problems existing in the prior art. To this end, the present invention proposes an elevator control method, device, equipment, and storage medium based on holographic projection, which can flexibly adjust the projection area, reduce the risk of accidental touch, and improve the passenger experience.
[0005] In a first aspect, an embodiment of the present invention provides an elevator control method based on holographic projection, which is applied to a control system of a target elevator, wherein the target elevator is provided with a holographic projection module, a first camera, and a second camera, wherein the first camera and the second camera are arranged at the top of the target elevator, the first camera and the holographic projection module are located on a side close to an elevator door of the target elevator, and the second camera is located on a side away from the elevator door, wherein the method comprises:
[0006] In response to a key generation signal, a first image in a top-down direction is acquired through the first camera, and a passenger area, a projection boundary of the holographic projection module in a horizontal direction, and a first projection area are determined from the first image;
[0007] Constructing a spatial coordinate system to determine vertex coordinates of each vertex of the first projection area, wherein the vertical coordinate of the vertex coordinate is zero;
[0008] When the first projection area overlaps with the passenger area, adjusting the first projection area within the projection boundary based on a preset adjustment strategy;
[0009] When the first projection area can be adjusted to not overlap with the passenger area, a key array is projected based on the adjusted first projection area, a vertical direction is determined as a reference direction, and the first camera is determined as a target camera, wherein the key array includes a plurality of virtual keys;
[0010] Alternatively, when the first projection area cannot be adjusted to not overlap with the passenger area, the ordinate and the vertical coordinate of each vertex coordinate are exchanged to construct a second projection area, the button array is projected in the second projection area, the horizontal direction is determined as the reference direction, and the second camera is determined as the target camera;
[0011] The target gesture information is acquired through the target camera, and the target elevator is controlled after the target gesture information is parsed based on the reference direction.
[0012] According to some embodiments of the present invention, the projection boundary includes a projection upper boundary, a projection lower boundary, a projection left boundary, and a projection right boundary, and adjusting the first projection area within the projection boundary based on a preset adjustment strategy includes:
[0013] Determine an overlapping area between the first projection area and the passenger area, determine a distance between a lower boundary of the overlapping area and an upper boundary of the first projection area as a first offset, determine a distance between an upper boundary of the overlapping area and a lower boundary of the first projection area as a second offset, determine a distance between a left boundary of the overlapping area and a right boundary of the first projection area as a third offset, and determine a distance between a right boundary of the overlapping area and a left boundary of the first projection area as a fourth offset;
[0014] Determine the distance between the upper boundary of the first projection area and the projection upper boundary as a first distance value, determine the distance between the lower boundary of the first projection area and the projection lower boundary as a second distance value, determine the distance between the left boundary of the first projection area and the projection left boundary as a third distance value, and determine the distance between the right boundary of the first projection area and the projection right boundary as a fourth distance value;
[0015] When the first condition and the second condition are satisfied at the same time, the first projection area is moved along the longitudinal axis based on the first offset or the second offset, and the first projection area is moved along the transverse axis based on the third offset or the fourth offset, so that the passenger area does not overlap with the first projection area, wherein the first condition is that the first distance value is greater than or equal to the first offset, and / or the second distance value is greater than or equal to the second offset, and the second condition is that the third distance value is greater than or equal to the third offset, and / or the fourth distance value is greater than or equal to the fourth offset;
[0016] When the first condition and the second condition are not met at the same time, the first projection area is rotated 90 degrees along the current plane, and the first offset, the second offset, the third offset, the fourth offset, the first distance value, the second distance value, the third distance value and the fourth distance value are updated, and then the movement judgment based on the first condition and the second condition is re-executed.
[0017] According to some embodiments of the present invention, after re-performing movement judgment based on the first condition and the second condition, the method further includes:
[0018] When the updated first projection area fails to satisfy both the first condition and the second condition, obtaining a preset first adjustment value and a preset second adjustment value, wherein the first adjustment value is used to indicate the longitudinal length of a single virtual key in the key array, and the second adjustment value is used to indicate the transverse length of a single virtual key in the key array;
[0019] Determine a quotient of a smaller value of the first offset and the second offset and the first adjustment value as a first quantity, and determine a quotient of a smaller value of the third offset and the fourth offset and the second adjustment value as a second quantity;
[0020] When the updated first projection area meets the first condition but does not meet the second condition, increasing the longitudinal length of the first projection area and reducing the transverse length of the first projection area based on the second number and the second adjustment value;
[0021] Alternatively, when the first projection area satisfies the second condition but does not satisfy the first condition, the horizontal axis length of the first projection area is increased and the vertical axis length of the first projection area is decreased based on the first number and the first adjustment value;
[0022] When the updated first projection area does not satisfy both the first condition and the second condition, the first projection area is restored, and the adjustment judgment based on the first quantity and the second quantity is re-executed.
[0023] According to some embodiments of the present invention, after re-determining the first number and the second number and re-judging, the method further includes:
[0024] When the first condition and the second condition are still not satisfied at the same time, obtaining a preset area threshold, wherein the area threshold is used to indicate the minimum projection area of the key array;
[0025] Scaling the first projection area, updating the first offset, the second offset, the third offset, the fourth offset, the first distance value, the second distance value, the third distance value, and the fourth distance value in real time during the scaling process, and determining whether the first condition and the second condition are met;
[0026] When it is detected that the first condition and the second condition are satisfied at the same time before the first projection area is scaled to the area threshold, the first projection area is moved so that the first projection area does not overlap with the passenger area;
[0027] When the first projection area is scaled to the area threshold, the first condition and the second condition are not satisfied at the same time, the first projection area is rotated 90 degrees, and the scaling judgment based on the area threshold is re-executed.
[0028] According to some embodiments of the present invention, the controlling the target elevator after parsing the target gesture information based on the reference direction includes:
[0029] Determining a target key corresponding to the target gesture information;
[0030] When the target button is used to indicate a first floor, and the target gesture information is determined to be a click operation based on the reference direction, the target elevator is controlled to perform a lifting operation based on the first floor;
[0031] Alternatively, when the target button is used to indicate a destination, and the target gesture information is determined to be a click operation based on the reference direction, a second floor pre-associated with the destination is determined, and the target elevator is controlled to perform a lifting operation based on the second floor;
[0032] Alternatively, when the target button is used to indicate the destination, and based on the reference direction it is determined that the target gesture information is used to indicate a sliding operation with the target button as the end point, the target elevator is controlled to perform a lifting operation based on the second floor, and target navigation information is played after reaching the second floor, wherein the target navigation information is used to indicate a navigation path from the target elevator to the destination.
[0033] According to some embodiments of the present invention, determining the target key corresponding to the target gesture information includes:
[0034] The target camera records the movement trajectory of the target hand in real time;
[0035] When it is detected that the target hand stays for a period exceeding a preset first period threshold, the three-dimensional coordinates of the current position of the target hand are determined as the three-dimensional coordinates of the hand;
[0036] Acquire the three-dimensional coordinates of each virtual key, determine the target space distance between the three-dimensional coordinates of the hand and the three-dimensional coordinates of each key, and determine the virtual key corresponding to the target space distance with the smallest value as a candidate key;
[0037] Displaying the candidate keys in the key array in a preset first style;
[0038] When it is detected that the target hand continues to stay for a period exceeding a preset second time threshold, the candidate key is determined as the target key;
[0039] Alternatively, when movement of the target hand is detected, the candidate keys are re-determined.
[0040] According to some embodiments of the present invention, the control system of the target elevator is in communication with a property system, and the property system is preset with an owner face library. Before acquiring the target gesture information through the target camera, the method further includes:
[0041] Acquire a second image and a third image, wherein the second image and the third image are captured by the second camera when the elevator door is opened, and the third image is captured later than the second image;
[0042] Performing face detection in the second image and the third image respectively, and determining a target face image from face images located in both the second image and the third image;
[0043] Performing face recognition based on the target face image and the owner face database to determine target owner information, and obtaining a third floor pre-associated with the target owner information;
[0044] The virtual button corresponding to the third floor is displayed in the button array based on a preset second style.
[0045] In a second aspect, an embodiment of the present invention provides an elevator control device based on holographic projection, comprising at least one control processor and a memory for communicating with the at least one control processor; the memory stores instructions executable by the at least one control processor, and the instructions are executed by the at least one control processor so that the at least one control processor can execute the elevator control method based on holographic projection as described in the first aspect above.
[0046] In a third aspect, an embodiment of the present invention provides an electronic device, comprising an elevator control device based on holographic projection as described in the second aspect above.
[0047] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium storing computer-executable instructions, wherein the computer-executable instructions are used to execute the elevator control method based on holographic projection as described in the first aspect above.
[0048] According to the elevator control method based on holographic projection of the embodiment of the present invention, there are at least the following beneficial effects: in response to a key generation signal, a first image in a top-down direction is acquired through a first camera, and a passenger area, a projection boundary of a holographic projection module in a horizontal direction and a first projection area are determined from the first image; a spatial coordinate system is constructed to determine the vertex coordinates of each vertex of the first projection area, wherein the vertical coordinates of the vertex coordinates are zero; when the first projection area overlaps with the passenger area, the first projection area is adjusted within the projection boundary based on a preset adjustment strategy; when the first projection area can be adjusted to not overlap with the passenger area, a key array is projected based on the adjusted first projection area, the vertical direction is determined as a reference direction, and the first camera is determined as a target camera, wherein the key array includes a plurality of virtual keys; or, when the first projection area cannot be adjusted to not overlap with the passenger area, a second projection area is constructed after the vertical coordinates and the vertical coordinates of each vertex coordinate are interchanged, and a key array is projected in the second projection area, the horizontal direction is determined as a reference direction, and the second camera is determined as a target camera; target gesture information is acquired through the target camera, and the target elevator is controlled after the target gesture information is parsed based on the reference direction. According to the technical solution of the embodiment of the present invention, the position of the first projection area can be adjusted within the projection boundary through image recognition results. When the first projection area can stagger the user area, the button array is projected along the horizontal plane. When the user area cannot be avoided, the projection is switched to the vertical direction, thereby realizing flexible adjustment of the projection area, ensuring that the projected button array can avoid passengers, effectively avoiding accidental button touches, and improving user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0049] Figure 1 is a schematic diagram of a target elevator provided by an embodiment of the present invention;
[0050] Figure 2 is a flow chart of an elevator control method based on holographic projection provided by another embodiment of the present invention;
[0051] Figure 3 is a schematic diagram of moving a first projection area provided by another embodiment of the present invention;
[0052] Figure 4 is a schematic diagram of adjusting the arrangement of a key array provided by another embodiment of the present invention;
[0053] Figure 5 It is a structural diagram of an elevator control device based on holographic projection provided by another embodiment of the present invention. DETAILED DESCRIPTION
[0054] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and cannot be understood as limiting the present invention.
[0055] In the description of the present invention, it should be understood that descriptions involving orientations, such as up, down, front, back, left, right, etc., and orientations or positional relationships indicated are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present invention.
[0056] In the description of the present invention, "several" means one or more, "more" means more than two, "greater than", "less than", "exceed" etc. are understood as not including the number itself, and "above", "below", "within" etc. are understood as including the number itself. If there is a description of "first" or "second", it is only used for the purpose of distinguishing the technical features, and cannot be understood as indicating or implying the relative importance or implicitly indicating the number of the indicated technical features or implicitly indicating the order of the indicated technical features.
[0057] In the description of the present invention, unless otherwise clearly defined, terms such as setting, installing, connecting, etc. should be understood in a broad sense, and technicians in the relevant technical field can reasonably determine the specific meanings of the above terms in the present invention based on the specific content of the technical solution.
[0058] The embodiment of the present invention provides an elevator control method, device, equipment, and storage medium based on holographic projection, wherein the elevator control method based on holographic projection includes: in response to a key generation signal, acquiring a first image in a top-down direction through a first camera, determining a passenger area, a projection boundary of a holographic projection module in a horizontal direction, and a first projection area from the first image; constructing a spatial coordinate system, determining the vertex coordinates of each vertex of the first projection area, wherein the vertical coordinate of the vertex coordinate is zero; when the first projection area overlaps with the passenger area, adjusting the first projection area within the projection boundary based on a preset adjustment strategy; when the first projection area can Adjust to not overlap with the passenger area, project a button array based on the adjusted first projection area, determine the vertical direction as the reference direction, and determine the first camera as the target camera, wherein the button array includes a plurality of virtual buttons; or, when the first projection area cannot be adjusted to not overlap with the passenger area, construct a second projection area after exchanging the ordinate and the vertical coordinate of each vertex coordinate, project a button array based on the second projection area, determine the horizontal direction as the reference direction, and determine the second camera as the target camera; obtain target gesture information through the target camera, and control the target elevator after parsing the target gesture information based on the reference direction. According to the technical solution of the embodiment of the present invention, the position of the first projection area can be adjusted within the projection boundary through the image recognition result, and the button array is projected along the horizontal plane when the first projection area can stagger the user area, and is switched to vertical projection when the user area cannot be avoided, thereby realizing flexible adjustment of the projection area, ensuring that the projected button array can avoid passengers, effectively avoiding accidental button touches, and improving user experience.
[0059] First, refer to Figure 1 , Figure 1 A schematic diagram of a target elevator provided in an embodiment of the present invention, wherein the target elevator 10 of this embodiment is provided with a holographic projection module 11, a first camera 12 and a second camera 13, wherein the first camera 12 and the second camera 13 are arranged at the top of the target elevator 10, the first camera 12 and the holographic projection module 11 are located on a side close to an elevator door 14 of the target elevator 10, and the second camera 13 is located on a side away from the elevator door 14.
[0060] Among them, Figure 1As shown, the shooting angle of the first camera 12 can be downward, so as to capture the top view of the target elevator 10 in a bird's-eye view manner. At the same time, when the holographic projection module 11 projects a horizontally distributed button array through the first projection area 21, the first camera 12 is located on the upper side of the first projection area 21, and can capture the passenger's hand operations in the button array, thereby obtaining target gesture information; similarly, the second camera 13 can shoot at the elevator door 14. Since it is set at the top, the shooting angle of the second camera 13 is tilted downward. When the holographic projection module 11 projects a vertical button array through the second projection area 22, the second camera 13 can capture the passenger's hand operations in the button array, thereby obtaining target gesture information.
[0061] Among them, the holographic projection module 11 is a common holographic projection device, which can project virtual buttons in space. Those skilled in the art know that each virtual button is projected based on the three-dimensional coordinates of the space. Therefore, when it is necessary to project based on the first projection area 21, the Z-axis coordinate of each virtual button is set to 0. When it is necessary to project based on the second projection area 22, the Y-axis coordinate of each virtual button is set to 0. This embodiment does not involve specific projection principles, which will not be elaborated here.
[0062] The following is based on the Figure 1 The structure shown is used to further illustrate the technical solution of the embodiment of the present invention.
[0063] Reference Figure 2 , Figure 2 A flowchart of an elevator control method based on holographic projection is provided in an embodiment of the present invention. The elevator control method based on holographic projection includes but is not limited to the following steps:
[0064] S10, in response to a key generation signal, acquiring a first image in a top-down direction through a first camera, and determining a passenger area, a projection boundary of the holographic projection module in a horizontal direction, and a first projection area from the first image;
[0065] S20, constructing a spatial coordinate system, determining vertex coordinates of each vertex of the first projection area, wherein the vertical coordinate of the vertex coordinate is zero;
[0066] S30, when the first projection area overlaps with the passenger area, adjusting the first projection area within the projection boundary based on a preset adjustment strategy;
[0067] S40, when the first projection area can be adjusted to not overlap with the passenger area, a button array is projected based on the adjusted first projection area, a vertical direction is determined as a reference direction, and a first camera is determined as a target camera, wherein the button array includes a plurality of virtual buttons;
[0068] S50, when the first projection area cannot be adjusted to not overlap with the passenger area, the ordinates and the vertical coordinates of each vertex coordinate are exchanged to construct a second projection area, based on the button array projected in the second projection area, the horizontal direction is determined as the reference direction, and the second camera is determined as the target camera;
[0069] S60, acquiring target gesture information through a target camera, parsing the target gesture information based on a reference direction, and then controlling the target elevator.
[0070] It should be noted that the button-generated signal can be automatically triggered after the elevator door is opened, or it can be triggered when the passenger operates the holographic projection module. After the button-generated signal is obtained, the first camera is triggered to capture the first image, and the first image is used as a top view to identify the passenger area. This can be done through simple image recognition technology, and this embodiment does not involve improvements in image recognition technology. The passenger area of this embodiment is not limited to only one passenger, but the area occupied by any number of passengers that can be identified in the first image in the first image. For the sake of ease of description, a passenger example is used later. When there are multiple passenger areas in the first image, the overlapping area can be determined by combining multiple passenger areas.
[0071] It is worth noting that the projection boundary of the holographic projection module is known in advance, and the first projection area can also use the default projection area of the holographic projection module, which is also a known area. The position of the first camera is also fixed, and the first camera of this embodiment is used for holographic projection, not ordinary monitoring, so its shooting angle is also fixed and will not be adjusted. Therefore, the projection boundary and the first projection area can be marked in the first image in a preset manner. For example, Figure 1 As shown, a projection boundary 31 and a first projection area 33 are preset in the first image, and a related dotted frame is displayed in the first image whenever shooting is performed, thereby improving the efficiency of subsequent recognition.
[0072] It should be noted that, in order to achieve flexible adjustment of the projection area, the present embodiment sets a first camera and a second camera on the top of the target elevator to provide different shooting angles. In order to accurately shoot the passenger area, the first camera is set on the side close to the elevator door, so that a bird's-eye view effect can be achieved. In this case, the image captured by the first camera can extract the Z-axis information of the passenger's hand to a certain extent, but it can only be used for gesture recognition. The shooting angle determines that the recognition accuracy is low. Therefore, the horizontal distribution of the button array projected based on the first projection area is more conducive to the first camera for plane recognition, thereby improving the recognition accuracy of the target gesture information; similarly, it is difficult to extract the Y-axis information of the passenger's hand from the image captured by the first camera. Therefore, the button array projected based on the second projection area is arranged in a vertical direction. By using different cameras with button arrays in different directions, the accuracy of gesture recognition can be ensured while adjusting the projection area in space, thereby improving the reliability of holographic control.
[0073] It should be noted that the spatial coordinate system of this embodiment takes the left and right direction of the target elevator as the X-axis, the front and back direction as the Y-axis, and the height direction as the Z-axis. Therefore, the vertices of the first projection area are located in the horizontal plane, and the vertical coordinate, i.e., the Z-axis coordinate, is zero.
[0074] It should be noted that after determining the passenger area, if the passenger area does not overlap with the first projection area, projection is performed directly based on the first projection area, and the first camera is used as the target camera to identify the target gesture information. When the passenger area overlaps with the first projection area, first try to adjust the first projection area within the projection boundary through an adjustment strategy so that the first projection area is staggered with the passenger area. The adjustment strategy may include moving the first projection area, adjusting the layout of the key array to adjust the shape of the first projection area, or scaling the first projection area. Of course, an irregularly shaped key array may also be projected by adjusting the position of the virtual keys in the key array, such as cancelling the projection of the keys that overlap with the passenger area, and projecting the canceled virtual keys in other non-overlapping areas. The adjustment strategy may be adjusted according to actual needs, and no further elaboration will be given here.
[0075] It should be noted that in step S40, after the first projection area is adjusted, the projection parameters of the holographic projection module can be synchronously adjusted according to the adjustment amount of the first projection area. For example, the coordinate value of each virtual key is adjusted according to the adjustment amount of the first projection area so that its position is offset during projection, thereby achieving the effect of moving the first projection area.
[0076] It should be noted that when the first projection area cannot be staggered with the passenger area by moving, scaling, and other adjustment methods, if the button array is projected in the horizontal direction, some buttons will be blocked by passengers, and the buttons cannot be clicked or will be accidentally touched. In this case, the present embodiment is converted into a vertical projection. For the holographic projection module, the key to spatial projection lies in the determination of spatial coordinates. The first projection area is located in the horizontal plane, so the Z-axis coordinate is 0. After the Z-axis coordinate and the Y-axis coordinate are interchanged, the first projection area is converted into a second projection area in the vertical direction. After the range of the second projection area is determined, the holographic projection module is pre-configured to project the button array based on the first projection area. Similarly, the Y-axis coordinate and the Z-axis coordinate of each projection pixel point of the button array are interchanged, and the vertical button array can be projected in the second projection area.
[0077] It should be noted that after holographic projection is performed based on the second projection area, the second camera is enabled as the target camera, and the passenger's operation direction is also different from that of the first projection area. At this time, the passenger's click operation is a horizontal action, so the horizontal direction is used as a reference direction to accurately identify the target gesture information. The specific gesture recognition is not an improvement made in this embodiment and will not be elaborated here.
[0078] It should be noted that the use of a camera to identify gesture information is a technology well known to those skilled in the art, and the specific principles will not be elaborated here. On this basis, the present embodiment flexibly adjusts the reference direction according to the projection strategy. When a horizontal button array is projected based on the first projection area, the vertical direction is used as the reference direction; when a vertical button array is projected based on the second projection area, the horizontal direction is used as the reference direction. Taking the vertical translation of the passenger's hand movement as an example, when the first projection area is applied, since the vertical direction is the reference direction, the gesture can be recognized as a click operation. When the second projection area is applied, since the horizontal direction is the reference direction, the gesture can be recognized as a sliding operation for indicating page turning.
[0079] Through the technical solution of this embodiment, it is possible to use image recognition technology to determine whether the first projection area and the passenger area overlap. When overlap occurs, the first projection area is first adjusted, with the first camera as the target camera and the vertical direction as the reference direction, so as to project the button array in the horizontal direction, thereby improving the convenience of operation; when the first projection area cannot be staggered with the passenger area by adjusting the position and size, the second projection area is adjusted to the vertical direction, with the second camera as the target camera and the horizontal direction as the reference direction, and the button array is projected on the vertical plane, thereby reducing the horizontal space required for projection, flexibly adjusting the projection strategy of the button array, effectively avoiding interference of passengers with the button array, reducing the risk of accidental touch, and improving the user experience and reliability of the holographic projection elevator.
[0080] In addition, in one embodiment, the projection boundary includes a projection upper boundary, a projection lower boundary, a projection left boundary, and a projection right boundary. In step S30, the first projection area is adjusted within the projection boundary based on a preset adjustment strategy, specifically including but not limited to the following steps:
[0081] S311, determining an overlapping area between the first projection area and the passenger area, determining a distance between a lower boundary of the overlapping area and an upper boundary of the first projection area as a first offset, determining a distance between an upper boundary of the overlapping area and a lower boundary of the first projection area as a second offset, determining a distance between a left boundary of the overlapping area and a right boundary of the first projection area as a third offset, and determining a distance between a right boundary of the overlapping area and a left boundary of the first projection area as a fourth offset;
[0082] S312, determining the distance between the upper boundary of the first projection area and the projection upper boundary as a first distance value, determining the distance between the lower boundary of the first projection area and the projection lower boundary as a second distance value, determining the distance between the left boundary of the first projection area and the projection left boundary as a third distance value, and determining the distance between the right boundary of the first projection area and the projection right boundary as a fourth distance value;
[0083] S313, when the first condition and the second condition are simultaneously satisfied, the first projection area is moved along the longitudinal axis based on the first offset or the second offset, and the first projection area is moved along the transverse axis based on the third offset or the fourth offset, so that the passenger area does not overlap with the first projection area, wherein the first condition is that the first distance value is greater than or equal to the first offset, and / or the second distance value is greater than or equal to the second offset, and the second condition is that the third distance value is greater than or equal to the third offset, and / or the fourth distance value is greater than or equal to the fourth offset;
[0084] S314, when the first condition and the second condition are not met at the same time, the first projection area is rotated 90 degrees along the current plane, and the first offset, the second offset, the third offset, the fourth offset, the first distance value, the second distance value, the third distance value and the fourth distance value are updated, and then the movement judgment based on the first condition and the second condition is re-executed.
[0085] It should be noted that if Figure 1 As shown, when the first projection area 33 and the projection boundary 31 are pre-set, target detection can be performed in the first image through a simple image recognition algorithm to determine the passenger area 32, such as detecting the area occupied by the passenger's head, torso or limbs. When it is detected that the first projection area 33 and the passenger area 32 intersect, the corresponding intersection is determined as the overlapping area 34.
[0086] It is worth noting that the overlapping area 34 can be obtained from any number of passenger areas 32. For example, when there are a large number of people in the elevator, multiple passenger areas 32 are detected in the first image, and the intersection of each passenger area 32 and the first projection area 33 is determined as the overlapping area 34, that is, the first image can include multiple overlapping areas 34. In order to better illustrate the technical solution of this embodiment, one passenger area 32 is taken as an example below. When the overlapping area 34 is obtained with multiple passenger areas 32, the farthest end of the overlapping area 34 can be used for numerical calculations. For example, at the upper boundary of the overlapping area 34 described below, when there are multiple overlapping areas 34, the upper boundary of each overlapping area 34 is used for subsequent calculations. The same applies to other values, which will not be repeated here.
[0087] It should be noted that the first offset is the distance between the upper boundary of the first projection area and the lower boundary of the overlapping area. The first offset represents the distance that the first projection area moves upward to leave the current overlapping area. Figure 3 As shown, the first offset is Figure 3 As shown in P1, when the first projection area moves upward by P1, the first projection area 33 no longer overlaps with the current overlapping area 34. The second offset represents the distance that the first projection area moves downward to leave the current overlapping area, such as Figure 3 The third offset represents the distance that the first projection area moves to the left to leave the current overlapping area, such as Figure 3 P3 shown in FIG; the fourth offset represents the distance that the first projection area moves to the right to leave the current overlapping area, such as Figure 3 The P4 shown in FIG. 1 is not described in detail here.
[0088] It should be noted that the first distance value, the second distance value, the third distance value and the fourth distance value are used to indicate the maximum distance that can be moved in each direction, ensuring that the first projection area after the move is still within the projection boundary. Therefore, before moving, the first distance value and the first offset are numerically compared. If the first distance value is less than the first offset, the first projection area cannot be moved upward to offset the passenger area. The same applies to the values in other directions. Therefore, after determining the above offsets and distance values, it is determined whether the feasibility of movement exists according to the first condition and the second condition. The first condition is used to characterize the feasibility of lateral movement, and the second condition is used to characterize the feasibility of longitudinal movement. In this embodiment, it is necessary to ensure that both conditions are met at the same time to ensure that the first projection area is offset from the passenger area.
[0089] It should be noted that when the first condition and the second condition are not met at the same time, if the first projection area is not a square, the first projection area can be rotated 90 degrees, and it is determined again whether the first condition and the second condition are met, which can exchange the requirements for horizontal space and vertical space, and realize flexible control of the projection area. Figure 3 As shown, when the first projection area 33 is a rectangle, if the lateral space occupied by the overlapping area 34 is large, it is difficult to move the first projection area 33 to stagger the passenger area 32 when it is long in the horizontal direction. After the first projection area 33 is rotated 90 degrees, the shorter side is located in the horizontal direction, and the demand for lateral space is reduced, that is, the third distance value and the fourth distance value are increased, so that the second condition is easier to be satisfied. The determination process of each value and the condition judgment are not repeated here.
[0090] It should be noted that the movement according to the technical solution of this embodiment can only leave the current overlapping area, but may introduce new overlapping areas, such as Figure 3 As shown, after the first projection area 33 is moved rightward based on P4, the first projection area 33 is as shown in FIG. Figure 3 As shown on the lower side, the first projection area 33 is offset from the passenger area 32, and related projection operations can be performed; however, if the first projection area 33 is shifted to the left based on P3, the first projection area 33 is only offset from the overlapping area 34 before the movement, but will have more intersections with the passenger area 32, resulting in a new overlapping area. Therefore, in step S313 of this embodiment, the movement judgment is made based on the reference that no overlapping area will be introduced. For example, when no new overlapping area will be introduced after shifting based on the first offset or the second offset, you can choose one to move. If no new overlapping area will be introduced after shifting based on the first offset, but a new overlapping area will be introduced after shifting based on the second offset, then shift based on the first offset. Of course, in order to achieve the above judgment, after determining the passenger area, the opposite direction of the passenger area can be used as the moving direction, such as Figure 3 As shown, when the passenger area 32 is located at the lower left side of the first projection area 33, the moving direction that can be selected is rightward or upward. The same judgment can be performed when there are multiple passenger areas 32; the overlapping area can also be re-determined after the movement, and the same calculation is re-executed, and the number of iterations is set. If there is still an overlapping area after the number of iterations is used up, it is determined that the strategy of adjusting the first projection area by moving is invalid, and the adjustment strategy of steps S321 to S325 is executed.
[0091] In addition, in one embodiment, after executing step S314, the method further includes but is not limited to the following steps:
[0092] S321, when the updated first projection area fails to satisfy both the first condition and the second condition, obtaining a preset first adjustment value and a second adjustment value, wherein the first adjustment value is used to indicate the length of the longitudinal axis occupied by the single virtual key in the key array, and the second adjustment value is used to indicate the length of the transverse axis occupied by the single virtual key in the key array;
[0093] S322, determining the quotient of the smaller value of the first offset and the second offset and the first adjustment value as the first quantity, and determining the quotient of the smaller value of the third offset and the fourth offset and the second adjustment value as the second quantity;
[0094] S323, when the updated first projection area meets the first condition but does not meet the second condition, increasing the longitudinal axis length of the first projection area and reducing the transverse axis length of the first projection area based on the second number and the second adjustment value;
[0095] S324, when the first projection area satisfies the second condition but does not satisfy the first condition, increasing the horizontal axis length of the first projection area and reducing the vertical axis length of the first projection area based on the first number and the first adjustment value;
[0096] S325: When the updated first projection area does not satisfy both the first condition and the second condition, the first projection area is restored, and the adjustment judgment based on the first quantity and the second quantity is re-executed.
[0097] It should be noted that if the first projection area still cannot meet the first condition and the second condition after rotation, it can be determined that the current shape and size of the first projection area cannot meet the requirements. In this embodiment, the space utilization within the projection boundary is first improved by adjusting the shape.
[0098] It should be noted that in the conventional projection process, Figure 4 As shown, the number of columns in each row of the projection array is the same. When the overlapping area 34 only interferes with the local virtual keys, the present embodiment adjusts the positions of the virtual keys to stagger the passenger area 32. Based on this, when the first offset is smaller than the second offset, the amount of movement required based on the first offset is smaller, and it can be determined that the direction corresponding to the first offset is easier to leave the passenger area, and the number of virtual keys adjusted based on the first offset is also smaller. Therefore, the first number determined based on the smaller value involves less adjustment, the adjustment efficiency is higher, and the shape of the key array is changed less, avoiding large changes that cause inconvenience to passengers.
[0099] It should be noted that the first adjustment value and the second adjustment value are the length and width of the virtual key, respectively. The first number can represent the number of columns that need to be adjusted to stagger the passenger area, and the second number can represent the number of rows that need to be adjusted to stagger the passenger area. In step S323, when the first projection area meets the first condition but does not meet the second condition, that is, the longitudinal space is larger and can accommodate more incremental keys, and the transverse space is smaller and can accommodate fewer incremental keys, the number of rows in the key array is transferred to the number of columns, and the second number is the number of rows that need to be adjusted to stagger the passenger area. Therefore, based on the second number, the longitudinal axis length of the first projection area is increased, and the transverse axis length is reduced, so that the above-mentioned reduction of the key array and the increase of the number of columns. The same is true for step S324, which will not be repeated here.
[0100] For example, Figure 4 As shown, the first adjustment value T1 is the longitudinal length, the second adjustment value T2 is the transverse length, taking the first offset P1 being less than the second offset P2 as an example, and the third offset P3 being greater than the fourth offset P4 as an example, the first number is the quotient of P1 and T1, the second number is the quotient of P4 and T1, the first number is 3, and the second number is 2. When the first condition is met and the second condition is not met, 2 columns are reduced in the first projection area, and 2 rows are added on the upper side of the first projection area. Of course, the reduced 2 columns are 2 columns close to the overlapping area 34, so that the obtained key array is staggered with the passenger area.
[0101] It is worth noting that, when the first projection area and the passenger area cannot be staggered based on steps S323 and S324, the first projection area is rotated 90 degrees and re-judged, which will not be repeated here.
[0102] In addition, in one embodiment, after executing step S325, the method further includes but is not limited to the following steps:
[0103] S331, when the first condition and the second condition are still not satisfied at the same time, obtaining a preset area threshold, wherein the area threshold is used to indicate the minimum projection area of the key array;
[0104] S332, scaling the first projection area, updating the first offset, the second offset, the third offset, the fourth offset, the first distance value, the second distance value, the third distance value and the fourth distance value in real time during the scaling process, and determining whether the first condition and the second condition are met;
[0105] S333, before the first projection area is scaled to the area threshold, when it is detected that the first condition and the second condition are simultaneously satisfied, the current first projection area is moved so that the first projection area does not overlap with the passenger area;
[0106] S334: When the first projection area is scaled to the area threshold, the first condition and the second condition are not satisfied at the same time, the first projection area is rotated 90 degrees, and the scaling judgment based on the area threshold is re-executed.
[0107] It should be noted that when adjusting the position and adjusting the shape of the button array cannot meet the requirements, this embodiment scales the first projection area and characterizes the minimum available button array through the area threshold to avoid virtual buttons being too small, ensure the passenger experience, and ensure the accuracy of gesture recognition. The specific area threshold can be determined according to the projection fineness of the holographic projection module, and no further limitation is made here.
[0108] It is worth noting that the scaling of the first projection area can be performed sequentially according to a preset ratio, for example, the preset ratio is 90%, and the area is scaled to 90% of the current area during the first scaling. Since the range of the first projection area changes after scaling, the first offset, the second offset, the third offset, the fourth offset, the first distance value, the second distance value, the third distance value, and the fourth distance value can be updated in real time, and the magnitude relationship of the above values will also change. Therefore, the judgment of step S313 is performed once each time the scaling is completed, and if the first condition and the second condition are met, the position adjustment operation of the above embodiment is performed.
[0109] It should be noted that if the first condition and the second condition still cannot be met simultaneously after scaling to the area threshold, refer to the principle of step S314, rotate the first projection area 90 degrees to adjust the horizontal and vertical space occupancy, and perform scaling judgment here, which will not be repeated here.
[0110] It should be noted that, when the first projection area and the passenger area still cannot be staggered based on step S334, the second projection area needs to be used for projection, which will not be repeated here.
[0111] In addition, in one embodiment, in step S60, after parsing the target gesture information based on the reference direction, the target elevator is controlled, which specifically includes but is not limited to the following steps:
[0112] S61, determining the target button corresponding to the target gesture information;
[0113] S62, when the target button is used to indicate the first floor, and the target gesture information is determined to be a click operation based on the reference direction, the target elevator is controlled to perform a lifting operation based on the first floor;
[0114] S63, when the target button is used to indicate the destination, and the target gesture information is determined to be a click operation based on the reference direction, a second floor pre-associated with the destination is determined, and the target elevator is controlled to perform a lifting operation based on the second floor;
[0115] S64, when the target button is used to indicate the destination, and the target gesture information is determined based on the reference direction to indicate a sliding operation with the target button as the end point, the target elevator is controlled to perform a lifting operation based on the second floor, and the target navigation information is played after reaching the second floor, wherein the target navigation information is used to indicate a navigation path from the target elevator to the destination.
[0116] It should be noted that compared with traditional physical buttons, holographic projection buttons can include floor and other destination options to provide passengers with clearer guidance. For example, in a residential scene, specific unit information can be displayed through virtual buttons, such as "1201", and the corresponding destination is 12th floor, unit 1; in a shopping mall scene, specific shops can be displayed through virtual buttons, such as "Shop A", and the corresponding destination is Shop A.
[0117] In addition, the key array may also provide a secondary menu, for example, first projecting a primary menu, displaying floor information in the primary menu, and then clicking on a specific floor to display a secondary menu, providing specific optional destinations for that floor. For example, in the above residential scenario, the floors are displayed through the primary menu, and after selecting the 12th floor, the various units on the 12th floor are displayed through the secondary menu, and "1201" is confirmed by a second click.
[0118] It should be noted that when the target button is the first floor, the lifting instruction of the target elevator is directly generated according to the first floor, and the elevator operation can be controlled based on the lifting instruction. The operation of determining the target gesture information as a click operation based on the reference direction can refer to the operation of the above embodiment, and will not be repeated here.
[0119] It should be noted that, according to the above description, the target button can also be used to indicate the destination. In this case, if the target gesture operation is a click operation, it can be determined that the passenger's intention is to go to the floor where the destination is located, and the elevator can be controlled based on the second floor. The floors of the destination can be pre-associated, for example, the second floor associated with "1201" is the 12th floor, and the second floor associated with "Shop A" is the 5th floor, etc.
[0120] It should be noted that when the target gesture information is used to indicate a sliding operation, the user's intention is to navigate to the destination. For example, when a holographic projection is performed based on the first projection area, the reference direction is the vertical direction. If a horizontal shift is detected, it can be determined as a sliding operation. After the sliding operation is determined, the elevator is controlled to rise and fall after the second floor is acquired according to the above method. The location of the destination is also fixed. Therefore, the path planning can be performed based on the target elevator to the destination, and the target navigation information is played after reaching the second floor to improve the passenger experience. For example, when the target button is "1201", the target navigation information is "turn left after exiting the elevator and go to the first room". The above target navigation information is played after reaching the 12th floor, so that passengers who are unfamiliar with the environment can quickly reach their destination, improving the passenger experience.
[0121] In addition, in one embodiment, step S61 specifically includes but is not limited to the following steps:
[0122] S611, records the movement trajectory of the target hand in real time through the target camera;
[0123] S612, when it is detected that the target hand stays for a period exceeding a preset first period threshold, the three-dimensional coordinates of the current position of the target hand are determined as the three-dimensional coordinates of the hand;
[0124] S613, obtaining the three-dimensional coordinates of each virtual key, determining the target space distance between the three-dimensional coordinates of the hand and the three-dimensional coordinates of each key, and determining the virtual key corresponding to the target space distance with the smallest value as the candidate key;
[0125] S614, displaying candidate keys in a key array in a preset first style;
[0126] S615, when it is detected that the target hand continues to stay for a period exceeding a preset second time threshold, the candidate key is determined as the target key;
[0127] S616: When it is detected that the target hand moves, the candidate keys are re-determined.
[0128] It should be noted that after determining the target camera, the hand located in the projection array can be determined as the target hand, and the movement trajectory of the target hand can be tracked to determine the current three-dimensional coordinates of the target hand. The distance is calculated through the three-dimensional coordinates of the hand and the three-dimensional coordinates of each button to determine the final target button.
[0129] It should be noted that this embodiment accurately judges the target hand's movements by setting a first duration threshold and a second duration threshold. When the target hand does not stay for more than the first duration threshold, it can be determined that the target hand has moved to the vicinity of the target key, and the closest virtual key is determined as a candidate key based on the distance calculation of the three-dimensional coordinates. In the case of having two spatial coordinates, those skilled in the art are familiar with how to perform distance calculation, and will not be elaborated here.
[0130] It should be noted that in this embodiment, the closest key is first determined as a candidate key to avoid the influence of recognition error on key clicks. After the multi-function candidate key is removed, it is displayed in the first style, for example, a border can be displayed around the candidate key, the candidate key can be enlarged, or the candidate key can be displayed in a color different from other virtual keys. When the duration of continued stay exceeds the second duration threshold, it is determined as the target key. If it moves before reaching the second duration threshold, it can be determined that the passenger confirms that the candidate key is selected by mistake, and the above judgment is repeated.
[0131] It should be noted that after the target button is determined, the target gesture information is recognized through the target camera, so as to realize the judgment of the subsequent steps S62 to S64.
[0132] In addition, in one embodiment, the control system of the target elevator is connected to the property management system, and the property management system has a preset owner face database. Before executing step S60, the method further includes but is not limited to the following steps:
[0133] S51, acquiring a second image and a third image, wherein the second image and the third image are captured by a second camera when the elevator door is opened, and the third image is captured later than the second image;
[0134] S52, performing face detection in the second image and the third image respectively, and determining a target face image from face images located in both the second image and the third image;
[0135] S53, performing face recognition based on the target face image and the owner face database to determine the target owner information, and obtaining the third floor pre-associated with the target owner information;
[0136] S54: Displaying a virtual button corresponding to the third floor in the button array based on a preset second style.
[0137] It should be noted that in the property field, each unit is pre-associated with corresponding owner information. Therefore, after the control system of the target elevator is connected to the property system, the owner face library can be set in advance, and the target owner information corresponding to the passengers entering the target elevator can be determined through image recognition. The specific face recognition technology is a technology well known to technical personnel in this field and is not limited here.
[0138] It should be noted that if Figure 1 In the structure shown, the second camera 13 shoots in the direction of the elevator door 14, so the second image and the third image captured when the elevator door 14 is opened can represent the entry and exit of passengers. In the elevator scene, passengers leaving the elevator can only be photographed from the back, so face recognition cannot be performed, and passengers entering the elevator can be photographed from the front, so face extraction and face recognition can be performed. Based on this, this embodiment determines the passengers whose faces can be identified in the second image and the third image as passengers entering the elevator, to ensure the accuracy of subsequent prompts.
[0139] It should be noted that the third image is taken later than the second image. For example, the third image is taken 3 seconds after the second image. The second image is used to determine the passengers outside the elevator after the elevator door is opened. Since there may be too many people in the elevator and not everyone can enter, the third image can be used to exclude passengers who have failed to enter the elevator. By taking the intersection of the recognized faces in the second and third images, the passengers who entered the elevator when the door was opened this time can be determined, and the passengers who were in the elevator but turned around before that are excluded, thereby improving the accuracy of subsequent prompt information.
[0140] It should be noted that after determining the target face image, the target owner information can be determined from the owner face library, and the third floor corresponding to the owner can be obtained, and the virtual button corresponding to the third floor can be displayed in the button array in the second style, so that the corresponding owner can quickly select the floor to go to, thereby improving the operation experience. For example, after identifying that the third floor associated with the target owner information is the 5th floor, the virtual button corresponding to the 5th floor can be enlarged in the button array, so that the passenger can click the 5th floor more easily.
[0141] like Figure 5 As shown, Figure 5 : is a structural diagram of an elevator control device based on holographic projection provided by an embodiment of the present invention. The present invention also provides an elevator control device based on holographic projection, comprising:
[0142] The processor 501 may be implemented by a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application;
[0143] The memory 502 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 502 can store an operating system and other application programs. When the technical solution provided in the embodiment of this specification is implemented by software or firmware, the relevant program code is stored in the memory 502, and the processor 501 calls and executes the elevator control method based on holographic projection in the embodiment of this application;
[0144] Input / output interface 503, used to implement information input and output;
[0145] Communication interface 504, used to realize communication interaction between the device and other devices, which can be realized through wired mode (such as USB, network cable, etc.) or wireless mode (such as mobile network, WI FI, Bluetooth, etc.);
[0146] A bus 505 that transmits information between the various components of the device (e.g., the processor 501, the memory 502, the input / output interface 503, and the communication interface 504);
[0147] The processor 501 , the memory 502 , the input / output interface 503 and the communication interface 504 are connected to each other in communication within the device via the bus 505 .
[0148] An embodiment of the present application also provides an electronic device, including the elevator control device based on holographic projection as described above.
[0149] An embodiment of the present application further provides a storage medium, which is a computer-readable storage medium and stores a computer program. When the computer program is executed by a processor, the above-mentioned elevator control method based on holographic projection is implemented.
[0150] As a non-transient computer-readable storage medium, the memory can be used to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage devices. In some embodiments, the memory may optionally include a memory remotely arranged relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof. The device embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and are implemented to be located in one place, or may also be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment.
[0151] It will be appreciated by those skilled in the art that all or some of the steps and systems in the disclosed method above may be implemented as software, firmware, hardware and appropriate combinations thereof. Some physical components or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor or a microprocessor, or may be implemented as hardware, or may be implemented as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or a non-transitory medium) and a communication medium (or a temporary medium). As known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, disk storage or other magnetic storage devices, or any other medium that may be used to store desired information and may be accessed by a computer. Furthermore, it is well known to those skilled in the art that communication media typically include computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.
[0152] The above is a specific description of the preferred implementation of the present invention, but the present invention is not limited to the above-mentioned implementation mode. Technical personnel familiar with the field can also make various equivalent deformations or substitutions under the shared conditions without violating the spirit of the present invention. These equivalent deformations or substitutions are all included in the scope defined by the claims of the present invention.
Claims
1. An elevator control method based on holographic projection, characterized in that: A control system applied to a target elevator, wherein the target elevator is provided with a holographic projection module, a first camera, and a second camera, wherein the first camera and the second camera are arranged on the top of the target elevator, the first camera and the holographic projection module are located on a side close to an elevator door of the target elevator, and the second camera is located on a side away from the elevator door, and the method comprises: In response to a key generation signal, a first image in a top-down direction is acquired through the first camera, and a passenger area, a projection boundary of the holographic projection module in a horizontal direction, and a first projection area are determined from the first image; Constructing a spatial coordinate system to determine vertex coordinates of each vertex of the first projection area, wherein the vertical coordinate of the vertex coordinate is zero; When the first projection area overlaps with the passenger area, adjusting the first projection area within the projection boundary based on a preset adjustment strategy; When the first projection area can be adjusted to not overlap with the passenger area, a key array is projected based on the adjusted first projection area, a vertical direction is determined as a reference direction, and the first camera is determined as a target camera, wherein the key array includes a plurality of virtual keys; Alternatively, when the first projection area cannot be adjusted to not overlap with the passenger area, the ordinate and the vertical coordinate of each vertex coordinate are exchanged to construct a second projection area, the button array is projected in the second projection area, the horizontal direction is determined as the reference direction, and the second camera is determined as the target camera; The target gesture information is acquired through the target camera, and the target elevator is controlled after the target gesture information is parsed based on the reference direction.
2. The elevator control method based on holographic projection according to claim 1, characterized in that: The projection boundary includes a projection upper boundary, a projection lower boundary, a projection left boundary, and a projection right boundary, and adjusting the first projection area within the projection boundary based on a preset adjustment strategy includes: Determine an overlapping area between the first projection area and the passenger area, determine a distance between a lower boundary of the overlapping area and an upper boundary of the first projection area as a first offset, determine a distance between an upper boundary of the overlapping area and a lower boundary of the first projection area as a second offset, determine a distance between a left boundary of the overlapping area and a right boundary of the first projection area as a third offset, and determine a distance between a right boundary of the overlapping area and a left boundary of the first projection area as a fourth offset; Determine the distance between the upper boundary of the first projection area and the projection upper boundary as a first distance value, determine the distance between the lower boundary of the first projection area and the projection lower boundary as a second distance value, determine the distance between the left boundary of the first projection area and the projection left boundary as a third distance value, and determine the distance between the right boundary of the first projection area and the projection right boundary as a fourth distance value; When the first condition and the second condition are satisfied at the same time, the first projection area is moved along the longitudinal axis based on the first offset or the second offset, and the first projection area is moved along the transverse axis based on the third offset or the fourth offset, so that the passenger area does not overlap with the first projection area, wherein the first condition is that the first distance value is greater than or equal to the first offset, and / or the second distance value is greater than or equal to the second offset, and the second condition is that the third distance value is greater than or equal to the third offset, and / or the fourth distance value is greater than or equal to the fourth offset; When the first condition and the second condition are not met at the same time, the first projection area is rotated 90 degrees along the current plane, and the first offset, the second offset, the third offset, the fourth offset, the first distance value, the second distance value, the third distance value and the fourth distance value are updated, and then the movement judgment based on the first condition and the second condition is re-executed.
3. The elevator control method based on holographic projection according to claim 2, characterized in that: After re-making the movement judgment based on the first condition and the second condition, the method further includes: When the updated first projection area fails to satisfy both the first condition and the second condition, obtaining a preset first adjustment value and a preset second adjustment value, wherein the first adjustment value is used to indicate the longitudinal length of a single virtual key in the key array, and the second adjustment value is used to indicate the transverse length of a single virtual key in the key array; Determine a quotient of a smaller value of the first offset and the second offset and the first adjustment value as a first quantity, and determine a quotient of a smaller value of the third offset and the fourth offset and the second adjustment value as a second quantity; When the updated first projection area meets the first condition but does not meet the second condition, increasing the longitudinal length of the first projection area and reducing the transverse length of the first projection area based on the second number and the second adjustment value; Alternatively, when the first projection area satisfies the second condition but does not satisfy the first condition, the horizontal axis length of the first projection area is increased and the vertical axis length of the first projection area is decreased based on the first number and the first adjustment value; When the updated first projection area does not satisfy both the first condition and the second condition, the first projection area is restored, and the adjustment judgment based on the first quantity and the second quantity is re-executed.
4. The elevator control method based on holographic projection according to claim 3 is characterized in that: After re-determining the first quantity and the second quantity and re-judging, the method further includes: When the first condition and the second condition are still not satisfied at the same time, obtaining a preset area threshold, wherein the area threshold is used to indicate the minimum projection area of the key array; Scaling the first projection area, updating the first offset, the second offset, the third offset, the fourth offset, the first distance value, the second distance value, the third distance value, and the fourth distance value in real time during the scaling process, and determining whether the first condition and the second condition are met; When it is detected that the first condition and the second condition are simultaneously satisfied before the first projection area is scaled to the area threshold, the first projection area is moved so that the first projection area does not overlap with the passenger area; When the first projection area is scaled to the area threshold, the first condition and the second condition are not satisfied at the same time, the first projection area is rotated 90 degrees, and the scaling judgment based on the area threshold is re-executed.
5. The elevator control method based on holographic projection according to claim 1, characterized in that: The controlling the target elevator after parsing the target gesture information based on the reference direction includes: Determining a target key corresponding to the target gesture information; When the target button is used to indicate a first floor, and the target gesture information is determined to be a click operation based on the reference direction, the target elevator is controlled to perform a lifting operation based on the first floor; Alternatively, when the target button is used to indicate a destination, and the target gesture information is determined to be a click operation based on the reference direction, a second floor pre-associated with the destination is determined, and the target elevator is controlled to perform a lifting operation based on the second floor; Alternatively, when the target button is used to indicate the destination, and based on the reference direction it is determined that the target gesture information is used to indicate a sliding operation with the target button as the end point, the target elevator is controlled to perform a lifting operation based on the second floor, and target navigation information is played after reaching the second floor, wherein the target navigation information is used to indicate a navigation path from the target elevator to the destination.
6. The elevator control method based on holographic projection according to claim 5, characterized in that: The determining the target key corresponding to the target gesture information includes: The target camera records the movement trajectory of the target hand in real time; When it is detected that the target hand stays for a period exceeding a preset first period threshold, the three-dimensional coordinates of the current position of the target hand are determined as the three-dimensional coordinates of the hand; Acquire the three-dimensional coordinates of each virtual key, determine the target space distance between the three-dimensional coordinates of the hand and the three-dimensional coordinates of each key, and determine the virtual key corresponding to the target space distance with the smallest value as a candidate key; Displaying the candidate keys in the key array in a preset first style; When it is detected that the target hand continues to stay for a period exceeding a preset second time threshold, the candidate key is determined as the target key; Alternatively, when movement of the target hand is detected, the candidate keys are re-determined.
7. The elevator control method based on holographic projection according to claim 1, characterized in that: The control system of the target elevator is in communication with the property system, and the property system is preset with an owner face library. Before acquiring the target gesture information through the target camera, the method further includes: Acquire a second image and a third image, wherein the second image and the third image are captured by the second camera when the elevator door is opened, and the third image is captured later than the second image; Performing face detection in the second image and the third image respectively, and determining a target face image from face images located in both the second image and the third image; Performing face recognition based on the target face image and the owner face database to determine target owner information, and obtaining a third floor pre-associated with the target owner information; The virtual button corresponding to the third floor is displayed in the button array based on a preset second style.
8. An elevator control device based on holographic projection, characterized in that: The invention comprises at least one control processor and a memory for communicating with the at least one control processor; the memory stores instructions executable by the at least one control processor, and the instructions are executed by the at least one control processor so that the at least one control processor can execute the elevator control method based on holographic projection as described in any one of claims 1 to 7.
9. An electronic device, characterized in that: Including the elevator control device based on holographic projection as described in claim 8.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to enable a computer to execute the elevator control method based on holographic projection as described in any one of claims 1 to 7.
Citation Information
Patent Citations
Projection interaction method, projection interaction device and intelligent terminal
CN106774827A
A virtual elevator interaction system and method based on deep learning
CN109934105A
Systems and methods for displaying car operating panels in elevator cars based on positions of passengers
CN113148788A
Elevator calling method, system and equipment and medium
CN114348809A
Projection interaction method, projection equipment and storage medium
CN115474032A
Cited By
Mistaken touch prevention interaction method based on medium-free holography
CN120994073A
