Elevator control method, device, equipment and storage medium based on holographic projection

CN119038335BActive Publication Date: 2026-09-25LINJIU WISDOM (GUANGDONG) TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411136263.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-19
Publication Date
2026-09-25
Estimated Expiration
2044-08-19

AI Technical Summary

Technical Problem

[0003]然而,现有方案是在固定的区域投影出固定大小的虚拟按键阵列,电梯轿厢的空间有限,在电梯内人员较多的情况下很容易出现投影区域被乘客占用的情况,导致虚拟按键无法正常使用或者形成误触发,影响乘客体验

Benefits of technology

[0048]根据本发明实施例的基于全息投影的电梯控制方法,至少具有如下有益效果:响应于按键生成信号,通过第一摄像头获取俯视方向的第一图像,从第一图像中确定乘客区域、全息投影模块在水平方向的投影边界和第一投影区域;构建空间坐标系,确定第一投影区域的各个顶点的顶点坐标,其中,顶点坐标的竖坐标为零;当第一投影区域与乘客区域重叠,基于预设的调整策略在投影边界内调整第一投影区域;当第一投影区域能够调整至与乘客区域不重叠,基于调整后的第一投影区域投影出按键阵列,将竖直方向确定为参考方向,将第一摄像头确定为目标摄像头,其中,按键阵列包括多个虚拟按键;或者,当第一投影区域不能调整至与乘客区域不重叠,将各个顶点坐标的纵坐标与竖坐标互换后构建出第二投影区域,基于第二投影区域中投影出按键阵列,将水平方向确定为参考方向,将第二摄像头确定为目标摄像头;通过目标摄像头获取目标手势信息,基于参考方向解析目标手势信息后控制目标电梯。根据本发明实施例的技术方案,能够通过图像识别结果在投影边界内调整第一投影区域的位置,在第一投影区域能够错开用户区域时沿水平面投影出按键阵列,在无法避开用户区域时切换成竖直方向投影,从而实现投影区域的灵活调整,确保投影出的按键阵列能够避开乘客,有效避免按键误触,提高用户体验。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119038335B_ABST
    Figure CN119038335B_ABST
Patent Text Reader

Abstract

The application provides an elevator control method, device and equipment based on holographic projection, and a storage medium. The method comprises the following steps: in response to a key generation signal, determining a passenger area, a first projection area and a projection boundary in a horizontal direction from a first image obtained by taking a bird's-eye view; when the first projection area overlaps with the passenger area, adjusting the first projection area to be non-overlapping with the passenger area within the projection boundary, projecting a key array based on the horizontal direction, and applying a first camera to perform gesture detection; otherwise, converting the first projection area into a second projection area in a vertical direction, projecting the key array based on the vertical direction, and applying a second camera to perform gesture detection, so as to complete control of a target elevator. According to the technical scheme of the embodiment of the application, the position and direction of the projection area can be flexibly adjusted according to the image recognition result, and the corresponding target camera is used to perform gesture detection, so that key mis-touching is effectively avoided, and the user experience is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of intelligent elevator technology, and in particular to an elevator control method, device, equipment, and storage medium based on holographic projection. Background Technology

[0002] Currently, holographic projection technology is being applied to elevator control. Imaging and detection modules are installed in the elevator. The imaging module projects 3D virtual buttons into the air, while the detection module captures the position and movements of passengers' hands, thereby recognizing their intentions and controlling the elevator. For example, floor buttons can be projected; by detecting the passenger's hand movements, the floor closest to the hand is identified as the target floor, and the passenger's intention is to go to that floor, thus controlling the elevator's ascent and descent.

[0003] However, the existing solution projects a fixed-size array of virtual buttons in a fixed area. The space in the elevator car is limited, and when there are many people in the elevator, the projection area is easily occupied by passengers, causing the virtual buttons to malfunction or be accidentally triggered, which affects the passenger experience. Summary of the Invention

[0004] This invention aims to solve at least one of the technical problems existing in the prior art. To this end, this invention proposes an elevator control method, device, equipment, and storage medium based on holographic projection, which can flexibly adjust the projection area, reduce the risk of accidental touch, and improve the passenger experience.

[0005] In a first aspect, embodiments of the present invention provide an elevator control method based on holographic projection, applied to the control system of a target elevator. The target elevator is equipped with a holographic projection module, a first camera, and a second camera. The first camera and the second camera are located on the top of the target elevator. The first camera and the holographic projection module are located on one side near the elevator door, and the second camera is located on the side away from the elevator door. The method includes:

[0006] In response to a button-generated signal, a first image from a top-down view is acquired through the first camera, and the passenger area, the horizontal projection boundary of the holographic projection module, and the first projection area are determined from the first image.

[0007] Construct a spatial coordinate system and determine the vertex coordinates of each vertex in the first projection region, wherein the vertical coordinate of the vertex coordinates is zero;

[0008] When the first projection area overlaps with the passenger area, the first projection area is adjusted within the projection boundary based on a preset adjustment strategy.

[0009] When the first projection area can be adjusted to not overlap with the passenger area, a button array is projected based on the adjusted first projection area, the vertical direction is determined as the reference direction, and the first camera is determined as the target camera, wherein the button array includes multiple virtual buttons;

[0010] Alternatively, when the first projection area cannot be adjusted to not overlap with the passenger area, the ordinate and vertical coordinate of each vertex coordinate are interchanged to construct a second projection area. The button array is projected based on the second projection area, the horizontal direction is determined as the reference direction, and the second camera is determined as the target camera.

[0011] The target camera acquires target gesture information, and the target elevator is controlled after the target gesture information is parsed based on the reference direction.

[0012] According to some embodiments of the present invention, the projection boundary includes an upper projection boundary, a lower projection boundary, a left projection boundary, and a right projection boundary, and the adjustment of the first projection area within the projection boundary based on a preset adjustment strategy includes:

[0013] The overlapping area between the first projection area and the passenger area is determined. The distance between the lower boundary of the overlapping area and the upper boundary of the first projection area is determined as the first offset. The distance between the upper boundary of the overlapping area and the lower boundary of the first projection area is determined as the second offset. The distance between the left boundary of the overlapping area and the right boundary of the first projection area is determined as the third offset. The distance between the right boundary of the overlapping area and the left boundary of the first projection area is determined as the fourth offset.

[0014] The distance between the upper boundary of the first projection area and the upper boundary of the projection is determined as a first distance value; the distance between the lower boundary of the first projection area and the lower boundary of the projection is determined as a second distance value; the distance between the left boundary of the first projection area and the left boundary of the projection is determined as a third distance value; and the distance between the right boundary of the first projection area and the right boundary of the projection is determined as a fourth distance value.

[0015] If the first condition and the second condition are met simultaneously, the first projection area is moved along the vertical axis based on the first offset or the second offset, and the first projection area is moved along the horizontal axis based on the third offset or the fourth offset, so that the passenger area does not overlap with the first projection area. The first condition is that the first distance value is greater than or equal to the first offset, and / or the second distance value is greater than or equal to the second offset. The second condition is that the third distance value is greater than or equal to the third offset, and / or the fourth distance value is greater than or equal to the fourth offset.

[0016] If the first condition and the second condition are not met simultaneously, the first projection area is rotated 90 degrees along the current plane, and the first offset, the second offset, the third offset, the fourth offset, the first distance value, the second distance value, the third distance value, and the fourth distance value are updated. Then, the movement judgment based on the first condition and the second condition is re-executed.

[0017] According to some embodiments of the present invention, after the move determination is re-based on the first condition and the second condition, the method further includes:

[0018] If the updated first projection area fails to simultaneously meet the first condition and the second condition, a preset first adjustment value and a preset second adjustment value are obtained, wherein the first adjustment value is used to indicate the vertical axis length occupied by a single virtual button in the button array, and the second adjustment value is used to indicate the horizontal axis length occupied by a single virtual button in the button array.

[0019] The smaller of the first offset and the second offset is divided by the first adjustment value to determine the first quantity, and the smaller of the third offset and the fourth offset is divided by the second adjustment value to determine the second quantity.

[0020] If the updated first projection area satisfies the first condition but does not satisfy the second condition, the vertical axis length of the first projection area is increased and the horizontal axis length of the first projection area is decreased based on the second quantity and the second adjustment value.

[0021] Alternatively, if the first projection area satisfies the second condition but does not satisfy the first condition, the horizontal axis length of the first projection area is increased and the vertical axis length of the first projection area is decreased based on the first quantity and the first adjustment value.

[0022] If the updated first projection area does not meet both the first and second conditions, the first projection area is restored, and the adjustment judgment based on the first and second quantities is re-executed.

[0023] According to some embodiments of the present invention, after the re-determination of the first quantity and the second quantity, the method further includes:

[0024] If the first condition and the second condition still cannot be met simultaneously, a preset area threshold is obtained, wherein the area threshold is used to indicate the minimum projected area of ​​the button array;

[0025] The first projection area is scaled, and the first offset, second offset, third offset, fourth offset, first distance value, second distance value, third distance value and fourth distance value are updated in real time during the scaling process, and it is determined whether the first condition and the second condition are met;

[0026] If the first condition and the second condition are simultaneously satisfied before the first projection area is scaled to the area threshold, the current first projection area is moved so that the first projection area does not overlap with the passenger area.

[0027] If the first condition and the second condition are not simultaneously satisfied after scaling the first projection area to the area threshold, the first projection area is rotated 90 degrees and the scaling judgment based on the area threshold is re-executed.

[0028] According to some embodiments of the present invention, controlling the target elevator after parsing the target gesture information based on the reference direction includes:

[0029] Determine the target button corresponding to the target gesture information;

[0030] When the target button is used to indicate the first floor, and the target gesture information is determined to be a click operation based on the reference direction, the target elevator is controlled to perform lifting and lowering operations based on the first floor.

[0031] Alternatively, when the target button is used to indicate the destination, and the target gesture information is determined to be a click operation based on the reference direction, the second floor pre-associated with the destination is determined, and the target elevator is controlled to perform lifting and lowering operations based on the second floor;

[0032] Alternatively, when the target button is used to indicate the destination, and the target gesture information is determined based on the reference direction to indicate a swipe operation with the target button as the endpoint, the target elevator is controlled to perform a lifting operation based on the second floor, and target navigation information is played after reaching the second floor, wherein the target navigation information is used to indicate the navigation path of the target elevator to the destination.

[0033] According to some embodiments of the present invention, determining the target button corresponding to the target gesture information includes:

[0034] The target camera records the movement trajectory of the target's hand in real time.

[0035] When it is detected that the duration of the target hand's stay exceeds a preset first duration threshold, the three-dimensional coordinates of the target hand's current position are determined as the hand's three-dimensional coordinates;

[0036] Obtain the three-dimensional coordinates of each virtual button, determine the target spatial distance between the three-dimensional coordinates of the hand and the three-dimensional coordinates of each button, and determine the virtual button corresponding to the target spatial distance with the smallest value as a candidate button;

[0037] The candidate buttons are displayed in the button array in a preset first style;

[0038] When the duration of the target hand's continued lingering exceeds a preset second duration threshold, the candidate button is determined as the target button;

[0039] Alternatively, when movement of the target hand is detected, the candidate button can be re-determined.

[0040] According to some embodiments of the present invention, the control system of the target elevator is communicatively connected to the property management system, and the property management system has a preset resident face database. Before acquiring target gesture information through the target camera, the method further includes:

[0041] Acquire a second image and a third image, wherein the second image and the third image are captured by the second camera when the elevator door opens, and the third image is captured later than the second image;

[0042] Face detection is performed in the second image and the third image respectively, and the face images that are simultaneously located in the second image and the third image are used to determine the target face image;

[0043] Based on the target face image and the owner face database, face recognition is performed to determine the target owner information, and the third floor pre-associated with the target owner information is obtained;

[0044] The virtual button corresponding to the third floor is displayed in the button array based on a preset second style.

[0045] In a second aspect, embodiments of the present invention provide an elevator control device based on holographic projection, including at least one control processor and a memory for communicatively connecting with the at least one control processor; the memory stores instructions executable by the at least one control processor, which, when executed by the at least one control processor, enables the at least one control processor to perform the elevator control method based on holographic projection as described in the first aspect above.

[0046] Thirdly, embodiments of the present invention provide an electronic device including an elevator control device based on holographic projection as described in the second aspect above.

[0047] Fourthly, embodiments of the present invention provide a computer-readable storage medium storing computer-executable instructions for executing the elevator control method based on holographic projection as described in the first aspect above.

[0048] The elevator control method based on holographic projection according to embodiments of the present invention has at least the following beneficial effects: In response to a button generation signal, a first image in a top-down direction is acquired through a first camera; the passenger area, the horizontal projection boundary of the holographic projection module, and the first projection area are determined from the first image; a spatial coordinate system is constructed, and the vertex coordinates of each vertex in the first projection area are determined, wherein the vertical coordinate of the vertex coordinates is zero; when the first projection area overlaps with the passenger area, the first projection area is adjusted within the projection boundary based on a preset adjustment strategy; when the first projection area can be adjusted to not overlap with the passenger area, a button array is projected based on the adjusted first projection area, the vertical direction is determined as the reference direction, and the first camera is determined as the target camera, wherein the button array includes multiple virtual buttons; or, when the first projection area cannot be adjusted to not overlap with the passenger area, the vertical coordinates of each vertex coordinate are interchanged to construct a second projection area, a button array is projected based on the second projection area, the horizontal direction is determined as the reference direction, and the second camera is determined as the target camera; target gesture information is acquired through the target camera, and the target elevator is controlled after parsing the target gesture information based on the reference direction. According to the technical solution of the present invention, the position of the first projection area can be adjusted within the projection boundary through image recognition results. When the first projection area can be offset from the user area, the button array is projected along the horizontal plane. When it cannot avoid the user area, the projection is switched to the vertical direction, thereby realizing flexible adjustment of the projection area, ensuring that the projected button array can avoid passengers, effectively avoiding accidental button touches, and improving user experience. Attached Figure Description

[0049] Figure 1 This is a schematic diagram of a target elevator provided in one embodiment of the present invention;

[0050] Figure 2 This is a flowchart of an elevator control method based on holographic projection provided in another embodiment of the present invention;

[0051] Figure 3 This is a schematic diagram of a movable first projection area provided in another embodiment of the present invention;

[0052] Figure 4 This is a schematic diagram illustrating the arrangement of the adjustable button array according to another embodiment of the present invention;

[0053] Figure 5 This is a structural diagram of an elevator control device based on holographic projection provided in another embodiment of the present invention. Detailed Implementation

[0054] Embodiments of the present invention are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and should not be construed as limiting the present invention.

[0055] In the description of this invention, it should be understood that the orientation descriptions, such as up, down, front, back, left, right, etc., are based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing this invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limiting this invention.

[0056] In the description of this invention, "several" means one or more, "more than" means two or more, "greater than," "less than," and "exceeding" are understood to exclude the stated number, while "above," "below," and "within" are understood to include the stated number. The use of "first" and "second" in the description is merely for distinguishing technical features and should not be construed as indicating or implying relative importance, or implicitly indicating the number of indicated technical features, or implicitly indicating the order of the indicated technical features.

[0057] In the description of this invention, unless otherwise explicitly defined, terms such as "set up," "install," and "connect" should be interpreted broadly, and those skilled in the art can reasonably determine the specific meaning of the above terms in this invention in conjunction with the specific content of the technical solution.

[0058] This invention provides an elevator control method, device, equipment, and storage medium based on holographic projection. The elevator control method based on holographic projection includes: responding to a button-generated signal, acquiring a first image in a top-down direction using a first camera; determining a passenger area, a horizontal projection boundary of the holographic projection module, and a first projection area from the first image; constructing a spatial coordinate system and determining the vertex coordinates of each vertex in the first projection area, wherein the vertical coordinate of each vertex is zero; when the first projection area overlaps with the passenger area, adjusting the first projection area within the projection boundary based on a preset adjustment strategy; and when the first projection area can... The first projection area is adjusted to not overlap with the passenger area. A button array is projected based on this adjusted first projection area, with the vertical direction determined as the reference direction and the first camera as the target camera. The button array includes multiple virtual buttons. Alternatively, if the first projection area cannot be adjusted to not overlap with the passenger area, a second projection area is constructed by swapping the ordinates of each vertex. A button array is projected based on this second projection area, with the horizontal direction determined as the reference direction and the second camera as the target camera. Target gesture information is acquired through the target camera, and the target elevator is controlled after parsing the target gesture information based on the reference direction. According to the technical solution of this embodiment, the position of the first projection area can be adjusted within the projection boundary based on image recognition results. When the first projection area can be offset from the user area, a button array is projected along the horizontal plane; when it cannot avoid the user area, the projection is switched to a vertical direction. This allows for flexible adjustment of the projection area, ensuring that the projected button array avoids passengers, effectively preventing accidental button presses, and improving the user experience.

[0059] First, refer to Figure 1 , Figure 1 This is a schematic diagram of a target elevator provided in an embodiment of the present invention. The target elevator 10 in this embodiment is provided with a holographic projection module 11, a first camera 12 and a second camera 13. The first camera 12 and the second camera 13 are located on the top of the target elevator 10. The first camera 12 and the holographic projection module 11 are located on the side close to the elevator door 14 of the target elevator 10, and the second camera 13 is located on the side away from the elevator door 14.

[0060] Among them, such as Figure 1As shown, the first camera 12 can be positioned downwards to capture a top-down view of the elevator 10. Simultaneously, when the holographic projection module 11 projects a horizontally distributed array of buttons through the first projection area 21, the first camera 12, located above the first projection area 21, can capture the passenger's hand movements within the button array, thus obtaining target gesture information. Similarly, the second camera 13 can be positioned towards the elevator door 14. Since it is positioned at the top, the second camera 13's shooting angle is tilted downwards. When the holographic projection module 11 projects a vertically oriented array of buttons through the second projection area 22, the second camera 13 can capture the passenger's hand movements within the button array, thus obtaining target gesture information.

[0061] Among them, the holographic projection module 11 is a common holographic projection device that can project virtual buttons in space. As those skilled in the art know, each virtual button is projected based on three-dimensional spatial coordinates. Therefore, when projection is required based on the first projection area 21, the Z-axis coordinate of each virtual button can be set to 0. When projection is required based on the second projection area 22, the Y-axis coordinate of each virtual button can be set to 0. This embodiment does not involve the specific projection principle, so it will not be elaborated here.

[0062] The following is based on the appendix Figure 1 The structure shown further illustrates the technical solution of the embodiments of the present invention.

[0063] Reference Figure 2 , Figure 2 The flowchart illustrates an elevator control method based on holographic projection, which includes, but is not limited to, the following steps:

[0064] S10, in response to the button generating signal, the first image in the top-down direction is acquired through the first camera, and the passenger area, the horizontal projection boundary of the holographic projection module and the first projection area are determined from the first image;

[0065] S20, Construct a spatial coordinate system and determine the vertex coordinates of each vertex in the first projection region, wherein the vertical coordinate of the vertex coordinate is zero;

[0066] S30, when the first projection area overlaps with the passenger area, the first projection area is adjusted within the projection boundary based on a preset adjustment strategy;

[0067] S40, when the first projection area can be adjusted to not overlap with the passenger area, a button array is projected based on the adjusted first projection area, the vertical direction is determined as the reference direction, and the first camera is determined as the target camera, wherein the button array includes multiple virtual buttons;

[0068] S50, when the first projection area cannot be adjusted to not overlap with the passenger area, the ordinate and vertical coordinate of each vertex are interchanged to construct the second projection area, the button array is projected based on the second projection area, the horizontal direction is determined as the reference direction, and the second camera is determined as the target camera;

[0069] The S60 acquires target gesture information through the target camera, and controls the target elevator after parsing the target gesture information based on the reference direction.

[0070] It should be noted that the button generation signal can be automatically triggered after the elevator door opens, or it can be triggered when a passenger operates the holographic projection module. Upon receiving the button generation signal, the first camera is triggered to capture a first image. This first image is used as a top-down view for passenger area identification, which can be achieved using simple image recognition technology. This embodiment does not involve any improvement to image recognition technology. The passenger area in this embodiment is not limited to a single passenger, but rather the area occupied by any number of passengers that can be identified in the first image. For ease of description, a single passenger example will be used subsequently. When there are multiple passenger areas in the first image, the overlapping area can be determined by combining the multiple passenger areas.

[0071] It is worth noting that the projection boundary of the holographic projection module is known in advance, and the first projection area can also be the default projection area of ​​the holographic projection module, which is also a known area. The position of the first camera is also fixed, and in this embodiment, the first camera is used for holographic projection, not ordinary monitoring; therefore, its shooting angle is also fixed and will not be adjusted. Thus, the projection boundary and the first projection area can be marked in the first image using a preset method. For example, as... Figure 1 As shown, a projection boundary 31 and a first projection area 33 are preset in the first image. Regardless of when the image is captured, the relevant dashed frame is displayed in the first image, which improves the efficiency of subsequent recognition.

[0072] It should be noted that, in order to achieve flexible adjustment of the projection area, a first camera and a second camera are set on the top of the target elevator to provide different shooting angles. In order to accurately capture the passenger area, the first camera is set on the side near the elevator door, thus achieving a top-down shooting effect. In this case, the image captured by the first camera can extract the Z-axis information of the passenger's hand to a certain extent, but it can only be used for gesture recognition. The shooting angle determines the low recognition accuracy. Therefore, it is more conducive to the first camera to perform planar recognition by projecting the button array based on the first projection area, thereby improving the recognition accuracy of the target gesture information. Similarly, it is difficult to extract the Y-axis information of the passenger's hand from the image captured by the first camera. Therefore, the button array projected based on the second projection area is arranged vertically. By using different cameras with button arrays of different directions, the accuracy of gesture recognition can be ensured while the projection area can be spatially adjusted, thereby improving the reliability of holographic control.

[0073] It should be noted that in this embodiment, the spatial coordinate system is based on the left-right direction of the target elevator as the X-axis, the front-back direction as the Y-axis, and the height direction as the Z-axis. Therefore, each vertex of the first projection area is located on the horizontal plane, and the vertical coordinate, i.e., the Z-axis coordinate, is zero.

[0074] It should be noted that after determining the passenger area, if the passenger area does not overlap with the first projection area, projection is directly based on the first projection area, and the first camera is used as the target camera to recognize the target gesture information. When the passenger area overlaps with the first projection area, the system first attempts to adjust the first projection area within the projection boundary using an adjustment strategy to offset it from the passenger area. The adjustment strategy can include moving the first projection area, adjusting the layout of the button array to adjust the shape of the first projection area, or scaling the first projection area. Of course, it is also possible to adjust the position of the virtual buttons in the button array to project an irregularly shaped button array. For example, the buttons overlapping with the passenger area can be unprojected, and the unprojected virtual buttons can be projected in other non-overlapping areas. The adjustment strategy can be adjusted according to actual needs, which will not be elaborated on here.

[0075] It should be noted that in step S40, after the first projection area is adjusted, the projection parameters of the holographic projection module can be adjusted synchronously according to the adjustment amount of the first projection area. For example, the coordinate values ​​of each virtual button can be adjusted according to the adjustment amount of the first projection area, so that its position is offset during projection, thereby achieving the effect of moving the first projection area.

[0076] It should be noted that if the first projection area cannot be offset from the passenger area through adjustments such as moving and scaling, projecting the button array horizontally will cause some buttons to be obscured by passengers, making them unclickable or causing accidental touches. In this case, this embodiment converts the projection to a vertical direction. For the holographic projection module, the key to spatial projection lies in determining the spatial coordinates. The first projection area is located on the horizontal plane, so the Z-axis coordinate is 0. After swapping the Z-axis and Y-axis coordinates, the first projection area is converted into a vertical second projection area. After the range of the second projection area is determined, the holographic projection module is pre-configured to project the button array based on the first projection area. Similarly, by swapping the Y-axis and Z-axis coordinates of each projection pixel of the button array, a vertical button array can be projected into the second projection area.

[0077] It should be noted that after holographic projection is performed based on the second projection area, the second camera is activated as the target camera, and the passenger's operation direction is also different from that of the first projection area. At this time, the passenger's click operation is a horizontal action. Therefore, the horizontal direction is used as the reference direction to accurately identify the target gesture information. The specific gesture recognition is not an improvement made in this embodiment, and will not be elaborated here.

[0078] It should be noted that using a camera to recognize gesture information is a technique well-known to those skilled in the art, and the specific principles will not be elaborated upon here. This embodiment flexibly adjusts the reference direction based on the projection strategy. When a horizontal button array is projected based on the first projection area, the vertical direction is used as the reference direction; when a vertical button array is projected based on the second projection area, the horizontal direction is used as the reference direction. Taking a passenger's hand movement as a vertical translation as an example, when using the first projection area, since the vertical direction is the reference direction, the gesture can be recognized as a click operation; when using the second projection area, since the horizontal direction is the reference direction, the gesture can be recognized as a swipe operation to indicate page turning.

[0079] The technical solution of this embodiment can utilize image recognition technology to determine whether the first projection area and the passenger area overlap. When overlap occurs, the first projection area is adjusted, with the first camera as the target camera and the vertical direction as the reference direction, to project a button array in the horizontal direction, improving the convenience of operation. When it is impossible to offset the first projection area from the passenger area by adjusting its position and size, a second projection area in the vertical direction is adjusted, with the second camera as the target camera and the horizontal direction as the reference direction, to project a button array in the vertical plane, reducing the horizontal space required for projection, flexibly adjusting the projection strategy of the button array, effectively avoiding interference from passengers to the button array, reducing the risk of accidental touches, and improving the user experience and reliability of the holographic projection elevator.

[0080] In another embodiment, the projection boundary includes an upper projection boundary, a lower projection boundary, a left projection boundary, and a right projection boundary. In step S30, the first projection area is adjusted within the projection boundary based on a preset adjustment strategy, which may include, but is not limited to, the following steps:

[0081] S311, determine the overlapping area of ​​the first projection area and the passenger area, determine the distance between the lower boundary of the overlapping area and the upper boundary of the first projection area as the first offset, determine the distance between the upper boundary of the overlapping area and the lower boundary of the first projection area as the second offset, determine the distance between the left boundary of the overlapping area and the right boundary of the first projection area as the third offset, and determine the distance between the right boundary of the overlapping area and the left boundary of the first projection area as the fourth offset.

[0082] S312, the distance between the upper boundary of the first projection area and the upper boundary of the projection is determined as the first distance value, the distance between the lower boundary of the first projection area and the lower boundary of the projection is determined as the second distance value, the distance between the left boundary of the first projection area and the left boundary of the projection is determined as the third distance value, and the distance between the right boundary of the first projection area and the right boundary of the projection is determined as the fourth distance value.

[0083] S313, if the first condition and the second condition are met simultaneously, the first projection area is moved along the vertical axis based on the first offset or the second offset, and the first projection area is moved along the horizontal axis based on the third offset or the fourth offset, so that the passenger area does not overlap with the first projection area. The first condition is that the first distance value is greater than or equal to the first offset, and / or the second distance value is greater than or equal to the second offset. The second condition is that the third distance value is greater than or equal to the third offset, and / or the fourth distance value is greater than or equal to the fourth offset.

[0084] S314, if the first condition and the second condition are not satisfied at the same time, rotate the first projection area by 90 degrees along the current plane, update the first offset, the second offset, the third offset, the fourth offset, the first distance value, the second distance value, the third distance value and the fourth distance value, and then re-execute the movement judgment based on the first condition and the second condition.

[0085] It should be noted that, as Figure 1 As shown, with the first projection area 33 and projection boundary 31 pre-set, a simple image recognition algorithm can be used to detect the target in the first image to determine the passenger area 32, such as the area occupied by the passenger's head, torso, or limbs. When an intersection is detected between the first projection area 33 and the passenger area 32, the corresponding intersection is determined as the overlapping area 34.

[0086] It is worth noting that the overlapping region 34 can be obtained from any number of passenger regions 32. For example, when there are many people in the elevator, multiple passenger regions 32 are detected in the first image. The intersection of each passenger region 32 and the first projection region 33 is determined as the overlapping region 34. That is, the first image may include multiple overlapping regions 34. In order to better illustrate the technical solution of this embodiment, the following uses one passenger region 32 as an example. When there are multiple passenger regions 32, the overlapping region 34 can be calculated at the farthest end of the overlapping region 34. For example, at the upper boundary of the overlapping region 34 described below, when there are multiple overlapping regions 34, the uppermost one of the upper boundaries of each overlapping region 34 is used for subsequent calculation. Other values ​​are similar and will not be repeated here.

[0087] It should be noted that the first offset is the distance between the upper boundary of the first projection area and the lower boundary of the overlapping area. The first offset represents the distance the first projection area moves upward away from the current overlapping area. Figure 3 As shown, the first offset is Figure 3 As shown in the diagram, after the first projection area moves upward by P1, the first projection area 33 no longer overlaps with the current overlapping area 34. The second offset represents the distance the first projection area moves downward away from the current overlapping area, as shown in the diagram. Figure 3 P2 as shown; the third offset represents the distance the first projection area moves to the left away from the current overlapping area, as... Figure 3 P3 as shown; the fourth offset represents the distance the first projection area moves to the right away from the current overlapping area, as... Figure 3 The P4 shown here will not be described in detail here.

[0088] It should be noted that the first, second, third, and fourth distance values ​​indicate the maximum distance that can be moved in each direction, ensuring that the first projected area remains within the projection boundary after movement. Therefore, before moving, the first distance value and the first offset are compared. If the first distance value is less than the first offset, the first projected area cannot be moved upwards to offset the passenger area. The same applies to other directions. Therefore, after determining the aforementioned offsets and distance values, the feasibility of movement is judged based on the first and second conditions. The first condition characterizes the feasibility of lateral movement, and the second condition characterizes the feasibility of longitudinal movement. This embodiment requires that both conditions be met simultaneously to ensure that the first projected area is offset from the passenger area.

[0089] It should be noted that if the first and second conditions are not simultaneously met, and the first projection area is not a square, the first projection area can be rotated 90 degrees, and the first and second conditions can be checked again. This allows for the exchange of requirements for horizontal and vertical space, enabling flexible control of the projection area. For example... Figure 3 As shown, when the first projection area 33 is rectangular, if the overlapping area 34 occupies a large horizontal space, it is difficult to move the first projection area 33 to offset the passenger area 32 when the first projection area 33 is long in the horizontal direction. After rotating the first projection area 33 by 90 degrees, the shorter side is located in the horizontal direction, reducing the need for horizontal space. This increases the third and fourth distance values, making the second condition easier to satisfy. The determination process and condition judgment of each value will not be repeated here.

[0090] It should be noted that the movement according to the technical solution of this embodiment only allows leaving the current overlapping area, but may introduce a new overlapping area, for example... Figure 3 As shown, after the first projection region 33 is shifted to the right based on P4, the first projection region 33 is as follows: Figure 3 As shown below, the first projection area 33 is offset from the passenger area 32, allowing for related projection operations. However, if the first projection area 33 is shifted to the left based on P3, it will only be offset from the overlapping area 34 before the shift, but will have more overlap with the passenger area 32, resulting in a new overlapping area. Therefore, in step S313 of this embodiment, the shift judgment is based on the premise that no new overlapping area is introduced. For example, if shifting based on either the first or second offset will not introduce a new overlapping area, either can be chosen for the shift. If shifting based on the first offset will not introduce a new overlapping area, but shifting based on the second offset will introduce a new overlapping area, then shifting based on the first offset is used. Of course, to achieve the above judgment, after determining the passenger area, the opposite direction of the passenger area can be used as the shift direction, such as... Figure 3 As shown, when passenger area 32 is located to the lower left of first projection area 33, the movement direction can be selected to the right or upward. The same judgment can be performed when there are multiple passenger areas 32. Alternatively, after moving, the overlapping area can be re-determined, and the same calculation can be performed again. The number of iterations is set. If there is still an overlapping area after the number of iterations is used up, it is determined that the strategy of adjusting the first projection area by moving is invalid, and the adjustment strategy of steps S321 to S325 is executed.

[0091] In another embodiment, after step S314 is performed, the method further includes, but is not limited to, the following steps:

[0092] S321, if the updated first projection area fails to simultaneously meet the first condition and the second condition, obtain a preset first adjustment value and a preset second adjustment value, wherein the first adjustment value is used to indicate the vertical axis length occupied by a single virtual key in the key array, and the second adjustment value is used to indicate the horizontal axis length occupied by a single virtual key in the key array.

[0093] S322, the quotient of the smaller of the first offset and the second offset and the first adjustment value is determined as the first quantity, and the quotient of the smaller of the third offset and the fourth offset and the second adjustment value is determined as the second quantity;

[0094] S323, if the updated first projection area satisfies the first condition but does not satisfy the second condition, increase the vertical axis length of the first projection area and decrease the horizontal axis length of the first projection area based on the second quantity and the second adjustment value.

[0095] S324, if the first projection area satisfies the second condition but does not satisfy the first condition, the horizontal axis length of the first projection area is increased and the vertical axis length of the first projection area is decreased based on the first quantity and the first adjustment value.

[0096] S325, if the updated first projection area does not meet both the first and second conditions, restore the first projection area and re-execute the adjustment judgment based on the first and second quantities.

[0097] It should be noted that if the first and second conditions cannot be met after the first projection area is rotated, it can be determined that the current shape and size of the first projection area cannot meet the requirements. In this embodiment, the space utilization rate within the projection boundary is improved by adjusting the shape first.

[0098] It should be noted that during a conventional projection process, such as Figure 4 As shown, each row of the projection array has the same number of columns. In the case where the overlapping area 34 only interferes with the virtual buttons locally, this embodiment adjusts the position of the virtual buttons to offset them from the passenger area 32. Based on this, when the first offset is less than the second offset, the amount of movement required based on the first offset is smaller. Therefore, it can be determined that the direction corresponding to the first offset is easier to leave the passenger area, and the number of virtual buttons adjusted based on the first offset is also less. Thus, the adjustment involved in the first number determined based on the smaller value is less, resulting in higher adjustment efficiency and less change to the shape of the button array, avoiding significant modifications that would cause inconvenience for passengers.

[0099] It should be noted that the first adjustment value and the second adjustment value are the length and width of the virtual buttons, respectively. The first quantity represents the number of columns that need to be adjusted to offset the passenger areas, and the second quantity represents the number of rows that need to be adjusted to offset the passenger areas. In step S323, when the first projection area meets the first condition but not the second condition (i.e., the vertical space is large enough to accommodate more incremental buttons, while the horizontal space is small enough to accommodate fewer incremental buttons), the number of rows in the button array is transferred to the number of columns. The second quantity is the number of rows that need to be adjusted to offset the passenger areas. Therefore, based on the second quantity, the vertical axis length of the first projection area is increased, and the horizontal axis length is decreased, resulting in the aforementioned reduction in the number of columns in the button array. Step S324 is similar and will not be repeated here.

[0100] For example, such as Figure 4 As shown, the first adjustment value T1 is the vertical length, and the second adjustment value T2 is the horizontal length. Taking the first offset P1 being less than the second offset P2 as an example, and the third offset P3 being greater than the fourth offset P4 as an example, the first quantity is the quotient of P1 and T1, and the second quantity is the quotient of P4 and T1. The first quantity is 3, and the second quantity is 2. When the first condition is met but the second condition is not met, 2 columns are reduced in the first projection area, and 2 rows are added above the first projection area. Of course, the 2 columns reduced are the 2 columns close to the overlapping area 34, so that the resulting button array is offset from the passenger area.

[0101] It is worth noting that if steps S323 and S324 fail to satisfy the condition that the first projection area and the passenger area are misaligned, the first projection area is rotated 90 degrees and re-evaluated. This will not be repeated here.

[0102] In another embodiment, after step S325 is performed, the method further includes, but is not limited to, the following steps:

[0103] S331, when the first condition and the second condition still fail to be met simultaneously, obtain a preset area threshold, wherein the area threshold is used to indicate the minimum projected area of ​​the key array.

[0104] S332, scale the first projection area, and update the first offset, second offset, third offset, fourth offset, first distance value, second distance value, third distance value and fourth distance value in real time during the scaling process, and determine whether the first condition and the second condition are met;

[0105] S333, before the first projection area is scaled to the area threshold, if the first condition and the second condition are simultaneously satisfied, the current first projection area is moved so that the first projection area does not overlap with the passenger area.

[0106] S334, when the first projection area is scaled to the area threshold, if the first condition and the second condition are not satisfied at the same time, the first projection area is rotated by 90 degrees and the scaling judgment based on the area threshold is re-executed.

[0107] It should be noted that when adjusting the position and the shape of the button array cannot meet the requirements, this embodiment scales the first projection area and uses an area threshold to characterize the minimum usable button array. This avoids the virtual buttons being too small, ensuring passenger experience and accurate gesture recognition. The specific area threshold can be determined based on the projection precision of the holographic projection module, and will not be limited here.

[0108] It is worth noting that the scaling of the first projection area can be performed sequentially according to a preset ratio. For example, if the preset ratio is 90%, the area will be scaled to 90% of the current size during the first scaling. Since the range of the first projection area changes after scaling, the first offset, second offset, third offset, fourth offset, first distance value, second distance value, third distance value, and fourth distance value can be updated in real time. The magnitude relationship of the above values ​​will also change. Therefore, the judgment in step S313 is performed once after each scaling is completed. If the first condition and the second condition are met, the position adjustment operation of the above embodiment is performed.

[0109] It should be noted that if the first and second conditions cannot be met simultaneously after scaling to the area threshold, referring to the principle of step S314, the first projection area is rotated 90 degrees to adjust the occupancy of the horizontal and vertical spaces, and scaling judgment is performed here. This will not be repeated here.

[0110] It should be noted that if step S334 still cannot make the first projection area and the passenger area staggered, then the second projection area needs to be applied for projection, which will not be repeated here.

[0111] In another embodiment, in step S60, after parsing the target gesture information based on the reference direction, the target elevator is controlled, which specifically includes, but is not limited to, the following steps:

[0112] S61, determine the target button corresponding to the target gesture information;

[0113] S62, when the target button is used to indicate the first floor, and the target gesture information is determined to be a click operation based on the reference direction, the target elevator is controlled to perform lifting and lowering operations based on the first floor;

[0114] S63, when the target button is used to indicate the destination, and the target gesture information is determined to be a click operation based on the reference direction, the second floor pre-associated with the destination is determined, and the target elevator is controlled to perform lifting and lowering operations based on the second floor;

[0115] S64, when the target button is used to indicate the destination, and the target gesture information is determined based on the reference direction to indicate the sliding operation with the target button as the endpoint, the target elevator is controlled to perform the lifting operation based on the second floor, and the target navigation information is played after reaching the second floor, wherein the target navigation information is used to indicate the navigation path of the target elevator to the destination.

[0116] It should be noted that, compared to traditional physical buttons, holographic projection buttons can include floor and other destination options, providing passengers with clearer guidance. For example, in a residential setting, specific unit information can be displayed via virtual buttons, such as "1201," with the destination being Unit 1, 12th floor; in a shopping mall setting, specific shops can be displayed via virtual buttons, such as "Shop A," with the destination being Shop A.

[0117] Additionally, button arrays can also provide secondary menus. For example, a primary menu can be projected first, displaying floor information. Clicking on a specific floor will then display a secondary menu, providing the available destinations for that floor. For instance, in the residential scenario described above, the primary menu displays the floors, selecting the 12th floor leads to a secondary menu displaying the various units on the 12th floor, and a second click confirms "1201".

[0118] It should be noted that when the target button is the first floor, the elevator's lift command is generated directly based on the first floor, and the elevator operation is controlled based on the lift command. Determining the target gesture information as a click operation based on the reference direction can be done by referring to the operation in the above embodiment, and will not be repeated here.

[0119] It should be noted that, as described above, the target button can also be used to indicate the destination. In this case, if the target gesture is a click, the passenger's intention can be determined to be to the floor where the destination is located, and the elevator can be controlled based on the second floor. The floor of the destination can be pre-associated, for example, "1201" is associated with the 12th floor, "Shop A" is associated with the 5th floor, and so on.

[0120] It should be noted that when the target gesture information is used to indicate a swipe operation, the user's intention is to navigate to the destination. For example, when performing holographic projection based on the first projection area, the reference direction is vertical. If a horizontal movement is detected, it can be determined as a swipe operation. After determining the swipe operation, the elevator is controlled to move up or down after obtaining the second floor in the above manner. The location of the destination is also fixed, so path planning can be performed based on the target elevator to the destination. Upon reaching the second floor, the target navigation information is played to improve the passenger experience. For example, when the target button is "1201", the target navigation information is "turn left after exiting the elevator, first room". This target navigation information is played upon reaching the 12th floor, allowing passengers unfamiliar with the environment to quickly reach their destination and improving the passenger experience.

[0121] In another embodiment, step S61 may include, but is not limited to, the following steps:

[0122] S611 records the movement trajectory of the target's hand in real time using a target camera;

[0123] S612, when the duration of the target hand's stay exceeds a preset first duration threshold, the three-dimensional coordinates of the target hand's current position are determined as the hand's three-dimensional coordinates;

[0124] S613, obtain the three-dimensional coordinates of each virtual button, determine the target spatial distance between the three-dimensional coordinates of the hand and the three-dimensional coordinates of each button, and determine the virtual button corresponding to the target spatial distance with the smallest value as the candidate button;

[0125] S614, displays candidate keys in a preset first pattern in the key array;

[0126] S615, when the duration of the target hand's continued stay exceeds a preset second duration threshold, the candidate button is determined as the target button;

[0127] S616, when movement of the target hand is detected, the candidate button is re-determined.

[0128] It should be noted that after the target camera is identified, the hand located on the projection array can be identified as the target hand. The movement trajectory of the target hand is tracked to determine the current three-dimensional coordinates of the target hand. Distance is calculated by combining the three-dimensional coordinates of the hand with the three-dimensional coordinates of each button to determine the final target button to be stopped at.

[0129] It should be noted that this embodiment uses a first duration threshold and a second duration threshold to accurately judge the target's hand movements. When the target's hand remains still for more than the first duration threshold, it can be determined that the target's hand has moved to the vicinity of the target button. Based on the distance calculation using three-dimensional coordinates, the closest virtual button is identified as the candidate button. Those skilled in the art are familiar with how to perform distance calculations when two spatial coordinates are available, and will not elaborate further here.

[0130] It should be noted that in this embodiment, the closest button is first identified as a candidate button to avoid the influence of recognition errors on button clicks. After a multi-functional candidate button is selected, it is displayed in a first style, such as displaying a border around the candidate button, enlarging the candidate button, or displaying the candidate button in a color different from other virtual buttons. If the dwell time exceeds a second time threshold, it is identified as the target button. If the button is moved before reaching the second time threshold, it can be determined that the passenger has mistakenly selected the candidate button, and the above judgment is repeated.

[0131] It should be noted that after the target button is identified, the target gesture information is then recognized by the target camera to realize the judgment in subsequent steps S62 to S64.

[0132] In another embodiment, the control system of the target elevator is communicatively connected to the property management system, which has a pre-set database of resident faces. Before executing step S60, the method further includes, but is not limited to, the following steps:

[0133] S51, acquire the second image and the third image, wherein the second image and the third image are captured by the second camera when the elevator door opens, and the third image is captured later than the second image;

[0134] S52, perform face detection in the second image and the third image respectively, and determine the target face image by the face image that is located in both the second image and the third image;

[0135] S53, based on the target face image and the owner face database, perform face recognition to determine the target owner information and obtain the third floor pre-associated with the target owner information;

[0136] S54, based on the preset second style, displays the virtual button corresponding to the third floor in the button array.

[0137] It should be noted that in the property management field, each unit is pre-associated with corresponding owner information. Therefore, after the control system of the target elevator is connected to the property management system, an owner facial database can be pre-set. The target owner information corresponding to the passenger entering the target elevator can be determined through image recognition. The specific facial recognition technology is well known to those skilled in the art and will not be limited here.

[0138] It should be noted that, as Figure 1 As shown in the structure, the second camera 13 shoots towards the elevator door 14. Therefore, the second and third images captured when the elevator door 14 is open can represent the entry and exit of passengers. In the elevator scenario, passengers leaving the elevator can only be photographed from behind, so facial recognition is not possible. Passengers entering the elevator can be photographed from the front, so facial extraction and facial recognition are possible. Based on this, this embodiment identifies passengers whose faces can be recognized in the second and third images as passengers entering the elevator, ensuring the accuracy of subsequent prompts.

[0139] It should be noted that the third image is taken later than the second image. For example, the third image is taken 3 seconds after the second image. The second image is used to identify passengers who are outside the elevator after the elevator door opens. Since there may be too many people in the elevator and not everyone can enter, the third image can be used to exclude passengers who failed to enter the elevator. By taking the intersection of the identified faces in the second and third images, the passengers who entered the elevator when the door opened can be identified, excluding passengers who were already in the elevator before but turned around, thus improving the accuracy of subsequent prompts.

[0140] It should be noted that after identifying the target facial image, the system can determine the target resident's information from the resident's facial database and obtain the corresponding third floor. The virtual button for the third floor is then displayed in the button array in a second style, allowing the resident to quickly select the desired floor and improving the user experience. For example, if the target resident's information is identified as the 5th floor, the virtual button for the 5th floor is enlarged in the button array, making it easier for passengers to click on the 5th floor.

[0141] like Figure 5 As shown, Figure 5 This is a structural diagram of an elevator control device based on holographic projection provided in one embodiment of the present invention. The present invention also provides an elevator control device based on holographic projection, comprising:

[0142] The processor 501 can be implemented using a general-purpose central processing unit (CPU), microprocessor, application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this application.

[0143] The memory 502 can be implemented as a read-only memory (ROM), static storage device, dynamic storage device, or random access memory (RAM). The memory 502 can store the operating system and other applications. When the technical solutions provided in the embodiments of this specification are implemented through software or firmware, the relevant program code is stored in the memory 502 and called and executed by the processor 501 to implement the elevator control method based on holographic projection according to the embodiments of this application.

[0144] The input / output interface 503 is used to implement information input and output;

[0145] The communication interface 504 is used to enable communication and interaction between this device and other devices. Communication can be achieved through wired means (such as USB, Ethernet cable, etc.) or wireless means (such as mobile network, WIFI, Bluetooth, etc.).

[0146] Bus 505 transmits information between various components of the device (e.g., processor 501, memory 502, input / output interface 503, and communication interface 504);

[0147] The processor 501, memory 502, input / output interface 503, and communication interface 504 are connected to each other within the device via bus 505.

[0148] This application also provides an electronic device, including the holographic projection-based elevator control device described above.

[0149] This application embodiment also provides a storage medium, which is a computer-readable storage medium, storing a computer program that, when executed by a processor, implements the above-described elevator control method based on holographic projection.

[0150] Memory, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs and non-transitory computer-executable programs. Furthermore, memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, memory may optionally include memory remotely located relative to the processor, and these remote memories can be connected to the processor via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof. The device embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separate, and may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0151] It will be understood by those skilled in the art that all or some of the steps and systems in the methods disclosed above can be implemented as software, firmware, hardware, and suitable combinations thereof. Some or all of the physical components can be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software can be distributed on a computer-readable medium, which can include computer storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and is accessible to a computer. Furthermore, as is known to those skilled in the art, communication media typically include computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.

[0152] The above provides a detailed description of the preferred embodiments of the present invention. However, the present invention is not limited to the above embodiments. Those skilled in the art can make various equivalent modifications or substitutions without departing from the spirit of the present invention. All such equivalent modifications or substitutions are included within the scope defined by the claims of the present invention.

Claims

1. An elevator control method based on holographic projection, characterized in that, A control system for a target elevator, the target elevator being equipped with a holographic projection module, a first camera, and a second camera, the first camera and the second camera being positioned on the top of the target elevator, the first camera and the holographic projection module being located on one side near the elevator door, and the second camera being located on the side away from the elevator door; the method includes: In response to a button-generated signal, a first image from a top-down view is acquired through the first camera, and the passenger area, the horizontal projection boundary of the holographic projection module, and the first projection area are determined from the first image. Construct a spatial coordinate system and determine the vertex coordinates of each vertex in the first projection region, wherein the vertical coordinate of the vertex coordinates is zero; When the first projection area overlaps with the passenger area, the first projection area is adjusted within the projection boundary based on a preset adjustment strategy. When the first projection area can be adjusted to not overlap with the passenger area, a button array is projected based on the adjusted first projection area, the vertical direction is determined as the reference direction, and the first camera is determined as the target camera, wherein the button array includes multiple virtual buttons; When the first projection area cannot be adjusted to not overlap with the passenger area, the ordinate and vertical coordinate of each vertex coordinate are interchanged to construct a second projection area. The button array is projected based on the second projection area, the horizontal direction is determined as the reference direction, and the second camera is determined as the target camera. The target camera acquires target gesture information, and the target elevator is controlled after the target gesture information is parsed based on the reference direction.

2. The elevator control method based on holographic projection according to claim 1, characterized in that, The projection boundary includes an upper projection boundary, a lower projection boundary, a left projection boundary, and a right projection boundary. The adjustment of the first projection area within the projection boundary based on a preset adjustment strategy includes: The overlapping area between the first projection area and the passenger area is determined. The distance between the lower boundary of the overlapping area and the upper boundary of the first projection area is determined as the first offset. The distance between the upper boundary of the overlapping area and the lower boundary of the first projection area is determined as the second offset. The distance between the left boundary of the overlapping area and the right boundary of the first projection area is determined as the third offset. The distance between the right boundary of the overlapping area and the left boundary of the first projection area is determined as the fourth offset. The distance between the upper boundary of the first projection area and the upper boundary of the projection is determined as a first distance value; the distance between the lower boundary of the first projection area and the lower boundary of the projection is determined as a second distance value; the distance between the left boundary of the first projection area and the left boundary of the projection is determined as a third distance value; and the distance between the right boundary of the first projection area and the right boundary of the projection is determined as a fourth distance value. If the first condition and the second condition are met simultaneously, the first projection area is moved along the vertical axis based on the first offset or the second offset, and the first projection area is moved along the horizontal axis based on the third offset or the fourth offset, so that the passenger area does not overlap with the first projection area. The first condition is that the first distance value is greater than or equal to the first offset, and / or the second distance value is greater than or equal to the second offset. The second condition is that the third distance value is greater than or equal to the third offset, and / or the fourth distance value is greater than or equal to the fourth offset. If the first condition and the second condition are not met simultaneously, the first projection area is rotated 90 degrees along the current plane, and the first offset, the second offset, the third offset, the fourth offset, the first distance value, the second distance value, the third distance value, and the fourth distance value are updated. Then, the movement judgment based on the first condition and the second condition is re-executed.

3. The elevator control method based on holographic projection according to claim 2, characterized in that, After re-executing the move determination based on the first and second conditions, the method further includes: If the updated first projection area fails to simultaneously meet the first condition and the second condition, a preset first adjustment value and a preset second adjustment value are obtained, wherein the first adjustment value is used to indicate the vertical axis length occupied by a single virtual button in the button array, and the second adjustment value is used to indicate the horizontal axis length occupied by a single virtual button in the button array. The smaller of the first offset and the second offset is divided by the first adjustment value to determine the first quantity, and the smaller of the third offset and the fourth offset is divided by the second adjustment value to determine the second quantity. If the updated first projection area satisfies the first condition but does not satisfy the second condition, the vertical axis length of the first projection area is increased and the horizontal axis length of the first projection area is decreased based on the second quantity and the second adjustment value. Alternatively, if the first projection area satisfies the second condition but does not satisfy the first condition, the horizontal axis length of the first projection area is increased and the vertical axis length of the first projection area is decreased based on the first quantity and the first adjustment value. If the updated first projection area does not meet both the first and second conditions, the first projection area is restored, and the adjustment judgment based on the first and second quantities is re-executed.

4. The elevator control method based on holographic projection according to claim 3, characterized in that, After re-executing the adjustment judgment based on the first quantity and the second quantity, the method further includes: If the first condition and the second condition still cannot be met simultaneously, a preset area threshold is obtained, wherein the area threshold is used to indicate the minimum projected area of ​​the button array; The first projection area is scaled, and the first offset, second offset, third offset, fourth offset, first distance value, second distance value, third distance value and fourth distance value are updated in real time during the scaling process, and it is determined whether the first condition and the second condition are met; If the first condition and the second condition are simultaneously satisfied before the first projection area is scaled to the area threshold, the current first projection area is moved so that the first projection area does not overlap with the passenger area. When the first projection area is scaled to the area threshold, if the first condition and the second condition are not simultaneously met, the first projection area is rotated 90 degrees and the scaling judgment based on the area threshold is re-executed.

5. The elevator control method based on holographic projection according to claim 1, characterized in that, The step of controlling the target elevator after parsing the target gesture information based on the reference direction includes: Determine the target button corresponding to the target gesture information; When the target button is used to indicate the first floor, and the target gesture information is determined to be a click operation based on the reference direction, the target elevator is controlled to perform lifting and lowering operations based on the first floor. Alternatively, when the target button is used to indicate the destination, and the target gesture information is determined to be a click operation based on the reference direction, the second floor pre-associated with the destination is determined, and the target elevator is controlled to perform lifting and lowering operations based on the second floor; Alternatively, when the target button is used to indicate the destination, and the target gesture information is determined based on the reference direction to indicate a swipe operation with the target button as the endpoint, the target elevator is controlled to perform a lifting operation based on the second floor, and target navigation information is played after reaching the second floor, wherein the target navigation information is used to indicate the navigation path of the target elevator to the destination.

6. The elevator control method based on holographic projection according to claim 5, characterized in that, Determining the target button corresponding to the target gesture information includes: The target camera records the movement trajectory of the target's hand in real time. When the duration of the target hand's stay exceeds a preset first duration threshold, the three-dimensional coordinates of the target hand's current position are determined as the hand's three-dimensional coordinates. Obtain the three-dimensional coordinates of each virtual button, determine the target spatial distance between the three-dimensional coordinates of the hand and the three-dimensional coordinates of each button, and determine the virtual button corresponding to the target spatial distance with the smallest value as a candidate button; The candidate buttons are displayed in the button array in a preset first style; When the duration of the target hand's continued lingering exceeds a preset second duration threshold, the candidate button is determined as the target button; Alternatively, when movement of the target hand is detected, the candidate button can be re-determined.

7. The elevator control method based on holographic projection according to claim 1, characterized in that, The control system of the target elevator is communicatively connected to the property management system, which has a pre-set database of resident faces. Before acquiring the target gesture information through the target camera, the method further includes: Acquire a second image and a third image, wherein the second image and the third image are captured by the second camera when the elevator door opens, and the third image is captured later than the second image; Face detection is performed in the second image and the third image respectively, and the face images that are simultaneously located in the second image and the third image are used to determine the target face image; Based on the target face image and the owner face database, face recognition is performed to determine the target owner information, and the third floor pre-associated with the target owner information is obtained; The virtual button corresponding to the third floor is displayed in the button array based on a preset second style.

8. An elevator control device based on holographic projection, characterized in that, It includes at least one control processor and a memory for communicatively connecting to the at least one control processor; the memory stores instructions executable by the at least one control processor, which, when executed by the at least one control processor, enable the at least one control processor to perform the holographic projection-based elevator control method as described in any one of claims 1 to 7.

9. An electronic device, characterized in that, Includes the elevator control device based on holographic projection as described in claim 8.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions for causing a computer to perform the elevator control method based on holographic projection as described in any one of claims 1 to 7.

Citation Information

Patent Citations

  • Projection interaction method, projection interaction device and intelligent terminal

    CN106774827A

  • A virtual elevator interaction system and method based on deep learning

    CN109934105A