Wireless remote control face recognition and remote hierarchical management control method and system

Abstract

The invention relates to the technical field of elevator hierarchical management, and discloses a wireless remote control face recognition and remote hierarchical management control method and system.The wireless remote control face recognition and remote hierarchical management control method comprises the steps that the age and gender of a user in a user image are recognized through a face classification model, and carried objects and the identity of the user in the user image are recognized through a target classification model; users are classified according to user ages, user genders, carried objects and user identities, classified users are obtained, the number of halfway pauses before the elevator module picks up and sends the classified users is analyzed, the waiting duration and the number of passengers needing to be taken together of the elevator module are calculated according to the number of halfway pauses, and target elevators meeting user requirements are determined; detecting whether the classified user arrives at an elevator waiting area of the target elevator within a preset time period or not; the classified users are conveyed to the target floor through the target elevator; and the classified users are conveyed to the target floor through the actual elevator corresponding to the actual waiting area. According to the invention, the user can quickly enter the elevator, and the user is not disturbed by too many people.

Description

Technical Field

[0001] The invention relates to a wireless remote control face recognition and remote hierarchical management control method and system, belonging to the technical field of elevator hierarchical management. Background Art

[0002] Nowadays, wireless remote control face recognition refers to the installation of a face recognition device with wireless remote control function at the elevator door to perform face recognition on users waiting for the elevator. The wireless remote control function refers to the remote control function that uses radio signals to control various remote mechanisms. Remote hierarchical management control refers to the transmission of data monitored during the operation of the elevator to the remote control center, which analyzes the data and sends control instructions to the elevator end.

[0003] At present, the existing elevator hierarchical management means that after facial recognition of the user's facial information waiting to go upstairs on the first floor, the floor where the user lives corresponding to the user's facial information is queried in the background, and the elevator takes the user to the floor where he lives. The user does not need to choose which floor to go to. Instead, the elevator automatically takes the user to the floor where he lives based on the pre-stored information, thereby realizing hierarchical management. However, if there is more than one elevator room on each floor, how to choose which elevator to enter first for the user, so that the user can enter the elevator quickly and meet the user's demand of not wanting to be disturbed by too many people is a problem that needs to be solved urgently. Summary of the invention

[0004] The present invention provides a wireless remote control face recognition and remote hierarchical management control method and system, the main purpose of which is to enable users to quickly enter the elevator and meet the needs of users who do not want to be disturbed by too many people.

[0005] To achieve the above-mentioned purpose, the present invention provides a wireless remote control face recognition and remote hierarchical management control method, comprising: Determine a hierarchical control system for a floor, wherein the hierarchical control system includes an elevator module, an image recognition module, and a remote control center, and the face recognition module includes a camera, a face classification model, and a target classification model; The camera collects user images of users on the floor, identifies the user age and gender in the user images by the face classification model, and identifies the carried objects and user identities in the user images by the object classification model; In the remote control center, the user is classified by using the user age, the user gender, the carried object and the user identity to obtain the classified users, and the user requirements of the classified users are obtained, wherein the user requirements include the waiting time requirement and the number of passengers, and the target floor of the classified users is queried; In the remote control center, the number of stops before the elevator module picks up the classified user is analyzed, and the waiting time and the number of passengers required for the elevator module are calculated using the number of stops. According to the waiting time and the number of passengers required, a target elevator that meets the user's needs is determined, and it is detected whether the classified user arrives at the elevator waiting area of ​​the target elevator within a preset time period; When the classified user arrives at the elevator waiting area of ​​the target elevator within a preset time period, the classified user is transported to the target floor by the target elevator, so as to complete the remote hierarchical management and control of the elevator module by the remote control center, and obtain a first remote hierarchical management and control result; When the classified user does not arrive at the elevator waiting area of ​​the target elevator within the preset time period, query the actual waiting area where the classified user is located, and transport the classified user to the target floor through the actual elevator corresponding to the actual waiting area, so as to complete the remote hierarchical management and control of the elevator module by the remote control center, and obtain a second remote hierarchical management and control result; The first remote hierarchical management control result and the second remote hierarchical management control result are used as the final remote hierarchical management control result of the remote control center on the elevator module.

[0006] Optionally, identifying the user age and the user gender in the user image by using the face classification model includes: Extracting attention features of the user image according to the channel attention mechanism in the face classification model; Outputting the user age in the user image using a long short-term memory network in the face classification model according to the attention feature; According to the attention feature, the BP neural network in the face classification model is used to output the user gender in the user image.

[0007] Optionally, the identifying the carried object and the user identity in the user image by using the target classification model includes: Identify the image target in the user image by using the target classification model; Removing background objects in a preset background image from the image objects to obtain a foreground object; Querying the target area of ​​the foreground target; When the target area is larger than a preset area, determining whether the foreground target is a first special target; When the foreground object is a first special object, determining a user identity in the user image; When the foreground object is not the first special object, determining whether the foreground object is the second special object; When the foreground object is not the second special object, the foreground object is regarded as a carried object.

[0008] Optionally, the classifying the users by using the user age, the user gender, the carried objects and the user identity to obtain classified users includes: Determine a first category of users and a second category of users among the users by using the user age and the user identity; Determine a third category of users among the users by using the user gender and the user age; Determining a fourth category of users among the users by using the carried objects; The first category of users, the second category of users, the third category of users and the fourth category of users are regarded as classified users.

[0009] Optionally, the analyzing the number of stops before the elevator module picks up the classified user includes: Collecting user pick-up and drop-off data of the elevator module in a historical period; Calculating the historical stop probability of the elevator module according to the user pick-up and drop-off data; Calculating the probability of midway users of the elevator module according to the user pick-up and drop-off data; Calculate the probability of simultaneous occurrence of the historical pause probability and the midway user probability; Selecting a high simultaneous occurrence probability greater than a preset probability value from the simultaneous occurrence probabilities; The number of floors corresponding to the high simultaneous occurrence probability is taken as the number of pauses.

[0010] Optionally, the step of calculating the waiting time and the number of passengers required for the elevator module by using the number of pauses includes: Based on the number of pauses, calculating the waiting time for the elevator module to go down; Calculate the waiting time for the elevator module to go up; The downlink waiting time and the uplink waiting time are used as the required waiting time; Based on the number of midway stops, calculating the number of passengers required to travel down the elevator module; The number of people in the waiting area of ​​the elevator module is used as the number of passengers required to go up the elevator module; The number of people required to travel together on the downward journey and the number of people required to travel together on the upward journey are taken as the number of people required to travel together.

[0011] Optionally, determining a target elevator that meets the user's needs according to the required waiting time and the number of passengers required to travel together includes: Obtaining the waiting time requirement and the number of passengers required in the user's requirements; Classifying the waiting time requirements into waiting time levels; Classifying the number of passengers into different levels according to the number of passengers required; Comparing the waiting time level with the number of passengers, and obtaining a level comparison result; Based on the level comparison result, determining the priority between the waiting time and the number of passengers required; According to the arrangement priority, a first target value and a second target value are selected from the required waiting time and the required number of passengers; sorting the elevator set corresponding to the elevator module by using the first target value to obtain a first sequence; Using the second target value to perform elevator sorting on the first sequence to obtain a second sequence; The first elevator is selected from the second sequence to obtain the target elevator.

[0012] Optionally, transporting the classified user to the target floor by the target elevator includes: When the classified user needs to go down, after the classified user is received by the target elevator, it is detected whether there is an intermediate user in the down-going process; After receiving the intermediate user through the target elevator, the classified user and the intermediate user are transported to the target floor, so as to complete the process of transporting the classified user to the target floor through the target elevator; When the classified user needs to go up, the classified user is transported to the target floor by the target elevator.

[0013] Optionally, the transporting the classified user to the target floor by using an actual elevator corresponding to the actual waiting area includes: When the classified user needs to go down, wait for the actual elevator to arrive at the current floor of the classified user; After the actual elevator receives the classified user at the current floor, it determines whether an online request sent by the remote control center is received; When receiving an online request from a remote control center, processing the online request through the actual elevator; When the online request is successfully processed by the actual elevator, the classified user is transported to the target floor by the actual elevator; When no online request is received from the remote control center, the classified user is transported to the target floor by the actual elevator; When the classified user needs to go up, wait for the actual elevator to arrive at the current floor of the classified user; After the actual elevator receives the classified user at the current floor, the classified user is transported to the target floor by the actual elevator based on the user floor number in the actual elevator.

[0014] In order to solve the above problems, the present invention also provides a wireless remote control face recognition and remote hierarchical management control system, the system comprising: A system determination module, used to determine a hierarchical control system of a floor, wherein the hierarchical control system includes an elevator module, an image recognition module and a remote control center, and the face recognition module includes a camera, a face classification model and a target classification model; An identity recognition module, used to collect user images of users on the floor through the camera, identify the user's age and gender in the user image through the face classification model, and identify the carried objects and user identity in the user image through the target classification model; A floor query module is used to classify the users in the remote control center by using the user age, the user gender, the carried objects and the user identity to obtain the classified users, obtain the user requirements of the classified users, wherein the user requirements include the waiting time requirement and the number of passengers, and query the target floor of the classified users; A user detection module is used to analyze the number of pauses before the elevator module picks up the classified user in the remote control center, calculate the waiting time and the number of passengers required for the elevator module by using the number of pauses, determine the target elevator that meets the user's needs according to the waiting time and the number of passengers required, and detect whether the classified user arrives at the elevator waiting area of ​​the target elevator within a preset time period; A first management module is used to transport the classified user to the target floor through the target elevator when the classified user arrives at the elevator waiting area of ​​the target elevator within a preset time period, so as to complete the remote hierarchical management control of the elevator module by the remote control center and obtain a first remote hierarchical management control result; The second management module is used to query the actual waiting area where the classified user is located when the classified user fails to arrive at the elevator waiting area of ​​the target elevator within a preset time period, and transport the classified user to the target floor through the actual elevator corresponding to the actual waiting area, so as to complete the remote hierarchical management control of the elevator module by the remote control center, and obtain a second remote hierarchical management control result; The final management module is used to use the first remote hierarchical management control result and the second remote hierarchical management control result as the final remote hierarchical management control result of the remote control center on the elevator module.

[0015] Compared with the problems described in the background technology, the embodiment of the present invention recognizes the user's age and gender in the user image through the face classification model to identify children, the elderly and women. The embodiment of the present invention recognizes the carried objects and user identity in the user image through the target classification model to identify whether the user is physically disabled and whether the object carried by the user is too large. The embodiment of the present invention classifies the users by using the user's age, the user's gender, the carried objects and the user's identity to divide the users into different categories of people, and assigns different elevators to each category of people, thereby realizing elevator stratification for different types of users. Management, the embodiment of the present invention analyzes the number of pauses before the elevator module picks up the classified users to analyze the number of users that the elevator will receive during the downward process from top to bottom. Further, the embodiment of the present invention calculates the waiting time and the number of passengers required for the elevator module by using the number of pauses to analyze how long the user needs to wait before the elevator receives the user and how many people will ride the elevator with him. Further, the embodiment of the present invention determines the target elevator that meets the user's needs based on the waiting time and the number of passengers required to ride the elevator, so as to formulate personalized elevator scheduling plans for different categories of users according to the needs of different categories of users. Therefore, the wireless remote control face recognition and remote hierarchical management control method and system provided by the embodiment of the present invention can enable users to quickly enter the elevator and meet the needs of users who do not want to be disturbed by too many people. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 A flowchart of a wireless remote control face recognition and remote hierarchical management control method provided by an embodiment of the present invention; Figure 2 A schematic diagram of modules for implementing the wireless remote control face recognition and remote hierarchical management control system provided in one embodiment of the present invention.

[0017] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings in conjunction with the embodiments. DETAILED DESCRIPTION

[0018] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0019] The embodiment of the present application provides a wireless remote control face recognition and remote hierarchical management control method. The execution subject of the wireless remote control face recognition and remote hierarchical management control method includes but is not limited to at least one of the electronic devices such as a server and a terminal that can be configured to execute the method provided by the embodiment of the present application. In other words, the wireless remote control face recognition and remote hierarchical management control method can be executed by software or hardware installed on a terminal device or a server device. The server includes but is not limited to: a single server, a server cluster, a cloud server or a cloud server cluster, etc.

[0020] Embodiment 1: Reference Figure 1 FIG. 1 is a flow chart of a wireless remote control face recognition and remote hierarchical management control method provided by an embodiment of the present invention. In this embodiment, the wireless remote control face recognition and remote hierarchical management control method includes: S1. Determine a hierarchical control system for each floor, wherein the hierarchical control system includes an elevator module, an image recognition module, and a remote control center, and the face recognition module includes a camera, a face classification model, and a target classification model.

[0021] In an embodiment of the present invention, the elevator module includes the elevator itself and a data processor that receives instructions from a remote control center. The data processor is mainly used to convert a request from the remote control center to pick up a user into a control instruction of the elevator, and control the elevator to go up and down, arrive at the floor where the user is located, etc. The remote control center is used to process the monitored elevator data and the monitoring data, wherein the monitoring data is mainly realized by a camera. It should be noted that there is more than one elevator room on each floor, and there will be a camera at the door of each elevator room facing the user standing at the door. For example, there are 4 elevator rooms on the second floor, and there are 4 corresponding cameras. Each camera only collects image data of its corresponding elevator waiting area, and the elevator waiting area is the area in front of the elevator door.

[0022] S2. Collect user images of users on the floor through the camera, identify the user age and user gender in the user image through the face classification model, and identify the carried objects and user identity in the user image through the target classification model.

[0023] In the embodiment of the present invention, the user image refers to the image data in front of the elevator door, including the user's entire body, objects carried by the user, and the like.

[0024] Furthermore, the embodiment of the present invention recognizes the user age and the user gender in the user image through the face classification model, so as to identify children, the elderly and women.

[0025] In one embodiment of the present invention, identifying the user age and the user gender in the user image by the face classification model includes: extracting the attention feature of the user image using the following formula according to the channel attention mechanism in the face classification model: in, Represents the attention feature, Indicates that the number of channels obtained by compressing the user image is , height is , width is images, represents the maximum pooling operation, Indicates the size images, represents the fully connected layer, represents the linear rectification function, represents the activation function; According to the attention feature, the long short-term memory network in the face classification model is used to output the user age in the user image; according to the attention feature, the BP neural network in the face classification model is used to output the user gender in the user image.

[0026] Optionally, the process of outputting the user age in the user image according to the attention feature using the long short-term memory network in the face classification model refers to using the attention feature as input data of the long short-term memory network, and the long short-term memory network outputs the age data. Furthermore, the process of outputting the user gender in the user image according to the attention feature using the BP neural network in the face classification model refers to using the attention feature as input data of the BP neural network, and the BP neural network outputs the age data.

[0027] Furthermore, the embodiment of the present invention recognizes the carried objects and the identity of the user in the user image through the target classification model to identify whether the user is physically disabled and whether the object carried by the user is too large.

[0028] In one embodiment of the present invention, the identifying of the carried object and the user identity in the user image by the target classification model includes: identifying the image target in the user image by the target classification model; removing the background target in the preset background image from the image target to obtain the foreground target; querying the target area of ​​the foreground target; when the target area is larger than the preset area, determining whether the foreground target is a first special target; when the foreground target is the first special target, determining the user identity in the user image; when the foreground target is not the first special target, determining whether the foreground target is a second special target; when the foreground target is not the second special target, treating the foreground target as a carried object.

[0029] Among them, the target classification model refers to the YOLOV5 target detection model, the image targets include objects such as clothing in the image, objects held by the user, shoes, cleaning tools in the background, etc., the preset background image refers to a pure background image without other people or objects opposite the elevator pre-entered in the system, such as a background image containing only cleaning tools, the target area refers to the area occupied by the target object in the image, the preset area refers to a pre-set area threshold that can be used to determine that an object is a large object. For example, the area of ​​the user's earrings is used as the preset area. When the target area is larger than the preset area, it indicates that the object is large. The first special target refers to auxiliary tools for disabled people such as crutches and wheelchairs, the user identity refers to the identity of the disabled person, and the second special target refers to targets such as clothing and shoes worn by the user that are not external objects carried by the user.

[0030] S3. In the remote control center, the users are classified according to their age, gender, carried objects and identities to obtain classified users, and user needs of the classified users are acquired, wherein the user needs include waiting time requirements and number of passengers, and the target floor of the classified users is queried.

[0031] The embodiment of the present invention classifies the users by using the user age, the user gender, the carried objects and the user identity, so as to divide the users into different categories of people, and assigns different elevators to each category of people, thereby realizing hierarchical management of elevators for different categories of users.

[0032] In one embodiment of the present invention, the user is classified by using the user age, the user gender, the carried object and the user identity to obtain classified users, including: using the user age and the user identity to determine the first category of users and the second category of users among the users; using the user gender and the user age to determine the third category of users among the users; using the carried object to determine the fourth category of users among the users; and using the first category of users, the second category of users, the third category of users and the fourth category of users as classified users.

[0033] Among them, the first category of users refers to users who are not elderly and are inconvenient users, the second category of users refers to elderly users who are convenient users, the third category of users refers to adult women and children who appear at the same time, and when the image area where the child is located in the image does not touch the ground and is in contact with the image area of ​​the adult woman, it means that the woman is holding a child, and the fourth category of users refers to users holding large objects. By pre-setting the area threshold of the target image, large-area carried objects are screened, and users holding large-area carried objects are regarded as the fourth category of users, and in the aforementioned image target, the carried objects do not touch the ground but touch the user.

[0034] Furthermore, in an embodiment of the present invention, the user demand refers to the user's waiting time demand and the number of passengers demand. The waiting time demand refers to the elevator waiting time that the user can tolerate as determined by a questionnaire survey of the users. The number of passengers demand refers to the number of other users who can ride in the same elevator that the user can tolerate as determined by a questionnaire survey of the users. For example, the demand of young users with physical disabilities is to reduce the attention of other users, then the number of passengers demand is to reduce the number of passengers as much as possible. The target floor refers to the floor that the user needs to reach, mainly including the floor where the users on the first floor live and the floor where the users live to go to the first floor.

[0035] S4. In the remote control center, the number of pauses of the elevator module before picking up the classified user is analyzed, and the waiting time and the number of passengers required of the elevator module are calculated using the number of pauses. According to the waiting time and the number of passengers required, a target elevator that meets the user's needs is determined, and it is detected whether the classified user arrives at the elevator waiting area of ​​the target elevator within a preset time period.

[0036] The embodiment of the present invention analyzes the number of stops before the elevator module picks up the classified users, so as to analyze the number of users that the elevator will receive during the downward process from top to bottom.

[0037] In one embodiment of the present invention, the analyzing the number of stops before the elevator module picks up the classified user includes: collecting user pick-up and drop-off data of the elevator module in a historical period; and calculating the historical stop probability of the elevator module according to the user pick-up and drop-off data using the following formula: in, represents the historical pause probability, Indicates the number of users in the pick-up and drop-off data. The elevator passes through the The number of floors, Indicates the user pick-up data The elevator passes through the Number of pauses when climbing floors; According to the user pick-up data, the intermediate user probability of the elevator module is calculated using the following formula: in, represents the probability of midway users, Indicates the number of users in the pick-up and drop-off data. Elevator arrives at The total number of people in the elevator waiting area in front of the floor, Indicates the number of users in the pick-up and drop-off data. Elevator arrives at The number of users who did not move to the waiting area before the floor; The probability of simultaneous occurrence of the historical pause probability and the midway user probability is calculated using the following formula: in, represents the probability of simultaneous occurrence, represents the historical pause probability, represents the probability of midway users, represents the number of sample days in the user pick-up and drop-off data, Represents the index of each day; A high simultaneous occurrence probability greater than a preset probability value is selected from the simultaneous occurrence probabilities; and the number of floors corresponding to the high simultaneous occurrence probability is used as the number of pauses.

[0038] It should be noted that the historical period refers to a long period, such as a period of one month. The time period refers to the daily time period, such as the time period from 9 to 10 every day. The elevator passes through the The number of pauses at each floor refers to the number of times the elevator opens its door to receive the first The number of floor users is counted , When waiting for data, if there are multiple elevator rooms on a floor, all elevator rooms will be counted. , The data such as the probability of midway users refers to the probability of users received midway when the elevator is descending, excluding users received on the way up. When the elevator is about to reach the user's current floor and is about to receive users, if the user still stands there waiting for the slow elevator in front of him instead of the fast elevator arriving at the surrounding area, then these users will be regarded as users who do not listen to the system instructions. In other words, the probability of midway users refers to the probability that the user still insists on waiting for the elevator when a designated elevator is recommended to the user in the future. When such users are encountered during the elevator's descent, the door needs to be opened to receive such users. There is no need to receive users midway on the way up. The preset probability value refers to a preset threshold value, which has different values ​​in different scenarios and needs to be set according to the actual scenario. It will not be repeated here. The number of floors refers to For example, there are three high simultaneous occurrence probabilities, and these three high simultaneous occurrence probabilities correspond to three different , then the number of floors is three.

[0039] Furthermore, the embodiment of the present invention calculates the waiting time and the number of passengers required for the elevator module by using the number of pauses, so as to analyze how long the user needs to wait before the elevator receives the user and how many people will ride the elevator with him.

[0040] In one embodiment of the present invention, the method of calculating the waiting time required for the elevator module and the number of passengers required by the elevator module using the number of pauses includes: calculating the waiting time required for the elevator module to go down based on the number of pauses using the following formula: in, Indicates the waiting time for downlink. Indicates between two floors The height that never stops, Indicates between two floors The average rate of descent without pause, Indicates the initial floor of the elevator module. Indicates the initial floor of the elevator module To the floor the user is currently waiting for The sequence number set between the two floors that will not stop, express To the floor the user is currently waiting for The number of pauses between the floors corresponds to the set, represents the probability of simultaneous occurrence, Indicates a high probability of simultaneous occurrence, The index of the time period. Indicates Floor and The height between floors, Indicates Floor and The average descent speed between floors, Indicates the floor index corresponding to the high probability of simultaneous occurrence; The following formula is used to calculate the waiting time for the elevator module to go up: in, Indicates the waiting time for uplink. Indicates that the elevator starts from the initial floor To the floor the user is currently waiting for Between every two floors The height that never stops, Indicates that the elevator starts from the initial floor To the floor the user is currently waiting for Between every two floors The average ascent speed without pause, Indicates that the elevator starts from the initial floor To the floor the user is currently waiting for Between every two floors A collection of Indicates that when there is a user in the elevator who needs to go to the Floor, Floor and The height between floors, Indicates that when there is a user in the elevator who needs to go to the Floor, Floor and The average speed of ascent between floors, Indicates the set of floors that the user needs to reach in the elevator; The waiting time required for going down and the waiting time required for going up are taken as the required waiting time; based on the number of pauses, the number of passengers required for going down of the elevator module is calculated using the following formula: in, Indicates the number of passengers required for the downlink trip. Indicates Time period Floor below , and it is the floor corresponding to the high probability of simultaneous occurrence, the average number of users who did not move to the waiting area, Indicates the floor the user is currently waiting for The set of floors corresponding to the number of stops between the start and end of the journey to the 1st floor; The number of people in the waiting area of ​​the elevator module is used as the number of people required to travel together on the upward journey of the elevator module; the number of people required to travel together on the downward journey and the number of people required to travel together on the upward journey are used as the number of people required to travel together.

[0041] The waiting time for descending refers to the waiting time when the elevator is above the floor where the user is located and needs to descend to receive the user. No pause means that there are no users on the lower floors between every two floors who need to be received by the elevator. For example, if a building is 6 stories high, there are no users on the lower floors between the 1st and 2nd floors, between the 2nd and 3rd floors, between the 3rd and 4th floors, between the 4th and 5th floors, and between the 5th and 6th floors. When the user is on the 3rd floor, there is a user on the 4th floor who needs to be received, that is The value of is 4, then the elevator will slow down between the 4th and 5th floors when descending and stop at the 4th floor. It will also slow down between the 3rd and 4th floors. Therefore, the average descent speed is determined by the average of the changes in the speed of the elevator when it encounters the stop floor in the historical period. The initial floor refers to the floor above the floor where the elevator is located. The waiting time for going up refers to the waiting time when the elevator is below the floor where the user is located and needs to go up to receive the user. The value of Sure.

[0042] Furthermore, the embodiment of the present invention determines a target elevator that meets the user's needs according to the waiting time and the number of passengers required, so as to formulate personalized elevator scheduling plans for different categories of users according to the needs of different categories of users.

[0043] In one embodiment of the present invention, determining a target elevator that meets the user's needs based on the required waiting time and the required number of passengers includes: obtaining the waiting time requirement and the number of passengers requirement in the user's needs; dividing the waiting time requirement into waiting time levels; dividing the number of passengers requirement into number of passengers levels; comparing the waiting time levels with the number of passengers levels to obtain a level comparison result; determining an arrangement priority between the required waiting time and the required number of passengers based on the level comparison result; selecting a first target value and a second target value from the required waiting time and the required number of passengers based on the arrangement priority; sorting the elevator set corresponding to the elevator module using the first target value to obtain a first sequence; sorting the elevators in the first sequence using the second target value to obtain a second sequence; and selecting the first elevator from the second sequence to obtain a target elevator.

[0044] Among them, the waiting time level and the number of passengers level both include low, medium and high levels. For example, the waiting time requirement is 30 minutes. Since 30 minutes is a long time, the waiting time requirement is classified as a low level, that is, the user's demand for waiting time is not high. The number of passengers required is 1 person, which means that the user only accepts 1 extra person to travel with him, which means that the user has a high demand for the number of passengers, and the number of passengers is classified as a high level. The arrangement priority means that low-level demands are arranged first. The first target value refers to a lower-level demand, and the second target value refers to a higher-level demand. The first sequence refers to a sequence of different elevator rooms on the same floor arranged in ascending order according to the first target value. The second sequence refers to a sequence of different elevator rooms on the same floor arranged in ascending order according to the second target value. The first elevator refers to the first elevator in the second sequence.

[0045] S5. When the classified user arrives at the elevator waiting area of ​​the target elevator within a preset time period, the classified user is transported to the target floor by the target elevator to complete the remote hierarchical management and control of the elevator module by the remote control center, and obtain a first remote hierarchical management and control result.

[0046] In the embodiment of the present invention, the preset time period is a value pre-set according to an actual scenario. For example, in a community with a large number of people, the preset time period is set to 5 minutes.

[0047] In one embodiment of the present invention, the transporting of the classified users to the target floor by the target elevator includes: when the classified users need to go down, after receiving the classified users by the target elevator, detecting whether there are midway users during the downlink process; after receiving the midway users by the target elevator, transporting the classified users and the midway users to the target floor to complete the process of transporting the classified users to the target floor by the target elevator; when the classified users need to go up, transporting the classified users to the target floor by the target elevator.

[0048] The intermediate user refers to the user in the downlink process. Elevator arrival time There is no movement of users in the waiting area before the floor.

[0049] S6. When the classified user fails to arrive at the elevator waiting area of ​​the target elevator within the preset time period, the actual waiting area where the classified user is located is queried, and the classified user is transported to the target floor through the actual elevator corresponding to the actual waiting area, so as to complete the remote hierarchical management and control of the elevator module by the remote control center, and obtain a second remote hierarchical management and control result.

[0050] In one embodiment of the present invention, the classified user is transported to the target floor by the actual elevator corresponding to the actual waiting area, including: when the classified user needs to go down, waiting for the actual elevator to arrive at the current floor of the classified user; when the actual elevator receives the classified user at the current floor, determining whether an online request from a remote control center is received; when the online request from the remote control center is received, processing the online request by the actual elevator; when the online request is successfully processed by the actual elevator, transporting the classified user to the target floor by the actual elevator; when the online request from the remote control center is not received, transporting the classified user to the target floor by the actual elevator; when the classified user needs to go up, waiting for the actual elevator to arrive at the current floor of the classified user; when the actual elevator receives the classified user at the current floor, based on the user floor number in the actual elevator, transporting the classified user to the target floor by the actual elevator.

[0051] Among them, the current floor refers to the floor where the user is waiting for the elevator, and the online request refers to the request that the actual elevator needs to be given priority after the new user is analyzed by the system and the system assigns the current actual elevator to the system. The users whose requests are given priority are the users who have moved in the waiting area, and the classified users in the actual waiting area are the users who have not moved in the waiting area.

[0052] Optionally, the process of transporting the classified users to the target floor through the actual elevator based on the user floor number in the actual elevator means that when the elevator transports the user from the first floor upwards, the doors are opened on designated floors in order from small to large according to the floor numbers to let the users through, and the designated floor refers to the floor where the user lives determined after the system recognizes the user's residential information through facial recognition.

[0053] S7. Using the first remote hierarchical management control result and the second remote hierarchical management control result as the final remote hierarchical management control result of the remote control center on the elevator module.

[0054] Compared with the problems described in the background technology, the embodiment of the present invention recognizes the user's age and gender in the user image through the face classification model to identify children, the elderly and women. The embodiment of the present invention recognizes the carried objects and user identity in the user image through the target classification model to identify whether the user is physically disabled and whether the object carried by the user is too large. The embodiment of the present invention classifies the users by using the user's age, the user's gender, the carried objects and the user's identity to divide the users into different categories of people, and assigns different elevators to each category of people, thereby realizing elevator stratification for different types of users. Management, the embodiment of the present invention analyzes the number of pauses before the elevator module picks up the classified users to analyze the number of users that the elevator will receive during the downward process from top to bottom. Further, the embodiment of the present invention calculates the waiting time and the number of passengers required for the elevator module by using the number of pauses to analyze how long the user needs to wait before the elevator receives the user and how many people will ride the elevator with him. Further, the embodiment of the present invention determines the target elevator that meets the user's needs based on the waiting time and the number of passengers required to ride the elevator, so as to formulate personalized elevator scheduling plans for different categories of users according to the needs of different categories of users. Therefore, the wireless remote control face recognition and remote hierarchical management control method and system provided by the embodiment of the present invention can enable users to quickly enter the elevator and meet the needs of users who do not want to be disturbed by too many people.

[0055] Embodiment 2: like Figure 2 The figure shows a functional module diagram of a wireless remote control face recognition and remote hierarchical management control system of the present invention.

[0056] The wireless remote control face recognition and remote hierarchical management control system 200 of the present invention can be installed in an electronic device. According to the functions to be implemented, the wireless remote control face recognition and remote hierarchical management control system can include a system determination module 201, an identity recognition module 202, a floor query module 203, a user detection module 204, a first management module 205, a second management module 206 and a final management module 207. The module of the present invention can also be called a unit, which refers to a series of computer program segments that can be executed by an electronic device processor and can complete fixed functions, which are stored in the memory of the electronic device.

[0057] In the embodiment of the present invention, the functions of each module / unit are as follows: The system determination module 201 is used to determine the hierarchical control system of the floor, wherein the hierarchical control system includes an elevator module, an image recognition module and a remote control center, and the face recognition module includes a camera, a face classification model and a target classification model; The identity recognition module 202 is used to collect user images of users on the floor through the camera, identify the user age and user gender in the user image through the face classification model, and identify the carried objects and user identity in the user image through the object classification model; The floor query module 203 is used to classify the users in the remote control center by using the user age, the user gender, the carried objects and the user identity to obtain the classified users, obtain the user requirements of the classified users, wherein the user requirements include the waiting time requirement and the number of passengers, and query the target floor of the classified users; The user detection module 204 is used to analyze the number of stops before the elevator module picks up the classified user in the remote control center, calculate the waiting time and the number of passengers required for the elevator module based on the number of stops, determine the target elevator that meets the user's needs based on the waiting time and the number of passengers required, and detect whether the classified user arrives at the elevator waiting area of ​​the target elevator within a preset time period; The first management module 205 is used to transport the classified user to the target floor through the target elevator when the classified user arrives at the elevator waiting area of ​​the target elevator within a preset time period, so as to complete the remote hierarchical management control of the elevator module by the remote control center and obtain a first remote hierarchical management control result; The second management module 206 is used to query the actual waiting area where the classified user is located when the classified user does not arrive at the elevator waiting area of ​​the target elevator within a preset time period, and transport the classified user to the target floor through the actual elevator corresponding to the actual waiting area, so as to complete the remote hierarchical management control of the elevator module by the remote control center, and obtain a second remote hierarchical management control result; The final management module 207 is used to use the first remote hierarchical management control result and the second remote hierarchical management control result as the final remote hierarchical management control result of the remote control center on the elevator module.

[0058] In detail, the modules in the wireless remote control face recognition and remote hierarchical management control system 200 in the embodiment of the present invention are used in the same manner as described above. Figure 1 The wireless remote control face recognition described in the text is the same technical means as the remote hierarchical management control method, and can produce the same technical effects, so it will not be repeated here.

[0059] It is obvious to those skilled in the art that the present invention is not limited to the details of the above exemplary embodiments, and that the present invention can be implemented in other specific forms without departing from the spirit or essential characteristics of the present invention.

[0060] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solution of the present invention can be modified or replaced by equivalents without departing from the spirit and scope of the technical solution of the present invention.

Claims

1. A wireless remote control face recognition and remote hierarchical management control method, characterized in that: The method comprises: Determine a hierarchical control system for a floor, wherein the hierarchical control system includes an elevator module, an image recognition module, and a remote control center, and the face recognition module includes a camera, a face classification model, and a target classification model; The camera collects user images of users on the floor, identifies the user age and gender in the user images by the face classification model, and identifies the carried objects and user identities in the user images by the object classification model; In the remote control center, the user is classified by using the user age, the user gender, the carried object and the user identity to obtain the classified users, and the user requirements of the classified users are obtained, wherein the user requirements include the waiting time requirement and the number of passengers, and the target floor of the classified users is queried; In the remote control center, the number of stops before the elevator module picks up the classified user is analyzed, and the waiting time and the number of passengers required for the elevator module are calculated using the number of stops. According to the waiting time and the number of passengers required, a target elevator that meets the user's needs is determined, and it is detected whether the classified user arrives at the elevator waiting area of ​​the target elevator within a preset time period; When the classified user arrives at the elevator waiting area of ​​the target elevator within a preset time period, the classified user is transported to the target floor by the target elevator, so as to complete the remote hierarchical management and control of the elevator module by the remote control center, and obtain a first remote hierarchical management and control result; When the classified user does not arrive at the elevator waiting area of ​​the target elevator within the preset time period, query the actual waiting area where the classified user is located, and transport the classified user to the target floor through the actual elevator corresponding to the actual waiting area, so as to complete the remote hierarchical management and control of the elevator module by the remote control center, and obtain a second remote hierarchical management and control result; The first remote hierarchical management control result and the second remote hierarchical management control result are used as the final remote hierarchical management control result of the remote control center on the elevator module.

2. The wireless remote control face recognition and remote hierarchical management control method according to claim 1, characterized in that: The identifying the user age and the user gender in the user image by using the face classification model includes: Extracting attention features of the user image according to the channel attention mechanism in the face classification model; Outputting the user age in the user image using a long short-term memory network in the face classification model according to the attention feature; According to the attention feature, the BP neural network in the face classification model is used to output the user gender in the user image.

3. The wireless remote control face recognition and remote hierarchical management control method according to claim 1, characterized in that: The identifying the carried object and the user identity in the user image by using the target classification model includes: Identify the image target in the user image by using the target classification model; Removing background objects in a preset background image from the image objects to obtain a foreground object; Querying the target area of ​​the foreground target; When the target area is larger than a preset area, determining whether the foreground target is a first special target; When the foreground object is a first special object, determining a user identity in the user image; When the foreground object is not the first special object, determining whether the foreground object is the second special object; When the foreground object is not the second special object, the foreground object is regarded as a carried object.

4. The wireless remote control face recognition and remote hierarchical management control method according to claim 1, characterized in that: The method of classifying the users by using the user age, the user gender, the carried objects and the user identity to obtain classified users includes: Determine a first category of users and a second category of users among the users by using the user age and the user identity; Determine a third category of users among the users by using the user gender and the user age; Determining a fourth category of users among the users by using the carried objects; The first category of users, the second category of users, the third category of users and the fourth category of users are regarded as classified users.

5. The wireless remote control face recognition and remote hierarchical management control method according to claim 1, characterized in that: The analyzing the number of stops before the elevator module picks up the classified user includes: Collecting user pick-up and drop-off data of the elevator module in a historical period; Calculating the historical stop probability of the elevator module according to the user pick-up and drop-off data; Calculating the probability of midway users of the elevator module according to the user pick-up and drop-off data; Calculate the probability of simultaneous occurrence of the historical pause probability and the midway user probability; Selecting a high simultaneous occurrence probability greater than a preset probability value from the simultaneous occurrence probabilities; The number of floors corresponding to the high simultaneous occurrence probability is taken as the number of pauses.

6. The wireless remote control face recognition and remote hierarchical management control method according to claim 1, characterized in that: The method of calculating the waiting time and the number of passengers required for the elevator module by using the number of midway stops includes: Based on the number of pauses, calculating the waiting time for the elevator module to go down; Calculate the waiting time for the elevator module to go up; The downlink waiting time and the uplink waiting time are used as the required waiting time; Based on the number of midway stops, calculating the number of passengers required to travel down the elevator module; The number of people in the waiting area of ​​the elevator module is used as the number of passengers required to go up the elevator module; The number of people required to travel together on the downward journey and the number of people required to travel together on the upward journey are taken as the number of people required to travel together.

7. The wireless remote control face recognition and remote hierarchical management control method according to claim 1, characterized in that: The step of determining a target elevator that meets the user's needs according to the required waiting time and the number of passengers required to travel together includes: Obtaining the waiting time requirement and the number of passengers required in the user's requirements; Classifying the waiting time requirements into waiting time levels; Classifying the number of passengers into different levels according to the number of passengers required; Comparing the waiting time level with the number of passengers, and obtaining a level comparison result; Based on the level comparison result, determining the priority between the waiting time and the number of passengers required; According to the arrangement priority, a first target value and a second target value are selected from the required waiting time and the required number of passengers; sorting the elevator set corresponding to the elevator module by using the first target value to obtain a first sequence; Using the second target value to perform elevator sorting on the first sequence to obtain a second sequence; The first elevator is selected from the second sequence to obtain the target elevator.

8. The wireless remote control face recognition and remote hierarchical management control method according to claim 1, characterized in that: The step of transporting the classified user to the target floor by the target elevator includes: When the classified user needs to go down, after the classified user is received by the target elevator, it is detected whether there is an intermediate user in the down-going process; After receiving the intermediate user through the target elevator, the classified user and the intermediate user are transported to the target floor, so as to complete the process of transporting the classified user to the target floor through the target elevator; When the classified user needs to go up, the classified user is transported to the target floor by the target elevator.

9. The wireless remote control face recognition and remote hierarchical management control method according to claim 1, characterized in that: The transporting the classified user to the target floor by the actual elevator corresponding to the actual waiting area includes: When the classified user needs to go down, wait for the actual elevator to arrive at the current floor of the classified user; After the actual elevator receives the classified user at the current floor, it determines whether an online request sent by the remote control center is received; When receiving an online request from a remote control center, processing the online request through the actual elevator; When the online request is successfully processed by the actual elevator, the classified user is transported to the target floor by the actual elevator; When no online request is received from the remote control center, the classified user is transported to the target floor by the actual elevator; When the classified user needs to go up, wait for the actual elevator to arrive at the current floor of the classified user; After the actual elevator receives the classified user at the current floor, the classified user is transported to the target floor by the actual elevator based on the user floor number in the actual elevator.

10. A wireless remote control face recognition and remote hierarchical management control system, characterized in that: The system comprises: A system determination module, used to determine a hierarchical control system of a floor, wherein the hierarchical control system includes an elevator module, an image recognition module and a remote control center, and the face recognition module includes a camera, a face classification model and a target classification model; An identity recognition module, used to collect user images of users on the floor through the camera, identify the user's age and gender in the user image through the face classification model, and identify the carried objects and user identity in the user image through the target classification model; A floor query module is used to classify the users in the remote control center by using the user age, the user gender, the carried objects and the user identity to obtain the classified users, obtain the user requirements of the classified users, wherein the user requirements include the waiting time requirement and the number of passengers, and query the target floor of the classified users; A user detection module is used to analyze the number of pauses before the elevator module picks up the classified user in the remote control center, calculate the waiting time and the number of passengers required for the elevator module by using the number of pauses, determine the target elevator that meets the user's needs according to the waiting time and the number of passengers required, and detect whether the classified user arrives at the elevator waiting area of ​​the target elevator within a preset time period; A first management module is used to transport the classified user to the target floor through the target elevator when the classified user arrives at the elevator waiting area of ​​the target elevator within a preset time period, so as to complete the remote hierarchical management control of the elevator module by the remote control center and obtain a first remote hierarchical management control result; The second management module is used to query the actual waiting area where the classified user is located when the classified user fails to arrive at the elevator waiting area of ​​the target elevator within a preset time period, and transport the classified user to the target floor through the actual elevator corresponding to the actual waiting area, so as to complete the remote hierarchical management control of the elevator module by the remote control center, and obtain a second remote hierarchical management control result; The final management module is used to use the first remote hierarchical management control result and the second remote hierarchical management control result as the final remote hierarchical management control result of the remote control center on the elevator module.

Images