Method, device, equipment and storage medium for guiding escalator passenger behavior

Abstract

The present invention discloses a method, device, equipment and storage medium for guiding escalator passenger behavior. The method comprises: acquiring image information of the escalator in real time, judging whether there is a passenger with abnormal behavior on the escalator based on the image information, and if there is a passenger with abnormal behavior, acquiring the passenger characteristics of the passenger with abnormal behavior; determining the step where the passenger with abnormal behavior is located based on the passenger characteristics, as the target step, wherein each step of the escalator is equipped with an alarm device, and a control instruction is sent to the alarm device equipped with the target step, so that the alarm device issues a behavior guidance prompt to the passenger with abnormal behavior. The method can remind the passenger with abnormal behavior intuitively, directly and in a targeted manner, thereby realizing effective behavior guidance.

Description

Technical Field

[0001] The present invention belongs to the technical field of escalator safety warnings, and in particular relates to a method, device, equipment and storage medium for guiding escalator passenger behavior. Background Art

[0002] With the development of the times, escalators are now widely used in many places such as shopping malls, airports, and subway stations. At the same time, with the development of video recognition technology, video recognition is also increasingly being applied to escalators to identify escalator passenger behavior. When passengers with abnormal behavior are identified, prompt reminders are issued to prevent safety accidents. However, current escalator passenger behavior guidance methods only use fixed voice or light devices at the top or bottom of the escalator to provide reminders. This behavior guidance method is easily ignored by escalator passengers and is ineffective. Summary of the Invention

[0003] The present invention provides a method, device, equipment and storage medium for guiding the behavior of escalator passengers, so as to solve the problem that the current behavior guidance effect of escalator passengers is poor.

[0004] According to one aspect of the present invention, a method for guiding escalator passenger behavior is provided, the method comprising:

[0005] Get escalator image information in real time;

[0006] Based on the image information, determining whether there is a passenger with abnormal behavior on the escalator;

[0007] If the passenger with abnormal behavior exists, obtaining the passenger characteristics of the passenger with abnormal behavior;

[0008] Determining the step where the passenger with abnormal behavior is located based on the passenger characteristics as the target step, wherein each step of the escalator is equipped with an alarm device;

[0009] A control instruction is sent to the alarm device configured at the target step, so that the alarm device issues a behavior guidance prompt to the passenger with abnormal behavior.

[0010] According to one aspect of the present invention, a device for guiding escalator passenger behavior is provided, the device comprising:

[0011] Image information acquisition module, used to acquire escalator image information in real time;

[0012] a judgment module, configured to judge whether there is a passenger with abnormal behavior on the escalator based on the image information;

[0013] A passenger feature acquisition module, configured to acquire the passenger features of the passenger with abnormal behavior when the passenger with abnormal behavior exists;

[0014] a target step determination module, configured to determine the step where the passenger with abnormal behavior is located based on the passenger characteristics as the target step, wherein each step of the escalator is equipped with an alarm device;

[0015] The control instruction sending module is used to send a control instruction to the alarm device configured at the target step, so that the alarm device sends a behavior guidance prompt to the passenger with abnormal behavior.

[0016] According to another aspect of the present invention, an electronic device is provided, comprising:

[0017] at least one processor; and

[0018] a memory communicatively connected to the at least one processor; wherein,

[0019] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the method for guiding escalator passenger behavior described in any embodiment of the present invention.

[0020] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the method for guiding escalator passenger behavior according to any embodiment of the present invention when executed.

[0021] The technical solution of an embodiment of the present invention provides a method for guiding escalator passenger behavior, the method comprising: acquiring image information of the escalator in real time, judging whether there is a passenger with abnormal behavior on the escalator based on the image information, and if there is a passenger with abnormal behavior, acquiring the passenger characteristics of the passenger with abnormal behavior, and determining the step where the passenger with abnormal behavior is located based on the passenger characteristics as the target step, wherein each step of the escalator is configured with an alarm device, and a control instruction is sent to the alarm device configured with the target step so that the alarm device issues a behavior guidance prompt to the passenger with abnormal behavior, which can intuitively, directly and specifically remind the passenger with abnormal behavior, thereby achieving more effective behavior guidance.

[0022] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present invention, nor is it intended to limit the scope of the present invention. Other features of the present invention will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0024] Figure 1 This is a flow chart of a method for guiding escalator passenger behavior according to the first embodiment of the present invention;

[0025] Figure 2 is a schematic diagram of an escalator configuration device provided according to Embodiment 1 of the present invention;

[0026] Figure 3 This is a schematic diagram of a ladder alarm device provided according to the first embodiment of the present invention;

[0027] Figure 4 1 is a schematic structural diagram of an escalator passenger behavior guidance device provided according to a second embodiment of the present invention;

[0028] Figure 5 The present invention is a schematic structural diagram of an electronic device for implementing an escalator passenger behavior guidance method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0029] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present invention.

[0030] It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0031] Example 1

[0032] Figure 1 This is a flow chart of a method for guiding escalator passenger behavior provided in Example 1 of the present invention.

[0033] In order to more effectively remind passengers with abnormal behavior, targeted alarms can be issued through the alarm equipment on the step where the passenger is located to remind the passenger to adjust his or her standing position. That is, while identifying the escalator passenger with abnormal behavior, the step where the passenger is located can be determined, and behavioral guidance prompts can be given directly on the step where the passenger is located. This can guide the behavior of escalator passengers to the greatest extent, avoiding issuing prompts only at fixed locations, which can easily be blocked by abnormally behaving passengers and fail to achieve the effect of behavioral guidance.

[0034] The method can be executed by a device for guiding escalator passenger behavior, and the device for guiding escalator passenger behavior can be implemented in the form of hardware and / or software.

[0035] like Figure 1 As shown, the method includes the following steps:

[0036] S110, acquiring image information of the escalator in real time.

[0037] When implementing escalator passenger behavior guidance, in addition to the infrared sensors, weighing sensors, acoustic wave sensors, etc. commonly used in the prior art to analyze whether there are escalator passengers and obtain relevant information about escalator passengers, image information can also be collected by configuring an image acquisition device, such as a camera.

[0038] refer to Figure 2 A schematic diagram of an escalator configuration device. Due to the structural characteristics of the escalator, cameras can be configured at the top and bottom of the escalator, such as Figure 2 Camera A and camera B can jointly capture the entire escalator range, and can also effectively avoid situations where some positions will be blocked.

[0039] In a specific implementation, when obtaining image information of the escalator, only the image information of escalator passengers can be selected from the image information collected by all cameras for subsequent analysis. In order to prevent image deformation, the image information corresponding to certain parts of the escalator can be taken from specific cameras. For example, the image of the lower half of the escalator is collected by camera A, and the image of the upper half of the escalator is collected by camera B.

[0040] In one embodiment, after S110, the following steps are further included:

[0041] determining whether there is a new passenger entering the escalator based on the image information;

[0042] If there is a new passenger, the passenger characteristics of the new passenger are obtained based on the image information, and the acquisition time of the current image information is used as the boarding time of the new passenger;

[0043] Obtain the arrival time of each step at the passenger boarding terminal, wherein each step has a step identifier;

[0044] The level whose arrival time is the boarding time is determined as the level where the new passenger is located, and the passenger characteristics are bound to the level identifier of the level where the new passenger is located.

[0045] Based on the image information of each frame, human bodies can be identified on the escalator, and the current number of escalator passengers and the position of each person on the escalator can be determined in real time. The presence of new passengers can be determined based on changes in the number of people and the position of each person on the escalator. For example, if the number of people increases, it is clear that there are new passengers. Alternatively, even if the number of people remains the same or decreases, but some people are located near the exit in the previous frame of image information, and the current frame identifies people near the entrance, while the people originally near the exit are no longer there, it can be determined that there are new passengers.

[0046] When a new passenger is detected on the escalator, the passenger characteristics of the new passenger can be extracted through image information. The passenger characteristics can be a combination of one or more of the passenger's head-to-shoulder width ratio, head projection shape, hair color, clothing color, height, and many other information.

[0047] The arrival time of each step at the passenger end can be determined by installing sensors on each step and the skirt of the escalator entrance and exit. For example, the sensor can be an NFC sensing tag. Figure 2 NFC sensing tags C and NFC sensing tags D can be installed on the skirt board of the escalator. The working sensing tags can be determined according to the specific running direction of the escalator. The sensing tags at both ends of the escalator can also be used to determine the arrival time of each escalator entering the escalator surface along the direction of movement, as well as the end time of the movement on the escalator surface.

[0048] Each step has a step identifier, which can be the code of a communication device installed on each step and communicating with an NFC sensor tag. For example, the communication device on the step can be coded as S1, S2, S3, ... Sn. When the step moves to the NFC sensor tag at the upper and lower ends, the communication device can sense the NFC sensor tag and determine the sensing time, and record the sensing time and the communication device code accordingly. The communication device can use Wi-Fi, Bluetooth, UWB signals (Ultra Wideband, a carrier-free communication technology), etc., and has two-way data transmission and reception capabilities, and collects corresponding data information through the communication device.

[0049] The step whose arrival time is the boarding time can be identified as the new passenger's step. That is, at the moment a new passenger is detected, the step passing the NFC sensor tag at the passenger's boarding end can be considered the new passenger's step. The new passenger's characteristics can be linked to the step identifier of the new passenger's step. This allows for subsequent detection of abnormal passenger behavior, allowing for a direct alert on that step, providing more effective guidance for the passenger's behavior.

[0050] In one embodiment, determining whether a new passenger has entered the escalator based on image information includes the following steps:

[0051] identifying a predetermined starting line from the image information;

[0052] Determine whether there are escalator passengers in the specified direction whose distance from the starting line is within the threshold range;

[0053] If so, it is determined that there is a new passenger entering the escalator;

[0054] Otherwise, it is determined that there is no new passenger entering the escalator.

[0055] The pre-set starting line can be the intersection of the floor and steps at the passenger boarding end, and the specified direction can be the direction of escalator movement. If there is an escalator passenger within a threshold distance from the starting line at the intersection of the floor and steps at the passenger boarding end, in the direction of escalator movement, it is considered that a person has crossed the starting line and become a new passenger.

[0056] S120: Based on the image information, determine whether there are passengers with abnormal behavior on the escalator.

[0057] Image information can be processed using an image recognition algorithm. Specifically, the image recognition algorithm can be an inter-frame difference method, an edge extraction method, etc. The algorithm can determine whether a passenger is behaving abnormally by determining the movement of each passenger's body outline, changes in the space occupied, etc. For example, if an escalator passenger's initial passenger characteristics indicate a height of 170 cm, but in a certain frame of image information, their real-time height is 120 cm. This means that their real-time height is less than the height indicated in the passenger characteristics and exceeds a certain range. It can be determined that the escalator passenger is bending over or squatting at this time, and thus can be identified as a passenger with abnormal behavior.

[0058] In one embodiment, S120 includes the following steps:

[0059] S120-1, detecting whether there are escalator passengers based on image information;

[0060] S120-2, if there is an escalator passenger, input the image information into a pre-set behavior matching model;

[0061] S120-3, receiving the behavior results output by the behavior matching model, and determining whether there are any passengers with abnormal behavior based on the behavior results.

[0062] Determining whether a human body is present based on image information is a relatively mature technology. It can be determined by extracting the human body contour or by performing image matching through a pre-set model. This embodiment does not limit the specific method of detecting whether there are escalator passengers.

[0063] After confirming the presence of escalator passengers, the image information of these passengers can be used to determine their behavior through deep learning. For example, the image information can be input into a behavior matching model, such as Cascade CNN, Faceness-Net, or MTCNN multi-task cascade convolutional neural networks. The behavior matching model can be trained in advance to predetermine the various postures and behaviors that passengers may exhibit in escalators. The model can then be matched with the human postures in the image information to output the behavior results.

[0064] The behavior result can directly output a conclusion of whether the passenger is normal or abnormal, or it can output a description of the current escalator passenger's behavior and then determine whether the behavior is normal or abnormal based on the action description. For example, if the received behavior result is a hand or head extended outside the escalator, the escalator passenger can be judged as abnormal.

[0065] When there are multiple escalator passengers in the same image information, the behavior matching model can output multiple behavior results, and can bind the behavior results with passenger characteristics and step identification to determine the escalator passenger to whom a certain behavior result belongs.

[0066] S130: If there is a passenger with abnormal behavior, obtain the passenger characteristics of the passenger with abnormal behavior.

[0067] When it is determined that there is a passenger with abnormal behavior, the passenger characteristics of the passenger with abnormal behavior can be obtained from the image information. The specific method of obtaining the passenger characteristics can adopt the aforementioned method to extract the passenger characteristics of the passenger with abnormal behavior. The passenger characteristics of the abnormal passenger can be determined based on the specific information of the passenger characteristics of the new passenger.

[0068] S140, determining the level where the passenger with abnormal behavior is located based on the passenger characteristics as the target level, wherein each level of the escalator is equipped with an alarm device.

[0069] After obtaining the passenger characteristics of the passenger with abnormal behavior, the position of the passenger with abnormal behavior in the image information can be determined based on the passenger characteristics of the passenger with abnormal behavior. In one implementation, a baseline can be set for the position of each part of the escalator when processing the image information. The positional relationship between the position of the passenger with abnormal behavior and the baseline can be used to determine the step where the passenger with abnormal behavior is located, that is, the target step.

[0070] In one embodiment, S140 includes the following steps:

[0071] S140-1, determining a step identifier associated with a passenger characteristic of a passenger with abnormal behavior;

[0072] S140-2, determining the step corresponding to the step identifier as the target step.

[0073] After obtaining the passenger characteristics of the passenger with abnormal behavior, they can be matched with the passenger characteristics obtained when a new passenger is detected. The step identifier bound to the passenger characteristics obtained for the successfully matched new passenger can be considered as the step identifier bound to the passenger characteristics of the passenger with abnormal behavior, that is, the step where the passenger with abnormal behavior was located when he was a new passenger is determined as the target step.

[0074] S150: Send a control instruction to the alarm device configured at the target step, so that the alarm device issues a behavior guidance prompt to the passenger with abnormal behavior.

[0075] Warning equipment can be a device that can emit sound prompts, light prompts, etc. to guide the behavior of escalator passengers. Figure 3 A schematic diagram of a step alarm device is shown, where E in the figure can be an LED module for issuing light prompts, and F in the figure can be a step, that is, each step is equipped with an LED module. For example, when the escalator passengers do not behave abnormally on the steps, the LED modules of the steps can be displayed in white. When a passenger with abnormal behavior appears, a control instruction can be sent to the LED module so that the LED module of the step is displayed in red, so as to remind the passenger with abnormal behavior to correct his or her current behavior. In another implementation, the alarm device can be a sound player, and a control instruction can be sent to make the sound player issue a voice prompt, wherein the voice content can also be combined with the passenger characteristics of the escalator passengers. For example, if a passenger with abnormal behavior is wearing a red short-sleeved shirt, in order to achieve the purpose of behavioral guidance more effectively and specifically, the voice content can be: Passengers wearing red short-sleeved shirts, please pay attention to escalator safety.

[0076] In addition, the alarm can display relevant prompt information when entering or leaving the escalator, such as a green-to-white gradient warning for multiple steps at the entrance, and a white-to-green gradient warning for multiple steps at the exit. Specifically, before passengers exhibit abnormal behavior, the LED screens on the left and right sides of the steps at the escalator entrance will display gradient guidance information from the entrance to the middle, such as a color gradient from green to white, and a dynamic arrow will be displayed on the LED screen in the middle of the step; at the exit section of the escalator, the LED screens on the left and right sides of the steps will display gradient guidance information from the middle to the exit, such as a color gradient from white to green, and a dynamic arrow will be displayed on the LED screen in the middle of the step.

[0077] It can realize multi-step linkage display, dynamically guide escalator passengers to take the escalator, and display different guidance information at different positions.

[0078] In one embodiment, the behavior results include multiple different types of abnormal behaviors, and the alarm device includes a visual device and an auditory device; and the following steps are also included before S150:

[0079] determining, based on the type of abnormal behavior received, content to be displayed on a visual device and content to be played on an auditory device;

[0080] Generate control instructions based on the displayed content and the played content.

[0081] Abnormal behavior can include things like a user not gripping the handrail, extending their hands or head outside the escalator, falling, being left with oversized luggage, or entering the escalator the wrong way. Visual display content and audio playback content can be pre-set based on different abnormal behavior types. Once the abnormal behavior type is determined, the pre-set display and playback content can be matched to the specific abnormal behavior type, prompting the warning device on the target escalator level to sound an alarm, thus providing behavioral guidance for passengers.

[0082] In addition to providing behavioral guidance for only a specific step, it's also possible to coordinate all steps of the escalator, allowing the alarm devices on all steps to collectively provide behavioral guidance. This means you can determine the display content for each step's alarm device and send different control commands to each device, allowing all escalator alarm devices to collectively provide behavioral guidance.

[0083] For example, if the abnormal behavior is not holding the handrail tightly, the control instructions may determine the display content of the visual device and the playback content of the auditory device as follows: the LED screens around the escalator steps display light yellow, the central LED module displays a dynamic pattern of holding the handrail tightly, and plays the content "Please hold the handrail tightly";

[0084] If the abnormal behavior is a passenger extending their hands or head outside the escalator, the control instructions can determine the display content of the visual device and the playback content of the auditory device as follows: the LED screens around the escalator steps will turn orange, and the central LED screen will display a dynamic pattern of a hand or head extending out of the escalator, and play the content "Please do not extend your body out of the escalator";

[0085] If the abnormal behavior is a user falling or a large piece of luggage being stranded, the control instructions can determine the display content of the visual device and the playback content of the auditory device: the LED screens around the escalator steps will turn red and play the content "Please note that people may fall" or "Please note that luggage is stranded", the LED screens around the steps adjacent to the target step will change to a gradient color from red to orange, and the central LED screen will display dynamic patterns of a user falling or a large piece of luggage being stranded;

[0086] If the type of abnormal behavior is the passenger entering in the opposite direction, the control instructions can determine the display content of the visual device and the playback content of the auditory device as follows: the LED screens around the steps change to red, the LED screen in the middle of the step displays a red dynamic arrow pattern, and the LED screens around the subsequent steps change to gradually change from red to orange, and the playback content is "Please do not go against the flow".

[0087] In one embodiment, the following steps are also included:

[0088] Get the running speed of the escalator and the width of the steps;

[0089] Determine the real-time moving speed of each escalator passenger based on multiple frames of image information;

[0090] Compare the running speed with the various movement speeds;

[0091] When the running speed is inconsistent with the moving speed, the passenger characteristics of the escalator passengers whose moving speed is inconsistent with the running speed are obtained;

[0092] Based on the running speed, moving speed and width, the step signs tied to the passenger characteristics are updated in real time.

[0093] When passengers are riding an escalator, they may walk on the escalator. The passenger's movement status can be determined based on image information, and the step the passenger is currently on can be changed in real time, that is, the step identifier bound to the passenger's characteristics can be changed in real time.

[0094] In specific implementation, to determine whether the escalator passenger is walking, the passenger's moving speed can be determined, and then the moving speed is compared with the running speed of the escalator. If the escalator passenger is not walking, the escalator passenger will remain relatively stationary with the steps, that is, the running speed is the same as the moving speed.

[0095] Continuous multi-frame image information can be obtained. For the two time points t1 and t2, the positions PL of the passengers can be determined by the image information. t1 and PL t2 , can be calculated based on V p1 =(PL t2 -PL t1 ) / (t2-t1) to determine the passenger's moving speed V p1 .

[0096] Step width S s and the escalator's running speed V s In addition, in a specific implementation, the running speed of the escalator can also be detected by NFC sensing the time between adjacent steps. S1 TNFC S2 , according to the kinematic formula V s =S s / (TNFC S2 -TNFC S1 ) Calculate the escalator's running speed V s .

[0097] When the passenger's moving speed is consistent with the running speed of the steps, the binding relationship between the passenger and the steps remains unchanged. When the passenger's moving speed is faster than the running speed of the steps, the kinematic formula PScount=(V p1 -V s )*(t2-t1) / S s , based on PScount, the position of the passenger and the step is moved forward by PScount steps. Similarly, when the passenger's speed is slower than the step speed, the position of the passenger and the step is moved backward according to the same calculation method, completing the real-time binding of passenger characteristics and step identification.

[0098] An embodiment of the present invention proposes a method for guiding escalator passenger behavior, which includes: acquiring image information of the escalator in real time, judging whether there is a passenger with abnormal behavior on the escalator based on the image information, and if there is a passenger with abnormal behavior, acquiring the passenger characteristics of the passenger with abnormal behavior, and determining the step where the passenger with abnormal behavior is located based on the passenger characteristics as the target step, wherein each step of the escalator is equipped with an alarm device, and a control instruction is sent to the alarm device equipped with the target step so that the alarm device issues a behavior guidance prompt to the passenger with abnormal behavior, which can intuitively, directly and specifically remind the passenger with abnormal behavior, thereby achieving more effective behavior guidance.

[0099] Example 2

[0100] Figure 4This is a schematic diagram of the structure of an escalator passenger behavior guidance device provided in Example 2 of the present invention, the device comprising:

[0101] Image information acquisition module 410, used to acquire image information of the escalator in real time;

[0102] A judgment module 420 is configured to judge whether there is a passenger with abnormal behavior on the escalator based on the image information;

[0103] The passenger characteristics acquisition module 430 is configured to acquire the passenger characteristics of the passenger with abnormal behavior when the passenger with abnormal behavior exists;

[0104] a target level determination module 440 for determining the level where the passenger with abnormal behavior is located based on the passenger characteristics as the target level, wherein each level of the escalator is equipped with an alarm device;

[0105] The control instruction sending module 450 is used to send a control instruction to the alarm device configured at the target step, so that the alarm device sends a behavior guidance prompt to the passenger with abnormal behavior.

[0106] In one embodiment, the apparatus further comprises the following modules:

[0107] A new passenger determination module, configured to determine whether there is a new passenger entering the escalator based on the image information;

[0108] an execution module, configured to, when the new passenger exists, obtain the passenger characteristics of the new passenger based on the image information, and use the current acquisition time of the image information as the boarding time of the new passenger;

[0109] An arrival time acquisition module is used to acquire the arrival time of each step at the passenger boarding end, wherein each step has a step identifier;

[0110] The binding module is used to determine the level whose arrival time is the boarding time as the level where the new passenger is located, and to bind the passenger characteristics with the level identifier of the level where the new passenger is located.

[0111] In one embodiment, the new passenger determination module includes the following submodules:

[0112] an identification submodule, configured to identify a preset starting line from the image information;

[0113] A judgment submodule, configured to judge whether there is an escalator passenger in a specified direction whose distance from the starting line is within a threshold range;

[0114] The execution submodule is configured to determine that there is a new passenger entering the escalator when there is an escalator passenger whose distance from the starting line is within a threshold range in the specified direction; otherwise, determine that there is no new passenger entering the escalator.

[0115] In one embodiment, the target level determination module 440 includes the following submodules:

[0116] a step identifier determination submodule, configured to determine a step identifier bound to the passenger characteristics of the passenger with abnormal behavior;

[0117] The target step determination submodule is configured to determine the step corresponding to the step identifier as the target step.

[0118] In one embodiment, the determination module 420 includes the following submodules:

[0119] a detection submodule, configured to detect whether there is an escalator passenger based on the image information;

[0120] An input submodule, configured to input the image information into a pre-set behavior matching model when the escalator passenger is present;

[0121] The receiving submodule is configured to receive the behavior results output by the behavior matching model and determine whether there is a passenger with abnormal behavior based on the behavior results.

[0122] In one embodiment, the behavior results include multiple different types of abnormal behaviors, the alarm device includes a visual device and an auditory device, and the apparatus further includes the following modules:

[0123] a content determination module, configured to determine the display content of the visual device and the playback content of the auditory device according to the type of the received abnormal behavior;

[0124] A control instruction generating module is used to generate a control instruction based on the display content and the playback content.

[0125] In one embodiment, the apparatus further comprises the following modules:

[0126] A first acquisition module is used to acquire the running speed of the escalator and the width of the steps;

[0127] A moving speed determination module, configured to determine the real-time moving speed of each escalator passenger based on the image information of a plurality of consecutive frames;

[0128] a comparison module, configured to compare the running speed with each of the moving speeds;

[0129] a second acquisition module, configured to acquire, when the running speed is inconsistent with the moving speed, passenger characteristics of the escalator passenger whose moving speed is inconsistent with the running speed;

[0130] An updating module is used to update the step identifier bound to the passenger characteristics in real time based on the running speed, the moving speed and the width.

[0131] An escalator passenger behavior guidance device provided by an embodiment of the present invention can implement an escalator passenger behavior guidance method provided by the first embodiment of the present invention, and has corresponding functional modules and beneficial effects of the execution method.

[0132] Example 3

[0133] Figure 5 A schematic diagram of the structure of an electronic device 10 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or claimed herein.

[0134] like Figure 5 As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by the at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. Various programs and data required for the operation of the electronic device 10 can also be stored in the RAM 13. The processor 11, ROM 12 and RAM 13 are connected to each other via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0135] Multiple components in the electronic device 10 are connected to the I / O interface 15, including an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a magnetic disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0136] The processor 11 can be any general-purpose and / or specialized processing component with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as a method for guiding escalator passenger behavior.

[0137] In some embodiments, a method for guiding escalator passenger behavior can be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the method for guiding escalator passenger behavior described above can be performed. Alternatively, in other embodiments, the processor 11 can be configured to perform a method for guiding escalator passenger behavior in any other appropriate manner (for example, by means of firmware).

[0138] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0139] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when the computer program is executed by the processor, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The computer program may be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0140] In the context of the present invention, computer-readable storage media can be tangible media that can contain or store a computer program for use with an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. Computer-readable storage media can include but are not limited to electronic, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, computer-readable storage media can be machine-readable signal media. More specific examples of machine-readable storage media can include electrical connections based on one or more lines, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0141] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0142] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0143] A computing system may include clients and servers. The clients and servers are typically remote from each other and typically interact via a communication network. This client-server relationship arises through computer programs running on the respective computers, creating a client-server relationship. The server may be a cloud server, also known as a cloud computing server or cloud host. This server is a hosting product within the cloud computing service ecosystem that addresses the management difficulties and limited scalability of traditional physical hosting and VPS services.

[0144] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in the present invention can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of the present invention can be achieved. This is not limited herein.

[0145] The above specific embodiments do not limit the scope of protection of the present invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention are intended to be included within the scope of protection of the present invention.

Claims

1. A method for guiding escalator passenger behavior, characterized in that: The method comprises: Get escalator image information in real time; Based on the image information, determining whether there is a passenger with abnormal behavior on the escalator; If the passenger with abnormal behavior exists, obtaining the passenger characteristics of the passenger with abnormal behavior; Determining the step where the passenger with abnormal behavior is located based on the passenger characteristics as the target step, wherein each step of the escalator is equipped with an alarm device; Sending a control instruction to the warning device configured at the target step, so that the warning device issues a behavior guidance prompt to the passenger with abnormal behavior; After acquiring the image information of the escalator in real time, the method further includes: determining whether there is a new passenger entering the escalator based on the image information; If the new passenger exists, obtaining the passenger characteristics of the new passenger based on the image information, and using the current acquisition time of the image information as the boarding time of the new passenger; Obtaining the arrival time of each step at the passenger boarding terminal, wherein each step has a step identifier; The level whose arrival time is the boarding time is determined as the level where the new passenger is located, and the passenger characteristics are bound to the level identifier of the level where the new passenger is located.

2. The method according to claim 1, characterized in that The determining, based on the image information, whether there is a new passenger entering the escalator comprises: identifying a predetermined starting line from the image information; Determining whether there are escalator passengers in a specified direction whose distance from the starting line is within a threshold range; If yes, it is determined that there is a new passenger entering the escalator; Otherwise, it is determined that there is no new passenger entering the escalator.

3. The method according to claim 1 or 2, characterized in that The step of determining the level where the passenger with abnormal behavior is located based on the passenger characteristics as the target level includes: determining a step identifier associated with the passenger characteristic of the passenger with abnormal behavior; The step corresponding to the step identifier is determined as the target step.

4. The method according to claim 1 or 2, characterized in that The determining, based on the image information, whether there is a passenger with abnormal behavior on the escalator includes: Based on the image information, detecting whether there is an escalator passenger; If the escalator passenger exists, inputting the image information into a pre-set behavior matching model; Receive the behavior results output by the behavior matching model, and determine whether there is a passenger with abnormal behavior based on the behavior results.

5. The method according to claim 4, characterized in that The behavior results include various types of abnormal behaviors, and the alarm devices include visual devices and auditory devices; Before sending the control instruction to the alarm device configured at the target level, the method further includes: Determining, based on the type of the received abnormal behavior, display content of the visual device and playback content of the auditory device; A control instruction is generated based on the display content and the playback content.

6. The method according to claim 1 or 2, characterized in that The method further comprises: Obtaining the running speed of the escalator and the width of the steps; Determining the real-time moving speed of each escalator passenger based on the image information of multiple consecutive frames; comparing the running speed with each of the moving speeds; When the running speed is inconsistent with the moving speed, obtaining the passenger characteristics of the escalator passenger whose moving speed is inconsistent with the running speed; The step identifier bound to the passenger characteristics is updated in real time based on the running speed, the moving speed, and the width.

7. A device for guiding escalator passenger behavior, characterized in that: The device comprises: Image information acquisition module, used to acquire escalator image information in real time; a judgment module, configured to judge whether there is a passenger with abnormal behavior on the escalator based on the image information; A passenger feature acquisition module, configured to acquire the passenger features of the passenger with abnormal behavior when the passenger with abnormal behavior exists; a target step determination module, configured to determine the step where the passenger with abnormal behavior is located based on the passenger characteristics as the target step, wherein each step of the escalator is equipped with an alarm device; a control instruction sending module, configured to send a control instruction to the alarm device configured at the target step, so that the alarm device issues a behavior guidance prompt to the passenger with abnormal behavior; Wherein, the device further comprises: A new passenger determination module, configured to determine whether there is a new passenger entering the escalator based on the image information; an execution module, configured to, when the new passenger exists, obtain the passenger characteristics of the new passenger based on the image information, and use the current acquisition time of the image information as the boarding time of the new passenger; An arrival time acquisition module is used to acquire the arrival time of each step at the passenger boarding end, wherein each step has a step identifier; The binding module is used to determine the level whose arrival time is the boarding time as the level where the new passenger is located, and to bind the passenger characteristics with the level identifier of the level where the new passenger is located.

8. An electronic device, characterized in that: The electronic device comprises: At least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the method for guiding escalator passenger behavior according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the method for guiding escalator passenger behavior according to any one of claims 1 to 6 when executed.

Images