Personnel positioning method, device, system and medium in multi-space scenes

Abstract

The present invention provides a method, device, system and medium for positioning personnel in multiple space scenes. The method jointly determines the specific position of personnel by means of mutual cooperation between main lighting devices and auxiliary lighting devices located in different spaces, thereby achieving personnel positioning while greatly reducing costs, and effectively solving technical problems such as large interference and easy misjudgment in personnel positioning.

Description

Technical Field

[0001] The present invention relates to the field of positioning technology, and in particular to a personnel positioning method, device, system and medium in multiple space scenes. Background Art

[0002] With the continuous improvement of my country's industrial technology and scientific and technological innovation capabilities, China's cruise tourism industry has flourished, and cruise tourism has gradually become the first choice for many tourists. However, cruise ships can generally accommodate hundreds or thousands of people, and the composition of the crew on board is complex. However, there are no effective measures on existing cruise ships to locate and manage the crew on board.

[0003] Although there are personnel positioning systems in the prior art, there are many problems in directly applying the existing personnel positioning systems to ships. First, the existing mobile phone personnel positioning system obtains the location information of mobile phone users through network data communication to achieve positioning, but this communication method needs to be established on wireless transmission lines and base stations. In the sea far away from the coastline, it is impossible to effectively access the communication signal, and it is impossible to achieve personnel positioning. Secondly, the rooms in the cabin are densely packed and complex in structure. Due to the manufacturing cost of large ships such as cruise ships, the partitions used to separate the cabins are mostly made of wooden boards and other partitions that cannot block wireless signals; this results in the use of wireless communication equipment installed in the cabin to achieve personnel positioning. Usually, multiple wireless signals in adjacent cabins or corridors are detected, and the wireless signals interfere with each other greatly. It is very easy to produce errors in locating the position of personnel based on this positioning method, so this positioning method cannot be effectively put into use. Summary of the invention

[0004] In view of the shortcomings of the prior art mentioned above, the purpose of the present invention is to provide a personnel positioning method, device, system and medium for multi-space scenarios, which is used to solve the technical problems that the existing wireless indoor positioning technology cannot be directly applied to large spaces such as ships, has large positioning interference, and is prone to misjudgment.

[0005] To achieve the above-mentioned purpose and other related purposes, the present invention provides a personnel positioning method in a multi-space scene, which is applied to a main lighting device, wherein the main lighting device is arranged in a first space and is communicatively connected to one or more auxiliary lighting devices located in a second space; the positioning method includes: collecting real-time image information in the first space, and receiving the user ID of the personnel from the auxiliary lighting device; determining the location information of the personnel based on the real-time image information and the user ID; the location information includes information located in the first space or information located in the second space.

[0006] In one embodiment of the present invention, the main lighting device and the auxiliary lighting device form a local area network or are connected to the Internet to work.

[0007] In one embodiment of the present invention, the real-time image information includes: any one or more combinations of real-time image information of a person being in the first space, a person not being in the first space, a person entering the second space from the first space, and a person entering the first space from the second space.

[0008] In one embodiment of the present invention, the real-time image information is used to identify the identity of a person and further locate the space where the person is located; wherein the space where the person is located identified based on the real-time image information is more reliable than the space where the person is located identified based on the user ID.

[0009] In one embodiment of the present invention, the method includes collecting real-time image information of a first space; receiving a user ID from an auxiliary lighting device of a second space; wherein the real-time image information is inconsistent with a user ID from the auxiliary lighting device; and identifying the space where the person is located based on the criterion that the referenceability of the space where the person is located identified by the real-time image information is higher than the space where the person is located identified by the user ID.

[0010] In one embodiment of the present invention, the real-time image information contradicts a user ID from the auxiliary lighting device, which specifically includes: the real-time image information includes a person being located in the first space, but the user ID of the auxiliary lighting device from the second space includes the user ID of the person; or, the real-time image information includes a person entering the second space from the first space, but the user ID of the auxiliary lighting device from the second space does not include the user ID of the person; or, the real-time image information includes a person entering the first space from the second space, but the user ID of the auxiliary lighting device from the second space includes the user ID of the person.

[0011] In one embodiment of the present invention, the method includes collecting real-time image information of a first space; receiving multiple user IDs from an auxiliary lighting device of a second space, the multiple user IDs including the user ID of the person and the user IDs of other persons; wherein the other persons are located within the signal collection area of ​​the auxiliary lighting device of the second space, but are not located in the second space themselves; excluding the user IDs of other persons from the multiple user IDs, and identifying the space where the person is located based on the criterion that the referenceability of the space where the person is located identified by the real-time image information is higher than the space where the person is located identified according to the user ID.

[0012] In one embodiment of the present invention, the method for excluding user IDs of other persons from multiple user IDs includes any one or a combination of two of the following methods: Method 1) excluding user IDs of other persons from multiple user IDs based on the fact that other persons are not located in the second space; Method 2) judging the strength relationship between signals corresponding to multiple user IDs, and excluding user IDs corresponding to signals other than the strongest signal.

[0013] In one embodiment of the present invention, the method includes: collecting real-time image information in a first space; receiving multiple user IDs from auxiliary lighting devices of multiple second spaces, the user IDs sent by the auxiliary lighting devices of each second space including the user ID of a person entering the second space and the user IDs of one or more other persons; wherein the other persons are located within the collection range of the auxiliary lighting device in the second space but are not located in the second space themselves; excluding the user IDs of other persons from the multiple user IDs of the auxiliary lighting devices of each second space, and identifying the space where each person is located based on the criterion that the referenceability of the space where the person is located identified by the real-time image information is higher than the space where the person is located identified according to the user ID.

[0014] In one embodiment of the present invention, the method for excluding user IDs of other persons from multiple user IDs of each auxiliary lighting device includes any one or more combinations of the following methods: Method 1) respectively judging the strength relationship between each signal corresponding to multiple user IDs of each auxiliary lighting device, and excluding user IDs corresponding to signals other than the strongest signal; Method 2) respectively judging the time consumed by each auxiliary lighting device to collect each user ID, and excluding user IDs corresponding to time periods other than the shortest time period; Method 3) collecting real-time image information entering the second space, performing face recognition on each person in the real-time image information, and excluding user IDs of unrecognized persons.

[0015] In one embodiment of the present invention, the main lighting device is communicatively connected to a control terminal, and the control terminal stores the user ID of the person; the method also includes: collecting real-time image information in the first space, and performing face recognition on each person in the real-time image information; extracting a moving target in the first space based on the result information of the face recognition and monitoring the movement of the moving target in the first space, thereby tracking the moving target.

[0016] In one embodiment of the present invention, the method further includes: determining the user ID of each person in the first space and the total number of people in the first space according to the result information of the face recognition and the user ID of the person stored in the control terminal.

[0017] To achieve the above-mentioned purpose and other related purposes, the present invention provides a personnel positioning lighting device for multi-space scenes, which is arranged in a first space and communicatively connected to one or more external devices located in a second space, and the personnel positioning lighting device includes: an image acquisition module, used to acquire real-time image information in the first space; a communication module, used to communicate with the external device to receive the user ID of the personnel from the external device; a processing module, used to determine the location information of the personnel based on the real-time image information and the user ID; the location information includes information located in the first space or information located in the second space.

[0018] To achieve the above-mentioned purpose and other related purposes, the present invention provides a personnel positioning method in a multi-space scene, which is applied to an auxiliary lighting device, wherein the auxiliary lighting device is communicatively connected to a main lighting device and is communicatively connected to one or more user terminals; the main lighting device is arranged in a first space, and the auxiliary lighting device is located in a second space; the positioning method includes: receiving a user ID of a person from one or more user terminals; transmitting the user ID of the person to the main lighting device, so that the main lighting device can determine the position information of the person based on the real-time image information collected by it and the user ID; the position information includes information located in the first space or information located in the second space.

[0019] In one embodiment of the present invention, the main lighting device and the auxiliary lighting device form a local area network or are connected to the Internet to work.

[0020] In one embodiment of the present invention, the real-time image information includes: any one or more combinations of real-time image information including a person being in a first space, a person not being in the first space, a person entering a second space from a first space, and a person entering the first space from a second space; the user ID includes: facial feature information and / or basic information, wherein the basic information includes name, nationality, gender, age, and any one or a combination of multiple pieces of information in the user ID.

[0021] In one embodiment of the present invention, the user terminal includes a handheld user terminal and / or a wearable user terminal.

[0022] To achieve the above-mentioned purpose and other related purposes, the present invention provides a personnel positioning lighting device for multi-space scenes, which is arranged in a second space and communicatively connected to an external device located in a first space. The personnel positioning lighting device includes: a first communication module, used to communicate and connect one or more user terminals to receive a user ID of a person from the user terminal; a second communication module, used to communicate and connect to the external device to transmit the user ID of the person to the external device.

[0023] In one embodiment of the present invention, the device further includes: a human body sensing module connected to the first communication module to control the first communication module to be turned on when a person is sensed.

[0024] To achieve the above-mentioned objectives and other related objectives, the present invention provides a personnel positioning system for a multi-space scene, comprising a plurality of main lighting devices; the system also comprises a plurality of auxiliary lighting devices; the main lighting devices are arranged in the first space of the multi-space scene, and the auxiliary lighting devices are arranged in the second space of the multi-space scene; each main lighting device is communicatively connected to one or more auxiliary lighting devices, and each auxiliary lighting device is communicatively connected to one or more user terminals; wherein: the auxiliary lighting device is used to receive a user ID of a person from the user terminal, and transmit the user ID of the person to the main lighting device; the main lighting device is used to collect real-time image information in the first space, and determine the location information of the person based on the real-time image information and the user ID of the person from the auxiliary lighting device; the location information includes information located in the first space or information located in the second space.

[0025] To achieve the above-mentioned purpose and other related purposes, the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the personnel positioning method in the multi-space scene.

[0026] As described above, the personnel positioning method, device, system and medium for multi-space scenes of the present invention have the following beneficial effects: the present invention jointly determines the specific position of personnel by means of mutual cooperation between the main lighting device and the auxiliary lighting device located in different spaces, thereby achieving personnel positioning while greatly reducing costs, and effectively solving technical problems such as large interference and easy misjudgment in personnel positioning. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 Shown is a schematic diagram of a multi-space scene according to an embodiment of the present invention.

[0028] Figure 2 Shown is a schematic flow chart of a method for positioning personnel in multiple space scenarios according to an embodiment of the present invention.

[0029] Figure 3 Shown is a schematic diagram of the interior layout of a ship in Embodiment 3 of the present invention.

[0030] Figure 4 Shown is a schematic diagram of the interior layout of a ship in Embodiment 4 of the present invention.

[0031] Figure 5 Shown is a schematic flow chart of a method for positioning personnel in multiple space scenarios according to an embodiment of the present invention.

[0032] Figure 6Shown is a schematic diagram of a personnel positioning lighting device for multiple space scenes in one embodiment of the present invention.

[0033] Figure 7 Shown is a schematic diagram of a personnel positioning lighting device for multiple space scenes in one embodiment of the present invention.

[0034] Component number description

[0035] 11 First Space

[0036] 12 Second Space

[0037] 13 Main lighting device

[0038] 14 Auxiliary lighting

[0039] 141 Auxiliary lighting device

[0040] 142 Auxiliary lighting device

[0041] 61 Image acquisition module

[0042] 62 Communication module

[0043] 63 Processing Module

[0044] 71 First communication module

[0045] 72 Second communication module

[0046] 73 Human body sensing module

[0047] Cabin 001~004

[0048] S21~S22 Method Steps

[0049] S51~S52 Method steps DETAILED DESCRIPTION

[0050] The following describes the embodiments of the present invention by specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.

[0051] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present invention, and thus the drawings only show components related to the present invention rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated.

[0052] The present invention provides a method, device, system and medium for locating personnel in a multi-space scene, which are used to locate the position information of personnel in the multi-space scene. The multiple spaces (such as the first space and the second space) in the multi-space scene can be divided into public spaces and non-public spaces according to their usage attributes, that is, the multi-space scene can include multiple public spaces and non-public spaces, or only include multiple public spaces, or only include multiple non-public spaces, and the present invention does not limit this.

[0053] In addition, the multi-space scene can be located within the coverage of the Internet, or it can be located outside the coverage of the Internet and work based on a local area network. The multi-space scene located within the coverage of the Internet includes, for example, a teaching building with multiple classrooms, a hospital with multiple wards, or a shopping mall with multiple counters, etc.; the multi-space scene located outside the coverage of the Internet includes, for example, a multi-cabin ship far away from the coastline, a multi-room building located on an isolated island or remote area, or a multi-studio flight equipment located at high altitude, etc. The following takes a multi-cabin ship far away from the coastline as an example to explain the implementation method and implementation principle of the present invention.

[0054] like Figure 1 As shown, a schematic diagram of a multi-space scene in an embodiment of the present invention is shown, which is used to represent the layout inside the ship. In this embodiment, the ship includes a corridor and a plurality of cabins on both sides of the corridor. The corridor is used as the first space 11, which is a public space, and each cabin is used as the second space 12, that is, a non-public space. A plurality of main lighting devices 13 are installed in the first space 11, and each second space 12 is installed with at least one auxiliary lighting device 14. Each main lighting device 13 is communicatively connected to one or more auxiliary lighting devices 14. In order to ensure the effectiveness of communication within the signal transmission range of each lighting device, each main lighting device is usually communicatively connected to the auxiliary lighting device adjacent to it or close to it.

[0055] The main lighting device 13 is used to collect real-time image information in the first space 11 , such as a person in the first space 11 , a person entering the second space 12 from the first space 11 , or a person entering the first space 11 from the second space 12 .

[0056] The real-time image information collected by the main lighting device 13 is associated with the identity data of the ship personnel. Specifically, the main lighting device 13 is also communicatively connected to the control terminal, and the control terminal stores the identity feature information of the ship personnel, including facial feature information and basic information, such as name, nationality, gender, or age, etc., or a combination of multiple information. The identity feature information of each person on the ship corresponds to a user ID, that is, the user terminal, the user ID and the identity feature information of the person stored in the control terminal are in a corresponding relationship. It should be noted that the identity feature information of the ship personnel can be collected and entered into the system through the collection equipment when the ship personnel board the ship, for example, through the collection equipment such as cameras, fingerprint biometric collectors, and document information collectors, and the identity feature information can also be collected through the user terminal equipped by each ship personnel. Since the identity feature information collection technology is all existing technology, it will not be repeated.

[0057] The main lighting device 13 is connected in communication with one or more auxiliary lighting devices 14 to receive the user ID of the ship personnel from the auxiliary lighting device 14. Specifically, the auxiliary lighting device 14 is connected in communication with the user terminal to collect the user ID of the ship personnel. The auxiliary lighting device 14 transmits the collected user ID of the ship personnel to the main lighting device 13. The main lighting device 13 determines the space where the ship personnel are located by combining the real-time image information and the user ID. How the main lighting device 13 specifically determines the space where the ship personnel are located will be described in detail in the positioning method below. It should be noted that the main lighting device 13 can also be directly connected in communication with the user terminal.

[0058] The user terminal may be a handheld terminal or a wearable terminal, the handheld terminal may be a mobile terminal, a pad computer, or a laptop computer, etc., and the wearable terminal may be a bracelet, a smart watch, etc. In addition, the user terminal may be used not only to input the identity information of the ship personnel, but also to perform other life functions, such as paying bills, monitoring the physical status information of the ship personnel, etc., and these functions are all prior art and will not be described in detail.

[0059] The main lighting device 13 can be connected to the auxiliary lighting device 14 in communication, and can also be connected to other main lighting devices in communication. For example, a main lighting device in a ship corridor is connected to other main lighting devices in the corridor in communication, so as to receive real-time image information from other main lighting devices, and judge the direction of travel of each ship personnel in the corridor according to the real-time image information collected by itself and from other main lighting devices, or count the total number of ship personnel in the corridor.

[0060] Specifically, the main lighting device 13 performs face recognition on the ship personnel based on the real-time image information in the first space 11, extracts the moving target in the first space 11 according to the result information of the face recognition, and monitors the movement of the moving target in the first space 11 to determine the direction of travel of the ship personnel. In addition, the main lighting device 13 can determine the total number of personnel in the first space 11 and the identity of each ship personnel according to the result information of the face recognition and the identity feature information of the ship personnel stored in the control terminal.

[0061] It should be noted that the main lighting device and the auxiliary lighting device, the main lighting device and the control terminal, the main lighting device and the user terminal, the main lighting device and the main lighting device, and the auxiliary lighting device and the user terminal can be connected for communication based on a wireless network, and the wireless network is, for example: Bluetooth network, WiFi network, mobile communication network, ZigBee network, NB-IoT network, or MavLink network, etc.

[0062] In addition, the main lighting device and the auxiliary lighting device described in this embodiment can be positioning lighting devices with completely identical functions, that is, the main lighting device and the auxiliary lighting device are both devices with processing functions; or, the main lighting device and the auxiliary lighting device can also be devices with incompletely identical functions, for example, the main lighting device is a device with a processing function, and the auxiliary lighting device is a device without a processing function, thereby reducing the positioning cost.

[0063] like Figure 2 As shown, a flow chart of a method for positioning personnel in a multi-space scene in one embodiment of the present invention is shown. In this embodiment, the multi-space scene is still set as a multi-cabin ship, and the personnel positioning method is applied to the main lighting device in the first space of the ship. The positioning method specifically includes:

[0064] S21: Collect real-time image information in the first space, and receive a user ID of a person from the auxiliary lighting device.

[0065] In this embodiment, the main lighting device collects image information of the ship personnel in the first space, and the real-time image is used to identify the identity of the personnel and further locate the space where the personnel are located. The image information may be image information such as the ship personnel are located in the first space, the ship personnel are not located in the first space, the ship personnel enter the second space from the first space, or the ship personnel enter the first space from the second space.

[0066] The main lighting device also receives the user ID of the person from the auxiliary lighting device, and the auxiliary lighting device obtains the user ID through the user terminal connected to the auxiliary lighting device for communication. This content has been explained above and will not be repeated here.

[0067] S22: Determine the location information of the person according to the real-time image information and the user ID; the location information includes information located in the first space or information located in the second space.

[0068] Preferably, the referenceability of the space where the person is located according to the real-time image information is higher than the referenceability of the space where the person is located according to the user ID. It should be noted that the main lighting device collects real-time image information inside the ship, that is, the image information of the user himself, while the auxiliary lighting device collects information of the user terminal. Those skilled in the art should take into account that when the user himself is separated from the user terminal, the main lighting device and the auxiliary lighting device may detect user signals in two different spaces at the same time. In this case, the space where the user is located should be identified based on the criterion that the referenceability of the space where the person is located according to the real-time image information is higher than the referenceability of the space where the person is located according to the user ID.

[0069] The following will use multiple embodiments to illustrate how the main lighting device identifies the user's location space based on the reference of the space where the person is located according to the real-time image information is higher than the criterion of the space where the person is located according to the user ID. For ease of explanation, in the following embodiments, the real-time image information collected by the main lighting device is named the first signal, and the information collected by the auxiliary lighting device is named the second signal.

[0070] Embodiment 1: There are 6 people walking in the corridor of the first space. The main lighting device arranged in the first space collects a first signal including images of the 6 walking people, and confirms the user IDs of the 6 walking people based on a face recognition algorithm. Since the face recognition algorithm is already available, it will not be described in detail.

[0071] In this embodiment, if the second signal received by the main lighting device from the auxiliary lighting device does not include the user ID of the six walking persons, the main lighting device can determine that the six walking persons are currently located in the first space by combining the first signal and the second signal. If the second signal received by the main lighting device from the auxiliary lighting device includes the user ID of the six walking persons, the second signal of the auxiliary lighting device contradicts the first signal of the main lighting device, and the reference of the space where the persons are located identified by the main lighting device based on the real-time image information is higher than the criterion of the space where the persons are located identified based on the user ID, and the six users are identified to be located in the first space.

[0072] Embodiment 2: There are 6 people walking in the corridor of the first space. The main lighting device arranged in the first space collects a first signal including images of the 6 walking people, and confirms the user IDs of the 6 walking people based on a face recognition algorithm. Since the face recognition algorithm is already available, it will not be described in detail.

[0073] In this embodiment, one of the six traveling personnel, for example, a ship personnel with user ID 587, enters cabin 001. Therefore, the main lighting device collects an image of ID.587 entering cabin 001 from the first space, and the first signal collected by the main lighting device after ID.587 enters cabin 001 does not include ID.587.

[0074] The main lighting device receives the second signal from the auxiliary lighting device in cabin 001. If the second signal includes ID.587, the main lighting device can determine that ID.587 is located in cabin 001 by combining the first signal and the second signal. If the signal does not include ID.587, the second signal of the auxiliary lighting device contradicts the first signal of the main lighting device. The main lighting device determines that ID.587 is located in cabin 001 because the reference of the space where the person is located identified by the real-time image information is higher than the criterion of the space where the person is located identified by the user ID.

[0075] It should be noted that, when the ship's personnel enter the corridor from the cabin, it is also possible to determine in which cabin the ship's personnel are located. The judgment principle is similar to that when the ship's personnel enter the cabin from the corridor, so it will not be repeated.

[0076] Embodiment 3: There are 6 people walking in the corridor of the first space, and the main lighting device set in the first space collects the first signal including the images of the 6 people through the image acquisition module. The main lighting device confirms the user IDs of the 6 people through the processing module based on the face recognition algorithm.

[0077] In this embodiment, one of the six traveling personnel, for example, a ship personnel with user ID 487, enters cabin 001. Therefore, the main lighting device collects an image of ID.487 entering cabin 001 from the first space, and the first signal collected by the main lighting device after ID.487 enters cabin 001 does not include ID.487.

[0078] like Figure 3 As shown, a schematic diagram of the layout of the interior of a ship in the third embodiment of the present invention is shown. Cabin 002 is adjacent to cabin 001. There is a ship personnel with a user ID of 366 in cabin 002, and his user terminal is located within the collection range of the auxiliary lighting device in cabin 001. Therefore, the second signal sent by the auxiliary lighting device in cabin 001 to the main lighting device may only include the information of the user terminal in cabin 001, or may include both the information of the user terminal in cabin 001 and the information of the user terminal in cabin 002. That is, the second signal received by the main lighting device from the auxiliary lighting device in cabin 001 may only include ID.487, or may include both ID.487 and ID.366.

[0079] The main lighting device determines the location information of user ID.487 by combining the first signal and the second signal from the auxiliary lighting device in cabin 001. Specifically, if the second signal from the auxiliary lighting device in cabin 001 only includes ID.487, the main lighting device can determine that ID.487 is located in cabin 001 by combining the first signal and the second signal; if the second signal from the auxiliary lighting device in cabin 001 includes both ID.487 and ID.366, the main lighting device can determine the location information of user ID.487 according to any one or a combination of two of the following methods, and the determination method is as follows:

[0080] Method 1) The main lighting device is located in cabin 002 according to user ID.366, and ID.366 in the second signal of the auxiliary lighting device in cabin 001 is excluded. Since the first signal includes the real-time image information of user ID.487 entering cabin 001, and the second signal includes ID.487, the first signal and the second signal of the auxiliary lighting device in cabin 001 are combined to determine that user ID.487 is located in cabin 001.

[0081] Method 2) The main lighting device determines that user ID.487 is located in cabin 001 based on the signal strength of different user terminals in the second signal, such as RSSI value, or energy feedback index and other parameters. The RSSI refers to Received Signal Strength Indication, which means the received signal strength indication, which is used to determine the link quality and whether to increase the broadcast transmission strength.

[0082] For example, since ID.487 is actually in cabin 001 and ID.366 is in cabin 002, the signal of the user terminal corresponding to ID.487 received by the auxiliary lighting device in cabin 001 must be stronger than the signal of the user terminal corresponding to ID.366, so it can be determined that user ID.487 is in cabin 001. Therefore, the location information of the ship user can be indirectly determined based on the signal strength.

[0083] It should be noted that the above two judgment methods can be used alone or in combination according to different weight ratios, and the present invention does not limit this. In addition, after excluding the identity information of other persons, if there is still interference from the identity information of the persons in the adjacent cabins, the interference can be eliminated by referring to the first or second embodiment, based on the reference of the space where the person identified by the real-time image information is located being higher than the criterion of the space where the person identified by the user ID is located.

[0084] Example 4: There are 6 people walking in the corridor of the first space, and the main lighting device set in the first space collects a first signal including images of the 6 people through the image acquisition module. The main lighting device confirms the user IDs of the 6 people through the processing module based on the face recognition algorithm.

[0085] In this embodiment, many of the six traveling personnel enter different cabins, for example, user ID.678 and user ID.688 enter cabin 003 and cabin 004 respectively. Therefore, the main lighting device collects an image of user ID.678 entering cabin 003 from the first space and an image of user ID.688 entering cabin 004 from the first space, and after user ID.678 and user ID.688 enter cabin 003 and cabin 004 respectively, the first signal collected by the main lighting device does not contain user ID.678 and user ID.688.

[0086] like Figure 4 As shown, a schematic diagram of the layout of the interior of a ship in the fourth embodiment of the present invention is shown. In the figure, the auxiliary lighting device in cabin 003 is named as auxiliary lighting device 141, and the auxiliary lighting device in cabin 004 is named as auxiliary lighting device 142. The detection area of ​​auxiliary lighting device 141 at least covers cabin 003 and cabin 004, and the detection area of ​​auxiliary lighting device 142 also at least covers cabin 003 and cabin 004; that is, the second signal collected by auxiliary lighting device 141 may only include the information of the user terminal in cabin 003, or may include both the information of the user terminal in cabin 003 and the information of the user terminal in cabin 004; the second signal collected by auxiliary lighting device 142 may only include the information of the user terminal in cabin 004, or may include both the information of the user terminal in cabin 004 and the information of the user terminal in cabin 003. The auxiliary lighting device 141 and the auxiliary lighting device 142 are both connected to the main lighting device in communication, that is, the second signal received by the main lighting device from the auxiliary lighting device 141 may include only ID.678, or may include both ID.678 and ID.688; the second signal received by the main lighting device from the auxiliary lighting device 142 may include only ID.688, or may include both ID.678 and ID.68. It should be noted that this embodiment is based on the situation that each user terminal is in normal operation.

[0087] If the second signal of the auxiliary lighting device 141 only includes ID.678, and the second signal of the auxiliary lighting device 142 only includes ID.688, the main lighting device can determine that the user with ID.678 is in cabin 003 and the user with ID.688 is in cabin 004 by combining the first signal collected by itself, the second signal of the auxiliary lighting device 141, and the second signal of the auxiliary lighting device 142.

[0088] If the second signal of the auxiliary lighting device 141 includes both ID.678 and ID.688, and the second signal of the auxiliary lighting device 142 also includes ID.678 and ID.688, the main lighting device determines the user's location information by combining the first signal collected by itself, the second signal of the auxiliary lighting device 141, and the second signal of the auxiliary lighting device 142 according to any one of the following methods or a combination of multiple methods.

[0089] Method 1) The main lighting device determines the user's location information based on the first signal, the signal strength of different user terminals in the second signal of the auxiliary lighting device 141, and the signal strength of different user terminals in the second signal of the auxiliary lighting device 142. This method can be summarized as a distance difference judgment method, which is used to judge the parameters of signal strength, such as the RSSI value of the signal or the energy feedback index, or a combination of the RSSI value and the energy feedback index.

[0090] For example, if the signal of the user terminal corresponding to ID.678 in the second signal collected by the auxiliary lighting device 141 is stronger than the signal of the user terminal corresponding to ID.688, the main lighting device can determine that the user with ID.678 is located in cabin 003 according to the first signal and the second signal of the auxiliary lighting device 141. If the signal of the user terminal corresponding to ID.688 in the second signal collected by the auxiliary lighting device 142 is stronger than the signal of the user terminal corresponding to ID.678, the main lighting device can determine that the user with ID.688 is located in cabin 004 according to the first signal and the second signal of the auxiliary lighting device 142.

[0091] Method 2) The main lighting device determines the user's location information based on the first signal, the acquisition time of signals of different user terminals in the second signal of the auxiliary lighting device 141, and the acquisition time of signals of different user terminals in the second signal of the auxiliary lighting device 142.

[0092] This method can be summarized as a time judgment method. The auxiliary lighting device scans the user terminals in its coverage area. It takes a certain amount of time from collection to receiving the feedback signal. Moreover, since the distance between the user terminals in the coverage area and the auxiliary lighting device varies, the signal feedback time of the user terminals that are closer to the auxiliary lighting device is shorter, while the signal feedback time of the user terminals that are farther away from the auxiliary lighting device is longer.

[0093] For example: the auxiliary lighting device 141 collects user terminals corresponding to ID.678 and user terminals corresponding to ID.688 in the coverage area, and the signal feedback time of the user terminal corresponding to ID.678 is shorter than the signal feedback time of the user terminal corresponding to ID.688. The main lighting device can determine that the user with ID.678 is in cabin 003 based on the time difference between the feedback times and the first signal. Similarly, the auxiliary lighting device 142 collects user terminals corresponding to ID.688 and user terminals corresponding to ID.678 in the coverage area, and the signal feedback time of the user terminal corresponding to ID.688 is shorter than the signal feedback time of the user terminal corresponding to ID.678. The main lighting device can determine that the user with ID.688 is in cabin 004 based on the time difference between the feedback times and the first signal.

[0094] Method 3) The main lighting device collects real-time images of the user with ID.678 entering cabin 003, and performs facial recognition on the user with ID.678, thereby determining that the user with ID.678 is in cabin 003; or the main lighting device collects real-time images of the user with ID.678 leaving cabin 003 and entering the first space, and the main lighting device performs facial recognition on the user with ID.678, thereby determining that the user with ID.678 is in the first space. Similarly, the main lighting device collects real-time images of the user with ID.688 entering cabin 004, and performs facial recognition on the user with ID.688, thereby determining that the user with ID.688 is in cabin 004; or the main lighting device collects real-time images of the user with ID.688 leaving cabin 004 and entering the first space, and the main lighting device performs facial recognition on the user with ID.688, thereby determining that the user with ID.688 is in the first space. This method can be summarized as an entry and exit judgment method, which has been detailed in the above-mentioned embodiments 1 to 3, and will not be repeated here.

[0095] It should be noted that the above three judgment methods can be used alone or in combination according to different weight ratios, and the present invention does not limit this. In addition, after excluding the identity information of other persons, if there is still interference from the identity information of the persons in the adjacent cabins, the interference can be eliminated by referring to the first or second embodiment, based on the reference of the space where the person identified by the real-time image information is located being higher than the criterion of the space where the person identified by the user ID is located.

[0096] It is worth noting that the existing personnel positioning technology is applied to ships, isolated islands, or remote areas far away from signal base stations, and its positioning error is large and the positioning effect is worrying. The personnel positioning method, device, system and medium of the multi-space scene provided by the present invention realize the personnel positioning function through the main and auxiliary lighting devices in different spaces through the cooperation of the main lighting device and the auxiliary lighting device, which effectively solves the technical problems of large interference and easy misjudgment of personnel positioning.

[0097] like Figure 5 As shown, a flow chart of a method for locating personnel in a multi-space scenario in an embodiment of the present invention is shown. In this embodiment, the method for locating personnel in a multi-space scenario is applied to an auxiliary lighting device, wherein the auxiliary lighting device is communicatively connected to a main lighting device and is communicatively connected to one or more user terminals; the main lighting device is located in a first space, and the auxiliary lighting device is located in a second space; the positioning method includes:

[0098] S51: receiving a user ID of a person from one or more user terminals;

[0099] S52: Transmit the user ID of the person to the main lighting device, so that the main lighting device can determine the location information of the person according to the real-time image information collected by it and the user ID; the location information includes information located in the first space or information located in the second space.

[0100] The main lighting device and the auxiliary lighting device form a local area network or connect to the Internet. The real-time image information includes: a combination of any one or more real-time image information of a person being in the first space, a person not being in the first space, a person entering the second space from the first space, and a person entering the first space from the second space.

[0101] The user terminal includes a handheld user terminal and / or a wearable user terminal, the handheld user terminal is, for example, a mobile terminal, a pad computer, a laptop computer, etc., and the wearable user terminal is, for example, a bracelet, a smart watch, etc. It should be noted that the implementation of the personnel positioning method applied to the auxiliary lighting device has been described in the implementation of the personnel positioning method applied to the main lighting device, so it will not be repeated.

[0102] like Figure 6 As shown, a schematic diagram of a personnel positioning lighting device for a multi-space scene in an embodiment of the present invention is shown. The personnel positioning lighting device for a multi-space scene is arranged in a first space and is communicatively connected to one or more external devices located in a second space. The personnel positioning lighting device comprises: an image acquisition module 61, a communication module 62, and a processing module 63, wherein the image acquisition module 61 is used to acquire real-time image information in the first space, the communication module 62 is used to communicate with an external device to receive a user ID of a person from the external device, and the processing module 63 is used to determine the position information of a person based on the real-time image information and the user ID; the position information comprises information located in the first space or information located in the second space.

[0103] The image acquisition module 61 can be a camera, such as a CMOS camera, a 360-degree panoramic camera, a CCD camera, or an infrared camera, etc.; the communication module 62 can be a wireless communication module, such as a Bluetooth communication module, a WiFi communication module, a mobile network communication module, a ZigBee communication module, a NB-IoT communication module, or a MavLink communication module, etc.; the processing module 63 can be a processor, such as an MCU processor, a DSP processor, a FPGA processor, a SoC processor, etc.

[0104] like Figure 7 As shown, a schematic diagram of a personnel positioning lighting device for a multi-space scene in an embodiment of the present invention is shown. The personnel positioning lighting device for a multi-space scene is arranged in the second space and is communicatively connected to an external device located in the first space, and the personnel positioning lighting device comprises: a first communication module 71 and a second communication module 72, wherein the first communication module 71 is used for communicatively connecting to one or more user terminals to receive a user ID of a person from the user terminal, and the second communication module 72 is used for communicatively connecting to the external device to transmit the user ID of the person to the external device.

[0105] Each of the communication modules may be, for example, a Bluetooth communication module, a WiFi communication module, a mobile network communication module, a ZigBee communication module, a NB-IoT communication module, or a MavLink communication module, etc.

[0106] Optionally, the personnel positioning lighting device for the multi-space scene further includes a human body sensing module 73, which is connected to the first communication module 71 to control the first communication module 71 to be turned on when a person is sensed. The human body sensing module includes at least one human body sensing sensor, which may be, for example, a pyroelectric sensor, a capacitive human body sensing sensor, an infrared detector, a curtain detector, a multi-beam infrared beam detector, or an infrared beam fence, etc. The human body sensing module is connected to the first communication module of the auxiliary lighting device, and is used to control the first communication module 71 to be turned on when a ship personnel is sensed. It should be noted that the human body sensing module can be integrated into the auxiliary lighting device to improve the degree of integration of the product, or the human body sensing module can be separated from the auxiliary lighting device, for example, installed at the junction of the first space and the second space, so that the action of the ship personnel entering the second space from the first space or entering the first space from the second space can be quickly and sensitively sensed.

[0107] The positioning lighting device used for locating the position information of personnel in multi-space scenes in the present invention can be a separate lighting device used only for positioning, or it can be a device with both positioning function and other functions. For example, it can also be used for fire-fighting equipment with positioning function, or alarm with positioning function, etc.

[0108] It should be noted that it should be understood that the division of the modules of the above devices is only a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or they can be physically separated. And these modules can all be implemented in the form of software called by processing elements; they can also be all implemented in the form of hardware; some modules can also be implemented in the form of software called by processing elements, and some modules can be implemented in the form of hardware. For example, the processing module can be a separately established processing element, or it can be integrated in a chip of the above device. In addition, it can also be stored in the memory of the above device in the form of program code, and called and executed by a processing element of the above device. The implementation of other modules is similar. In addition, these modules can be fully or partially integrated together, or they can be implemented independently. The processing element described here can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each module above can be completed by an integrated logic circuit of hardware in the processor element or instructions in the form of software.

[0109] For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as one or more application specific integrated circuits (ASICs), or one or more digital signal processors (DSPs), or one or more field programmable gate arrays (FPGAs). For another example, when a module above is implemented in the form of a processing element scheduling program code, the processing element may be a general-purpose processor, such as a central processing unit (CPU) or other processors that can call program codes. For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).

[0110] The present invention also provides a multi-space scene personnel positioning system, which includes multiple Figure 6 The lighting device shown in Figure 7 The lighting installations shown in Figure 6 The lighting device in the main lighting device and Figure 7The lighting device in is an auxiliary lighting device. The main lighting device is arranged in the first space of the multi-space scene, and the auxiliary lighting device is arranged in the second space of the multi-space scene; each main lighting device is communicatively connected to one or more auxiliary lighting devices, and each auxiliary lighting device is communicatively connected to one or more user terminals, wherein: the auxiliary lighting device is used to receive the user ID of the person from the user terminal, and transmit the user ID of the person to the main lighting device; the main lighting device is used to collect real-time image information in the first space, and determine the location information of the person according to the real-time image information and the user ID of the person from the auxiliary lighting device; the location information includes information located in the first space or information located in the second space.

[0111] Those skilled in the art can understand that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to the computer program. The aforementioned computer program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and other media that can store program codes.

[0112] In summary, the personnel positioning method, device, system and medium for multi-space scenes provided by the present invention jointly determine the specific position of personnel through the cooperation between the main lighting device and the auxiliary lighting device located in different spaces, thereby achieving personnel positioning while greatly reducing costs, and effectively solving technical problems such as large interference and easy misjudgment in personnel positioning. Therefore, the present invention effectively overcomes various shortcomings in the prior art and has high industrial utilization value.

[0113] The above embodiments are merely illustrative of the principles and effects of the present invention, and are not intended to limit the present invention. Anyone familiar with the art may modify or alter the above embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or alterations made by a person of ordinary skill in the art without departing from the spirit and technical concept disclosed by the present invention shall still be covered by the claims of the present invention.

Claims

1. A method for positioning personnel in multiple space scenes, characterized in that: Applicable to a main lighting device, the main lighting device is arranged in a first space and is communicatively connected to one or more auxiliary lighting devices located in a second space; The auxiliary lighting device is communicatively connected to one or more user terminals, and is used to receive a user ID of a person from the one or more user terminals; The positioning method comprises: Collecting real-time image information in the first space and receiving a user ID of a person from the auxiliary lighting device; The location information of a person is determined based on the real-time image information and the user ID; the location information includes information located in a first space or information located in a second space; the real-time image information is used to identify the identity of the person and further locate the space where the person is located; wherein the referenceability of the space where the person is located identified based on the real-time image information is higher than the space where the person is located identified based on the user ID.

2. The method for locating personnel in multiple space scenes according to claim 1, characterized in that: The main lighting device and the auxiliary lighting device form a local area network or are connected to the Internet to work.

3. The method for locating personnel in multiple space scenes according to claim 1, characterized in that: The real-time image information includes any one or more combinations of real-time image information including a person being in the first space, a person not being in the first space, a person entering the second space from the first space, and a person entering the first space from the second space.

4. The method for locating personnel in multiple space scenes according to claim 1, characterized in that: The method comprises: Collecting real-time image information of the first space; Receiving a user ID from an auxiliary lighting device of a second space; wherein the real-time image information contradicts a user ID from the one auxiliary lighting device; The referenceability of the space where the person is located identified based on the real-time image information is higher than the criterion of the space where the person is located identified based on the user ID, and the space where the person is located is identified.

5. The method for locating personnel in multiple space scenes according to claim 4, characterized in that: The real-time image information is inconsistent with a user ID from the auxiliary lighting device, which specifically includes: The real-time image information includes that a person is located in the first space, but the user ID of the auxiliary lighting device from the second space also includes the user ID of the person; or, The real-time image information includes a person entering the second space from the first space, but the user ID of the auxiliary lighting device from the second space does not include the user ID of the person; or, The real-time image information includes that a person enters the first space from the second space, but the user ID of the auxiliary lighting device from the second space still includes the user ID of the person.

6. The method for locating personnel in multiple space scenes according to claim 1, characterized in that: The method comprises: Collecting real-time image information of the first space; Receiving multiple user IDs from an auxiliary lighting device in a second space, the multiple user IDs including the user ID of the person and the user IDs of other persons; wherein the other persons are located in a signal collection area of ​​the auxiliary lighting device in the second space, but are not located in the second space; The user IDs of other persons from the multiple user IDs are excluded, and based on the criterion that the referenceability of the space where the person is located identified by the real-time image information is higher than the space where the person is located identified by the user ID, the space where the person is located is identified.

7. The method for locating personnel in multiple space scenes according to claim 6, characterized in that: The method of excluding the user IDs of other persons from the multiple user IDs includes any one or a combination of two of the following methods: Method 1) excluding user IDs of other persons from the plurality of user IDs based on the fact that the other persons are not located in the second space; Method 2) Determine the strength relationship between the signals corresponding to multiple user IDs, and exclude the user IDs corresponding to signals other than the strongest signal.

8. The method for locating personnel in multiple space scenes according to claim 1, characterized in that: The method comprises: Collecting real-time image information in the first space; Receiving multiple user IDs from the auxiliary lighting devices of the multiple second spaces, the user IDs sent by the auxiliary lighting devices of each second space include the user ID of the person entering the second space and the user IDs of one or more other persons; wherein the other persons are located within the collection range of the auxiliary lighting device in the second space but are not located in the second space; The user IDs of other persons in the multiple user IDs of the auxiliary lighting devices of each second space are excluded, and the space where each person is located is identified based on the criterion that the referenceability of the space where the person is located identified by the real-time image information is higher than the space where the person is located identified according to the user ID.

9. The method for locating personnel in multiple space scenes according to claim 8, characterized in that: The method of excluding the user IDs of other persons from the multiple user IDs of the auxiliary lighting devices of each second space includes any one or more combinations of the following methods: Method 1) respectively determining the strength relationship between the signals corresponding to the multiple user IDs of the auxiliary lighting devices of the second spaces, and excluding the user IDs corresponding to the signals other than the strongest signal; Method 2) respectively determining the duration of time spent by the auxiliary lighting device of each second space to collect data from each user ID, and excluding the user IDs corresponding to durations other than the shortest duration; Method 3) Collecting real-time image information of people entering the second space, and performing face recognition on each person in the real-time image information, and excluding user IDs of unrecognized people.

10. The method for locating personnel in multiple space scenes according to claim 1, characterized in that: The main lighting device is communicatively connected to a control terminal, and the control terminal stores a user ID of the person; the method further includes: Collecting real-time image information in the first space, and performing face recognition on each person in the real-time image information; A moving target in the first space is extracted according to the result information of face recognition, and the movement of the moving target in the first space is monitored to track the moving target.

11. The method for locating personnel in multiple space scenes according to claim 10, characterized in that: The method further comprises: The user ID of each person in the first space and the total number of people in the first space are determined according to the result information of the face recognition and the user ID of the person stored in the control terminal.

12. A personnel positioning lighting device for multiple space scenes, characterized in that: A lighting device for locating personnel is provided in a first space and is communicatively connected to one or more external devices located in a second space, wherein the external device is communicatively connected to one or more user terminals and is used to receive a user ID of a person from the one or more user terminals; the lighting device for locating personnel comprises: An image acquisition module, used to acquire real-time image information in the first space; A communication module, used for communicating with an external device to receive a user ID of a person from the external device; A processing module is used to determine the location information of a person based on the real-time image information and the user ID; the location information includes information located in a first space or information located in a second space; the real-time image information is used to identify the identity of the person and further locate the space where the person is located; wherein the referenceability of the space where the person is located identified based on the real-time image information is higher than the space where the person is located identified based on the user ID.

13. A method for locating personnel in multiple space scenes, characterized in that: Applicable to an auxiliary lighting device, the auxiliary lighting device is communicatively connected to the main lighting device and is communicatively connected to one or more user terminals; The main lighting device is arranged in the first space, and the auxiliary lighting device is arranged in the second space; The positioning method comprises: receiving a user ID of a person from one or more user terminals; The user ID of the person is transmitted to the main lighting device so that the main lighting device can determine the location information of the person based on the real-time image information collected by it and the user ID; the location information includes information located in the first space or information located in the second space; the real-time image information is used to identify the identity of the person and further locate the space where the person is located; wherein, the referenceability of the space where the person is located identified based on the real-time image information is higher than the space where the person is located identified based on the user ID.

14. The method for locating personnel in multiple space scenes according to claim 13, characterized in that: The main lighting device and the auxiliary lighting device form a local area network or are connected to the Internet to work.

15. The method for locating personnel in multiple space scenes according to claim 13, characterized in that: The real-time image information includes any one or more combinations of real-time image information including a person being in the first space, a person not being in the first space, a person entering the second space from the first space, and a person entering the first space from the second space.

16. The method for locating personnel in multiple space scenes according to claim 13, characterized in that: The user terminal includes a handheld user terminal and / or a wearable user terminal.

17. A personnel positioning lighting device for multiple space scenes, characterized in that: The personnel positioning lighting device is arranged in the second space and is communicatively connected to an external device located in the first space, and includes: A first communication module, used for communicating with one or more user terminals to receive a user ID of a person from the user terminal; A second communication module, used for communicating with the external device to transmit the user ID of the person to the external device; The external device determines the location information of the person based on the real-time image information and user ID collected by it; the location information includes information located in the first space or information located in the second space; the real-time image information is used to identify the identity of the person and further locate the space where the person is located; wherein the referenceability of the space where the person is located identified based on the real-time image information is higher than the space where the person is located identified based on the user ID.

18. The personnel positioning lighting device for multiple space scenes according to claim 17, characterized in that: The device also includes: The human body sensing module is connected to the first communication module to control the first communication module to be turned on when a person is sensed.

19. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the personnel positioning method for a multi-space scene described in any one of claims 1 to 11 is implemented, or when the program is executed by a processor, the personnel positioning method for a multi-space scene described in any one of claims 13 to 16 is implemented.

Images