Information processing method and device based on intelligent building Internet of Things platform
Through the intelligent building Internet of Things platform and edge computing devices, user information is processed and virtual objects are generated for guidance, which solves the problem of inaccurate positioning in the intelligent building, and improves user activity convenience and load balancing of the Internet of Things platform.
Patent Information
- Application Number
- CN202410853669.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-28
- Publication Date
- 2025-01-17
- Estimated Expiration
- 2044-06-28
AI Technical Summary
Positioning and guidance in intelligent buildings are problematic due to different building spatial structures, and it is difficult for the prior art to achieve accurate user positioning and guidance.
Through the intelligent building Internet of Things platform, edge computing devices are used to process user identification information and monitoring information, generate virtual objects, and superimpose guidance information on the monitoring screen of multiple monitoring devices, so as to achieve accurate guidance of users in the building and reduce the central server. The information processing pressure ensures the load balance of the IoT platform.
It realizes accurate user positioning and guidance in smart buildings without the need for precise positioning systems, improves the convenience of users' activities in buildings, and reduces the pressure of information processing on the Internet of Things platform.
Smart Images

Figure CN118433220B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of Internet of Things and information processing technology, and in particular, relates to an information processing method and device based on an intelligent building Internet of Things platform. Background Art
[0002] The Internet of Things (IoT) is a network based on information carriers such as the Internet and traditional telecommunications networks, which allows all ordinary objects that can be independently addressed to be interconnected. By applying IoT technology, objects can be connected to the network and exchange information and communicate according to the agreed protocol, thereby realizing various intelligent functions. For example, by applying IoT technology in buildings, intelligent buildings can be constructed, thereby improving the convenience of people living or working there.
[0003] Smart buildings have different internal structures and layouts. For example, people's activities inside large shopping malls, office buildings, apartments, residential buildings, etc. may need to be guided by a precise positioning system. However, the positioning inside the building may be affected by many factors, such as the different floors where people are located, which may affect the accuracy of the positioning results. Therefore, accurate positioning and guidance with the help of terminals and devices connected to the IoT platform inside smart buildings has become a focus of attention for technicians in this field. Summary of the invention
[0004] In view of this, the present application provides an information processing method and device based on the smart building Internet of Things platform, which can realize accurate positioning and guidance of users in the building with the help of the Internet of Things platform inside the smart building, avoiding the problem of inaccurate positioning caused by factors such as different spatial structures in the building when using the existing positioning system for positioning and guidance. In the process of realizing the positioning and guidance of users, the processing of relevant information in the present application is completed by the edge computing devices associated with the corresponding monitoring equipment, which reduces the information processing pressure of the central server of the Internet of Things platform, helps to maintain the relative balance of the amount of information that each edge computing device needs to process, and ensures the load balance of the entire Internet of Things platform.
[0005] The first aspect of the present application provides an information processing method based on an intelligent building Internet of Things platform, which is applied to an edge computing device, and the method includes:
[0006] After the first terminal is connected to the smart building Internet of Things platform, receiving identification information of the first user sent by the first terminal;
[0007] Acquire monitoring information of the first user collected by a first monitoring device;
[0008] generating a virtual object representing the first user based on the identification information and the monitoring information;
[0009] Determine in sequence a plurality of subsequent monitoring devices of the first monitoring device, any of the subsequent monitoring devices being associated with an edge computing device;
[0010] The virtual object is superimposed on the monitoring screen collected by each of the continuous monitoring devices to generate guidance information; wherein the monitoring screen collected by each of the continuous monitoring devices includes the first user, and the guidance information is generated by the edge computing device associated with each of the continuous monitoring devices after the first user moves to the monitoring coverage area of the corresponding continuous monitoring device;
[0011] The guiding information is sent to the first terminal to guide the first user to move inside the intelligent building.
[0012] The second aspect of the present application provides an information processing device based on an intelligent building Internet of Things platform, comprising:
[0013] An identification information receiving module, configured to receive identification information of a first user sent by the first terminal after the first terminal accesses the intelligent building Internet of Things platform;
[0014] A monitoring information acquisition module, used to acquire the monitoring information of the first user collected by the first monitoring device;
[0015] a virtual object generation module, configured to generate a virtual object for representing the first user based on the identification information and the monitoring information;
[0016] A monitoring device determination module, used to sequentially determine a plurality of subsequent monitoring devices of the first monitoring device, any of which is associated with an edge computing device;
[0017] A guidance information generation module, configured to respectively superimpose the virtual object on the monitoring screen collected by each of the continuous monitoring devices to generate guidance information; wherein the monitoring screen collected by each of the continuous monitoring devices includes the first user, and the guidance information is respectively generated by the edge computing device associated with each of the continuous monitoring devices after the first user moves to the monitoring coverage area of the corresponding continuous monitoring device;
[0018] The guidance information sending module is used to send the guidance information to the first terminal to guide the first user to move inside the intelligent building.
[0019] The third aspect of the present application provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the information processing method based on the smart building Internet of Things platform as described in the first aspect above.
[0020] The fourth aspect of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the information processing method based on the smart building Internet of Things platform as described in the first aspect above.
[0021] The fifth aspect of the present application provides a computer program product. When the computer program product is run on a computer, the computer executes the information processing method based on the smart building Internet of Things platform described in the first aspect above.
[0022] Compared with the prior art, this application has the following beneficial effects:
[0023] In the embodiment of the present application, in combination with the smart building IoT platform, the first terminal connected to the IoT platform can receive in real time the guidance information generated by the edge computing device based on the monitoring screen of the user's actual location at that time, and guide the user's activities inside the smart building. In this way, positioning and guidance inside the building can be achieved without the help of an accurate positioning system, thereby improving the convenience of users' activities inside the building. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] In order to more clearly illustrate the technical solutions in this application, the following is a brief introduction to the drawings required for use in the embodiments or prior art descriptions. Obviously, the drawings described below are only some embodiments of this application, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0025] Figure 1 It is a schematic diagram of an information processing method based on an intelligent building Internet of Things platform provided in an embodiment of the present application;
[0026] Figure 2 This is a schematic diagram of the architecture of an intelligent building Internet of Things platform provided in an embodiment of the present application;
[0027] Figure 3 It is a schematic diagram of a possible implementation of S103 in an information processing method based on an intelligent building Internet of Things platform provided in an embodiment of the present application;
[0028] Figure 4It is a schematic diagram of a possible implementation of S104 in an information processing method based on an intelligent building Internet of Things platform provided in an embodiment of the present application;
[0029] Figure 5 is a schematic diagram of installation information of various monitoring devices represented in a tree structure provided by an embodiment of the present application;
[0030] Figure 6 It is a schematic diagram of a possible implementation of S1042 in an information processing method based on an intelligent building Internet of Things platform provided in an embodiment of the present application;
[0031] Figure 7 It is a schematic diagram of a possible implementation of S105 in an information processing method based on an intelligent building Internet of Things platform provided in an embodiment of the present application;
[0032] Figure 8 It is a schematic diagram of an information processing device based on an intelligent building Internet of Things platform provided by an embodiment of the present application;
[0033] Fig. 9 It is a schematic diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0034] In the following description, specific details such as specific system structures, technologies, etc. are proposed for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from hindering the description of the present application.
[0035] The technical solution of the present application is described below through specific embodiments.
[0036] Reference Figure 1 , shows a schematic diagram of an information processing method based on an intelligent building Internet of Things platform provided by an embodiment of the present application, which may specifically include the following steps:
[0037] S101. After a first terminal accesses an intelligent building Internet of Things platform, identification information of a first user sent by the first terminal is received.
[0038] It should be noted that this method can be applied to a computer device, which can be used as an edge computing device in the smart building Internet of Things platform to process relevant information in the Internet of Things platform. That is, the execution subject of the embodiment of the present application is a computer device that is an edge computing device in the Internet of Things platform. By executing the various steps in the embodiment of the present application, the computer device can realize the positioning and activity guidance of users entering the smart building based on the Internet of Things platform.
[0039] like Figure 2 As shown in FIG. 1 , it is a schematic diagram of the architecture of an intelligent building Internet of Things platform provided by an embodiment of the present application. Figure 2 The IoT platform shown includes a central server 201, a plurality of edge computing devices 202 (i.e. Figure 2 The edge computing device 1, edge computing device 2, ... edge computing device N, etc. shown in FIG. 1 and multiple terminals, devices and / or sensors connected to the above-mentioned Internet of Things. For example, multiple monitoring devices 203 (i.e. Figure 2 Monitoring device 1, monitoring device 2, ... monitoring device N, etc.) shown in FIG.
[0040] In an embodiment of the present application, each terminal, device and / or sensor connected to the Internet of Things may be associated with multiple edge computing devices, and these multiple edge computing devices include at least one edge computing master device and one or more edge computing slave devices. Figure 2 As shown, the edge computing master device associated with monitoring device 1 is edge computing device 1 (in Figure 2 ), and its associated edge computing slave devices include edge computing device 2 and edge computing device 3 (in Figure 2 The dashed lines connect the Figure 2 The relationship between other monitoring devices and edge computing devices is not shown). When processing the information collected or transmitted by each connected terminal, device and / or sensor, the embodiment of the present application preferentially uses the edge computing master device to complete it. If the amount of information that the edge computing master device needs to process is large, the edge computing slave device can be called to process the information, so as to ensure that the amount of information that each edge computing device in the Internet of Things platform needs to process is relatively balanced.
[0041] In a possible implementation of the embodiment of the present application, the edge computing host device associated with each terminal, device and / or sensor connected to the Internet of Things can be relatively fixed. Figure 2The edge computing master device associated with monitoring device 1 is always edge computing device 1. The edge computing master device associated with each terminal, device and / or sensor can be determined based on the location of the terminal, device and / or sensor and the location of the edge computing device, thereby reducing the distance of information transmission. Alternatively, the edge computing master device can be determined based on the type of information processed by each edge computing device. For example, edge computing devices 1-10 (not fully shown in the figure) can be configured as edge computing masters for each monitoring device, and edge computing devices 11-20 (not fully shown in the figure) can be configured as edge computing masters for various types of sensors such as photoelectric sensors and voice-controlled sensors. For edge computing slave devices, the embodiments of the present application may limit their number or not. For example, in the case of limiting the number of edge computing slave devices, Figure 2 The edge computing devices 2 and 3 in the monitoring device 1 are used as edge computing slave devices; without limiting the number of edge computing slave devices, Figure 2 All edge computing devices in the monitoring device 1 serve as edge computing slave devices, so that in actual application, appropriate edge computing slave devices are selected according to specific needs, and this embodiment of the present application does not limit this.
[0042] The intelligent building in the embodiment of the present application can be a single building, or a building complex composed of multiple single buildings. Among them, the single building can be a public building such as a shopping mall, a hospital outpatient building or an inpatient building, a library, or an office building, an apartment or a residential building. In a building complex composed of multiple single buildings, the types of each single building can be the same or different. For example, a building complex can be composed of a variety of buildings with different functions and uses, such as an industrial park composed of factories, dormitories, and public activity spaces, or a hospital campus composed of outpatient buildings and inpatient buildings. The embodiment of the present application does not limit the existence form of intelligent buildings.
[0043] In the embodiment of the present application, the first user may be a user entering the smart building, for example, a visitor entering a residential building, etc. The first terminal may be a terminal held by the first user, such as a mobile phone, a tablet computer, etc. The embodiment of the present application does not limit the type of the first terminal.
[0044] When the first user enters the smart building with the first terminal, the first terminal can access the smart building IoT platform. For example, when the first user enters an office building or a residential building with a mobile phone, the mobile phone can access the smart building IoT platform. Figure 2 The Internet of Things shown.
[0045] In the embodiment of the present application, after the first terminal is connected to the smart building Internet of Things platform, the computer device as the edge computing device can receive the identification information of the first user sent by the first terminal. The identification information can be information characterizing the characteristics of the first user. Exemplarily, the identification information can include the face information, fingerprint information, etc. of the first user.
[0046] It should be noted that the information collection process (such as the face image collection process, fingerprint information collection process, etc.) / feature extraction process involved in the embodiments of the present application is performed with the knowledge and permission of the user. That is, the information collection process / feature extraction process meets the relevant requirements and does not constitute an act that harms the public interest. For example, the face information and fingerprint information of the first user mentioned above should be collected with the knowledge and consent of the first user.
[0047] In a possible implementation of the embodiment of the present application, the identification information is the facial information of the first user. The first user can hold the first terminal and use the front camera of the first terminal to perform facial recognition to collect the facial information of the first user. The facial information collected by the first terminal can be sent to the edge computing device.
[0048] In one example, the edge computing device that receives the facial information of the first user collected by the first terminal may be an edge computing master device corresponding to a terminal, device, or sensor in the area where the first user is currently located. Figure 2 In the monitoring coverage area of the monitoring device 1, the first terminal can send the facial information of the first user to the edge computing main device associated with the monitoring device 1, that is, Figure 2 The edge computing device 1 shown in the figure is further processed by the edge computing host device.
[0049] In another example, before the first terminal sends the facial information of the first user to the edge computing master device, it can inquire about the information processing capacity of the edge computing master device. If the amount of information being processed or to be processed by the edge computing master device exceeds a certain value, it means that the edge computing master device may not be able to continue to process the subsequently received information. At this time, the edge computing master device can feedback the information of the edge computing slave device available for processing to the first terminal, and the first terminal can send the facial information of the first user to the edge computing slave device.
[0050] In a possible implementation of an embodiment of the present application, when the number of edge computing slave devices includes multiple ones, the edge computing master device can determine an edge computing slave device from the multiple devices according to the actual situation, and feed it back to the first terminal. Exemplarily, the edge computing master device can determine which device to select as the edge computing slave device according to the amount of information currently being processed or to be processed by each edge computing slave device. The amount of information processed by each of the above edge computing devices can be fed back to each edge computing device by the central server at regular intervals. In this way, each edge computing device can know the operating status of other edge computing devices, so that when it acts as an edge computing master device and needs to determine an edge computing slave device, it can select an edge computing slave device from each device according to actual needs.
[0051] S102: Obtain monitoring information of the first user collected by a first monitoring device.
[0052] In the embodiment of the present application, the first monitoring device may be the first monitoring device that the first user faces when entering the building, that is, after entering the building, the first user will first be in the monitoring coverage area of the first monitoring device. The monitoring information of the first user may be video information or image information collected by the first monitoring device. For example, the first monitoring device may be Figure 2 The monitoring device 1 in the embodiment can perform video monitoring on the first user after the first user enters the building to obtain corresponding video monitoring information.
[0053] In a possible implementation of the embodiment of the present application, the first monitoring device may be slightly different from the other monitoring devices. For example, Figure 2 The monitoring device 1 in the embodiment is slightly different from other monitoring devices, such as monitoring devices 2-N. Specifically, the first monitoring device may have a point cloud acquisition function, and can acquire point cloud information of the first user.
[0054] Usually, the entrance of a smart building is fixed, and the path for users to enter the building is also fixed. Therefore, it is only necessary to configure a first monitoring device with a point cloud acquisition function at the entrance of the smart building, and then the point cloud information of the first user can be acquired by using the first monitoring device.
[0055] In an embodiment of the present application, after the first monitoring device collects the point cloud information of the first user, the point cloud information can be sent to an edge computing device, such as an edge computing master device associated with the first monitoring device or an edge computing slave device.
[0056] The manner in which the first monitoring device determines the edge computing master device or edge computing slave device that will send the point cloud information can refer to the manner in which the first terminal determines the edge computing master device or edge computing slave device corresponding to the identification information of the first user in the aforementioned S101, and this embodiment of the present application will not go into details.
[0057] S103: Generate a virtual object for representing the first user based on the identification information and the monitoring information.
[0058] In an embodiment of the present application, after receiving the identification information sent by the first terminal and the monitoring information sent by the first monitoring device, the computer device can verify the first user based on the above identification information and monitoring information, and generate a virtual object for representing the first user after the verification is passed. The virtual object can be used in the subsequent guidance of the first user in the building.
[0059] In a possible implementation of the embodiment of the present application, the identification information is the face information of the first user, and the monitoring information is the point cloud information of the first user. Figure 3 As shown, in the above S103, generating a virtual object for representing the first user based on the identification information and the monitoring information may specifically include the following steps S1031-S1034:
[0060] S1031. Extracting a face point cloud from the point cloud information.
[0061] In the embodiment of the present application, the point cloud information collected by the first monitoring device may be a full body point cloud of the first user or a half body point cloud of the first user. The computer device may extract the face point cloud of the first user from the point cloud information.
[0062] S1032: Perform human-machine matching between the first user and the first terminal according to the facial information and the facial point cloud.
[0063] In the embodiment of the present application, human-machine matching between the first user and the first terminal belongs to the verification process of the first user, and its purpose is to confirm whether the first terminal connected to the Internet of Things platform is held by the first user.
[0064] In a specific implementation, the computer device can match the face information and the face point cloud to determine whether they are the same face. If so, it can be determined that the first user and the first terminal have successfully matched.
[0065] S1033: After the first user and the first terminal are matched, determine basic features of the first user according to the monitoring information.
[0066] In an embodiment of the present application, the basic characteristics of the first user may include the first user's clothing, appearance and other characteristics. Depending on actual needs, the basic characteristics of the first user determined by the computer device from the monitoring information may be different. For example, the computer device may obtain external characteristics such as the color of the first user's clothing, the general style, whether the first user wears a mask, etc. These characteristics obtained by the computer device can be used in the subsequent generation of a virtual object representing the first user.
[0067] S1034: Generate a virtual object representing the first user based on the point cloud information of the first user and the basic features, where the virtual object has the basic features of the first user.
[0068] In an embodiment of the present application, the computer device may generate a virtual object based on the acquired basic features of the first user, and use the virtual object to refer to the first user.
[0069] In a possible implementation of the embodiment of the present application, the virtual object generated by the computer device may have the basic features of the first user. In this way, the association between the virtual object and the first user can be enhanced, and the use of the virtual object in subsequent activity guidance can also enhance the fun of the guidance process.
[0070] In the embodiment of the present application, virtual objects of different similarities can be generated according to different needs, and the similarity can be used to represent the similarity between the virtual object finally generated and the first user. Usually, the computer device obtains more basic features from the monitoring information, so that a virtual object more similar to the first user can be obtained when generating a virtual object; accordingly, if the basic features obtained by the computer device are relatively less, the similarity between the generated virtual object and the first user is also lower. That is, the number of basic features of the first user obtained by the computer device is proportional to the similarity between the virtual object finally generated and the first user. Of course, the computer device obtains more basic features from the monitoring information, and the amount of information required to process to generate a virtual object more similar to the first user is more; conversely, the amount of information that needs to be processed is less. Therefore, the computer device can select a corresponding number of basic features for generating virtual objects according to the amount of information it is processing or to be processed, and the embodiment of the present application is not limited to this.
[0071] S104. Determine in sequence a plurality of subsequent monitoring devices of the first monitoring device, any of the subsequent monitoring devices being associated with an edge computing device.
[0072] In the embodiment of the present application, the successive monitoring devices may be those monitoring devices that will be contacted in sequence when the first user moves in the building, that is, the activity path of the first user will pass through the monitoring coverage area of each successive monitoring device in sequence.
[0073] In a possible implementation of the embodiment of the present application, the sequentially determined successive monitoring devices may be determined starting from the first monitoring device, one by one from those monitoring devices whose monitoring coverage areas are adjacent to the monitoring coverage area of the first monitoring device.
[0074] For example, Figure 2 The monitoring device 1 in the figure is the first monitoring device. Assuming that the monitoring coverage area of the monitoring device 1 is adjacent to the monitoring coverage areas of the monitoring devices 2 and 3, the subsequent monitoring devices to be determined in sequence should first be determined from the monitoring devices 2 and 3. Assuming that the subsequent monitoring device of the monitoring device 1 is the monitoring device 2, the subsequent determination process is similar to the above process, that is, the monitoring device 2 can be regarded as the first monitoring device, and then the subsequent monitoring device of the first monitoring device is determined, assuming that it is the monitoring device 4. At this time, it means that the activity path of the first user in the building will move from the monitoring coverage area of the monitoring device 1 to the monitoring coverage area of the monitoring device 2, and then to the monitoring coverage area of the monitoring device 4.
[0075] In the embodiment of the present application, when determining the successive monitoring device, if adjacent monitoring coverage areas belong to the monitoring coverage areas of two or more monitoring devices, the successive monitoring device may be determined in different ways.
[0076] In a possible implementation of an embodiment of the present application, assuming that the target location of the first user's activity in the building is determined, the computer device can plan an activity path for the first user based on the determined target location, thereby determining the next subsequent monitoring device adjacent to each monitoring device based on the relationship between the activity path and the monitoring coverage area.
[0077] In another possible implementation of the embodiment of the present application, assuming that the target position of the first user's activity in the building is uncertain, that is, the first user's activity does not have a clear target position, the computer device can predict the next subsequent monitoring device based on the real-time activity trajectory of the first user in a certain monitoring coverage area. For example, when the first user moves along a straight line in the monitoring coverage area of the monitoring device 2, the computer device can preferentially determine the monitoring device to which the monitoring coverage area corresponding to the extension of the straight line belongs as the subsequent monitoring device. When the first user moves along a curve in the monitoring coverage area of the monitoring device 2, the computer device can draw a curve based on the real-time position of the first user in the monitoring screen, and determine the monitoring device to which the monitoring coverage area corresponding to the extension of the tangent of each point on the curve belongs as the subsequent monitoring device. Of course, considering that the real-time calculation of the tangent of the curve may bring about a large amount of information processing, the computer device can extract the position point of the first user at a certain time interval, and determine the subsequent monitoring device by the monitoring device to which the monitoring coverage area corresponding to the extension of the line connecting the two adjacent points belongs.
[0078] In a possible implementation of the embodiment of the present application, as Figure 4 As shown, in S104, multiple subsequent monitoring devices of the first monitoring device are sequentially determined, which may specifically include the following steps S1041-S1043:
[0079] S1041. Acquire installation information of each monitoring device installed inside the intelligent building, wherein the installation information includes positional relationship information between monitoring coverage areas of each monitoring device formed in a tree structure.
[0080] In an embodiment of the present application, the Internet of Things platform may store installation information of various monitoring devices installed inside the smart building, and the installation information may represent the positional relationship between the respective monitoring coverage areas in the form of a tree structure.
[0081] like Figure 5 , which is a schematic diagram of the installation information of each monitoring device represented by a tree structure provided in an embodiment of the present application. Figure 5 Each circle in represents a monitoring device, and the numbers in the circles represent the changes of the monitoring devices, that is, number 1 represents monitoring device 1, number 2 represents monitoring device 2, and so on. Figure 5 Monitoring devices 1-8 are shown in FIG. Assuming that monitoring device 1 is the first monitoring device and its monitoring coverage area is adjacent to the monitoring coverage areas of monitoring devices 2-4, the circles representing monitoring devices 1-4 can be connected by straight lines. Figure 5 The line between any two circles in indicates that the monitoring coverage areas of the corresponding two monitoring devices are adjacent. Figure 5In (a), the monitoring coverage area of monitoring device 2 is adjacent to the monitoring coverage areas of monitoring device 1 , monitoring device 3 , monitoring device 5 and monitoring device 6 .
[0082] S1042. Predict a probability value of each monitoring device one by one based on the position relationship information and the monitoring information collected by the first monitoring device, wherein the probability value is used to indicate the possibility of the first user activity being within the monitoring coverage area of the corresponding monitoring device.
[0083] In the embodiment of the present application, after obtaining Figure 5 After the position relationship information is displayed, the computer device can predict the possibility of the first user moving into the monitoring coverage area of the corresponding monitoring device one by one, and the possibility can be expressed by a probability value. Generally, the larger the probability value, the more likely the first user is to move into the corresponding monitoring coverage area. When predicting the probability value, the computer device can only process those monitoring devices whose monitoring coverage areas have an adjacent relationship.
[0084] For example, Figure 5 In (a), the monitoring coverage area of monitoring device 2 is adjacent to the monitoring coverage areas of monitoring device 1, monitoring device 3, monitoring device 5 and monitoring device 6, then the computer device can only predict the probability value of the first user moving from the monitoring coverage area of monitoring device 2 to the monitoring coverage areas of monitoring device 1, monitoring device 3, monitoring device 5 and monitoring device 6. In an example, assuming that the predicted probability values of monitoring device 1, monitoring device 3, monitoring device 5 and monitoring device 6 are 3%, 11%, 36% and 50% respectively, it means that the probability of the first user moving from the monitoring coverage area of monitoring device 2 to the monitoring coverage areas of monitoring device 1, monitoring device 3, monitoring device 5 and monitoring device 6 is 3%, 11%, 36% and 50% respectively. It can be seen that since the probability value of monitoring device 6 is the largest, it can be considered that the first user has a greater probability of moving from the monitoring coverage area of monitoring device 2 to the monitoring coverage area of monitoring device 6.
[0085] In a specific implementation, the computer device can predict the probability value of each monitoring device based on the activity path of the first user in the current monitoring coverage area, and can also predict the probability value in combination with the actual position relationship between adjacent monitoring coverage areas and the environmental features between the boundaries of the monitoring coverage areas. The above environmental features can be determined based on the monitoring screens collected by the monitoring devices. For example, if the boundary of the monitoring coverage areas of two monitoring devices is a separated obstacle, it can be considered based on the environmental features that the first user cannot move between the two monitoring coverage areas at all. Therefore, the probability value of adjacent monitoring devices can be 0.
[0086] In a possible implementation of the embodiment of the present application, the computer device may also update the installation information of each monitoring device represented by a tree structure according to the real-time environmental characteristics. Figure 5 In (a), if the monitoring device 3 and the monitoring device 6 belong to the type where the boundary of the monitoring coverage area is an obstacle, the computer device can Figure 5 The installation information represented by (a) in FIG. 1 is updated, and the connection line between the two circles representing monitoring device 3 and monitoring device 6 is deleted, and the following is obtained: Figure 5 The installation information shown in (b) in the figure.
[0087] S1043. Determine, in turn from each monitoring device, a plurality of subsequent monitoring devices of the first monitoring device according to the probability value.
[0088] In the embodiment of the present application, the monitoring device with the largest probability value can be used as the subsequent monitoring device of the previous monitoring device according to the probability value, thereby obtaining multiple subsequent monitoring devices of the first monitoring device.
[0089] It should be noted that the computer device may update each connection monitoring device according to the actual activity path of the first user, thereby ensuring that the monitoring coverage area where the connection monitoring device is located is more consistent with the actual activity path of the first user.
[0090] In a possible implementation of the embodiment of the present application, as Figure 6 As shown, in S1042, the probability value of each monitoring device is predicted one by one according to the position relationship information and the monitoring information collected by the first monitoring device, which may specifically include the following steps S1421-S1423:
[0091] S1421. Determine an activity direction of the first user according to the monitoring information collected by the first monitoring device.
[0092] In an embodiment of the present application, the monitoring information collected by the monitoring device may be video information or image information. Based on the position change of the first user on the video screen or image, the activity direction of the first user may be determined. For example, the activity direction of the first user within the monitoring coverage area of the first monitoring device may be determined based on the monitoring information collected by the first monitoring device.
[0093] S1422. Predict the probability value of the first user moving to the monitoring coverage areas of each monitoring device adjacent to the first monitoring device based on the activity direction and the positional relationship information between the monitoring coverage areas of each monitoring device.
[0094] After determining the activity direction of the first user, the probability value of the first user moving to an adjacent monitoring coverage area can be predicted by combining the direction and the positional relationship between the monitoring coverage areas of each monitoring device. For example, the probability value of the first user moving from the monitoring coverage area of the first monitoring device to the adjacent monitoring coverage area is predicted.
[0095] In a specific implementation, a ray may be drawn with the current location of the first user as the endpoint and the activity direction of the first user as the direction, and the current location of the first user and the center point of the monitoring coverage area of each monitoring device may be connected, and the probability value may be predicted by the angle formed by the above two line segments. Generally, the closer the angle is to zero, the greater the possibility that the first user is active in the monitoring coverage area of the corresponding monitoring device, and the greater the corresponding probability value.
[0096] S1423. After the first user actually enters a monitoring coverage area of a certain monitoring device, redetermine the activity direction of the first user according to the behavior of the first user in the monitoring coverage area, and predict the probability values of each adjacent monitoring device based on the redetermined activity direction.
[0097] In an embodiment of the present application, after the computer device predicts the probability values of each monitoring device adjacent to the first monitoring device, one or more monitoring devices with relatively large probability values can be used as subsequent monitoring devices of the first monitoring device.
[0098] In a possible implementation of the embodiment of the present application, two monitoring devices with the largest probability values can be selected as the subsequent monitoring devices of the first monitoring device. Assume that they are monitoring device 2 and monitoring device 3. Then, the activity of the first user in the first monitoring device is continuously analyzed. After the first user actually enters the monitoring coverage area of a certain monitoring device, for example, after actually entering the monitoring coverage area of monitoring device 2, the computer device can determine that the subsequent monitoring device of the first monitoring device is monitoring device 2. At this time, the computer device can take monitoring device 2 as the first monitoring device, repeat the above steps, and determine the subsequent monitoring device of monitoring device 2.
[0099] S105: Superimpose the virtual object on the monitoring screen collected by each of the continuous monitoring devices to generate guidance information.
[0100] In the embodiment of the present application, each monitoring screen collected by the continuous monitoring device may include the first user. The computer device may generate guidance information for guiding the activities of the first user in the building by superimposing the generated virtual objects on the monitoring screens collected by the continuous monitoring devices.
[0101] In a specific implementation, the above guidance information can be generated by the edge computing device associated with each connection monitoring device after the first user moves to the monitoring coverage area of the corresponding connection monitoring device.
[0102] In a possible implementation of the embodiment of the present application, as Figure 7 As shown, in S105, a virtual object is superimposed on each monitoring screen collected by each subsequent monitoring device to generate guidance information, which may specifically include the following steps S1051-S1054:
[0103] S1051. Determine the target location of the first user.
[0104] S1052: Plan the activity path of the first user within the monitoring coverage area of each of the subsequent monitoring devices based on the target location.
[0105] In the embodiment of the present application, the target location of the first user may be a location that the first user expects to reach in a building. For example, an office on a certain floor of an office building, a specific location in a shopping mall, a park, or a hospital, etc. After determining the target location of the first user, the computer device may plan the activity path of the first user in the monitoring coverage area of each subsequent monitoring device based on the target location.
[0106] S1053: When the first user moves to the monitoring coverage area of any of the continuous monitoring devices, the edge computing device associated with the continuous monitoring device receives the monitoring images collected by the continuous monitoring device.
[0107] S1054: Draw the activity path in the monitoring screen, and overlay the virtual object on the activity path to generate the guidance information.
[0108] When the first user moves to the monitoring coverage area of any connected monitoring device, the edge computing device associated with the connected monitoring device can receive the monitoring screen collected by the monitoring device, and generate guidance information by drawing the activity path in the monitoring screen and superimposing virtual objects.
[0109] Exemplarily, when the first user is active in the monitoring coverage area of the first monitoring device, the relevant information collected by the first monitoring device can be processed preferentially by the edge computing master device associated with the first monitoring device. If the amount of information currently processed by the edge computing master device associated with the first monitoring device is large, the above information processing can also be completed by a certain edge computing slave device associated with the first monitoring device.
[0110] Assuming that the relevant information collected by the first monitoring device is processed by the edge computing master device associated with the first monitoring device, after the first user moves to the monitoring coverage area of monitoring device 2, the edge computing device associated with monitoring device 2 can receive the monitoring screen collected by monitoring device 2, and generate guidance information by drawing the activity path in the monitoring screen and superimposing virtual objects. The edge computing device associated with the above-mentioned monitoring device 2 can be an edge computing master device associated with monitoring device 2, or it can be an edge computing slave device. This depends on the amount of information actually processed by the edge computing master device or edge computing slave device associated with monitoring device 1 or monitoring device 2.
[0111] In another possible implementation of the embodiment of the present application, after the first user moves from the monitoring coverage area of the first monitoring device, i.e., monitoring device 1, to the monitoring coverage area of monitoring device 2, the edge computing master device associated with monitoring device 1 may continue to process the relevant information collected by monitoring device 2 according to the actual situation of the edge computing master device associated with monitoring device 1 and the edge computing device associated with monitoring device 2. When the first user moves from the monitoring coverage area of monitoring device 2 to the monitoring coverage area of monitoring device 3, according to the actual situation of the edge computing master device associated with monitoring device 1 and the edge computing device associated with monitoring device 3, the edge computing master device associated with monitoring device 1 may no longer be used to process the relevant information collected by monitoring device 3, but the edge computing master device associated with monitoring device 3 may process the relevant information collected by monitoring device 3, and the embodiment of the present application does not limit this.
[0112] As an example of an embodiment of the present application, the successive monitoring device includes a second monitoring device and a third monitoring device adjacent to the monitoring coverage area, namely, monitoring device 2 and monitoring device 3. Before the edge computing device associated with the successive monitoring device receives the monitoring screen collected by the successive monitoring device, it also includes:
[0113] When the first user moves to the edge of the monitoring coverage area of the second monitoring device, the edge computing device associated with the second monitoring device sends an information processing transfer instruction to the edge computing device associated with the third monitoring device. The above information processing transfer instruction can be used to instruct the edge computing device associated with the third monitoring device to take over the edge computing device associated with the second monitoring device to communicate with the first terminal, so as to continue to guide the first user to move inside the smart building.
[0114] S106: Send the guidance information to the first terminal to guide the first user to move inside the intelligent building.
[0115] After the computer device generates corresponding guidance information according to the monitoring images collected by each monitoring device corresponding to the location of the first user, the guidance information can be sent to the first terminal to guide the activities of the first user inside the intelligent building.
[0116] In the embodiment of the present application, the guidance information may be generated based on the monitoring screens collected by the monitoring devices corresponding to the location of the first user, which is the monitoring screen actually captured by the monitoring device. On this basis, the computer device may overlay virtual objects and possible activity paths on the monitoring screen to show the deviation between the actual activity path of the first user and the planned activity path, so as to guide the user to better move within the building and quickly reach the target location.
[0117] In a possible implementation of the embodiment of the present application, the guidance information generated by the computer device can also be sent to the second terminal, and the second terminal can be used to display the activities of the first user inside the smart building to the second user in real time. The second user can be the user that the first user is going to visit, or the security personnel in the building. In this way, the second user that the first user is going to visit or the security personnel in the building can understand the activities of the first user in the building in real time.
[0118] In another possible implementation of the embodiment of the present application, the computer device sequentially determines multiple subsequent monitoring devices of the first monitoring device, which can also be implemented through the indication information of the second user. Specifically, the computer device can receive the indication information of the second user sent by the second terminal, and determine the multiple subsequent monitoring devices of the first monitoring device according to the indication information.
[0119] In one example, based on the first user's activity status displayed in real time on the second terminal, the second user can inform the first user through voice that at a certain location, they can "turn left and walk 100 meters" or "go up the stairs to the 5th floor and turn left." The computer device connected to the Internet of Things platform can process the second user's voice, determine the corresponding location information, and determine the subsequent monitoring device of the current monitoring device based on the location information.
[0120] In the embodiment of the present application, in combination with the smart building IoT platform, the first terminal connected to the IoT platform can receive in real time the guidance information generated by the edge computing device based on the monitoring screen of the user's actual location at that time, and guide the user's activities inside the smart building. In this way, positioning and guidance inside the building can be achieved without the help of an accurate positioning system, thereby improving the convenience of users' activities inside the building.
[0121] It should be noted that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0122] Reference Figure 8, shows a schematic diagram of an information processing device based on an intelligent building Internet of Things platform provided by an embodiment of the present application, which may specifically include an identification information receiving module 801, a monitoring information acquisition module 802, a virtual object generation module 803, a monitoring device determination module 804, a guidance information generation module 805 and a guidance information sending module 806, wherein:
[0123] The identification information receiving module 801 is used to receive the identification information of the first user sent by the first terminal after the first terminal accesses the smart building Internet of Things platform;
[0124] A monitoring information acquisition module 802 is used to acquire the monitoring information of the first user collected by a first monitoring device;
[0125] A virtual object generation module 803, configured to generate a virtual object for representing the first user based on the identification information and the monitoring information;
[0126] A monitoring device determination module 804, configured to sequentially determine a plurality of subsequent monitoring devices of the first monitoring device, any of the subsequent monitoring devices being associated with an edge computing device;
[0127] A guidance information generating module 805 is used to overlay the virtual object on the monitoring screen collected by each of the continuous monitoring devices to generate guidance information; wherein the monitoring screen collected by each of the continuous monitoring devices includes the first user, and the guidance information is generated by the edge computing device associated with each of the continuous monitoring devices after the first user moves to the monitoring coverage area of the corresponding continuous monitoring device;
[0128] The guidance information sending module 806 is used to send the guidance information to the first terminal to guide the first user to move inside the intelligent building.
[0129] In a possible implementation manner of the embodiment of the present application, the identification information may include facial information of the first user, the monitoring information includes point cloud information of the first user, and the virtual object generation module 803 may be specifically used to:
[0130] Extracting a face point cloud from the point cloud information;
[0131] Performing human-machine matching between the first user and the first terminal according to the facial information and the facial point cloud;
[0132] After the first user and the first terminal are matched, basic features of the first user are determined according to the monitoring information;
[0133] Based on the point cloud information of the first user and the basic features, a virtual object representing the first user is generated, and the virtual object has the basic features of the first user.
[0134] In a possible implementation of the embodiment of the present application, the monitoring device determination module 804 may be specifically used to:
[0135] Acquire installation information of each monitoring device installed inside the intelligent building, wherein the installation information includes positional relationship information between monitoring coverage areas of each monitoring device formed in a tree structure;
[0136] Predicting the probability value of each monitoring device one by one according to the position relationship information and the monitoring information collected by the first monitoring device, the probability value being used to indicate the possibility of the first user activity being within the monitoring coverage area of the corresponding monitoring device;
[0137] According to the probability value, a plurality of subsequent monitoring devices of the first monitoring device are determined from each monitoring device in turn.
[0138] In another possible implementation of the embodiment of the present application, the monitoring device determination module 804 may also be used to:
[0139] determining an activity direction of the first user according to the monitoring information collected by the first monitoring device;
[0140] Predicting the probability value of the first user moving to the monitoring coverage area of each monitoring device adjacent to the first monitoring device based on the activity direction and the positional relationship information between the monitoring coverage areas of each monitoring device;
[0141] After the first user actually enters the monitoring coverage area of a certain monitoring device, the activity direction of the first user is re-determined according to the behavior of the first user in the monitoring coverage area, and the probability values of each adjacent monitoring device are predicted based on the re-determined activity direction.
[0142] In a possible implementation of the embodiment of the present application, the guidance information sending module 806 may also be used to:
[0143] Sending the guidance information to a second terminal, where the second terminal is used to display the activities of the first user inside the smart building to the second user in real time;
[0144] Accordingly, the monitoring device determination module 804 may also be used to:
[0145] receiving indication information of the second user sent by the second terminal;
[0146] Determine a plurality of subsequent monitoring devices of the first monitoring device according to the indication information.
[0147] In a possible implementation of the embodiment of the present application, the guidance information generation module 805 may be specifically used to:
[0148] determining a target location of the first user;
[0149] Planning the activity path of the first user within the monitoring coverage area of each of the subsequent monitoring devices based on the target location;
[0150] When the first user moves to the monitoring coverage area of any of the continuous monitoring devices, the edge computing device associated with the continuous monitoring device receives the monitoring screen collected by the continuous monitoring device;
[0151] The activity path is drawn in the monitoring screen, and the virtual object is superimposed on the activity path to generate the guidance information.
[0152] In another possible implementation of the embodiment of the present application, the connection monitoring device may include a second monitoring device and a third monitoring device having adjacent monitoring coverage areas, and the guidance information generating module 805 may also be used to:
[0153] When the first user moves to the edge of the monitoring coverage area of the second monitoring device, the edge computing device associated with the second monitoring device sends an information processing transfer instruction to the edge computing device associated with the third monitoring device. The information processing transfer instruction is used to instruct the edge computing device associated with the third monitoring device to take over communication with the first terminal to continue guiding the first user to move inside the smart building.
[0154] The information processing device based on the smart building Internet of Things platform provided in the embodiment of the present application may be the computer device in the aforementioned embodiments, and the computer device may be used as an edge computing device in the smart building Internet of Things platform; or the aforementioned device may be one or more components in the computer device. The device provided in the embodiment of the present application may be used to implement the various steps in the aforementioned method embodiments.
[0155] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment part.
[0156] Reference Fig. 9 , shows a schematic diagram of a computer device provided by an embodiment of the present application. Fig. 9As shown, the computer device 900 in the embodiment of the present application includes: a processor 910, a memory 920, and a computer program 921 stored in the memory 920 and executable on the processor 910. When the processor 910 executes the computer program 921, the steps in each embodiment of the above-mentioned information processing method based on the smart building Internet of Things platform are implemented, such as Figure 1 Alternatively, when the processor 910 executes the computer program 921, the functions of each module / unit in the above-mentioned device embodiments are realized, for example Figure 8 Functions of modules 801 to 806 are shown.
[0157] Exemplarily, the computer program 921 may be divided into one or more modules / units, which are stored in the memory 920 and executed by the processor 910 to complete the present application. The one or more modules / units may be a series of computer program instruction segments that can perform specific functions, and the instruction segments may be used to describe the execution process of the computer program 921 in the computer device 900. For example, the computer program 921 may be divided into an identification information receiving module, a monitoring information acquisition module, a virtual object generation module, a monitoring device determination module, a guidance information generation module, and a guidance information sending module, and the specific functions of each module are as follows:
[0158] An identification information receiving module, configured to receive identification information of a first user sent by the first terminal after the first terminal accesses the intelligent building Internet of Things platform;
[0159] A monitoring information acquisition module, used to acquire the monitoring information of the first user collected by the first monitoring device;
[0160] a virtual object generation module, configured to generate a virtual object for representing the first user based on the identification information and the monitoring information;
[0161] A monitoring device determination module, used to sequentially determine a plurality of subsequent monitoring devices of the first monitoring device, any of which is associated with an edge computing device;
[0162] A guidance information generation module, configured to respectively superimpose the virtual object on the monitoring screen collected by each of the continuous monitoring devices to generate guidance information; wherein the monitoring screen collected by each of the continuous monitoring devices includes the first user, and the guidance information is respectively generated by the edge computing device associated with each of the continuous monitoring devices after the first user moves to the monitoring coverage area of the corresponding continuous monitoring device;
[0163] The guidance information sending module is used to send the guidance information to the first terminal to guide the first user to move inside the intelligent building.
[0164] The computer device 900 may be a device capable of implementing the relevant steps or functions in the aforementioned method embodiments. The computer device 900 may be used as an edge computing device to build an intelligent building Internet of Things platform with various sensors, monitoring devices, and other terminals and servers installed in the building. The computer device may be a desktop computer, a cloud server, or other computing device. The computer device 900 may include, but is not limited to, a processor 910 and a memory 920. Those skilled in the art will understand that Fig. 9 This is only an example of the computer device 900 and does not constitute a limitation of the computer device 900. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the computer device 900 may also include input and output devices, network access devices, buses, etc.
[0165] The processor 910 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.
[0166] The memory 920 may be an internal storage unit of the computer device 900, such as a hard disk or memory of the computer device 900. The memory 920 may also be an external storage device of the computer device 900, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the computer device 900. Further, the memory 920 may also include both an internal storage unit of the computer device 900 and an external storage device. The memory 920 is used to store the computer program 921 and other programs and data required by the computer device 900. The memory 920 may also be used to temporarily store data that has been output or is to be output.
[0167] An embodiment of the present application also discloses a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the information processing method based on the smart building Internet of Things platform as described in the aforementioned embodiments is implemented.
[0168] An embodiment of the present application also discloses a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the information processing method based on the smart building Internet of Things platform as described in the above-mentioned embodiments.
[0169] An embodiment of the present application also discloses a computer program product. When the computer program product is run on a computer, the computer executes the information processing method based on the smart building Internet of Things platform described in the aforementioned embodiments.
[0170] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application is described in detail with reference to the above-mentioned embodiments, a person skilled in the art should understand that the technical solutions described in the above-mentioned embodiments can still be modified, or some of the technical features can be replaced by equivalents; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application.
Claims
1. An information processing method based on an intelligent building Internet of Things platform, characterized in that: Applied to an edge computing device, the edge computing device includes an edge computing master device and one or more edge computing slave devices, the method is performed by the edge computing master device, when the amount of information processed by the edge computing master device exceeds a certain value, the edge computing master device calls the edge computing slave device to process the information, the method includes: After the first terminal is connected to the smart building Internet of Things platform, receiving identification information of the first user sent by the first terminal; Acquire monitoring information of the first user collected by a first monitoring device; generating a virtual object representing the first user based on the identification information and the monitoring information; Determine in sequence a plurality of subsequent monitoring devices of the first monitoring device, any of the subsequent monitoring devices being associated with an edge computing device; The virtual object is superimposed on the monitoring screen collected by each of the continuous monitoring devices to generate guidance information; wherein the monitoring screen collected by each of the continuous monitoring devices includes the first user, and the guidance information is generated by the edge computing device associated with each of the continuous monitoring devices after the first user moves to the monitoring coverage area of the corresponding continuous monitoring device; Sending the guidance information to the first terminal to guide the first user to move inside the intelligent building; The step of sequentially determining a plurality of subsequent monitoring devices of the first monitoring device comprises: Acquire installation information of each monitoring device installed inside the intelligent building, the installation information including positional relationship information between monitoring coverage areas of each monitoring device formed in a tree structure, each circle in the installation information represents a monitoring device, when any two circles in the installation information are connected by a straight line, it means that the monitoring coverage areas of the two monitoring devices corresponding to the two circles are adjacent, the installation information is also updated according to environmental characteristics, and the update includes deleting a line between two circles representing the two monitoring devices when the boundaries of the monitoring coverage areas of the two monitoring devices are obstacles; Predicting the probability value of each monitoring device one by one according to the position relationship information and the monitoring information collected by the first monitoring device, the probability value being used to indicate the possibility of the first user activity being within the monitoring coverage area of the corresponding monitoring device; According to the probability value, determining a plurality of subsequent monitoring devices of the first monitoring device from each monitoring device in turn; The predicting the probability value of each monitoring device one by one according to the position relationship information and the monitoring information collected by the first monitoring device includes: determining an activity direction of the first user according to the monitoring information collected by the first monitoring device; Predicting the probability value of the first user moving to the monitoring coverage area of each monitoring device adjacent to the first monitoring device based on the activity direction and the positional relationship information between the monitoring coverage areas of each monitoring device; After the first user actually enters the monitoring coverage area of a certain monitoring device, the activity direction of the first user is re-determined according to the behavior of the first user in the monitoring coverage area, and the probability values of each adjacent monitoring device are predicted based on the re-determined activity direction.
2. The method according to claim 1, characterized in that The identification information includes facial information of the first user, the monitoring information includes point cloud information of the first user, and the generating a virtual object for representing the first user based on the identification information and the monitoring information includes: Extracting a face point cloud from the point cloud information; Performing human-machine matching between the first user and the first terminal according to the facial information and the facial point cloud; After the first user and the first terminal are matched, basic features of the first user are determined according to the monitoring information; Based on the point cloud information of the first user and the basic features, a virtual object representing the first user is generated, and the virtual object has the basic features of the first user.
3. The method according to claim 1, characterized in that Also includes: Sending the guidance information to a second terminal, where the second terminal is used to display the activities of the first user inside the smart building to the second user in real time; Accordingly, the method of sequentially determining a plurality of subsequent monitoring devices of the first monitoring device further includes: receiving indication information of the second user sent by the second terminal; Determine a plurality of subsequent monitoring devices of the first monitoring device according to the indication information.
4. The method according to claim 1, characterized in that The step of respectively superimposing the virtual object on the monitoring screen collected by each of the continuous monitoring devices to generate guidance information includes: determining a target location of the first user; Planning the activity path of the first user within the monitoring coverage area of each of the subsequent monitoring devices based on the target location; When the first user moves to the monitoring coverage area of any of the continuous monitoring devices, the edge computing device associated with the continuous monitoring device receives the monitoring screen collected by the continuous monitoring device; The activity path is drawn in the monitoring screen, and the virtual object is superimposed on the activity path to generate the guidance information.
5. The method according to claim 4, characterized in that The continuous monitoring device includes a second monitoring device and a third monitoring device with adjacent monitoring coverage areas. When the first user moves to the monitoring coverage area of any of the continuous monitoring devices, before the edge computing device associated with the continuous monitoring device receives the monitoring screen collected by the continuous monitoring device, the method further includes: When the first user moves to the edge of the monitoring coverage area of the second monitoring device, the edge computing device associated with the second monitoring device sends an information processing transfer instruction to the edge computing device associated with the third monitoring device. The information processing transfer instruction is used to instruct the edge computing device associated with the third monitoring device to take over communication with the first terminal to continue guiding the first user to move inside the smart building.
6. An information processing device based on an intelligent building Internet of Things platform, characterized in that: Applied to edge computing devices, the edge computing devices include an edge computing master device and one or more edge computing slave devices, the related information processing is completed by the edge computing master device, when the amount of information processed by the edge computing master device exceeds a certain value, the edge computing master device calls the edge computing slave device to process the information, the device includes: An identification information receiving module, configured to receive identification information of a first user sent by the first terminal after the first terminal accesses the intelligent building Internet of Things platform; A monitoring information acquisition module, used to acquire the monitoring information of the first user collected by the first monitoring device; a virtual object generation module, configured to generate a virtual object for representing the first user based on the identification information and the monitoring information; A monitoring device determination module, used to sequentially determine a plurality of subsequent monitoring devices of the first monitoring device, any of which is associated with an edge computing device; A guidance information generation module, configured to respectively superimpose the virtual object on the monitoring screen collected by each of the continuous monitoring devices to generate guidance information; wherein the monitoring screen collected by each of the continuous monitoring devices includes the first user, and the guidance information is respectively generated by the edge computing device associated with each of the continuous monitoring devices after the first user moves to the monitoring coverage area of the corresponding continuous monitoring device; A guidance information sending module, used for sending the guidance information to the first terminal to guide the first user to move inside the intelligent building; The monitoring device determination module is specifically used to: Acquire installation information of each monitoring device installed inside the intelligent building, the installation information including positional relationship information between monitoring coverage areas of each monitoring device formed in a tree structure, each circle in the installation information represents a monitoring device, when any two circles in the installation information are connected by a straight line, it means that the monitoring coverage areas of the two monitoring devices corresponding to the two circles are adjacent, the installation information is also updated according to environmental characteristics, and the update includes deleting a line between two circles representing the two monitoring devices when the boundaries of the monitoring coverage areas of the two monitoring devices are obstacles; Predicting the probability value of each monitoring device one by one according to the position relationship information and the monitoring information collected by the first monitoring device, the probability value being used to indicate the possibility of the first user activity being within the monitoring coverage area of the corresponding monitoring device; According to the probability value, determining a plurality of subsequent monitoring devices of the first monitoring device from each monitoring device in turn; The monitoring device determination module is further used for: determining an activity direction of the first user according to the monitoring information collected by the first monitoring device; Predicting the probability value of the first user moving to the monitoring coverage area of each monitoring device adjacent to the first monitoring device based on the activity direction and the positional relationship information between the monitoring coverage areas of each monitoring device; After the first user actually enters the monitoring coverage area of a certain monitoring device, the activity direction of the first user is re-determined according to the behavior of the first user in the monitoring coverage area, and the probability values of each adjacent monitoring device are predicted based on the re-determined activity direction.
7. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the information processing method based on the smart building Internet of Things platform is implemented as described in any one of claims 1 to 5.
8. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the information processing method based on the smart building Internet of Things platform is implemented as described in any one of claims 1 to 5.
Citation Information
Patent Citations
Guide method, device and system based on Internet of Things
CN114543816A
Intelligent video monitoring method and system based on multi-camera data fusion
CN116582653A