Smart Asset Management System

Abstract

The present invention provides a smart asset management system, including a positioning device configured for various types of assets, a smart mobile terminal held by a manager and an analysis terminal, the smart mobile terminal communicates with the analysis terminal, the positioning device is started according to a preset startup cycle, and the positioning information is sent to the analysis terminal, the analysis terminal analyzes the flow trajectory of various types of assets according to the positioning information sent by the positioning device corresponding to each type of asset, and records any one or a combination of the asset's purchase information, use information, maintenance information, update information, and relocation information, and compares the flow trajectory analysis result with any one or a combination of the purchase information, use information, maintenance information, update information, and relocation information, so as to realize smart asset management. Through this system, flexible, efficient, accurate and timely positioning information of various types of assets is obtained, and management efficiency is improved.

Description

Technical Field

[0001] The present invention relates to an asset management system, and in particular to an intelligent asset management system, which is used for integrating, analyzing and managing the location and flow of assets, and belongs to the field of item tracking. Background Art

[0002] The campuses of schools, institutions, enterprises and public institutions are equipped with many assets related to teaching, scientific research, office (instruments, computers, tables and chairs, etc.) and basic daily necessities (such as water dispensers, air conditioners, lighting, etc.). These assets generally need to be regularly maintained and updated, and corresponding records and reports should be followed up to integrate resources and manage them efficiently. However, there are some situations where personnel may move some movable assets or take them out of the campus for various reasons (such as teaching, business trips, etc.), which will lead to the flow trajectory of assets and the risk of loss or even loss. This requires the use of positioning and image recording information to achieve trackable trajectories.

[0003] However, the existing technology generally realizes the positioning of assets and items through active or passive patch-shaped chips. However, due to the limitations of the appearance and usage scenarios of the items, not all assets are suitable for the patch form (such as some experimental glassware, or scientific research equipment that needs to eliminate signal interference). In addition, the existing technologies emphasize positioning, and do not track its flow trajectory and analyze the reasons for the trajectory. Real-time positioning will increase the computing power burden, and when the power of the active positioning device is exhausted, there will be the disadvantage of missing analysis data due to possible untimely charging and equipment aging and failure. Since the trajectory does not care about all points at all times, generally only some points are needed to analyze the approximate trajectory from the starting point to the end point. Therefore, how to reasonably allocate the time distribution of data and simplify the trajectory. It is also a problem to be considered in the efficient management of these assets. Summary of the invention

[0004] In view of the above problems, the present invention considers the following solutions: first, matching different positioning devices for different asset types; second, adopting a time-sharing method to collect positioning information and describe simplified trajectories; third, analyzing the causes of the trajectories. It should be emphasized that the corresponding positioning device only collects positioning information once during the startup cycle of the present invention, and the positioning information sent by different types of positioning devices is no longer named differently.

[0005] Based on the above problems, on one hand, the present invention provides a smart asset management system, including a positioning device configured for each type of asset, a smart mobile terminal held by a manager, and an analysis terminal, wherein the positioning device includes a satellite positioning device or a patch chip equipped with a sensor, as well as a micro camera and a rangefinder, and the smart mobile terminal communicates with the analysis terminal. The positioning device is started according to a preset startup cycle and sends positioning information to the analysis terminal. The analysis terminal analyzes the flow trajectory of each type of asset according to the positioning information sent by the positioning device corresponding to each type of asset, and records any one or a combination of the asset's purchase information, usage information, maintenance information, update information, and relocation information. The flow trajectory analysis result is compared with any one or a combination of the purchase information, usage information, maintenance information, update information, and relocation information to realize smart asset management, wherein the usage information, maintenance information, update information, and relocation information are confirmed to the analysis terminal in advance (i.e., before use, before maintenance, before update, and before relocation) by the smart mobile terminal.

[0006] Optionally, for assets with a curb mass exceeding a first preset mass (such as 10kg) but not exceeding a second preset mass (such as 25kg) and with any dimension less than a preset dimension (such as 50±5cm), a satellite positioning device as shown or a chip equipped with a sensor is configured; for assets with a curb mass between the second preset mass and a third preset mass (such as 25kg-170kg) but not equal to the second preset mass (such as 25kg), a rangefinder or a chip equipped with a sensor is configured; for assets with a curb mass exceeding the third preset mass (such as 170kg), a rangefinder is configured; for assets with a curb mass not exceeding the first preset mass (such as 10kg), a miniature camera is set at the placement location.

[0007] Preferably, the patch chip includes an RFID sensor chip, and a plurality of readers and writers and a plurality of sensors are correspondingly configured in the managed place (such as a campus). When the asset with the RFID sensor chip is in a position capable of receiving the radio frequency signal emitted by the reader and writer, and if it is within the reader and writer startup cycle, the reader and writer emits a radio frequency signal, so that the RFID sensor chip obtains energy and transmits positioning information to the sensor, which is then sent to the analysis terminal by the sensor. The reader and writer startup cycle is 5min-8h.

[0008] It is understandable that the reason for choosing 8 hours is that, considering the 8-hour workday, assets may be moved during the working day, so the location change is likely to occur within 8 hours.

[0009] More preferably, multiple readers are configured with different reader start-up cycles. Since not all assets change positions frequently, setting different start-up cycles can adapt to the frequency. It can also reduce the aging problem of components that work for a long time.

[0010] Optionally, the satellite positioning device or the patch chip equipped with a sensor sends positioning information to the analysis terminal when it is started. When the straight-line distance between two positioning information exceeds a first preset value of 3-10 meters, the analysis terminal records the first start flow information.

[0011] Since different flow trajectories have different reasons behind them, if it is only for rearrangement (belonging to relocation information), or use, maintenance, or update, the distance will not be very large; if it is relocation or temporary move to another place, the distance will generally be very long. Therefore, through the straight-line distance measurement of different periods, not only the simplified (not all trajectory points are recorded at all times) flow trajectory, time information, and the three possible reasons for the flow of assets can be recorded, but also compared with the recorded use information, maintenance information, update information, etc., to determine whether it is a move, relocation, or temporary move caused by use, maintenance, update, etc., so as to accurately track assets. If the use information, maintenance information, and update information are empty, it indicates negligence in management registration, and there can be a plan to initiate accountability.

[0012] Optionally, the rangefinder is set in any wall, ground, or support on which the asset is placed, so that the distance to the asset or the obstacle can be measured when it is started. When the distance exceeds a second preset value of 1-2 meters, a second start flow information is sent to the analysis terminal, and positioning information is sent to the analysis terminal within a preset startup period of 0.5h-30d.

[0013] It is understandable that the preset startup cycle time span is large because some assets move frequently, such as elevators. Therefore, the detection time is as short as 0.5 hours. Generally, when the elevator's distance measurement produces a 0.5-hour distance measurement abnormality during the period when it should move (rush hour, lunch, etc.), the elevator is considered to be faulty. Although the elevator has its own fault remote monitoring system, it is only for the elevator product itself, and the system is not incorporated into asset management. When the product software and system are not compatible, we still monitor the movement of the elevator. For 30 days, some assets that hardly move are considered, such as medium and large scientific research equipment, air conditioning outdoor units, and ventilation equipment.

[0014] Preferably, the rangefinder includes a rangefinder head, a rangefinder chip, a first wireless transmitting device, and a signal line. The rangefinder head and the rangefinder chip, the signal line and the rangefinder chip, and the signal line and the first wireless transmitting device are detachably connected through a first interface. The rangefinder chip, the signal line, and the rangefinder head are embedded in the wall, the ground, or a support for placing assets, and a first inspection door with an exposure hole for the rangefinder head is provided on the surface of the wall, the ground, or the support for placing assets. When the first inspection door is closed, the surface of the first inspection door is flush with the surface of the wall, the ground, or the support for placing assets. When the first inspection door is opened, the rangefinder head and the rangefinder chip can be maintained and updated by unplugging the first interface, and the first wireless transmitting device can also be maintained and updated by unplugging the first interface. The first wireless transmitting device communicates with the analysis terminal to send positioning information to the analysis terminal.

[0015] Preferably, there are multiple micro cameras, which are respectively arranged on the ceiling of the room and in a second inspection door with a camera hole on the wall. The startup cycle of the micro camera is 4h-1d. The micro camera includes a camera body, a second wireless transmitting device, and a signal line that can detachably connect the camera body and the second wireless transmitting device through a second interface.

[0016] Since the corresponding mass of the micro-camera is relatively light (such as the keyboard, mouse, notebook, and lighting device of the desktop computer), the types are diverse (small test equipment, such as ultrasonic generators, pipettes, magnetic stirrers, analytical test instruments, such as portable instruments, the host of the electrochemical workstation, etc.), or the quantity is large (such as experimental glassware), the frequency of movement is relatively large, and the movement trajectory is relatively complex, it is impractical to configure rangefinders for each of them. The solution of using multiple cameras to shoot as a whole and intelligently identify objects can track these assets. Therefore, it is more appropriate to set the startup cycle to within one day and consider it between half of the working day (morning and afternoon).

[0017] Optionally, the positioning information sent by the micro camera to the analysis terminal is an image or a video.

[0018] The method for the analysis terminal to analyze the flow tracks of various types of assets according to the positioning information sent by the positioning devices corresponding to various types of assets specifically includes:

[0019] The S1 analysis terminal sets the startup cycle of various positioning devices and receives the positioning information sent by various positioning devices during their respective startup cycles. If the information is not received, the positioning device abnormality information is generated.

[0020] S2 For satellite positioning devices or patch chips and rangefinders equipped with sensors, the analysis terminal draws the flow trajectory according to the positioning information sent by various positioning devices during their respective startup cycles. For micro cameras, the analysis terminal identifies the assets in the venue according to the images or videos, and draws the flow trajectory for the same asset identified in different venues.

[0021] S3 displays the flow trajectory on an electronic map. By clicking a point on the flow trajectory corresponding to the positioning information sent during the startup cycle, the corresponding positioning information can be displayed.

[0022] Optionally, you can click on any point on the flow trajectory to display the location information of the assets surrounding the point, and click on the surrounding assets again to display the corresponding location information and the historical flow trajectory, and further click on the historical flow trajectory to display more surrounding asset location information and corresponding more historical flow trajectories.

[0023] The method of identifying assets in a place according to the image or video and drawing a flow trajectory through the same asset identified in different places further includes the following method steps:

[0024] Q1 In the location, the micro camera shoots various types of assets and obtains multiple images or multiple videos of each type of asset. The multiple images or multiple videos have watermarks corresponding to the coordinates of the corresponding micro camera that performs the shooting behavior.

[0025] Q2 pre-processes the image to obtain multiple corresponding images or video frames with uniform size, resolution, brightness and saturation setting parameters, and cuts and copies the watermark.

[0026] Q3 builds an artificial intelligence model, divides multiple images or video frames into training sets and verification sets with a ratio of 7-4:1, substitutes the training set into the established artificial intelligence model for training, verifies the accuracy through the verification set, continuously optimizes the model parameters, obtains the final asset recognition model, builds a natural language analysis model (NLP), divides the watermark into training sets and verification sets to train the natural language analysis model, verifies the accuracy through the verification set, continuously optimizes the model parameters, and obtains the coordinate recognition model.

[0027] Q4 captures images or videos of different places during different startup cycles, pre-processes the images or video frames according to the Q2 method, and substitutes them into the corresponding asset recognition model and coordinate recognition model in Q3 to obtain the positioning information of various assets in the image, and draws the flow trajectory of the same asset in different places based on the positioning information. Among them, for multiple micro cameras in the same place, the coordinates of one of them are selected as the unified coordinates of all micro cameras in the place.

[0028] Optionally, the specific method of drawing the flow trajectory of the same asset in different places based on the positioning information described in Q4 is, for the satellite positioning device or the surface-mount chip equipped with a sensor, and the rangefinder, connecting the points on the flow trajectory corresponding to the positioning information sent during the startup cycle with a straight line; for the micro camera, when it is identified that the same asset disappears from the location where it appears in the historical images and videos, but appears in another place in the post-startup period, the flow trajectory is drawn on the electronic map according to the identified coordinates corresponding to the two different places.

[0029] Preferably, all positioning information includes coordinate information and additional information including the name, location and number of the asset, and the artificial intelligence model includes a convolutional neural network (CNN).

[0030] It is easy to understand that if the same asset appears in images and video frames taken at different locations during different startup cycles, it means that the same asset has generated a flow track. In this case, there is no limit on the threshold of the moving distance. Because the distance between different locations is different, it may be different rooms less than 3 meters apart, or it may be two buildings far apart. However, as long as the above-mentioned disappearance and appearance in different places occur, it is determined to have generated a flow track.

[0031] The smart mobile terminal held by the manager has a positioning function and is installed with an asset management app. When the analysis terminal obtains a flow trajectory based on the positioning information, it immediately determines whether the flow trajectory of the smart mobile terminal held by the searched manager matches the flow trajectory. If it matches, it compares any one of the usage information, maintenance information, update information, and relocation information or a combination thereof. If it matches, it determines that the flow trajectory obtained by analysis is caused by the corresponding usage behavior, maintenance behavior, update behavior, and relocation behavior, and displays the status as normal. Otherwise, the asset management app reminds the manager holding the smart mobile terminal to confirm whether there is usage behavior, maintenance behavior, update behavior, and relocation behavior related to the flow trajectory obtained by the analysis, and displays the reminder message on the analysis terminal. If confirmed, a notification of filing record is issued. Otherwise, when the manager fails to confirm within 8h-24h, or uninstalls the asset management app and needs to enter confirmation information on the smart mobile terminal, the analysis terminal determines the timeout and failure to confirm, and the confirmation information will be sent to the analysis terminal. As long as the analysis terminal receives the confirmation information, the program for judging the timeout and failure to confirm the uninstalled personnel is terminated; if it does not match, it is judged as non-management behavior.

[0032] It is easy to understand that reminders for patches, satellite positioning, and rangefinders will not occur every day and disturb management personnel, because they are only executed when the corresponding asset generates positioning devices that can detect the start of flow, and the analysis terminal analyzes the flow trajectory, and it is also required that the above comparison fails. There are many conditions to meet, and reminder messages will not be easily generated. Because generally for the moving distance threshold of 3-10 meters, generally small-scale daily office needs will not generate trajectories. If you move long distances within the campus and the distance out of the campus is too large, it will (to indicate possible usage information).

[0033] However, image and video-based recognition may trigger alerts due to the frequent movement of assets, which urges managers to properly manage frequently used or replaced assets. Therefore, we have equivalently adjusted the level of attention paid to asset management for assets that are not frequently moved and those that are relatively frequently moved by setting the movement threshold distance and special tracking settings for small objects for the camera. When managers uninstall the app, it will be displayed on the analysis terminal, so that the reasons for uninstallation can be analyzed and personnel management can be strengthened.

[0034] Optionally, the method for determining whether the moving trajectory of the smart mobile terminal held by the searched manager matches the flow trajectory is to determine whether the positioning information corresponding to the point within the startup cycle on the flow trajectory matches the positioning information of the point on the moving trajectory obtained by the positioning function.

[0035] Optionally, calculating whether the positioning information on the flow trajectory corresponding to the point in the startup cycle matches the positioning information of the point on the moving trajectory obtained by the positioning function further specifically includes obtaining the coordinate information of the positioning information on the flow trajectory corresponding to the point in the startup cycle, and the coordinate information of the point on the moving trajectory obtained by the positioning function, and comparing whether there is a distance between the two coordinate information that is less than a preset value, wherein the preset value is less than or equal to 3m.

[0036] In another aspect, the present invention provides a computer-readable non-transitory storage medium provided in an analysis terminal of a smart asset management system, wherein a program that can be executed by the analysis terminal to implement smart asset management is stored.

[0037] The third aspect of the present invention provides a storage medium installed in a smart mobile terminal held by a manager in a smart asset management system, wherein an asset management application app is stored, which is used to confirm usage information, maintenance information, update information, relocation information, and confirmation of usage behavior, maintenance behavior, update behavior, and relocation behavior to an analysis terminal in advance. Beneficial Effects

[0038] First, the present invention classifies different assets and equips different types of positioning devices in a targeted manner, so as to better meet the physical inherent properties of the assets and the requirements of the working environment. Second, the positioning device is started periodically to slow down the aging of the positioning device, and it is flexibly adjusted according to the frequency of flow to respond to flow behavior. Third, the image intelligent recognition of relatively light and numerous assets makes it possible to locate and identify the flow of assets with complex flow situations. Fourth, based on the positioning comparison between the manager's smart mobile terminal and the flow path, the reasons for the implementation of asset flow can be tracked in time, and an intelligent management model with personal responsibility can be implemented through the app. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1a A schematic diagram of a location A showing the overall configuration of the smart asset management system according to Embodiment 1 of the present invention;

[0040] Figure 1b A schematic diagram of an electron microscope room of the overall configuration of the smart asset management system of Example 1 of the present invention;

[0041] Figure 2a A schematic diagram of a scene at time t1 of the overall configuration of the smart asset management system according to Embodiment 1 of the present invention;

[0042] Figure 2b A schematic diagram of a scene at time t2 of the overall configuration of the smart asset management system according to Embodiment 1 of the present invention;

[0043] Figure 3 This is a schematic diagram of an integrated reader / writer and sensor structure according to Embodiment 1 of the present invention;

[0044] Figure 4a This is a schematic diagram of the burying method of the rangefinder according to Embodiment 1 of the present invention;

[0045] Figure 4b This is a schematic diagram of the structure of a rangefinder according to Embodiment 1 of the present invention;

[0046] Figure 4c This is a schematic diagram of the embedding method of the micro camera according to Embodiment 1 of the present invention;

[0047] Figure 4d Schematic diagram of the structure of a micro camera according to Embodiment 1 of the present invention.

[0048] Figure 5a A grayscale diagram of the method flow of analyzing the flow trajectories of various types of assets according to the positioning information sent by the positioning devices corresponding to various types of assets by the analysis terminal in Embodiment 2 of the present invention;

[0049] Figure 5bA color diagram of the method flow of analyzing the flow tracks of various types of assets by the analysis terminal according to the positioning information sent by the positioning devices corresponding to various types of assets in Embodiment 2 of the present invention;

[0050] Figure 6a This is a schematic diagram of the flow trajectory of assets in Example 2 of the present invention;

[0051] Figure 6b This is a schematic diagram of surrounding assets in Example 2 of the present invention;

[0052] Figure 6c A schematic diagram of the historical flow trajectory and more surrounding assets in Example 2 of the present invention;

[0053] Figure 6d This is a schematic diagram of the movement trajectory of a smart phone in Example 2 of the present invention;

[0054] Figure 6e for Figure 6d A partial enlarged view of the moving trajectory can be found in Figure 1a The display interface is displayed on the analysis terminal;

[0055] Figure 7 A flow chart of the method for identifying assets in a place based on the image or video and drawing a flow trajectory of the same asset identified in different places,

[0056] Figure 8 Flowchart of analysis and confirmation of pre-information and in-process behavior by smartphones equipped for management personnel; wherein the figure numerals are: 1, rangefinder; 2, surface mount chip equipped with sensor; 3, seat; 4, scanning electron microscope; 5, glass dish; 6, sample bottle; 7, flask 7; 8, test tube rack; 9, laboratory equipment magnetic stirrer; 10, miniature camera; AC site number; N-due north, E-due east, α, β, x are the numbers of the three types of assets III. DETAILED DESCRIPTION

[0057] Example 1

[0058] The embodiment of the present invention provides a smart asset management system applied to a campus. This embodiment illustrates the overall configuration of a campus smart asset management system. Figure 1a ~b (direction signs N and E indicate north and east respectively) Figure 1a )、Electron Microscope Room( Figure 1b ),like Figure 2a~Figure 2b (Direction signs are the same as Figure 1a ~b, not shown) a certain experimental floor separated by a corridor, location B and location C (i.e., two laboratories with opposite entrance doors, Figure 2a~Figure 2b ) as an example, the system includes the system configured in these places including such as for the cabinet ( Figure 1a)、Workbench for analysis terminal, 3 seats, computer on workbench, scanning electron microscope 4 ( Figure 1b ), the experimental consumables glassware 5, sample bottle 6, flask 7, test tube rack 8, experimental equipment magnetic stirrer 9 and the like are configured as positioning devices, and the analysis terminal (such as Figure 1a ), wherein the positioning device includes a patch chip 2 equipped with a sensor, a micro camera 10, and a rangefinder 1. The specific location is as follows Figure 1a , Figure 1b and Figure 2a , Figure 2b For example Figure 1a The cabinet in the middle uses a rangefinder 1 installed on the wall, the scanning electron microscope 4 is a rangefinder 1 installed under the ground at its bottom, and the locations B and C are installed on the laboratory wall ( Figure 2a , Figure 2b The arrows in the figure show the shooting direction) and multiple miniature cameras 10 on the top, analyzing the terminal workbench, the computer on the table ( Figure 1a , Figure 1b )、Test bench( Figure 2a , Figure 2b ) is configured with a patch chip 2 equipped with a sensor. Figure 2a , Figure 2b They are sequential moments t1 and t2 respectively.

[0059] The system also includes an intelligent mobile terminal held by the manager, namely a smart phone, which is connected to Figure 1a The analysis terminal communicates with the sensor-equipped patch chip 2, the micro camera 10, and the rangefinder 1 are started according to different start-up cycles preset by the analysis terminal, and their respective positioning information is sent to the analysis terminal.

[0060] The analysis terminal is based on Figure 1a , Figure 1b and Figure 2a , Figure 2b The positioning information sent by the above three types of positioning devices corresponding to various types of assets in the example above analyzes the flow tracks of various types of assets, and records the purchase information, use information, maintenance information, and update information of the assets. The purchase information, use information, maintenance information, update information, and relocation information are compared with the flow track analysis results to realize smart asset management, wherein the use information, maintenance information, update information, and relocation information are sent to the smart phone before use, maintenance, update, and relocation. Figure 1a Confirm in the analysis terminal.

[0061] Specifically, the patch chip 2 includes an RFID sensor chip, and a plurality of readers and a plurality of sensors are configured on campus accordingly. When an asset (such as Figure 1a , Figure 1b and Figure 2a , Figure 2b When the analysis terminal and the test bench shown in the figure are in a position to receive the radio frequency signal emitted by the reader, if it is also in the reader startup cycle, the reader will send out a radio frequency signal, so that the RFID sensor chip can obtain energy and transmit the positioning information to the sensor, which is then sent to the analysis terminal by the sensor. The reader startup cycle is 5min-4h. Figure 1a , Figure 1b , Figure 2a , Figure 2b The installation locations of the reader / writer and sensor are not shown, but they are generally installed near the indoor ceiling or on the wall near the window or door.

[0062] Figure 3 An integrated reader / writer and sensor are provided, the reader / writer having a radio frequency transmitter and the sensor having a communication mainboard. The communication mainboard is based on Figure 1a The analysis system sets the startup cycle in the command line. The RF transmitter sends out a RF signal and reads the positioning information of the RFID sensor chip and sends it to Figure 1a The analysis system in the RFID sensor has a position resolution of 6-10 meters. Therefore, for the same site B and site C, the coordinate information of different test benches is actually unified, but the numbers are different, so different positioning information can be distinguished. The distinction of positioning information is simplified. Because the distance is short, it is actually unnecessary to subdivide which test bench is in which determined position, and it is actually impossible to distinguish. Because site B and site C are separated by only an aisle, the aisle is generally about 2 meters, which is less than the resolution accuracy.

[0063] However, if the lab bench needs to be moved due to relocation, such as moving to a new building, the analysis terminal can reset the reader start cycle to 5 minutes after receiving the relocation information confirmed by the smartphone, in order to respond to the relocation as quickly as possible. Since the moving distance of the lab bench is much longer than 10 meters, if it enters the RF signal receiving range of other RF transmitters during transportation, Figure 1a The analysis system in the analysis system analyzes the first flow information and the positioning changes. When moving to a new location, the sensor at the new location can form new positioning information, and then form a flow trajectory. For the cabinet and the scanning electron microscope 4, the distance measurement of the rangefinder changes. For example, the cabinet is moved away, and the scanning electron microscope is moved away, so that the distance measurement of the rangefinder 1 is respectively Figure 1a The left and right width of the site A and Figure 1b The height of the electron microscope room is greater than 2 meters, so Figure 1aThe analysis terminal analyzes the positioning information sent by the rangefinder 1 to form the second start flow information. When the cabinet or the scanning electron microscope 4 is moved to a new location, the rangefinder 1 at the new location forms a new distance measurement, so that the analysis system senses the new positioning information, thereby forming a flow trajectory.

[0064] It is possible that the start of relocation and arrival at the new location are not within the startup cycle (0.5h) of the rangefinder 1 or the RFID sensor chip, but as time goes by, there is always a period within the startup cycle, so the relocation behavior can always sense the change of positioning information.

[0065] Furthermore, if Figure 4a As shown in Figure 1, the rangefinder 1 is Figure 1b Take the buried form as an example ( Figure 1a The same structure, similar burial location, i.e. vertical wall, different), including Figure 4b Distance measuring head, distance measuring chip, such as Figure 1b A first wireless transmission device (such as a 4G module), a signal line (in Figure 1a and Figure 1b In the figure, since the buried wall is indicated by a dotted line, the distance measuring head and the distance measuring chip, the signal line and the distance measuring chip, and the signal line and the first wireless transmitting device are detachably connected through a first interface, and the distance measuring chip, the signal line, and the distance measuring head are embedded in the ground, and a first inspection door with an exposure hole for the distance measuring head is provided on the surface of the ground ( Figure 4a ).

[0066] like Figure 4b When the first inspection door is closed, the surface of the first inspection door is flush with the wall, the ground, or the surface of the support on which the asset is placed. Figure 4a As shown, when the first inspection door is opened, Figure 4b The other end of the signal line connected to the ranging chip is connected to the first wireless generating device through the first interface. The first interface is also buried in the wall, or exposed when another maintenance door is opened and connected to the first wireless generating device (for simplicity, these two cases are Figure 4d (not shown in the figure) wherein the first wireless transmitting device and Figure 1a The analysis terminal communicates with the analysis terminal in the example embodiment, and is used to send the positioning information to the analysis terminal.

[0067] like Figure 4c and Figure 4d As shown, set in Figure 2a The ceiling of the room in the figure and each of the micro cameras 10 on the wall are arranged on a wall having a camera hole ( Figure 4c), the micro camera 10 has a startup cycle of 4 hours, and the micro camera 10 includes a camera body, a second wireless transmitting device, and a signal line (such as a 4G module) that can be detachably connected to the camera body and the second wireless transmitting device (such as a 4G module) through a second interface. Figure 4d ). Since the signal line is buried in the wall, Figure 2a In this embodiment, the micro camera 10 is directed to Figure 1a The positioning information sent by the analysis terminal is an image.

[0068] Example 2

[0069] This embodiment describes the specific flow trajectory and the itinerary and related analysis of the smart phone movement trajectory in Embodiment 1. Figure 5a~5b As shown, the method for the analysis terminal to analyze the flow tracks of various types of assets according to the positioning information sent by the positioning devices corresponding to various types of assets specifically includes:

[0070] S1, Figure 1a The analysis terminal sets the start-up cycle of various positioning devices, and receives the positioning information sent by the chip 2, rangefinder 1 and micro camera 10 configured for the three types of assets I, II and III during their respective start-up cycles. If the information is not received, the abnormal information of the positioning device is generated.

[0071] S2, for equipment such as Figure 3 The sensor chip 2, namely the RFID sensor chip and the rangefinder 1, the analysis terminal draws the flow trajectory according to the positioning information sent during the respective start-up cycles (see Example 1) (this step Figure 5b In the figure, the black and blue boxes are placed on top. For the micro camera, the analysis terminal identifies the assets in the place according to the image or video, and draws the flow trajectory of the same asset identified in different places (this step Figure 5b (indicated by a red frame at the top of the figure).

[0072] S3, the flow trajectory is displayed on the electronic map of the campus. By clicking on the point on the flow trajectory corresponding to the positioning information sent during the startup period, the corresponding positioning information can be displayed. Figure 1a The diagram of the interface displayed by the analysis terminal in the figure shows the overall blueprint of the campus in the lower left corner, and the other areas show the partial enlargement of the short red line segment in the overview map. The enlarged display of the flow trajectory is given, running north-south between the two buildings.

[0073] Furthermore, if Figure 6a As shown in the figure, on the actual interface, you can click any point on the flow trajectory ( Figure 6a), displays the surrounding asset location information within the flow trajectory area where the point is located ( Figure 6b , and by clicking on the surrounding asset again ( Figure 6c The corresponding location information is displayed ( Figure 6a ~e) and historical flow track. And further on the historical flow track, by clicking ( Figure 6c ) to display more surrounding asset location information in another area, as well as more corresponding historical flow trajectories ( Figure 6a ~e are not shown).

[0074] like Figure 7 As shown, the method of identifying assets in a place according to the image or video and drawing a flow trajectory through the same asset identified in different places further includes the following method steps:

[0075] Q1, in the place where you are, such as Figure 4d The micro camera 10 captures various types of assets III-α, assets III-β, assets III-x (i.e. Figure 5a Other types of assets in Asset III subdivision, such as Figure 2a ~b) to obtain multiple images of each type of asset, each of which has a watermark corresponding to the coordinates of the corresponding micro camera 10 that performs the shooting behavior;

[0076] Q2, preprocess the image to obtain multiple corresponding images with uniform size, resolution, brightness and saturation setting parameters, and cut and copy the watermark;

[0077] Q3, build a CNN model, divide multiple images into training sets and validation sets with a ratio of 4:1, substitute the training set into the established CNN model for training, verify the accuracy through the validation set, continuously optimize the model parameters, and obtain the final asset recognition model. Build a natural language analysis model NLP, divide the watermark into training sets and validation sets to train the natural language analysis model, and verify the accuracy through the validation set, and continuously optimize the model parameters to obtain the coordinate recognition model;

[0078] Q4, capture images or videos of different places during different startup cycles, pre-process the images or video frames according to the Q2 method, and substitute them into the corresponding asset recognition model and coordinate recognition model in Q3 to obtain the positioning information of various assets in the image, including the name, location, number, and coordinate information of the asset, and draw the flow trajectory of the same asset in different places based on the coordinate information in the positioning information. Among them, for multiple micro cameras in the same place, the coordinates of one of them are selected as the unified coordinates of all micro cameras in the place.

[0079] The specific method of drawing the flow trajectory of the same asset in different places based on the positioning information is to Figure 3 The patch chip 2 of the sensor, namely the RFID sensor chip and the rangefinder 1, connects the points on the flow trajectory corresponding to the positioning information sent during the startup cycle with a straight line (such as Figure 6a and Figure 6c It is drawn in this way).

[0080] For the micro camera 10, see again Figure 2a and Figure 2b , which are the scenes at time t1 and time t2 in the order of sequence. Figure 2a Multiple miniature cameras 10 (shooting at different angles to improve recognition accuracy) in the location B identify the location where the same asset magnetic stirrer 9 appears when shooting the historical image at time t1 ( Figure 2a ) disappeared ( Figure 2b ), but appeared in the post-startup period at site C ( Figure 2b ), then the flow trajectory is drawn on the electronic map of the campus according to the identified coordinates corresponding to the two different places. Specifically, the training identification of the same asset magnetic stirrer 9 can be realized by labeling the same asset magnetic stirrer 9. Other consumables, such as flask 7, have not disappeared, but have moved to a new place and are filled with red liquid. Figure 2b The test tube rack 8 is also only moved. Consumables can also be labeled to achieve training identification of the same asset.

[0081] like Figure 8 As shown, the smart phone held by the manager has a positioning function and is installed with an asset management app. When the analysis terminal obtains the flow trajectory (such as Figure 6d As shown), it is immediately determined whether the movement trajectory of the smartphone held by the searched manager matches the flow trajectory. If it matches, it is compared with any one or a combination of the usage information, maintenance information, update information, and relocation information. If it matches, it is determined that the flow trajectory obtained by analysis is caused by the corresponding usage behavior, maintenance behavior, update behavior, and relocation behavior, and the status is displayed as normal. Otherwise, the asset management app reminds the manager holding the smartphone to confirm whether there is usage behavior, maintenance behavior, update behavior, and relocation behavior related to the flow trajectory obtained by the analysis, and displays the reminder message on the analysis terminal. If confirmed, a notification of filing record is issued. Otherwise, when the manager fails to confirm within 8h-24h, or uninstalls the asset management app and needs to enter confirmation information on the smartphone, the analysis terminal determines the timeout and non-confirmation, and the confirmation information will be sent to the analysis terminal. As long as the analysis terminal receives the confirmation information, the program for judging the timeout and non-confirmation of the uninstalled personnel is terminated; if there is no match, it is judged as non-management behavior.

[0082] The method of determining whether the movement trajectory of the smart phone held by the searched manager matches the flow trajectory is to obtain the coordinate information of the positioning information terminal corresponding to the point in the start cycle on the flow trajectory, and Figure 6d The coordinate information of the point on the moving track obtained by the positioning function is compared to see if the distance between the two coordinate information is less than the preset value. Figure 6e Given that there is less than the preset value of 3m, the analysis terminal confirms the match, which means Figure 6d The managers corresponding to the movement trajectory in Figure 6b The assets referred to in the words "surrounding assets" are relocated. The analysis terminal is confirmed by the manager on the smartphone according to the prompt message displayed. Figure 6c Relocation caused by historical migration trajectories between the two areas.

[0083] This embodiment also provides a computer-readable non-temporary storage medium set by an analysis terminal of a campus smart asset management system, which stores a program that can be run by the analysis terminal to implement smart asset management. At the same time, a storage medium installed in a smart phone held by a manager in the campus smart asset management system is provided, which stores an asset management application app for confirming usage information, maintenance information, update information, relocation information, and confirmation of usage behavior, maintenance behavior, update behavior, and relocation behavior to the analysis terminal in advance.

[0084] In addition to the above, the embodiment of the present invention also provides a smart asset management system applied to other places, which can be used to integrate, analyze and manage the location and flow of assets in designated places, belonging to the field of item tracking. The designated places can be shopping malls, restaurants, scenic spots, parks and other places. By locating and tracing various types of assets in the target place, the smart management of assets in the designated place is realized.

[0085] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A smart asset management system, characterized in that: It includes positioning devices configured for various types of assets, smart mobile terminals held by managers, and analysis terminals, wherein the positioning devices include satellite positioning devices or patch chips equipped with sensors, as well as micro cameras and rangefinders, the smart mobile terminals communicate with the analysis terminals, the positioning devices are started according to a preset start-up cycle, and the positioning information is sent to the analysis terminals, the analysis terminals analyze the flow tracks of various types of assets according to the positioning information sent by the positioning devices corresponding to various types of assets, and record any one or a combination of the purchase information, use information, maintenance information, update information, and relocation information of the assets, and compare the purchase information, use information, maintenance information, update information, and relocation information with any one or a combination of the purchase information, use information, maintenance information, update information, and relocation information through the flow track analysis results to realize smart asset management, wherein the use information, maintenance information, update information, and relocation information are confirmed to the analysis terminal in advance through the smart mobile terminal; the positioning information sent by the micro camera to the analysis terminal is an image or video; The patch chip includes an RFID sensor chip, and is configured with a plurality of readers and writers and a plurality of sensors accordingly. When the asset with the RFID sensor chip is in a position where it can receive the radio frequency signal emitted by the reader and writer, and if it is also within the reader and writer startup cycle, the reader and writer emits a radio frequency signal, so that the RFID sensor chip obtains energy and emits positioning information to the sensor, which is then sent to the analysis terminal by the sensor; The method for the analysis terminal to analyze the flow tracks of various types of assets according to the positioning information sent by the positioning devices corresponding to various types of assets specifically includes: S1, the analysis terminal sets the startup cycle of various positioning devices, and receives the positioning information sent by various positioning devices in their respective startup cycles. If the information is not received, the positioning device abnormality information is generated; S2, for satellite positioning devices or patch chips and rangefinders equipped with sensors, the analysis terminal draws flow tracks according to the positioning information sent by various positioning devices during their respective startup cycles; for micro cameras, the analysis terminal identifies assets in the venue according to the images or videos, and draws flow tracks for the same asset identified in different venues; S3, displaying the flow trajectory on an electronic map, and by clicking on a point on the flow trajectory corresponding to the positioning information sent during the startup period, the corresponding positioning information can be displayed; The method of identifying assets in a place according to the image or video and drawing a flow trajectory through the same asset identified in different places further includes the following method steps: Q1, in the location, the micro camera shoots various types of assets to obtain multiple images or multiple videos of each type of asset, and the multiple images or multiple videos have watermarks corresponding to the coordinates of the corresponding micro camera that performs the shooting behavior; Q2, preprocess the image to obtain multiple corresponding images or video frames with uniform size, resolution, brightness and saturation setting parameters, and cut and copy the watermark; Q3: Establish an AI model, divide multiple images or video frames into training sets and validation sets, substitute the training sets into the established AI model for training, verify the accuracy through the validation set, continuously optimize the model parameters, obtain the final asset recognition model, establish a natural language analysis model (NLP), divide the watermarks into training sets and validation sets to train the natural language analysis model, verify the accuracy through the validation set, continuously optimize the model parameters, and obtain the coordinate recognition model; Q4, capture images or videos of different places in different startup cycles, pre-process the images or video frames according to the Q2 method, substitute them into the corresponding asset recognition model and coordinate recognition model in Q3 to obtain the positioning information of various assets in the image, and draw the flow trajectory of the same asset in different places based on the positioning information, wherein the coordinates of one of the multiple micro cameras in the same place are selected as the unified coordinates of all micro cameras in the place; You can click on any point on the flow track to display the location information of the assets around the point, and click on the surrounding assets again to display the corresponding location information and historical flow track, and further click on the historical flow track to display more surrounding asset location information and corresponding more historical flow tracks; The specific method of drawing the flow trajectory of the same asset in different places according to the positioning information described in Q4 is that, for the satellite positioning device or the patch chip equipped with a sensor, and the rangefinder, a straight line is used to connect the points on the flow trajectory corresponding to the positioning information sent during the startup period; for the micro camera, when it is identified that the same asset disappears from the location where it appears in the historical image and video, but appears in another place in the post-startup period, the flow trajectory is drawn on the electronic map according to the identified coordinates corresponding to the two different places; All positioning information includes coordinate information and additional information including the name, location and number of the asset, and the artificial intelligence model includes a convolutional neural network (CNN).

2. The system according to claim 1, characterized in that For assets whose curb weight exceeds the first preset weight but does not exceed the second preset weight and any dimension of the size is smaller than the preset size, the satellite positioning device shown or the chip equipped with a sensor is configured; for assets whose curb weight is between the second preset weight and the third preset weight but the curb weight is not equal to the second preset weight, a rangefinder or a chip equipped with a sensor is configured; for assets whose curb weight exceeds the third preset weight, a rangefinder is configured; for assets whose curb weight does not exceed the first preset weight, a miniature camera is installed at the placement location.

3. The system according to claim 1, characterized in that The reader-writer startup cycle is 5 minutes to 8 hours; multiple readers are configured with different reader-writer startup cycles.

4. The system according to claim 1, characterized in that When the satellite positioning device or the patch chip equipped with a sensor is started, the positioning information is sent to the analysis terminal. When the straight-line distance between two positioning information exceeds the first preset value of 3-10 meters, the analysis terminal records the first start flow information; the rangefinder is set in any of the wall, the ground, or the support for placing the asset, so that the distance to the asset or the obstacle can be measured when it is started. When the distance exceeds the second preset value of 1-2 meters, the second start flow information is sent to the analysis terminal, and the positioning information is sent to the analysis terminal within the preset startup period of 0.5h-30d.

5. The system according to claim 4, characterized in that The rangefinder includes a rangefinder head, a rangefinder chip, a first wireless transmitting device and a signal line. The rangefinder head and the rangefinder chip, the signal line and the rangefinder chip, and the signal line and the first wireless transmitting device are detachably connected through a first interface. The rangefinder chip, the signal line and the rangefinder head are embedded in the wall, the ground, or a support for placing assets, and a first inspection door with an exposure hole for the rangefinder head is provided on the surface of the wall, the ground, or the support for placing assets. When the first inspection door is closed, the surface of the first inspection door is flush with the surface of the wall, the ground, or the support for placing assets. When the first inspection door is opened, the rangefinder head and the rangefinder chip can be maintained and updated by pulling out the first interface, and the first wireless transmitting device can also be maintained and updated by pulling out the first interface. The first wireless transmitting device communicates with the analysis terminal and is used to send positioning information to the analysis terminal. There are multiple miniature cameras, which are respectively arranged on the top of the room in the second inspection door with a camera hole on the wall. The startup cycle of the miniature camera is 4h-1d. The miniature camera includes a camera body, a second wireless transmitting device, and a signal line that can be detachably connected to the camera body and the second wireless transmitting device through a second interface.

6. The system according to claim 1, characterized in that The ratio of training set to validation set in step Q3 is 4:

1.

7. The system according to claim 1, characterized in that The smart mobile terminal held by the manager has a positioning function and is installed with an asset management app. When the analysis terminal obtains a flow trajectory based on the positioning information, it immediately determines whether the flow trajectory of the smart mobile terminal held by the searched manager matches the flow trajectory. If it matches, it compares any one of the usage information, maintenance information, update information, and relocation information or a combination thereof. If it matches, it determines that the flow trajectory obtained by analysis is caused by the corresponding usage behavior, maintenance behavior, update behavior, and relocation behavior, and displays the status as normal. Otherwise, the asset management app reminds the manager holding the smart mobile terminal to confirm whether the usage behavior, maintenance behavior, update behavior, and relocation behavior are related to the flow trajectory obtained by the analysis, and displays a reminder message on the analysis terminal. If confirmed, a notification of filing record is issued. Otherwise, when the manager fails to confirm within 8h-24h, or uninstalls the asset management app and needs to enter confirmation information on the smart mobile terminal, the analysis terminal determines the timeout and failure to confirm, and the confirmation information will be sent to the analysis terminal. As long as the analysis terminal receives the confirmation information, the program for judging the timeout and failure to confirm the uninstalled personnel is terminated; if there is no match, it is judged as non-management behavior; The method for determining whether the moving trajectory of the smart mobile terminal held by the searched manager matches the flow trajectory is to obtain the coordinate information in the positioning information corresponding to the point in the startup cycle on the flow trajectory, and the coordinate information of the point on the moving trajectory obtained by the positioning function, and compare whether there is a distance between the two coordinate information that is less than a preset value, and the preset value is less than or equal to 3m.

8. A computer-readable non-transitory storage medium provided in an analysis terminal of a smart asset management system as claimed in any one of claims 1 to 7, characterized in that: It stores programs that can be run by the analysis terminal to achieve smart asset management.

9. A storage medium installed in a smart mobile terminal held by a manager in a smart asset management system as claimed in any one of claims 1 to 7, characterized in that: An asset management application app is stored therein, which is used to confirm usage information, maintenance information, update information, relocation information to the analysis terminal in advance, as well as confirmation of usage behavior, maintenance behavior, update behavior, and relocation behavior.

Images