CN118428897A - Smart Asset Management System - Google Patents

Abstract

The invention provides an intelligent asset management system, which comprises a positioning device configured for various assets, an intelligent mobile terminal and an analysis terminal, wherein the intelligent mobile terminal is held by a manager and is communicated with the analysis terminal, the positioning device is started according to a preset starting period and sends positioning information to the analysis terminal, the analysis terminal analyzes the flowing track of various assets according to the positioning information sent by the positioning device corresponding to various assets, and records any one or combination of purchase information, use information, maintenance information, update information and relocation information of the assets, and the intelligent asset management is realized by comparing the flowing track analysis result with any one or combination of purchase information, use information, maintenance information, update information and relocation information. The system obtains the positioning information of various assets flexibly, efficiently, accurately and timely, and improves the management efficiency.

Description

Smart Asset Management System

Technical Field

The present invention relates to an asset management system, and in particular to an intelligent asset management system, which is used for integrating, analyzing and managing the location and flow of assets, and belongs to the field of item tracking.

Background technique

The campuses of schools, institutions, enterprises and public institutions are equipped with many assets related to teaching, scientific research, office (instruments, computers, tables and chairs, etc.) and basic daily necessities (such as water dispensers, air conditioners, lighting, etc.). These assets generally require regular maintenance and updates, and corresponding follow-up records and reports to integrate resources and manage efficiently. However, there are some situations where personnel may move some movable assets or take them out of the campus for various reasons (such as teaching, business trips, etc.), which leads to the flow trajectory of assets and the risk of loss or even loss. This requires the use of positioning and image recording information to achieve trackable trajectories.

However, the existing technology generally realizes the positioning of assets and items through active or passive patch-shaped chips. However, due to the limitations of the appearance and usage scenarios of the items, not all assets are suitable for the patch form (such as some experimental glassware, or scientific research equipment that needs to eliminate signal interference). In addition, the existing technologies emphasize positioning, and do not track its flow trajectory and analyze the reasons for the trajectory. Real-time positioning will increase the computing power burden, and after the power of the active positioning device is exhausted, there will be the disadvantage of missing analysis data due to possible untimely charging and equipment aging and failure. Since the trajectory does not care about all points at all times, generally only some points are needed to analyze the approximate trajectory from the starting point to the end point. Therefore, how to reasonably allocate the time distribution of data and simplify the trajectory. It is also a problem to be considered in the efficient management of these assets.

Summary of the invention

In view of the above problems, the present invention considers the following solutions: first, matching different positioning devices for different asset types; second, adopting a time-sharing method to collect positioning information and describe simplified trajectories; third, analyzing the causes of the trajectories. It should be emphasized that the corresponding positioning device only collects positioning information once during the startup cycle of the present invention, and the positioning information sent by different types of positioning devices is no longer named differently.

Based on the above problems, on one hand, the present invention provides a smart asset management system, including a positioning device configured for each type of asset, a smart mobile terminal held by a manager, and an analysis terminal, wherein the positioning device includes a satellite positioning device or a patch chip equipped with a sensor, as well as a micro camera and a rangefinder, and the smart mobile terminal communicates with the analysis terminal. The positioning device is started according to a preset startup cycle and sends positioning information to the analysis terminal. The analysis terminal analyzes the flow trajectory of each type of asset according to the positioning information sent by the positioning device corresponding to each type of asset, and records any one or a combination of the asset's purchase information, usage information, maintenance information, update information, and relocation information. The flow trajectory analysis result is compared with any one or a combination of the purchase information, usage information, maintenance information, update information, and relocation information to realize smart asset management, wherein the usage information, maintenance information, update information, and relocation information are confirmed to the analysis terminal in advance (i.e., before use, before maintenance, before update, and before relocation) by the smart mobile terminal.

Optionally, for assets with a curb mass exceeding a first preset mass (such as 10kg) but not exceeding a second preset mass (such as 25kg) and with any dimension less than a preset dimension (such as 50±5cm), a satellite positioning device as shown or a chip equipped with a sensor is configured; for assets with a curb mass between the second preset mass and a third preset mass (such as 25kg-170kg) but not equal to the second preset mass (such as 25kg), a rangefinder or a chip equipped with a sensor is configured; for assets with a curb mass exceeding the third preset mass (such as 170kg), a rangefinder is configured; for assets with a curb mass not exceeding the first preset mass (such as 10kg), a miniature camera is set at the placement location.

Preferably, the patch chip includes an RFID sensor chip, and a plurality of readers and writers and a plurality of sensors are correspondingly configured in the managed place (such as a campus). When the asset with the RFID sensor chip is in a position capable of receiving the radio frequency signal emitted by the reader and writer, and if it is within the reader and writer startup cycle, the reader and writer emits a radio frequency signal, so that the RFID sensor chip obtains energy and transmits positioning information to the sensor, which is then sent to the analysis terminal by the sensor. The reader and writer startup cycle is 5min-8h.

It is understandable that the reason for choosing 8 hours is that, considering the 8-hour workday, assets may be moved during the working day, so the location change is likely to occur within 8 hours.

More preferably, multiple readers are configured with different reader start-up cycles. Since not all assets change positions frequently, setting different start-up cycles can adapt to the frequency. It can also reduce the aging problem of components that work for a long time.

Optionally, the satellite positioning device or the patch chip equipped with a sensor sends positioning information to the analysis terminal when it is started. When the straight-line distance between two positioning information exceeds a first preset value of 3-10 meters, the analysis terminal records the first start flow information.

Since different flow trajectories have different reasons behind them, if it is only for rearrangement (belonging to relocation information), or use, maintenance, or update, the distance will not be very large; if it is relocation or temporary move to another place, the distance will generally be very long. Therefore, through the straight-line distance measurement of different periods, not only the simplified (not all trajectory points are recorded at all times) flow trajectory, time information, and the three possible reasons for the flow of assets can be recorded, but also compared with the recorded use information, maintenance information, update information, etc., to determine whether it is a move, relocation, or temporary move caused by use, maintenance, update, etc., so as to accurately track assets. If the use information, maintenance information, and update information are empty, it indicates negligence in management registration, and there is a plan to initiate accountability.

Optionally, the rangefinder is set in any wall, ground, or support on which the asset is placed, so that the distance to the asset or the obstacle can be measured when it is started. When the distance exceeds a second preset value of 1-2 meters, a second start flow information is sent to the analysis terminal, and positioning information is sent to the analysis terminal within a preset startup period of 0.5h-30d.

It is understandable that the preset startup cycle time span is large because some assets move frequently, such as elevators. Therefore, the detection time is as short as 0.5 hours. Generally, when the elevator distance measurement produces a 0.5-hour distance measurement abnormality during the period when it should move (rush hour, lunch, etc.), the elevator is considered to be faulty. Although the elevator has its own fault remote monitoring system, it is only for the elevator product itself, and the system is not incorporated into asset management. When the product software and system are not compatible, we still monitor the movement of the elevator. For 30 days, some assets that hardly move are considered, such as medium and large scientific research equipment, air conditioning outdoor units, and ventilation equipment.

Preferably, the rangefinder includes a rangefinder head, a rangefinder chip, a first wireless transmitting device, and a signal line. The rangefinder head and the rangefinder chip, the signal line and the rangefinder chip, and the signal line and the first wireless transmitting device are detachably connected through a first interface. The rangefinder chip, the signal line, and the rangefinder head are embedded in the wall, the ground, or a support for placing assets in an embedded manner, and a first inspection door with an exposure hole for the rangefinder head is provided on the surface of the wall, the ground, or the support for placing assets. When the first inspection door is closed, the surface of the first inspection door is flush with the surface of the wall, the ground, or the support for placing assets. When the first inspection door is opened, the rangefinder head and the rangefinder chip can be maintained and updated by unplugging the first interface, and the first wireless transmitting device can also be maintained and updated by unplugging the first interface, wherein the first wireless transmitting device communicates with the analysis terminal for sending positioning information to the analysis terminal.

Preferably, there are multiple micro cameras, which are respectively arranged on the ceiling of the room and in the second inspection door with a camera hole on the wall. The startup cycle of the micro camera is 4h-1d. The micro camera includes a camera body, a second wireless transmitting device, and a signal line that can detachably connect the camera body and the second wireless transmitting device through a second interface.

Since the corresponding micro-cameras are relatively light in weight (such as keyboards and mice of desktop computers, as well as notebooks and lighting devices), of various types (small test devices, such as ultrasonic generators, pipettes, magnetic stirrers, analytical test instruments, such as portable instruments, mainframes of electrochemical workstations, etc.), or in large quantities (such as experimental glassware), they move relatively frequently and their movement trajectories are relatively complex, it is impractical to configure rangefinders for each of them. The solution of using multiple cameras to shoot as a whole and intelligently identify objects can track these assets. Therefore, it is more appropriate to set the startup cycle to within one day and consider it between half of the working day (morning and afternoon).

Optionally, the positioning information sent by the micro camera to the analysis terminal is an image or a video.

The method for the analysis terminal to analyze the flow tracks of various types of assets according to the positioning information sent by the positioning devices corresponding to various types of assets specifically includes:

The S1 analysis terminal sets the startup cycle of various positioning devices and receives the positioning information sent by various positioning devices during their respective startup cycles. If the information is not received, the positioning device abnormality information is generated.

S2 For satellite positioning devices or patch chips and rangefinders equipped with sensors, the analysis terminal draws the flow trajectory according to the positioning information sent by various positioning devices during their respective startup cycles. For micro cameras, the analysis terminal identifies the assets in the venue according to the images or videos, and draws the flow trajectory for the same asset identified in different venues.

S3 displays the flow trajectory on an electronic map. By clicking a point on the flow trajectory corresponding to the positioning information sent during the startup cycle, the corresponding positioning information can be displayed.

Optionally, you can click on any point on the flow trajectory to display the location information of the assets surrounding the point, and click on the surrounding assets again to display the corresponding location information and historical flow trajectory, and further click on the historical flow trajectory to display more surrounding asset location information and corresponding more historical flow trajectories.

The method of identifying assets in a place according to the image or video and drawing a flow trajectory through the same asset identified in different places further includes the following method steps:

Q1 In the location, the micro camera shoots various assets and obtains multiple images or multiple videos of each type of asset. The multiple images or multiple videos have watermarks corresponding to the coordinates of the corresponding micro camera that performs the shooting behavior.

Q2 pre-processes the image to obtain multiple images or video frames with uniform size, resolution, brightness and saturation setting parameters, and cuts and copies the watermark.

Q3 builds an artificial intelligence model, divides multiple images or video frames into training sets and verification sets with a ratio of 7-4:1, substitutes the training set into the established artificial intelligence model for training, verifies the accuracy through the verification set, continuously optimizes the model parameters, obtains the final asset recognition model, builds a natural language analysis model (NLP), divides the watermark into training sets and verification sets to train the natural language analysis model, verifies the accuracy through the verification set, continuously optimizes the model parameters, and obtains the coordinate recognition model.

Q4 captures images or videos of different places during different startup cycles, pre-processes the images or video frames according to the Q2 method, and substitutes them into the corresponding asset recognition model and coordinate recognition model in Q3 to obtain the positioning information of various assets in the image, and draws the flow trajectory of the same asset in different places based on the positioning information. Among them, for multiple micro cameras in the same place, the coordinates of one of them are selected as the unified coordinates of all micro cameras in the place.

Optionally, the specific method of drawing the flow trajectory of the same asset in different places based on the positioning information described in Q4 is, for the satellite positioning device or the surface-mount chip equipped with a sensor, and the rangefinder, connecting the points on the flow trajectory corresponding to the positioning information sent during the startup cycle with a straight line; for the micro camera, when it is identified that the same asset disappears from the location where it appears in the historical images and videos, but appears in another place in the post-startup period, the flow trajectory is drawn on the electronic map according to the identified coordinates corresponding to the two different places.

Preferably, all positioning information includes coordinate information and additional information including the name, location and number of the asset, and the artificial intelligence model includes a convolutional neural network (CNN).

It is easy to understand that if the same asset appears in images and video frames taken at different locations during different startup cycles, it means that the same asset has generated a flow track. In this case, there is no limit on the threshold of the moving distance. Because the distance between different locations is different, it may be different rooms less than 3 meters apart, or it may be two buildings far apart. However, as long as the above-mentioned disappearance and appearance in different places occur, it is determined to have generated a flow track.

The smart mobile terminal held by the manager has a positioning function and is installed with an asset management app. When the analysis terminal obtains a flow trajectory based on the positioning information, it immediately determines whether the flow trajectory of the smart mobile terminal held by the searched manager matches the flow trajectory. If it matches, it compares any one of the usage information, maintenance information, update information, and relocation information or a combination thereof. If it matches, it determines that the flow trajectory obtained by analysis is caused by the corresponding usage behavior, maintenance behavior, update behavior, and relocation behavior, and displays the status as normal. Otherwise, the asset management app reminds the manager holding the smart mobile terminal to confirm whether there is usage behavior, maintenance behavior, update behavior, and relocation behavior related to the flow trajectory obtained by the analysis, and displays the reminder message on the analysis terminal. If confirmed, a notification of filing record is issued. Otherwise, when the manager fails to confirm within 8h-24h, or uninstalls the asset management app and needs to enter confirmation information on the smart mobile terminal, the analysis terminal determines the timeout and failure to confirm, and the confirmation information will be sent to the analysis terminal. As long as the analysis terminal receives the confirmation information, the program for judging the timeout and failure to confirm the uninstalled personnel is terminated; if it does not match, it is judged as non-management behavior.

It is easy to understand that reminders for patches, satellite positioning, and rangefinders will not occur every day and disturb management personnel, because they are only executed when the corresponding asset generates positioning devices that can detect the start of flow, and the analysis terminal analyzes the flow trajectory, and when the comparison fails, there are many conditions to meet, and reminder messages will not be easily generated. Because generally for the moving distance threshold of 3-10 meters, generally small-scale daily office needs will not generate trajectories. If you move long distances within the campus and the distance out of the campus is too large, it will (to indicate possible usage information).

However, image and video-based recognition may trigger alerts due to the frequent movement of assets, which urges managers to properly manage frequently used or replaced assets. Therefore, we have equivalently adjusted the level of attention paid to asset management for assets that are not frequently moved and those that are relatively frequently moved by setting the movement threshold distance and special tracking settings for small objects for the camera. When managers uninstall the app, it will be displayed on the analysis terminal, so that the reasons for the uninstallation can be analyzed and personnel management can be strengthened.

Optionally, the method for determining whether the moving trajectory of the smart mobile terminal held by the searched manager matches the flow trajectory is to determine whether the positioning information corresponding to the point within the startup cycle on the flow trajectory matches the positioning information of the point on the moving trajectory obtained by the positioning function.

Optionally, calculating the positioning information on the flow trajectory corresponding to the point in the startup cycle and whether the positioning information of the point on the moving trajectory obtained by the positioning function matches further specifically includes obtaining the coordinate information of the positioning information on the flow trajectory corresponding to the point in the startup cycle, and the coordinate information of the point on the moving trajectory obtained by the positioning function, and comparing whether there is a distance between the two coordinate information that is less than a preset value, wherein the preset value is less than or equal to 3m.

In another aspect, the present invention provides a computer-readable non-transitory storage medium provided in an analysis terminal of a smart asset management system, wherein a program that can be executed by the analysis terminal to implement smart asset management is stored.

The third aspect of the present invention provides a storage medium installed in a smart mobile terminal held by a manager in a smart asset management system, wherein an asset management application app is stored, which is used to confirm usage information, maintenance information, update information, relocation information, and confirmation of usage behavior, maintenance behavior, update behavior, and relocation behavior to an analysis terminal in advance.

Beneficial Effects

First, the present invention classifies different assets and equips different types of positioning devices in a targeted manner, so as to better meet the physical inherent properties of the assets and the requirements of the working environment. Second, the positioning device is started periodically to slow down the aging of the positioning device, and it is flexibly adjusted according to the frequency of flow to respond to flow behavior. Third, the image intelligent recognition of relatively light and numerous assets makes it possible to locate and identify the flow of such assets with complex flow situations. Fourth, based on the positioning comparison between the manager's smart mobile terminal and the flow path, the reasons for the implementation of asset flow can be tracked in time, and an intelligent management model with personal responsibility can be implemented through the app.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1a is a schematic diagram of a location A of the overall configuration of a smart asset management system according to Embodiment 1 of the present invention;

FIG1b is a schematic diagram of an electron microscope room of the overall configuration of the smart asset management system according to Example 1 of the present invention;

FIG2a is a schematic diagram of a scene at time t1 of the overall configuration of the smart asset management system according to Embodiment 1 of the present invention;

FIG2 b is a schematic diagram of a scene at time t2 of the overall configuration of the smart asset management system according to Embodiment 1 of the present invention;

FIG3 is a schematic diagram of an integrated reader/writer and sensor structure according to Embodiment 1 of the present invention;

FIG4a is a schematic diagram of a method for embedding a rangefinder according to Embodiment 1 of the present invention;

FIG4b is a schematic diagram of the structure of a range finder according to Embodiment 1 of the present invention;

FIG4c is a schematic diagram of the embedding method of the micro camera according to Embodiment 1 of the present invention;

FIG4d is a schematic diagram of the structure of a micro camera according to Embodiment 1 of the present invention,

FIG5a is a grayscale diagram of the method flow of analyzing the flow trajectories of various types of assets according to the positioning information sent by the positioning devices corresponding to various types of assets by the analysis terminal in Embodiment 2 of the present invention;

FIG5b is a color diagram of the method flow of analyzing the flow tracks of various types of assets according to the positioning information sent by the positioning devices corresponding to various types of assets by the analysis terminal in Embodiment 2 of the present invention;

FIG6a is a schematic diagram of the flow trajectory of assets in Example 2 of the present invention;

FIG6b is a schematic diagram of surrounding assets in Example 2 of the present invention;

FIG6c is a schematic diagram of the historical flow trajectory and more surrounding assets in Example 2 of the present invention;

FIG6d is a schematic diagram of a moving trajectory of a smart phone in Embodiment 2 of the present invention;

FIG6e is a partial enlarged view of the moving track of FIG6d , which can be displayed on the display interface of the analysis terminal in FIG1a ;

FIG. 7 is a flow chart of a method for identifying assets in a place based on the image or video and drawing a flow trajectory of the same asset identified in different places,

Figure 8 is a flowchart of the analysis and confirmation of pre-information and in-process behavior by the smart phones equipped by managers; the figure numbers are: 1, rangefinder; 2, surface mount chip equipped with sensor; 3, seat; 4, scanning electron microscope; 5, glass dish; 6, sample bottle; 7, flask 7; 8, test tube rack; 9, experimental equipment magnetic stirrer; 10, miniature camera; A-C site number; N-due north, E-due east, α, β, x are the numbers of the three types of assets III.

Detailed ways

Example 1

The embodiment of the present invention provides a smart asset management system for campus, and this embodiment illustrates the overall configuration of a campus smart asset management system. As shown in Figure 1 (the direction signs N and E represent north and east respectively), the place A (Figure 1a), the electron microscope room (Figure 1b), and Figures 2a and 2b (the direction signs are the same as Figure 1, not shown) take the places B and C of a certain laboratory floor separated by an aisle (i.e., two laboratories with relative entrance doors, Figures 2a and 2b) as examples, the system includes the system configured in these places, such as a cabinet (Figure 1a), a workbench for analysis terminals, a chair 3, a computer on the workbench, a scanning electron microscope 4 (Figure 1b), a positioning device configured for experimental consumables glassware 5, a sample bottle 6, a flask 7, a test tube rack 8, and an experimental equipment magnetic stirrer 9, and an analysis terminal (as shown in Figure 1a), wherein the positioning device includes a patch chip 2 equipped with a sensor, a micro camera 10, and a rangefinder 1. The specific positions are shown in Figures 1a, 1b and 2a, 2b. For example, the cabinet in FIG1a uses a rangefinder 1 installed on the wall, the scanning electron microscope 4 is a rangefinder 1 installed under the ground at its bottom, and the locations B and C are multiple miniature cameras 10 installed on the laboratory wall (the shooting direction is shown by arrows in FIG2a and FIG2b) and the top, and the analysis terminal workbench, the table computer (FIG1a, FIG1b), and the experimental bench (FIG2a, FIG2b) are configured with a surface mount chip 2 equipped with a sensor. Among them, FIG2a and FIG2b are respectively the sequential time t1 and t2.

The system also includes an intelligent mobile terminal held by the manager, that is, a smart phone, which communicates with the analysis terminal in Figure 1a. The patch chip 2 equipped with a sensor, as well as the micro camera 10 and the rangefinder 1 are started according to different start-up cycles preset by the analysis terminal, and their respective positioning information is sent to the analysis terminal.

The analysis terminal analyzes the flow trajectories of various types of assets based on the positioning information sent by the above three types of positioning devices corresponding to various types of assets in Figures 1a, 1b and Figures 2a, 2b, and records the purchase information, usage information, maintenance information, and update information of the assets. The purchase information, usage information, maintenance information, update information, and relocation information are compared with the flow trajectory analysis results to realize smart asset management, wherein the usage information, maintenance information, update information, and relocation information are confirmed to the analysis terminal in Figure 1a through a smart phone before use, maintenance, update, and relocation.

Specifically, the patch chip 2 includes an RFID sensor chip, and multiple readers and multiple sensors are configured on campus accordingly. When the asset with the RFID sensor chip (such as the analysis terminal and the experimental bench shown in Figures 1a, 1b and 2a, 2b) is in a position where it can receive the radio frequency signal emitted by the reader, if it is in the reader startup cycle, the reader sends out a radio frequency signal, so that the RFID sensor chip obtains energy and transmits positioning information to the sensor, which is then sent to the analysis terminal by the sensor. The reader startup cycle is 5min-4h. Although Figures 1a, 1b, 2a, and 2b do not show the location of the reader and sensor, they are generally set near the indoor ceiling or on the wall near the window or door.

FIG3 shows an integrated reader and sensor, a reader with a radio frequency transmitter and a sensor with a communication mainboard. The communication mainboard instructs the radio frequency transmitter to send a radio frequency signal according to the startup cycle set by the analysis system in FIG1a, and reads the positioning information of the RFID sensor chip and sends it to the analysis system in FIG1a. The position resolution accuracy of RFID sensing is 6-10 meters, so for the same place B and place C, the coordinate information of different experimental benches is actually unified, but the numbers are different, so different positioning information can be distinguished. The distinction of positioning information is simplified, because the distance is short, and there is actually no need to subdivide which specific experimental bench is in which determined position, and it is actually impossible to distinguish. Because places B and C are separated only by an aisle, the aisle is generally about 2 meters, which is less than the resolution accuracy.

However, once the laboratory bench needs to be moved due to relocation or other behaviors, such as changing a building, the analysis terminal receives the relocation information confirmed by the smartphone, and the analysis terminal can reset the reader start cycle to 5 minutes, in order to respond to the relocation behavior as quickly as possible. Since the moving distance of the laboratory bench is far more than 10 meters. Therefore, during the transportation, if it enters the RF signal receiving range of other RF transmitters, the analysis system in Figure 1a analyzes the first start flow information and the positioning changes. When moving to a new location, the sensor at the new location can form new positioning information, thereby forming a flow trajectory. For the cabinet and the scanning electron microscope 4, the distance measurement of the rangefinder changes according to the distance measurement of the rangefinder, such as the cabinet is moved away, the scanning electron microscope is moved away, so that the distance measurement of the rangefinder 1 is respectively the left and right width of the place A in Figure 1a and the indoor height of the electron microscope in Figure 1b, which is greater than 2 meters, so the analysis terminal in Figure 1a analyzes the second start flow information according to the positioning information sent by the rangefinder 1. And when the cabinet or the scanning electron microscope 4 is moved to a new location, the rangefinder 1 at the new location forms a new distance measurement, so that the analysis system senses the new positioning information, thereby forming a flow trajectory.

It is possible that the start of relocation and arrival at the new location are not within the start-up cycle (0.5h) of the rangefinder 1 or the RFID sensor chip, but as time goes by, there is always a period within the start-up cycle, so the relocation behavior can always sense the change of positioning information.

Further, as shown in Figures 4a~4d, the rangefinder 1, taking the buried form of Figure 1b as an example (the structure in Figure 1a is the same, and the approximate buried location, i.e., the vertical wall, is different), includes a ranging head as shown in Figure 4b, a ranging chip, a first wireless transmitting device as shown in Figure 1b (for example, a 4G module), and a signal line (in Figures 1a and 1b, dotted lines are used to indicate the buried wall). The ranging head and the ranging chip, as well as the signal line and the ranging chip, and the signal line and the first wireless transmitting device are detachably connected through a first interface. The ranging chip, the signal line, and the ranging head are buried in the ground in an embedded manner, and a first inspection door having a hole for exposing the ranging head is provided on the surface of the ground (Figure 4a).

As shown in Figure 4b, when the first inspection door is closed, the surface of the first inspection door is flush with the surface of the wall, the ground, or the support on which the asset is placed. As shown in Figure 4a, when the first inspection door is opened, the ranging head and the ranging chip can be maintained and updated by plugging and unplugging the first interface of Figure 4b. The other end of the signal line connected to the ranging chip is connected to the first wireless generating device through the first interface. The first interface is also buried in the wall, or is exposed when another inspection door is opened and connected to the first wireless generating device (for simplicity, these two situations are not shown in Figure 4d). Among them, the first wireless transmitting device communicates with the analysis terminal in Figure 1a, and is used to send positioning information to the analysis terminal.

As shown in Figures 4c and 4d, each of the micro cameras 10 set on the ceiling of the room in Figure 2 and on the wall is set in a second inspection door with a camera hole (Figure 4c). The startup cycle of the micro camera 10 is 4 hours. The micro camera 10 includes a camera body, a second wireless transmitting device, and a signal line that can be detachably connected to the camera body and the second wireless transmitting device (such as a 4G module) through a second interface (Figure 4d). Since the signal line is buried in the wall, the location B in Figure 2a is taken as an example and is also represented by a dotted line. In this embodiment, the positioning information sent by the micro camera 10 to the analysis terminal in Figure 1a is an image.

Example 2

This embodiment describes the specific flow trajectory and the itinerary and related analysis of the smart phone movement trajectory in embodiment 1. As shown in Figures 5a and 5b, the method for the analysis terminal to analyze the flow trajectory of various assets according to the positioning information sent by the positioning device corresponding to each asset specifically includes:

S1, the analysis terminal in Figure 1a sets the start-up cycle of various positioning devices, and receives the positioning information sent by the chip 2, rangefinder 1 and micro camera 10 configured for the three types of assets I, II and III during their respective start-up cycles. If the information is not received, the abnormal information of the positioning device is generated.

S2, for the patch chip 2 equipped with the sensor as shown in Figure 3, that is, the RFID sensor chip and the rangefinder 1, the analysis terminal draws the flow trajectory according to the positioning information sent during the respective startup cycles (see Example 1) (this step is represented by the black and blue boxes at the top in Figure 5b), and for the micro camera, the analysis terminal identifies the assets in the place according to the image or video, and draws the flow trajectory through the same asset identified in different places (this step is represented by the red box at the top in Figure 5b).

S3, the flow trajectory is displayed on the electronic map of the campus. By clicking on the point on the flow trajectory corresponding to the positioning information sent during the startup cycle, the corresponding positioning information can be displayed. The figure shows a schematic diagram of the interface displayed by the analysis terminal in Figure 1a. The lower left corner is the overall blueprint of the campus, and the other areas show the partial enlargement of the short red line segment in the overview map. The enlarged display of the flow trajectory is given, running north-south between the two buildings.

Furthermore, as shown in Figures 6a to 6e, on the actual interface, any point on the flow trajectory (Figure 6a) can be clicked to display the location information of the surrounding assets within the flow trajectory area where the point is located (Figure 6b), and the corresponding location information (not shown in Figures 6a to 6e) and the historical flow trajectory can be displayed by clicking the surrounding assets again (the position indicated by the words "surrounding assets" in Figure 6c). And further, by clicking on the historical flow trajectory (Figure 6c), more surrounding asset location information in another area and more corresponding historical flow trajectories (not shown in Figures 6a to 6e) can be displayed.

As shown in FIG. 7 , the method of identifying assets in a place according to the image or video and drawing a flow trajectory through the same asset identified in different places further includes the following method steps:

Q1, in the location, the micro camera 10 in FIG4d shoots various types of assets III-α, assets III-β, assets III-x (i.e., other types of assets subdivided by asset III in FIG5, such as the experimental consumables and experimental equipment shown in FIG2a~b), and obtains multiple images of each type of asset, and the multiple images have watermarks corresponding to the coordinates of the corresponding micro camera 10 that performs the shooting behavior;

Q2, preprocess the image to obtain multiple corresponding images with uniform size, resolution, brightness and saturation setting parameters, and cut and copy the watermark;

Q3, build a CNN model, divide multiple images into training sets and validation sets with a ratio of 4:1, substitute the training set into the established CNN model for training, verify the accuracy through the validation set, continuously optimize the model parameters, and obtain the final asset recognition model. Build a natural language analysis model NLP, divide the watermark into training sets and validation sets to train the natural language analysis model, and verify the accuracy through the validation set, and continuously optimize the model parameters to obtain the coordinate recognition model;

Q4, capture images or videos of different places during different startup cycles, pre-process the images or video frames according to the Q2 method, and substitute them into the corresponding asset recognition model and coordinate recognition model in Q3 to obtain the positioning information of various assets in the image, including the name, location, number, and coordinate information of the asset, and draw the flow trajectory of the same asset in different places based on the coordinate information in the positioning information. Among them, for multiple micro cameras in the same place, the coordinates of one of them are selected as the unified coordinates of all micro cameras in the place.

A specific method for drawing the flow trajectory of the same asset in different places based on the positioning information is to connect the points on the flow trajectory corresponding to the positioning information sent during the startup cycle with straight lines for the patch chip 2 equipped with the sensor as shown in FIG3 , i.e., the RFID sensor chip and the rangefinder 1 (as shown in FIG6a and FIG6c , which are drawn according to this method).

For the micro camera 10, refer to Figure 2a and Figure 2b again, which are the scenes at time t1 and time t2 in the order of sequence. When multiple micro cameras 10 (shooting at different angles to improve recognition accuracy) in the place B of Figure 2a recognize that the same asset magnetic stirrer 9 disappears (Figure 2b) in the location where the historical image appears in the shooting at time t1 (Figure 2a), but appears in the post-startup period of place C (Figure 2b), the flow trajectory is drawn on the electronic map of the campus according to the recognized coordinates corresponding to the two different places. Specifically, the training recognition of the same asset magnetic stirrer 9 can be achieved by labeling the same asset magnetic stirrer 9. Other consumables, such as flask 7, did not disappear, but moved to a new place and were filled with red liquid. The test tube rack 8 in Figure 2b also only moved. Consumables can also be labeled to achieve training recognition of the same asset.

As shown in FIG8 , the smart phone held by the manager has a positioning function and is installed with an asset management app. When the analysis terminal obtains a flow trajectory according to the positioning information (as shown in FIG6 d ), it immediately determines whether the movement trajectory of the smart phone held by the searched manager matches the flow trajectory. If it matches, it compares any one or a combination of the usage information, maintenance information, update information, and relocation information. If it matches, it determines that the flow trajectory obtained by the analysis is caused by the corresponding usage behavior, maintenance behavior, update behavior, and relocation behavior, and displays the status as normal. Otherwise, the asset management app reminds the manager holding the smart phone to confirm whether there is a usage behavior, maintenance behavior, update behavior, and relocation behavior related to the flow trajectory obtained by the analysis, and displays the reminder message on the analysis terminal. If confirmed, a notification of filing record is issued. Otherwise, when the manager fails to confirm within 8h-24h, or uninstalls the asset management app and needs to enter confirmation information on the smart phone, the analysis terminal determines the timeout and failure to confirm, and the confirmation information will be sent to the analysis terminal. As long as the analysis terminal receives the confirmation information, the program for judging the timeout and failure to confirm the uninstalled personnel is terminated; if it does not match, it is judged as non-management behavior.

The method of determining whether the mobile trajectory of the smartphone held by the manager that is searched matches the flow trajectory is to obtain the coordinate information of the positioning information terminal corresponding to the point in the startup cycle on the flow trajectory, and the coordinate information of the point on the mobile trajectory in Figure 6d obtained by the positioning function, and compare whether there is a distance less than the preset value between the two coordinate information. Figure 6e shows that there is a distance less than the preset value of 3m. At this time, the analysis terminal confirms the match, which means that the manager corresponding to the mobile trajectory in Figure 6d has relocated the assets referred to by the words "surrounding assets" in Figure 6b. The analysis terminal confirms the relocation caused by the historical flow trajectory between the two areas in Figure 6c after the manager confirms it on the smartphone according to the prompt message shown.

This embodiment also provides a computer-readable non-temporary storage medium set by an analysis terminal of a campus smart asset management system, which stores a program that can be run by the analysis terminal to implement smart asset management. At the same time, a storage medium installed in a smart phone held by a manager in the campus smart asset management system is provided, which stores an asset management application app for confirming usage information, maintenance information, update information, relocation information, and confirmation of usage behavior, maintenance behavior, update behavior, and relocation behavior to the analysis terminal in advance.

In addition to the above, the embodiment of the present invention also provides a smart asset management system applied to other places, which can be used to integrate, analyze and manage the location and flow of assets in designated places, belonging to the field of item tracking. The designated places can be shopping malls, restaurants, scenic spots, parks and other places, and the smart management of assets in the designated places can be achieved by locating and tracing various types of assets in the target places.

Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims (10)

1. The intelligent asset management system is characterized by comprising a positioning device configured for various assets, an intelligent mobile terminal held by a manager and an analysis terminal, wherein the positioning device comprises a satellite positioning device or a chip with a sensor, a miniature camera and a range finder, the intelligent mobile terminal is communicated with the analysis terminal, the positioning device is started according to a preset starting period and sends positioning information to the analysis terminal, the analysis terminal analyzes the flowing track of various assets according to the positioning information sent by the positioning device corresponding to various assets and records any one or a combination of purchase information, use information, maintenance information, update information and relocation information of the assets, and the intelligent asset management is realized by comparing the analysis result of the flowing track with any one or the combination of purchase information, use information, maintenance information, update information and relocation information;

The patch type chip comprises an RFID sensing chip, a plurality of readers and a plurality of sensors are correspondingly configured, when the asset attached with the RFID sensing chip is positioned at a position capable of receiving radio frequency signals transmitted by the readers, if the asset is in a starting period of the readers, the readers transmit the radio frequency signals, so that the RFID sensing chip obtains energy to transmit positioning information to the sensors, and the sensors transmit the positioning information to the analysis terminal.

2. The system of claim 1, wherein for assets having a setup mass exceeding a first preset mass but not exceeding a second preset mass and having dimensions smaller than the preset dimensions in dimension, the satellite positioning device or the sensor-equipped chip is configured, for assets having a setup mass between the second preset mass and a third preset mass but not equal to the second preset mass, the rangefinder or the sensor-equipped chip is configured, for assets having a setup mass exceeding the third preset mass, the rangefinder is configured, and for assets having a setup mass not exceeding the first preset mass, the miniature camera is configured at the place where the asset is placed.

3. The system of claim 1, wherein the reader start-up period is 5min-8h; the plurality of readers are configured with different reader start cycles.

4. The system according to claim 1, wherein the satellite positioning device or the sensor-equipped chip transmits positioning information to the analysis terminal upon activation, and wherein the analysis terminal records first start-flow information when a linear distance between two positioning information exceeds a first preset value of 3-10 meters; the distance meter is arranged in any one of a wall body, the ground or a support for placing the asset, so that the distance between the distance meter and the asset or a baffle can be measured when the distance meter is started, when the distance exceeds a second preset value by 1-2 meters, second starting flowing information is sent to the analysis terminal, and positioning information is sent to the analysis terminal in a preset starting period of 0.5-30 hours.

5. The system of claim 4, wherein the rangefinder comprises a rangefinder head, a rangefinder chip, a first wireless transmitter, a signal line, wherein the rangefinder head and the rangefinder chip, the signal line and the rangefinder chip, and the signal line and the first wireless transmitter are detachably connected through a first interface, the rangefinder chip, the signal line, the rangefinder head are embedded in the wall body, the ground or the support for placing the asset in an embedded manner, and a first access door with an exposed hole of the rangefinder head is arranged on the surface of the wall body, the ground or the support for placing the asset, when the first access door is closed, the surface of the first access door is flush with the surface of the wall body, the ground or the support for placing the asset, when the first access door is opened, the rangefinder head, the rangefinder chip and the first wireless transmitter can be maintained and updated by pulling out the first interface, and the first wireless transmitter can also be maintained and updated by pulling out the first interface, wherein the first wireless transmitter is communicated with the analysis terminal for transmitting positioning information to the analysis terminal;

The miniature video camera is a plurality of parts and is respectively arranged on the top of a room, and the wall body is arranged in a second access door with a camera hole, the starting period of the miniature video camera is 4h-1d, the miniature video camera comprises a camera main body, a second wireless transmitting device and a signal wire which can be detachably connected with the camera main body and the second wireless transmitting device through a second interface, and positioning information transmitted by the miniature video camera to the analysis terminal is an image or a video.

6. The system of claim 5, wherein the method for the analysis terminal to analyze the flow track of each asset according to the positioning information sent by the positioning device corresponding to each asset specifically comprises:

S1, the analysis terminal sets the starting period of various positioning devices, receives positioning information sent by various positioning devices in the respective starting period, if not, generates abnormal information of the positioning devices,

S2, for a satellite positioning device or a chip with a sensor and a range finder, the analysis terminal draws a flow track according to positioning information sent by various positioning devices in respective starting periods, for a miniature camera, the analysis terminal identifies assets in a place according to the images or videos and draws the flow track through the same asset identified in different places,

S3, displaying the flow track on the electronic map, and clicking a point on the flow track corresponding to the positioning information sent in the starting period to display the corresponding positioning information;

The method for identifying assets in a place according to the images or videos and drawing the flowing track through the same identified assets in different places further comprises the following steps:

Q1, in the place, shooting various assets by the micro-camera to obtain a plurality of images or a plurality of sections of videos of each asset, wherein the images or the sections of videos are provided with watermarks corresponding to the coordinates of the corresponding micro-camera for executing shooting actions,

Q2, preprocessing the image to obtain a plurality of corresponding images or video frames with uniform size, resolution and brightness and saturation setting parameters, cutting and copying the watermark,

Q3, establishing an artificial intelligent model, dividing a plurality of images or video frames into a training set and a verification set, wherein the proportion is 7-4:1, substituting the training set into the established artificial intelligent model for training, verifying the accuracy through the verification set, continuously optimizing model parameters to obtain a final asset identification model, establishing a natural language analysis model (NLP), equally dividing watermarks into the training set and the verification set for training the natural language analysis model, continuously optimizing model parameters through the verification set to obtain a coordinate identification model,

And Q4, shooting images or videos of different places in different starting periods, preprocessing the images or video frames according to a Q2 method, substituting the images or video frames into a corresponding asset identification model and a coordinate identification model in Q3 to respectively obtain positioning information of various assets in the images, and drawing flow tracks of the same asset in different places according to the positioning information, wherein in a plurality of micro cameras in the same place, selecting the coordinates of one part as unified coordinates of all the micro cameras in the place.

7. The system of claim 6, wherein any point on the flow track can be clicked on arbitrarily, displaying asset location information around the point, and displaying corresponding location information and historical flow tracks by clicking on the peripheral asset again, and further displaying more peripheral asset location information and corresponding more historical flow tracks on the historical flow tracks also by clicking on completion;

The specific method for drawing the flow track of the same asset in different places according to the positioning information in the Q4 is that a satellite positioning device or a patch chip provided with a sensor and a range finder are connected with points on the flow track corresponding to the positioning information sent in the starting period in a straight line; for the miniature camera, when the fact that the same asset disappears in the position where the historical image and the video appear is recognized, but appears in the starting period after the other place appears, drawing a flow track on an electronic map according to recognized coordinates corresponding to the two different places;

all positioning information includes coordinate information and additional information including the name, location and number of the asset, and the artificial intelligence model includes a Convolutional Neural Network (CNN).

8. The system according to claim 7, wherein the intelligent mobile terminal held by the manager has a positioning function, and is provided with an asset management app, when the analysis terminal analyzes the flow track according to the positioning information, it is immediately judged whether the searched mobile track of the intelligent mobile terminal held by the manager matches with the flow track, if matching, it is against any one or a combination of usage information, maintenance information, update information, and relocation information, if matching is possible, it is judged that the flow track obtained by the analysis is caused by the corresponding usage behavior, maintenance behavior, update behavior, and relocation behavior, and the display state is normal, if otherwise, it is not judged that the usage behavior, maintenance behavior, update behavior, and relocation behavior are related to the flow track obtained by the analysis by the manager, and if the analysis is confirmed, it is not confirmed that the analysis is complete, if the analysis is complete, or if the management app is unloaded, it is required to input the confirmation information on the intelligent mobile terminal, it is respectively determined that the analysis terminal is overtime, and if the confirmation is not confirmed that the analysis is complete, and if the confirmation is not confirmed that the confirmation is complete, it is not confirmed that the analysis complete; if the behaviors are not matched, judging that the behaviors of the non-manager are not judged;

the method for judging whether the moving track of the intelligent mobile terminal held by the searched manager is matched with the moving track is that coordinate information in positioning information corresponding to a point in a starting period on the moving track and coordinate information obtained by a positioning function of the point on the moving track are acquired, and whether a distance between the two pieces of coordinate information is smaller than a preset value or not is compared, wherein the preset value is smaller than or equal to 3m.

9. A computer-readable non-transitory storage medium provided in an analysis terminal of a smart asset management system according to any one of claims 1 to 8, wherein a program executable by the analysis terminal to implement smart asset management is stored.

10. A storage medium installed in an intelligent mobile terminal held by a manager in an intelligent asset management system according to any of claims 1-8, wherein an asset management application app is stored for said a priori analysis terminal to confirm usage information, maintenance information, update information, relocation information, and to confirm usage behavior, maintenance behavior, update behavior, relocation behavior.