WO2018035667A1 - Display method and apparatus, electronic device, computer program product, and non-transient computer readable storage medium - Google Patents

Abstract

Provided are a display method and apparatus, an electronic device, a computer program product, and a non-transient computer readable storage medium. The method comprises: acquiring an image feature of a tracked object (101); performing, on the basis of the image feature of the tracked object, image identification on multiple monitoring images acquired from different locations, to determine a monitoring image that matches the image feature (102); and generating a trace of the tracked object on the basis of the locations of the acquired monitoring images that match the image feature, and displaying the trace on an electronic map (103). According to the method, an image feature of a tracked object is automatically identified in images of a monitoring video, locations of the acquired monitoring images that match the image feature are recorded, a trace of the tracked object is obtained through further intelligent processing on the basis of the locations, and the trace of the tracked object is displayed on an electronic map, so that a user can intuitively acquire monitoring information of the tracked object.

Description

Display method, device, electronic device, computer program product, and non-transitory computer readable storage medium Technical field

The present invention relates to the field of video surveillance technologies, and in particular, to a display method, apparatus, electronic device, computer program product and non-transitory computer readable storage medium in video surveillance.

Background technique

Video surveillance can be applied to many social fields such as urban management, security, and marketing. The video surveillance system has undergone the first generation of analog video surveillance system Closed Circuit Television (CCTV), to the second generation of digital video surveillance systems based on computers and multimedia cards, and has developed into the existing third generation network-based video surveillance. system.

The existing video surveillance system usually consists of a terminal probe, a transmission network and a server. After the terminal probe collects the surveillance video, the monitoring data is transmitted to the server through the transmission network, and then the monitoring video is played for the monitoring personnel, and the monitoring personnel manually identify the monitoring target. And analysis.

The disadvantages of the prior art are:

The existing video surveillance system is not intelligent enough to monitor and analyze the target, and is highly dependent on manual analysis.

Summary of the invention

The embodiment of the invention provides a display method, a device, an electronic device and a computer program product, so that the video monitoring system can intelligently monitor and analyze the target, and reduce the dependence on the manual analysis.

In one aspect, an embodiment of the present invention provides a display method, where the method includes:

Obtaining image features of the tracked target;

Mapping multiple monitoring images from different acquisition locations based on image characteristics of the tracked target Image recognition to determine a monitoring picture that conforms to the characteristics of the image;

A trace of the tracked target is generated based on the acquisition locations of the respective monitor images that conform to the image features and displayed on the electronic map.

In another aspect, an embodiment of the present invention provides a display device, where the device includes:

An image feature acquisition module, configured to acquire image features of the tracked target;

An image recognition module, configured to perform image recognition on a plurality of monitoring images from different collection locations according to image features of the tracked target to determine a monitoring image that conforms to the image features;

And a display module, configured to generate a trace of the tracked target according to the collected position of each monitoring screen that meets the image feature and display the image on the electronic map.

In another aspect, an embodiment of the present invention provides an electronic device, including: a display, a memory, one or more processors; and one or more modules, the one or more modules being stored in The memory is configured and executed by the one or more processors, the one or more modules including instructions for performing the various steps of the methods described above.

In another aspect, embodiments of the present invention provide a computer program product for use with an electronic device including a display, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, The computer program mechanism includes instructions for performing the various steps of the above methods.

In another aspect, embodiments of the present invention provide a non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the above method Each step.

The beneficial effects of the present invention are as follows:

The invention automatically recognizes the image features of the tracked target in the picture of the monitoring video and records the collection positions of the respective monitoring pictures that conform to the image features, further intelligently processes the traces of the tracked objects according to the collected positions, and will be tracked The target trace is displayed on the electronic map, enabling the user to intuitively obtain the monitoring information of the tracked target.

DRAWINGS

Specific embodiments of the present invention will be described below with reference to the accompanying drawings, in which:

1 is a schematic flow chart of a display method in Embodiment 1 of the present invention;

2a-2d are schematic views showing the display in the first embodiment of the present invention;

3 is a schematic flow chart of a display method in Embodiment 2 of the present invention;

4a-4b are schematic diagrams showing the second embodiment and the third embodiment of the present invention;

FIG. 5 is a schematic flow chart showing a display method in Embodiment 3 of the present invention;

6a-6f are schematic views showing the display in the fifth embodiment of the present invention;

FIG. 7 is a schematic diagram showing the architecture of a monitoring system in each implementation sixth of the present invention; FIG.

FIG. 8 is a schematic structural view of a display device in Embodiment 7 of the present invention.

detailed description

The embodiments of the present invention are further described in detail with reference to the accompanying drawings, in which FIG. An exhaustive example. And in the case of no conflict, the features in the embodiments and the embodiments in the description can be combined with each other.

The inventor noticed during the invention that the existing video surveillance system is not intelligent enough to monitor and analyze the target, and is highly dependent on manual analysis.

In view of the above deficiencies, the present invention provides a display method for automatically identifying image features of a tracked target in a screen of a surveillance video and recording the collection locations of the respective monitoring images that conform to the image features, and further intelligently processing according to the collection locations. A trace of the tracked target is obtained, and the tracked target track is displayed on the electronic map, so that the user can intuitively obtain the monitoring information of the tracked target.

In order to facilitate the implementation of the present invention, the following description will be made by way of examples.

Embodiment 1:

1 is a schematic flowchart of a display method in Embodiment 1 of the present invention. As shown in FIG. 1, the display method includes:

Step 101: Acquire image features of the tracked target;

Step 102: Perform image recognition on multiple monitoring screens from different collection locations according to image features of the tracked target to determine a monitoring screen that conforms to the image features;

Step 103: Generate a trace of the tracked target according to the collection position of each monitoring screen that meets the image feature and display it on the electronic map.

In step 101, the monitoring system needs to acquire the image features of the target before monitoring or analyzing a certain tracked target. In this embodiment, the tracked target may be extracted according to a clear image of the tracked target input by the user. The image feature may also directly use the image feature data input by the user as the image feature of the tracked target, and may also extract or learn image features of a tracked target on certain frame images of the source video specified by the user. For example, the wanted image of the wanted person is extracted by the user to extract the facial image feature of the wanted person, or the user inputs the grayscale data of a certain pattern as the image feature of the tracked target; or the user intercepts the desired image in a certain frame of the source video. The target face image from which the target face image feature and the like are extracted.

Preferably, the acquiring the image feature of the tracked target comprises: acquiring an image feature input by the user as an image feature of the tracked target.

The image features of the tracked target that are desired to be monitored or analyzed are input by the user, so that the display result can be more suitable for the user's needs. The manner in which the user inputs the image feature of the tracked target may be: extracting the image feature of the tracked target according to the image of the monitoring target input by the user; using the image feature data input by the user as the image feature of the tracked target; The image features of a tracked target are extracted or learned on certain frame pictures of the source video.

In step 102, image recognition of a plurality of monitoring images from different collection locations is performed based on image features of the tracked target to determine a monitoring screen that conforms to the image features. The system needs to obtain the source monitoring video by each monitoring terminal, and the monitoring video includes a multi-frame monitoring picture. The monitoring screen may be a monitoring screen in a video stream collected by each monitoring terminal in real time, or may be a monitoring screen in a historical monitoring video read from a historical monitoring video library.

The image features of the tracked target acquired in step 101 are identified in each source monitoring video in real time or non-real time. The specific method of image feature recognition may refer to existing image recognition technologies. Once the image feature of the tracked target is identified in a certain frame or a certain frame of the monitoring video of each segment of the monitoring video, that is, once the monitoring target appears in the monitoring screen of a certain monitoring video, the current determination is determined. The screen is a monitoring screen that conforms to the image characteristics of the tracked target.

After determining the monitoring screen that conforms to the image feature of the tracked target, the information of the monitoring screen is recorded, where at least the collection position of the monitoring screen, that is, the monitoring video corresponding to the monitoring image of the image feature of the tracked target, is included. Collection location. The location of the monitoring video is the location of the monitoring device that collects the surveillance video or the location where the device is aligned. It is a precise location that can be marked on the map, such as latitude and longitude, relative coordinates, or street and distance information. The collection location of the monitoring video may be acquired together with the source monitoring video, or after the monitoring screen of the image feature of the tracked target is determined in this step, the collection location is not directly recorded, and the recording location is recorded first. The identifier of the monitoring video source or the identifier of the monitoring device that collects the video source, and then check the table to obtain the location for recording.

The information of the monitoring screen that conforms to the image features of the tracked target can be recorded by referring to the following table:

The collection position of the monitoring screen that matches the image characteristics of the tracked target Coordinate 1 Coordinate 2 Coordinate 1 Coordinate 3 ......

Table 1 shows the information record of the monitoring screen.

In the process of recording the above information, the image feature of the tracked target may be recorded once in the monitoring screen, or the image feature of the tracked target may be recognized in a certain monitoring image, and then in several consecutive monitoring images. No more recorded when the image feature of the tracked target appears.

In step 103, a trace of the tracked target is generated and displayed on the electronic map based on the information of the monitor screen that conforms to the image feature of the tracked target. The trace may be a combination of one or more of the following:

1) Identify the set of identification points at the location of the monitoring screen of the tracked target, as shown in Figure 2a An example of the display of such a situation; 2) expanding the set of identification points of a certain range centering on the position of the monitoring screen for identifying the tracked object, FIG. 2b shows a display example of such a case; 3) for all Identifying the monitoring screen collection position of the tracked target, performing clustering and the like to obtain an appearance area of the tracked target, and displaying the calculated appearance area of the tracked target as an area trace of the tracked target, as shown in FIG. 2c. An example of the display of the situation; 4) determining, in the divided area of the electronic map, which one or which areas of the divided area are mainly present in the divided area according to the monitoring picture collection position of the tracked target, The divided area is determined as the appearance area of the user, thereby generating an area trace, and a display example of such a case is shown in Fig. 2d.

Of course, the monitoring screen collection position of the tracked target can be intelligently processed in other ways to obtain the trace of the tracked target, and displayed on the electronic map.

When a large amount of monitoring screen information conforming to the characteristics of the tracked target image is accumulated, the layered display on the electronic map enables the monitoring personnel to intuitively determine the location of the tracked target trace, which is convenient for analysis, management, and security maintenance.

In this embodiment, the image features of the tracked target are automatically identified in the screen of the monitoring video, and the collection positions of the respective monitoring images that meet the image features are recorded, and the trace of the tracked target is further intelligently processed according to the collected position, and will be The tracking target trace is displayed on the electronic map, enabling the user to intuitively obtain the monitoring information of the tracked target.

Embodiment 2:

This embodiment is implemented on the basis of the display method of the first embodiment. For the similarities or repetitions of the first embodiment, reference may be made to the description of the first embodiment. FIG. 3 is a schematic flowchart of a display method in Embodiment 2 of the present invention, where the display method includes the following steps:

Step 201: Acquire a first image feature of the tracked target, and simultaneously acquire a second image feature of the tracked target;

Step 202: Perform image recognition on a plurality of monitoring images from different collection locations according to the first image feature of the tracked target to determine a first type of monitoring image that conforms to the first image feature; and, in obtaining Tracking the second image feature of the target, according to the second of the tracked target Performing image recognition on the first type of monitoring image to determine a second type of monitoring image that simultaneously conforms to the first image feature and the second image feature;

Step 203: Generate a first trace of the tracked target according to the collection position of each first type of monitoring image that meets the first image feature and display it on the electronic map; and, according to the first image feature and the The acquisition position of the second type of monitoring image of the second image feature generates a second trace of the tracked object and is displayed on the electronic map different from the first trace.

In step 201, a first image feature and a second image feature of the tracked object are acquired simultaneously, the first image feature being different from the second image feature. In a specific implementation, the first image feature may be an image feature of a large class of tracked targets, and the second image feature is an image of a majority of the tracked targets having the first image feature. feature. For example, the monitoring personnel input the image feature of the white car as the first image feature, and the image feature with the license plate number of “Kyo A12345” is the second image feature, and the tracked target is all white cars. Further, the important tracked target is The white car with the license plate number "Kyoto A12345", that is, the tracked target has the first image feature, and the important tracked target has both the first image feature and the second image feature. Of course, the monitoring personnel can also determine a plurality of other license plate numbers, that is, determine a different set of second image features corresponding to the same first image feature, for example, the tracked target is all white cars, and the important tracked targets are respectively white cars. Vehicles with different license plate numbers.

Similar to the first embodiment, the first or second image feature may be extracted according to a clear image of the tracked target input by the user, or the image feature data input by the user may be directly used as the first or the first target of the tracked target. The second image feature may also extract or learn the first or second image feature on certain monitored images of the specified source video.

In step 202, image recognition is performed on a plurality of monitoring images from different collection locations according to the first image feature and the second image feature of the tracked target. In the specific identification process, the first image feature is first identified according to the first image feature, and the first type of monitoring image conforming to the first image feature is determined, and the second image feature is further identified in the first type of monitoring image. The first type of monitoring picture that meets the second image feature is determined to be the second type of monitoring picture. If the previous steps get more For the second image feature, each of the second image features can be simultaneously identified in the first type of monitoring image to obtain a plurality of sets of the second type of monitoring images.

According to the image recognition result, the information of the first type of monitoring screen and the information of the second type of monitoring screen are recorded. For specific implementation, the recording may be separately performed by referring to the form of Table 1 above, or may be combined with reference to the following Table 2:

Table 2 shows the information record of the monitoring screen.

In step 203, a first trace of the tracked target is generated according to the collected position of the first type of monitoring image and displayed on the electronic map; and according to the second image that conforms to the first image feature and the second image feature. The acquisition location of the class monitoring screen generates a second trace of the tracked object and is displayed on the electronic map different from the first trace. The difference is displayed, that is, when the second trace is displayed, the display is performed using a different trace form or display feature than the first trace. The trace form may be: a marker point, a marker point having a certain expansion range, and an area trace obtained by clustering or region division, and may further carry a trace with time information based on the foregoing trace form. The display feature may be: a color, a mark point shape, a mark point size, a layer, a mark of adding an image feature or a dynamic display mode, and a display manner that other monitoring personnel can distinguish.

Figure 4a shows a schematic representation of the first trace and the second trace in different traces, with different shape display features for differential display. That is, the trace form of the first trace is a marker point, and the trace form of the second trace is a marker point plus a track; the marker point of the first trace shows that the feature is a circle, and the marker point of the second trace shows that the feature is a square.

Figure 4b shows the first trace and the second trace in the same trace form, adding different image features A schematic diagram showing the distinguishing display of the displayed features of the mark. That is, the trace forms of the first trace and the second trace are both regional traces, but no mark (black background) is added on the first trace, and a mark of the second image feature is added to the second trace, such as "Kyo A12345".

The difference between the first trace and the second trace is displayed to enable the user to further acquire one of the more specific, simultaneously having the first image feature and the second, based on the monitoring information of the large class of objects having the first image feature. The monitoring information of the tracked target of the image feature is displayed visually.

For example, while displaying the traces of the courier vehicles with the same logo, it is possible to distinguish the different license plate numbers from the specific travel data of different vehicles; for example, to display the traces of similar vehicles (dangerous vehicles, such as tank trucks), it is possible to distinguish different license plates. The number shows specific driving data of different vehicles; for example, while displaying the trace of the same license plate number vehicle, it is possible to distinguish the facial features of different drivers to display specific driving data when different people drive the vehicle; and, for example, to display a certain image according to facial recognition At the same time as the criminal suspect traces, it is possible to distinguish between the range of activities in which the clothes are displayed and the different clothing states.

In this embodiment, the monitoring personnel has determined that the first image feature shared by a large class of objects and the second image feature of some of the key targets are to be retrieved before the monitoring video is analyzed, so that two Image features are identified and synchronized for simultaneous display.

The embodiment can automatically identify a large class of objects having the first image feature in the monitoring video, and the key target of the second class image having the second image feature, and then the target of the major class and the key target thereof The monitoring information is differentiated and displayed, so that users can obtain monitoring information of some key targets at the same time while intuitively acquiring monitoring information of a large class of targets.

Embodiment 3:

This embodiment is implemented on the basis of the display method of the first embodiment, and is similar to the second embodiment. For the similarities or repetitions of the first embodiment and the second embodiment, reference may be made to the descriptions of the first embodiment and the second embodiment. FIG. 5 is a schematic flowchart of a display method in Embodiment 3 of the present invention, where the display method includes the following steps:

Step 301: Acquire a first image feature of the tracked target.

Step 302, when acquiring the first image feature of the tracked target, performing image recognition on the plurality of monitoring images from different collection locations according to the first image feature of the tracked target to determine that the first image feature is met The first type of monitoring screen;

Step 303, when acquiring the first image feature of the tracked target, generating a first trace of the tracked target according to the collection position of each first type of monitoring image that meets the first image feature and displaying the image on the electronic map;

Step 304: Acquire a second image feature of the tracked target.

Step 305: Perform image recognition on the first type of monitoring image according to the second image feature of the tracked target when acquiring the second image feature of the tracked target, to determine that the first image feature is consistent with a second type of monitoring image of the second image feature;

Step 306, when acquiring the second image feature of the tracked target, generating a second trace of the tracked target according to the collection position of the second type of monitoring image that simultaneously meets the first image feature and the second image feature. The first trace is distinguished from the display on the electronic map.

Step 301 and step 304 in this embodiment correspond to step 201 in the second embodiment, step 302 and step 305 correspond to step 202 in the second embodiment, step 303 and step 306 are the same as steps in the second embodiment. 203 corresponds. The specific implementation manners of the steps are the same, except that in the embodiment, after the first trace of the large-scale target has been obtained according to the first image feature, the display result on the electronic map is further determined according to the second target obtained. The image feature performs image recognition on the important target in the first type of monitoring image, and generates a second trace of the important target superimposed on the original first trace and performs differential display.

Step 301 to step 303 and step 304 to step 306 in this embodiment perform two-step image recognition and result display. The two-step image recognition and result display can be in the following two ways:

One implementation is to re-image all the source videos after obtaining the first step display result and acquiring the second image feature. This implementation second step identification and display step is similar to the steps in the second embodiment.

Another preferred implementation is that in the second step image recognition process, only the first image feature is monitored in the first image recognition process, that is, the second image feature is retrieved in the first type of image recognition process. In this implementation, after determining the first type of monitoring pictures that meet the first image feature in step 302, the first type of monitoring pictures are extracted and recorded. When some monitoring pictures are consecutive frames in the video, the most representative one or several frames of monitoring pictures can be extracted and recorded as the first type of monitoring pictures. Usually, the first image features can be selected to be the clearest. Or the first image feature occupies a frame or a few frames of the monitor image with the largest area ratio. It can be understood that the calculation amount of such an implementation will be smaller than the calculation amount of the first mode.

In this embodiment, the monitoring personnel only determines that the first image feature shared by a large class of objects is to be retrieved when the first image is recognized by the monitoring video, and after obtaining the first step display result, some important ones are The second image feature possessed by the target further performs image recognition, and displays and distinguishes the new result from the search result of the first image recognition.

The embodiment can automatically identify a large class of objects having the first image feature in the monitoring video, and the key target of the second class image having the second image feature, and then the target of the major class and the key target thereof The monitoring information is differentiated and displayed, so that the user can obtain the monitoring information of some key targets further intuitively while acquiring the monitoring information of a large class of targets.

Embodiment 4:

This embodiment is implemented on the basis of any of the above-described first to third display methods. For the similarities or repetitions of the first to third embodiments, reference may be made to the description of the first to third embodiments.

This embodiment further provides the following preferred solutions:

Generating a trace of the tracked target according to the collected position of each monitoring picture that meets the image feature and displaying the trace on the electronic map includes: generating an area trace of the tracked target according to the collected position of each monitoring picture that meets the image feature And displayed on the electronic map.

In a specific implementation, after determining a position point of the collection position of each monitoring picture that meets the image feature, the position point is clustered, and each group of the position points after the clustering (excluding the noise point whose distance is too far) is All the locations are connected by two or two, and the outer edges of all the connections are tracked. The target area trace; or calculate the center of gravity for each set of position points after clustering (excluding noise points that are too far away), and center the center of gravity, the distance between the position farthest from the center of gravity and the center of gravity ( Or the radius is greater than or less than the preset threshold), and the obtained circular area is the area trace of the tracked target.

In a specific implementation, the area trace of the tracked target may also be determined according to the divided area, where the divided area is an area divided according to a street, a public security jurisdiction or an administrative area, and each monitoring screen conforming to the image feature is determined. The location point in the collection location information appears at most or which of the divided regions, and the one or several divided regions are used as the region trace of the tracked target.

When the first trace and the second trace are displayed according to the first image feature or the second image feature, the traces of the first trace and the second trace may be the same or different, and may be regional traces or only one type The trail is a regional trail.

In this embodiment, after the occurrence area of the tracked target is intelligently processed, the area trace is displayed on the electronic map. Compared with the display of other traces, the area trace is more convenient for the monitoring personnel to visually confirm the appearance area of the tracked target, which is convenient for subsequent monitoring or taking. Related actions.

Embodiment 5:

This embodiment is implemented on the basis of the target tracking display method according to any one of the first to fourth embodiments. For the similarities or repetitions of the first to fourth embodiments, reference may be made to the descriptions of the first to fourth embodiments.

The following preferred solution is further provided in this embodiment:

Generating a trace of the tracked target according to the collection position of each monitoring screen that meets the image feature and displaying the trace on the electronic map includes: generating a time according to the collection position and the acquisition time of each monitoring screen that meets the image feature A trace of the tracked target of the information is displayed on the electronic map.

In the above embodiment, in the process of performing image recognition in each picture of the video source according to the image feature of the tracked object, or according to the first image feature or the second image feature, determining the image feature that matches the tracked target After monitoring the screen, the information of the monitoring screen is recorded, and In addition to the collection location of the monitoring screen, the acquisition time is included. When recording the acquisition time, when the image feature of the tracked target is retrieved in a certain monitoring screen, the time of recording the current monitoring screen is the acquisition time; or when the image feature of the tracked target appears in the continuous monitoring screen The time of the monitoring screen that first recognizes the image feature of the tracked target is the acquisition time, that is, the start time, and is not recorded when the image feature of the tracked target appears in the continuous monitoring screen; and may also be in a certain monitoring screen. After identifying the image features of the tracked target, it is determined whether the image features of the tracked target are still present in the subsequent consecutive image frames until the image features of the tracked target no longer appear, and only the last appearance of the image features of the tracked target is recorded. The time of the screen is the acquisition time, that is, the end time; the middle point of the start time and the end time may be the acquisition time, or the acquisition time of the monitoring image with the highest image feature matching rate of the tracked target between the start time and the end time.

In the first embodiment, the information of the monitoring screen conforming to the image features of the tracked target can be recorded by referring to the following Table 3:

Table 3 shows the information record of the monitoring screen.

Similarly, in the second embodiment, the information of the monitoring picture that conforms to the first image feature and the information of the monitoring picture that conforms to the first image feature and the second image feature can be recorded in the following table:

Table 4 shows the information record of the monitor screen.

In each of the above embodiments, the trace carrying the collection time information is displayed on the electronic map according to the collection time and the collection location included in the information of the monitoring screen that conforms to the image feature;

The manner in which the trace carries the collection time information may be one or a combination of the following:

1) Add an acquisition time identifier to the trace;

Including identifying an identification time or an acquisition time period for each location identification point, each expanded range of location identification points, or each regional trace;

Figures 6a-6d show examples of the display of several typical traces on the electronic map after the acquisition time identification.

2) Display a trace carrying the collection time information;

For the case where the trace itself contains acquisition time information, the acquisition time information is carried along with the trace. For example, the trajectory is a kind of trace carrying the acquisition time information (because when the trajectory is generated, the position of the collection position included in the monitoring screen information is sequentially connected according to the order of the acquisition time included in the monitoring screen information), so as to further highlight The trajectory serves as the information of the acquisition time carried by the trace, and the trajectory direction can be indicated on the trajectory according to the acquisition time.

Fig. 6e shows an example of display on the electronic map when the trace is a trajectory; Fig. 6f shows a display example in which the trace is added as shown in 1) when the trace is a trajectory to which the moving direction is added, and is displayed. .

3) distinguishing the traces according to the collection time;

It is possible to gradually display the trace of the target on the electronic map according to the sequence of the acquisition time. Since the period of the acquisition time is much longer than the time of the display process, the period of the acquisition time can be compressed in a certain proportion during the display process; The color or size of the target may be displayed according to the sequence of the collection time. For example, the collection information corresponding to the current acquisition time is darker or more obvious.

Performing image recognition based on the first image feature or the second image feature and generating a first trace and a When the two traces are displayed, the traces of the first trace and the second trace may be the same or different, that is, the time information may or may not be carried.

Preferably, the generating, according to the collection position and the acquisition time of each monitoring picture that meets the image feature, a trace of the tracked target carrying the time information and displaying the trace on the electronic map includes: monitoring according to the image characteristics The acquisition position and acquisition time of the picture generate traces of the tracked target marked with the acquisition time and are displayed on the electronic map.

Including adding an acquisition time or an acquisition time period identifier for each location point, each location range, each target appearance area, or each track;

Figures 6a-6d and 6f show examples of display of several typical traces on the electronic map after the acquisition time identification.

Preferably, the generating, according to the collection position and the acquisition time of each monitoring picture that meets the image feature, a trace of the tracked target carrying the time information and displaying the trace on the electronic map includes: monitoring according to the image characteristics The acquisition position and acquisition time of the screen generate the trajectory of the tracked target and display it on the electronic map.

In a specific implementation, each location point may be sequentially connected according to the collection position and the acquisition time in the monitoring screen information conforming to the image feature, and the trajectory of the monitored target is generated. The trajectory of the monitored target is taken as a trace of the monitored target. In the process of generating the trajectory, points that are obviously unreasonable can be excluded, and the trajectory is fitted according to the street.

Fig. 6e shows an example of display on the electronic map when the trace of the monitored target is a trajectory; Fig. 6f shows that the trace of the monitored target is a trajectory to which the moving direction is added, and the display of the time stamp is further added when displayed Example.

When a large amount of information conforming to the monitoring image of the tracked target image feature is accumulated, when the tracked target track per unit time (for example, every day) is displayed on the electronic map, the monitoring personnel can be provided with frequent activities in the target time period. Scope for easy analysis, management and security maintenance.

In this embodiment, the information of the monitoring screen conforming to the image feature is enriched to include the acquisition time of the monitoring screen, and then the trace is generated according to the information of the monitoring screen conforming to the image feature and displayed in the trace On the electronic map, the collection time information can be carried in various forms to provide users with more comprehensive monitoring information more flexibly; in addition, an intelligent scheme for displaying traces in the form of tracks is proposed to provide users with more intuitive monitoring information.

Example 6:

FIG. 7 is a schematic structural diagram of a monitoring system according to Embodiment 6 of the present invention, which includes a video acquisition layer 601, a network access layer 602, and an intelligent analysis layer 603. The layers may be strongly coupled or loosely coupled.

The video capture layer 601 mainly includes various standard monitoring video acquisition devices, and can be a camera, a video recorder or a monitoring robot with a video capture function. Various monitoring video capture devices can have the following functions: 1) Multiple network access functions: monitoring video capture devices can support multiple networks such as LTE, Wifi, XPON, etc.; 2) Error correction function: high network packet loss rate, mobile Guarantee image quality under the network; 3) Breakpoint retransmission function: ensure data is not lost in case of abnormal network disconnection; 4) High-definition codec function: encode and decode images by high-definition codec algorithm to ensure monitoring video clarity; 5) Efficient coding compression function: achieve lower bandwidth and storage requirements under the same image quality, reduce bandwidth occupancy and storage space of different scenes; 6) Capturing high-speed moving object image capability: capture image recognition capability of video surveillance acquisition equipment An image of a moving object at high speed. The functions of the above 1) to 5) can be realized by the monitoring video collection device itself, or by externally connecting the enhanced device (such as a hardware box product, etc.) through a USB or an Ethernet port.

The various monitoring video capture devices transmit the collected multimedia information (images, sounds, etc.) to the intelligent analysis layer 603 through the network access layer 602.

The network access layer 602 is an IP bearer network. Further, the IP bearer network can be a dedicated acceleration/encryption network. The data stream of the video captured by the video capture device is connected to the network through LTE, Wifi, XPON, and the like. The layer 602 is further transferred to the intelligent analysis layer for processing. The use of a dedicated IP bearer network for monitoring video data transmission, compared with the traditional Internet service, can ensure the real-time performance of message transmission when the network has poor transmission quality (busy time), and avoid the monitoring accuracy or real-time due to poor network quality. Sex.

The intelligent analysis layer 603 performs AI (Artificial Intelligence) through cloud computing technology. The analysis can be performed by using the methods provided in the above embodiments to process and analyze the surveillance video, and the results can be sent to the command center or the monitoring center for linkage, and the city management and security can be achieved through visual dispatching, command and security linkage. Or marketing purposes.

Example 7:

Based on the same inventive concept, the display device is also provided in the embodiment of the present invention. Since the principle of solving the problem is similar to the display method, the implementation of the device may refer to the implementation of the method, and the repeated description is not repeated. FIG. 8 is a schematic structural diagram of a display device according to Embodiment 7 of the present invention. As shown in the figure, the device 700 includes:

The image feature acquiring module 701 is configured to acquire image features of the tracked target;

The image recognition module 702 is configured to perform image recognition on a plurality of monitoring images from different collection locations according to image features of the tracked target to determine a monitoring screen that conforms to the image features;

The display module 703 is configured to generate a trace of the tracked target according to the collected position of each monitoring screen that conforms to the image feature and display the image on the electronic map.

Preferably, the image feature acquiring module 701 is specifically configured to acquire an image feature input by the user as an image feature of the tracked target.

Preferably, the image feature obtaining module 701 is specifically configured to:

Obtaining a first image feature of the tracked target, and acquiring a second image feature of the tracked target, the acquisition time of the first image feature being earlier than or equal to the acquisition time of the second image feature;

The image recognition module 702 is specifically configured to:

When acquiring the first image feature of the tracked target, performing image recognition on the plurality of monitoring images from different collection locations according to the first image feature of the tracked target to determine a first image that conforms to the first image feature a class monitoring screen; when acquiring the second image feature of the tracked target, performing image recognition on the first type of monitoring image according to the second image feature of the tracked target to determine that the first image feature is simultaneously met And a second type of monitoring picture of the second image feature;

The display module 703 is specifically configured to:

When acquiring the first image feature of the tracked target, generating a first trace of the tracked target according to the collection position of each first type of monitoring image that matches the first image feature and displaying the image on the electronic map; When tracking the second image feature of the target, generating a second trace of the tracked target according to the collected position of the second type of monitoring image that simultaneously meets the first image feature and the second image feature and distinguishing it from the electronic map The first trace is displayed for display.

Preferably, the display module 703 is specifically configured to:

An area trace of the tracked target is generated based on the collection locations of the respective monitoring pictures that conform to the image features and displayed on the electronic map.

Preferably, the display module 703 is specifically configured to:

A trace of the tracked object carrying the time information is generated and displayed on the electronic map according to the collection position and the acquisition time of the respective monitoring pictures that conform to the image features.

Preferably, the display module 703 is specifically configured to:

Generating a trace of the tracked target marked with the acquisition time according to the collection position and the acquisition time of each monitoring picture that meets the image feature and displaying on the electronic map;

Alternatively, the trajectory of the tracked object is generated and displayed on the electronic map according to the collection position and the acquisition time of the respective monitoring pictures that conform to the image features.

Example 8:

Based on the same inventive concept, an embodiment of the present invention provides a target tracking display electronic device. Since the principle is similar to that of a target tracking display, the implementation of the method can be referred to the implementation of the method, and the repeated description is not repeated. The electronic device includes: a display, a memory, one or more processors; and one or more modules, the one or more modules being stored in the memory and configured to be configured by the one or more The processor executes, the one or more modules including instructions for performing the various steps of any of the above methods.

Example 9:

Based on the same inventive concept, an embodiment of the present invention further provides a target trace display computer program product for use in combination with an electronic device including a display, which is based on a principle and a target trace. The method is similar, so the implementation can refer to the implementation of the method, and the repeated description will not be repeated. The computer program product comprises a computer readable storage medium and a computer program mechanism embodied therein, the computer program mechanism comprising instructions for performing the various steps of any of the foregoing methods.

Example 10:

Based on the same inventive concept, an embodiment of the present invention further provides a non-transitory computer readable storage medium storing computer instructions for causing the computer to execute any Each step in the foregoing method.

For the convenience of description, the various parts of the above-described apparatus are separately described by functions into various modules. Of course, the functions of the various modules or units may be implemented in one or more software or hardware in the practice of the invention.

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The device is implemented in a flow chart or Multiple processes and/or block diagrams The functions specified in one or more boxes.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

While the preferred embodiment of the invention has been described, it will be understood that Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and the modifications and

Claims (15)

A display method, characterized in that the method comprises: Obtaining image features of the tracked target; Performing image recognition on a plurality of monitoring images from different collection locations according to image features of the tracked target to determine a monitoring screen that conforms to the image features; A trace of the tracked target is generated based on the acquisition locations of the respective monitor images that conform to the image features and displayed on the electronic map. The method according to claim 1, wherein the acquiring the image feature of the tracked target comprises: acquiring an image feature input by the user as an image feature of the tracked target. The method of claim 1 wherein: The acquiring image features of the tracked target includes: Obtaining a first image feature of the tracked target, and acquiring a second image feature of the tracked target, the acquisition time of the first image feature being earlier than or equal to the acquisition time of the second image feature; Performing image recognition on the plurality of monitoring images from different collection locations according to the image features of the tracked target to determine a monitoring screen that conforms to the image features, including: When acquiring the first image feature of the tracked target, performing image recognition on the plurality of monitoring images from different collection locations according to the first image feature of the tracked target to determine a first image that conforms to the first image feature a class monitoring screen; when acquiring the second image feature of the tracked target, performing image recognition on the first type of monitoring image according to the second image feature of the tracked target to determine that the first image feature is simultaneously met And a second type of monitoring picture of the second image feature; Generating a trace of the tracked target according to the collection position of each monitoring screen that meets the image feature and displaying the trace on the electronic map, including: When acquiring the first image feature of the tracked target, generating a first trace of the tracked target according to the collection position of each first type of monitoring image that meets the first image feature and on the electronic map Displaying; when acquiring the second image feature of the tracked target, generating a second trace of the tracked target according to a collection position of the second type of monitoring image that simultaneously meets the first image feature and the second image feature and The electronic map is displayed differently from the first trace. The method according to claim 1, wherein the generating a trace of the tracked target according to the collection position of each of the monitoring images conforming to the image feature and displaying the trace on the electronic map comprises: An area trace of the tracked target is generated based on the collection locations of the respective monitoring pictures that conform to the image features and displayed on the electronic map. The method according to claim 1, wherein the generating a trace of the tracked target according to the collection position of each of the monitoring images conforming to the image feature and displaying the trace on the electronic map comprises: A trace of the tracked object carrying the time information is generated and displayed on the electronic map according to the collection position and the acquisition time of the respective monitoring pictures that conform to the image features. The method according to claim 5, wherein the generating a trace of the tracked target carrying the time information according to the collection position and the acquisition time of each of the monitoring images conforming to the image feature is displayed on the electronic map, including : Generating a trace of the tracked target marked with the acquisition time according to the collection position and the acquisition time of each monitoring picture that meets the image feature and displaying on the electronic map; or, A trajectory of the tracked object is generated and displayed on the electronic map according to the collection position and the acquisition time of the respective monitoring pictures that conform to the image features. A display device, characterized in that the device comprises: An image feature acquisition module, configured to acquire image features of the tracked target; An image recognition module, configured to perform image recognition on a plurality of monitoring images from different collection locations according to image features of the tracked target to determine a monitoring image that conforms to the image features; And a display module, configured to generate a trace of the tracked target according to the collected position of each monitoring screen that meets the image feature and display the image on the electronic map. The device according to claim 7, wherein the image feature acquisition module is configured to acquire an image feature input by the user as an image feature of the tracked target. The device of claim 7 wherein: The image feature acquisition module is specifically configured to: Obtaining a first image feature of the tracked target, and acquiring a second image feature of the tracked target, the acquisition time of the first image feature being earlier than or equal to the acquisition time of the second image feature; The image recognition module is specifically configured to: When acquiring the first image feature of the tracked target, performing image recognition on the plurality of monitoring images from different collection locations according to the first image feature of the tracked target to determine a first image that conforms to the first image feature a class monitoring screen; when acquiring the second image feature of the tracked target, performing image recognition on the first type of monitoring image according to the second image feature of the tracked target to determine that the first image feature is simultaneously met And a second type of monitoring picture of the second image feature; The display module is specifically configured to: When acquiring the first image feature of the tracked target, generating a first trace of the tracked target according to the collection position of each first type of monitoring image that matches the first image feature and displaying the image on the electronic map; When tracking the second image feature of the target, generating a second trace of the tracked target according to the collected position of the second type of monitoring image that simultaneously meets the first image feature and the second image feature and distinguishing it from the electronic map The first trace is displayed for display. The device according to claim 7, wherein the display module is specifically configured to: An area trace of the tracked target is generated based on the collection locations of the respective monitoring pictures that conform to the image features and displayed on the electronic map. The device according to claim 7, wherein the display module is specifically configured to: A trace of the tracked object carrying the time information is generated and displayed on the electronic map according to the collection position and the acquisition time of the respective monitoring pictures that conform to the image features. The device according to claim 11, wherein the display module is specifically configured to: Generating a trace of the tracked target marked with the acquisition time according to the collection position and the acquisition time of each monitoring picture that meets the image feature and displaying on the electronic map; or, A trajectory of the tracked object is generated and displayed on the electronic map according to the collection position and the acquisition time of the respective monitoring pictures that conform to the image features. An electronic device, comprising: a display, a memory, one or more processors; and one or more modules, the one or more modules being stored in the memory and configured to be executed by the one or more processors, The one or more modules include instructions for performing the various steps of the method of any of claims 1-6. A computer program product for use with an electronic device including a display, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, the computer program mechanism comprising for performing claim 1 The instructions of the various steps in any of the methods described in 6. A non-transitory computer readable storage medium, wherein the non-transitory computer readable storage medium stores computer instructions for causing the computer to perform any of claims 1-6 The various steps of the method.

Images