TWI846392B - Monitoring method, device, internet of vehicles server, and storage medium - Google Patents

Abstract

A monitoring method, a device, an internet of vehicles server, and a storage medium are provided. The method is applied on the internet of vehicles server. The method obtains images captured by a number of cameras in a surround-view camera of a preset vehicle from all the preset vehicles in a monitoring area. Each preset vehicle starts a sentry mode. If the obtained images include an image captured by the cameras in the surround-view camera of the first preset vehicle where one or more suspect objects of the first preset vehicle is existed, and a definition of the suspect objects in the image is less than a preset value, the method determines one or more second preset vehicles according to the image captured by the cameras in the surround-view camera of the first preset vehicle where one or more suspect objects of the first preset vehicle is existed. The second preset vehicles are different from the first preset vehicle. An lighting area lighted by a preset exterior lamp of each second preset vehicle includes the one or more suspect objects. The method further informs the second preset vehicles each to start the preset exterior lamp.

Description

Monitoring method, device, vehicle networking server and storage medium

The present application embodiment relates to the field of vehicle networking, and in particular to a monitoring method, device, vehicle networking server and storage medium.

At present, many vehicles are equipped with sentry mode, which can ensure the safety of vehicle property when it is turned on. Specifically, when the sentry mode is turned on, the panoramic camera of the vehicle can start to monitor the surrounding environment of the vehicle. At this time, the monitoring area of the vehicle is the surrounding environment of the vehicle. When there are suspicious objects in the surrounding environment of the vehicle (such as people, objects or things that pose a threat to the vehicle), the vehicle will automatically turn on the vehicle's headlights and other preset exterior lights. At the same time, the panoramic camera of the vehicle can also automatically record videos, store videos, and send videos or notifications to the owner's terminal, such as a mobile phone, to notify the owner of the vehicle. Among them, since the suspicious object in front of the vehicle can be illuminated by the vehicle's preset exterior lights, the suspicious object in front of the vehicle is clear in the video. However, the suspicious object on the left, right or rear of the vehicle may not be clear in the video due to reasons such as dim light. This will result in the inability to record clear videos, resulting in loss of vehicle property.

In view of the above content, the present application embodiment provides a monitoring method, device, vehicle network server and storage medium, which can provide light source for suspicious objects to avoid unclear video recording.

In a first aspect, an embodiment of the present application provides a monitoring method, the method comprising: a vehicle network server obtains images collected by a panoramic camera device of a preset vehicle from all preset vehicles in a monitoring area; each preset vehicle turns on a sentry mode, each preset vehicle includes a panoramic camera device, and the panoramic camera device is used to collect images of the surrounding environment of the preset vehicle; each preset vehicle includes a preset exterior light; if there is a suspicious object of the first preset vehicle in the image collected by the panoramic camera device of the first preset vehicle in the image obtained by the vehicle network server, If the clarity of the suspicious object in the image captured by the panoramic camera of the first preset vehicle is less than a preset value, the vehicle network server determines the second preset vehicle based on the image of the suspicious object captured by the panoramic camera of the first preset vehicle; the first preset vehicle is the preset vehicle in the monitoring area; the second preset vehicle is different from the first preset vehicle; the illuminated area illuminated by the preset exterior lights of the second preset vehicle includes the suspicious object; the vehicle network server notifies the second preset vehicle to turn on the preset exterior lights.

According to some embodiments of the present application, before the vehicle networking server obtains images captured by the panoramic camera device of the preset vehicle from all preset vehicles in the monitoring area, the method further includes: the vehicle networking server determines that the monitoring area is the intersection of the image capture ranges of the panoramic camera devices of all preset vehicles.

According to some embodiments of the present application, the vehicle network server determines the second preset vehicle based on the image of the suspicious object collected by the panoramic camera device of the first preset vehicle, including: the vehicle network server detects the location information of the suspicious object based on the image of the suspicious object collected by the panoramic camera device of the first preset vehicle; the vehicle network server determines that the second preset vehicle is one or more preset vehicles whose illuminated area illuminated by the preset exterior lights includes the location information of the suspicious object.

According to some embodiments of the present application, the second preset vehicle is located at a different position of the first preset vehicle, and the different positions include at least two of the front, left, right and rear.

According to some embodiments of the present application, after the vehicle network server notifies the second preset vehicle to turn on the preset exterior lights, the method further includes: the vehicle network server determines that a third preset vehicle other than the first preset vehicle exists in the acquired image and is a suspicious object of the first preset vehicle; the third preset vehicle is a preset vehicle in the monitoring area; the vehicle network server notifies the third preset vehicle to record a video through a panoramic camera device; the vehicle network server obtains the video from the third preset vehicle; the vehicle network server sends the video to the owner terminal corresponding to the first preset vehicle.

According to some embodiments of the present application, the image acquired by the vehicle network server contains a suspicious object of the first preset vehicle in the image captured by the panoramic camera device of the first preset vehicle, and the clarity of the suspicious object in the image captured by the panoramic camera device of the first preset vehicle is less than a preset value. If the image acquired contains a suspicious object of the first preset vehicle in the image captured by the panoramic camera device of the first preset vehicle, the vehicle network server acquires the image captured by the panoramic camera device of the first preset vehicle. The current image includes a suspicious object of the first preset vehicle; when the current image is obtained, the preset exterior lights of the first preset vehicle are turned on; if the clarity of the suspicious object in the current image is less than a preset value, the vehicle network server determines that the obtained image contains a suspicious object of the first preset vehicle in the image captured by the panoramic camera device of the first preset vehicle, and the clarity of the suspicious object in the image captured by the panoramic camera device of the first preset vehicle is less than a preset value.

According to some embodiments of the present application, after the vehicle network server notifies the second preset vehicle to turn on the preset exterior lights, the method further includes: the vehicle network server controls the panoramic camera devices of all preset vehicles in the monitoring area to track the suspicious object until the suspicious object leaves the monitoring area; during the tracking, the vehicle network server predicts that the suspicious object including the first preset vehicle in the image captured by the panoramic camera device is the fourth preset vehicle; the fourth preset vehicle is the first preset vehicle in the monitoring area. Vehicle; the vehicle network server predicts the position of the suspicious object of the first preset vehicle in the image collected by the panoramic camera device of the fourth preset vehicle; the vehicle network server determines the fifth preset vehicle according to the predicted position of the suspicious object of the first preset vehicle in the image collected by the panoramic camera device of the fourth preset vehicle; the fifth preset vehicle is the preset vehicle in the monitoring area; the illuminated area illuminated by the preset exterior lights of the fifth preset vehicle includes the suspicious object of the first preset vehicle.

In a second aspect, an embodiment of the present application provides a monitoring device for use in a vehicle network server, the device comprising: an acquisition module, the acquisition module being used to acquire images captured by a panoramic camera of a preset vehicle from all preset vehicles in a monitoring area; each preset vehicle has a sentry mode turned on, each preset vehicle comprises a panoramic camera, the panoramic camera is used to capture images of the environment around the preset vehicle; each preset vehicle comprises preset exterior lights; a determination module, the determination module being used to determine if the acquired image exists in the image captured by the panoramic camera of the first preset vehicle. A suspicious object of a preset vehicle, and the clarity of the suspicious object in the image captured by the panoramic camera device of the first preset vehicle is less than a preset value, then a second preset vehicle is determined according to the image of the suspicious object captured by the panoramic camera device of the first preset vehicle; the first preset vehicle is a preset vehicle in the monitoring area; the second preset vehicle is a preset vehicle in the monitoring area; the second preset vehicle is different from the first preset vehicle; the illuminated area illuminated by the preset exterior lights of the second preset vehicle includes the suspicious object; a notification module, the notification module is used to notify the second preset vehicle to turn on the preset exterior lights.

In the third aspect, an embodiment of the present application provides a vehicle network server, the vehicle network server includes a processor and a memory, the memory is used to store program instructions, and when the processor calls the program instruction, the monitoring method of any possible embodiment of the first aspect above is implemented.

In the fourth aspect, an embodiment of the present application provides a computer-readable storage medium, the computer-readable storage medium stores a program, and the program enables the vehicle network server to execute the monitoring method of any possible embodiment of the first aspect above.

This application obtains images captured by the panoramic camera of the preset vehicle from all preset vehicles in the monitoring area with the sentry mode turned on by the vehicle network server, and when there is a suspicious object of the first preset vehicle in the image captured by the panoramic camera of the first preset vehicle in the image obtained by the vehicle network server, and the clarity of the suspicious object in the image captured by the panoramic camera of the first preset vehicle is less than a preset value, the second preset vehicle is determined according to the image of the suspicious object captured by the panoramic camera of the first preset vehicle, and the second preset vehicle is notified to turn on the preset exterior lights, wherein the illuminated area illuminated by the preset exterior lights of the second preset vehicle includes the suspicious object. Therefore, the preset exterior lights of other preset vehicles can illuminate the suspicious object of the first preset vehicle, so that the suspicious object in the subsequent video recorded by the first preset vehicle is clear, thereby avoiding the loss of property of the first preset vehicle.

11: Internet of Vehicles Server

12: Default vehicle

121: First default vehicle

122: Second default vehicle

20: Internet of Vehicles Server

21: Memory

22: Processor

23: Display screen

24: Communication interface

S301~S303: Steps

601: First default vehicle

602: Suspicious object

S701~S702: Steps

S801~S802: Steps

A1: Suspicious objects

B1: First default vehicle

C1: Default vehicle

b1: Area

c1: area

c11: Area

A2: Suspicious objects

B2: First default vehicle

C2: Default vehicle

D2: Default vehicle

b2: Area

c2: area

d2: Area

c22: Area

d22: Area

A3: Suspicious objects

B3: First default vehicle

C3: Default vehicle

D3: Default vehicle

b3: Area

c3: area

d3: Area

c33: Area

d33: Area

S1001~S1004: Steps

S1101~S1104: Steps

120: Monitoring device

1201: Get module

1202: Confirm module

1203: Notification module

Figure 1 is a schematic diagram of the application scenario of the vehicle networking server of the present application embodiment.

Figure 2 is a schematic diagram of the hardware structure of the vehicle networking server of the embodiment of this application.

Figure 3 is a flow chart of the monitoring method of the present application embodiment.

Figure 4 is a schematic diagram of the default vehicle with sentry mode turned on.

Figure 5 is a schematic diagram of a panoramic camera device for a preset vehicle in an embodiment of the present application.

Figure 6 is a schematic diagram of a suspicious object in the embodiment of this application.

FIG. 7 is a flowchart of an embodiment of the present application for determining that a suspicious object of a first preset vehicle exists in an image captured by a panoramic camera device of a first preset vehicle and that the clarity of the image including the suspicious object is less than a preset value.

Figure 8 is a flowchart for determining the second preset vehicle in the embodiment of this application.

FIG. 9A is a schematic diagram of determining a second preset vehicle in one embodiment of the present application; FIG. 9B is a schematic diagram of determining another second preset vehicle in another embodiment of the present application; FIG. 9C is a schematic diagram of determining another second preset vehicle in another embodiment of the present application.

Figure 10 is a flowchart of another preset vehicle providing video recording via the vehicle networking server in the embodiment of this application.

Figure 11 is a flow chart of tracking and monitoring of a suspicious object when it moves in the embodiment of this application.

Figure 12 is a schematic diagram of a monitoring device according to an embodiment of the present application.

In the description of the embodiments of this application, words such as "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "for example" in the embodiments of this application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Rather, the use of words such as "for example" is intended to present the relevant concepts in a concrete way.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by technicians in the technical field of this application. The terms used in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application. It should be understood that in this application, unless otherwise specified, "plurality" means two or more than two.

Please refer to Figure 1, which is a schematic diagram of the application scenario of the vehicle network server of the embodiment of this application. The vehicle network server 11 can be a vehicle network platform for managing the preset vehicle 12. The specific deployment form of the vehicle network server 11 can be cloud deployment or a locally deployed computer device, etc., and this application does not limit this. The vehicle network server 11 can be a server or a server cluster, and this application does not limit this.

The vehicle network server 11 can communicate with one or more preset vehicles 12. The vehicle network server 11 communicates with the base station (eNodeB) or the road side unit (RSU) through the evolved packet core (EPC), and the base station or the road side unit communicates with the preset vehicle 12 through the vehicle to vehicle (V2V) or cellular network communication (Uu) interface. Among them, V2V can include: the fifth interface of the near neighbor communication (prose communication 5, PC5) and the dedicated short range communication (Dedicated Short Range Communications, DSRC). The Uu interface refers to the interface between the preset vehicle 12 and the universal terrestrial radio access network (UMTS Terrestrial Radio Access Network, UTRAN), which is the air interface of the universal mobile telecommunications system (Universal Mobile Telecommunications System, UMTS).

The default vehicle 12 may be a vehicle with sentry mode turned on. In some embodiments, the default vehicle 12 may turn on sentry mode when the vehicle is turned off and parked. The default vehicle 12 includes a panoramic camera. The panoramic camera is used to capture images of the environment around the default vehicle 12. In some embodiments, the panoramic camera can capture 360-degree images of the environment around the default vehicle 12. After the sentry mode is turned on, the default vehicle 12 can start to capture images of the environment around the default vehicle 12 through the panoramic camera. The default vehicle 12 can also start recording video through the panoramic camera when a suspicious object is detected to have invaded the default vehicle 12. The preset vehicle 12 may include preset exterior lights. The preset exterior lights may be headlights, etc., and this application does not impose any restrictions on this.

In some embodiments, after being turned on, the vehicle networking server 11 may obtain images captured by the panoramic camera of the preset vehicle 12 from the plurality of preset vehicles 12. When a suspicious object of the first preset vehicle 121 exists in the image captured by the panoramic camera of the first preset vehicle 121 in the acquired image, and the clarity of the image including the suspicious object is less than a preset value, the vehicle networking server 11 determines the second preset vehicle 122 based on the image captured by the panoramic camera of the first preset vehicle 121 containing the suspicious object. That is, the vehicle network server 11 determines the second preset vehicle 122 only when it is detected that a suspicious object has invaded the first preset vehicle 121 and the image of the suspicious object collected by the first preset vehicle 121 is not clear enough. The second preset vehicle 122 is different from the first preset vehicle 121, and the illuminated area illuminated by the preset exterior lights of the second preset vehicle 122 includes the suspicious object of the first preset vehicle 121. The vehicle network server can notify the second preset vehicle 122 to turn on the preset exterior lights. The second preset vehicle 122 can turn on the preset exterior lights according to the notification. Therefore, when the first preset vehicle 121 records the video, the suspicious object will be illuminated, so that the suspicious object in the video recorded by the first preset vehicle 121 is clear.

It is understood that the positional relationship between the preset vehicles in Figure 1 is only for illustration, and the actual positional relationship between the preset vehicles may be other positional relationships; Figure 1 only shows two preset vehicles, but the actual number of preset vehicles may be greater than two, and this application does not impose any restrictions on this.

It is understandable that the default vehicle can be represented by another terminal or device associated or coupled thereto, for example, the default vehicle can be represented by a vehicle-mounted terminal such as a mobile phone installed in the vehicle, or a vehicle-mounted unit, a vehicle computer, or other devices integrated in the vehicle.

Please refer to Figure 2, which is a schematic diagram of the hardware structure of the vehicle network server of the embodiment of this application. The vehicle network server can be a single physical device, or it can include multiple devices, such as multiple physically different computers that can be connected to each other through a data network.

The vehicle network server includes a memory 21, a processor 22, a display 23 and a communication interface 24. A person skilled in the art can understand that the structure shown in FIG. 2 does not constitute a limitation on the vehicle network server 20. The vehicle network server 20 may include more or fewer components than shown, or combine some components, or split some components, or arrange the components differently.

The memory 21 can be used to store software programs and/or modules/units. The processor 22 implements various functions of the vehicle network server 20 by running or executing the software programs and/or modules/units stored in the memory 21 and calling the data stored in the memory 21. The memory 21 can mainly include a program storage area and a data storage area, wherein the program storage area can store the operating system, at least one application required for a function (such as an image playback function, etc.), etc.; the data storage area can store data created according to the use of the vehicle network server 20 (such as a second vehicle, etc.), etc. In addition, the memory 21 may include non-volatile computer-readable memory, such as a hard disk, memory, etc. It is understandable that the memory 21 may also include other non-volatile computer-readable memory, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash memory card (Flash Card), at least one disk memory device, a flash memory device, or other non-volatile solid-state memory devices.

The processor 22 can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The processor 22 can be a microprocessor or any conventional processor, etc. The processor 22 is the control center of the Internet of Vehicles server 20, and uses various interfaces and lines to connect various parts of the entire Internet of Vehicles server 20.

The display 23 can be used to display data, etc. The display 23 includes a display panel. The display panel can be a liquid crystal display, an organic light-emitting display, a flexible display, a plasma display, etc. It is understood that the display 23 can be a display of a physical device in the car networking server 20, such as a display of a computer in the car networking server 20, and this application does not limit this. It is understood that the display 23 can also be used to receive user input, and the display 23 can also include a touch panel, and this application does not limit this.

The communication interface 24 may include a Uu interface, a PC5 interface, etc. The communication interface 24 is used for the vehicle network server 20 to communicate with the preset vehicle.

Please refer to Figure 3, which is a flow chart of the monitoring method of the embodiment of the present application. The monitoring method is applied to the vehicle network server shown in Figure 2. The monitoring method includes:

Step S301: The vehicle network server obtains images captured by the panoramic camera device of the preset vehicle from all preset vehicles in the monitoring area.

In some embodiments, each default vehicle may have sentry mode turned on. In some embodiments, the default vehicle may turn on sentry mode when the engine is turned off and the vehicle is parked. After the default vehicle turns on sentry mode, the default vehicle displays a red sentry mode icon. In FIG4 , the default vehicle displays the sentry mode icon via the vehicle-mounted unit of the default vehicle. The sentry mode icon may be red. It is understood that FIG4 is an example of the default vehicle displaying the sentry mode icon. The default vehicle may also display the sentry mode icon via a mobile phone terminal installed on the default vehicle, and the present application does not limit this.

，攝像裝置

，攝像裝置

，攝像裝置

，攝像裝置

，攝像裝置

，攝像裝置

，攝像裝置

。其中攝像裝置

，攝像裝置

，及攝像裝置

安裝於預設車輛的前方，攝像裝置

及攝像裝置

安裝於預設車輛的左方，攝像裝置

及攝像裝置

安裝於預設車輛的右方，攝像裝置

安裝於預設車輛的後方。攝像裝置

，攝像裝置

，及攝像裝置

分別為廣角鏡頭、窄角鏡頭及主鏡頭。攝像裝置

及攝像裝置

分別位於預設車輛的左側後視鏡和預設車輛的左側B柱上。攝像裝置

及攝像裝置

分別位於預設車輛的右側後視鏡和預設車輛的右側B柱上。可理解，圖5是全景攝像裝置的一種示例，全景攝像裝置的數量和安裝位置可分別為其他數量和安裝位置，本申請對此不作限制。 In some embodiments, each preset vehicle may include a panoramic camera device. The panoramic camera device may have a field of view of up to 360 degrees. The panoramic camera device includes a plurality of camera devices. The plurality of camera devices are respectively installed on the front, rear, left and right sides of the preset vehicle. As shown in FIG5 , the number of the plurality of camera devices is 8, which are respectively camera devices:

, Camera

, Camera

, Camera

, Camera

, Camera

, Camera

, Camera

. The camera device

, Camera

, and camera equipment

Installed in front of the preset vehicle, the camera

and camera equipment

Installed on the left side of the default vehicle, the camera

and camera equipment

Installed on the right side of the default vehicle, the camera

Installed on the rear of the intended vehicle.

, Camera

, and camera equipment

They are wide-angle lens, narrow-angle lens and main lens.

and camera equipment

They are located on the left side rearview mirror of the default vehicle and on the left side B-pillar of the default vehicle.

and camera equipment

They are located on the right side rearview mirror of the preset vehicle and the right side B-pillar of the preset vehicle respectively. It can be understood that FIG5 is an example of a panoramic camera device, and the number and installation position of the panoramic camera device can be other numbers and installation positions respectively, and this application does not limit this.

In some embodiments, after each default vehicle turns on the sentry mode, it can automatically collect images of the default vehicle's surrounding environment through its own panoramic camera. Then, all default vehicles in the monitoring area can automatically collect images of their surrounding environment through their respective panoramic cameras, and the car networking server can automatically obtain images collected by the panoramic cameras of the default vehicles from all default vehicles in the monitoring area.

In some embodiments, each preset vehicle may include preset exterior lights. The preset exterior lights may be headlights. The headlights are front lights of the preset vehicle. The preset exterior lights are used to provide light sources. It is understood that the preset exterior lights may also be other exterior lights, and this application does not limit this.

In some embodiments, before the vehicle network server obtains images captured by the panoramic camera device of the preset vehicle from all preset vehicles in the monitoring area, the monitoring method further includes: the vehicle network server obtains the monitoring area.

In some embodiments, the vehicle network server obtaining the monitoring area may include: the vehicle network server determines that the monitoring area is the intersection of the image acquisition ranges of the panoramic camera devices of all preset vehicles. In some embodiments, the vehicle network server obtaining the monitoring area may include: the vehicle network server may also determine that the distance between adjacent preset vehicles in all preset vehicles is less than a preset value, and determine that the monitoring area is the intersection of the image acquisition ranges of the panoramic camera devices in the plurality of preset vehicles. Therefore, the vehicle network server may automatically combine the vehicles with sentry mode turned on to form a new monitoring area. It is understandable that the monitoring area can also be a preset parking lot or other area for vehicles to park. The monitoring area can include not only preset vehicles but also non-preset vehicles, etc. This application does not limit this.

Step S302: If the image acquired by the vehicle network server contains a suspicious object of the first preset vehicle in the image captured by the panoramic camera device of the first preset vehicle, and the clarity of the suspicious object in the image captured by the panoramic camera device of the first preset vehicle is less than a preset value, the vehicle network server determines the second preset vehicle based on the image of the suspicious object captured by the panoramic camera device of the first preset vehicle.

In some embodiments, the suspicious object of the first preset vehicle is a person, object or thing that threatens the first preset vehicle, and these people, objects or things may cause the loss of the property of the first preset vehicle. As shown in FIG6, the suspicious object 602 of the first preset vehicle 601 is a person who touches the first preset vehicle. It can be understood that FIG6 is an example of a suspicious object of the first preset vehicle. The suspicious object of the first preset vehicle may also be a person who scratches or collides with the first preset vehicle, or a person who damages the window of the first preset vehicle, etc. This application does not limit the content and form of the first preset vehicle and the suspicious object.

In some embodiments, as shown in FIG. 7 , the image acquired by the vehicle network server contains a suspicious object of the first preset vehicle in the image captured by the panoramic camera device of the first preset vehicle, and the clarity of the suspicious object in the image captured by the panoramic camera device of the first preset vehicle is less than a preset value including:

S701: If the image obtained contains a suspicious object of the first preset vehicle in the image collected by the panoramic camera of the first preset vehicle, the vehicle network server obtains the current image collected by the panoramic camera of the first preset vehicle; the current image includes the suspicious object of the first preset vehicle; when obtaining the current image, the default exterior lights of the first preset vehicle are turned on.

In some embodiments, when each preset vehicle detects that there is a suspicious object in the image captured by its own panoramic camera device, it can automatically turn on the preset exterior lights and continue to monitor the surrounding environment through its own panoramic camera device. At this time, the preset exterior lights of the preset vehicle can illuminate the preset area in front of the preset vehicle, so that the preset area in front of the preset vehicle is clear in the image, but the preset area to the left, right or rear of the preset vehicle is unclear in the image. Then, when the car networking server obtains the current image captured by the panoramic camera device of the first preset vehicle again, the preset exterior lights of the first preset vehicle are in the turned-on state.

S702: If the clarity of the suspicious object in the current image is less than the preset value, the vehicle network server determines that the acquired image contains a suspicious object of the first preset vehicle in the image captured by the panoramic camera device of the first preset vehicle, and the clarity of the suspicious object in the image captured by the panoramic camera device of the first preset vehicle is less than the preset value.

In some embodiments, when the preset exterior lights of the first preset vehicle are turned on, if the suspicious object is located in front of the first preset vehicle, the clarity of the suspicious object in the current image is greater than the preset value; if the suspicious object is located to the left, right or rear of the first preset vehicle, the clarity of the suspicious object in the current image is less than the preset value.

In some embodiments, as shown in FIG8 , the vehicle network server determines the second preset vehicle based on the image of the suspicious object captured by the panoramic camera device of the first preset vehicle, including:

S801: The vehicle network server detects the location information of the suspicious object based on the image of the suspicious object collected by the panoramic camera device of the first preset vehicle.

In some embodiments, the location information of the suspicious object detected by the vehicle network server may be obtained from the first preset vehicle. In some embodiments, the first preset vehicle may determine the spatial coordinates of the suspicious object. The first preset vehicle may determine the spatial coordinates of the suspicious object in the camera coordinate system based on the image of the suspicious object captured by the panoramic camera device of the first preset vehicle, and determine the spatial coordinates of the suspicious object in the world coordinate system based on the spatial coordinates of the suspicious object in the camera coordinate system. It is understandable that the first preset vehicle may determine the spatial coordinates of the suspicious object in other ways, such as the first preset vehicle directly determining the spatial coordinates of the suspicious object in the world coordinate system, etc., and this application does not limit this.

In some embodiments, the vehicle network server obtains the location information of the suspicious object by calculating the location information of the suspicious object. Specifically, the vehicle network server can determine the spatial coordinates of the suspicious object in the world coordinate system by using the image of the suspicious object collected by the panoramic camera device of the first preset vehicle. The vehicle network server determines the spatial coordinates of the suspicious object in the world coordinate system by using the image of the suspicious object collected by the panoramic camera device of the first preset vehicle. For example, the spatial coordinates of the suspicious object in the camera coordinate system are first determined according to the image, and the spatial coordinates of the suspicious object in the world coordinate system are determined according to the spatial coordinates of the suspicious object in the camera coordinate system. It is understandable that the vehicle network server can also determine the spatial coordinates of the suspicious object in other ways, and this application does not limit this.

It is understandable that the location information of the suspicious object can also be the relative position relationship between the suspicious object and the first preset vehicle, such as being 3 decimeters to the left of the first preset vehicle, etc. This application does not impose any restrictions on this.

S802: The vehicle network server determines that the second default vehicle is one or more default vehicles whose illuminated area illuminated by the default exterior lights includes the location information of the suspicious object.

In some embodiments, the vehicle network server determines that the second default vehicle is one or more default vehicles whose illuminated area illuminated by the default exterior lights includes the location information of the suspicious object, including: the vehicle network server can determine the illuminated area illuminated by the default exterior lights of all default vehicles in the monitoring area; determine the target illuminated area in the illuminated area that includes the location information of the suspicious object; determine that the second default vehicle is one or more default vehicles corresponding to the target illuminated area.

In some embodiments, as shown in Fig. 9A, the second preset vehicle may be a preset vehicle directly behind the first preset vehicle. In Fig. 9A, the monitoring area includes two preset vehicles, the two preset vehicles at least include the first preset vehicle B1, and another preset vehicle C1 is located directly behind the first preset vehicle B1. In FIG. 9A , the suspicious object A1 of the first preset vehicle B1 is located directly behind the first preset vehicle B1 in the monitoring area, the acquisition range of the panoramic camera device of the first preset vehicle B1 is area b1, the illuminated area of the preset exterior lights of the preset vehicle C1 in the monitoring area is area c1, and the acquisition range of the panoramic camera device of the preset vehicle C1 is area c11. Among them, area b1 and area c11 are roughly circular and are represented by gray dots; area c1 is roughly sector-shaped and is represented by white. As can be seen from FIG9A, the illuminated area c1 illuminated by the preset exterior lights of the preset vehicle C1 includes the suspicious object A1, and the second preset vehicle is the preset vehicle C1, and the second preset vehicle can provide sufficient lighting conditions for the suspicious object A1, so that the first preset vehicle B1 can clearly capture the image or video of the suspicious object A1. It can be understood that in FIG9A, if there is a suspicious object to the left or right of the first preset vehicle B1, the preset vehicle C1 may also provide sufficient lighting conditions for the suspicious object of the first preset vehicle B1 to the left or right of the first preset vehicle B1, and this application does not limit this.

In some embodiments, as shown in Figure 9B, the second preset vehicle may be two preset vehicles behind the first preset vehicle. In Figure 9B, the monitoring area includes three preset vehicles, the three preset vehicles include at least the first preset vehicle B2, and the other two preset vehicles C2 and D2 are located behind the left side and the right side of the first preset vehicle B2 respectively. In FIG9B , the suspicious object A2 of the first preset vehicle B2 is located directly behind the first preset vehicle B2 in the monitoring area, the acquisition range of the panoramic camera of the first preset vehicle B2 is area b2, the illuminated area illuminated by the preset exterior lights of the preset vehicle C2 is area c2, the acquisition range of the panoramic camera of the preset vehicle C2 is area c22, the illuminated area illuminated by the preset exterior lights of the preset vehicle D2 is area d2, and the acquisition range of the panoramic camera of the preset vehicle D2 is area d22. Among them, area b2, area c22 and area d22 are roughly circular and are represented by gray dots; area c2 and area d2 are roughly sector-shaped and are represented by white. As can be seen from FIG9B, the intersection of the illuminated area c2 illuminated by the preset exterior lights of the preset vehicle C2 and the illuminated area d2 illuminated by the preset exterior lights of the preset vehicle D2 includes the suspicious object A2, then the second preset vehicle is the preset vehicle C2 and the preset vehicle D2, and the second preset vehicle can provide sufficient lighting conditions for the suspicious object A2, so that the first preset vehicle B2 can clearly capture the image or video of the suspicious object A2. It can be understood that in FIG9B, if there is a suspicious object to the left or right of the first preset vehicle B2, the preset vehicle C2 and the preset vehicle D2 may also provide sufficient lighting conditions for the suspicious object of the first preset vehicle B2 to the left or right of the first preset vehicle B2, and this application does not limit this.

In some embodiments, as shown in Figure 9C, the second preset vehicle may be two preset vehicles in front of and to the left of the first preset vehicle. In Figure 9C, the monitoring area includes three preset vehicles, the three preset vehicles at least include the first preset vehicle B3, and the other two preset vehicles C3 and D3 are located in front of and to the left of the first preset vehicle B3, respectively. In FIG9C , the suspicious object A3 is located to the left of the first preset vehicle B3 in the monitoring area, the acquisition range of the panoramic camera of the first preset vehicle B3 is area b3, the illuminated area illuminated by the preset exterior lights of the preset vehicle C3 is area c3, the acquisition range of the panoramic camera of the preset vehicle C3 is area c33, the illuminated area illuminated by the preset exterior lights of the preset vehicle D3 is area d3, and the acquisition range of the panoramic camera of the preset vehicle D3 is area d33. Among them, area b3, area c33 and area d33 are roughly circular and are represented by gray dots; area c3 and area d3 are roughly sector-shaped and are represented by white. As can be seen from FIG9C, the intersection of the illuminated area c3 illuminated by the preset exterior lights of the preset vehicle C3 and the illuminated area d3 illuminated by the preset exterior lights of the preset vehicle D3 includes the suspicious object A3, then the second preset vehicle is the preset vehicle C3 and the preset vehicle D3, and the second preset vehicle can provide sufficient lighting conditions for the suspicious object A3, so that the first preset vehicle B3 can clearly capture the image or video of the suspicious object A3. It can be understood that in FIG9C, if there is a suspicious object to the left or right of the first preset vehicle B3, the preset vehicle C3 and the preset vehicle D3 may also provide sufficient lighting conditions for the suspicious object of the first preset vehicle B3 to the right, front or rear of the first preset vehicle B3, and this application does not limit this.

As shown in FIG. 9C , the second preset vehicle can be located at different positions of the first preset vehicle, and the different positions include at least two of the front, left, right and rear.

It is understandable that the method for the vehicle network server to determine the second preset vehicle may also be other methods, such as omitting the location information of the suspicious object and directly considering that the suspicious object is close to the edge area of the first preset vehicle. Then, the edge area of the first preset vehicle corresponding to the suspicious object may be determined based on the image of the suspicious object captured by the panoramic camera device of the first preset vehicle, and the second preset vehicle may be determined to be one or more preset vehicles whose illuminated area illuminated by the preset exterior lights includes the edge area of the first preset vehicle. This application does not limit this.

Step S303: The vehicle network server notifies the second default vehicle to turn on the default exterior lights.

In some embodiments, the vehicle networking server may notify the vehicle terminal installed in the second preset vehicle, or the vehicle unit, vehicle computer, etc. integrated in the second preset vehicle to turn on the preset exterior lights.

In some embodiments, after the vehicle network server notifies the second preset vehicle to turn on the preset exterior lights, the second preset vehicle can turn on the preset exterior lights, so that the second preset vehicle can illuminate the suspicious object of the first preset vehicle.

In some embodiments, when each preset vehicle detects that there is a suspicious object of itself in the image captured by its panoramic camera device, it can automatically turn on the preset exterior lights and continue to monitor the surrounding environment through its own panoramic camera device, such as recording the surrounding environment. Each preset vehicle can also store the video and send the video or notification to the owner's terminal, so that the owner of the preset vehicle can know the existence of the suspicious object of the preset vehicle and can even clearly view the suspicious object. In some embodiments, as shown in FIG. 10, in order to more clearly view the suspicious object, after the car network server notifies the second preset vehicle to turn on the preset exterior lights, the monitoring method also includes:

S1001: The vehicle network server determines that a third preset vehicle other than the first preset vehicle exists in the acquired image and is a suspicious object of the first preset vehicle; the third preset vehicle is a preset vehicle in the monitoring area.

S1002: The vehicle network server notifies the third preset vehicle to record video using the panoramic camera device.

S1003: The vehicle network server obtains the video from the third preset vehicle.

S1004: The car networking server sends the video to the owner's terminal corresponding to the first preset vehicle.

Therefore, the car networking server can provide the owner of the first preset vehicle with videos of suspicious objects from other perspectives through other preset vehicles that are not the first preset vehicle, so that the owner of the first preset vehicle can view the suspicious object more clearly.

It is understood that the third preset vehicle may be the same as the second preset vehicle, that is, when the vehicle network server determines the second preset vehicle, it determines that the second preset vehicle is one or more preset vehicles that meet the first preset condition and the second preset condition. The first preset condition includes that the illuminated area illuminated by the preset exterior lights includes the location information of the suspicious object, and the second preset condition includes that the image captured by the panoramic camera device includes the suspicious object of the first preset vehicle. This application does not limit this.

In some embodiments, when the suspicious object of the first preset vehicle moves, the vehicle networking server may also automatically switch to instruct other preset vehicles to continue to provide light sources for the suspicious object. Specifically, as shown in FIG11 , after the vehicle networking server notifies the second preset vehicle to turn on the preset exterior lights, the monitoring method further includes:

S1101: The vehicle network server controls the panoramic camera devices of all preset vehicles in the monitoring area to track the suspicious object until the suspicious object leaves the monitoring area.

In some embodiments, the suspicious object leaving the monitoring area can be detected by the absence of the suspicious object in the images and videos captured by the panoramic camera device of any preset vehicle in the monitoring area.

S1102: During tracking, the vehicle network server predicts that the suspicious object including the first preset vehicle in the image captured by the panoramic camera device is the fourth preset vehicle; the fourth preset vehicle is the preset vehicle in the monitoring area.

S1103: The vehicle network server predicts the position of the suspicious object of the first preset vehicle in the image captured by the panoramic camera device of the fourth preset vehicle.

S1104: The vehicle network server determines the fifth preset vehicle according to the predicted position of the suspicious object of the first preset vehicle in the image captured by the panoramic camera of the fourth preset vehicle; the fifth preset vehicle is the preset vehicle in the monitoring area; the illuminated area illuminated by the preset exterior lights of the fifth preset vehicle includes the suspicious object of the first preset vehicle.

In some embodiments, the process of the vehicle network server determining the fifth preset vehicle based on the predicted position of the suspicious object of the first preset vehicle in the image captured by the panoramic camera device of the fourth preset vehicle is similar to the process of the vehicle network server determining the second preset vehicle based on the image of the suspicious object captured by the panoramic camera device of the first preset vehicle, and will not be repeated here.

Therefore, the vehicle networking server can track the suspicious object of the first preset vehicle in real time and provide light source for the suspicious object of the first preset vehicle.

In some embodiments, the vehicle network server also notifies the fourth preset vehicle to record a video through a panoramic camera device, obtains the video from the fourth preset vehicle, and sends the video to the owner's terminal corresponding to the first preset vehicle. Therefore, the vehicle network server can also provide the owner of the first preset vehicle with the moving path of the suspicious object of the first preset vehicle, and facilitate the owner of the first preset vehicle to view the details.

Please refer to FIG. 12, which is a schematic diagram of a monitoring device of an embodiment of the present application. The monitoring device 120 includes an acquisition module 1201, a determination module 1202, and a notification module 1203. The acquisition module 1201 is used to acquire images collected by a panoramic camera of a preset vehicle from all preset vehicles in the monitoring area; each preset vehicle turns on the sentry mode, each preset vehicle includes a panoramic camera, and the panoramic camera is used to collect images of the environment around the preset vehicle; each preset vehicle includes a preset exterior light. The determination module 1202 is used to determine the second preset vehicle according to the image with suspicious objects collected by the panoramic camera device of the first preset vehicle if the acquired image contains a suspicious object of the first preset vehicle in the image collected by the panoramic camera device of the first preset vehicle, and the clarity of the suspicious object in the image collected by the panoramic camera device of the first preset vehicle is less than a preset value; the first preset vehicle is a preset vehicle in the monitoring area; the second preset vehicle is a preset vehicle in the monitoring area; the second preset vehicle is different from the first preset vehicle; the illuminated area illuminated by the preset exterior lights of the second preset vehicle includes suspicious objects. The notification module 1203 is used to notify the second preset vehicle to turn on the preset exterior lights.

It is understandable that the monitoring device can also be transformed into other embodiments. Please refer to the monitoring method shown in Figure 3 for details. This application will not elaborate on this.

In addition to the above methods and devices, the present application embodiment also provides a computer-readable storage medium, which stores a program that enables the automatic optical detection equipment to execute the monitoring method shown in Figure 3.

A computer program product, the computer program product includes computer execution instructions, the computer execution instructions are stored in a computer-readable storage medium; at least one processor of an automatic optical detection device can read the computer execution instructions from the computer-readable storage medium, and at least one processor executes the computer execution instructions so that the automatic optical detection device implements the monitoring method shown in Figure 3.

This application obtains images captured by the panoramic camera of the preset vehicle from all preset vehicles in the monitoring area with the sentry mode turned on by the vehicle network server, and when there is a suspicious object of the first preset vehicle in the image captured by the panoramic camera of the first preset vehicle in the image obtained by the vehicle network server, and the clarity of the suspicious object in the image captured by the panoramic camera of the first preset vehicle is less than a preset value, the second preset vehicle is determined according to the image of the suspicious object captured by the panoramic camera of the first preset vehicle, and the second preset vehicle is notified to turn on the preset exterior lights, wherein the illuminated area illuminated by the preset exterior lights of the second preset vehicle includes the suspicious object. Therefore, the preset exterior lights of other preset vehicles can illuminate the suspicious object of the first preset vehicle, so that the suspicious object in the subsequent video recorded by the first preset vehicle is clear, thereby avoiding the loss of property of the first preset vehicle.

In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed.

In addition, each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

Through the above description of the implementation, the technical personnel in the relevant field can clearly understand that the present application can be implemented by means of software plus necessary general hardware, and of course can also be implemented by dedicated hardware including dedicated integrated circuits, dedicated CPUs, dedicated memories, dedicated components, etc. In general, all functions completed by computer programs can be easily implemented by corresponding hardware, and the specific hardware structures used to implement the same function can also be diverse, such as analog circuits, digital circuits or dedicated circuits, etc. However, for the present application, software program implementation is a better implementation in most cases. Based on this understanding, the technical solution of this application, or the part that contributes to the existing technology, can be embodied in the form of a software product. The computer software product is stored in a readable storage medium, such as a computer floppy disk, USB flash drive, mobile hard disk, ROM, RAM, magnetic disk or optical disk, etc., and includes several instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods described in each embodiment of this application.

In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.

The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that can be stored by a computer or a data storage device such as a server or data center that includes one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of this application and are not limiting. Although this application is described in detail with reference to the preferred embodiments, ordinary technicians in this field should understand that the technical solution of this application can be modified or replaced by equivalents without departing from the spirit and scope of the technical solution of this application.

S301~S303: Steps

Claims (9)

A monitoring method, the improvement of which is that the method comprises: a vehicle network server obtains images collected by a panoramic camera device of all preset vehicles in a monitoring area; each of the preset vehicles turns on a sentry mode, and each of the preset vehicles includes the panoramic camera device, which is used to collect images of the environment around the preset vehicle; each of the preset vehicles The vehicle includes preset exterior lights; if the image acquired by the vehicle network server contains a suspicious object of the first preset vehicle in the image captured by the panoramic camera device of the first preset vehicle, and the clarity of the suspicious object in the image captured by the panoramic camera device of the first preset vehicle is less than a preset value, the vehicle network server generates a signal according to the panoramic camera device of the first preset vehicle. The second preset vehicle is determined from the image captured by the panoramic camera device containing the suspicious object; the first preset vehicle is the preset vehicle in the monitoring area; the second preset vehicle is different from the first preset vehicle; the illuminated area illuminated by the preset exterior lights of the second preset vehicle includes the suspicious object; the vehicle network server notifies the second preset vehicle to turn on the preset exterior lights; before the vehicle network server obtains the image captured by the panoramic camera device of the preset vehicle from all the preset vehicles in the monitoring area, the method further includes: the vehicle network server determines the monitoring area as the intersection of the image acquisition ranges of the panoramic camera devices of all the preset vehicles. The method as described in claim 1, wherein the vehicle network server determines the second default vehicle includes: the vehicle network server detects the location information of the suspicious object; the vehicle network server determines that the second default vehicle is one or more of the default vehicles whose illuminated area illuminated by the default exterior lights includes the location information of the suspicious object. The method as described in claim 2, wherein: the second preset vehicle is located at a different position of the first preset vehicle, and the different positions include at least two of the front, left, right and rear. The method as described in claim 1, wherein after the vehicle network server notifies the second preset vehicle to turn on the preset exterior lights, the method further includes: the vehicle network server determines that a third preset vehicle other than the first preset vehicle exists in the acquired image and is a suspicious object of the first preset vehicle; the third preset vehicle is the preset vehicle in the monitoring area; the vehicle network server notifies the third preset vehicle to record a video through the panoramic camera device; the vehicle network server obtains the video from the third preset vehicle; the vehicle network server sends the video to the owner terminal corresponding to the first preset vehicle. The method as described in claim 1, wherein the image acquired by the vehicle network server contains a suspicious object of the first preset vehicle in the image captured by the panoramic camera of the first preset vehicle, and the clarity of the suspicious object in the image captured by the panoramic camera of the first preset vehicle is less than a preset value, comprising: if the image acquired contains a suspicious object of the first preset vehicle in the image captured by the panoramic camera of the first preset vehicle, then the vehicle network server acquires the image captured by the panoramic camera of the first preset vehicle. The current image includes a suspicious object of the first preset vehicle; when the current image is obtained, the preset exterior lights of the first preset vehicle are turned on; if the clarity of the suspicious object in the current image is less than a preset value, the vehicle network server determines that the obtained image contains a suspicious object of the first preset vehicle in the image captured by the panoramic camera device of the first preset vehicle, and the clarity of the suspicious object in the image captured by the panoramic camera device of the first preset vehicle is less than a preset value. The method as described in claim 1, wherein after the vehicle network server notifies the second preset vehicle to turn on the preset exterior lights, the method further comprises: the vehicle network server controls the panoramic camera devices of all the preset vehicles in the monitoring area to track the suspicious object until the suspicious object leaves the monitoring area; during the tracking, the vehicle network server predicts that the suspicious object including the first preset vehicle in the image collected by the panoramic camera device is a fourth preset vehicle; the fourth preset vehicle is the first preset vehicle in the monitoring area The vehicle network server predicts the position of the suspicious object of the first preset vehicle in the image collected by the panoramic camera device of the fourth preset vehicle; the vehicle network server determines the fifth preset vehicle according to the predicted position of the suspicious object of the first preset vehicle in the image collected by the panoramic camera device of the fourth preset vehicle; the fifth preset vehicle is the preset vehicle in the monitoring area; the illuminated area illuminated by the preset exterior lights of the fifth preset vehicle includes the suspicious object of the first preset vehicle. A monitoring device is applied to a vehicle network server, wherein the device comprises: an acquisition module, wherein the acquisition module is used to acquire images collected by a panoramic camera device of all preset vehicles in a monitoring area; each of the preset vehicles turns on a sentinel mode, and each of the preset vehicles includes the panoramic camera device, wherein the panoramic camera device is used to collect images of the preset vehicle; each of the preset vehicles includes preset exterior lights; a determination module, the determination module being used to determine whether a suspicious object of the first preset vehicle exists in the image captured by the panoramic camera device of the first preset vehicle, and the clarity of the suspicious object in the image captured by the panoramic camera device of the first preset vehicle is less than a preset value, according to the first preset vehicle. The image of the suspicious object captured by the panoramic camera of the preset vehicle determines a second preset vehicle; the first preset vehicle is the preset vehicle in the monitoring area; the second preset vehicle is different from the first preset vehicle; the illuminated area illuminated by the preset exterior lights of the second preset vehicle Including the suspicious object; a notification module, the notification module is used to notify the second preset vehicle to turn on the preset exterior lights; before obtaining the images collected by the panoramic camera device of the preset vehicle from all the preset vehicles in the monitoring area, the acquisition module is also used to: determine that the monitoring area is the intersection of the image collection ranges of the panoramic camera devices of all the preset vehicles. A vehicle network server, the improvement of which is that the vehicle network server includes a processor and a memory, the memory is used to store program instructions, and when the processor calls the program instructions, the monitoring method described in any one of claim items 1 to 6 is implemented. A computer-readable storage medium, the improvement of which is that the computer-readable storage medium stores a program, and the program enables the vehicle network server to implement the monitoring method described in any one of claim items 1 to 6.

Images