KR102245850B1 - Method and apparatus for providing integrated control service using black box images - Google Patents

Abstract

By the start, the step of acquiring a first image including objects and surrounding environment around the CCTV through CCTV installed in the smart city, including GPS information of the vehicle through a camera installed in the vehicle, and outside the vehicle Acquiring a second image including the located object and the surrounding environment, receiving a user input requesting current state information of the first area on the map of the smart city, time information, weather information, traffic information, and GPS information Generating a third image by combining the first image and the second image based on the first image, obtaining current image information for the first area from the first image when the first area is a CCTV-installed area, the first area In the case of an area where the CCTV is not installed, acquiring current image information for the first area from a second image acquired from a vehicle located in area 1, providing current image information for the first area to the user, A black box image comprising receiving a user input requesting detailed information about the first area, obtaining detailed information of the first area from a third image, and providing detailed information of the first area to the user Disclosed is a method of providing an integrated control service using

Description

TECHNICAL FIELD [Method and apparatus for providing integrated control service using black box images}

According to one disclosure, a method and apparatus for providing an apparatus and method for providing an integrated control service in a place where CCTV control service is vulnerable using an image of a black box is disclosed.

The black box, which is mainly used in the aviation safety field, has begun to be grafted into the automotive industry. The black box is a flight recorder that records altitude, airspeed, vertical acceleration, time, etc. necessary for clarifying the flight status of an aircraft. As the black box of such an aircraft is grafted with the automobile industry, various examples of vehicle operation records are provided. For example, it refers to a device that stores a driving speed, a driving lane, an external situation, and an engine state, and provides the stored driving information to a user if necessary.

The image information stored in the vehicle black box is mostly used for accident or crime confirmation. However, verification of the stored image information can often be performed after an accident or crime has occurred. That is, the image information stored in the memory of the vehicle black box is viewed post-mortem through an offline method.

The video information of the vehicle black box includes information on the accident situation or surrounding vehicles/passengers. In addition, the image information of the vehicle black box includes a lot of very useful information such as real-time traffic conditions, real-time vehicle tracking, and vehicle information while driving in the direction of progress/reverse direction. Such useful information can be a resource that can be used in a timely manner.

In general, in the case of a CCTV system, CCTVs are installed only at major points. Therefore, the CCTV system is relatively vulnerable to real-time traffic situation identification, security monitoring, and vehicle tracking in suburbs or blind spots. In addition, when the number of CCTV installations increases, there is a problem that the cost burden for system operation increases.

Republic of Korea Patent Publication No. 10-2017-0070940 (published on June 23, 2017) Republic of Korea Patent Publication No. 10-2015-0069623 (published on June 14, 2015)

A technical problem according to the disclosure is to provide a method and apparatus for providing an integrated control service using a black box image and GPS information captured while a vehicle is moving.

According to the first embodiment, acquiring a first image including objects and surrounding environments around the CCTV through a CCTV installed in a smart city, including GPS information of the vehicle through a camera installed in the vehicle, and Acquiring a second image including an object located outside and the surrounding environment, receiving a user input requesting current state information of the first area on a map of a smart city, time information, weather information, traffic information, and GPS Generating a third image by combining the first image and the second image based on the information, obtaining current image information for the first area from the first image when the first area is a CCTV installed area, the first If the zone 1 is a zone where CCTV is not installed, acquiring current image information for the first zone from a second image acquired from a vehicle located in zone 1, providing current image information for the first zone to the user , Receiving a user input requesting detailed information on the first area, obtaining detailed information on the first area from a third image, and providing detailed information on the first area to the user, Black Disclosed is a method of providing an integrated control service using a box image.

Further, when acquiring an image of a collision between the first object and the second object, determining the fruit ratio α of the first object and the fruit ratio β of the second object, the fruit ratio α of the first object and the When any one of the second object's fruit ratio is determined to be between 45 and 55%, weather information, traffic information, and other object information along with images of all viewpoints at which the images of the first object and the second object are acquired It is possible to provide a step of generating a report image by combining surrounding environment information including, and a step of automatically transmitting the generated report image to a police station server.

According to the second embodiment, a communication unit that communicates with a CCTV and a camera, a processor, and a memory storing instructions executable by the processor are included, and the processor executes the instructions, and the object around the CCTV through the CCTV installed in the smart city And a first image including the surrounding environment, including GPS information of the vehicle through a camera installed in the vehicle, and acquiring a second image including an object located outside the vehicle and the surrounding environment, and Receives a user input requesting current state information of the first area on the map, combines the first image and the second image based on time information, weather information, traffic information, and GPS information to generate a third image, If zone 1 is an area with CCTV installed, current image information for zone 1 is acquired from the first image, and when zone 1 is an area where CCTV is not installed, it is determined from the second image acquired from a vehicle located in zone 1. Acquires current image information for zone 1, provides current image information for zone 1 to a user, receives user input requesting detailed information for zone 1, and receives details of zone 1 from image 3 An apparatus for providing an integrated control service using a black box image that acquires information and provides detailed information of the first area to a user may be presented.

In order to execute a method of providing an integrated control service using a black box image according to the third embodiment, a non-transitory computer-readable storage medium in which instructions executable by a processor are stored may be provided.

By the start, it is possible to provide a CCTV integrated control service in real time using GPS information and clear image information stored in a vehicle black box, thereby improving problems due to the blind spot and low quality of CCTV.

According to the present invention, according to the present invention, it is possible to automatically report vehicles, people, etc. that violate traffic regulations, so that traffic using images of vehicles that violate traffic regulations without special video editing, login, video search, etc. You can report violations of the law.

In addition, according to the present invention, it is possible to automatically report a vehicle continuously driving a passing lane for a certain period of time or longer, a vehicle moving in a lane without a turn indicator light, a signal violation vehicle, a reckless driving vehicle, a bus lane violation vehicle, an illegal parking vehicle, etc. There is an economical advantage because it can contribute to maintaining social order and automatically accumulate points according to reports.

1 is a diagram schematically illustrating a method of providing an integrated control service using a black box image according to an exemplary embodiment.
2 is a flowchart illustrating a method of providing an integrated control service using a black box image according to one disclosure.
FIG. 3 is a diagram for explaining a feature of providing an integrated control service by analyzing an image related to an object located outside a vehicle according to an exemplary embodiment.
4 is a view for explaining a feature of providing notification information by analyzing information on surrounding environments from an image of a CCTV and a black box image of a vehicle according to one disclosure.
5 is a diagram illustrating a configuration of an apparatus for providing an integrated control service using a black box image according to one disclosure.
6 is a diagram showing a detailed configuration of an apparatus for providing an integrated control service using a black box image according to one disclosure.

The terms used in the present specification will be briefly described, and an embodiment of the present invention will be described in detail.

Terms used in the present specification have selected general terms that are currently widely used as possible while taking functions of the present invention into consideration, but this may vary according to the intention or precedent of a technician working in the field, the emergence of new technologies, and the like. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning of the terms will be described in detail in the description of the corresponding invention. Therefore, the terms used in the present specification should be defined based on the meaning of the term and the overall contents of the present invention, not a simple name of the term.

When a part of the specification is said to "include" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary. In addition, terms such as "... unit" and "module" described in the specification mean units that process at least one function or operation, which may be implemented as hardware or software, or as a combination of hardware and software. .

Hereinafter, the apparatus 100 for providing an integrated control service using a black box image will be abbreviated as the apparatus 100 for providing an integrated control service.

1 is a diagram schematically illustrating a method of providing an integrated control service using a black box image according to an exemplary embodiment.

According to one start, the integrated control service providing apparatus 100 may acquire an image captured in real time from a plurality of CCTVs 300 installed in a smart city and a camera 200 installed in a vehicle.

Here, a smart city is a modern city composed of various types of public services and infrastructure, and represents a city constructed under a plan. By the start of work, the smart city can manage the order of the city, install CCTVs in various places in the city to prevent crime, and acquire images of all over the city.

The integrated control service providing apparatus 100 may be a server that provides a service that comprehensively controls the order of the city, and the configuration thereof is not limited.

According to another disclosure, the integrated control service providing apparatus 100 may be installed in a vehicle. For example, the integrated control service providing apparatus 100 may be included in the vehicle as a part of the vehicle, or may be mounted detachably.

According to one start, the integrated control service providing apparatus 100 may acquire images of the inside and outside of the vehicle using at least one camera installed in the vehicle. According to one disclosure, the camera may mean a black box camera, a camera included in the apparatus 100 for providing an integrated infrared camera control service, and the like, and the type of a device capable of photographing an image is not limited.

By initiation, the integrated control service providing apparatus 100 may determine an object as a vehicle, a person, or a traffic light in an image acquired while the vehicle is moving. In addition, objects such as road conditions, number and shape of lanes, people, street trees, and the like can all be recognized while the vehicle is moving.

By the start, when the traffic light is red, the apparatus 100 for providing the integrated control service may capture a scene in which the vehicle moves toward the crosswalk, and analyzes the captured image to determine that the vehicle has violated the signal. The integrated control service providing apparatus 100 may transmit an image of a vehicle at a point in time when a traffic law is violated to a traffic law violation management server. The integrated control service providing apparatus 100 may automatically transmit all images including a vehicle, an image at a time point when a signal is violated, an image including a predetermined time before/after the time point at which the signal is violated, and the like, to an external server. .

That is, the integrated control service providing apparatus 100 analyzes the CCTV 200 and the image acquired from the outside of the vehicle to determine whether the objects located in the image violate traffic laws, and transmits the image including the determined result to an external server. By sending, it is possible to automatically report violations of traffic laws by objects.

By the start of the day, the integrated control service providing device 100 can supplement the blind spot of the CCTV based on the image acquired from the CCTV 200 and the image acquired from the vehicle camera 300, and produce a high-definition image. It is possible to provide the user with an image of the city.

2 is a flowchart illustrating a method of providing an integrated control service using a black box image according to one disclosure.

According to one disclosure, in block 201, the integrated control service providing apparatus 100 may acquire a first image including objects around the CCTV and the surrounding environment through the CCTV installed in the smart city. According to one disclosure, CCTV may refer to a plurality of CCTVs installed in the entire smart city, and may refer to CCTVs that photograph a specific area/area according to an embodiment.

By the start of the day, in block 202, the integrated control service providing apparatus 100 may acquire a second image including GPS information of the vehicle and including an object located outside the vehicle and the surrounding environment through a camera installed in the vehicle. have. By initiation, the integrated control service providing apparatus 100 may periodically acquire surrounding image information from a previously registered vehicle. Here, the second image may include GPS information of a vehicle taking an image, a vehicle speed, and vehicle state information.

According to an initiation, in block 203, the apparatus 100 for providing an integrated control service may receive a user input requesting current state information of a first area on a map of a smart city. The integrated control service providing apparatus 100 may provide a map of a smart city to a user's terminal. The map of the smart city may include buildings, roads, points where CCTV is installed, coordinate information based on GPS, etc., and the user can select a point on the map of the smart city or enlarge or reduce the map. I can. Here, the range of the first area may vary according to the map size/scale at a point in time when the user selects a point on the map.

At the start of the day, in block 204, the apparatus 100 for providing an integrated control service may generate a third image by combining the first image and the second image based on time information, weather information, traffic information, and GPS information. The apparatus 100 for providing an integrated control service according to an initiation may fuse the first image and the second image based on GPS information. Here, the third image is produced based on the first image, and an image of a blind spot that can be obtained from the first image may be obtained from the second image. Alternatively, the third image may include a second image as a screen independent from the first image.

According to one start, the integrated control service providing apparatus 100 in block 205 may obtain current image information for the first area from the first image when the first area is a CCTV installed area. According to one disclosure, the integrated control service providing apparatus 100 is economical because it can provide an integrated control service only with CCTV images when sufficient CCTVs capable of securing images for the first area are installed.

By the start of the day, in block 206, the integrated control service providing device 100 obtains the current image information for the first area from the second image acquired from the vehicle located in the first area when the first area is an area where CCTV is not installed. can do. According to one disclosure, when CCTV is not sufficiently installed in the first area, or when a blind spot occurs only with images by CCTV, information on the blind spot can be obtained from the black box image of the vehicle, which is economical.

According to an initiation, in block 207, the apparatus 100 for providing an integrated control service may provide current image information for the first area to the user. That is, the integrated control service providing apparatus 100 may provide an image acquired from at least one of a CCTV and a black box of a vehicle by one start.

According to an initiation, in block 208, the apparatus 100 for providing an integrated control service may receive a user input requesting detailed information for the first area. Here, the detailed information may include an enlarged image of a specific area included in the first area, weather in the first area, information on buildings, people, vehicles, and the like. In other words. What includes more information than the basically provided current image information is referred to as detailed information, and the user may request more detailed information than information displayed in the current image of the first area.

According to an initiation, the apparatus 100 for providing an integrated control service in block 209 may obtain detailed information of the first area from the third image. By initiation, the integrated control service providing apparatus 100 may acquire information related to weather, object, road condition information, event occurrence, and the like in the first area. According to one disclosure, the integrated control service providing apparatus 100 may obtain detailed information of the first area from an SNS server, an external server, a broadcasting company server, a police station server, a fire station server, and the like.

By initiation, the integrated control service providing apparatus 100 may determine the type of the object as one of a person, a bicycle, a motorcycle, and a car. According to one disclosure, when the object is a vehicle, the integrated control service providing apparatus 100 may determine a detailed type as one of a passenger vehicle, a freight vehicle, and a bus according to the purpose of the vehicle.

By the start of the day, when the object corresponds to an emergency dispatch vehicle including an ambulance, a police vehicle, a hospital ambulance and a fire engine, it does not determine whether the object violates traffic laws, and By applying the following traffic laws, it is possible to determine whether or not traffic laws are violated due to yielding driving of other vehicles located in the vicinity of the emergency dispatch vehicle.

By the start of the day, the integrated control service providing device 100 may determine whether or not to report a traffic law violation of another vehicle according to the severity of the traffic law violation, and based on the determined result, the timing of the traffic law violation of another vehicle You can automatically transfer the video from the video to an external server.

According to an initiation, the apparatus 100 for providing the integrated control service in block 210 may provide detailed information of the first area to the user. By initiation, when a specific event occurs in the detailed information of the first area, the integrated control service providing device 100 may additionally transmit a notification message through a notification message, an SNS message, or an e-mail.

FIG. 3 is a diagram for explaining a feature of providing an integrated control service by analyzing an image related to an object located outside a vehicle according to an exemplary embodiment.

According to an initiation, the integrated control service providing apparatus 100 may obtain movement information of an object with respect to a speed of an object, a movement direction of the object, lane information, and location information of the object according to movement of the object. That is, according to one start, the integrated control service providing apparatus 100 may acquire other information of an object through acquisition of information from a sensor, another camera, or a peripheral device.

By the start of the day, the integrated control service providing apparatus 100 includes traffic regulation information, traffic light information, weather information, road traffic situation information, hypocrisy photo information, and movement information of other objects according to the characteristics of the road on which the object is moving. It is possible to obtain information about the surrounding environment. That is, by the start of the day, the integrated control service providing device 100 collects the surrounding environment information at the time when the image is acquired through information received from sensors, satellite devices, other cameras, external servers, peripheral devices, and other vehicles. It can be acquired in real time.

By the start, the integrated control service providing apparatus 100 may combine movement information and surrounding environment information of an object with an image of the object and transmit it to an external server. By initiation, the integrated control service providing device 100 may transmit surrounding environment information and object movement information to an external server in order to prevent false reports due to machine errors, special application of laws, and changes in traffic laws. . The external server may prevent unfair reporting by determining whether the object violates traffic laws once again, and may transmit the determined result to the integrated control service providing apparatus 100 or to the user's terminal.

For example, as shown in FIG. 3, an image of a collision between the car 301 and the bicycle 303 can be automatically transmitted to an external server. Collision images can be transmitted to an insurance company server or the like.

In addition, the integrated control service providing apparatus 100 may receive information on the wanted vehicle and the wanted person from an external server. For example, information on the vehicle type, license plate information, and vehicle status of the wanted vehicle may be obtained, and information on the desired person's impression and wear, height, age, and montage information may be obtained.

By the start of the day, when the integrated control service providing apparatus 100 acquires an image that matches 80% or more of information on any one of the wanted vehicle and the wanted person from the acquired surrounding image of the vehicle, the acquired image is transferred to an external server. Can be transferred to. For example, the integrated control service providing apparatus 100 may acquire a match rate between the wanted vehicle and the wanted person and the acquired information by using an artificial intelligence learning model. According to one disclosure, the 80% match rate is only an example, and may vary according to embodiments.

According to an initiation, the apparatus 100 for providing an integrated control service may receive information on whether the image matches information on the wanted vehicle and the wanted person from an external server. That is, by the start of the day, the integrated control service providing device 100 primarily determines whether or not the match is matched, and a more accurate match can be determined by an external server, and the integrated control service providing device 100 It is possible to receive the result of the correct secondary judgment.

By the start of the day, when the integrated control service providing apparatus 100 receives determination information that the image corresponds to any one of the wanted vehicle and the wanted person, from the start point to the end point of detecting any one of the wanted vehicle and the wanted person Images up to and including can be transmitted to an external server. That is, in order to provide more detailed information, all information including the wanted vehicle or the wanted person may be transmitted to an external server.

For example, when the integrated control service providing device 100 determines that 82% of the information on the desired person's impression of the pedestrian 302 matches, all images including the pedestrian 302 can be transmitted to the National Police Agency server. have. According to an initiation, the integrated control service providing apparatus 100 may transmit an image generated from a different angle to an external server using another camera of a vehicle.

FIG. 4 is a diagram for explaining a feature of providing notification information by analyzing information on a surrounding environment from an image of a CCTV and a black box image of a vehicle according to one disclosure.

By initiation, the integrated control service providing apparatus 100 may recognize an object from the third image and determine the type of the object and the type of the road.

According to one start, the integrated control service providing apparatus 100 may determine whether the object violates social laws, based on traffic law information determined according to the type of the object and the type of the road.

According to an initiation, the apparatus 100 for providing an integrated control service may automatically transmit an image of an object to an external server at a time when the object violates social laws.

According to an initiation, the apparatus 100 for providing an integrated control service may receive information on determining an error ratio of the second object and the third object from an external server. In this case, the external server may mean a traffic law related server, a police station server, an insurance company server, and the like, and may mean any system capable of determining the negligence rate.

By the start, the integrated control service providing apparatus 100 may transmit the image of the second object, the image of the third object, and information on determining the percentage of negligence to the insurance company server of the second object and the insurance company server of the third object. That is, the integrated control service providing apparatus 100 may contribute to solving a problem caused by a collision of an object by automatically transmitting an image of a collision process of an object to the insurance company server of the object.

By the start of the day, when the information on the second object and the third object cannot be obtained directly, the integrated control service providing device 100 transmits a second image of the collision of the object through an external server through the National Police Agency server. The object and the server connected to the third object can be transmitted, and the transmission result can be obtained through an external server.

By initiation, the integrated control service providing apparatus 100 may receive a user input requesting an image of a previously registered first object. According to an initiation, the apparatus 100 for providing the integrated control service may time-sequentially track the first object included in the third image according to the movement of the first object to generate a fourth image and transmit it to the user.

According to an initiation, the apparatus 100 for providing an integrated control service may transmit the fourth image to a pre-registered user, a guardian of the user of the first object, and other external servers.

Here, the first object is a terminal previously registered at the request of a user, and is characterized in that consent to obtain location information and image information for the first object has been received in advance.

In addition, the fourth image includes the speed of the first object, the movement direction of the first object, road information, the state information of the building, the movement information of the first object relative to the location information of the first object, and the road on which the first object is moving. It is characterized by including traffic law information, traffic light information, weather information, road traffic situation information, hypocrisy photo information, and movement information of other objects according to characteristics.

By initiation, the integrated control service providing apparatus 100 may receive destination information from the driver of the vehicle. Here, the integrated control service providing apparatus 100 may function as a device mounted on a vehicle by one start.

By initiation, the integrated control service providing apparatus 100 may generate a moving route according to destination information, and obtain a current image included in the moving route from CCTV.

By initiation, the integrated control service providing apparatus 100 may determine a risk level in a moving path using traffic laws, traffic laws violation history, accident history, and current traffic situation information in the current image.

According to an initiation, the apparatus 100 for providing an integrated control service may generate traffic guide information to be noted in a moving route based on a risk level. For example, as shown in the drawing, the integrated control service providing device 100 may collide with the person 400 when the person 400 rushes toward the road while the vehicle does not recognize the blind spot 102. It is possible to generate traffic guidance information by determining the risk of an event that may be possible.

In addition, the integrated control service providing apparatus 100 may generate traffic guide information using the display screen 103 installed in the vehicle. Here, the traffic guide information may include simulation information, an image at a future point of view, and the like.

The integrated control service providing apparatus 100 is economical and effective because it can generate traffic guide information using an image supplemented from an image acquired from the CCTV 200 in addition to the image acquired from the vehicle.

By the start of the day, the integrated control service providing device 100 may display traffic guide information determined for each moving route through the display of the vehicle moving along the moving route, and the integrated control service providing device 100 by the start of the day While moving in an area with a high risk level, by driving a plurality of cameras installed on the side and rear of the vehicle, additional images of the surrounding objects of the vehicle may be obtained.

By the start of the day, the integrated control service providing apparatus 100 obtains a fourth image of the vehicle's surroundings from a black box image of a vehicle surrounding the vehicle, and analyzes the additional image and the fourth image to determine whether the surrounding object violates traffic laws. Can be judged.

By initiation, the integrated control service providing apparatus 100 may output traffic guide information according to the movement of the vehicle.

By the start of the day, the integrated control service providing apparatus 100 analyzes the additional image to determine whether a neighboring object violates traffic laws, and automatically externalizes the image for 30 seconds before/after the time when the traffic law violation of the neighboring object occurs. Can be sent to the server. The 30 seconds before/after are merely exemplary, and the video time may be preset by a user or an administrator.

According to one disclosure, the integrated control service providing apparatus 100 may display that the current road area is an 80 km/h speed limit area, and that a speed violation is always reported as an area through the head-up display device 402 of the vehicle. In addition, the integrated control service providing apparatus 100 may display a risk level for a current road.

Furthermore, the integrated control service providing device 100 displays the speed and signal violation of the other vehicle 401 through the display device of the vehicle. Information can be presented to the user.

5 is a diagram showing a main configuration of an apparatus for providing an integrated control service using a black box image.

6 is a diagram showing a detailed configuration of an apparatus for providing an integrated control service using a black box image according to one disclosure.

According to one disclosure, the integrated control service providing apparatus 100 may include a communication unit 1500, a processor 1300, and a memory 1700. However, not all of the components shown in FIG. 5 are essential components of the apparatus 100 for providing an integrated control service. The integrated control service providing device 100 may be implemented by more components than the components shown in FIG. 5, and the integrated control service providing device 100 is implemented by fewer components than the components shown in FIG. 5. It could be.

For example, as shown in FIG. 6, the integrated control service providing apparatus 100 according to an embodiment includes a user input unit 1100, a communication unit 1500, a display unit 1210, a processor 1300, and a memory. In addition to the 1700, an output unit 1200, a sensing unit 1400, and an A/V input unit 1600 may be further included.

For example, the integrated control service providing apparatus 100 according to an embodiment may basically include a control unit 1300, a user input unit 1100, and a memory 1700, and provide an integrated control service according to an embodiment. In addition to the control unit 1300, the communication unit 1500, and the memory 1700, the device 100 includes at least one of the communication unit 1500, the output unit 1200, the sensing unit 1400, and the A/V input unit 1600. It may be an integrated control service providing apparatus 100 that further includes.

The user input unit 1100 refers to a means for a user to input data for controlling the integrated control service providing apparatus 100. For example, the user input unit 1100 includes a key pad, a dome switch, and a touch pad (contact type capacitance method, pressure type resistive film method, infrared detection method, surface ultrasonic conduction method, integral type). There may be a tension measurement method, a piezo effect method, etc.), a jog wheel, a jog switch, etc., but the present invention is not limited thereto.

The user input unit 1100 may receive a user input for receiving a user input for controlling an operation of a module installed in the integrated control service providing apparatus 100.

The output unit 1200 may output an audio signal, a video signal, or a vibration signal, and the output unit 1200 may include a display unit 1210, an audio output unit 1220, and a vibration motor 1230. have. In an embodiment, the output unit 1200 may output a notification message in the form of audio, video, and/or vibration.

The display unit 1210 displays and outputs information processed by the integrated control service providing apparatus 100.

The sound output unit 1220 outputs audio data received from the communication unit 1500 or stored in the memory 1700. In addition, the sound output unit 1220 outputs sound signals related to functions (eg, a call signal reception sound, a message reception sound, and a notification sound) performed by the integrated control service providing apparatus 100. For example, the sound output unit 1220 may output an alarm sound for notifying that an event has occurred.

The controller 1300 generally controls the overall operation of the integrated control service providing apparatus 100. According to one disclosure, the control unit is also referred to as a processor. For example, by executing programs stored in the memory 1700, the control unit 1300, the user input unit 1100, the output unit 1200, the sensing unit 1400, the communication unit 1500, the A/V input unit 1600 ) And so on. In addition, the controller 1300 may perform a function of the integrated control service providing apparatus 100 by executing programs stored in the memory 1700. The control unit 1300 may include at least one processor. The control unit 1300 may include a plurality of processors or may include one integrated processor according to its function and role. In an embodiment, the controller 1300 may include at least one processor to provide a notification message by executing at least one program stored in the memory 1700.

The sensing unit 1400 may sense a state of the integrated control service providing device 100, a user's state, or a state around the integrated control service providing device 100, and transmit the sensed information to the controller 1300.

The sensing unit 1400 includes a magnetic sensor 1410, an acceleration sensor 1420, a temperature/humidity sensor 1430, an infrared sensor 1440, a gyroscope sensor 1450, and a position sensor. (For example, a GPS) 1460, an atmospheric pressure sensor 1470, a proximity sensor 1480, and an RGB sensor 1490 may be included, but the present invention is not limited thereto. Since the function of each sensor can be intuitively inferred by a person skilled in the art from its name, a detailed description will be omitted.

The communication unit 1500 may include one or more components that allow the integrated control service providing apparatus 100 to communicate with other devices and other servers. For example, the communication unit 1500 may include a short range communication unit 1510, a mobile communication unit 1520, and a broadcast reception unit 1530. The other user device may be a computing device or a sensing device, but is not limited thereto.

The short-range wireless communication unit 1510 includes a Bluetooth communication unit, a Bluetooth Low Energy (BLE) communication unit, a Near Field Communication unit, a WLAN (Wi-Fi) communication unit, a Zigbee communication unit, and an infrared ( IrDA, infrared data association) communication unit, WFD (Wi-Fi Direct) communication unit, UWB (ultra wideband) communication unit, Ant+ communication unit, etc. may be included, but is not limited thereto.

The mobile communication unit 1520 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include a voice call signal, a video call signal, or various types of data according to transmission and reception of text/multimedia messages.

The broadcast receiving unit 1530 receives a broadcast signal and/or broadcast-related information from outside through a broadcast channel. Broadcast channels may include satellite channels and terrestrial channels. According to an implementation example, the integrated control service providing apparatus 100 may not include the broadcast reception unit 1530.

In an embodiment, the communication unit 1500 may receive a video sequence including a plurality of frames from a camera installed in the integrated control service providing apparatus 100. In an embodiment, the communication unit 1500 may transmit a command for controlling an operation of a module installed in the integrated control service providing device 100 to a module installed in the integrated control service providing device 100.

The A/V (Audio/Video) input unit 1600 is for inputting an audio signal or a video signal, and may include a camera 1610 and a microphone 1620. The camera 1610 may obtain an image frame such as a still image or a video through an image sensor in a video call mode or a photographing mode. The image captured through the image sensor may be processed by the control unit 1300 or a separate image processing unit (not shown). For example, an image captured by the camera 1610 may be used as information for determining whether an event has occurred.

The microphone 1620 receives an external sound signal and processes it as electrical voice data. For example, the microphone 1620 may receive an acoustic signal from an external device or a user. The microphone 1620 may use various noise removal algorithms for removing noise generated in a process of receiving an external sound signal.

The memory 1700 may store a program for processing and control of the controller 1300, and may store data input to the integrated control service providing device 100 or output from the integrated control service providing device 100.

The memory 1700 is a flash memory 1700 type, a hard disk type, a multimedia card micro type, and a card type memory 1700 (for example, SD or XD memory (1700), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read- Only Memory), a magnetic memory 1700, a magnetic disk, and an optical disk.

Programs stored in the memory 1700 can be classified into a plurality of modules according to their functions. Here, the plurality of modules are software, not hardware, meaning modules that operate functionally. For example, a UI module ( 1710), a touch screen module 1720, a notification module 1730, and the like.

The UI module 1710 may provide a specialized UI, a GUI, etc. linked with the apparatus 100 for providing an integrated control service for each application. The touch screen module 1720 may detect a user's touch gesture on a touch screen and transmit information about the touch gesture to the controller 1300. The touch screen module 1720 according to an embodiment may recognize and analyze a touch code. The touch screen module 1720 may be configured with separate hardware including a controller.

The notification module 1730 may generate a signal for notifying the occurrence of an event. The notification module 1730 may output a notification signal in the form of a video signal through the display unit 1210, may output a notification signal in the form of an audio signal through the sound output unit 1220, and the vibration motor 1230 It is also possible to output a notification signal in the form of a vibration signal through.

The method according to an embodiment of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements by those skilled in the art using the basic concept of the present invention defined in the following claims are also provided. It belongs to the scope of rights.

Claims (9)

Acquiring a first image including an object around the CCTV and a surrounding environment through a CCTV installed in a smart city;
Acquiring, through a camera installed in the vehicle, a second image including GPS information of the vehicle and including an object located outside the vehicle and a surrounding environment;
Receiving a user input requesting current state information of a first area on the map of the smart city;
Generating a third image by combining the first image and the second image based on time information, weather information, traffic information, and GPS information;
Acquiring current image information for the first area from a first image when the first area is a CCTV installed area;
Obtaining current image information for the first zone from a second image acquired from a vehicle located in the first zone when the first zone is a zone where CCTV is not installed;
Providing current image information on the first area to a user;
Receiving a user input requesting detailed information on the first area;
Obtaining detailed information of the first area from the third image;
Providing detailed information of the first zone to the user;
Recognizing an object from the third image and determining a type of the object and a type of a road;
Determining whether the object violates social regulations based on traffic regulation information determined according to the type of the object and the type of the road; And
Including; automatically transmitting the image of the object to an external server at the time when the violation of the social law of the object occurs
The step of determining the type of the object and the type of the road,
Determining the type of the object as one of a person, a bicycle, a motorcycle, and a car; And
If the object is a car, determining a detailed type of one of a passenger car, a freight car, and a bus according to the purpose of the car; including,
The step of determining whether the object violates social laws and regulations,
Not determining whether the object violates traffic laws when the object corresponds to an emergency dispatch vehicle including an ambulance, a police vehicle, a hospital ambulance and a fire engine; And
Including, by applying the traffic laws according to the emergency dispatch vehicle, determining whether or not a traffic law violation due to the yield driving of another vehicle located in the vicinity of the emergency dispatch vehicle; Including,
The step of transmitting to the external server,
Determining whether or not to report a violation of the traffic law of the other vehicle according to the severity of the violation of the traffic law; And
A method for providing an integrated control service using a black box image comprising; automatically transmitting an image at the time of violation of traffic laws of the other vehicle to the external server based on a result of determining the presence or absence of the report. delete delete The method of claim 1,
Receiving a user input requesting an image of a previously registered first object;
Generating a fourth image by tracking the first object included in the third image in time series according to the movement of the first object; And
And transmitting the fourth image to a user,
The first object is a terminal previously registered at the request of a user, and has previously received consent to obtain location information and image information for the first object,
The fourth image includes the speed of the first object, the direction of movement of the first object, road information, state information of the building, movement information of the first object with respect to the location information of the first object, and the road on which the first object is moving. A method of providing an integrated control service using a black box image, characterized in that it includes traffic law information, traffic light information, weather information, road traffic situation information, hypocrisy photo information, and movement information of other objects according to the characteristics of. The method of claim 1,
Receiving information on the wanted vehicle and the wanted person from the external server;
Transmitting the acquired image to the external server when acquiring an image that matches 80% or more of information on any one of the wanted vehicle and the wanted person in the second image;
Receiving determination information on whether the image matches information on the wanted vehicle and the wanted person from the external server; And
When receiving determination information that the image corresponds to one of the wanted vehicle and the wanted person, an image from the start point to the end point of detecting any one of the wanted vehicle and the wanted person is acquired from the second image, and the external A method of providing an integrated control service using a black box image, comprising the step of transmitting to a server. The method of claim 5,
Determining a fruit ratio α of the second object and a fruit ratio β of the third object when obtaining an image of the collision between the second object and the third object from the second image;
When any one of the fruit ratio α of the second object and the fruit ratio of the third object is determined to be between 45 and 55%, the second object and the third object together with images of all viewpoints obtained Generating a report image by combining weather information, traffic information, and surrounding environment information including information on other objects; And
A method of providing an integrated control service using a black box image comprising the step of automatically transmitting the generated report image to a police station server. The method of claim 1,
Receiving destination information from a driver of the vehicle;
Generating a moving route according to the destination information, and obtaining a current image included in the moving route from the CCTV;
Determining a risk level in the moving route by using traffic regulations, traffic regulations violation history, accident history, and current traffic situation information from the current image;
Generating traffic guide information to be noted in the moving route based on the risk level;
Displaying the traffic guide information determined for each of the movement paths through a display of the vehicle moving along the movement path;
Driving a plurality of cameras installed on side and rear sides of the vehicle while moving the area where the risk level is higher than a preset level to obtain additional images of surrounding objects of the vehicle;
Acquiring a fourth image of a surrounding of the vehicle from a black box image of a vehicle surrounding the vehicle; And
Providing an integrated control service using a black box image, comprising the step of analyzing the additional image and the fourth image to determine whether the surrounding object violates traffic laws, and outputting traffic guide information according to the movement of the vehicle. Way. delete A non-transitory computer-readable storage medium storing instructions executable by a processor to execute the method of claim 1.

Images