KR102832128B1 - Display screen photographing prevention device for privacy - Google Patents

Abstract

A display screen capture prevention device for personal information protection according to one embodiment of the present invention detects whether an image including personal information is captured from the front and side of the device when an image including personal information is output from the device, and outputs an image not including personal information when capture is detected. The display screen capture prevention device for personal information protection may include: a display unit which outputs a first image including personal information and a second image not including personal information; a camera unit which is mounted at a predetermined position on the display unit and generates image information which is information on an external situation of the display unit corresponding to a shooting range; and a control unit which controls the display unit and the camera unit based on at least one of the image output on the display unit or the image information.

Description

{Display screen photographing prevention device for privacy}

The present invention relates to a display screen capture prevention device for personal information protection, and more specifically, to a display screen capture prevention device for personal information protection which detects whether an image containing personal information is captured from the front and side of the device when the device outputs an image containing personal information, and if capture is detected, outputs an image not containing personal information.

Public, financial, and corporate sectors are establishing and protecting physical, management, and technical security standards based on relevant laws and regulations such as ISMS-P and the Personal Information Protection Act to protect information assets.

For example, financial institutions (and corporations) are audited by the Financial Supervisory Service, and public institutions are audited by the National Intelligence Service.

Although general companies are not required to conduct regular audits, they protect information assets by establishing an information protection system based on the Personal Information Protection Act, Information and Communications Network Act, etc. depending on the services they provide.

However, despite these efforts, information security incidents continue to occur and cybercrimes are becoming more sophisticated.

Recently, as terminal devices (e.g., smartphones, laptops, tablet PCs, etc.) have become widespread and the work environment has changed to non-face-to-face work such as remote work and smart work due to the spread of COVID-19, threats to corporate and institutional information assets are also rapidly increasing.

As a countermeasure, the Korea Internet & Security Agency (KISA) took this work environment into consideration and presented information protection measures through the "Security Guide for Introduction and Operation of a Non-Face-to-Face Work Environment."

In particular, this guide also provides security methods and inspection checklists for human and physical threats, such as terminal security, secure USB, vaccines, DLP, media control, and DRM.

However, since most of the security measures or guides described above protect information through software that runs within the device and provides functions such as network security, system security, and encryption modules, it is impossible to prevent information displayed on the display from being leaked through actions such as video and image recording using other devices.

In the current information security system, the security of terminal devices is configured to be controlled (and encrypted and stored) by installing antivirus software, DLP, and DRM on the terminal device, and is controlled and protected only within the terminal device.

Although this approach does not provide complete information protection, even if it did, it creates security vulnerabilities in the information exposed to the user's display.

In other words, the company is defenseless against attacks such as users accessing work and viewing information using their devices while they are away from their desks in external spaces or personal spaces where an unspecified number of people gather, or others illegally filming (photos, videos, etc.) information assets displayed on the user's display.

Although these problems have been increasingly recognized in recent years, there are no realistic security measures in place.

To solve these problems, Korean Patent No. 10-233-7779 B1 (December 6, 2021) discloses a behavior-based information leakage prevention method and a system for executing the same that can prevent leakage of information displayed on a display using an image capturing device in a terminal device.

However, in industrial settings, there is a need to develop a system that can more closely determine whether illegal filming has occurred and prohibit filming based on the results of the determination in order to prevent personal information leaks in advance.

The present invention has been made to solve the above problems, and provides a display screen shooting prevention device for personal information protection that can prevent personal information leakage by more closely determining whether illegal shooting has occurred based on image information of the front and side of the device acquired through a camera such as a vision sensor.

The problems to be solved by the present invention are not limited to the problems described above, and problems not mentioned can be clearly understood by a person having ordinary skill in the art to which the present invention belongs from this specification and the attached drawings.

A display screen capture prevention device for personal information protection according to one embodiment of the present invention detects whether an image including personal information is captured from the front and side of the device when an image including personal information is output from the device, and outputs an image not including personal information when capture is detected. The display screen capture prevention device for personal information protection may include: a display unit which outputs a first image including personal information and a second image not including personal information; a camera unit which is mounted at a predetermined position on the display unit and generates image information which is information on an external situation of the display unit corresponding to a shooting range; and a control unit which controls the display unit and the camera unit based on at least one of the image output on the display unit or the image information.

According to a display screen capture prevention device for personal information protection according to one embodiment of the present invention, when an image containing personal information is output, if it is determined that illegal filming is taking place in front of the device, an image not containing personal information is output, thereby having the advantage of protecting personal information.

In addition, according to the display screen capture prevention device for personal information protection according to one embodiment of the present invention, when an image containing personal information is output, the camera power is controlled to ON, and when an image not containing personal information is output, the camera power is controlled to OFF, thereby reducing the power consumption of the device.

The effects of the present invention are not limited to the effects described above, and effects not mentioned can be clearly understood by a person skilled in the art from this specification and the attached drawings.

FIG. 1 is an exemplary diagram illustrating a manufacturing method of a display screen capture prevention device for personal information protection according to one embodiment of the present invention.
FIG. 2 is a block diagram for explaining in detail the elements constituting a display screen capture prevention device for personal information protection according to one embodiment of the present invention.
FIG. 3 is an exemplary diagram explaining that a first image containing personal information is output on a display unit constituting a display screen capture prevention device for personal information protection according to one embodiment of the present invention.
FIG. 4 is an exemplary diagram explaining that a second image, which is an image that does not include personal information, is output on a display unit constituting a display screen capture prevention device for personal information protection according to one embodiment of the present invention.
FIG. 5 is an exemplary diagram for explaining that a first image and a second image are switched and output by a control unit on a display unit constituting a display screen capture prevention device for personal information protection according to one embodiment of the present invention.
FIG. 6 is a graph for explaining in more detail the switching and output of a first image and a second image on a display unit constituting a display screen capture prevention device for personal information protection according to one embodiment of the present invention.
FIGS. 7 and 8 are flowcharts for explaining in more detail the process of switching and outputting a first image and a second image by a control unit on a display unit constituting a display screen capture prevention device for personal information protection according to one embodiment of the present invention.

Hereinafter, specific embodiments of the present invention will be described in detail with reference to the drawings. However, the spirit of the present invention is not limited to the presented embodiments, and those skilled in the art who understand the spirit of the present invention will be able to easily propose other regressive inventions or other embodiments included within the scope of the spirit of the present invention by adding, changing, deleting, etc. other components within the scope of the same spirit, but this will also be considered to be included within the scope of the spirit of the present invention.

A display screen capture prevention device for personal information protection according to one embodiment of the present invention detects whether an image including personal information is captured from the front and side of the device when an image including personal information is output from the device, and outputs an image not including personal information when capture is detected. The display screen capture prevention device for personal information protection may include: a display unit which outputs a first image including personal information and a second image not including personal information; a camera unit which is mounted at a predetermined position on the display unit and generates image information which is information on an external situation of the display unit corresponding to a shooting range; and a control unit which controls the display unit and the camera unit based on at least one of the image output on the display unit or the image information.

Here, the control unit may be a display screen capture prevention device for personal information protection that keeps the camera unit's power ON when the first image is output on the display unit, and controls the camera unit's power from ON to OFF when the second image is output on the display unit.

In addition, the control unit may be a display screen capture prevention device for personal information protection that controls the second image to be output on the display unit when the image information is not obtained from the camera unit.

Meanwhile, the first image and the second image are output on the display unit for a preset period of time, and the control unit may be a display screen capture prevention device for personal information protection that controls the display unit to output the second image if a first condition, which is a preset condition, is satisfied based on the image information while the first image is output.

More specifically, the first condition may be a condition that, with respect to the acquired image information, at least one of an image of a specific item and a specific part of a body is included.

Furthermore, the control unit may be a display screen capture prevention device for personal information protection that controls the first image to be output when a second condition, which is a pre-determined condition, is satisfied based on the acquired image information while the second image is output.

More specifically, the second condition may be a condition in which the acquired image information does not include an image of a specific item or a specific part of the body.

Components having the same function within the same scope of the same idea shown in the drawings of each embodiment are described using the same reference numerals.

Figures 1 (a) and (b) are exemplary drawings for explaining a form in which a display screen capture prevention device for personal information protection according to one embodiment of the present invention is manufactured.

FIG. 2 is a block diagram for explaining in detail the elements constituting a display screen capture prevention device for personal information protection according to one embodiment of the present invention.

FIGS. 3 (a) and 3 (b) are exemplary diagrams for explaining that a first image, which is an image including personal information, is output on a display unit constituting a display screen capture prevention device for personal information protection according to one embodiment of the present invention.

FIGS. 4(a) and 4(b) are exemplary diagrams for explaining that a second image, which is an image that does not include personal information, is output on a display unit constituting a display screen capture prevention device for personal information protection according to one embodiment of the present invention.

FIG. 5 is an exemplary diagram for explaining that a first image and a second image are switched and output by a control unit on a display unit constituting a display screen capture prevention device for personal information protection according to one embodiment of the present invention.

FIGS. 6(a) to 6(c) are graphs for explaining in more detail the switching and output of the first image and the second image on the display unit constituting the display screen capture prevention device for personal information protection according to one embodiment of the present invention.

FIGS. 7 and 8 are flowcharts for explaining in more detail the process of outputting a first image and a second image by switching them with each other by a control unit on a display unit constituting a display screen capture prevention device for personal information protection according to one embodiment of the present invention.

In order to more clearly express the technical idea of the present invention, the attached drawings have simplified or omitted parts that are not related to the technical idea of the present invention or can be easily derived from those skilled in the art.

The present invention can undergo various modifications and have various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the detailed description.

However, this is not intended to limit the present invention to specific embodiments, but should be understood to include all transformations, equivalents, or substitutes included in the spirit and technical scope of the present invention.

In explaining the present invention, if it is determined that a detailed description of a related known technology may obscure the gist of the present invention, the detailed description is omitted.

The terms first, second, etc. may be used to describe various components, but such components should not be limited by such terms.

The above terms are used solely to distinguish one component from another.

The terminology used in this application is used only to describe particular embodiments and is not intended to limit the present invention.

Singular expressions include plural expressions unless the context clearly indicates otherwise.

In this application, it should be understood that terms such as “include” or “have” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in the specification, but do not exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

Hereinafter, with reference to FIGS. 1 to 8, a display screen capture prevention device (10) for personal information protection according to one embodiment of the present invention will be described in detail.

A display screen capture prevention device (10, hereinafter referred to as a device) for personal information protection according to one embodiment of the present invention can be installed in a government office, a company building, etc. for the purpose of providing information, and a user can receive information about the company, personnel information, and tourist information for the area where the device (10) is installed through the device (10).

The above device (10) may be manufactured as a wall-mounted type, as shown in (a) of Fig. 1, or as another example, may be manufactured as a known kiosk type, as shown in (b) of Fig. 1, and may provide information such as corporate information, human resources information, and tourism information to the user through the display unit (500) constituting the device (10).

The above information may be output as an image on the display unit (500), for example.

The above image may mean a concept that includes not only an image but also a video.

The memory unit (300) constituting the above device (10) can receive and store in advance from an administrator a first image (I1) containing personal information (PI), a second image (I2) not containing personal information, and a third image (I3) not containing personal information and different from the second image, and the display unit (500) can output the first image (I1) to the second image (I3).

As an example, the first image (I1) above may mean an organizational chart including personal information (PI), as can be seen in (a) of FIG. 3, and as another example, the first image (I1) may mean an organizational chart including personal information (PI), as can be seen in (a) of FIG. 3.

The second image (I2) and the third image (I3) may mean images in which personal information (PI) is not exposed because they are covered by a warning image (W) that restricts shooting, as shown in (a) of FIG. 4, for example, with respect to the first image (I1), and as another example, as shown in (b) of FIG. 4, they may mean images such as tourist information, company news, and company promotional videos that do not include personal information (PI).

As another example, the second image (I2) and the third image (I3) may mean images in which personal information (PI) included in the first image (I1) is covered with a watermark, and may also mean images in which personal information (PI) included in the first image (I1) is replaced with an avatar.

As described above, the first image (I1) and the third image (I3) may include not only images output on the display unit (500), but also images output on the display unit (500).

Meanwhile, the device (10) may further include a camera unit (400), such as a vision sensor, which is mounted at a predetermined location on the display unit (500) and generates image information, which is information on the external situation of the display unit within the shooting range.

Here, the shooting range may mean the front of the display unit (500) and the side of the display unit (500), and the shooting range may vary depending on the position where the camera unit (400) is mounted on the display unit (500).

The control unit (100), such as the processor constituting the above device (10), can control the display unit (500) and the camera unit (400) based on the first image (I1) to the third image (I3) output on the display unit (500) and the image information. (Step S100, Step S200)

To explain this in more detail, when the first image (I1) including personal information (PI) is output on the display unit (500), the control unit (100) keeps the power of the camera unit in the ON state (step S110), thereby allowing (step S130) to confirm through the image information whether the user is taking a picture of the first image (I1).

To implement this, as can be seen in (a) of Fig. 6, it is preferable that the control unit (100) control the power of the camera unit (400) from OFF to ON before the first image (I1) is output, taking into account the operating time of the camera unit (400).

The above user may refer to a person who receives information through the above device (10).

Conversely, when the second image (I2) that does not include personal information (PI) is output on the display unit (500), the control unit (100) controls the power of the camera unit from ON to OFF (step S120) so that the power consumed by the device (10) can be reduced.

That is, the control unit (100) controls the power of the camera unit (100) to be turned ON when the first image (I1) containing personal information (PI) is output, thereby obtaining the image information, thereby determining whether the user is taking a picture, and controls the power of the camera unit (100) to be turned OFF when the second image (I2) containing no personal information (PI) is output, thereby reducing the power consumption by the camera unit (100).

Furthermore, when the control unit (100) fails to obtain the image information from the camera unit (400) due to a malfunction of the camera unit (400), it controls the second image (I2) to be output on the display unit (500), thereby preventing personal information (PI) from being leaked due to illegal filming by the user.

For example, if the control unit (100) is currently outputting the first image (I1) containing personal information (PI) on the display unit (500) and is unable to acquire image information from the camera unit (500) at the current time, the control unit (100) causes the display unit (500) to output the second image (I2) instead of the first image (I1), thereby preventing personal information (PI) from being leaked due to illegal filming by the user.

Meanwhile, the first image (I1), the second image (I2), and the third image (I3) can be sequentially and continuously output on the display unit for a preset time, as can be seen in (a) of FIGS. 5 and 6.

The output order and output time of the first image (I1), the second image (I2), and the third image (I3) on the display unit (500) may be directly input by the administrator of the device (10) through the device (10), or information about the output order and output time may be transmitted to the communication unit (200) constituting the device through an administrator terminal such as a PC or smartphone.

Meanwhile, the control unit (100) can control the display unit (500) to output the second image (I2) (step S150) when the first image (I1) is output and the first condition, which is a pre-determined condition, is satisfied based on the image information (step S140).

Here, the first condition may mean a condition in which at least one of an image of a specific item and a specific part of a body is included in the image information acquired by the control unit (100) from the camera unit (400).

For example, the first condition may mean an image of a specific part of the body, such as the user's arm or hand, or as another example, image information of a specific item, such as a smartphone or tripod.

Accordingly, the control unit (100) controls the display unit (500) to switch from the first image (I1) to the second image (I2) when at least one of the image information obtained from the camera unit (400) includes an image of the user's arm or hand, or image information of a smartphone, tripod, etc.

This is to prevent leakage of personal information (P1) by allowing the device (10) to determine whether or not the user is taking a photo based on the image information, and if it determines that the user is taking a photo of the first image (I1), converting it to a second image (I2) that does not include personal information (PI) and outputting it.

To explain this in more detail, for example, as can be seen in (a) of FIG. 6, when the first image (I1) is output, if the control unit (100) determines that the user is taking a picture at time T1, it controls the display unit (500) to output the second image (I2) at time T1, thereby preventing personal information (PI) from being leaked due to the user taking a picture.

That is, when the control unit (100) determines that the user is taking a picture of the first image (I1) while it is being output, it causes the display unit (500) to switch to the second image (I2) and output it, thereby preventing leakage of personal information (P1).

The above device (10) enables the control unit (100) to automatically generate learning data through machine learning so as to more accurately determine whether the user is taking a photo.

Accordingly, the control unit (100) can more accurately determine whether the user has taken a photo by comparing the generated learning data with the image information.

Furthermore, the control unit (100) gives priority to images of specific items, i.e., images including a smartphone or a tripod, based on the image information, over images of specific items or images including specific parts of the body, so as to enable a more detailed judgment on whether to film the user's personal information (PI).

In addition, if the control unit (100) determines that the user is taking the first image (I1) based on the image information, it controls the storage of the image in the memory unit (300), and the stored image can also be utilized as learning data.

At this time, the control unit (100) performs outline processing, brightness processing, etc. on the image determined to be the first image (I1) to relatively reduce the capacity so that it can be stored in the memory unit (300).

However, although the device (10) is described as having the control unit (100) automatically generate learning data through machine learning and more accurately determine whether the user is taking a picture by comparing the data with image information, the device (10) may also be configured to receive learning data from an external storage device such as a USB and have the control unit (100) determine whether the user is taking a picture by comparing the data with image information.

Meanwhile, the control unit (100) can control the first image (I1) to be output (step S240) when the second condition, which is a pre-determined condition, is satisfied based on the acquired image information while the second image (I2) is output (step S250).

More specifically, the second condition may mean a condition in which the acquired image information does not include an image of a specific item or a specific part of the body.

To explain this in more detail, the second image (I2) is an image of information that does not include personal information (PI), and the device (10) controls the power of the camera unit (400) from OFF to ON at or before the output ends based on the output time of the second image (I2), thereby enabling the control unit (100) to obtain image information from the camera unit (400).

Accordingly, the control unit (100) determines whether the user is taking pictures based on the acquired image information, and if it is determined that the user is not taking pictures, it controls the first image (I1) including personal information (PI) to be output on the display unit (500) at the time when the output of the second image (I2) ends.

That is, when the second image (I2) is output on the display unit (500), if the control unit (100) determines that the user is not taking pictures based on the image information, the control unit (100) controls the first image (I1) including personal information (PI) to be output on the display unit (500) after the output of the second image (I2).

In addition, when the control unit (100) determines that the user is taking a picture while the first image (I1) is output on the display unit (500), it can control the output of the second image (I2) and compensate for the output time of the first image (I1).

For example, as can be seen in (c) of Fig. 6, at point T1, the control unit (100) determines that the user is taking a picture and can control the second image (I2) to be output on the display unit (500).

In addition, the control unit (100) can control the power of the camera unit (400) from OFF to ON at time T3 to obtain image information from the camera unit (400), and if it is determined based on the obtained image information that the user is not performing shooting, the control unit can control the image switching after allowing the first image (I1) to be output for the remaining output time of the first image (I1).

For example, if the output time of the first image (I1) and the second image (I2) is 5 minutes, and the control unit (100) determines that the user is taking a picture when the output time of 3 minutes has elapsed, it can control the image switching so that the first image (I1) is output for the remaining 2 minutes after the output of the second image (I2).

That is, when the first image (I1), which is a screen including personal information, is output, the device (10) can determine whether the user is being photographed based on the user's image information and take action accordingly, thereby minimizing the leakage of personal information (PI) output on the display unit (500).

Although the configuration and features of the present invention have been described above based on embodiments according to the present invention, the present invention is not limited thereto, and it will be apparent to those skilled in the art that various changes or modifications can be made within the spirit and scope of the present invention, and therefore it is made clear that such changes or modifications fall within the scope of the appended patent claims.

10: Anti-screen capture device for privacy protection
100: Control Unit
200: Communication Department
300: Memory section
400: Camera section
500: Display section
I1: 1st image, I2: 2nd image, I3: 3rd image
PI: Personal Information, W: Warning Image

Claims (7)

In a device to prevent display screen capture for privacy protection,
A display unit that outputs a first image containing personal information and a second image not containing personal information;
A camera unit mounted at a predetermined location on the display unit and generating image information, which is information about the external situation of the display unit within the shooting range; and
A control unit that controls the display unit and the camera unit based on at least one of the image output on the display unit or the image information;
The above first image and the above second image,
It is output on the display unit for a preset period of time,
The above control unit,
Based on the above image information, if the first image is output and satisfies the first condition, which is a pre-determined condition,
Controlling the above display unit to output the second image,
The first condition above is,
For the acquired image information, a condition that includes at least one of an image of a specific item and a specific part of the body,
Display screen capture prevention device for privacy protection.
In the first paragraph,
The above control unit,
When the first image is output on the above display unit,
Keep the power of the above camera unit turned ON,
When the second image is output on the above display section,
Controlling the power of the above camera unit from ON to OFF,
Display screen capture prevention device for privacy protection.
In the first paragraph,
The above control unit,
If the image information cannot be obtained from the above camera unit,
Controlling so that the second image is output on the display unit,
Display screen capture prevention device for privacy protection.
delete delete In the first paragraph,
The above control unit,
In the state where the second image is output, if the second condition, which is a pre-determined condition, is satisfied based on the acquired image information,
Controlling so that the first image above is output,
Display screen capture prevention device for privacy protection.
In Article 6,
The second condition above is,
Regarding the acquired image information, the condition is that the image of a specific item and a specific part of the body are not included.
Display screen capture prevention device for privacy protection.