JP2013214180A - Display device - Google Patents

Abstract

In a table type display device, an object placed on a table and a user operation can be easily distinguished and detected.
In a table-type display device having a display panel, a user operation detection sensor for detecting a user operation is integrated with the display panel, and an object placed on the display panel is also provided. The display panel 11 is provided with an optical sensor used for the object detection process for detecting the image.
[Selection] Figure 1

Description

  The present invention relates to a display device, and more particularly to a table type display device.

  A display device having a display panel such as a liquid crystal panel or an organic EL (electroluminescence) panel is generally arranged so that the display panel is vertical, but a table arranged so that the display panel is horizontal. A type of device has also been developed.

  Patent Document 1 discloses a display device attached to a table, in which a display panel in which a transparent pressure-sensitive touch panel is laid is provided on a frame portion supported horizontally by legs. ing. In this display device, a user operation is detected by the pressure sensitive touch panel.

  Patent Document 2 discloses a table-type display device in which the surface of a desk on which a work is performed is used as a display screen, in which a shield placed on the surface of the desk and a window in the display screen do not overlap. Is disclosed. In this display device, a camera sensor is used to recognize an object on the table, and when the object is recognized, a window in the display screen is displayed so as not to overlap the object.

  FIG. 1 is a flowchart for explaining object detection processing and user operation detection processing in such a conventional table-type display device. A case where object detection processing and user operation detection processing are performed using the display device described in Patent Literature 2 will be described. First, when a sensor output is generated (step S1), the sensor output is observed for several frames (step S2), and it is determined whether or not the object is moving (step S3). If it is not moving (NO in step S3), it is recognized as an object (step S4), and the output area output as the object is recognized is set as a non-display area (step S5). On the other hand, if it is moving (YES in step S3), a command based on the motion is determined (step S6), and processing corresponding to the command determined (recognized) is executed (step S7).

  As a technique for providing a sensor in a display device, Patent Document 3 discloses a technique in which an optical sensor is built in a liquid crystal panel and an image is read by the optical sensor.

Japanese Patent Laid-Open No. 9-6298 JP 2004-77516 A JP 2006-343713 A

  However, the display device described in Patent Document 1 can detect a user operation with a pressure-sensitive touch panel, but cannot distinguish between an object placed on a table and a user operation.

  Further, in the display device described in Patent Document 2, such distinction is possible, but since the object is recognized using the camera sensor, the camera sensor is positioned above the table surface so that the entire table can be copied. There is a restriction on installation. In addition, when the camera device is installed by searching for a place such as a wall or a ceiling where the display device main body can shoot, the display device cannot thereafter move the arrangement of the camera sensor and the table type display device. In addition, this display device requires a cable or a wireless communication circuit for transmitting information from the camera sensor to the display device body, and a cable for supplying power to the camera sensor. Further, in this display device, when the display device body and the camera sensor are to be integrated, a mounting member such as a support is required to fix the camera sensor to the display device body, and such a mounting member is used. It gets in the way. In addition, in this display device, processing such as steps S2 to S4 described above is required.

  Note that the display device described in Patent Document 3 does not consider application to a table-type display device, and cannot distinguish between an object placed on a table and a user operation.

  The present invention has been made in view of the above circumstances, and its purpose is to easily distinguish and detect an object placed on a table and a user operation in a table-type display device. There is in making it possible.

  In order to solve the above problems, a first technical means of the present invention is a table-type display device provided with a display panel, wherein a user operation detection sensor for detecting a user operation is provided integrally with the display panel, Furthermore, an optical sensor used for an object detection process for detecting an object placed on the display panel is provided integrally with the display panel.

  According to a second technical means of the present invention, in the first technical means, the object detection processing is performed by subtracting the output of the user operation detection sensor from the output of the optical sensor.

  According to a third technical means of the present invention, in the first technical means, the object detection processing detects a region where the output of the optical sensor is darker than a predetermined value as a region where the object is placed. It is characterized by doing.

  According to a fourth technical means of the present invention, in any one of the first to third technical means, the user operation is detected from a logical sum of the output of the optical sensor and the output of the user operation detection sensor. It is characterized by.

  According to a fifth technical means of the present invention, in any one of the first to fourth technical means, the user operation detection sensor is a sheet-like electrostatic sensing sensor.

  According to a sixth technical means of the present invention, in any one of the first to fifth technical means, the user operation detection sensor and / or the optical sensor detects a fingerprint or palm print, and the detected fingerprint or palm print is detected. It is characterized by further comprising a user authentication unit for performing user authentication.

  A seventh technical means of the present invention is characterized in that, in any one of the first to sixth technical means, a region where an object is detected in the object detection processing is a non-display region.

  According to an eighth technical means of the present invention, in any one of the first to seventh technical means, the output of the optical sensor is divided into a plurality of divided areas, which are areas obtained by dividing the display area of the display device. Accordingly, the brightness of the display device is controlled according to the above.

  According to the present invention, in a table-type display device, it is possible to easily distinguish and detect an object placed on a table and a user operation.

It is a flowchart for demonstrating the object detection process and user operation detection process in the conventional table type display apparatus. It is the schematic which shows an example of the table type display apparatus which concerns on this invention. It is a flowchart for demonstrating an example of the object detection process and user operation detection process in the table type display apparatus which concerns on this invention. It is a schematic diagram for demonstrating the light transmission in the table type display apparatus which concerns on this invention. It is a figure for demonstrating an example of the circuit of the optical sensor integrated in the table type display apparatus which concerns on this invention. It is the schematic for demonstrating the process example in the table type display apparatus which concerns on this invention. It is the schematic for demonstrating the other process example in the table type display apparatus which concerns on this invention.

  FIG. 2 is a schematic view showing an example of a table type display device according to the present invention. Here, FIG. 2A is a diagram illustrating a state where an object is placed on the display device and a user operates with a finger, and FIG. 2B is a user operation detection sensor and object recognition light in the display device. It is a figure which shows an example of the detection result of a sensor.

  As illustrated in FIG. 2A, the display device 1 according to the present invention is a table-type (top plate type) display device, and has a leg portion and a frame or a top plate that supports a display panel such as the liquid crystal panel 11. The housing | casing 10 which has these. In this display device 1, an object O can be placed as exemplified by a cup, and a user operation with a user's finger F, a touch pen, or the like is also possible. User operations include various touch operations such as window designation, area designation, enlargement, reduction, and character input. Hereinafter, the liquid crystal panel 11 will be described as an example of the display panel included in the display device 1, but various display methods such as an organic EL panel can be applied.

  And as one of the main characteristics of this invention, the display apparatus 1 has provided the user operation detection sensor which detects said user operation integrally with the liquid crystal panel 11. As shown in FIG. Examples of the user operation detection sensor include a sheet-like electrostatic sensing sensor (capacitance type electrostatic sensor), that is, an electrostatic sensing sensor sheet (hereinafter, electrostatic sensor sheet) 12. The electrostatic sensor sheet 12 can be integrated and installed by being affixed on the liquid crystal panel 11, and is low cost because it is versatile.

  Hereinafter, the electrostatic sensor sheet 12 will be described as a preferable example of the user operation detection sensor. However, the user operation detection sensor is not limited to this, and may support multi-touch. A sensor of a system type or a resistance film type may be used. If multi-touch is supported, a user operation can be detected even when an object is placed.

  Furthermore, as one of the main features of the present invention, the display device 1 includes an optical sensor (object recognition optical sensor) used for object detection processing for detecting an object placed on the liquid crystal panel 11. Integrated. 2A and 2B show a state in which the optical sensor is built in the liquid crystal panel 11, the optical sensor is attached between the electrostatic sensor sheet 12 and the liquid crystal panel 11 as an optical sensor sheet. May be.

  The optical sensor described above is a sensor that detects brightness, and can be provided integrally with the liquid crystal panel 11 as described in Patent Document 3, for example. For example, in a liquid crystal panel, a photosensor can be embedded using a TFT (Thin Film Transistor) that can be manufactured in the same process as a pixel switch. An optical sensor can be embedded in an organic EL panel in the same manner. In addition, the optical sensor may be provided for each pixel or each of a plurality of pixels constituting the display screen.

  Next, referring to FIGS. 2B and 3, when an object is placed on the display device 1 (that is, on the table), the area is set as a non-display area, and the operation is performed with a gesture drawn with a finger. Will be described. FIG. 3 is a flowchart for explaining an example of object detection processing and user operation detection processing in the table-type display device according to the present invention.

  First, detection is performed independently by the optical sensor and the electrostatic sensor of the electrostatic sensor sheet 12 (steps S11 and S12). The output of the optical sensor generated in step S11 and the output of the electrostatic sensor generated in step S12 are input, and the latter is subtracted from the former (step S13). In the example of FIG. 2B, the former is an output indicated by Fs (of course, this line Fs is not detected at once, but is detected according to the operation speed of the user), and the latter is Fo and O. The output will be as follows.

  Then, the output area of the subtracted value, that is, the area where the subtracted value exists (area indicated by O) is set as a non-display area (non-display area) (step S14). The area where the subtracted value exists is not directly used as the non-display area, but the area where the subtracted value exceeds the predetermined value may be set as the non-display area.

  Although an image such as a document file is not displayed in the non-display area, the background image may be displayed as it is. In addition, when an object is moved from a state where it is not placed and an image such as a document file is already displayed in the placed area, the image is moved so as to avoid the object. You can do it.

  On the other hand, the output of the electrostatic sensor generated in step S12 is also used for detecting a user operation. That is, a command based on movement is determined for the output of the electrostatic sensor (step S15), and a process corresponding to the command determined (recognized) is executed (step S16). In the process of FIG. 3, steps S <b> 2 to S <b> 4 of FIG. 1 necessary for the display device described in Patent Document 2 are not necessary. Therefore, in the process of FIG. 3, the processing amount and the processing program amount can be reduced compared to the process of FIG. 1, and the load on a control unit such as a CPU (Central Processing Unit) that controls the entire display device 1 is reduced. Can be reduced.

  As described above, the object detection process is preferably performed by subtracting the output (detection result) of the electrostatic sensor from the output (detection result) of the optical sensor. Then, the output of the electrostatic sensor is used for the detection process of the user operation, and the area where the output has been detected may be detected as the area operated by the user. That is, an area where the difference between the output of the optical sensor and the output of the electrostatic sensor exists is identified as an area where a stationary object (object) exists, and the output of the electrostatic sensor is identified as an input for a user operation.

  However, the user operation may be detected from the logical sum of the output (detection result) of the optical sensor and the output of the electrostatic sensor. By recognizing such a region where the logical sum is effective as a region operated by the user, erroneous detection by the electrostatic sensor can be prevented.

  In addition, the object detection process can use only the output of the optical sensor instead of using the difference as described above. In this case, in the object detection process, a region where the output of the optical sensor is darker than a predetermined value may be detected as a region where the object is placed. For example, an AD converter is provided for the output of the optical sensor, the value of the sensor output is digitally recognized, and an area darker than a predetermined value is detected as an area of an object placed on the display device 1. That's fine. In this case, the output of the electrostatic sensor may be used for the detection process of the user operation, and the area where the output is performed may be detected as the area operated by the user.

  As described above, the liquid crystal panel 11 is provided with the light sensor for object recognition and the electrostatic sensor for user operation detection, and adopts different processing depending on whether the user operation is detected or the object is detected. Thus, it is possible to easily distinguish and detect an object placed on the table and a user operation, and it is possible to prevent an object from being erroneously recognized as a user operation and malfunctioning. Further, in the display device 1 according to the present invention, a sensor for object authentication is built in the table body, and it is not necessary to install the sensor at a position away from the table as in the camera described in Patent Document 2. There is no restriction on the installation location, and it is excellent in portability.

Next, installation of an optical sensor and an example of a circuit will be described with reference to FIGS.
FIG. 4 is a schematic view for explaining light transmission in the table type display device according to the present invention. Here, FIG. 4A is a diagram showing a state of light transmission when the optical sensor is built in the liquid crystal display panel, and FIG. 4B is a light transmission when the optical sensor sheet is attached to the liquid crystal display panel. FIG.

  As shown in FIG. 4A, when the optical sensor is built in the liquid crystal panel 11 and the electrostatic sensor sheet 12 is attached thereon, the light emitted from the backlight 13 is embedded in the optical sensor. The liquid crystal panel 11 and the electrostatic sensor sheet 12 are transmitted and visually recognized by the user. On the other hand, as shown in FIG. 4B, when the optical sensor sheet 11b is attached on the liquid crystal panel 11a and the electrostatic sensor sheet 12 is further attached thereon, the light is irradiated from the backlight 13. The light passes through the liquid crystal panel 11a, the optical sensor sheet 11b, and the electrostatic sensor sheet 12, and is visually recognized by the user.

  Therefore, the configuration of FIG. 4A can reduce the number of sensor sheets passing through the configuration of FIG. 4B, and the attenuation due to the transmission of the light irradiated from the backlight 13 is reduced accordingly. In order to obtain the same brightness, the brightness of the backlight 13 can be reduced, and the power consumption is reduced. Further, by adopting a high-definition panel such as 4K2K as the liquid crystal panel 11, the resolution of the photosensor attached to the pixels can be increased.

  FIG. 5 is a diagram for explaining an example of a circuit of an optical sensor incorporated in the table type display device according to the present invention. Here, FIG. 5A is a circuit diagram illustrating an example of an optical sensor, and FIG. 5B is a diagram illustrating a timing chart in the circuit of FIG.

  For example, as shown in FIG. 5A, the optical sensor circuit includes a diode for detecting light (photosensor, photodiode), a capacitor for accumulating charges output from the diode, and a current corresponding to the capacitance of the capacitor. A transistor for flowing is provided.

  The driving of this circuit will be described with reference to FIG. 5B. First, as shown by <I>, Vrst is set to high (for example, −6 [V]), and Net_A is reset (Net_A is set to −6). [V] and AMP_Tr is turned OFF). Next, as shown in <II>, Vrst is set to Low (for example, −16 [V]), and the diode (photosensor) is reverse-biased. Here, as indicated by <III>, since the light hits the diode, a difference occurs in the current passing through the diode, and a difference occurs in the Net_A potential between the dark part and the bright part.

  As indicated by <IV>, after such a state, after a certain charge time (for example, after 16.7 msec), Vs is set to high (for example, 0 [V] → 15 [V]), and Vrw is set to high (for example, − 16 [V] → 24 [V]). As a result, Net_A is raised to a positive potential by the capacitive coupling of Cst while maintaining the potential difference between the light and dark portions. Then, as indicated by <V>, AMP_Tr is output according to the potential of Net_A in the light and dark part.

  Next, an application example of processing in a configuration in which the display panel is a non-self-luminous display panel such as a liquid crystal panel and the display device includes a backlight that irradiates the display panel from the back will be described with reference to FIG. To do. FIG. 6 is a schematic diagram for explaining an example of processing in the table type display device according to the present invention.

  As shown in FIG. 6, a user's shadow S may be placed on the surface of the display device 1, and the display device 1 needs to be distinguished from an object such as a document D or a cup. Such a distinction is possible if the difference is taken as in the processing example in FIG. 3, and also when detecting the object only with the optical sensor, the shadow S is identified as the object by raising the detection threshold. There is no need to detect it.

  However, since the appearance of the display image to the user differs between the area where the shadow S exists and the area where the shadow S does not exist, the light sensor recognizes how the light on the table is touched (shadow, electric light, outside light) for each divided area, It is preferable to control the light emission luminance of the backlight according to the brightness on the display panel. Here, the divided area is an area obtained by dividing the backlight into a plurality of areas. In particular, in the case of a backlight using an LED (Light Emitting Diode), this divided area can be set in detail.

  Moreover, although the example which adjusted the brightness | luminance (light emission luminance) of the backlight corresponding to a division area was given about the non-self-light-emitting display panel, also when a display panel is a self-light-emitting display panel, display apparatus Can control the brightness.

  More specifically, how the light on the table strikes (shadow, electric light, outside light) is recognized for each divided region by the optical sensor, and the luminance in the display device is controlled according to the brightness on the display device. Here, since the self-luminous display panel is described, this luminance control is the display luminance in the display panel. For example, the luminance control signal of the pixels in the divided area may be adjusted based on the signal from the optical sensor to adjust the light emission luminance of itself. Here, the divided area is an area for controlling the luminance control to be the same, and the display area of the display device (that is, the display area of the display panel) is divided into a plurality of control areas. In addition, although it can ultimately be divided for each pixel, the present invention is not limited to the number of divided areas and the shape.

  By the brightness control as described above, it is possible to control the display panel so that it can be easily seen in accordance with light and dark on the display panel regardless of whether the display panel is self-luminous or non-self-luminous. Control of the brightness of the display device according to the output of the optical sensor includes, for example, (i) whether the output of the optical sensor falls within the range corresponding to the shadow, or (ii) the range where the lamp is hit The brightness may be controlled for each divided region according to whether the output is within the range in which external light is applied (iii). In order to make it easy for the user to visually recognize, it is necessary to suppress the luminance most in the case (i) and to increase the luminance most in the case (iii).

  Further, when it is detected that an object is placed on the display panel by recognizing the object on the display panel (document D in this example), the brightness of the detected area is set to zero. By reducing it to some extent, power consumption can be reduced. In addition to the detected area, it is preferable to reduce the brightness to zero or to some extent not only the area that cannot be seen by the user due to the placement of the object. In such a configuration, it is necessary to detect the position of the user in order to detect an area invisible to the user. However, the detection of the shadow S as described above may be used, and in order to grasp more accurately. Alternatively, a plurality of user detection sensors may be provided on the frame of the display device.

  Thus, it is preferable that the display device controls the luminance of the display device in accordance with the output of the optical sensor (that is, in accordance with the detected brightness distribution) for each divided region of the display region. In particular, in a region where an object is detected in the object detection process, if the display panel is a non-self-luminous display panel, the illumination by the backlight is stopped or the luminance of the backlight is reduced compared to the region where it is not detected. Is preferred. Even in the case of a self-luminous display panel, it is preferable to adjust the luminance control signal of the pixels in the region to zero or to reduce the luminance to some extent.

  Next, an application example of processing in a display device applicable regardless of whether the display panel is a non-self-luminous type or a self-luminous type will be described with reference to FIG. FIG. 7 is a schematic view for explaining another processing example in the table type display device according to the present invention.

  The display device 1 preferably includes a user authentication unit. The user authentication unit detects the fingerprint of the user's finger F or the palm print of the hand with the electrostatic sensor sheet 12 and / or the optical sensor, and uses the detected fingerprint or palm print, that is, the detected fingerprint or palm print and the display device. User authentication is performed by collating with fingerprint (palmprint) information (pattern) stored in advance in one built-in memory. As described above, in the display device 1, it is preferable that the electrostatic sensor sheet 12 and / or the optical sensor perform control such as reading a fingerprint or a palm print. The fingerprint or palm print may be read by scanning a predetermined area Afp or an area designated by the user, and it is automatically determined whether or not the fingerprint or palm print is in the shape of a fingerprint or palm print. You may read by scanning the area | region determined to be a hand.

  Note that the fingerprint or palm print information used for authentication need not be stored in the built-in memory of the display device 1, but may be stored in an authentication server device or the like if connected to a network. In any case, the user authentication unit may acquire this information from the storage destination and perform user authentication. Of course, the display device 1 may simply send the read fingerprint or palm print to the server device for authentication and receive the authentication result.

  Although an example of scanning a fingerprint or a palm print has been described, an image described in the document D can be optically read (scanned) by adopting a similar method. That is, the document D may be read by scanning a predesignated area Ad or an area designated by the user, whether the document D has a shape of a document or a drawing (for example, a rectangle, It may be read by automatically determining whether or not it is a rectangle of a predetermined size such as A4 and scanning the area Ad determined to be a document or drawing. Of course, the user places the document so that the surface of the document matches the surface of the display device 1.

  The display device according to the present invention has been described above. A control unit that controls the entire display device includes a CPU, a RAM (Random Access Memory) as a work area, and a ROM (Read Only Memory) that records a program for causing the CPU to execute the processing according to the present invention described above. ) And the like. Here, the process according to the present invention corresponds to, for example, a user operation detection process or an object detection process. Further, an image display process according to a user operation, information processing such as file rewriting or deletion, and the above-described user authentication process Various processes such as a process for controlling backlight emission luminance may be added.

DESCRIPTION OF SYMBOLS 1 ... Display apparatus, 10 ... Housing | casing, 11, 11a ... Liquid crystal panel, 11b ... Optical sensor sheet | seat,
12 ... Electrostatic sensor sheet, 13 ... Backlight.

Claims (8)

In a table type display device provided with a display panel,
A user operation detection sensor for detecting a user operation is provided integrally with the display panel, and an optical sensor used for object detection processing for detecting an object placed on the display panel is integrated with the display panel. A display device provided.   The display device according to claim 1, wherein the object detection process is performed by subtracting an output of the user operation detection sensor from an output of the optical sensor.   The display device according to claim 1, wherein the object detection processing detects a region where an output of the optical sensor is darker than a predetermined value as a region where an object is placed.   The display device according to claim 1, wherein the user operation is detected from a logical sum of an output of the optical sensor and an output of the user operation detection sensor.   The display device according to claim 1, wherein the user operation detection sensor is a sheet-like electrostatic detection sensor.   The user operation detection sensor and / or the optical sensor further includes a user authentication unit that detects a fingerprint or a palm print, and performs user authentication using the detected fingerprint or palm print. The display device according to any one of the above.   The display device according to claim 1, wherein a region in which an object is detected by the object detection processing is set as a non-display region.   The luminance of the display device is controlled according to the output of the photosensor for each divided region, which is a region obtained by dividing the display region of the display device into a plurality of regions. Item 1. A display device according to item 1.

Images