JP2010140410A - Mobile apparatus and method of controlling the same - Google Patents

Abstract

An object of the present invention is to realize a portable device that can read an object without erroneous input and is excellent in convenience and stability for a user.
The present invention relates to data in which a sensor built-in liquid crystal panel 301 having a housing that can be folded in half and capable of inputting a nearby image is provided on both the front and back surfaces of the housing in a folded state. In the display / sensor device 100, based on the posture information acquired by the posture information acquisition unit 810 when the posture information acquisition unit 810 that acquires posture information indicating the posture of the housing and the gravity direction is the downward direction, Of the two sensor-incorporated liquid crystal panels 301 in a folded state, the specifying unit 820 for specifying the sensor-incorporating liquid crystal panel 301 located on the lower side, and the lower sensor-incorporating liquid crystal panel specified by the specifying unit 820 301, an input invalidation unit 830 that invalidates the function of inputting a nearby image.
[Selection] Figure 1

Description

  The present invention relates to a portable device capable of inputting an image of an object and a method for controlling the device.

  2. Description of the Related Art Conventionally, an input device (portable device) in which an input unit for inputting data is provided on at least one of a front surface and a back surface is known.

  Patent Document 1 includes a double-sided electronic device main body having a plurality of keys and display units for displaying information input by key operation on both front and back surfaces, and a notebook-type case for storing the same. A double-sided electronic device is disclosed. The double-sided electronic device detects which side is facing upward due to light shielding when the double-sided keyboard is stored in a notebook-type case, thereby disabling input from the keyboard on the back side. It is said. The double-sided electronic device disables input from the keyboard on the back side by the above method, and prevents erroneous input from the keyboard on the back side.

  Patent Document 2 has a housing that can be folded in half, and includes an input unit that performs data input operation on one inner surface facing the display, and a display unit that displays input information on the other inner surface The input unit and the display unit are rotatable by a hinge mechanism and can be folded back into two. The input device can detect whether or not the input device is folded in half according to the hinge angle. If the input device is folded in half, the input to the keyboard becomes invalid, and the input from the keyboard becomes invalid. Incorrect input is prevented.

Patent Document 3 describes a double-sided keyboard that doubles as a foot for installation and is provided with a switch that determines whether the surface is valid / invalid. Input is prevented.
JP 58-191060 A (publication date: November 8, 1983) JP 11-305921 A (publication date: November 5, 1999) JP 62-256015 A (publication date: November 7, 1987)

  However, the double-sided electronic device described in Patent Document 1 requires a notebook-type case that houses the double-sided electronic device main body in order to invalidate input from the back side keyboard. Therefore, when the notebook type case does not exist at hand, the input from the keyboard on the back side cannot be invalidated.

  Further, the input device described in Patent Document 2 is configured to invalidate input to the keyboard based on the hinge angle. Therefore, even when the input unit faces the user side (that is, the upper side), the user cannot input to the input unit depending on the hinge angle. In that case, data input operation is impossible unless the hinge angle is changed, and the convenience as an input device is extremely low for the user.

  Furthermore, in the double-sided keyboard described in Patent Document 3, in order to invalidate the input from the back side keyboard, it is necessary to provide a switch for determining whether the surface is valid or invalid on each side. Therefore, since it is necessary to provide a switch as a protrusion on each surface, the protrusion becomes a hindrance, and the operability of the double-sided keyboard is significantly reduced.

  Further, in each of the above-mentioned patent documents, a keyboard is used for input operations. Therefore, when the casing is installed on the desk in a folded state, the keyboard is likely to come into contact with the desk and cause damage to the keyboard.

  The present invention has been made in view of the above problems, and an object of the present invention is to realize a portable device excellent in operability and convenience for a user, and a method for controlling the device.

  In order to solve the above-described problem, the portable device according to the present invention has a housing that can be folded in half, and a planar member that can input an image in the vicinity of the front and back surfaces in a state in which the housing is folded. Each of the mobile devices disposed in the position information acquisition means for acquiring the posture information indicating the attitude of the housing, and the posture information acquired by the posture information acquisition means when the gravity direction is a downward direction. Of the two planar members in a state where the casing is folded based on the specifying means for specifying the lower side surface member located on the lower side, and the lower side surface member specified by the specifying means, And an input invalidating means for invalidating a function of inputting a neighboring image.

  In addition, in order to solve the above-described problem, the portable device control method according to the present invention includes a casing that can be folded in half, and a planar member that can input an image in the vicinity folds the casing. Control method for portable devices respectively disposed on both the front and back surfaces in a state where the posture information acquisition step for acquiring posture information indicating the posture of the housing and the posture information when the gravity direction is set to the downward direction Based on the posture information acquired by the acquisition step, the specifying step for specifying the lower side surface member located on the lower side of the two surface members in the state where the housing is folded back, and the specifying step An input invalidation step for invalidating the function of inputting an image in the vicinity of the identified lower side surface-shaped member.

  Thereby, in the portable device and the method for controlling the portable device according to the present invention, it is possible to invalidate the function of inputting an image in the vicinity of the lower side surface member that does not require the user to input an image, and as a result. Incorrect input from the lower side surface member can be prevented. And since the planar member located on the lower side can be easily specified by the posture information acquisition means and the specifying means, it is necessary to use another article such as a cover case in order to recognize the front and back of the apparatus as in the past. There is no. In addition, by providing the above-described configuration, it is not necessary to determine in advance the surface to be folded, and both the front and back surfaces can be used evenly.

  As described above, the portable device and the control method can be used in the state of being held in the hand without distinguishing between the front and the back of the device, and improve the operability and convenience of the device for the user. Can do.

  Furthermore, in the portable device according to the present invention, in the above configuration, the planar member may further display an image.

  According to said structure, the said planar member can not only input the image of the vicinity but can display an image.

  Therefore, the planar member can present information to the user of the portable device according to the present invention.

  Therefore, since the user can use the portable device according to the present invention while viewing the image displayed on the planar member, the operability and convenience of the device can be improved for the user. .

  Furthermore, the portable device according to the present invention may be configured to include image display control means for stopping image display on the lower side surface-shaped member in the above configuration.

  The image displayed by the lower side surface member cannot be visually recognized from the user. Therefore, the image display control means stops displaying the image on the lower side surface member, so that it is possible to reduce the power consumption of the device that is spent on displaying the image, and the portable device is more convenient for the user. Can be realized.

  Furthermore, in the portable device according to the present invention, in the above configuration, when the planar member positioned on the upper side of the two planar members is an upper lateral member, the image display control means is It is good also as a structure which displays the lower side image which should be displayed in the said lower side surface-like member on the said upper side surface-like member, after an image display is stopped in a shape-like member.

  In the portable device according to the present invention, in the above configuration, the upper side surface member displays the upper side image and the lower side image displayed by the upper side surface member side by side or superimposes each other. It is good also as a structure to display.

  The image displayed by the lower side surface member cannot be visually recognized by the user, but the lower side to be displayed on the lower side surface member after the image display control unit stops displaying the image on the lower side surface member. By displaying the image on the upper side surface member, the user can view the images displayed on the front surface and the back surface only with the upper side surface member. Furthermore, by displaying the two screens side by side or overlapping each other, a portable device that is more convenient for the user can be realized.

  Furthermore, in the portable device according to the present invention, in the above configuration, the posture information acquisition unit may be configured by a gyro sensor, an acceleration sensor, a strain sensor, or a mercury switch.

  In the portable device according to the present invention, the planar member includes a photodiode group that detects the amount of received light at each position on the planar member, and based on a change in the amount of received light detected by the photodiode group. It can be set as the structure which inputs the image of the said vicinity.

  As described above, the portable device according to the present invention includes the posture information acquisition unit that acquires the posture information indicating the posture of the casing, and the posture acquired by the posture information acquisition unit when the gravity direction is a downward direction. Based on the information, of the two planar members in the state where the casing is folded back, the specifying means for specifying the lower side surface member located on the lower side, and the lower side surface member specified by the specifying means And an input invalidating means for invalidating the function of inputting a nearby image.

  In addition, as described above, the method for controlling the portable device according to the present invention includes a posture information acquisition step for acquiring posture information indicating the posture of the casing, and the posture information acquisition step when the gravity direction is a downward direction. Of the two planar members in the state where the casing is folded back based on the posture information acquired by the identification step, and the identification step is identified by the identifying step and the identifying step. And an input invalidation step for invalidating the function of inputting a nearby image of the lower side surface member.

  Therefore, in the portable device and the method for controlling the portable device, the function of inputting an image in the vicinity of the lower side surface member that does not require the user to input an image can be invalidated. An erroneous input from a member can be prevented, and the device can be used in a hand-held state without distinction of the front and back sides of the device, thereby improving user operability and convenience.

  An embodiment of the present invention will be described below with reference to FIGS.

  The data display / sensor device 100 (portable device) according to the present embodiment has a housing that can be folded in half, detects a nearby image, and inputs the image into the sensor built-in liquid crystal panel 301 ( Planar members) are disposed on both the front and back surfaces in a state where the casing is folded. The data display / sensor device 100 includes a posture information acquisition unit 810 (posture information acquisition unit) that acquires posture information indicating the posture of the casing, and a posture information acquisition unit 810 when the gravity direction is a downward direction. Based on the acquired posture information, in the state where the data display / sensor device 100 is folded, the sensor-equipped liquid crystal panel 301 (lower side surface member) located on the lower side of the two sensor-equipped liquid crystal panels 301 is specified. Unit 820 (identifying means). Furthermore, the data display / sensor device 100 includes an input invalidation unit 830 (input invalidation means), and invalidates the function of inputting an image in the vicinity of the lower sensor-equipped liquid crystal panel 301 identified by the identification unit 820. be able to.

  First, an outline of the sensor built-in liquid crystal panel 301 included in the data display / sensor device 100 will be described below.

(Outline of LCD panel with built-in sensor)
The sensor built-in liquid crystal panel 301 provided in the data display / sensor device 100 is a liquid crystal panel capable of detecting an image of an object in addition to displaying data. Here, the image detection of the object is, for example, detection of a position pointed (touched) by the user with a finger or a pen, or reading (scanning) of an image of a printed material. The device used for display is not limited to a liquid crystal panel, and may be an organic EL (Electro Luminescence) panel or the like.

  The structure of the sensor built-in liquid crystal panel 301 will be described with reference to FIG. FIG. 2 is a diagram schematically showing a cross section of the sensor built-in liquid crystal panel 301. The sensor built-in liquid crystal panel 301 described here is an example, and any structure can be used as long as the display surface and the reading surface are shared.

  As shown in the figure, the sensor built-in liquid crystal panel 301 includes an active matrix substrate 51A disposed on the back surface side and a counter substrate 51B disposed on the front surface side, and has a structure in which a liquid crystal layer 52 is sandwiched between these substrates. is doing. The active matrix substrate 51A is provided with a pixel electrode 56, a data signal line 57, an optical sensor circuit 32 (not shown), an alignment film 58, a polarizing plate 59, and the like. The counter substrate 51B is provided with color filters 53r (red), 53g (green), 53b (blue), a light shielding film 54, a counter electrode 55, an alignment film 58, a polarizing plate 59, and the like. In addition, a backlight 307 is provided on the back surface of the sensor built-in liquid crystal panel 301.

  The photodiode 6 included in the photosensor circuit 32 is provided in the vicinity of the pixel electrode 56 provided with the blue color filter 53b, but is not limited to this configuration. It may be provided in the vicinity of the pixel electrode 56 provided with the red color filter 53r, or may be provided in the vicinity of the pixel electrode 56 provided with the green color filter 53g.

  Next, with reference to FIGS. 3A and 3B, two types of methods for detecting the position where the user touches the sensor built-in liquid crystal panel 301 with a finger or a pen will be described.

  FIG. 3A is a schematic diagram illustrating a state in which a position touched by the user is detected by detecting a reflected image. When the light 63 is emitted from the backlight 307, the optical sensor circuit 32 including the photodiode 6 detects the light 63 reflected by the object 64 such as a finger. Thereby, the reflected image of the target object 64 can be detected. Thus, the sensor built-in liquid crystal panel 301 can detect the touched position by detecting the reflected image.

  FIG. 3B is a schematic diagram illustrating a state in which a position touched by the user is detected by detecting a shadow image. As shown in FIG. 3B, the optical sensor circuit 32 including the photodiode 6 detects external light 61 transmitted through the counter substrate 51B and the like. However, when there is an object 62 such as a pen, the incident of the external light 61 is hindered, so that the amount of light detected by the optical sensor circuit 32 is reduced. Thereby, a shadow image of the object 62 can be detected. Thus, the sensor built-in liquid crystal panel 301 can also detect a touched position by detecting a shadow image.

  As described above, the photodiode 6 may detect reflected light (shadow image) of the light emitted from the backlight 307 or may detect a shadow image caused by external light. Further, the two types of detection methods may be used in combination to detect both a shadow image and a reflected image at the same time.

(Data display / sensor configuration)
Next, with reference to FIG. 4, the configuration of the main part of the data display / sensor device 100 will be described. FIG. 4 is a block diagram showing a main configuration of the data display / sensor device 100. As shown in FIG. As illustrated, the data display / sensor device 100 includes one or more display / light sensor units 300, a circuit control unit 600, a data processing unit 700, a main control unit 800, a storage unit 901, a primary storage unit 902, and an operation unit. 903, an external communication unit 907, an audio output unit 908, and an audio input unit 909. Here, the data display / sensor device 100 will be described as including two display / light sensor units 300 (first display / light sensor unit 300A and second display / light sensor unit 300B). When the first display / light sensor unit 300A and the second display / light sensor unit 300B are not distinguished, they are referred to as the display / light sensor unit 300.

  The display / light sensor unit 300 is a so-called liquid crystal display device with a built-in light sensor. The display / light sensor unit 300 includes a sensor built-in liquid crystal panel 301, a backlight 307, and a peripheral circuit 309 for driving them.

  The sensor built-in liquid crystal panel 301 includes a plurality of pixel circuits 31 and photosensor circuits 32 arranged in a matrix. The detailed configuration of the sensor built-in liquid crystal panel 301 will be described later.

  The peripheral circuit 309 includes a liquid crystal panel drive circuit 304, an optical sensor drive circuit 305, a signal conversion circuit 306, and a backlight drive circuit 308.

  The liquid crystal panel driving circuit 304 outputs a control signal (G) and a data signal (S) in accordance with the timing control signal (TC1) and the data signal (D) from the display control unit 601 of the circuit control unit 600, and the pixel circuit 31. It is a circuit which drives. Details of the driving method of the pixel circuit 31 will be described later.

  The optical sensor driving circuit 305 is a circuit that drives the optical sensor circuit 32 by applying a voltage to the signal line (R) in accordance with a timing control signal (TC2) from the sensor control unit 602 of the circuit control unit 600. Details of the driving method of the optical sensor circuit 32 will be described later.

  The signal conversion circuit 306 is a circuit that converts the sensor output signal (SS) output from the optical sensor circuit 32 into a digital signal (DS) and transmits the converted signal to the sensor control unit 602.

  The backlight 307 includes a plurality of white LEDs (Light Emitting Diodes) and is disposed on the back surface of the sensor built-in liquid crystal panel 301. When a power supply voltage is applied from the backlight drive circuit 308, the backlight 307 is turned on and irradiates the sensor built-in liquid crystal panel 301 with light. Note that the backlight 307 is not limited to white LEDs, and may include LEDs of other colors. The backlight 307 may include, for example, a cold cathode fluorescent lamp (CCFL) instead of the LED.

  The backlight driving circuit 308 applies a power supply voltage to the backlight 307 when the control signal (BK) from the backlight control unit 603 of the circuit control unit 600 is at a high level, and conversely, the backlight control unit 603. When the control signal from is at a low level, no power supply voltage is applied to the backlight 307.

  Next, the circuit control unit 600 will be described. The circuit control unit 600 has a function as a device driver that controls the peripheral circuit 309 of the display / light sensor unit 300. The circuit control unit 600 includes a display control unit 601, a sensor control unit 602, a backlight control unit 603, and a display data storage unit 604.

  The display control unit 601 receives display data from the display data processing unit 701 of the data processing unit 700, and performs timing control on the liquid crystal panel driving circuit 304 of the display / light sensor unit 300 in accordance with an instruction from the display data processing unit 701. A signal (TC1) and a data signal (D) are transmitted, and the received display data is displayed on the sensor built-in liquid crystal panel 301.

  The display control unit 601 temporarily stores the display data received from the display data processing unit 701 in the display data storage unit 604. Then, a data signal (D) is generated based on the primary stored display data. The display data storage unit 604 is, for example, a video random access memory (VRAM).

  The sensor control unit 602 transmits a timing control signal (TC2) to the optical sensor driving circuit 305 of the display / optical sensor unit 300 in accordance with an instruction from the sensor data processing unit 703 of the data processing unit 700, and the sensor built-in liquid crystal panel 301. Run the scan with.

  In addition, the sensor control unit 602 receives a digital signal (DS) from the signal conversion circuit 306. Then, image data is generated based on the digital signal (DS) corresponding to the sensor output signal (SS) output from all the optical sensor circuits 32 included in the sensor built-in liquid crystal panel 301. That is, the image data read in the entire reading area of the sensor built-in liquid crystal panel 301 is generated. Then, the generated image data is transmitted to the sensor data processing unit 703.

  The backlight control unit 603 transmits a control signal (BK) to the backlight drive circuit 308 of the display / light sensor unit 300 in accordance with instructions from the display data processing unit 701 and the sensor data processing unit 703 to drive the backlight 307. Let

  When the data display / sensor device 100 includes a plurality of display / light sensor units 300, the display control unit 601 determines which display / light sensor unit 300 displays the display data from the data processing unit 700. When an instruction is received, the liquid crystal panel drive circuit 304 of the display / light sensor unit 300 is controlled according to the instruction. When the sensor control unit 602 receives an instruction from the data processing unit 700 as to which display / light sensor unit 300 is to scan the object, The sensor drive circuit 305 is controlled and a digital signal (DS) is received from the signal conversion circuit 306 of the display / light sensor unit 300 according to the instruction.

  Next, the data processing unit 700 will be described. The data processing unit 700 has a function as middleware that gives an instruction to the circuit control unit 600 based on a “command” received from the main control unit 800. Details of the command will be described later.

  The data processing unit 700 includes a display data processing unit 701 and a sensor data processing unit 703. When the data processing unit 700 receives a command from the main control unit 800, at least one of the display data processing unit 701 and the sensor data processing unit 703 depends on the value of each field (described later) included in the received command. One works.

  The display data processing unit 701 receives display data from the main control unit 800, and gives instructions to the display control unit 601 and the backlight control unit 603 according to the command received by the data processing unit 700, and displays the received display data. The image is displayed on the sensor built-in liquid crystal panel 301. The operation of the display data processing unit 701 according to the command will be described later.

  The sensor data processing unit 703 gives an instruction to the sensor control unit 602 and the backlight control unit 603 according to the command received by the data processing unit 700.

  The sensor data processing unit 703 receives image data from the sensor control unit 602 and stores the image data in the image data buffer 704 as it is. Then, in accordance with the command received by the data processing unit 700, the sensor data processing unit 703 performs “whole image data”, “partial image data (partial image coordinate data) based on the image data stored in the image data buffer 704. At least one of “including coordinate data” and “coordinate data” is transmitted to the main control unit 800. The whole image data, partial image data, and coordinate data will be described later. The operation of the sensor data processing unit 703 according to the command will be described later.

  Next, the main control unit 800 executes an application program. The main control unit 800 reads the program stored in the storage unit 901 into a primary storage unit 902 configured by, for example, a RAM (Random Access Memory) and executes the program.

  An application program executed by the main control unit 800 causes the data processing unit 700 to display display data on the sensor built-in liquid crystal panel 301 or to scan an object on the sensor built-in liquid crystal panel 301. Send commands and display data. When “data type” is designated as a command, at least one of whole image data, partial image data, and coordinate data is received from the data processing unit 700 as a response to the command.

  The circuit control unit 600, the data processing unit 700, and the main control unit 800 can be configured by a CPU (Central Processing Unit), a memory, and the like, respectively. The data processing unit 700 may be configured by a circuit such as an ASIC (application specific integrate circuit).

  Next, the storage unit 901 stores programs and data executed by the main control unit 800 as shown in the figure. The program executed by the main control unit 800 may be separated into an application-specific program and a general-purpose program that can be shared by each application.

  Next, the operation unit 903 receives an input operation of the user of the data display / sensor device 100. The operation unit 903 includes input devices such as a switch, a remote controller, a mouse, and a keyboard, for example. Then, the operation unit 903 generates a control signal corresponding to the user's input operation of the data display / sensor device 100, and transmits the generated control signal to the main control unit 800.

  As an example of the switch, a hinge switch 904 that is provided at the hinge portion of the housing and detects the open / closed state of the housing, a power switch 905 that switches power on and off, and a predetermined function are assigned in advance. A hardware switch such as a user switch 906 is assumed.

  In addition, the data display / sensor device 100 includes an external communication unit 907 for communicating with an external device by wireless / wired communication, an audio output unit 908 such as a speaker for outputting audio, and a microphone for inputting an audio signal. A voice input unit 909 such as the above may be provided as appropriate.

(Command details)
Next, details of commands transmitted from the main control unit 800 to the data processing unit 700 will be described with reference to FIGS. 5 and 6. FIG. 5 is a diagram schematically illustrating an example of a command frame structure. FIG. 6 is a diagram for explaining an example of values that can be specified for each field included in the command and an outline thereof.

  As shown in FIG. 5, the commands are “header”, “data acquisition timing”, “data type”, “scan method”, “scan image gradation”, “scan resolution”, “scan panel”, “display panel”. "And" Reserve "fields. In each field, for example, values shown in FIG. 6 can be designated.

  The “header” field is a field indicating the start of a frame. As long as it is possible to identify the “header” field, the value of the “header” field may be any value.

  Next, the “data acquisition timing” field is a field for designating a timing at which data should be transmitted to the main control unit 800. In the “data acquisition timing” field, for example, values “00” (sense), “01” (event), and “10” (all) can be specified.

  Here, “sense” designates that the latest data is transmitted immediately. Therefore, when the sensor data processing unit 703 receives a command whose value in the “data acquisition timing” field is “sense”, the latest data specified in the “data type” field is immediately updated to the main control unit 800. Send to.

  The “event” designates transmission at a timing when a change occurs in the image data received from the sensor control unit 602. Therefore, when the sensor data processing unit 703 receives a command whose value in the “data acquisition timing” field is “event”, the image that receives the data specified in the “data type” field from the sensor control unit 602. The data is transmitted to the main control unit 800 at a timing when a change larger than a predetermined threshold occurs.

  “All” designates data transmission at a predetermined cycle. Therefore, when the sensor data processing unit 703 receives a command whose value in the “data acquisition timing” field is “all”, the data designated in the “data type” field is transferred to the main control unit 800 at a predetermined cycle. Send to. The predetermined period coincides with the period in which the optical sensor circuit 32 performs scanning.

  Next, the “data type” field is a field for designating the type of data acquired from the sensor data processing unit 703. In the “data type” field, for example, values of “001” (coordinates), “010” (partial image), and “100” (entire image) can be specified. Furthermore, by adding these values, “coordinates” and “partial image” / “whole image” can be specified simultaneously. For example, “011” can be specified when “coordinate” and “partial image” are specified at the same time, and “101” can be specified when “coordinate” and “whole image” are specified at the same time. it can.

  When the sensor data processing unit 703 receives a command whose value of the “data type” field is “whole image”, the sensor data processing unit 703 transmits the image data itself stored in the image data buffer 704 to the main control unit 800. The image data itself stored in the image data buffer 704 is referred to as “whole image data”.

  In addition, when the sensor data processing unit 703 receives a command whose value of the “data type” field is “partial image”, the sensor data processing unit 703 selects a portion where a change larger than a predetermined threshold has occurred from the image data received from the sensor control unit 602. A region to be included is extracted, and image data of the extracted region is transmitted to the main control unit 800. Here, the image data is referred to as “partial image data”. When a plurality of partial image data are extracted, the sensor data processing unit 703 transmits each extracted partial image data to the main control unit 800.

  Further, when the sensor data processing unit 703 receives a command whose value of the “data type” field is “partial image”, the sensor data processing unit 703 detects representative coordinates in the partial image data and indicates the position of the representative coordinates in the partial image data. The coordinate data is transmitted to the main control unit 800. The representative coordinates include, for example, the coordinates of the center of the partial image data, the coordinates of the center of gravity of the partial image data, and the like.

  Next, when receiving a command whose value of the “data type” field is “coordinate”, the sensor data processing unit 703 transmits coordinate data indicating the position of the representative coordinate in the entire image data to the main control unit 800. When a plurality of partial image data are extracted, the sensor data processing unit 703 detects representative coordinates in the entire image data of the extracted partial image data, and the coordinate data indicating the representative coordinates is detected. Each is transmitted to the main control unit 800 (multi-point detection).

  Specific examples of the whole image data, the partial image data, and the coordinate data will be described later with reference to schematic diagrams.

  Next, the “scan method” field is a field for designating whether or not the backlight 307 is turned on at the time of executing the scan. In the “scan method” field, for example, values of “00” (reflection), “01” (transmission), and “10” (reflection / transmission) can be designated.

  “Reflection” specifies that scanning is performed with the backlight 307 turned on. Therefore, when the sensor data processing unit 703 receives a command whose “scan method” field value is “reflection”, the sensor data processing unit 703 performs sensor control so that the optical sensor driving circuit 305 and the backlight driving circuit 308 operate in synchronization. An instruction is given to the unit 602 and the backlight control unit 603.

  “Transmission” specifies that scanning is performed with the backlight 307 turned off. Therefore, when the sensor data processing unit 703 receives a command whose “scan method” field value is “transparent”, the sensor control unit 602 operates the optical sensor driving circuit 305 and does not operate the backlight driving circuit 308. Instructions to the backlight control unit 603. Note that “reflection / transmission” specifies that scanning is performed using both “reflection” and “transmission”.

  Next, the “scanned image gradation” field is a field for designating gradations of the partial image data and the entire image data. In the “scanned image gradation” field, for example, values of “00” (binary) and “01” (multivalue) can be designated.

  When the sensor data processing unit 703 receives a command whose “scan image gradation” field value is “binary”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 as monochrome data. .

  When the sensor data processing unit 703 receives a command whose “scanned image gradation” field value is “multivalued”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 as multitone data. To do.

  Next, the “scan resolution” field is a field for designating the resolution of the partial image data and the entire image data. In the “scan resolution” field, for example, values of “0” (high) and “1” (low) can be designated.

  Here, “high” designates a high resolution. Therefore, when the sensor data processing unit 703 receives a command whose “scan resolution” field value is “high”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 with high resolution. For example, it is desirable to designate “high” for image data (image data such as a fingerprint) to be subjected to image processing such as image recognition.

  “Low” designates a low resolution. Therefore, when the sensor data processing unit 703 receives a command whose “scan resolution” field value is “low”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 at a low resolution. For example, it is desirable to designate “low” for image data (such as touched finger or hand image data) that only needs to be recognized.

  Next, the “scan panel” field is a field for designating which display / light sensor unit 300 is to scan the object. In the “scan panel” field, for example, values “001” (first display / light sensor unit 300A) and “010” (second display / light sensor unit 300B) can be designated. By adding these values, a plurality of display / light sensor units 300 can be specified at the same time. For example, when “first display / light sensor unit 300A” and “second display / light sensor unit 300B” are specified at the same time, “011” can be specified.

  When the sensor data processing unit 703 receives a command whose “scan panel” field value is “first display / photosensor unit 300A”, the sensor data processing unit 703 and the photosensor drive circuit 305 of the first display / photosensor unit 300A and An instruction is given to the sensor control unit 602 and the backlight control unit 603 so as to control the backlight drive circuit 308.

  Next, the “display panel” field is a field for designating which display / light sensor unit 300 displays the display data. In the “display panel” field, for example, values of “001” (first display / light sensor unit 300A) and “010” (second display / light sensor unit 300B) can be designated. By adding these values, a plurality of display / light sensor units 300 can be specified at the same time. For example, when “first display / light sensor unit 300A” and “second display / light sensor unit 300B” are specified at the same time, “011” can be specified.

  Here, for example, when the display data processing unit 701 receives a command whose value of the “display panel” field is “first display / light sensor unit 300A”, the display data processing unit 701 displays the display data on the first display / light sensor unit 300A. Therefore, an instruction is given to the display control unit 601 and the backlight control unit 603 to control the liquid crystal panel driving circuit 304 and the backlight driving circuit 308 of the first display / light sensor unit 300A.

  Next, the “reserved” field is a field that is appropriately specified when it is necessary to further specify information other than information that can be specified in the above-described fields.

  Note that an application executed by the main control unit 800 does not need to use all the above-described fields when transmitting a command, and an invalid value (such as a NULL value) may be set for a field that is not used. .

  When the user wants to acquire coordinate data of a position touched with a finger or pen, a command specifying “coordinate” in the “data type” field is transmitted to the data processing unit 700. Therefore, it is desirable to specify “all” in the “data acquisition timing” field of the command to acquire coordinate data. Further, since it is only necessary to acquire coordinate data of the touched position, the scanning accuracy may not be high. Therefore, “low” may be specified as the value of the “scan resolution” field of the above command.

  Further, when “coordinate” is specified in the “data type” field of the command, for example, when the user touches the sensor built-in liquid crystal panel 301 with a plurality of fingers or pens at the same time, the coordinate data of the touched position is used. Can be acquired (multi-point detection).

  When acquiring image data of an object such as a document, a command specifying “whole image” in the “data type” field is transmitted to the data processing unit 700. Since it is common to perform a scan in a stationary state, it is not necessary to periodically perform the scan. Therefore, in this case, it is desirable to designate “sense” or “event” in the “data acquisition timing” field. When scanning an object such as a document, it is desirable that the scanning accuracy is high so that the user can easily read the characters. Therefore, it is desirable to designate “high” in the “scan resolution” field.

(Whole image data / Partial image data / Coordinate data)
Next, the whole image data, the partial image data, and the coordinate data will be described with reference to FIG. The image data shown in FIG. 7A is image data obtained as a result of scanning the entire sensor built-in liquid crystal panel 301 when the object is not placed on the sensor built-in liquid crystal panel 301. The image data shown in FIG. 7B is image data obtained as a result of scanning the entire sensor-equipped liquid crystal panel 301 when the user touches the sensor-equipped liquid crystal panel 301 with a finger.

  When the user touches the sensor built-in liquid crystal panel 301 with a finger, the amount of light received by the photosensor circuit 32 in the vicinity of the touch changes, so that the voltage output from the photosensor circuit 32 changes, and as a result, In the image data generated by the sensor control unit 602, the brightness of the pixel value of the portion touched by the user changes.

  In the image data shown in FIG. 7B, the brightness of the pixel value of the portion corresponding to the user's finger is higher than that in the image data shown in FIG. In the image data shown in FIG. 7B, the smallest rectangular area (area PP) that includes all pixel values whose lightness changes more than a predetermined threshold is “partial image data”.

  The image data indicated by the area AP is “whole image data”.

  Also, the coordinate data in the whole image data (area AP) of the representative coordinates Z of the partial image data (area PP) is (Xa, Ya), and the coordinate data in the partial image data (area PP) is (Xp, Yp). It is.

(Configuration of sensor built-in liquid crystal panel)
Next, the configuration of the sensor built-in liquid crystal panel 301 and the configuration of the peripheral circuit 309 of the sensor built-in liquid crystal panel 301 will be described with reference to FIG. FIG. 8 is a block diagram showing the main part of the display / light sensor unit 300, particularly the configuration of the sensor built-in liquid crystal panel 301 and the configuration of the peripheral circuit 309.

  The sensor built-in liquid crystal panel 301 includes a pixel circuit 31 for setting light transmittance (brightness) and an optical sensor circuit 32 that outputs a voltage corresponding to the intensity of light received by the sensor. The pixel circuit 31 is used as a general term for the R pixel circuit 31r, the G pixel circuit 31g, and the B pixel circuit 31b corresponding to the red, green, and blue color filters, respectively.

  The pixel circuits 31 are arranged on the sensor built-in liquid crystal panel 301 in the column direction (vertical direction) and 3n in the row direction (horizontal direction). A set of the R pixel circuit 31r, the G pixel circuit 31g, and the B pixel circuit 31b is continuously arranged in the row direction (lateral direction). This set forms one pixel.

  In order to set the light transmittance of the pixel circuit 31, first, the high level voltage (TFT 33 is turned on) to the scanning signal line Gi connected to the gate terminal of the TFT (Thin Film Transistor) 33 included in the pixel circuit 31. Voltage). Thereafter, a predetermined voltage is applied to the data signal line SRj connected to the source terminal of the TFT 33 of the R pixel circuit 31r. Similarly, the light transmittance is also set for the G pixel circuit 31g and the B pixel circuit 31b. Then, by setting these light transmittances, an image is displayed on the sensor built-in liquid crystal panel 301.

  Next, the photosensor circuit 32 is arranged for each pixel. One pixel may be arranged in the vicinity of each of the R pixel circuit 31r, the G pixel circuit 31g, and the B pixel circuit 31b.

  In order for the optical sensor circuit 32 to output a voltage according to the light intensity, first, the sensor readout line RWi connected to one electrode of the capacitor 35 and the anode terminal of the photodiode 6 are connected. A predetermined voltage is applied to the sensor reset line RSi. In this state, when light is incident on the photodiode 6, a current corresponding to the amount of incident light flows through the photodiode 6. And according to the said electric current, the voltage of the connection point (henceforth connection node V) of the other electrode of the capacitor | condenser 35 and the cathode terminal of the photodiode 6 falls. When the power supply voltage VDD is applied to the voltage application line SDj connected to the drain terminal of the sensor preamplifier 37, the voltage at the connection node V is amplified and output from the source terminal of the sensor preamplifier 37 to the sensing data output line SPj. Based on the output voltage, the amount of light received by the optical sensor circuit 32 can be calculated.

  Next, the liquid crystal panel drive circuit 304, the optical sensor drive circuit 305, and the sensor output amplifier 44, which are peripheral circuits of the sensor built-in liquid crystal panel 301, will be described.

  The liquid crystal panel drive circuit 304 is a circuit for driving the pixel circuit 31, and includes a scanning signal line drive circuit 3041 and a data signal line drive circuit 3042.

  The scanning signal line driving circuit 3041 sequentially selects one scanning signal line from the scanning signal lines G1 to Gm for each line time based on the timing control signal TC1 received from the display control unit 601, and A high level voltage is applied to the selected scanning signal line, and a low level voltage is applied to the other scanning signal lines.

  Based on the display data D (DR, DG, and DB) received from the display controller 601, the data signal line driver circuit 3042 generates a predetermined voltage corresponding to the display data for one row for each line time. The data signal lines SR1 to SRn, SG1 to SGn, and SB1 to SBn are applied (line sequential method). Note that the data signal line driver circuit 3042 may be driven by a dot sequential method.

  The optical sensor driving circuit 305 is a circuit for driving the optical sensor circuit 32. Based on the timing control signal TC2 received from the sensor control unit 602, the optical sensor driving circuit 305 selects a predetermined sensor readout signal line from the sensor readout signal lines RW1 to RWm for each line time. A read voltage is applied, and a voltage other than a predetermined read voltage is applied to the other sensor read signal lines. Similarly, based on the timing control signal TC2, a predetermined reset voltage is applied to the sensor reset signal line selected from the sensor reset signal lines RS1 to RSm for each line time, and the others. A voltage other than a predetermined reset voltage is applied to the sensor reset signal line.

  The sensing data output signal lines SP1 to SPn are grouped into p groups (p is an integer of 1 to n), and the sensing data output signal lines belonging to each group are connected via a switch 47 that is sequentially turned on in time division. And connected to the sensor output amplifier 44. The sensor output amplifier 44 amplifies the voltage from the group of sensing data output signal lines connected by the switch 47 and outputs the amplified voltage to the signal conversion circuit 306 as sensor output signals SS (SS1 to SSp).

(Key points of the invention)
The main feature of the present invention is that the data display / sensor device 100 has a housing that can be folded in half, and the sensor built-in liquid crystal panel 301 that inputs an image in the vicinity is turned upside down. The data display / sensor device 100 is disposed on both sides, and the data display / sensor device 100 folds the case when the gravity direction is a downward direction, and a posture information acquisition unit 810 that acquires posture information indicating the posture of the case. A specifying unit 820 for specifying the sensor-incorporated liquid crystal panel 301 located on the lower side of the two sensor-incorporated liquid crystal panels 301 based on the attitude information acquired by the attitude information acquisition unit 810 Further, the data display / sensor device 100 includes an input invalidation unit 830, and inputs an image in the vicinity of the lower sensor built-in liquid crystal panel 301 specified by the specifying unit 820. There is a point to disable the function that.

  As a result, the data display / sensor device 100 can disable the function of inputting an image in the vicinity of the sensor built-in liquid crystal panel 301 that does not require the user to input an image, and as a result, the sensor built-in liquid crystal panel. An erroneous input from 301 can be prevented. Then, since the sensor built-in liquid crystal panel 301 located on the lower side can be easily specified by the posture information acquisition unit 810 and the specifying unit 820, other items such as a cover case are used to recognize the front and back of the device as in the past. There is no need to use. In addition, by providing the above configuration, it is not necessary to determine in advance the surface to be folded, and the surface and both surfaces can be used evenly.

  Therefore, the data display / sensor device 100 can be used in the state of being held in the hand without distinguishing the front and back of the device, and the operability and convenience of the device can be improved for the user.

  Details of each function of the posture information acquisition unit 810 and the like will be described in detail later with reference to FIG.

  Further, the data display / sensor device 100 includes two sensor-embedded liquid crystal panels 301. The two sensor-embedded liquid crystal panels 301 are divided into a first display / light sensor unit 300A and a second display / light sensor unit 300B, respectively. It will be described as being included. Further, here, the first display / light sensor unit 300A and the second display / light sensor unit 300B are connected by a hinge structure, and the first display / light sensor unit 300A and the second display / light sensor unit 300B are connected. It is assumed that the hinge part switch 904 illustrated in FIG. 4 is activated by the operation from the folded state or the operation toward the folded state. However, when the hinge part switch 904 is not provided, the hinge part switch 904 may be configured not to exist.

(How to disable the detection function using the data display / sensor device)
Next, a typical example of processing in which the data display / sensor device 100 disables the function of inputting an image in the vicinity of the sensor built-in liquid crystal panel 301 will be described with reference to FIGS. Here, an outline of the processing will be described, and details of each processing will be described later.

  FIG. 9A shows a state in which the first display / light sensor unit 300A and the second display / light sensor unit 300B of the data display / sensor device 100 are folded. At this time, the sensor built-in liquid crystal panel 301 (not shown) is disposed on the opposing inner surfaces of the first display / light sensor unit 300A and the second display / light sensor unit 300B. In the following description, the lower side of the drawing will be described as the direction of gravity.

  9B shows a state in which the first display / light sensor unit 300A and the second display / light sensor unit 300B are opened from the state of FIG. 9A (a state in which the first display / light sensor unit 300B is not completely folded, or State in which it is not completely folded). At this time, images (illustrated by oblique lines and horizontal lines for convenience) are displayed on the sensor-embedded liquid crystal panels 301 of the first display / light sensor unit 300A and the second display / light sensor unit 300B, respectively.

  9C further opens the first display / light sensor unit 300A and the second display / light sensor unit 300B from the state of FIG. 9B, and finally opens the first display / light sensor unit 300A and the first display / light sensor unit 300B. 2 shows a state where the 2 display / light sensor unit 300B is folded. At this time, the sensor built-in liquid crystal panel 301 of the first display / light sensor unit 300A faces upward (the direction opposite to the direction of gravity), and the sensor built-in liquid crystal panel 301 of the second display / light sensor unit 300B faces down. Yes.

  In the state of FIG. 9C, the image (horizontal line) displayed on the sensor built-in liquid crystal panel 301 of the second display / light sensor unit 300B in FIG. 9B is the first display / light sensor unit 300A. It is displayed on the sensor built-in liquid crystal panel 301. Further, in the state of FIG. 9C, the second display / light sensor unit 300B has an invalid function of inputting a nearby image, and the second display / light sensor unit 300B operates the detection function. I can't.

  As described above, in the data display / sensor device 100, the data display / sensor device acquired by the posture information acquisition unit 810 in a state where the user turns back the first display / light sensor unit 300A and the second display / light sensor unit 300B. Based on the posture information indicating the posture of 100, the display / light sensor unit positioned on the lower side is triggered by the specification unit 820 specifying which display / light sensor unit 300 is positioned on the lower side. The function of inputting a nearby image of 300 is disabled. Further, based on the trigger, an image displayed on the lower display / light sensor unit 300 is displayed on the upper display / light sensor unit 300.

  In FIG. 9C, the second display / light sensor unit 300B is described as being on the lower side, but the same effect can be obtained even when the first display / light sensor unit 300A is on the lower side. . The posture information acquisition unit 810 may be disposed in either the first display / light sensor unit 300A or the second display / light sensor unit 300B. Whether or not 810 is provided can be selected as appropriate. Further, in FIG. 9C, the image displayed on the display / light sensor unit 300 positioned on the lower side has been described as being displayed on the display / light sensor unit 300 positioned on the upper side. It is also possible to adopt a configuration in which no display is performed on the upper display / light sensor unit 300. However, by displaying the image displayed on the two screens on one screen, the data display / sensor device 100 with more convenience can be provided to the user.

(Data display / more detailed configuration of sensor device)
Next, a more detailed configuration of the data display / sensor device 100 will be described with reference to FIG. Here, in order to make the description easy to understand, the description of the operations of the data processing unit 700 and the circuit control unit 600 located between the main control unit 800 and the display / light sensor unit 300 is omitted. However, to be precise, when performing image display and image input, each unit of the main control unit 800 transmits a command to the data processing unit 700, and the data processing unit 700 controls the circuit control unit 600 based on the command. Then, the circuit control unit 600 transmits a signal to the display / light sensor unit 300. Further, the main control unit 800 acquires the entire image data, the partial image data, and the coordinate data from the data processing unit 700 as a response to the command transmitted to the data processing unit 700.

  FIG. 1 is a block diagram showing a more detailed configuration of the data display / sensor device 100. As illustrated, the main control unit 800 includes an attitude information acquisition unit 810, a specification unit 820, an input invalidation unit 830, and an image display control unit (image display control means) 840.

  The posture information acquisition unit 810 acquires posture information indicating the posture of the data display / sensor device 100 and outputs the posture information to the specifying unit 820.

  As an example of the posture information acquisition unit 810, a change in the angular velocity of an object is detected, a gyro sensor that converts the detected angular velocity into an electrical signal and output, a change in velocity per unit time is detected, and the detected velocity is Acceleration sensor that outputs in place of electrical signals, detects minute changes (strains) in mechanical dimensions as electrical signals, and is also used as a sensor sensing element for force, pressure, acceleration, vibration, displacement, torque, etc. A mercury sensor that detects a tipping or tilting using a strain sensor or a mercury movement in a glass tube can be cited. Furthermore, a three-axis or six-axis sensor in which some of the above sensors are combined is also possible.

  When the gravity direction is set to the downward direction, the specifying unit 820 turns the posture information acquisition unit 810 in a state where the first display / light sensor unit 300A and the second display / light sensor unit 300B of the data display / sensor device 100 are folded. Based on the acquired posture information indicating the posture of the data display / sensor device 100, the display / light sensor unit 300 located on the lower side of the first display / light sensor unit 300A or the second display / light sensor unit 300B is specified. To do. Therefore, for example, when a gyro sensor is used as the posture information acquisition unit 810, the gyro sensor transmits an electric signal indicating the detected angular velocity to the data display / posture information indicating the tilt state (posture) of the sensor device 100 with respect to the center of gravity direction. And the posture information is output to the specifying unit 820. Next, the specifying unit 820 specifies the display / light sensor unit 300 located on the lower side of the first display / light sensor unit 300A or the second display / light sensor unit 300B based on the posture information.

  Then, the specifying unit 820 outputs position specifying information indicating the lower display / light sensor unit 300 to the input invalidation unit 830 and the image display control unit 840 described later.

  The input invalidation unit 830 inputs an image in the vicinity of the display / light sensor unit 300 located on the lower side of the first display / light sensor unit 300A or the second display / light sensor unit 300B specified by the specifying unit 820. It has a role of disabling the function to be performed. As a means for invalidating the input function, a method in which an application executed by the main control unit 800 transmits a command related only to the display / light sensor unit 300 located on the upper side can be considered. Specifically, when the first display / light sensor unit 300A is positioned on the upper side, the main control unit 800 sends a command specifying (“001”) to the data processing unit 700 in the “scan panel” field of the command. Send. At this time, the main control unit 800 does not transmit a command specifying (“010”) to the data processing unit 700 in the “scan panel” field of the command.

  Further, as means for invalidating the input function, for example, “detection (input) in the first display / light sensor unit is invalidated” in the “reserved” field of the command transmitted from the main control unit 800 to the data processing unit 700. A method of providing a new command such as “ Further, there is a method of performing control to stop the supply of power necessary for input instead of a command. By such a method, the input invalidation information indicating that the function of inputting the image in the vicinity of the display / light sensor unit 300 located below is invalidated is output from the input invalidation unit 830 to the data processing unit 700. .

  The image display control unit 840 uses the position specifying information indicating the display / light sensor unit 300 located below the first display / light sensor unit 300A or the second display / light sensor unit 300B specified by the specifying unit 820. Based on this, the display of the image on the lower display / light sensor unit 300 is stopped. Alternatively, the image display control unit 840 controls the display data to display the image on the lower display / light sensor unit 300 on the other display / light sensor unit 300 and displays it on the data processing unit 700. Send data.

  In the case where the image (screen) displayed on the display / light sensor unit 300 located on the lower side is displayed on the display / light sensor unit 300 located on the upper side (two screens are displayed on one screen), for example, As shown in FIG. 9C, the screens may be arranged side by side, or may be arranged vertically. Or the structure which displays so that two screens may be superimposed may be sufficient, and the display method can be selected suitably. In addition, after the image display is stopped in the lower display / light sensor unit 300, the image to be displayed on the lower display / light sensor unit 300 is displayed on the upper side. In addition, the screens can be displayed side by side or side by side. Here, the image to be displayed on the lower display / light sensor unit 300 is the lower display / light of the first display / light sensor unit 300A or the second display / light sensor unit 300B. The display / light sensor unit 300 specified by the specifying unit 820 as being the sensor unit 300 is “001” (first display / light sensor unit 300A) or “010” (second display) in the “display panel” field. This means an image to be displayed on the screen in the display / light sensor unit 300 in which the value of / light sensor unit 300B) has been designated.

  When the image display control unit 840 stops displaying an image, or when the image display control unit 840 displays two screens on one screen, the application executed by the main control unit 800 is positioned on the lower side. A command for controlling the brightness of the backlight of the display / light sensor unit 300 may be transmitted.

(Flowchart explanation)
Next, with reference to FIGS. 9A to 9C and FIG. 10, the flow of processing of the data display / sensor device 100 and details of commands transmitted from the main control unit 800 to the data processing unit 700 will be described. explain.

  FIG. 10 is a flowchart showing the flow of processing of the data display / sensor device 100.

  First, when the data display / sensor device 100 is turned off, the user presses the power switch 905 to turn on the data display / sensor device 100 (step S11).

  The image display control unit 840 generates display data to be displayed on the sensor built-in liquid crystal panel 301 by detecting a user operation (for example, pressing the user switch 906), and the generated display data is displayed. The data is output to the data processing unit 700 (step S12). Here, it is assumed that the display image is displayed on both the first display / light sensor unit 300A and the second display / light sensor unit 300B.

  When displaying an image on the first display / light sensor unit 300 </ b> A, the image display control unit 840 outputs a command specifying the upper screen (“001”) as the value of the “display panel” field to the data processing unit 700. To do. Further, when displaying an image on the second display / light sensor unit 300B, the image display control unit 840 sends a command specifying the lower screen (“010”) as the value of the “display panel” field, to the data processing unit 700. Output to. Here, in order to display an image on the first display / light sensor unit 300A and the second display / light sensor unit 300B, the image display control unit 840 displays both screens (“011”) as the value of the “display panel” field. The specified command is output to the data processing unit 700.

  As a result, as shown in FIG. 9B, the image display control unit 840 displays images on the two sensor-equipped liquid crystal panels 301 (step S12).

  The image display control unit 840 may display an image on the sensor built-in liquid crystal panel 301 by detecting the pressing of the power switch 905.

  At this stage, it is assumed that the display / light sensor unit 300 is in a state where a nearby image can be input. In order to perform the above input, when the display data for displaying the image on the sensor built-in liquid crystal panel 301 is output to the data processing unit 700, the image display control unit 840 is also displayed in the “data acquisition timing” field. A command in which “event” is specified and both “coordinates” and “whole image” are specified in the “data type” field (“101” is specified) is output to the data processing unit 700.

  Accordingly, when the sensor built-in liquid crystal panel 301 inputs a nearby image, the main control unit 800 can acquire the coordinate data and the entire image data from the data processing unit 700.

  In step S <b> 13, it is determined whether the posture information acquisition unit 810 has acquired posture information indicating the posture of the data display / sensor device 100. That is, if the first display / light sensor unit 300A and the second display / light sensor unit 300B are not in the folded state (NO in step S13), the posture information acquisition unit 810 changes the posture of the data display / sensor device 100. The attitude information shown is not acquired. Therefore, in this case, the process proceeds to “END”.

  On the other hand, if first display / light sensor unit 300A and second display / light sensor unit 300B are in the folded state (YES in step S13), posture information acquisition unit 810 changes the posture of data display / sensor device 100. The attitude information shown is acquired. Therefore, in that case, the posture information acquisition unit 810 outputs the posture information to the specifying unit 820. When the posture information acquisition unit 810 is configured by a gyro sensor, the posture information acquisition unit 810 detects a change in the angular velocity of the data display / sensor device 100, changes the detected angular velocity into an electrical signal, and Posture information is output to the identifying unit 820.

  Subsequently, based on the posture information acquired by the posture information acquisition unit 810, the specifying unit 820 displays which of the first display / light sensor unit 300A or the second display / light sensor unit 300B is located on the lower side. / It is specified whether it is the optical sensor part 300 (step S14).

  When the specifying unit 820 specifies that the lower display / light sensor unit is the first display / light sensor unit 300A (YES in step S14), the process proceeds from step S14 to step S15. In FIG. 10, for convenience, the first display / light sensor unit 300A is referred to as “A”, and the second display / light sensor unit 300B is referred to as “B”.

  At this time, the specifying unit 820 outputs position specifying information indicating the display / light sensor unit 300 positioned on the lower side to the input invalid unit 830 and the image display control unit 840.

  Subsequently, in step S15, the input invalidation unit 830 indicates to the data processing unit 700 that the function of inputting a nearby image of the first display / light sensor unit 300A positioned below is invalidated. As a result, the function of inputting the nearby image of the first display / light sensor unit 300A is invalidated. As a means for invalidating the input function, as described above, the application executed by the main control unit 800 transmits a command related only to the display / light sensor unit 300 positioned above, and the main control unit 800 performs data processing. In the “reserved” field of the command to be transmitted to the unit 700, for example, a new command such as “invalidate detection in the first display / light sensor unit” is provided, or supply of power necessary for detection is provided instead of the command. It is conceivable to perform a control to stop the operation.

  Further, in step S16, the image display control unit 840 determines the first display / light sensor unit 300A based on the position specifying information indicating the display / light sensor unit 300 positioned on the lower side input from the specifying unit 820. Stop displaying images.

  In step S17, the image display control unit 840 controls the display data so that the image on the first display / light sensor unit 300A located on the lower side is displayed on the second display / light sensor unit 300B. The display data is transmitted to the data processing unit 700, and the process returns to step S13.

  In addition, although the input function of A is first invalidated (step S16) and the processing flow is described in the order of display stop of A (step S17), it is not limited to this order. It may be the configuration performed in

  Next, for example, when the user reverses the vertical relationship between the first display / light sensor unit 300A and the second display / light sensor unit 300B (NO in step S14, that is, B is lowered by the specifying unit 820) If it is determined that the process proceeds to step S21 from step S14.

  Since the flow from step S21 to step S23 is different from the flow from step S15 to step S17 only in A and B, detailed description thereof is omitted here. However, when the first display / light sensor unit 300A comes to the upper side by reversing the vertical relationship between the first display / light sensor unit 300A and the second display / light sensor unit 300B, the first display / light sensor unit 300A Image display / image input is performed, and image display / image input is not performed in the first display / light sensor unit 300A. Accordingly, the command in the “data acquisition timing” field and the command in the “scan panel” field are appropriately changed.

  As described above, in the data display / sensor device 100 and the control method thereof according to the present embodiment, a function of inputting an image in the vicinity of the lower display / light sensor unit 300 where the user does not need to input an image. As a result, erroneous input from the lower display / light sensor unit 300 can be prevented. Since the display / light sensor unit 300 positioned on the lower side can be easily specified by the posture information acquisition unit 810 and the specifying unit 820, in order to recognize the front and back of the device as in the past, other cases such as a cover case are used. There is no need to use goods. In addition, by providing the above-described configuration, it is not necessary to determine in advance the surface to be folded, and both the front and back surfaces can be used evenly.

  Therefore, the portable device and the control method can be used in the state of being held in the hand without distinguishing the front and back of the device, and the operability and convenience of the device can be improved for the user. .

  Further, in the data display / sensor device 100 and the control method thereof according to the present embodiment, the device can be used in the state of being held in the hand without distinguishing the front and back of the device, and the operability of the device for the user. In addition, convenience can be improved.

  Further, in the data display / sensor device 100 according to the present embodiment, the display / light sensor unit 300 can display not only a nearby image but also an image. Therefore, the display / light sensor unit 300 can perform information presentation to the data display / sensor device 100 user. Accordingly, since the user can use the data display / sensor device 100 while viewing the image displayed on the display / light sensor unit 300, the operability and convenience of the device can be improved for the user. Can do.

  Further, in the data display / sensor device 100 according to the present embodiment, the image displayed by the lower display / light sensor unit 300 cannot be visually recognized from the user. Therefore, the image display control unit 840 stops displaying the image on the lower display / light sensor unit 300, so that it is possible to reduce the power consumption of the data display / sensor device 100 spent for displaying the image. Therefore, it is possible to realize the data display / sensor device 100 that is more convenient.

  In the data display / sensor device 100 according to the present embodiment, the image displayed by the lower display / light sensor unit 300 cannot be viewed by the user, but the image display control unit 840 displays the lower display. By displaying the image on another display / light sensor unit 300 different from / light sensor unit 300, the user can view the images displayed on the front and back surfaces on one screen. Thereby, it is possible to realize the data display / sensor device 100 that is more convenient for the user.

  In the data display / sensor device 100 according to the present embodiment, the posture information acquisition unit 810 includes a gyro sensor, an acceleration sensor, a strain sensor, or a mercury switch, so that the posture of the data display / sensor device 100 can be obtained. It is possible to follow posture changes with high accuracy and acquire posture information.

  In the data display / sensor device 100 according to the present embodiment, the display / light sensor unit 300 includes a photodiode group that detects the amount of received light at each position on the display / light sensor unit 300, and the photo The neighboring image may be input based on a change in the amount of received light detected by the diode group. Thereby, the image on the display / light sensor unit 300 can be input successfully.

(Supplement)
Finally, each block of the data display / sensor device 100, in particular the posture information acquisition unit 810, the specifying unit 820, the input invalidation unit 830, and the image display control unit 840 may be configured by hardware logic. Thus, it may be realized by software using a CPU.

  That is, the data display / sensor device 100 includes a CPU (central processing unit) that executes instructions of a control program for realizing each function, a ROM (read only memory) that stores the program, and a RAM (random access) that expands the program. memory), a storage device (recording medium) such as a memory for storing the program and various data. An object of the present invention is a record in which a program code (execution format program, intermediate code program, source program) of a control program for the data display / sensor device 100, which is software for realizing the functions described above, is recorded so as to be readable by a computer. This can also be achieved by supplying a medium to the data display / sensor device 100 and reading and executing the program code recorded on the recording medium by the computer (or CPU or MPU).

  Examples of the recording medium include tapes such as magnetic tapes and cassette tapes, magnetic disks such as floppy (registered trademark) disks / hard disks, and disks including optical disks such as CD-ROM / MO / MD / DVD / CD-R. Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.

  The data display / sensor device 100 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Also, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  The present invention relates to a portable device capable of inputting an image of an object and a method for controlling the device.

It is a block diagram which shows the more detailed structure of the data display / sensor apparatus which concerns on one Embodiment of this invention. It is a figure which shows typically the cross section of the liquid crystal panel with a built-in sensor with which the data display / sensor apparatus which concerns on one Embodiment of this invention is provided. FIG. 3A is a schematic diagram showing a state in which a position touched by a user is detected by detecting a reflected image on a sensor built-in liquid crystal panel included in the data display / sensor device according to the embodiment of the present invention. is there. FIG. 3B is a schematic diagram illustrating a state in which a position touched by the user is detected by detecting a shadow image on the sensor built-in liquid crystal panel included in the data display / sensor device according to the embodiment of the present invention. . It is a block diagram which shows the principal part structure of the data display / sensor apparatus which concerns on one Embodiment of this invention. It is a figure which shows typically an example of the frame structure of the command used with the data display / sensor apparatus which concerns on one Embodiment of this invention. It is a figure explaining an example of the value which can be specified to each field contained in the command shown in FIG. 5, and its outline. FIG. 7A is a result of scanning the entire sensor-equipped liquid crystal panel when the object is not placed on the sensor-equipped liquid crystal panel in the data display / sensor device according to the embodiment of the present invention. Image data. FIG. 7B is obtained as a result of scanning the entire sensor-equipped liquid crystal panel when the user is touching the sensor-equipped liquid crystal panel with a finger in the data display / sensor device according to the embodiment of the present invention. Image data. It is a block diagram which shows the principal part of the display / light sensor part 300 with which the data display / sensor apparatus which concerns on one Embodiment of this invention is provided, especially the structure of the liquid crystal panel with a built-in sensor, and the structure of a peripheral circuit. FIG. 9A is a diagram illustrating a state in which the first display / light sensor unit 300A and the second display / light sensor unit 300B of the data display / sensor device 100 are folded. FIG. 9B shows a state in which the first display / light sensor unit 300A and the second display / light sensor unit 300B are opened from the state of FIG. 9A (a completely folded state or a completely folded state). It is a figure which shows the state which is not. 9C further opens the first display / light sensor unit 300A and the second display / light sensor unit 300B from the state of FIG. 9B, and finally opens the first display / light sensor unit 300A and the first display / light sensor unit 300B. It is a figure which shows the state which turned up 2 display / light sensor part 300B. FIG. 10 is a flowchart showing the flow of processing of the data display / sensor device 100.

Explanation of symbols

100 Data display / sensor device (portable device)
300 Display / light sensor unit 301 Liquid crystal panel with built-in sensor (planar member)
700 Data processing unit 800 Main control unit 810 Posture information acquisition unit (posture information acquisition means)
820 Identification part (identification means)
830 Input invalid part (input invalid means)
840 Image display control unit (image display control means)

Claims (8)

A portable device having a casing that can be folded in two and having a planar member capable of inputting a nearby image disposed on both the front and back surfaces in a state in which the casing is folded back,
Attitude information acquisition means for acquiring attitude information indicating the attitude of the housing;
When the direction of gravity is a downward direction, a lower side surface member located on the lower side of the two surface members in a state where the housing is folded based on the posture information acquired by the posture information acquisition means Identifying means for identifying
A portable device comprising: an input invalidating unit that invalidates a function of inputting an image in the vicinity of the lower side surface member identified by the identifying unit.   The portable device according to claim 1, wherein the planar member further displays an image.   The portable device according to claim 2, further comprising image display control means for stopping display of an image on the lower side surface member. Of the two planar members, when the planar member located on the upper side is an upper lateral member,
The image display control means causes the lower side surface member to display a lower image to be displayed on the lower side surface member after the image display is stopped on the lower side surface member. 3. The portable device according to 3.   The portable device according to claim 4, wherein the upper side surface member displays the upper image and the lower image displayed by the upper side surface member so as to be displayed side by side or superimposed on each other. .   The portable apparatus according to any one of claims 1 to 5, wherein the posture information acquisition unit includes a gyro sensor, an acceleration sensor, a strain sensor, or a mercury switch.   The planar member includes a photodiode group that detects the amount of light received at each position on the planar member, and the neighboring image is input based on a change in the amount of received light detected by the photodiode group. The portable device according to any one of claims 1 to 6, wherein A method of controlling a portable device having a casing that can be folded in two and having a planar member capable of inputting a nearby image disposed on both the front and back surfaces in a state in which the casing is folded,
An attitude information acquisition step for acquiring attitude information indicating the attitude of the housing;
When the gravitational direction is a downward direction, a lower side surface shape located on the lower side of the two planar members in a state where the housing is folded based on the posture information acquired by the posture information acquisition step. A specific step of identifying a member;
An input invalidation step of invalidating a function of inputting a nearby image of the lower side surface member identified by the identification step.

Images