JP2009198815A - Guidance display apparatus for information processor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a guidance display apparatus providing an operator with conspicuous guidance information, when inputting information into a display near a very large display or when describing a display content therein. <P>SOLUTION: This guidance display apparatus is provided with a display screen displaying guidance information, an input part for inputting the information onto the display screen, an input position detecting part for detecting an input position where the information is input by the input part, and a guidance display control part for displaying the guidance information in the input position detected by the input position detecting part. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a guidance display device that displays guidance information of an information processing device on a display screen, and more particularly to a guidance display device that makes it easy for an operator to notice that guidance is displayed.

It is known to display operation information / guidance or function explanation of the information processing apparatus or guidance information such as notification, alert or warning on the screen of the personal computer.
For example, Patent Document 1 discloses a guidance display device that automatically determines the display position of a pop-up screen that displays guidance information. More specifically, when there is a guidance display request, the display position of the pop-up screen is automatically determined based on the screen display state displayed on the display screen, and is displayed so as not to hinder the currently displayed screen operation. Is. That is, in the currently displayed screen information, the largest undisplayed area is continuously examined in the VRAM, the display position of the pop-up screen is determined, and the guidance information is displayed at the determined pop-up screen position. is there. This patent document 1 also discloses that a pop-up screen is moved in a specified direction by key input or deleted.
Further, Patent Document 2 detects an operator's position existing in front of the display device by a detection sensor, and an image displayed on the display device in accordance with a displacement from a predetermined reference position based on the output of the detection sensor. A display device for changing contents is disclosed.
Japanese Patent Laid-Open No. 04-160528 Japanese Patent Laid-Open No. 10-208075

Patent Document 1 determines a pop-up screen position so as not to hinder the screen operation currently being displayed. Japanese Patent Application Laid-Open No. 2004-228561 changes video content according to the position of the operator. In the description of the embodiment, the 3D image is changed in accordance with the movement of the operator.
A screen of a conventional display device has a size of about several tens of centimeters × several tens of centimeters. On the screen having such a size, the operator can notice the guidance display almost without overlooking the guidance information at any position. However, for example, a very large display device such as 50 cm × 50 cm to 2 m × 2 m is used for explanation at conferences, lectures, briefing sessions, etc., so information is input to the display device near the large display device. When instructing and explaining the display contents, the guidance information may not be noticed depending on the operator's position and line-of-sight direction. That is, when the guidance display position is always fixed at the center, left side, or right side of the screen, or when the guidance display position is continuously displayed in the largest undisplayed area as in Patent Document 1, the operator's position and line-of-sight direction are displayed. May not be recognized.
The present invention solves the problems as described above, and provides a guidance display device for an information processing device that makes it easy for an operator to notice that guidance is displayed.

In order to solve the above problems, a guidance display device for an information processing apparatus according to the present invention displays a display screen capable of displaying guidance information, an input unit for inputting information on the display screen, and information input by the input unit. An input position detecting unit for detecting the input position, and a guidance display control unit for displaying the guidance information at the input position detected by the input position detecting unit.
As a result, the operator can quickly notice the guidance display and view the guidance information.

In the embodiment of the guidance display device of the information processing apparatus according to the present invention, the guidance display unit displays guidance at the latest input position detected by the input position detection unit.
As a result, the operator can quickly notice the guidance display and view the guidance information.

In order to solve the above problems, a guidance display device of an information processing device according to the present invention includes a display screen capable of displaying guidance information, an operator detection unit that detects an operator position before the display screen, and the operator detection A guidance display control unit that displays the guidance information on a display screen in the vicinity of the position detected by the unit.
Accordingly, guidance can be displayed at a position where the operator is present, and guidance information can be quickly viewed.

In the guidance display device for an information processing device according to the present invention, in the embodiment, the operator detection unit is an optical sensor or a sound sensor.
Thereby, an operator can be detected and guidance information can be shown to the operator.

In the embodiment, the guidance display device of the information processing apparatus of the present invention further includes a determination unit that determines whether or not the guidance information display area protrudes from the screen, and the determination by the determination unit is at least part of the guidance information display area. Is provided with a display position determination unit that changes the guidance information display area to a position that does not protrude from the screen size.
Thereby, all the guidance information is displayed on the screen, and all the guidance information can be shown.

  According to the present invention, the operator can quickly notice the guidance display and can view the guidance information. In addition, guidance can be displayed at a position where the operator is present, and guidance information can be viewed quickly.

(Embodiment 1)
FIG. 1 is a configuration diagram of a guidance display device of the information processing apparatus according to the first embodiment of the present invention.
A guidance display device 10 of an information processing device includes a display device 1, a processing device 2, a main storage device 3, an auxiliary storage device 4, and an input device 5.
The display device 1 is typically a liquid crystal display device, but may be a plasma display device, an organic EL display device, or the like. In the guidance display device 10 of the information processing apparatus of the present invention, the display device 1 has a very large display screen such as 50 cm × 50 cm to 2 m × 2 m or more. The display device 1 may be a display device in which one display screen is a large screen as described above, but may be a display device in which small screens are assembled into a large screen as described above. This display device preferably includes a touch panel on the screen.

The processing device 2 constitutes a main processing unit of the guidance display device 10 of the information processing device, and includes a display drive unit 21, a control unit 22, a display position determination unit 23, an operation position detection unit 24, and a fixed sentence storage unit. 25, a guidance generation unit 26, a size comparison unit 27, and a screen size storage unit 28.
The display drive unit 21 is a part that drives the display device 1, and generates a drive signal for displaying video information and guidance information on the display device 1.
The control unit 22 includes, for example, a CPU, reads a control program of the guidance display device of the information processing apparatus, and sequentially controls each component according to the program.
The display position determination unit 23 is a part that determines a position where a pop-up screen or window (hereinafter referred to as a guidance information display area) for displaying guidance information is opened. The display position of the guidance information display area will be described later.
The operation position detection unit 24 is a part that detects which position on the screen of the display device the operator is operating. That is, the input device detects which position on the display device is being input.
The fixed sentence storage unit 25 is a part that stores fixed guidance information to be displayed on the guidance display device 10. For example, the guidance information is an operation instruction, an operation guide, or a function explanation of the information processing apparatus. Or notification information, alerts or warnings. The guidance information shown here is an example, and other guidance information may be used.
The guidance generation unit 26 is a part that generates guidance information based on the guidance information stored in the fixed phrase storage unit 25.
The size comparison unit 27 is a part that compares the size of the guidance information display area for displaying guidance information with the size of the screen of the display device 1 so that the guidance information is displayed on the screen. That is, the screen size is compared with the size of the guidance information display area, and when at least a part of the guidance information display area protrudes from the screen size, the guidance information display area is changed to a position that does not protrude from the screen size.
The screen size storage unit 28 is a part that stores the screen size of the display device 1.
The guidance display device 10 of the information processing apparatus includes the above-described parts, but may include a processing function part as appropriate for the information processing apparatus.

The storage device 3 includes a RAM, a hard disk, a flash memory, and the like, and is used as a work area of the information processing device.
The auxiliary storage device 4 includes a ROM, a hard disk, a flash memory, and the like, and stores information processing device applications and software such as an OS. The guidance display device application 41 of the present invention is also provided.
The input device 5 is a mouse, a keyboard, a touch panel or the like, and inputs data and operation information. Since this guidance display device is equipped with a touch panel, the touch panel is also an input device.

The guidance display device of the information processing device shown in FIG. 1 is used, for example, as shown in FIG. FIG. 2 shows the display screen A, and the operator B inputs to the display screen A. This display device has a very large display screen equivalent to or higher than that of a human being, for example, 50 cm × 50 cm to 2 m × 2 m or more. Now, the operator B is located on the right side of the display screen A for a meeting, lecture, or explanatory meeting, and while viewing the display screen A, the operator B instructs information input or display contents on the right side of the screen. Since this display device is equipped with a touch panel, the location where the operator is inputting information or the location where the operator is pointing is detected by the operating position detection unit 24 shown in FIG.
Thus, when the operator B is instructing information input or display contents on the display screen A, the guidance information C is displayed at the information input location or the indication location. Alternatively, the guidance information C is displayed in the vicinity of the information input location or the indication location.

Next, the operation of the guidance display device 10 of the information processing apparatus shown in FIG. 1 will be described with reference to the flowchart shown in FIG.
When the information processing apparatus starts operating, in step S1, the application of the guidance display apparatus 10 is activated, and the guidance display apparatus 10 enters an operating state. Next, in step S2, it is determined whether there is an input to the screen. Whether or not there is an input to the screen is determined by whether or not there is an input on the touch panel mounted on the screen. Alternatively, it is determined whether or not there is an input using a keyboard or a mouse. When there is an input, the process proceeds to step S7, where the operation position detection unit 24 detects the input position and stores the position. The input position is stored as coordinates in the X and Y directions on the screen.
If there is no input in step S2, or after the processing in step S7, the process proceeds to step S3 to execute application processing. In the next step S4, it is determined whether a new event has occurred and guidance display is necessary. That is, when a new operation is started, or when a new event occurs due to the passage of a predetermined time or through communication, it is determined whether there is a guidance display request from the system (OS) or application of the guidance display device.

If there is no guidance display request, the process advances to step S5 to determine whether guidance information is being displayed. If not, it is determined in step S6 whether or not this flow is to be terminated. When the process ends, the process proceeds to the end step, and this flow ends. If it is not the end in step S6, the process returns to step S2.
If the guidance information is being displayed in step S5, the process proceeds to step S12 to determine whether or not to cancel the guidance information display. When canceling the guidance display, a guidance display canceling process is executed in step S13. Then, the process returns to step S2. If the guidance display is not canceled in step S12, the process of this flow is terminated through step S6, or the process returns to step S2.

In step S4, when a new event occurs, operation information of the information processing apparatus, operation guidance or function explanation, or guidance information such as notification information, alert or warning is generated. In step S9, the input position immediately before the occurrence of the new event is called. That is, the final input coordinates stored in the operation position detection unit 24 are called in step S7. In step S10, the display position of the guidance information display area is determined. At this time, the head position or the center position of the guidance information display area is matched with the input coordinate position.
Whether the guidance information display area is within the screen size by comparing the size of the guidance information display area with the screen size stored in the screen size storage section 28 by the size comparison section 27. To decide. That is, when all the guidance information display areas are within the screen size, all the guidance information is displayed, and the process proceeds to the next step S11. However, if at least a part of the guidance information display area exceeds the screen size, the control unit 22 operates the display position determination unit 23 so that the position of the guidance information display area is within the screen size. To change.
In step S11, the control unit 22 and the display driving unit 21 operate so as to display the guidance information at the display position determined in step S10, and display the guidance information on the display device. Then, it returns to step S2.

(Embodiment 2)
In the second embodiment, the position of the operator is detected, and guidance information is displayed at a position near the operator.
FIG. 4 shows a configuration diagram of the second embodiment. The second embodiment includes an operator spatial position detection unit 6 and an operator position determination unit 31 inside the processing apparatus 2. The other configuration is the same as that shown in FIG.
In the second embodiment, as shown in FIG. 5, the operator spatial position detection unit 6 is provided near the upper center portion of the display screen A. The operator spatial position detection unit 6 is, for example, a CCD camera, a line sensor, an infrared sensor, or a sound sensor. The operator B that is near the display screen is photographed by the CCD camera or the line sensor, and the operator B is captured from the captured image. The position of is detected. The position of the operator is detected by an infrared sensor or a sound sensor. In the example shown in FIG. 5A, since the operator B is on the left side of the display screen A, the guidance information C1 is displayed on the left side of the display screen A. It is also displayed at the eye level so that the operator can easily notice it. In the example shown in FIG. 5B, since the operator B is on the right side of the display screen A, the guidance information C2 is displayed on the right side of the display screen A at the eye height position.

The guidance display device 10 of the information processing apparatus according to the second embodiment is processed as shown in the flowchart of FIG.
When the information processing apparatus starts operating, an application of the information processing apparatus is activated in step S1, and then application processing is executed in step S21. Since the second embodiment does not detect an input position on the screen, steps S2 and S7 of the first embodiment are not necessary. Steps S4, S5, S6, S12, and S13 are the same as those in the first embodiment.

In step S4, when a new event occurs, the process proceeds to step S23, and the guidance generation unit 26 generates guidance information such as an operation instruction of the information processing apparatus, operation guidance or function explanation, notification information, alert or warning. . Next, in step S24, the operator spatial position detection unit 6 images the operator, and detects the position of the operator from the captured image. Alternatively, the position of the operator is detected by an infrared sensor or a sound sensor. In step S25, it is determined whether an operator has been detected. If an operator is detected, the process proceeds to step S26, and the display position of the guidance information display area is set at a position close to the operator. In this case, a position close to the eyes of the operator is desirable. At this time, the head position or the center position of the guidance information display area is set to a position close to the operator.
However, if the operator cannot be detected or if there is no operator, the process proceeds to step S28, and a predetermined position, for example, the center of the screen is set as the guidance display position.

In step S26, when the guidance display position is set, the size comparison unit 27 compares the size of the guidance information display region with the screen size stored in the screen size storage unit 28, and the guidance information display region is within the screen size. Compare if it is. If the entire guidance information display area is within the screen size, all the guidance information is displayed, so the process proceeds to the next step S27. However, if at least a part of the guidance information display area exceeds the screen size, the control unit 22 operates the display position determination unit 23 so that the position of the guidance information display area is within the screen size. To change.
In step S28, when the guidance display position is the center of the screen, the guidance information display area is set to be displayed within the screen size, so there is no need to compare the guidance information display area with the screen size. However, if the guidance information display area extends beyond the screen size, the position of the guidance information display area is changed in the same manner as in step S26, and the guidance information display area is determined to be within the screen size.
In step S27, the control unit 22 and the display driving unit 21 operate so as to display the guidance information at the display position determined in step S26 or step S28, and display the guidance information on the guidance display device. Then, it returns to step S21.

The operation for determining the guidance display position in step S26 of the flowchart will be described with reference to the flowchart of FIG.
First, in step S31, the horizontal position of the guidance information display area is determined. That is, the horizontal position in the display screen where the distance between the position of the operator detected in step S24 and the horizontal position on the display screen is the shortest is set as the X coordinate of the guidance information display area. Next, in step S32, the vertical position of the guidance information display area is determined. The vertical position in the display screen where the distance between the height of the eyes of the general operator obtained from the average height of the Japanese and the vertical position of the display screen is the shortest in the guidance information display area. The Y coordinate is used.
In step S33, the display size of the guidance information display area is acquired. In step S34, it is determined whether the guidance information display area is within the screen size. If the guidance information display area is within the screen size and does not protrude, this flow ends. However, if it protrudes, the position of the guidance information display area is corrected in step S25. For example, when the coordinates of the guidance information display area are the upper left coordinates of the display screen, correction is performed as in the following formulas (1) and (2).
If X + CX> W, X ← W−CX (1)
If Y + CY> H, Y ← H−CT (2)
Here, X is the position coordinate in the X direction of the guidance information display area,
CX is the size of the guidance information display area in the X direction,
Y is the position coordinate in the Y direction of the guidance information display area,
CY is the size of the guidance information display area in the Y direction,
W is the size of the display screen in the X direction,
H is the size of the display screen in the Y direction

  As shown in the above formulas (1) and (2), the position coordinate X in the X direction of the guidance information display area is less than or equal to the difference between the X direction size W of the display screen and the X direction size CX of the guidance information display area. To do. Similarly, the position coordinate Y in the Y direction of the guidance information display area is set to be equal to or smaller than the difference between the Y direction size W of the display screen and the Y direction size CY of the guidance information display area. Thereby, it is possible to prevent the guidance display from protruding from the display screen.

The block diagram of the guidance display apparatus of the information processing apparatus of Embodiment 1 of this invention is shown. The figure explaining the state by which guidance information is displayed by the guidance display apparatus of Embodiment 1 is shown. FIG. 2 shows a flowchart of the first embodiment. The block diagram of the guidance display apparatus of the information processing apparatus of Embodiment 2 of this invention is shown. The figure explaining the state in which guidance information is displayed by the guidance display apparatus of Embodiment 2 is shown. The flowchart figure of Embodiment 2 is shown. In Embodiment 2, the flowchart figure which correct | amends a guidance information display area is shown.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Display apparatus 2 Processing apparatus 3 Auxiliary storage apparatus 4 Main storage apparatus 5 Input apparatus 6 Operator spatial position detection apparatus 22 Control part 23 Display position determination part 24 Operation position detection part 26 Guidance generation part 27 Comparison part 28 Screen size storage part 31 Operator spatial position detector

Claims (5)

A display screen capable of displaying guidance information;
An input unit for inputting information on the display screen;
An input position detection unit for detecting an input position where information is input by the input unit;
A guidance display device of an information processing apparatus, comprising: a guidance display control unit that displays the guidance information at an input position detected by the input position detection unit.   The guidance display device of the information processing apparatus according to claim 1, wherein the guidance display unit displays guidance at a latest input position detected by the input position detection unit. A display screen capable of displaying guidance information;
An operator detection unit for detecting an operator position in front of the display screen;
A guidance display device of an information processing apparatus, comprising: a guidance display control unit configured to display the guidance information on a display screen in the vicinity of the position detected by the operator detection unit.   The guidance display device for an information processing apparatus according to claim 3, wherein the operator detection unit is an optical sensor or a sound sensor.   And a determination unit that determines whether or not the guidance information display area protrudes from the screen, and the determination by the determination unit determines that at least a part of the guidance information display area protrudes from the screen size. The guidance display device for an information processing device according to claim 1, further comprising a display position determination unit that changes the guidance information display area to a position that does not protrude from the screen size.

Images