JPH07121293A - Remote controller to access the display screen - Google Patents

Abstract

(57) [Summary] [Purpose] It is possible to input the pointing point and the position information of the pointing person with a simple structure. [Arrangement] A marker is placed on a display screen for each predetermined frame, the camera unit 11 takes an image of the frame, the marker extraction processing unit 12 extracts only the marker, and the coordinate position calculation processing unit 13 extracts the coordinates of the pointing point and the pointer. The position of the display screen is detected, and if there is an instruction from the instructor, a predetermined IR pulse is generated from the IR pulse pattern generation unit 15 by the output from the instruction detection unit 14, and the IR light transmission / reception unit 16 outputs the specified IR pulse. It is characterized in that it is sent out to the remote controller receiver.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image display device using a large screen (several tens of inches to several meters square) for inputting an instruction indicating a specific portion of an image being displayed, and position information of the instructor. Related to a remote controller that accesses the display screen that enables sending of

[0002]

2. Description of the Related Art In a presentation, a video conference using a large screen, or the like, it is necessary to point out what one is paying attention to with a simple structure as well as operability. Obtaining the position information of is important for high performance of devices such as automatic tracking of displays and cameras.

[0003]

The conventional instruction input device, as represented by a mouse, a laser pointer, etc.,
Although it was possible to display the point of the instructor on the display image, it was not possible to send data such as the position information of the instructor to the display side.

A means using a magnetic sensor is known as a means for detecting and transmitting the position information of the instructor, but it is erroneously detected that there is a magnetic field generation source, a special additional device is required, etc. It had drawbacks and was not user friendly.

It is an object of the present invention to provide a remote controller for accessing a display screen which enables an instruction input and an input of position information of an instructor with a simple structure.

[0006]

A remote controller according to the present invention includes a camera unit for photographing a display screen displayed by inserting a marker for each predetermined frame, and only a marker image in the photographed image. A marker extraction processing unit for extracting, and a coordinate / position calculation processing unit for detecting a point indicated by the instructor on the display screen and the position of the instructor from the display screen from the markers extracted by the marker extraction processing unit. ,
An instruction detection unit that detects the presence or absence of an instruction from the instructor, an IR pulse pattern generation unit that inputs each coordinate value obtained by the coordinate / position calculation processing unit, and generates an IR pulse pattern, and an instruction by the instruction detection unit When it is detected that the IR pulse pattern is generated, an IR light transmitting / receiving unit that sends the IR pulse pattern generated from the IR pulse pattern generating unit to the remote controller receiving unit on the display side is provided.

[0007]

In the present invention, the marker extraction processing unit extracts only the image of the marker from the image input by the camera unit,
The coordinate / position calculation processing unit obtains the designated coordinates on the display of the remote controller and the position coordinate of the instructor seen from the display, and each coordinate value is sent to the IR pulse pattern generation unit, and based on the instruction from the push button detection unit. Is transmitted to the IR light transmitting / receiving unit, and IR light is transmitted.

[0008]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT FIG. 1 shows a remote controller 1 according to the present invention.
In the block diagram showing the configuration example of 0, 11 is a camera unit that performs imaging, 12 is a marker extraction processing unit that extracts only a marker image from an input image, and 13 is a display (not shown) of the remote controller 10 from the extracted markers. The coordinate / position calculation processing unit for obtaining the above indicated coordinates and the position coordinate of the instructor seen from the display, 14 is an instruction detection unit for detecting the instruction when the instructor pushes a push button or the like, and 15 is An IR (infrared) pulse pattern generation unit converts the designated coordinates and position conversion obtained by the coordinate / position calculation processing unit 13 into an IR pulse pattern. 16 is this I
It is an IR light transmitting / receiving unit that sends out an R pulse pattern as IR light and receives IR light from a remote controller receiving unit described later.

Next, the outline of the operation will be described. In the camera unit 11, the marker extraction processing unit 12 extracts only the marker image from the input image, and then the coordinate / position calculation processing unit 13 extracts the marker image from the remote controller 10.
The designated coordinates on the display and the position coordinate of the indicator seen from the display are obtained. Each coordinate value is sent to the IR pulse pattern generation unit 15, and is sent to the IR light transmission / reception unit 16 based on the instruction from the instruction detection unit 14, and the IR light is sent out. IR light synchronized with the video signal is transmitted from a remote controller reception unit on the display side, which will be described later, and the IR light transmission / reception unit 16 of the remote controller 10 receives the synchronization signal and synchronizes the camera unit 11 with the display.

FIG. 2 shows a remote controller 10 of the present invention.
21 is a block diagram showing an example of the configuration of the remote controller receiving unit 20 that receives a signal from
IR light transmitter / receiver 16 of the remote controller 10 of FIG.
22 is a CPU, 23 is a display control unit that controls a display device 30, which will be described later, and 24 is a superimposer unit.

Next, the outline of the operation will be described. When the IR light transmitter / receiver 21 receives a signal from the remote controller 10 shown in FIG.
And sends a command to the display control unit 23 to generate a marker pattern. When the IR light transmitting / receiving unit 21 receives the designated coordinates and the position coordinates from the remote controller 10, the CPU
Reference numeral 22 sends a command to the superimposer unit 24 and the display control unit 23 to perform necessary processing such as displaying a cursor mark.

3 and 4 show a state after the marker m is displayed on the display screen 31 of the display device 30,
It is a figure which shows the example of the input image of the remote controller 10 side. When the markers m are displayed at the four corners of the display screen 31, according to the designated position of the remote controller 10,
The display screen and the marker M are photographed at positions deviated from the center of the camera visual field in FIG.

FIG. 5 shows an example of a method for extracting only marker points from an image taken by the camera section 11. The moving image is formed by connecting unit images (frames) every 1/30 seconds. First, a marker pattern is displayed on the display screen every other frame. Then, the images captured by the camera unit 11 of the remote controller 10 are also images containing the marker m every other frame. Here, when the difference image between the adjacent frames is obtained, it is 1/30
Since the display image itself and the background of the display device hardly change in a short time of seconds, only the marker pattern can be extracted. The marker m may be inserted not every frame as long as it is every predetermined frame.

FIG. 6 shows an instruction point p (x1, y) from the position of the marker pattern on the display and the position of the marker pattern photographed by the camera of the remote controller.
1) and a method of obtaining the distance L between the instructor. That is, m1 to m4 in FIG.
Shows the upper marker, and p (x1, y1) is the point x
1, y1 are coordinate values, d is the distance between the markers m1 and m2,
o (0,0) is the origin (center point), FIG. 6B is a display screen in the camera field of view, M1 to M4 are markers, D is the distance between markers 1 and 2, P (0,0) Indicates the center of the display screen, and o (x0, y0) indicates the centers of the markers M1 to M4.

Now, the point point p (x1, y1) is

[0016]

## EQU1 ## X1 = X0 × d / D

[0017]

## EQU2 ## It can be obtained from Y1 = Y0 × d / D. Further, the position (distance) L from the display screen 31 of the instructor is

[0018]

## EQU00003 ## L = K.times.d / D where K is a constant between the instructor and the display screen when D = d.

In this way, the coordinates can be obtained by a simple arithmetic calculation.

[0020]

According to the remote controller of the present invention, a camera unit for photographing a display screen displayed by inserting a marker for each predetermined frame, and a marker extraction process for extracting only a marker image in the photographed image. Section, a coordinate / position calculation processing section that detects a point pointed by the instructor on the display screen from the marker extracted by the marker extraction processing section and the position of the instructor from the display screen, and an instruction from the instructor. There is an instruction from the instruction detection unit that detects the presence / absence of the presence / absence, an IR pattern generation unit that inputs each coordinate value obtained by the coordinate / position calculation processing unit, and generates an IR pulse pattern, and the instruction detection unit. When detected, the IR pulse pattern generated from the IR pulse pattern generator is displayed on the remote controller. Since it has an IR light transmitter / receiver for sending to the receiver, there is no need to make major changes to the existing display, and since the camera captures the marker pattern on the display as an image, the accurate point and the position of the indicator There is an advantage that information can be detected.

[Brief description of drawings]

FIG. 1 is a block diagram showing the configuration of an embodiment of a remote controller according to the present invention.

FIG. 2 is a block diagram showing an example of a remote controller reception unit on the display side.

FIG. 3 illustrates a state in which a marker is displayed on the display screen.

FIG. 4 is a diagram showing an example of a camera field of view in the state of FIG.

FIG. 5 is an explanatory diagram of a method of extracting only marker points from an image captured by a camera unit.

FIG. 6 is an explanatory diagram of a method for obtaining the coordinates of the pointing point and the distance from the display screen of the instructor according to the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 10 remote controller 11 camera section 12 marker extraction processing section 13 coordinate / position calculation processing section 14 instruction detection section 15 IR pulse pattern generation section 16 IR light transmission / reception section 20 remote controller reception section 21 IR light transmission / reception section 22 CPU 23 display control section 24 Super imposer section 30 Display device 31 Display screen

 ─────────────────────────────────────────────────── ─── Continued Front Page (72) Inventor Toshiro Kita 1-1-6 Uchisaiwaicho, Chiyoda-ku, Tokyo Nihon Telegraph and Telephone Corporation

Claims (1)

[Claims] 1. A camera unit for photographing a display screen displayed by inserting a marker for each predetermined frame, a marker extraction processing unit for extracting only a marker image in the photographed image, and this marker extraction process. A coordinate / position calculation processing unit that detects a point pointed by the instructor on the display screen and the position of the instructor from the display screen from the marker extracted by the unit, and an instruction detection that detects the presence or absence of an instruction from the instructor. Part and the coordinates
When each coordinate value obtained by the position calculation processing unit is input and an IR pulse pattern generation unit that generates an IR pulse pattern and the instruction detection unit detects that there is an instruction, I
A remote controller for accessing a display screen, comprising: an IR light transmitting / receiving unit that sends an IR pulse pattern generated from an R pulse pattern generating unit to a remote controller receiving unit on the display side.