JPH0222772A - Picture segment picking system - Google Patents

Abstract

PURPOSE:To improve the speed of a desired picture segment pickup processing so that the response when a man-machine interface (MMI) is realized can be obtained quickly even when the number of displaying picture segments increases by providing a display management memory. CONSTITUTION:A display management memory 17 for storing identification numbers of corresponding segments 13A, etc., is provided to rectangular displaying areas 171A, etc., corresponding to rectangular displaying areas 111A, etc., of each picture segment 13A, etc., displayed on a displaying screen 11. Then contents of the segments 13A, etc., are displayed according to prescribed displaying priority in each area 11A, etc., on the screen 11 and identification numbers of the corresponding segments 13A, etc., are stored in the areas 171A, etc., of the memory 17 corresponding to the areas 111A, etc., on the screen 11. Then the picture segment of an object to be picked up is detected from the identification number stored in the coordinate position of the memory 17 corresponding to the coordinate position of the picking up point on the screen 11. Since the identification number of the picture segment to be picked up can be found directly from the memory 17 in such way, the response when MMI is realized can be made quicker.

Description

[Detailed Description of the Invention] [Summary] An image segment big method in which pick coordinates are input on a display screen on which the contents of a plurality of segmented image memories are displayed, and a desired image segment corresponding to the pick coordinates is detected. Regarding the desired coordinates on the display surface where the contents of multiple image segments are displayed, the purpose is to speed up the process of picking a desired image segment and speed up the response of MMl even when the number of image segments to be displayed increases. In the image segment pick method, which inputs the coordinates and detects the image segment corresponding to the rectangular display area with the highest display priority in which the coordinates exist, a display management memory is provided to display the contents of each image segment in each rectangle within the display surface. In addition to displaying the image segment in the area according to a predetermined display priority order, the identification number of the image segment is stored in each area on the display management memory corresponding to each of the rectangular display areas, and the identification number on the display management memory corresponding to the big point coordinate is stored. The image segment is configured to detect a desired image segment.

[Industrial application field]

The present invention provides an image segment pick method in which, like a multi-window display, pick coordinates are manually entered on a display surface on which the contents of a plurality of segmented image memories are displayed, and a desired image segment corresponding to the pick coordinates is detected. Regarding.

[Conventional technology]

On a display surface where the contents of multiple segmented image memories are displayed superimposed, such as in a multi-window display, input the coordinates for picking an image segment from an input device, and select which image segment the coordinate value is. Conventionally, when detecting whether the input device corresponds to the current input device, it is necessary to search all the mapping information and display priority from each displayed image segment to the display surface, and match it with the coordinates that the current input device is starting at. This has been realized.

FIG. 4 shows a principle diagram of the conventional image segment pick method. In the figure, the display surface 31 of the display device has a plurality of rectangular display areas 311A, 311B inside thereof.
and 311C, the rectangular display images A, B, and C are displayed superimposed in a multi-window format.

There is a display priority order for displaying each rectangular display image A to C.
In the case of a diagram in which items with high display priority are displayed at the top, the rectangular display image C has the highest rank, and the rectangular display image A has the lowest rank.

32 is a logical screen space of three display surfaces, and each coordinate on the display surface 31 and each coordinate on this logical screen space 32 have a corresponding relationship. 321A to 321C indicate the arrangement of rectangular display areas 311A to 311C developed on the logical screen space 32.

33A, 33B, and 33C are image segments in which image data of corresponding rectangular display images A, B, and C are stored. It is assumed that each image segment 1-33A to 1-33C is managed by an identification number, and the identification numbers of image segments 33A, 33B, and 33C are 1.2 and 3, respectively.

Reference numeral 34 denotes an image segment arrangement management table, which includes an image segment arrangement table 341A, an image segment arrangement table 341B, and an image segment arrangement table 341C in which mapping information from each of the image segments I-33A to 33C to the display surface is stored. That is, the image segment arrangement tables 3418 to 341C contain segment names, identification numbers, and rectangular display areas (321
A to 321C) coordinate information, etc. are stored.

The arrangement tables 341A to 341C are arranged according to their display priority order (C>B>A) as shown.

Reference numeral 35 denotes a man-machine interface input device (hereinafter referred to as MMI input device), which is composed of a tablet, a mouse, etc., and coordinates for various inputs, including pick coordinates for picking a desired image segment, are input.

36 is an image processing processor (hereinafter referred to as PMPU);
Controls the entire operation of the device, including image segment big processing.

In the above configuration, the PMPU 36 expands each image data of each image segment 33A to 33C onto each rectangular display area 321A to 32C in the logical screen space 32 according to each mapping information specified by the image segment arrangement management table 34, and then According to the display priority order, the display screen 31
Rectangular display images A to C are displayed on the corresponding rectangular display area 3] IA to 311C.

Since the display priority order of each rectangular display image A to C is C,>B>, the rectangular display image C is displayed at the top position as shown.

The mapping information from the image segments 33A to 33C of the rectangular display images A to C displayed as shown in FIG. Ru.

Next, the conventional image segment big method will be explained according to its processing steps with reference to the image segment big processing flowchart shown in FIG.

■ Processing S21. Szt When the coordinates of the start point P for starting the desired image segment are input to the MM1 input Kadeka device 35, the PMPU
36 detects the coordinates of the pick point P using the MMI input device 32 (Process St), converts this into the coordinates of the logical screen space 32 (Process 522), ■ Process S23 The MPU 36 searches the image segment arrangement management table 34 Then, it is determined whether there is an image segment to be processed (processing 5g5). Initially, it is assumed that the image segment 33A is the image segment to be processed.

■ Processing Sz4. S□ The PMPU 36 determines whether the coordinate position of the pick point P developed on the logical screen space 32 exists within the rectangular display area 321A of the image segment 33A also developed on the logical screen space 32 (processing S2. ), this determination is made by comparing the coordinates of the pick point P with the rectangular display area information in the image segment arrangement table 341A.

Since the coordinate position of the pick point P exists within the rectangular display area 321A, the image segment 33A is selected as a big candidate image segment (processing 5zs).

■ Processing S zh, S 27 When the processing SZS is completed, or when the coordinate position of the pick point P is not within the rectangular display area 321A in the processing szm, the PMPU 36 selects the image segment arrangement management table 34 that should be referred to. The image segment arrangement table is updated from the image segment arrangement table 341A to the next image segment arrangement table (referred to as the image segment arrangement table 341B).

Hereinafter, regarding the image segment 33B, the above-mentioned process S2
3 to SZ6 are performed, and image segment 33 is further processed.
Similar processing is performed for C as well.

The coordinate position of the pick point P is the rectangular display area 321B and 3
21C, so image segment 3
3B and 33C are also selected as big candidate image segments.

As described above, the rectangular display area 32 including the pick point P
The image segment C corresponding to the rectangular display area 321C (rectangular display screen C) having the highest display priority can be activated from among 1A to 321C (processing S2.).

Similarly, the pick point P is located in the rectangular display areas 321A and 321A.
21B is surprised and the pick point P is displayed in the rectangular display area 321.
If it exists only in A, then image segment A is jumped.

[Problem to be solved by the invention]

As mentioned above, the conventional image segment big method searches all the mapping information and display priority from each displayed image segment to its display surface, and finds the corresponding coordinates that the current input device is starting from. This was achieved by letting

For this reason, it takes time to convert the coordinates of the pick points input to the input device and search the placement table for each image segment, resulting in the problem of poor response when trying to implement a man-machine interface (MMI). there were. As the number of image segments to be displayed increases, this response delay increases proportionately, which is extremely inconvenient.

The present invention speeds up processing of a desired image segment even when the number of image segments to be displayed increases.
It is an object of this invention to provide an improved image segment big method so as to speed up the response when trying to realize I.

[Means to solve the problem]

The means adopted by the present invention to solve the above-mentioned problems are as follows:
This will be explained with reference to the principle diagram shown in FIG.

In FIG. 1, 10 is the entire image processing device. On the display surface 11 of the display device in the image processing bag 210, rectangular display images A, B, C, etc. are superimposed and displayed in a plurality of internal rectangular display areas 11A, IIB, 11C, etc. according to their display priority order. be done.

The figure shows a case where the display priority order is C>B>A, and the rectangular display image C is displayed at the top position.

12 is a logical screen space of the display surface 11, and each coordinate on the display surface 11 and each coordinate on the logical screen space 12 have a corresponding relationship. 121A to 121C indicate the arrangement of rectangular display areas 111A to 111C developed on the logical screen space 12.

13A, 13B, and 13C are image segments in which image data of corresponding rectangular display images A, B, and C are stored. It is assumed that each image segment 13A-130 is managed by an identification number, and the identification numbers of image segments 13A-13C are 1, 2, and 3, respectively.

Reference numeral 14 denotes an image segment arrangement management table, which includes an image segment arrangement table 141A, an image segment arrangement table 141B, and an image segment arrangement table 141C in which mapping information from each of the image segments l-13A to 13C to the display surface is stored. That is, the image segment arrangement tables 141A to 141C contain segment salts, identification numbers, and rectangular display areas (121
A-121C) coordinate information, etc. are stored.

The arrangement tables 141A to 141C are arranged according to their display priority order (C>B>A) as shown.

15 is a man-machine interface input device (M
It consists of an M1-enabled Kadeka device, a tablet, a mouse, etc., and coordinates for various inputs including pick coordinates for picking a desired image segment are input.

Reference numeral 16 denotes an image processing processor (PMPU) that starts image segment pick processing and controls the operation of the entire apparatus.

F is a display management memory that stores rectangular display areas 111A to 111C of each rectangular display image A to C displayed on the display surface 11.
Identification numbers 1 to 3 of image segments A to C corresponding to rectangular display areas 171A to 171C are stored.

Note that the case where the number of image segments is three represents an example of the present invention, and the number of image segments in the present invention is not limited to three.

The image segment pick method of the present invention is implemented by each of the means described above, and is configured as follows.

That is, by inputting the desired coordinates on the display surface (11) where the contents of a plurality of image segments 1- (13A, etc.) are displayed, the image segment corresponding to the rectangular display area with the highest display priority in which the coordinate position exists is input. In the image segment pick method, which detects as the image segment to be picked.

(A) Each image segment 13 displayed on the display surface ll
A display management memory 17 is provided in which the identification number of the corresponding image segment 13A, etc. is stored in a rectangular display area 171A, etc. corresponding to the rectangular display area 111A, etc., such as A, and (B) the contents of each image segment 13A, etc. are displayed. Images are displayed in each rectangular display area 111A, etc. on the display surface 11 according to a predetermined display priority order, and corresponding images are displayed in each rectangular display area 171A, etc. on the display management memory 17 corresponding to the rectangular display area 111A, etc. on the display surface 11. Segment l-13
(C) The image segment to be picked is stored at the coordinate position on the display management memory 17 corresponding to the input coordinate position of the pick point on the display surface 11. Configure to detect.

[For production]

The effect of the present invention can be realized by using three image segments 13A to 13C.
An example will be explained in which there are .

The PMPU 16 has an image segment arrangement table 141A.
Each image segment 13 according to mapping information such as rectangular display area information to logical screen space indicated by ~141C.
After developing the data A to 13C on each rectangular display area 121A to 121C in the logical screen space 12, the corresponding rectangular display area 11 on the display surface 11 is expanded according to the display priority order.
Rectangular display images A-C are displayed on 1A-11IC.

Assuming that the display priority order of each rectangular display image A to C is CAB>A, the rectangular display image C is displayed at the top position as shown in the figure, and the rectangular display area 111A is correctly rectangular, but other The rectangular display areas 111B and 111C have a rectangular shape with a portion missing.

The mapping information from the image segments l-13A to 13C of each rectangular display image A-C displayed in this way to the display surface 11 is managed by each image segment arrangement table 141A to 141C in the image segment arrangement management table 14. Ru.

On the other hand, the PMPU 16 controls each image segment 13A to 13.
The contents of C are displayed in each rectangular display area 111A to 1 on the display surface 11.
11C according to a predetermined display priority order, rectangular display jJf areas 111A to 11IC on display surface ll.
The image segment 13 corresponding to each rectangular display area 171A to 171C on the display management memo 'J 17 corresponding to
Identification numbers A to 13C are stored.

Now, assuming that the identification numbers of the image segments 13A, 13B and 13C are 1, 2 and 3, the rectangular display area 111 on the display surface 11 as shown in the display management memory 17 in FIG.
Image segments 13A-
Identification numbers 1 to 3 of 13C are written.

When picking an image segment, the coordinates of the big point P on the display surface 11 of the MM1-incorporated Kadeka device 15 are input.

The PMPU 16 selects the input pick point P on the display surface 11.
The identification number on the display management memory 17 corresponding to the coordinates of is detected, and the image segment to be picked is detected from this identification number.

In the case of FIG. 1, the identification number stored at the coordinate position on the display management memory 17 corresponding to the coordinate position of the big point is "3".
Therefore, from now on, each image segment arrangement table 141A to 1 in the image segment arrangement management table 14
A desired image segment can be quickly detected by simply searching the identification number area of 41C.

If the identification number of the coordinate position on the display management memory 17 corresponding to the input coordinate position of the big point on the display surface 11 is "2", the image segment 13B is used, and when it is rl, the image segment 13A is used. , are respectively detected as image segments to be picked. Therefore, even if the number of image segments increases, the desired image segment to be picked can be quickly detected by referring to the display management memory 17 once.

As described above, each rectangular display area 11 on the display surface 11
Image segments 13A-13 corresponding to 1A-llIC
By using the display management memory 17 that stores the identification number of C, the image segment identification number to be picked can be immediately obtained from the display management memory 17. It is not necessary to search the entire image segment, and the desired image segment can be quickly detected by simply searching the identification number area.

Further, even if the number of image segments to be displayed increases, the identification number of the image segment to be picked can be immediately determined from the display management memory, so that the desired image segment can be picked at high speed.

Furthermore, from the above, it is possible to speed up the response when attempting to implement MMI.

〔Example〕

An embodiment of the present invention will be described with reference to FIGS. 2 and 3. FIG. 2 is an explanatory diagram of an image processing apparatus used to implement an embodiment of the present invention, and FIG. 3 is an explanatory diagram of a processing flowchart of an embodiment of the present invention.

(A) Configuration of image display device In FIG. 2, an image processing device 10, a display surface 11, rectangular display areas 111A to 111C, image segments 13A to
13C1 image segment arrangement management table 14, image segment arrangement tables 141A to 141CSMMI input device 15, image processing processor (PMPU) 16,
Display management memo IJ17, rectangular display area 171A to 171
C is as explained in FIG.

Reference numeral 18 denotes a bitmap memory (hereinafter referred to as BMM), which stores the display surface 11 developed on the logical screen space 12 shown in FIG.
The contents of one image above are stored.

In this embodiment, the display management memory 17 has a bitmap memory structure like the 8MM18, and each rectangular area 171A-171C has a corresponding image segment 13A.
Identification numbers 1 to 3 of ~13C are stored as pixel values.

Reference numeral 19 denotes a main memory (hereinafter referred to as MSU), which includes an image segment arrangement management table 14 as well as a work area ( (not shown) is provided.

Reference numeral 21 denotes a display device that reads each data of rectangular display images A to C of each image segment developed on the 8MM 18 and displays them on the display surface 11.

(B) Operation of the Embodiment The operation of the image processing apparatus 10 shown in FIG. An example of detecting the image segment 13C in this case will be described.

(B-1) Display operation of image segment contents PMPU1
6 is an image segment arrangement table 141A to 141C.
Each image segment 13A to 13C is mapped to a logical screen space according to mapping information such as rectangular display area information instructed by
Each image data is displayed in each rectangular display area 121A in the logical space.
~ 12 IC (see Figure 1), and the contents are 8M
Store in M18.

At the same time, the PMPU 16 displays each rectangular display area 12.
1A to 121C (therefore, corresponding to the rectangular display areas 111A to 111C on the display surface ll) on the display management memory 17,
Write the identification number of the corresponding image segment 13A-13C. Since the display priority order of the image segments L3A to 13C is C>B>A, the rectangular display areas 171A to 17
Identification numbers 1 to 3 are written in 1C as shown.

On the other hand, the display device 21 reads out each data of the rectangular display images A to C of each image segment expanded on the 8MM18, and displays the corresponding rectangular display areas 111A to ll on the display surface 11.
Rectangular display images A to C are displayed on the IC. Since the display priority order of the image segments 13A to 13C is C>B>A, the rectangular display image C is displayed at the top position, and then the rectangular display image B → rectangular display image A are superimposed and displayed in the order as shown in the figure. be done.

Mapping information from the image segments 13A to 13C of each rectangular display image A to C displayed on the display surface 11 is managed by each image segment arrangement table 141A to 141C in the image segment arrangement management table 14.

(B-2) Image Segment Bic Processing Bic processing of the desired image segment 13C will be described in accordance with its processing steps with reference to the image segment bip processing flowchart of FIG.

■ Process 311 When the coordinates of the start point P for starting the desired image segment are input to the MM1 input Kadeka device 15, PMPt
J16 detects the big point coordinates from the input device 15 (MM). When detecting the image segment 13C, the coordinates of the big point P are input so that it is within the rectangular display area 111C on the display surface 11.

■ Processing S It t S l: I The PMPU 16 converts the coordinates of the detected big point P into the coordinates of the logical screen space 12, and converts them into the coordinates of the pink point P on the display management memory 17 (Processing S+z) ,
An identification number is obtained from the pixel value of the big point P on the display management memory 17 (processing 513). In the case of the embodiment, since the pick point is converted onto the rectangular display area 171C, the identification number "3" of the image segment 13C is detected.

■ Processing S+4. S+s PMPU 16 is the image segment arrangement management table 14
is searched to determine the presence or absence of an image segment to be processed (processing s+,). First, image segment 13A
is selected as a processing target, and it is determined whether the identification number of the image segment arrangement table 141A is "3" (processing S1.). The identification number for image segment 141 is "1"
Therefore, it is determined that it is rNOJ.

■ Processing Sl? If rNOJ is determined in process 315, the next image segment table in the image segment placement management table 14 (referred to as the image segment placement table 141B for image segment B) is updated to the next search target.

■ Thereafter, the above-mentioned processing 314 and srs processing are performed, but since the identification number in the image segment arrangement table 141B is "2", rNo.
It is determined that As a result, the next image segment arrangement table 141C is updated to the next search target in step S17.

(2) Process 316 The above-described processes SI4 and SIS are repeated for the image segment arrangement table 141C, but since the identification number in the image segment arrangement table 141C is "3", it is determined as "YESJ" in process SI5.

From this, the image segment name (image segment 13C) is obtained from the image segment arrangement table 141C,
Let image segment 13C be a big image segment (
Processing S,,).

As described above, by referring to the display management memory 17, the identification number of the image segment to be searched can be detected.
Each image segment arrangement table 141A to 141C in
By searching only the identification number area, the image segment to be searched can be quickly detected.

Similarly, the pick point P is located in the rectangular display area 1 of the display surface 11.
When the pick point P is within the rectangular display area 111A, the image segment 13B is surprised, and when the pick point P is within the rectangular display area 111A, the image segment A is surprised.

Although one embodiment of the present invention has been described above, the embodiment of the present invention is not limited to this embodiment. for example,
If the corresponding image segment name is directly used as the identification number of the image segment stored in each rectangular display area 1718 in the display management memory 17, the image segment big processing can be further speeded up. Also,
The correspondence between identification numbers and image segments may be stored in a table separate from the image segment arrangement management table 14.

〔Effect of the invention〕

As explained above, according to the present invention, the following effects can be obtained.

(1) By using a display management memory that stores the identification number of the image segment corresponding to each rectangular display area on the display surface, the identification number of the image segment to be searched can be immediately determined from this display management memory, so the image segment arrangement It is not necessary to search all of the image segment arrangement tables in the management table, and a desired image segment can be quickly detected by simply searching its identification number area.

(2) Even if the number of image segments to be displayed increases, the identification number of the image segment to be checked can be immediately determined from the display management memory, so that the desired image segment can be checked at high speed.

(3) The above-mentioned (1) and (2) can speed up the response when attempting to realize a man-machine interface.

[Brief explanation of the drawing]

Fig. 1 is a diagram of the principle of the present invention, Fig. 2 is an explanatory diagram of an image processing device used to implement an embodiment of the invention, Fig. 3 is a processing flowchart of an embodiment of the invention, and Fig. 4 is An explanatory diagram of the conventional image segment big method. FIG. 5 is a flowchart of the conventional image segment big process. 171A to 171C...Rectangular display area, 18...
・Bitmap memory (BMM), 19... Main memory (MSU), 21... Display unit.

Claims (1)

[Claims] Enter desired coordinates on the display surface (11) on which the contents of a plurality of image segments (13A, etc.) are displayed, and the coordinate position corresponds to the rectangular display area with the highest display priority. In the image segment pick method that detects an image segment as a pick target image segment, (A) a rectangular display area corresponding to a rectangular display area (111A, etc.) of each image segment (13A, etc.) displayed on the display surface (11); (171A, etc.) is provided with a display management memory (17) in which the identification number of the corresponding image segment (13A, etc.) is stored, and (B) each image segment (13A, etc.)
The contents of each rectangular display area (111A) within the display surface (11)
etc.) according to a predetermined display priority order, and display each rectangular display area (
171A, etc.), the corresponding image segment (13A, etc.)
(C) The image to be picked is stored from the identification number stored at the coordinate position on the display management memory (17) corresponding to the coordinate position of the input pick point on the display surface (11). An image segment pick method characterized by detecting segments.