JP2018156321A - Image processing device, information processing method, and program - Google Patents

Abstract

An object of the present invention is to reduce the possibility of drawing an object in time for display.
An image processing apparatus having a memory, comprising: a first acquisition unit that acquires display information of an object displayed on a display unit; a second acquisition unit that acquires a drawing time of an object; Extraction means for extracting the free space, and control means for controlling whether to release the off-screen area of the object in the memory based on the display information of the object, the drawing time of the object, and the free space.
[Selection] Figure 2

Description

  The present invention relates to an image processing apparatus, an information processing method, and a program.

An image forming apparatus that reads a graphics description language, draws an object in an off-screen area secured on a memory, and displays the object once drawn on the off-screen area on a display in accordance with a drawing magnification specified by a user. is there.
Patent Document 1 suppresses the consumption of the off-screen area by releasing the off-screen area of an object that has already been displayed and whose contents are not changed or less frequently updated, and holding it in an intermediate data state. Techniques to do this are disclosed.

JP 2008-293065 A

  However, since Patent Document 1 does not consider the time required for the object redrawing process, when an object update request is made, the object may not be redrawn in time and cannot be displayed.

  An image processing apparatus according to the present invention is an image processing apparatus having a memory, and includes a first acquisition unit that acquires display information of an object displayed on a display unit, and a second acquisition that acquires a drawing time of the object. Whether to release the off-screen area of the object in the memory based on the means, the extracting means for extracting the free capacity of the memory, the display information of the object, the drawing time of the object, and the free capacity And control means for controlling.

  According to the present invention, it is possible to reduce the possibility that drawing of an object will not be in time for display.

2 is a diagram illustrating an example of a hardware configuration of a multifunction peripheral. FIG. FIG. 3 is a diagram illustrating an example of a software configuration of a multifunction machine. FIG. 3 is a diagram illustrating an example of a graphics description language read by a multifunction peripheral. It is a figure which shows an example of a screen object. It is a flowchart which shows an example of information processing. It is a figure which shows the constant k.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a diagram illustrating an example of a hardware configuration of the multifunction machine 110. The multifunction device 110 includes a controller unit 200, an operation unit 220, a scanner 230, and a printer 240 as hardware configurations. The multifunction device 110 is an example of an image processing apparatus. The operation unit 220 is an example of a display unit.
More specifically, the controller unit 200 includes a CPU (Central Processing Unit) 202. The CPU 202 starts up an OS (Operating System) by a boot program stored in a ROM (Read Only Memory) 206. The controller unit 200 executes application programs stored in an HDD (Hard Disk Drive) 205 on the OS, thereby executing various processes. A RAM (Random Access Memory) 203 is used as a work area of the CPU 202. The HDD 205 stores application programs and various data.
An operation unit I / F 201, device I / F 204, network I / F 207, and image processing unit 208 are connected to the CPU 202 via the system bus 210, along with the RAM 203 and ROM 206.
An operation unit I / F 201 is an interface with an operation unit 220 having a touch panel. The operation unit I / F 201 sends information such as various data to be displayed on the operation unit 220 or sends information input by the user to the CPU 202. A scanner 230 and a printer 240 are connected to the device I / F 204, and data and control signals are input and output. A network I / F 207 is connected to the network 100 and performs input / output between the devices on the network 100 and the multifunction peripheral 110 via the network 100. The image processing unit 208 performs processing such as input image processing from a scanner, output image processing to a printer, image rotation, image compression, resolution conversion, color space conversion, and gradation conversion.
When the CPU 202 executes processing based on programs stored in the ROM 206 and the HDD 205, the software configuration of the multifunction peripheral 110 shown in FIG. 2 described later and the processing shown in the flowchart shown in FIG. 5 described later are realized.

FIG. 2 is a diagram illustrating an example of a software configuration and the like of the multifunction machine 110. The MFP 110 includes, as a software configuration, a renderer unit 102, a drawing time measurement unit 103, an object display information extraction unit 104, a memory information extraction unit 105, an off-screen determination unit 106, and an off-screen control unit 107. The memory 108 is the RAM 203 in FIG.
The renderer unit 102 reads the drawing command 101, performs drawing processing, and stores the drawn object in the off-screen area of the memory 108. At this time, the drawing time measuring unit 103 measures the time required for the drawing process of each object, and transmits it to the off-screen determining unit 106. On the other hand, the object display information extraction unit 104 reads the drawing command 101, extracts the display period of each object on the screen, and transmits it to the off-screen determination unit 106. In addition, the memory information extraction unit 105 extracts the available memory capacity from the memory 108 and transmits it to the off-screen determination unit 106. The off-screen determination unit 106 determines whether or not to release the off-screen area of the object based on the measurement results of the drawing time measurement unit 103, the extraction results of the object display information extraction unit 104, and the memory information extraction unit 105. Is transmitted to the off-screen control unit 107. Based on the determination result of the off-screen determination unit 106, the off-screen control unit 107 releases the off-screen area of the corresponding object in the memory 108 at the start time of the period in which the corresponding object is not displayed on the touch panel of the operation unit 220. . The process of the object display information extraction unit 104 is an example of a first acquisition process. The process of the drawing time measurement unit 103 is an example of a second acquisition process.

The object display information extracted by the object display information extraction unit 104 will be described. The object display information extraction unit 104 extracts object display information from a description of an object in a graphics description language. FIG. 3 is a diagram illustrating an example of Scalable Vector Graphics that is one of the graphics description languages read by the multifunction peripheral 110. In Scalable Vector Graphics, the drawing processing order is the order of drawing description. Therefore, the object corresponding to the description of the last object is displayed on the foreground of the display screen. Hereinafter, the graphics description language “Scalable Vector Graphics” is referred to as a drawing command.
The drawing commands in FIG. 3 can be classified into object descriptions 50, 52, and 53 and other descriptions 51. FIG. 4 shows the first frame image in the drawing result of the drawing command of FIG. The description 50 is a description defining a screen having a width of 500 pixels and a height of 500 pixels, and is a description corresponding to the screen object 300 in FIG. A description 51 is a description for creating a gradation of red and orange. The description 52 is a description for drawing a rectangular object as indicated by the first circle of the description of (1). The description (1) in the description 52 is a description corresponding to the circle object 301 painted with a red and orange gradation defined in the description 51 with a radius of 50 pixels around the coordinates X = 50 and Y = 200. . The description (2) in the description 52 indicates that the circle object 301 has coordinates X = 50 and Y = 200 to coordinates X = 450 and Y = 200 at 50 pixels / s from the start of display as indicated by the arrow in FIG. It is a description showing performing the operation of moving up to. A description 53 is a description corresponding to a blue rectangular object 302 with coordinates of X = 150 and Y = 150 as the upper left corner coordinates, a width of 200 pixels, a height of 100 pixels.
Therefore, from these descriptions, the circle object 301 overlaps the rectangular object 302 and is not displayed on the screen in the frame from 3.0 seconds to 5.0 seconds after the first display frame because it overlaps the rectangular object 302 and is arranged behind. Further, the screen object 300 and the rectangular object 302 remain displayed on the screen. Therefore, the object display information extraction unit 104 does not display the circle object 301 on the screen for 2 seconds from 3.0 seconds to 5.0 seconds after the display start, and the screen object 300 and the rectangular object 302 remain displayed on the screen. Extract the information that there is. In this embodiment, display information on the object screen is extracted from the object size, position, and movement information. However, the object display information extraction unit 104 may extract the information based on information such as transparency.

Next, the determination method of the off-screen determination unit 106 when the drawing command shown in FIG. 3 is drawn will be described with reference to the flowchart of FIG. 5 and FIG. FIG. 5 is a flowchart illustrating an example of information processing. FIG. 6 is a diagram illustrating the constant k.
In step S <b> 400, the off-screen determination unit 106 receives display information of each object from the object display information extraction unit 104. The display information of each object is that the screen object 300 and the rectangular object 302 remain displayed on the screen, and the circle object 301 is not displayed on the screen for 2 seconds from 3.0 seconds to 5.0 seconds after the start of display. Information. In step S <b> 401, the off-screen determination unit 106 receives, from the drawing time measurement unit 103, a measurement result of the time actually required for drawing processing of each object. Assume that the screen object 300 takes 50 ms to draw one frame, the rectangular object 302 takes 30 ms to draw one frame, and the circle object 301 takes 100 ms to draw one frame. In step S <b> 402, the off-screen determination unit 106 receives the current available memory capacity from the memory information extraction unit 105. In S403, the off-screen determination unit 106 determines the constant k of the evaluation formula to be evaluated in the subsequent S404 with respect to the current free space in the memory. Here, the constant k will be described with reference to FIG. A graph 500 in FIG. 6 is a graph in which the vertical axis represents the constant k and the horizontal axis represents the free memory capacity. When the free space of the memory is small, the constant k is set to 1 in order not to reduce the delay of other processes. The value of the constant k decreases monotonously as the memory is freed up.

In S404, the off-screen determination unit 106 uses the time when the object received in S400 is not displayed on the screen, the time required for drawing the object received in S401, and the constant k determined in S403 for each object. The following formula (1)
Time required for drawing an object> k × time when an object is not displayed on the screen (1)
To evaluate. Since the time during which the screen object 300 is not displayed on the screen is 0, the right side of Expression (1) is 0, which satisfies Expression (1). When Expression (1) is satisfied, the process proceeds to S405, and the off-screen determination unit 106 determines to hold the off-screen area of the screen object 300 as it is. Similarly, since the time during which the rectangular object 302 is not displayed on the screen is 0, Expression (1) is satisfied. When Expression (1) is satisfied, the process proceeds to S405, and the off-screen determination unit 106 determines to hold the off-screen area of the rectangular object 302 as it is. The time when the circle object 301 is not displayed on the screen is 2 seconds. The time required to draw one frame is 100 ms = 0.1 seconds. Therefore, the constant k approaches 1 when the free memory capacity is small, and does not satisfy Expression (1). When Expression (1) is not satisfied, the process proceeds to S406, and the off-screen determination unit 106 determines to release the off-screen area of the circle object 301. On the other hand, in a state where the memory is almost free, the constant k approaches 0 as much as possible, and therefore Expression (1) is satisfied. When Expression (1) is satisfied, the process proceeds to S405, and the off-screen determination unit 106 determines to hold the off-screen area of the circle object 301 as it is.
The off-screen control unit 107 releases the off-screen area of the corresponding object at a timing at which the corresponding object is not displayed on the screen based on the result determined by the off-screen determination unit 106.

  As described above, the multi-function device 110 controls the off-screen area of the memory based on the display information of each object, the drawing time, and the free space of the memory, thereby reducing the consumption amount. Delay can be reduced. In addition, when there is room in the memory, the rendering process load of the renderer can be reduced by not releasing the off-screen area.

<Other embodiments>
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium. It can also be realized by a process in which one or more processors in the computer of the system or apparatus read and execute the program. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

The exemplary embodiment of the present invention has been described in detail above, but the present invention is not limited to the specific embodiment.
A part or all of the software configuration of the multifunction device 110 described above may be implemented in the multifunction device 110 as a hardware configuration.
Further, as the hardware configuration of the multifunction peripheral 110, it is not necessary to have a single CPU, RAM, ROM, HDD, network I / F, or the like. A plurality of CPUs may execute functions while using data stored in a plurality of RAMs, ROMs, HDDs, and the like based on a program to realize the functions of the multifunction peripheral 110.

  According to each of the embodiments described above, it is possible to reduce the delay of other task processing while efficiently using the memory. Further, it is possible to reduce the possibility that the drawing of the object will not be in time for display.

110 MFP 200 Controller unit 202 CPU
203 RAM

Claims (7)

An image processing apparatus having a memory,
First acquisition means for acquiring display information of an object displayed on the display unit;
Second acquisition means for acquiring the drawing time of the object;
Extraction means for extracting the free capacity of the memory;
Control means for controlling whether to release the off-screen area of the object in the memory based on the display information of the object, the drawing time of the object, and the free space;
An image processing apparatus. A determination unit for determining whether to release the off-screen area of the object in the memory based on the display information of the object, the drawing time of the object, and the free space;
The control means releases the off-screen area of the object in the memory when the determination means determines that the off-screen area of the object in the memory is released, and does not release the off-screen area of the object in the memory by the determination means. The image processing apparatus according to claim 1, wherein the image processing apparatus holds the off-screen area when it is determined.   The image processing apparatus according to claim 1, wherein the first acquisition unit acquires display information of the object based on the size, position, and movement information of the object described in a drawing command.   The image processing apparatus according to claim 3, wherein the first acquisition unit further acquires display information of the object based on transparency information of the object described in the drawing command.   The image processing apparatus according to claim 1, wherein the first acquisition unit acquires a period during which the object is not displayed on the screen as the display information. An information processing method executed by an image processing apparatus having a memory,
A first acquisition step of acquiring display information of an object displayed on the display unit;
A second acquisition step of acquiring a drawing time of the object;
An extraction step of extracting the free capacity of the memory;
A control step for controlling whether or not to release the off-screen area of the object in the memory based on the display information of the object, the drawing time of the object, and the free space;
An information processing method including:   A program for causing a computer having a memory to function as each unit of the image processing apparatus according to any one of claims 1 to 5.

Images