JP2014222299A - Image processing device, program, information storage medium, and production method of image processing device - Google Patents

Abstract

Proper afterimage erasure is made possible for electronic paper display. In an image display apparatus, a display unit that operates based on a display unit including electronic paper, a frame buffer, a display control unit, and an application program, and displays on the electronic paper using a GUI component of a GUI library. A class related to drawing of a display image, including an application processing unit that performs an image drawing request, and a drawing processing unit that executes a program of a GUI component corresponding to the drawing request from the application program and a GUI component of a base class thereof An electronic paper afterimage erasure process is incorporated in the GUI component of the base class of the hierarchy, and the electronic paper afterimage erasure process is performed when the display image drawing process is performed. [Selection] Figure 1

Description

  The present invention relates to an image processing device, a program, an information storage medium, and a method for manufacturing the image processing device.

  In recent years, there has been an increasing demand for electronic paper with advantages such as excellent visibility and low power consumption, and it is used for electronic book readers (electronic book readers), electronic signage (digital signage), and some mobile phones. ing.

  Applications that generate images to be displayed on electronic paper in these electronic devices are diverse and complex, and in order to facilitate their development, application frameworks (in which data structures and library functions are defined in advance) ( "GUI toolkit") is used. This application framework is stored in a memory of an electronic device and operates as a GUI (Graphical User Interface) system (also referred to as a “graphic system”) on an embedded OS.

  Basically, it is essential that drawing of an application in the GUI system is completed within a handler of the drawing event when a drawing event is notified from the GUI system. As a result, the management of the drawing process can be left to the GUI system, so that the application does not have to manage the drawing process in detail.

  However, as shown in FIGS. 18 and 19, the electronic paper has a characteristic afterimage phenomenon. When the white 520 is drawn on the image 510 having the white area and the black area displayed on the electronic paper, the white color differs depending on the previous color even if the white 520 is drawn. Reference numeral 530 indicates whiteness when the previous color is white, and reference numeral 540 indicates whiteness when the previous color is black.

  In addition, when writing a document such as a character on electronic paper, the display is turned over as shown in FIG.

  Further, as shown in FIG. 20, electronic paper has a characteristic black blur phenomenon. Since the black region is actually wider than the portion displayed in black, even if the same character is overwritten with another color (white), the outline remains as shown in FIG.

Japanese Patent Laid-Open No. 5-128264

  When using a general-purpose GUI library in electronic paper application development, to prevent the above-mentioned special afterimage phenomenon and black blurring phenomenon each time drawing is performed in an event handler of a GUI component such as a button or a dialog. It is necessary to perform afterimage erasing processing. In other words, an application that displays electronic paper must execute Cleanup to remove afterimages and black blurs every time the screen display is updated.

  There are several types of cleanup (those with few flashes but not very clean-flashes that stand out but surely erase afterimages), and it is necessary to use them properly. The timing for executing Cleanup is from the frame buffer to the EPD panel. Cleanup execution is complicated, such as the need to synchronize by stopping and restarting display reflection. And since it is unfamiliar to general application developers, it has been difficult to perform an appropriate afterimage erasing process in an application program.

  The present invention has been made in view of the above problems, and according to some aspects of the present invention, in an application for displaying electronic paper using a GUI library, afterimage erasure can be performed by an application. It is possible to provide an image processing apparatus, a program, an information storage medium, and a method for manufacturing the image processing apparatus that can appropriately erase an afterimage without performing the process.

  SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following aspects or application examples.

(1) In this application example, a display unit including electronic paper, a frame buffer for storing image data to be displayed on the display unit, and an image corresponding to the image data written in the frame buffer are displayed on the display unit. A display control unit that performs control to be displayed on the electronic paper;
An application processing unit that operates based on an application program and makes a display image display request to be displayed on an electronic paper using a GUI component of the GUI library, and the GUI component that constitutes the GUI library has an object-oriented class hierarchical structure In response to a drawing request from an application program, the corresponding GUI component and its base class GUI component program are executed to generate image data corresponding to the drawing request, and the image data is A rendering processing unit that performs processing to write to a frame buffer, and the rendering processing unit includes a base class GUI component of a class hierarchy related to rendering of the display image, and an afterimage erasing process of the electronic paper is incorporated. Afterimage of electronic paper when drawing the display image It relates to an image processing apparatus for performing the processed (clean-up process).

  In addition, this application example is a program that performs display control on electronic paper, and configures a GUI library that is called from an application program and performs display control on electronic paper. The GUI components that configure the GUI library are object-oriented. The class has a hierarchical structure, and in response to a drawing request from an application program, the corresponding GUI component and its base class GUI component program are executed to generate image data corresponding to the drawing request, and the image A rendering processing unit that performs processing of writing data to a frame buffer for storing image data to be displayed on electronic paper, and causing the computer to function, wherein the rendering processing unit is a base class of a class hierarchy related to rendering of the display image In the GUI parts, the electronic paper And afterimage erasing processing is incorporated, when performing a drawing process of the display image, a program for performing after-image elimination processing of the electronic paper (the clean-up process).

  The application example also relates to a recording medium in which the above-described program is stored.

  Further, the present application example is a method of manufacturing an image processing apparatus having electronic paper, and a GUI component of a base class of a class hierarchy related to drawing of a display image in a GUI library composed of GUI parts having an object-oriented class hierarchical structure A step of performing correction to incorporate after-image erasing processing of the electronic paper, a step of creating an application for controlling display of EPD using the GUI library, and a device having the modified GUI library and the created application in the electronic paper And a method of manufacturing the image processing apparatus.

  According to this application example, in the application for displaying electronic paper using the GUI library, it is possible to perform appropriate afterimage erasure without performing afterimage erasure by the application. Therefore, it is possible to develop an application without considering afterimage processing unique to electronic paper.

  Moreover, it is only necessary to embed electronic paper afterimage erasure processing (cleanup processing) in the GUI component of the base class of the class hierarchy related to the drawing of the GUI library, and also add mounting to various components derived from the processing or new components. It is applicable without.

  In addition, since an optimum afterimage erasing process corresponding to the content of each GUI component can be reliably incorporated and provided, there is no risk that the application developer will make a mistake in usage.

(2) In the image processing apparatus, the program, the information storage medium, and the image processing apparatus manufacturing method according to this application example, the application processing unit specifies the drawing position information of the display image for the GUI component and performs the drawing request. The drawing processing unit may perform the afterimage erasing process of the electronic paper by determining the position of the region where the afterimage erasing process is performed based on the drawing position information.

  The flicker associated with the afterimage erasure process is less noticeable when the target area of the afterimage erasure process is smaller. Therefore, it is preferable to perform the afterimage erasure process only in a necessary area.

  In this way, the afterimage erasing process can be performed only in a necessary area without being conscious of the application, and therefore, the afterimage erasing process can be performed while minimizing the flicker caused by the afterimage erasing process. it can.

(3) In the image processing device, the program, the information storage medium, and the method for manufacturing the image processing device according to this application example, the drawing processing unit is based on the type of display image or the drawing content (for example, contact position information). The size of the area to be erased may be determined, and the afterimage erasing process of the electronic paper may be performed for the area of the determined size.

  In this way, the afterimage erasing process can be performed only on a region having a required size without being conscious of the application, and thus the afterimage erasing process with minimal flickering can be performed.

(4) In the image processing apparatus, the program, the information storage medium, and the image processing apparatus manufacturing method according to this application example, the drawing processing unit incorporates a plurality of different types of afterimage erasing processes in the base class GUI component. Depending on the type of GUI component executed in the derived class or the type of image to be drawn, the type of afterimage erasing process may be determined and the determined type of afterimage erasing process may be performed.

  In this way, an afterimage erasing process of an appropriate type can be performed according to the type of image without being conscious of the application.

(5) In the image processing apparatus, the program, the information storage medium, and the image processing apparatus manufacturing method according to this application example, the GUI library is customized to change an afterimage processing type selection algorithm of the base class GUI component. The application processing unit performs a change request to change the selection algorithm of the afterimage processing type of the base class GUI component to a given content using the customization GUI component; In the drawing processing unit, the customization GUI component may change the selection algorithm of the afterimage processing type of the base class GUI component to a given content in response to the change request.

  In this way, the afterimage processing of the base class GUI component can be customized from the application. Therefore, it is possible to cope with a case where an afterimage erasing process different from the afterimage erasing process prepared in the GUI library is desired in the application.

1 is a diagram illustrating a configuration example of an image processing apparatus according to an embodiment. The figure for demonstrating the afterimage erasing process of electronic paper. The figure which shows the example of a class structure of the GUI component of a general purpose GUI library. The figure which shows the class hierarchy example (simplified example) regarding drawing of a display image. The figure which shows the flow of the data in a hardware / software hierarchy. The figure for demonstrating the afterimage deletion area | region in the case of displaying a button object. The figure for demonstrating the afterimage deletion area | region in the case of displaying "Doodle". The figure for demonstrating the kind and feature of Cleanup for afterimage deletion. The figure which shows the example of a cleanup process sequence for the afterimage deletion of a comparative example. The figure which shows the example of a cleanup process sequence for the afterimage deletion of this Embodiment. 1 is an external view of an electronic book terminal according to an embodiment. The figure which shows the hardware structural example inside the electronic book terminal of this embodiment. 1 is a block diagram of an electrophoretic display device according to an embodiment. FIG. 3 is a diagram illustrating a configuration example of a pixel of an electrophoretic display device according to an embodiment. FIG. 15A is a diagram illustrating a configuration example of an electrophoretic element, and FIGS. 15B and 15C are explanatory diagrams of operations of the electrophoretic element. 1 is a diagram illustrating an example of an image processing apparatus according to an embodiment. 4 is a flowchart showing a method for manufacturing the image processing apparatus according to the present embodiment. The figure which shows the afterimage phenomenon peculiar to electronic paper. The figure which shows the afterimage phenomenon peculiar to electronic paper. The figure which shows the black bleeding phenomenon peculiar to electronic paper.

  DESCRIPTION OF EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings. The embodiments described below do not unduly limit the contents of the present invention described in the claims. Also, not all of the configurations described below are essential constituent requirements of the present invention.

1. Image processing apparatus 1-1. Configuration FIG. 1 is a diagram illustrating a configuration example of an image processing apparatus according to the present embodiment. As shown in FIG. 1, the image processing apparatus 1 according to the present embodiment includes a processing unit (CPU) 10, an operation unit 20, a storage unit 30, a display control unit 40, a display unit 50, a sound output unit 60, and a communication unit 70. It is configured to include. The image processing apparatus 1 of the present embodiment may have a configuration in which some of the components (each unit) in FIG. 1 are omitted or changed, or other components are added.

  The operation unit 20 is an input device including operation keys, button switches, and the like, and outputs an operation signal corresponding to an operation by a user to the processing unit (CPU) 10.

  The storage unit 30 stores programs, data, and the like for the processing unit (CPU) 10 to perform various types of calculation processing and control processing. In particular, in the present embodiment, the storage unit 30 stores various application programs 32 accompanied by a drawing request to the display unit 50, a GUI library 38, a data file 34 storing image data, and the like.

  The GUI library 38 is a library that is called from an application program and performs display control on electronic paper. The GUI components that constitute the GUI library 38 have an object-oriented class hierarchical structure. In response to the drawing request, the corresponding GUI component and its base class GUI component program (including methods) are executed to generate image data corresponding to the drawing request and display the image data on the electronic paper. The computer is caused to function as a drawing processing unit that performs processing for writing into a frame buffer for storing image data. The GUI part of the base class of the class hierarchy related to drawing of the display image incorporates an afterimage erasing process of the electronic paper, and when the display image is drawn, the afterimage erasing process (cleanup process of the electronic paper) is performed. )I do.

  The storage unit 30 is also used as a work area for the processing unit (CPU) 10. In particular, in this embodiment, a frame buffer 36 is provided in a part of the storage area.

  The frame buffer 36 is a storage area for storing image data included in the data file 34, image data created in response to a predetermined input operation by the user, and the like.

  The sound output unit 60 is a device that outputs sound, such as a speaker, and outputs various sounds (including sound) based on signals input from the processing unit (CPU) 10.

  The communication unit 70 is for performing data communication with other devices connected to a wired or wireless communication network under the control of the processing unit (CPU) 10.

  The display unit 50 is a display device that includes an electronic paper 52, and an image corresponding to the image data stored in the frame buffer 36 is displayed on the electronic paper 52. Various types of electronic paper 52 can be used. For example, an electrophoresis type that switches charged particles by moving the display, a particle rotation type that switches charged particles by rotating the charged particles, or a magnetophoretic method that switches particles by moving the particles by magnetism A display method using a small battery-driven thin liquid crystal or EL element, a display method using a liquid crystal having a memory characteristic typified by a ferroelectric liquid crystal, or the like can be appropriately employed as the electronic paper 52.

  The display unit 50 may include a contact position detection unit 54. The contact position detection unit 54 detects a contact position with respect to the electronic paper 52 and outputs information on the contact position, and can be realized by, for example, a digitizer.

  The display control unit 40 performs control to display an image corresponding to the image data written in the frame buffer 36 on the electronic paper 52 of the display unit 50.

  The processing unit (CPU) 10 performs various calculation processes and control processes in accordance with various programs stored in the storage unit 30. In particular, in the present embodiment, the processing unit (CPU) 10 includes an input operation detection processing unit 12, an application processing unit 14, a drawing processing unit 16, and an image data transfer processing unit 18. However, the processing unit (CPU) 10 of the present embodiment may have a configuration in which some of these configurations (elements) are omitted or changed, or other configurations (elements) are added.

  The input operation detection processing unit 12 performs a process of detecting an input operation by the user based on an operation signal from the operation unit 20 or the like. Further, the input operation detection processing unit 12 may detect a user input operation on the electronic paper 52 based on the detection result of the contact position detection unit 54.

  The application processing unit 14 operates based on the application program 32 and performs processing according to the input operation detected by the input operation detection processing unit 12. That is, the processing unit (CPU) 10 functions as the application processing unit 14 by executing the application program 32.

  The drawing processing unit 16 operates based on a program such as a GUI component in the GUI library 38, generates image data corresponding to a drawing request from the application processing unit 14 and the like, and writes the image data in the frame buffer 36 I do.

  The application processing unit 14 operates based on the application program 32, makes a display image display request to be displayed on the electronic paper 52 using the GUI component of the GUI library 38, and the drawing processing unit 16 stores the GUI library. The configured GUI parts have an object-oriented class hierarchical structure. In response to a drawing request from the application program 32, the corresponding GUI part and its base class GUI part program are executed to respond to the drawing request. The image data is generated and the image data is written into the frame buffer. The GUI component of the base class of the class hierarchy related to the drawing of the display image of the GUI library 38 incorporates the afterimage erasing process of the electronic paper 52, and the drawing processing unit 16 performs the drawing process of the display image. Then, an afterimage erasing process (cleanup process) of the electronic paper 52 is performed.

  The GUI library 38 is an application framework in which a data structure and a library function are defined in advance, and includes a plurality of GUI parts having an object-oriented class hierarchical structure. The GUI library may be a library provided for general use.

  The application processing unit 14 may be realized by an application program installed in the image processing apparatus being executed by a CPU or the like. The drawing processing unit 16 may be realized by executing a GUI component or an operating system (such as a frame buffer driver) of the GUI library 38 on the CPU.

  The application processing unit 14 designates the drawing position information of the display image for the GUI component and makes a drawing request, and the drawing processing unit 16 determines the position of the region where the afterimage erasing process is performed based on the drawing position information. You may perform the afterimage deletion process of an electronic paper.

  The drawing processing unit 16 determines the size of the area where the afterimage erasing process is performed based on the type of display image or the drawing content (contact position information), and performs the afterimage erasing process of the electronic paper for the area of the determined size. May be.

  Since the size of the display image to be drawn is determined according to the type of display image (for example, a display object such as a button or a dialog, or handwritten input or a photograph), at least one of the current display image and the past display image is determined. The size of the area where the afterimage erasing process is performed may be determined based on the type of one display image.

  In addition, when drawing graffiti input on the display unit, afterimage removal processing is performed by determining the area (position and size) containing the graffiti based on the drawing contents (coordinates of sample points of the movement locus of the contact position, etc.). May be.

  The GUI component of the base class of the class hierarchy related to the rendering of the display image of the GUI library 38 incorporates a plurality of different types of afterimage erasing processing, and the rendering processing unit 16 determines the type of GUI component executed by the derived class or The type of afterimage erasing process may be determined according to the type of image to be drawn, and the determined type of afterimage erasing process may be performed.

  The GUI library 38 includes a customization GUI component that changes a selection algorithm for the type of afterimage processing of the base class GUI component, and the application processing unit 14 uses the customization GUI component to change the base class GUI component. A change request is made to change the selection algorithm for the type of afterimage processing of the part to a given content, and the drawing processing unit 16 determines that the customization GUI part is the base class GUI part in response to the change request. The selection algorithm of the afterimage processing type may be changed to a given content.

  The selection algorithm for the type of afterimage processing of the GUI component may be described as a method, for example. For example, in the base class GUI component, when the default afterimage erasure processing is the first type of afterimage erasure processing, the application program calls the customization GUI component to set the default afterimage erasure processing to the second type. A change request can be made that requires a change. In this way, the customization GUI component changes the default afterimage erasure processing of the base class GUI component to the second type in response to the change request. 2 types.

  The application program 32, the data file 34, and the GUI library 38 may be stored in the storage unit 30 from the beginning, but the processing unit (CPU) 10 is stored in a computer-readable information storage medium. The application program 32, the data file 34, and the GUI library 38 may be read and downloaded to the storage unit 30. Computer-readable information storage media include, for example, optical discs (compact disc (CD), digital versatile disc (DVD), Blu-ray disc (BD), laser disc (LD), etc.), magneto-optical disc (MO), and magnetic disc. (Hard disk drive (HDD), floppy disciple (FD), etc.), magnetic tape (digital data storage (DDS), etc.), memory (flash memory, memory card, USB memory, etc.), etc.

  Alternatively, the processing unit (CPU) 10 receives the application program 32, the data file 34, and the GUI library 38 stored in a device such as a personal computer (server) via the communication unit 70 and stores them in the storage unit 30. You may download it.

1-2. FIG. 2 is a diagram for explaining the afterimage erasing process of electronic paper.

  If the first image 560 displayed on the electronic paper is updated with the second image 562, the first image (previous image) 560 is turned over and an image 564 with black blurring remains. It is necessary to execute the after-image erasing process 572 of the electronic paper by issuing a Cleanup command (command for erasing the after-image of the electronic paper) 570.

  The electronic paper afterimage erasing process 572 is performed by, for example, an EPD controller (controller for controlling electronic paper) controlling the EPD panel (an example of electronic paper) from all black to all white to all black. Flash all black → all white → all black. As a result, the second image 566 in which the reverse of the previous image and the black blur are removed is displayed on the electronic paper.

1-3. Display control using a GUI library The application according to the present embodiment is a general-purpose GUI library (an application framework in which a data structure and a library function are defined in advance) when describing processing for displaying on electronic paper. The drawing part of the display image is requested using the GUI parts (data structure and library function (drawing function etc.)).

  FIG. 3 is a diagram showing an example of a class structure of GUI parts of a general-purpose GUI library.

  The GUI parts 420, 430, 432, 434, 440, etc. constituting the GUI library 400 have an object-oriented class hierarchical structure. A class hierarchy using derivation / inheritance of an object-oriented language (for example, C ++) derives more complicated functions step by step from more basic function classes. For example, the GUI component 420 becomes a base class of the class hierarchy 410 related to drawing of a display image. The GUI parts 430, 440 and the like are derived classes of the GUI part 420. The GUI parts 432, 434 and the like are derived classes of the GUI part 430. The base class-derived class may be called superclass-subclass, parent class-child class, but they are synonymous.

  FIG. 4 is a diagram illustrating a class hierarchy example (simplified example) related to display image rendering.

  As a derived class of the base class of all objects (GUI component 402), there is a base class of all display images (GUI component 420 of the base class of the class hierarchy 410 relating to drawing of the display image in FIG. 3). Derived classes of the base class (GUI component 430) of all button objects include a push button class (GUI component 432), a radio button class (GUI component 434), and other button classes. For example, in the push button class GUI component 432, the push button-specific image rendering process is defined as a method. In the GUI component 430 of the base class of all button objects, an image rendering process common to all button objects is defined as a method. In the GUI component 420 defined as the base class of display objects, image drawing processing and cleanup processing common to all display objects are defined as methods.

  In the present embodiment, among all the class hierarchies of the GUI library 400, a base class in the class hierarchy 410 relating to the rendering of the display object (may be referred to as a base class in the class hierarchy relating to the display), that is, By embedding afterimage removal cleanup processing in the most basic display processing related to the display function (specifying as a method), in all of the upper GUI components 430, 432, 434, 436, etc. derived therefrom, The afterimage erasure is automatically performed.

  That is, a drawing request (drawing instruction + rectangular information to be drawn) 452 from the application program descends in the reverse direction of the inheritance / derivation of the display class hierarchy, and the class of each hierarchy performs drawing processing specific to that class. Do more, and leave the drawing to the lower base class for more basic processing. For example, push button class GUI parts perform push button-specific image rendering processing, and all button object base class GUI parts perform image rendering processing common to all button objects and are related to display. In the GUI component 420 of the base class of the class to be processed, an image drawing process common to all display objects is performed, and finally, Cleanup for deleting the afterimage of the target rectangle is executed.

1-4. Hardware / Software Hierarchy FIG. 5 is a diagram showing a data flow in the hardware / software hierarchy in the present embodiment.

  In the present embodiment, software executed by the CPU 110 is hierarchized in order of the operating system 131, the graphic system 132 (including the GUI library), and the graphic display application 133 (an example of an application) from the lowest layer. The operating system 131 interfaces with the hardware. The graphic system 132 mediates data exchange between the operating system 131 and the graphic application 133.

  When the user performs an operation input to the EPD panel (an example of electronic paper) 152, the digitizer 154 detects the xy coordinates of the contact position and sends the xy coordinates to the digitizer driver 131a of the operating system 131.

  The digitizer driver 131a receives the xy coordinates of the contact position, analyzes the operation input, and sends the operation input information and the xy coordinates to the graphic system 132.

  The graphic system 132 receives operation input information and xy coordinates, generates a drawing event, and sends the drawing event and xy coordinates to the graphic display application 133.

  The graphic display application 133 receives a drawing event and xy coordinates, and performs drawing processing specific to the application. The graphic display application 133 requests the graphic system 132 to draw a display image by calling a GUI component (drawing function or the like) prepared by the graphic system 132 based on the received drawing event and xy coordinates, for example. To do.

  In response to the drawing request, the graphic system 132 executes the GUI component of the display upper class 132a, the GUI component of the display middle class 132b, the GUI component of the display base class 132c, and the like to create image data, and Drawing is performed in the frame buffer 135 via the frame buffer driver 131 b of the system 131. Thereafter, a cleanup execution instruction is instructed to the frame buffer 135 via the frame buffer driver 131b.

  The image data drawn in the frame buffer 135 is sequentially sent to the EPD controller 140, and each straight line image is sequentially displayed on the EPD panel 152 under the control of the EPD controller 140.

  Also, the Cleanup execution instruction instructed to the frame buffer 135 is sent to the EPD controller 140, and the EPD panel 152 is flashed, for example, from all black to all white to all black under the control of the EPD controller 140.

  The operating system 131 (particularly, the digitizer driver 131a) corresponds to the input operation detection processing unit 12 in FIG. The graphic display application 133 corresponds to the application processing unit 14 in FIG. The graphic system 132 and the operating system 131 correspond to the drawing processing unit 16 in FIG. The EPD controller 146 corresponds to the display control unit 40 in FIG.

1-5. Determining the size of the area where cleanup is performed In this embodiment, afterimage erasing of the entire display area (screen) of electronic paper may be performed, or afterimage erasure of a part of the display area (screen) may be performed. Good. For example, when a new image is displayed on the entire screen, the afterimage of the display area (screen) of the electronic paper may be deleted. For example, when a display image (for example, a display object such as a button or a dialog) is displayed in a part of the display area (screen), an afterimage of a part of the display area (screen) of the electronic paper may be deleted.

  FIG. 6 is a diagram for explaining an afterimage erasing area when a button object is displayed.

  For example, when processing to display a push button (an example of a display image) in an application, a drawing request is made by designating push button drawing position information for a bush button display GUI component (432 in FIG. 4). I do. The drawing position information is an example of rectangular information of “drawing instruction + rectangular information” 452 in FIG. 4, and in the case of FIG. 6, is coordinate information of the representative point 610 (upper right) of the bush button object 620.

  A drawing request (push button object drawing instruction + drawing target push button object coordinate information (an example of rectangular information)) 452 from the application program descends the inheritance / derivation relationship of the display class hierarchy in the reverse direction. In a GUI part (420 in FIG. 4) of a base class of a class related to display, a drawing request (instruction for drawing a push button object + coordinate information 452 of a push button object to be drawn) is passed to all display objects. A common image drawing process is performed, and finally the position and size of the target rectangle that will be the area to be cleaned up are determined based on at least one of the current and past coordinate information, and the cleanup for afterimage removal is executed The

  The position of the representative point 610 of the target rectangle 630 that is the area where the cleanup is performed may be determined based on the representative point of the push button object or the representative point of the object displayed before that. In addition, the vertical size 11 and the horizontal size 12 of the target rectangle 630 to be cleaned up are determined based on the vertical size and horizontal size of at least one of the push button object and the object displayed before that. May be. That is, Cleanup may be performed on an overlapping area of the drawing area of the current display image and the drawing area of the previous display image, or an area related to at least one of them.

  The target rectangle 630 that is the area where the cleanup is performed is a rectangle 630 ′ containing the push button object 620 or the object displayed in front of it (an offset area outside the push button object 620 or the object displayed in front of it) May also be included). Since the push button object and the width and height of the object displayed before the push button object are managed by a GUI component (for example, a GUI component for displaying a bush button), the information may be used.

  In this way, even if the display image such as a button is placed at an arbitrary position on the screen without being conscious of the application, the afterimage erasure process (Cleanup) of the electronic paper is performed on the area of the required size. Can do.

  FIG. 7 is a diagram for explaining an afterimage erasing area when “Doodle” is displayed.

  “Doodle” is an input format in which a user inputs a line such as a character or a figure by moving the contact position on the screen. When displaying “graffiti”, the application receives the contact position information detected by the digitizer from the graphic system. Therefore, the contact position information detected by the digitizer for the graffiti drawing GUI component (for example, the movement locus of the contact position). A drawing request is made by designating the coordinates of the sample points p1 to p4, which is an example of rectangular information of “drawing instruction + rectangular information” 452 in FIG.

  The drawing request from the application program (“Doodle” drawing instruction + contact position information (an example of rectangular information)) 452 descends the inheritance / derivation relationship of the display class hierarchy in the reverse direction, and displays the class related to the display. In the base class GUI part (420 in FIG. 4), an image drawing process common to all display objects is performed, and finally the target rectangle set based on the contact position information (coordinates of the sample points p1 to p4) Cleanup for afterimage removal is executed. The target rectangle that is the region where the cleanup is performed may be determined based on the outer edge rectangle 640 by obtaining the outer edge rectangle 640 including the coordinates of the sample points p1 to p4. The target rectangle may be the same size as the outer edge rectangle 640, or may be a rectangle 640 ′ including the outer edge rectangle 640 (an area including an offset area outside the outer edge rectangle 640).

  In this way, it is possible to perform the afterimage erasure processing (Cleanup) of the electronic paper in an area of a necessary size for any graffiti made on the screen without being conscious of the application.

1-6. Change of Type of Afterimage Erasing Cleanup FIG. 8 is a diagram for explaining the types and characteristics of the afterimage erasing Cleanup.

  There are a plurality of execution contents of the cleanup process, and each has advantages and disadvantages. Therefore, it is preferable to switch according to the contents of the image to be displayed.

  As shown at 710, the cleanup type 0 is to erase the afterimage by setting the EPD panel to all white once (current image → all white → current image). High speed and little flicker (advantages), but afterimages cannot be completely removed (disadvantages). Used for temporary afterimage erasure during continuous page feed, etc., or for simple afterimage erasure with few or no images displayed on the button.

As shown in 720, Cleanup type 1 erases the afterimage with all white after reversing only the white portion of the current image of the EPD panel to black (current image → reverse only white to black → all white → current image). . The processing speed between type 0 and type 2 is effective for erasing a general image afterimage (advantage), but is slower than type 0 and not as beautiful as type 2 (disadvantage). Used to erase afterimages of display parts such as buttons with slightly complicated image display (use).

  As shown in 730, Cleanup type 2 performs complete afterimage erasing by setting the EPD panel to all white, all black, and all white once (current image → all white → all black → all white → current image). . Any images and afterimages can be completely erased (advantages), but the processing speed is slow and screen flickering is conspicuous (disadvantages). Dedicated button for afterimage erasure on the last page of continuous page feed, afterimage erasure after omitting the afterimage erasure for a certain time, afterimage erasure when displaying complex display parts, afterimage erasure when displaying photographic images, afterimage erasure Used for manual afterimage erasure by (use).

  As shown at 740, in Cleanup type 3, the afterimage is erased by only reversing the original image in the EPD panel (current image → black / white reversal → current image). High speed and low flicker (advantage), but afterimage erasure is not effective for photographic images (disadvantage). Used to erase afterimages of display parts such as general buttons that do not contain photographic images, and to display text / picture-centric pages other than photographs (uses).

  The base class GUI component incorporates afterimage erasure processing of a plurality of different types of electronic paper such as Cleanup type 0 to Cleanup type 3 described above. The type of afterimage erasing process may be determined according to the type of image to be performed, and the determined type of afterimage erasing process may be performed.

  The Cleanup process embedded in the base class can obtain information on the status and context in which Cleanup is executed in addition to the rectangular information to be displayed, based on the information from the upper class. It is possible to perform processing that makes use of the characteristics corresponding to the type of Cleanup as shown. For example, when displaying a PDF image, information such as the type of image is included in the incidental information included in the image information, and this may be used to determine the type of Cleanup.

  In this way, when making a rendering request on the application side, it is possible to perform a type of cleanup corresponding to the type of image without specifying anything about the type of cleanup.

1-7. Customization of afterimage erasure type from application In this embodiment, the application program does not need to be aware of the type of afterimage erasure, and the afterimage erasure process incorporated in the base class GUI component is a type of Cleanup according to the image type. However, the contents of the afterimage removal processing of the base class may be customized on the application side.

  The GUI library is provided with a customizing GUI component for changing an afterimage processing type selection algorithm (method) of the base class GUI component, and is called by the application program to the customizing GUI component, and the base class GUI A change request for changing the part afterimage processing type selection algorithm (method) to a given content may be made. When there is a change request, the customization GUI component may change the selection algorithm (method) of the afterimage processing type of the base class GUI component to a given content in response to the change request.

  For example, in the base class GUI component, when the default afterimage processing is the first type of afterimage deletion processing, the application program calls the customization GUI component to change the default afterimage processing to the second type. Change requests can be made. In this way, the customization GUI component changes the default afterimage processing of the base class GUI component to the second type in response to the change request, and thereafter, the default residual layer processing is the second type. It becomes the type.

1-8. FIG. 9 is a diagram illustrating an afterimage erasing Cleanup processing sequence example of a comparative example.

  The comparative example shows an example of the processing sequence of the application when the application directly issues a cleanup command for afterimage deletion. Here, the transfer process of the display data in the frame buffer and the cleanup execution in the EPD controller are overlapped and paralleled to shorten the overall execution time, so the cleanup execution is separated into two parts, the first half and the second half. An example will be described.

  When issuing a cleanup command for afterimage erasure, it is better to stop display reflection on the EPD panel (reflecting the contents of the frame buffer on the EPD panel). Transmit to the buffer driver (a1). Receiving this, the frame buffer driver transmits a “display reflection stop” instruction to the EPD controller (b1). Next, the application transmits a cleanup command (first half) for erasing afterimages to the frame buffer driver (a2). Upon receiving this, the frame buffer driver transmits a “Cleanup execution (second half)” instruction to the EPD controller (b2). Next, the application transmits screen display data to the frame buffer driver (a3). Receiving this, the frame buffer driver resumes display reflection (b3-1), and transmits screen display data to the EPD controller (b3-2).

  If the cleanup process is divided into the first half and the second half, as shown in 610, the entire time can be reduced by overlapping the execution of the cleanup and the transfer of screen display data by the frame buffer.

  Next, the application transmits a cleanup command (second half) for image erasure to the frame buffer driver (a4). Here, after the execution delay indicated by 620, the frame buffer driver transmits a “Cleanup execution (second half)” instruction to the EPD controller (b4).

  Then, the application waits for a deliberate time as indicated by 630, and then transmits a Resume command for resuming display to the frame buffer driver (a5). Receiving this, the frame buffer driver resumes display reflection (b5).

  When the application directly issues a cleanup command for erasing an afterimage, the complicated cleanup process (a1 to a5) as described above is forced every time it is displayed.

  FIG. 10 is a diagram illustrating an example of the afterimage erasing Cleanup processing sequence according to the present embodiment.

  In the present embodiment, the application does not give an instruction for the afterimage erasing process, but only makes a drawing request to a GUI component of a higher class of the GUI library (a GUI component of a derived class).

  When the application makes a drawing request to the GUI component of the derived class (a1), the drawing request descends the inheritance / derivation relationship of the display class hierarchy in the reverse direction, and the drawing request is transmitted to the base class ( c1).

  The GUI component of the base class that has received the drawing request transmits a Suspend command for stopping display to the frame buffer driver (d1). Receiving this, the frame buffer driver transmits a “display reflection stop” instruction to the EPD controller (b1). Next, the base class GUI component transmits a cleanup command (first half) for erasing the afterimage to the frame buffer driver (d2). Upon receiving this, the frame buffer driver transmits a “Cleanup execution (second half)” instruction to the EPD controller (b2). Next, the base class GUI component transmits screen display data to the frame buffer driver (d3). Receiving this, the frame buffer driver resumes display reflection (b3-1), and transmits screen display data to the EPD controller (b3-2).

  Next, the base class GUI component transmits a cleanup command (second half) for erasing the afterimage to the frame buffer driver (d4). Here, after the execution delay indicated by 620, the frame buffer driver transmits a “Cleanup execution (second half)” instruction to the EPD controller (b4).

  Then, the application waits for a deliberate time as indicated by 630, and then transmits a Resume command for resuming display to the frame buffer driver (d5). Receiving this, the frame buffer driver resumes display reflection (b5).

  In the present embodiment, when the application makes a display image drawing request (a1), the complex cleanup process (d1 to d5) that is performed each time a display is performed is performed. Do. Thus, the application is freed from the Cleanup process and can concentrate on the process of the application itself. This facilitates the porting of applications running on non-electronic paper hardware such as personal computers to electronic paper terminals.

2. Electronic book terminal 2-1. Configuration of Electronic Book Terminal FIG. 11 is an external view of an electronic book terminal which is an example of the image processing apparatus of the present embodiment, and FIG. 12 is a diagram illustrating an example of a hardware configuration inside the electronic book terminal of the present embodiment. It is.

  As shown in FIG. 12, the electronic book terminal 100 according to the present embodiment includes components such as a CPU 110, an input button 120, an internal memory 130, an EPD controller 140, a display 150, a speaker 160, and a USB interface 170. These components can exchange various data via the bus 180. The electronic book terminal 100 of the present embodiment may have a configuration in which some of the components (each unit) in FIG. 12 are omitted or changed, or other components are added.

  The input button 120 is used for an input operation by the user, and includes various hard buttons 120a and various soft buttons 120b (see FIG. 11). The input button 120 corresponds to the operation unit 20 in FIG.

  The internal memory 130 stores programs, data, and the like for the CPU 110 to perform various calculation processes and control processes. The internal memory 130 has an operating system 131 that performs basic processing such as file operations and hardware interface processing, a data structure (class) for drawing, and various library functions, and general-purpose drawing processing. A graphics system 132 to be installed is installed. Since the graphic system 132 is incorporated, various applications involving drawing can be developed using various data structures (classes) and library functions, thereby reducing development costs and bugs. There are advantages such as being able to.

  In addition, the internal memory 130 stores a handwriting application 133 for writing (adding) handwritten characters, graphics, and the like by pen input to a page displayed on the display 150. The handwriting application 133 may be installed from the beginning, or may be installed from a personal computer or the like via the USB interface 170, for example.

  The internal memory 130 stores a content file 134 that stores image data of each page of the electronic book (content). The content file 134 may be stored in the internal memory 130 from the beginning, or may be downloaded from a personal computer, a USB memory, or the like via the USB interface 170, for example.

  The internal memory 130 also includes a work area of the CPU 110. In particular, in this embodiment, image data included in the content file 134, image data created in response to a predetermined input operation by the user, and the like are part of the storage area. And a cache 136 for storing cache information for speeding up the process of writing image data to the frame buffer 135.

  In general, the internal memory 130 includes a plurality of physically separated memories that are optimal for each application. The internal memory 130 corresponds to the storage unit 30 in FIG. The handwriting application 133 and the content file 134 correspond to the application program 32 and the data file 34 in FIG. 1, respectively. Each frame buffer 135 corresponds to the frame buffer 36 of FIG.

  The speaker 160 outputs various sounds and sounds under the control of the CPU 110. The speaker 160 corresponds to the sound output unit 60 of FIG.

  The USB interface 170 is connected to a USB cable, a USB memory, or the like, and performs data communication with a personal computer, a USB memory, or the like under the control of the CPU 110. The USB interface 170 corresponds to the communication unit 70 in FIG.

  The display 150 includes an EPD panel 152, and an image corresponding to the image data stored in the frame buffer 135 is displayed on the surface of the EPD panel 152.

  FIG. 13 is a diagram illustrating a configuration example of the display 150. The example of FIG. 13 is an active matrix type electrophoretic display (EPD). In FIG. 13, the digitizer 154 is not shown.

  As shown in FIG. 13, the display 150 includes an EPD panel 152, a scanning line driving circuit 221, a data line driving circuit 222, and a common power supply modulation circuit 224.

  The scanning line driving circuit 221, the data line driving circuit 222, and the common power supply modulation circuit 224 are each connected to the EPD controller 140 (not shown in FIG. 13).

  In the EPD panel 152, a plurality of scanning lines 226 extending from the scanning line driving circuit 221 and a plurality of data lines 228 extending from the data line driving circuit 222 are formed, and a plurality of pixels corresponding to these intersection positions are formed. 200 is provided.

The scanning line driving circuit 221 is connected to each pixel 200 by j scanning lines 226 (Y1, Y2,..., Yj). The scanning line driving circuit 221 sequentially selects the scanning lines 226 from the first row to the j-th row under the control of the EPD controller 140, thereby driving TFTs (Thin provided in the pixels 200).
A selection signal defining the on timing of the film transistor 208 (see FIG. 14) is supplied.

  The data line driving circuit 222 is connected to each pixel 200 by k data lines 228 (X1, X2,..., Xk). The data line driving circuit 222 supplies a 1-bit image signal to each of the pixels 200 according to the control of the EPD controller 140 based on the transfer data. In this embodiment, when defining pixel data “0”, a low-level image signal is supplied to the pixel 200, and when defining pixel data “1”, a high-level image signal is applied to the pixel 200. 200.

The EPD panel 152 also includes a low potential power supply line 209 (Vss), a high potential power supply line 210 (Vdd), a common electrode wiring 215 (Vcom), and a first pulse signal line 251 (S) extending from the common power supply modulation circuit 224. ₁ ), a second pulse signal line 252 (S ₂ ) is provided, and each wiring is connected to the pixel 200. The common power supply modulation circuit 224 generates various signals to be supplied to each of the wirings under the control of the EPD controller 140, and electrically connects and disconnects these wirings (high impedance, Hi-Z).

  FIG. 14 is a circuit configuration diagram of the pixel 200 of FIG. In FIG. 14, the same wiring as in FIG. 13 is assigned the same number, and the description is omitted. In FIG. 14, the common electrode wiring 215 common to all the pixels is not shown.

  As shown in FIG. 14, the pixel 200 is provided with a driving TFT 208, a latch circuit 230, and a switch circuit 240. The pixel 200 has an SRAM (Static Random Access Memory) type configuration in which an image signal is held as a potential by the latch circuit 230.

  The driving TFT 208 is a pixel switching element composed of an N-MOS transistor. The gate terminal of the driving TFT 208 is connected to the scanning line 226, the source terminal is connected to the data line 228, and the drain terminal is connected to the data input terminal of the latch circuit 230. The latch circuit 230 includes a transfer inverter 230t and a feedback inverter 230f. A power supply voltage is supplied to the inverters 230t and 230f from the low potential power supply line 209 (Vss) and the high potential power supply line 210 (Vdd).

  The switch circuit 240 includes transmission gates TG1 and TG2, and outputs a signal to the pixel electrode 195 (see FIGS. 15B and 15C) according to the level of the pixel data stored in the latch circuit 230. . Note that Va means a potential applied to the pixel electrode of one pixel 200.

And pixel data "1" in the latch circuit 230 (a high-level image signal) is stored, the transmission gate TG1 is turned on, the switch circuit 240 is a pulse signal to be supplied (drive pulse) S ₁ as Va. On the other hand, the pixel data "0" in the latch circuit 230 (image signal of a low level) is stored, when the transmission gate TG2 is turned on, the switch circuit 240 supplies a pulse signal (drive pulse) S ₂ as Va. With such a circuit configuration, the potential applied to the pixel electrode of each pixel 200 can be controlled by the control unit.

  The EPD panel 152 of the present embodiment may be, for example, a two-particle microcapsule type electrophoretic EPD panel. If the dispersion is colorless and transparent, and the electrophoretic particles are white or black, at least two colors can be displayed with two colors of white or black as basic colors.

  FIG. 15A is a diagram illustrating a configuration example of the electrophoretic element 262. The electrophoretic element 272 is sandwiched between the element substrate 270 and the counter substrate 271 (see FIGS. 15B and 15C). The electrophoretic element 272 is configured by arranging a plurality of microcapsules 260. The microcapsule 260 encloses, for example, a colorless transparent dispersion, a plurality of white particles (electrophoretic particles) 267, and a plurality of black particles (electrophoretic particles) 266. In the present embodiment, for example, it is assumed that the white particles 267 are negatively charged and the black particles 266 are positively charged.

  FIG. 15B is a partial cross-sectional view of the EPD panel 152. The element substrate 270 and the counter substrate 271 sandwich an electrophoretic element 272 in which microcapsules 260 are arranged. The EPD panel 152 includes a drive electrode layer 280 in which a plurality of pixel electrodes 195 are formed on the electrophoretic element 272 side of the element substrate 270. In FIG. 15B, a pixel electrode 195A and a pixel electrode 195B are shown as the pixel electrode 195. The pixel electrode 195 can supply a potential to each pixel (for example, Va and Vb). Here, a pixel having the pixel electrode 195A is referred to as a pixel 200A, and a pixel having the pixel electrode 195B is referred to as a pixel 200B. The pixel 200A and the pixel 200B are two pixels corresponding to the pixel 200 (see FIGS. 13 and 14).

  On the other hand, the counter substrate 271 is a transparent substrate, and an image is displayed on the counter substrate 271 side in the display unit. The EPD panel 152 includes a common electrode layer 282 in which a common electrode 197 having a planar shape is formed on the electrophoretic element 272 side of the counter substrate 271. The common electrode 197 is a transparent electrode. Unlike the pixel electrode 195, the common electrode 197 is an electrode common to all the pixels, and the potential Vcom is applied.

  An electrophoretic element 272 is disposed on an electrophoretic display layer 290 provided between the common electrode layer 282 and the drive electrode layer 280, and the electrophoretic display layer 290 becomes a display region. A desired display color can be displayed for each pixel in accordance with a potential difference between the common electrode 197 and a pixel electrode (for example, 195A and 195B).

  In FIG. 15B, the common electrode side potential Vcom is higher than the potential Va of the pixel electrode of the pixel 200A. At this time, the negatively charged white particles 267 are attracted to the common electrode 197 side, and the positively charged black particles 266 are attracted to the pixel electrode 195A side, so that the pixel 200A is visually recognized as displaying white.

  In FIG. 15C, the common electrode side potential Vcom is lower than the potential Va of the pixel electrode of the pixel 200A. At this time, on the contrary, the positively charged black particles 266 are attracted to the common electrode 197 side, and the negatively charged white particles 267 are attracted to the pixel electrode 195A side, so that it is visually recognized that the pixel 200A displays black. Is done. Note that the structure in FIG. 15C is similar to that in FIG. Further, in FIGS. 15B and 15C, Va, Vb, and Vcom are described as fixed potentials. However, in reality, Va, Vb, and Vcom change with time.

  Here, in the example of the pixel 200A in FIGS. 15B and 15C, the white particles 267 and the black particles 266 are all drawn toward the common electrode 197 side (so-called saturated state), respectively. Yes. However, it is possible not only to display the basic colors (white and black) in a saturated state but also to display intermediate colors (light gray and dark gray) by applying an electric field in the opposite direction for an appropriate time, for example.

  Returning to FIG. 12, the display 150 further includes a digitizer 154. The digitizer 154 is provided so as to face the back surface of the EPD panel 152, detects a position where an input touch pen (hereinafter simply referred to as “pen”), a user's finger, or the like touches the EPD panel 152, and provides information on the contact position. Is output. For example, when the user performs operations such as inputting characters or figures using a pen, or sliding a finger to perform page operations such as page advance or page return, page enlargement or reduction, the digitizer 154 performs these operations. Outputs the information of the contact position when.

  The display 150 corresponds to the display unit 50 in FIG. The EPD panel 152 and the digitizer 154 correspond to the electronic paper 52 and the contact position detection unit 54 in FIG. 1, respectively.

  The EPD controller 140 performs control to display an image corresponding to the image data written in the frame buffer 135 on the EPD panel 152 of the display 150. The EPD controller 140 is provided with a memory pipeline 142 for managing a history of image data corresponding to an image displayed on the EPD panel 152. The memory pipeline 142 holds history information of image data (image data written in the frame buffer 135) corresponding to the image displayed on the EPD panel 152 in time series. The EPD controller 140 determines the optimum number of times considering the display characteristics of the EPD panel 152 based on the characteristic information (color and brightness of each pixel) to be displayed next and the history information held in the memory pipeline 142. Control is performed to generate drive pulses at intervals and display the next image on the EPD panel 152.

  The EPD controller 140 corresponds to the display control unit 40 in FIG.

  The CPU 110 performs various processes of the operating system 131, the graphic system 132, and the handwriting application 133. In particular, in the present embodiment, when a predetermined input operation is performed on the input button 120 or the EPD panel 152, the CPU 110 operates according to an operation signal (an operation signal such as page feed or page return) corresponding to the input operation. The information on the contact position (pen input position, finger contact position, etc.) is received from the digitizer 154, and at least a part of the image displayed on the EPD panel 152 is drawn at high speed. The CPU 110 corresponds to the processing unit (CPU) 10 in FIG.

3. Other Image Processing Apparatus FIGS. 16A and 16B show examples of the image processing apparatus 1 of the present embodiment other than the electronic book terminal 100.

  FIG. 16A is an external view of the smartphone 500. The smartphone 500 includes a case 502. Three operation buttons 511, 512 and 513 are provided on the front surface of the case 502. In addition, a display unit 504 including electronic paper such as an EPD panel is provided on the front surface of the case 502, and various types of information (images) are displayed on the surface of the electronic paper. In response to a predetermined operation by a pen (not shown) or operation buttons 511, 512, 513, etc., a direct drawing process from the built-in CPU (application) to the frame buffer is performed, and on the surface of the electronic paper of the display unit 504, An image corresponding to each operation is displayed at high speed.

  FIG. 16B is an external view of the wristwatch 600. The wristwatch 600 includes a case 602 and a pair of bands 603 connected to the case 602. Two operation buttons 611 and 61 are provided on the side surface of the case 602. A display unit 604 including electronic paper such as an EPD panel is provided on the front surface of the case 602, and various information (images) are displayed on the surface of the electronic paper in addition to time. In accordance with a predetermined operation using a pen (not shown) or the operation buttons 611, 612, a built-in CPU (application) performs direct drawing processing on the frame buffer, and each operation is performed on the surface of the electronic paper of the display unit 604. The image corresponding to is displayed at high speed.

  In addition to this, as the image processing apparatus 1 of the present embodiment, for example, an electronic signboard (digital signage), a personal computer, a mobile phone, a digital still camera, a television, a video camera, a video tape recorder, a car navigation device, An electronic notebook, an electronic game machine, etc. are mentioned.

4). Method for Manufacturing Image Processing Device FIG. 17 is a flowchart showing a method for manufacturing the image processing device of the present embodiment.

  First, in the GUI library composed of GUI parts having an object-oriented class hierarchical structure, a modification is made to incorporate the afterimage erasure processing of the electronic paper into the GUI part of the base class of the class hierarchy relating to the rendering of the display image (step S10). Next, an application that performs display control of EPD using the GUI library is created (step S20). Then, the corrected GUI library and the created application are mounted on a device having electronic paper (step S30).

  The present invention is not limited to the present embodiment, and various modifications can be made within the scope of the gist of the present invention.

  The present invention includes configurations that are substantially the same as the configurations described in the embodiments (for example, configurations that have the same functions, methods, and results, or configurations that have the same objects and effects). In addition, the invention includes a configuration in which a non-essential part of the configuration described in the embodiment is replaced. In addition, the present invention includes a configuration that exhibits the same operational effects as the configuration described in the embodiment or a configuration that can achieve the same object. Further, the invention includes a configuration in which a known technique is added to the configuration described in the embodiment.

DESCRIPTION OF SYMBOLS 1 ... Image processing apparatus, 10 ... Processing part (CPU), 12 ... Input operation detection processing part, 14 ... Application processing part, 16 ... Drawing processing part, 18 ... Image data transfer processing part, 20 ... Operation part, 30 ... Memory | storage , 32 ... application program, 34 ... data file, 36 ... frame buffer, 38 ... GUI library, 40 ... display control unit, 50 ... display unit, 52 ... electronic paper, 54 ... contact position detection unit, 60 ... sound output , 70 ... communication unit, 100 ... electronic book terminal, 110 ... CPU, 120 ... input button, 120a ... input button, 120b ... input button, 130 ... internal memory, 131 ... operating system, 131a ... digitizer driver, 131b ... frame Buffer driver, 132 ... Graphic system, 133 ... Handwriting application 134 ... Content file, 135 ... Frame buffer, 136 ... Cache, 140 ... EPD controller, 142 ... Memory pipeline, 150 ... Display, 152 ... EPD panel, 154 ... Digitizer, 160 ... Speaker, 170 ... USB interface, 195 ... pixel electrode, 195A ... pixel electrode, 195B ... pixel electrode, 197 ... common electrode, 200 ... pixel, 200A ... pixel, 200B ... pixel, 208 ... driving TFT, 209 ... low potential power line (Vss), 210 ... high Potential power supply line (Vdd), 215... Common electrode wiring (Vcom), 221... Scan line drive circuit, 222... Data line drive circuit, 224. Circuit, 240... Switch circuit, 251 The first pulse signal line _(S 1), 252 ... second pulse signal line _(S 2), 260 ... microcapsules, 266 ... black particles, 267 ... white particles, 270 ... device substrate, 271 ... counter substrate 272 ... Electrophoretic element, 280 ... Drive electrode layer, 282 ... Common electrode layer, 290 ... Electrophoretic display layer, 500 ... Smartphone, 502 ... Case, 504 ... Display unit, 511 ... Operation button, 512 ... Operation button, 513 ... Operation Button, 600 ... wristwatch, 602 ... case, 603 ... band, 604 ... display section, 611 ... operation button, 612 ... operation button.

Claims (9)

A display unit equipped with electronic paper;
A frame buffer for storing image data to be displayed on the display unit;
A display control unit that performs control to display an image corresponding to the image data written in the frame buffer on the electronic paper of the display unit;
An application processing unit that operates based on an application program and makes a display image rendering request to be displayed on the electronic paper using a GUI component of the GUI library;
The GUI parts constituting the GUI library have an object-oriented class hierarchical structure, and in response to a drawing request from an application program, execute the corresponding GUI parts and the program of the base class GUI parts. A drawing processing unit that generates image data corresponding to the drawing request and performs processing for writing the image data in the frame buffer;
The drawing processing unit
The GUI part of the base class of the class hierarchy related to drawing of the display image incorporates an afterimage erasing process of the electronic paper, and image processing for performing the afterimage erasing process of the electronic paper when the display image drawing process is performed apparatus. In claim 1,
The application processing unit
A drawing request is made by designating drawing position information of a display image to the GUI component,
The drawing processing unit
An image processing apparatus for performing afterimage erasure processing of electronic paper by determining a position of a region where afterimage erasure processing is performed based on the drawing position information. In claim 1 or 2,
The drawing processing unit
An image processing apparatus that determines the size of an area for which an afterimage erasing process is performed based on a type of display image or a drawing content, and that performs an afterimage erasing process on an electronic paper for the determined size area. In any one of Claims 1 thru | or 3,
The drawing processing unit
The base class GUI component incorporates a plurality of different types of afterimage erasing processing, and determines the type of afterimage erasing processing according to the type of GUI component executed in the derived class or the type of image to be drawn. An image processing apparatus that performs the afterimage erasing process of the determined type. In any one of Claims 1 thru | or 4,
The GUI library includes a GUI component for customization that changes an algorithm for selecting a type of afterimage processing of the GUI component of the base class,
The application processing unit
Using the customization GUI component, make a change request to change the selection algorithm of the afterimage processing type of the base class GUI component to a given content,
The drawing processing unit
The image processing apparatus, wherein the customization GUI component changes an afterimage processing type selection algorithm of a base class GUI component to a given content in response to the change request. A program for controlling display on electronic paper,
Configure a GUI library that is called from the application program and controls the display of electronic paper,
The GUI parts constituting the GUI library have an object-oriented class hierarchical structure, and in response to a drawing request from an application program, execute the corresponding GUI parts and the program of the base class GUI parts. The computer functions as a drawing processing unit that performs processing to generate image data corresponding to the drawing request and write the image data in a frame buffer for storing image data to be displayed on the electronic paper,
The drawing processing unit
A program for performing afterimage erasure processing of electronic paper when the afterimage erasure processing of the electronic paper is incorporated in the GUI component of the base class of the class hierarchy relating to drawing of the display image, and performing the drawing processing of the display image. In claim 6,
A program that operates based on an application program and causes a computer to function as an application processing unit that makes a display image rendering request to be displayed on an electronic paper using a GUI component of a GUI library.   A recording medium in which the program according to claim 6 or 7 is stored. A method of manufacturing an image processing apparatus having electronic paper,
A step of performing a modification for incorporating an afterimage erasure process of electronic paper into a GUI part of a base class of a class hierarchy related to drawing of a display image in a GUI library composed of GUI parts having an object-oriented class hierarchical structure;
Creating an application for controlling display of EPD using a GUI library;
Mounting the modified GUI library and the created application on a device having electronic paper, and a method of manufacturing an image processing apparatus.