JP2000163443A - Portable information devices and information storage media - Google Patents

Abstract

(57) [Summary] [PROBLEMS] To provide an electronic book, a portable information device, and an information storage medium used for the same, which can realize a search operation with a human interface that is easy for a user to use. An electronic book includes a display unit capable of displaying an image on which a plurality of search items are displayed. When at least two of the plurality of search items are touched with a finger at the same time or within a predetermined time, information having a logical product relationship with search conditions corresponding to the plurality of search items is searched. When there is no information having a relationship between a plurality of search conditions and a logical product, information having at least one of a logical sum and a combination of a logical sum and a logical product is searched. Displays the first page that contains information that satisfies the search conditions.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a portable information device, an electronic book, and an information storage medium used therein.

[0002]

2. Description of the Related Art In recent years, electronic books, which are publishing forms in which information such as characters, images, and sounds are recorded on electronic media such as CD-ROMs and FDs and used like books, Portable information devices have been put to practical use.

[0003] Such an electronic book or portable information device can solve the physical limitations that paper books have to deal with. A non-linear reading style is also possible, and readers can enjoy reading from various perspectives.

[0004] Furthermore, since publishing does not require much money or labor,
It is also possible to realize the ideal image of publishing such that anyone can publish easily or publish a specialized one with limited subscribers.

[0005] Such an electronic book or portable information device can realize much more enhanced functions in retrieving and utilizing information than a normal paper book. For example, in a book, you use a table of contents to check which page contains the necessary information, and then refer to that page.
If necessary information is described in a dispersed manner, it is difficult to find a place where the information is described. However, in an electronic book or a portable information device, even in such a case, the search is automatically performed, so that it is very convenient for the user.

FIG. 43 is a diagram for explaining an example of a general information search when performing a search by designating a plurality of search conditions in an electronic book or the like. On the table of contents screen 910 or the like on which a search item is displayed, the user selects a search item that the user wants to search. For example, when the user selects and inputs A1, the A1 information display screen 920 that satisfies the search condition A1
Is displayed.

[0007] The A1 information display screen 920 is also configured so that an item to be searched can be further selected and input, and the user can select a search item to be searched. For example, when the user selects and inputs B1, an information display screen 930 that satisfies the search conditions A1 and B1 is output. In this way, the user can arrive at information that satisfies the plurality of selection conditions by sequentially selecting and inputting the selection items corresponding to the search conditions desired by the user.

[0008] However, such a method has a problem that a quick search cannot be performed because a plurality of operations are required until a user reaches desired information.

[0009] Further, since it is only possible to specify search conditions in series along the screen, it cannot be said that it is convenient for the user.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned problems, and has as its object to provide an electronic book and a portable information device capable of realizing a search operation with a human interface which is easy for a user to use. The purpose is to provide an information storage medium to be used.

[0011]

SUMMARY OF THE INVENTION The present invention is a portable information device including a display unit for displaying search items corresponding to a plurality of search conditions, wherein at least two of the displayed plurality of search items are displayed. A search input means for inputting a search execution specifying a plurality of search conditions by touching with a finger at the same time or within a predetermined time; and a search condition corresponding to a plurality of search items touched by a finger at the same time or within a predetermined time And information searching means for searching for information having a logical product relationship, wherein the search input means detects a position of a finger that has been brought into contact with a display unit, and a finger based on the detected position of the finger. Means for determining the search item touched in step (1).

[0012] The means for detecting the contact position of the finger can be constituted, for example, by overlaying a transparent touch panel or the like on the display unit.

According to the present invention, a search operation execution instruction and a search condition can be input by a finger, so that there is no need to provide hardware such as a button or a keyboard in a housing, and a more compact portable information device can be provided. .

[0014] Conventionally, by touching one search item, only an instruction to execute a search under a search condition corresponding to the search item can be given. However, according to the present invention, when the user touches two or more search items displayed on the display unit simultaneously or with a finger within a predetermined time, information having a logical product relationship with the two or more search items is displayed. The search can be performed and the search result can be output to the display unit. Thus, according to the present invention, a user can input two or more search conditions and give a search execution instruction by one operation.

Therefore, according to the present invention, it is possible to provide a portable information device having an easy-to-use human interface that can be simply and quickly performed only by finger input of a complicated search operation.

Further, according to the present invention, when there is no information having a logical product relation with a search condition corresponding to a plurality of search items touched by a finger at the same time or within a predetermined time, the information search means may perform a logical sum operation. And searching for information having at least one of a combination of a logical sum and a logical product.

When the information of the logical sum is output, for example, if the information of the logical product of the search condition A and the search condition B is A∩B, if {A∩B｝ = Φ, For example, when outputting information. Further, the case of outputting a logical sum or a combination of a logical sum and a logical product means, for example, that information of a logical product of the search condition A, the search condition B, and the search condition C is A∩B∩C. If｝ = Φ, the case of outputting information of ｛A∪B｝ ∩C or information of ｛A∩B｝ ∪C is included.

As described above, when there is no information having a logical product relationship with a plurality of search conditions, information having at least one of a logical sum and a combination of a logical sum and a logical product is automatically searched. Then, information having the most appropriate relationship with a plurality of search conditions can be searched. Therefore, the user simply touches multiple search items,
A portable information device capable of acquiring optimal search information can be provided.

According to the present invention, there is provided the portable information device described above, wherein the portable information device is used as an electronic book.

That is, the present invention is an electronic book including a display unit for displaying search items corresponding to a plurality of search conditions,
At least two of the displayed search items are
Search input means for inputting a search execution specifying a plurality of search conditions by touching with a finger simultaneously or within a predetermined time,
Information search means for searching for information having a logical product relationship with a search condition corresponding to a plurality of search items touched by a finger at the same time or within a predetermined time, and wherein the search input means contacts the display unit. And a means for determining a search item touched by the finger based on the detected position of the finger.

In the electronic book of the present invention, if the information search means does not have information having a logical product relationship with search conditions corresponding to a plurality of search items touched by a finger simultaneously or within a predetermined time, , Or information having at least one of a combination of a logical sum and a logical product.

According to the present invention, it is possible to provide an electronic book having an easy-to-use human interface that can be easily and quickly performed only by finger input of a complicated search operation.

Further, the present invention further comprises a page image output means for outputting the information to which the page number is assigned as image information in page units, wherein the page image output means comprises a first page on which information satisfying a search condition is described. Is output.

Normally, an electronic book outputs information to a screen in page units. According to the present invention, the first page of the information in which the search result is described is displayed, so that the user can use the table of contents in a manner similar to drawing the table of contents, which is convenient. In addition, since a series of information is normally posted in a row, if the search result does not fit on one screen, the user can obtain desired information by referring to the next page and subsequent pages.

According to the present invention, there is provided an information storage medium for use in at least one of a portable information device and an electronic book including a display unit for outputting search items corresponding to a plurality of search conditions, wherein the plurality of displayed search items are provided. Information for inputting a search execution specifying a plurality of search conditions by simultaneously touching at least two of them with a finger within a predetermined time, and a plurality of pieces of information touched by a finger at the same time or within a predetermined time. Information for searching for information having a logical product relationship with a search condition corresponding to a search item, wherein the information for inputting the execution of the search is for detecting a position of a finger touching a display unit. It is characterized by including information and information for judging a search item touched by a finger based on the detected position of the finger.

In the information storage medium of the present invention, if there is no information having a logical product relation with a search condition corresponding to a plurality of search items touched by a finger at the same time or within a predetermined time, a logical sum and a logical It is preferable to search for information having at least one of a combination of a sum and a logical product.

In the information storage medium of the present invention, the information storage medium further includes information for outputting page numbered information as image information in page units, and the information includes a first page in which information satisfying a search condition is described. It is preferable to include information for outputting the image.

[0028]

BEST MODE FOR CARRYING OUT THE INVENTION Features of the present invention The feature of the present invention is that when at least two of a plurality of displayed search items are touched with a finger simultaneously or within a predetermined time, search conditions and logic corresponding to the plurality of touched search items are determined. The point is that information having a product relationship can be searched.

FIG. 1 is a functional block diagram of a form information device or an electronic book having a characteristic function of the present invention.

The finger position detector 10 detects the position of the finger touched by the user on the display. The finger position detection unit 10 is configured by overlapping a transparent touch panel or the like on the display unit 60. The detection data obtained by the finger position detection unit 10 is input to the processing unit 20.

The processing section 20 searches for information based on the detected data, a given program, and the like, and performs processing for generating an image on which the search information is displayed. The function of this processing unit 20 is a CPU (CISC type, RISC type),
It can be realized by hardware such as a DSP, a custom (gate array or the like) IC, and a memory.

The information storage medium 70 is for storing programs and data. The functions of the information storage medium 70 are as follows: CD-ROM, cassette, IC card, MO,
It can be realized by hardware such as FD, DVD, hard disk, and memory. The processing unit 20 performs various processes based on the programs and data from the information storage medium 70.

The processing section 20 includes a search item determining section 30, an information searching section 40, and an image generating section 50.

The search item judging section 30 includes the finger position detecting section 10
Judge the search item touched by the user based on the detected contact position of the finger. Specifically, the search item display position on the display screen is compared with the contact position of the user's finger to determine the search item touched by the user's finger.

The information search unit 40 performs a search process using search conditions corresponding to the search item determined by the search item determination unit 30. When a plurality of search items are touched with a finger at the same time or within a predetermined time, the information search unit 40 searches for information having a logical product relationship with search conditions corresponding to the plurality of touched search items. .

If there is no information having a relation between a search condition and a logical product corresponding to a plurality of search items touched with a finger at the same time or within a predetermined time, at least one of a logical sum and a combination of a logical sum and a logical product is used. Search for information that has one.

The image generation unit 50 generates an image of the first page on which the search information is described, and outputs the image to the display unit.

2. Preferred Embodiment of the Present Invention Hereinafter, a preferred embodiment of the present invention will be described in detail using an electronic book as an example.

(1) Appearance of Electronic Book FIGS. 2A, 2B, and 2C are external views of an electronic book according to the present embodiment. Reference numeral 110 in FIG. 2A is an external front view in a state where the electronic book of the present embodiment is closed.
0 is a side view. Reference numeral 130 denotes a state in which the electronic book of the present embodiment is opened. The electronic book according to the present embodiment is configured to be approximately the size of a paperback book with the electronic book closed, as shown at 110, for convenience in carrying.

FIG. 2B is a diagram showing a disk 140 containing software used for an electronic book. As shown in FIG. 2C, the electronic book according to the present embodiment can provide information corresponding to the contents of various software by setting a disk 140 containing various software in the electronic book main body 150. .

(2) Operation of Map Image Operation by Finger Movement Next, a specific example of operation of a map image by finger movement in the electronic book of the present embodiment will be described.

FIG. 3 is a diagram showing an example of a screen displayed when travel information software is set. The center of the screen is mainly used as an information display area, and the end area of the screen is mainly used as a search tag area and a toolbar display area. In the information display area, the content described in one page spread of the book is displayed as image information. In the search tag area, search tags 210 to 230 and the like are displayed. In addition, images 240 and 242 imitating “book thickness” are displayed at the left and right ends of the display area.

Map Enlargement Operation When the user touches the “map” 220 field of the search tag with the finger 250, the entire map 26 of “India” is displayed on the screen.
0 is displayed (see FIG. 4). To obtain information near “Bombay”, place the thumb and forefinger around “Bombay” on the screen with the thumb and forefinger close as shown in FIG. Performing the operation of moving in the direction (enlargement gesture of the map) (FIG. 5)
reference). By doing so, a map image enlarged according to the movement history of the thumb and the index finger is displayed. That is, the larger the degree of separation between the thumb and the index finger, the smaller the scale and the more detailed the map is displayed.

At this time, the map on the screen may be enlarged in response to the operation of moving the thumb and the index finger away from each other in real time. Alternatively, after the final enlargement amount is determined when the movement of the finger stops, a map image enlarged according to the enlargement amount may be displayed.

As shown in FIG. 7, a case where the thumb is fixed and only the index finger is moved away from the thumb may be included in the enlarged gesture of the map.

If it is desired to obtain a more detailed map image as a result of referring to the enlarged map, a more detailed map image can be obtained by repeating the map's enlarged gesture. In this embodiment, a detailed map of a city, such as a town map, is displayed when the map of an urban area is enlarged to some extent.

As shown in FIG. 8, when a finger is placed on the screen, and the finger is pressed on the screen and moved in a desired direction (a map scroll gesture), the map is moved in the moved direction. The map is moved and displayed by the distance.

Map Reduction Operation When the user wants to reduce the map, for example, when he wants to see a map image of a larger scale or when he wants to display a wide range of information on the screen, the user first needs to change the map shown in FIG. As shown in the figure, the user places the thumb and the index finger apart on the map displayed on the screen, and performs an operation of moving the thumb and the index finger toward each other as shown in FIG. 9 (reduction gesture of the map). In this way, a map image reduced according to the movement history of the thumb and the index finger is displayed. That is, the larger the degree of separation between the thumb and the index finger, the smaller the scale and the more detailed the map is displayed.

At this time, the map on the screen may be reduced in real time together with the operation of bringing the thumb and the index finger closer. Alternatively, a map image reduced according to the final reduction amount may be displayed after the final reduction amount is determined when the movement of the finger stops.

Also, a case where the thumb is fixed and only the index finger is moved in the direction approaching the thumb may be included in the reduced gesture of the map.

As a result of referring to the reduced map, if it is desired to obtain a map image of a wider area, a map image of a wider area can be obtained by repeating the gesture of reducing the map. In the present embodiment,
When the map of an urban area is reduced to some extent, a detailed map of a city such as a town map is changed to a normal map display and displayed.

If the user wants to change the direction of the displayed map image without changing the scale, the user first releases the thumb and forefinger on the screen as shown in FIG. On the map displayed in, fix either the thumb or index finger,
An operation of rotating one of the other fingers like a compass with the fixed finger as the center axis (map rotation gesture)
(See FIG. 10). By doing so, a map image rotated according to the movement history of the thumb and forefinger is displayed.

As shown in FIG. 11, when one of the fingers is fixed at the point O and the other finger is rotated from the point A to the point B, the distance from the point A to the point B is changed by the rotation angle Θ. The map image rotated in the rotation direction 370 is displayed.

At this time, the map on the screen may be rotated in real time together with the rotation of one of the fingers. Alternatively, a map image reduced according to the rotation amount may be displayed after the final rotation amount is determined when the movement of the finger stops.

The finger operation is not limited to the case of performing with the thumb and the index finger, but may be performed with, for example, the thumb and the middle finger, or a combination of other fingers.

(3) Search Process Next, a specific example of a search process by a finger operation in the electronic book according to the present embodiment will be described.

Normal Search Operation For example, when a user wants to obtain information on a hotel in “South India”, there is a method as shown in FIG. That is, first select the tag of "South India", display the first page with information of "South India", then select the tag of accommodation,
This is a method of displaying the first page on which the information of "South India accommodation" is posted. This method is used when the user wants to obtain various information about "South India", displays the first page with information about "South India", and then searches for various information about "South India". It is effective for etc.

Search operation based on logical product condition However, if the user needs only the information on “South India accommodation”, the first page where the information on “South India accommodation” is directly posted in one operation Is preferably displayed. Thus, in the present embodiment, as shown in FIG.
If you touch the tag of "Accommodation" with the right finger at the same time, the first page with the information of "Accommodation in South India" is displayed directly by one operation. I have.

When the information of "South India accommodation" is spread over a plurality of pages, the information described on the next page and subsequent pages can be read by inputting a page turn as shown in FIG. Can be.

(4) Page Turning, Bookmark Processing, etc. Next, a specific example of turning pages in the electronic book of the present embodiment will be described.

Page Turning Input Operation In the electronic book of the present embodiment, since various operations are input as finger movements on the screen, there are few operation input buttons or the like on the housing. Also, the screen on which the book contents are displayed is characterized in that there is almost no operation input mark on the screen (see FIG. 3).

In the present embodiment, by setting travel information software in an electronic book, the user can use the same convenience as referring to a travel guidebook, and display the actual book on a screen as shown in FIG. You can refer to the same content as the page.

When the user wants to refer to the next page, the user traces the information display area on the screen from left to right with his index finger as in turning a page of a paper book, as shown in FIG. The display screen is updated to the contents of the next page as if the page were turned.

At this time, it is necessary for the user to move the finger in the lateral direction so as to rub the index finger or the like or touch the screen with a certain strength. In the present embodiment, in order to distinguish the page turning input from other inputs, when the finger is touching the screen with a predetermined area or more and a predetermined pressure value or more and moving in the horizontal direction, This is because it is determined that the turning has been input.

Note that the direction of page turning and the elevation of a page differ depending on whether it is written vertically or horizontally as in an actual book.
Therefore, in the case of a vertically written book, the page advances from right to left, so when the finger is moved as shown in FIG. 14, the next page is turned, but in the case of horizontal writing, the previous page is turned. Conversely, in the case of a vertically written book, tracing from right to left with the index finger turns the previous page contrary to FIG. 14, but in the case of horizontal writing, the next page is turned.

As described above, since the user can perform page turning input with the same feeling as handling a normal book, it is possible to provide a human interface that is easy to learn and easy to use.

At the time of page turning input, an image in which a page is being turned may be displayed according to the movement of a finger as shown in FIG. 14, but it may be configured to switch directly to the previous page screen or the next page screen.

In addition, an image sound that can be associated with a page turning sound such as “para” may be output in response to the page turning.

Continuous page turning input operation As shown in FIG. 15, when the user keeps touching images (hereinafter referred to as “book thickness”) 240 and 242 imitating “book thickness” for a predetermined time or more, the page is displayed. It flips continuously. At this time, if the user changes the touching strength, the speed of turning the page can be changed. That is, the user can increase the speed of turning the page by touching more strongly. You can also slow down the page turn by reducing the intensity of the touch. When the user finds the page he / she wants to read, he / she can release the hand from the “thickness of the book” to stop the continuous page turning and position the display screen on the page.

As in the case of the page turning described above, the elevation of the page differs depending on the vertical writing or the horizontal writing. Therefore, in the case of a vertically written book, if the thickness of the book on the left end is kept touching as shown in FIG. 15, the pages are continuously turned in the next page direction. Turn over. Conversely, in the case of a vertically written book, FIG.
Conversely, if you keep touching the thickness of the book on the right end, the pages will be turned continuously in the previous page direction, but in the case of horizontal writing, the pages will be turned continuously in the next page direction.

As described above, since the user can perform page turning input with the same feeling as handling a normal book, it is possible to provide a human interface that is easy to learn and easy to use.

At the time of continuous page turning input, as shown in FIG. 15, an image in which a page is being turned may be displayed according to the movement of the finger, but it is directly displayed on the previous page screen or the next page screen every predetermined time. The configuration may be switched.

In addition, an image sound that can be associated with a page turning sound such as “para-para-para” may be output in response to page turning.

Next, a bookmark function of the present embodiment will be described. Just as a bookmark is inserted at a place to be referred to again during normal reading, a bookmark can be added to a page to be referred to again in the present embodiment.

As shown in FIG. 16, when the arrow 260 is dragged and traced to the bottom of the screen with a finger, a bookmark can be inserted into the page. That is, after the above operation, FIG.
As shown in FIG. 7, a bookmark mark 270 is displayed on the screen.

When the user is viewing another page, a bookmark 27 is displayed at the lower end of the screen as shown in FIG.
0 is displayed.

When the user wants to refer to the bookmarked page, he touches the bookmark 270 displayed at the bottom of the screen with his finger as shown in FIG.
As shown in FIG. 18C, the screen is switched to a page with a bookmark.

Although the description has been made by taking an example in which only one bookmark is sandwiched, the present invention is not limited to this. For example, when it is desired to bookmark a plurality of pages, a bookmark mark of a plurality of colors may be displayed.

(5) Example of Using Today's Folder Next, a specific example of using the today's folder according to the present embodiment will be described.

In FIG. 3, when the input icon 280 is touched with a finger, a toolbar composed of various operation icons (282, 284, 286, 288) is displayed at the bottom of the screen as shown in FIG.

Reference numeral 282 denotes an icon to be touched when shifting to a mode for inputting various settings of the electronic book. Reference numeral 284 denotes an icon to be touched when shifting to a mode for shooting a moving image or a still image with a camera which is an accessory part of the electronic book. Reference numeral 286 denotes an icon to be touched when shifting to a mode in which characters, graphics, and the like are memo input using a pen which is an accessory part of the electronic book.
An icon 288 is touched when input data or information specified on the screen is stored in the today's folder, or when the user wants to refer to the contents of the today's folder. This folder of today is created automatically every day, and its usage is like a warehouse where data created in daily use scenes is always kept. Hereinafter, various usage examples of today's folder will be described.

Example of Floating and Storing Information Stored in Electronic Book An example of floating and storing information stored in an electronic book will be described with reference to FIGS.
For example, if you want to get information about "North India"
Touch the index to open the page and read it.
Among them, the character “Taj Mahail” is displayed in red, so touch it (see FIG. 20A). Then, it is configured to automatically jump to the "Taj Mahail" page.

For example, when reading "Taj Mahaile" in a normal paper book and wishing to copy and carry this part, the following operation can be performed in this electronic book.

That is, while tracing the range in which the information that the user wants to cut out is described with the index finger, the user encloses the rectangle in a rectangle and releases the finger from the screen (see arrow 410 in FIG. 20B). Then, the enclosed portion is displayed as if it were raised on the screen (see 420 in FIG. 21). This is called floating.

Then, hold the floating portion with a finger, move to the today's folder icon 288 in the manner of drag and drop, and release the finger there (hereinafter, “drag and drop to today's folder”). (See FIG. 22), and the floating portion is stored in the today's folder. As described above, in this electronic book, by specifying the content to be cut out with the finger and dragging and dropping the content into the today's folder, the content specified on the screen can be stored in the today's folder.

The area to be floated is not limited to an area surrounded by a closed curve or a polygon, but may be an area designated by an edge of the screen and a portion surrounded by a finger. For example, FIG.
As shown in FIG. 2A, when the user traces the screen by drawing a locus like a finger 840, the portion 852 (shaded area) surrounded by the locus 840 and the edge 850 at the edge of the screen is floated. You may.

As shown in FIG. 42B, two points P1 and P2 on the screen are designated with a finger, and a rectangular area 854 (hatched area) having a line connecting the two points as a diagonal line is floated. You may make it.

As shown in FIG. 42 (C), three points P3, P4 and P5 on the screen are designated by a finger, and a circular area 856 (hatched area) having the three points on the circumference is designated. You may make it float.

Example of Storing Still Image and Moving Image Next, an example of storing a video shot by a camera in a today's folder will be described with reference to FIGS.

For example, when the user wants to check the contents of a timetable or the like while traveling, this electronic book can be used as shown in FIG.
As shown in FIG. 4A, the user can pull out the camera lens 520 provided in the electronic book main body, photograph the timetable 510, and store the photographed data in the electronic book.

That is, when the user pulls out the toolbar of the electronic book and touches the camera icon 284 with a finger, the mode is changed to a shooting mode, and a camera shooting operation display screen as shown in FIG. 23 is displayed. The user can select one of the screen switches 550, 550 and 5 for “moving image” and “still image” displayed on the finder screen 530 that is largely arranged on the left side of the screen.
By touching 40 with a finger, a moving image or a still image can be selected.

For example, when the user sets the still image screen switch 5
When the user touches 40, the display of the shooting execution switch 560 changes to “shutter”. And the user has timetable 5
When the camera lens is pointed at 10, the viewfinder screen 53
At 0, a timetable image captured by the camera lens 520 is displayed. When the user touches the "shutter" button 560 with a finger, the captured image data is automatically stored in the folder file together with the shooting date and time.

The folder file is a file for storing information to be put in the “today's folder”. The stored information is managed by date and time, and is configured to be readable on a date basis.

For example, when the user wants to shoot a moving image, touching the switch 550 of the moving image changes the display of the shooting execution switch 560 to “waiting for recording”. When the user touches the “recording standby” button, shooting of a moving image is started.

As shown in FIG. 25, the camera lens 520 of the electronic book is of a wireless type that can be detached from the electronic book main body 522, so that the user can take a picture without hesitation by others. Further, the photographing execution switch 560 in which the user displays “waiting for recording”
Pressing switches the display to "Shooting". If the user wants to interrupt the shooting, touch the “Shooting” button with a finger to interrupt the shooting and display “Standby for shooting”.
Switch to Then, the photographed image is automatically stored in a folder file together with the photographing date and time.

Example of Storing Memo Writing Next, an example of storing memo writing of a user will be described with reference to FIG.
This will be described with reference to FIG.

When the user pulls out the toolbar at the bottom of the screen and touches the “memo” icon 286 with a finger, a memo input screen 600 as shown in FIG. 26 is displayed. When a user inputs characters and the like on this screen with a pen 610 attached to the electronic book, the characters are directly recorded as image data. After the writing, as shown in FIG. 27, by dragging and dropping the memo input screen to today's folder, the contents described on the memo input screen 600 can be stored in a folder file together with the storage date and time.

Today's folder reference process The user pulls out the toolbar at the bottom of the screen,
Touching the “today's folder” icon 288 with a finger causes the today's folder screen 7 of that day as shown in FIG.
00 is displayed. Among them, the data stored in today's folder on that day is iconified (710, 720,
730, 740). In this electronic book, the data content stored by the user is converted into an icon as a reduced image as it is, so that the user can easily evoke storage of the contents of the data. Further, since the time at which the data is stored is displayed below the icon, it is easy to use it as a record of the user's actions, which is convenient for organizing the data later.

The user inputs the iconized data 71
When the user touches 0, 720, 730, 740 with his finger and drags and drops it to the "view contents" portion 750, the contents are displayed on the screen. Similarly, if the contents are put in the trash box portion 780 that is "discarded", the contents can be automatically deleted.

When touching a portion 760 where "the previous day" is written, a "today's folder screen" of the previous day is displayed, and when touching a portion 770 where "the next day" is touched,
The next day, "Today's folder screen" is displayed. The user can go back to the previous folder screen and return to the current folder screen by touching the "previous day" and the "next day".

Further, as shown in FIG. 29, when the icon of the related data is moved by a finger so as to touch, the touching data is grouped. This is convenient for organizing data.

FIG. 30 is a diagram for explaining an example of the use of folders today.

For example, it is assumed that a user carries this electronic book with him for a travel of about one month, and stores various data in today's folder while traveling. When the user opens the electronic book, 30 today's folders are stored (see FIG. 30A).

The user writes today's folder data stored in the electronic book 800 to another computer 810 connected to the Internet and sends it to the travel data collection company 820 using the Internet (FIG. 30B). reference).

The travel data collection company 820 edits the collected data and supplies the latest travel data to the travel software publishing company 830. And travel software publisher 830
Releases travel software upgraded based on the latest data.

If the electronic publishing industry develops in this way, it will be possible to supply digital software having contents reflecting the latest data. In addition, publishing requires no money and hassle, so that the ideal image of publishing can be realized such that anyone can easily publish, or publish a specialized one with limited subscribers. Is also possible.

(6) Configuration of Electronic Book Next, the hardware configuration of the electronic book according to the present embodiment will be described with reference to FIG.

As shown in FIG. 31, the electronic book according to the present embodiment includes a CPU (Central Processing Unit) 1010, a memory 1020, a display controller 1030, a touch panel controller 1040, a bus 1050, a touch panel 1060, a display 1070, a disk drive controller. 1080, disk drive 109
0, information storage medium 1220, camera 1130, pen 11
20.

The display 1070 is composed of a liquid crystal or the like, and the output is controlled by the display controller 1030.

The touch panel 1060 is constituted by a panel of an optical type, a resistance type, a capacitance type, an ultrasonic type or the like, and is controlled by a touch panel controller 1040. The touch panel 1060 is connected to the display 10
A transparent touch sensor plate is superimposed on 70. When the user touches the display screen with a fingertip, a pen 1120, or the like, the touch panel 1060 can detect contact position information, a contact pressure and a contact area of the finger, and image data such as a character or a figure input with the pen 1120.

By thus integrating the transparent touch sensor plate on the surface of the display 1070, a finger motion input or a pen input on the display screen becomes possible.

The CPU 1010 controls the entire apparatus, performs various data processing, and executes the various processing described with reference to FIGS. The memory is composed of a ROM and a RAM.
Is storage means used as a work area or the like of the CPU 1010, and stores given contents of the information storage medium 1220 and the ROM, the calculation results of the CPU 1010, and the like.

A disk drive 1090 writes and reads data to and from an information storage medium 1220 such as a floppy disk, and is controlled by a disk drive controller 1080.

The information storage medium 1220 mainly stores data and programs for generating images, information for performing the various processes described with reference to FIGS. 2 to 30, and the like.

The camera 1130 is for taking moving pictures and still pictures.

The pen 1120 is for inputting a memo on the display screen, and may be anything as long as a pen-shaped stick or ink does not adhere to the display.

When the user performs various inputs such as finger operation on the display, memo input, photographing with a camera, etc., the CPU 1010 executes the operation specified by the user based on the input contents. I do.

FIG. 32 is an example of a functional block diagram of the electronic book.

The finger motion detection unit 1110 is for detecting the history of finger movement performed by the user on the display unit, the contact pressure, and the contact area. The finger motion detection unit 1110 is configured by overlapping a transparent touch panel or the like on the display unit 1240. The detection data obtained by the finger motion detection unit 1110 is input to the processing unit 1100.

The pen input unit 1120 is for the user to input the contents described with the pen on the display unit.
The pen input unit 1120 is configured such that when a user writes characters, graphics, and the like on the display unit 1240 with the pen 1120, a transparent touch panel or the like superimposed on the display unit detects the content as image data. The detection data obtained by the pen input unit 1120 is input to the processing unit 1100.

The photographing section 1130 is for the user to photograph at least one of a moving image and a still image. The imaging unit 1130 is configured by a camera, a video camera, or the like. The photographing data photographed by the photographing unit 1130 is input to the processing unit 1100.

The processing section 1100 generates an image to be displayed on the display section based on the detected data obtained by the finger operation or pen input, photographing data, a given program, and the like, stores the data in a folder file, and the like. Is what you do. The function of this processing unit 1100 is a CPU (CISC
, RISC type), DSP, custom (gate array, etc.) IC, and memory such as memory.

The information storage medium 1220 is for storing programs and data. This information storage medium 1
The function of 220 can be realized by hardware such as a CD-ROM, cassette, IC card, MO, FD, DVD, hard disk, and memory. The processing unit 1100 performs various processes based on the program and data from the information storage medium 1220.

The processing section 1100 includes a processing content determination section 114
0, various processing units 1150, an image generation unit 1200, and a storage unit 1230.

The processing content determining unit 1140 determines the content to be processed based on the data input from the finger motion detecting unit 1110, the pen input unit 1120, and the photographing unit 1130.

The various processing units 1150 include the enlargement processing unit 116
2, reduction processing unit 1164, rotation processing unit 1166, scroll processing unit 1168, ordinary search processing unit 1172, logical product search processing unit 1174, page turning processing unit 1182,
Continuous page turning processing unit 1184, bookmark insertion processing unit 1
186, a bookmark insertion point reference processing unit 1188, a floating processing unit 1192, a photographing processing unit 1194, a memo input processing unit 1196, and a folder reference processing unit 1198,
According to the determination of the processing content determining unit 1140, the map image is enlarged, reduced, rotated, scrolled, ordinarily searched, logical product search, page turning, continuous page turning, bookmark insertion, bookmark insertion. It performs location reference processing, floating processing, photographing processing, memo input processing, folder reference processing, and the like.

[0127] The storage unit 1230 stores various information, and includes a folder file 1232 for storing data stored in today's folder.

The image generation unit 1200 includes various processing units 115
0 generates an image to be displayed on the display unit based on the processing performed by the control unit 0.

(7) Operation Example of this Embodiment FIGS. 33 to 41 are flowcharts showing an operation example of the electronic book of this embodiment.

In the electronic book of this embodiment, when there is an input such as a finger operation, a pen input, and a photographing operation, the processing content is determined as follows (step S10 in FIG. 33). If the current shooting mode, the shooting process is performed (step S20,
S30). Normally, the mode is the normal input mode, and when the camera icon on the toolbar is touched, the mode shifts to the shooting mode. When an input is detected in the shooting mode, FIG.
The photographing processing described with reference to FIGS. 3 to 25 is performed.

For example, when it is detected that the user has pressed the operation button on the screen, the processing corresponding to the button is detected. For example, when the “movie” or “still picture” button is touched, the moving picture and the still picture are touched. Selection process, if the "shutter" button is touched, a still image is shot, the shot image data is stored in a folder file with the date and time of shooting, and the "recording standby" button is touched In this case, the process of starting shooting of a moving image, the process of ending the shooting of a moving image when the “recording” button is touched, and storing the shot image data in a folder file with the shooting date and time, etc. Is performed.

If the current mode is the memo input mode, memo input processing is performed (steps S40 and S50). Normally, the mode is the normal input mode. When the memo icon on the toolbar is touched, the mode shifts to the memo input mode. When an input is detected in the memo input mode, the memo input process as described with reference to FIGS.

For example, when it is detected that the user has input characters or the like with a pen on the screen, a process of displaying the input content in real time and storing the input content as image data in the work area is performed. When the input content is dragged and dropped, a process of storing the image data stored in the work area with the date and time of storage in a folder file is performed.

If the current mode is the folder reference mode, folder reference processing is performed (steps S52 and S54). Normally, the mode is the normal input mode. When the today's folder icon on the toolbar is touched, the mode is switched to the folder reference mode. When an input is detected in the folder reference mode, the folder reference processing as described with reference to FIGS. 28 to 29 is performed.

For example, if it is detected that the user has touched the icon on the screen and dragged and dropped it on the "view contents" part, the process of displaying the data contents on the screen is performed. Done. Similarly, if it is detected that the data is put in the trash box marked “Discard”, the data is deleted. Also, if it is detected that the portion marked "Previous Day" has been touched, the process of displaying the "Today's folder screen" of the previous day is performed, and the portion marked "Next Day" is touched. Is detected, the process of displaying the “today's folder screen” the next day is performed.

In the normal input mode, when a finger touches the touch panel, the following processing is performed (see step S60 in FIG. 33 and FIG. 34).

When there is a contact with an icon on the toolbar, various icon processes (see FIG. 41) are performed (S70 and S80 in FIG. 34).

Input mark operation processing (see FIG. 36) in the case of contact with various input marks such as “search tag”, “book thickness”, “bookmark”, “bookmark insertion arrow”, etc.
Is performed (steps S90 and S100).

When the touch panel is touched at the second point or when a map image is displayed, a map operation process is performed (steps S110, S120, S130).

If there is no contact at the second point, it is detected whether or not the contact point is moving, and if it is moving, the processing contents indicated and input by the contact area and the contact pressure are determined. A determination is made (steps S140, S150).

When the contact area and the contact pressure are equal to or more than predetermined values, a scroll process is performed if the displayed image is a map image, and a page turning process is performed if the displayed image is a normal book page image. (Steps S160, S18
0).

If the contact area and the contact pressure are not equal to or larger than the predetermined values, the following processing is performed (see FIG. 35). If not drag and drop to "Today's folder"
If there is information surrounded by a finger, floating processing of the information surrounded by the finger is performed (steps S910 and S910).
960, S970).

In the case of drag and drop to “Today's folder”, if the content is a memo, the memo is stored as image data in a folder file with a storage date and time (steps S920 and S93).
0).

If the data is floating data, the floating data is stored with a storage date and time in a folder file (steps S940 and S940).
950).

FIG. 36 is a flow chart for explaining the detailed processing contents of the processing (step S100 in FIG. 34) when a touch on the input mark is detected.

When the user's finger touches the search tag, a search process is performed (steps S210 and S22).
0).

If the user's finger touches the bookmark insertion arrow mark, bookmark insertion processing is performed (steps S230 and S240).

If the user's finger is in contact with the bookmark mark, bookmark insertion point reference processing is performed (steps S250 and S260).

If the user's finger is in contact with the continuous page turning mark, a continuous page turning process is performed (steps S270 and S280).

FIG. 37 is a flow chart for explaining the detailed processing contents of the map operation processing (step S130 in FIG. 34).

The change in the distance between the two points is calculated (step S
310) If the distance between the two points is increasing, enlargement processing according to the enlargement distance is performed (steps S320 and S3).
30).

If the distance between the two points is reduced, a reduction process according to the reduced distance is performed (steps S340 and S340).
350).

If the distance between the two points has not changed,
A rotation process is performed (steps S360, S370).

FIG. 38 shows a search process (step S2 in FIG. 36).
FIG. 20 is a flowchart for explaining a detailed processing content of 20).

When the contact of the second point of the user's finger is not detected, a page in which information satisfying the search condition of the search tag touching the user's finger is described,
A normal search process for displaying the first page is performed (steps S410, S420).

The contact of the user's finger at the second point is detected,
If it is a contact on the search tag, information satisfying the condition corresponding to the logical product of the two search conditions is described if the logical product of the search conditions of the two search tags is scheduled. A logical product search process of searching for the current page and displaying the first page on the display unit is performed (step S44).
0, S450).

FIG. 39 is a flow chart for explaining the detailed processing contents of the page turning processing (step S180 in FIG. 34).

When the contact position of the user's finger is moving from left to right on the screen, and when the displayed book is a vertically written book, the image is updated to the image of the next page, and the horizontally written book is updated. In this case, the image is updated to the image of the previous page (step S51).
0, S520, S530, S540).

When the contact position of the user's finger is moving from right to left on the screen, and the displayed book is a vertically written book, the image is updated to the image of the previous page, and the horizontally written book is updated. In this case, the image is updated to the image of the next page (step S55).
0, S560, S570, S580).

FIG. 40 is a flow chart for explaining the detailed processing contents of the continuous page turning process (step S280 in FIG. 36).

The contact pressure of the user's finger is detected, and if the pressure is not equal to or higher than the predetermined pressure value, the continuous page turning is stopped (steps S610, S620, S630).

If the pressure is equal to or more than the predetermined pressure value, continuous page turning is performed as follows.

That is, if the contact position of the user's finger is the thickness of the book at the right end on the screen, and if the displayed book is a vertically written book, the page is turned continuously in the previous page direction. In the case of a horizontally written book, page turning is continuously performed in the next page direction (steps S640, S650, S66)
0, S670).

If the contact position of the user's finger is the thickness of the book at the left end on the screen, and if the displayed book is a vertically written book, the page is turned continuously in the next page direction. In the case of a horizontally written book, page turning is performed continuously in the previous page direction (steps S640, S680, S69).
0, S700).

FIG. 41 is a flow chart for explaining the detailed processing contents of the various icon processing (step S80 in FIG. 34).

If the touch is on the camera icon, an operation screen for camera shooting as shown in FIG. 23 is displayed and the mode is shifted to the shooting mode. (Steps S810, S82
0). Hereinafter, when an input is made during the shooting mode, FIG.
The photographing process of step S30 of 3 is executed.

If the contact is on the memo icon,
A memo input screen as shown in FIG. 26 is displayed, and the mode shifts to the memo input mode. (Steps S830 and S840). When there is an input during the memo input mode, the memo input process of step S50 in FIG. 33 is executed.

If the touch is on the today's folder icon, a today's folder screen as shown in FIG. 28 is displayed, and the mode shifts to the folder reference mode. (Step S85
0, S860). When an input is made during the folder reference mode, the folder reference process of step S54 in FIG. 33 is executed.

(8) Other Various Embodiments The present invention is not limited to the present embodiment, and various modifications can be made within the scope of the present invention.

In this embodiment, the case where the operation input is performed using the thumb and the index finger has been described as an example, but the present invention is not limited to this. For example, a thumb and a middle finger may be used, or a combination of other fingers may be used.

In the present embodiment, the case of an electronic book has been described as an example, and therefore, the first page in which search information that is the logical product of the search items is described is displayed. In some cases there is no concept of a page. Therefore, the information unit may be displayed regardless of the page.

Further, in the present embodiment, an example has been described in which, when two search items are simultaneously touched with a finger, search information that is a logical product of the two items is output, but the present invention is not limited to this. For example, a case may be used in which three or more search items are simultaneously touched with a finger and search information that is a logical product of the three or more items is output.

Further, the search information that is a logical product may be output not only when the finger is touched at the same time but also when the finger is touched within a predetermined time.

If there is no information having a relation between a search condition and a logical product corresponding to a plurality of search items touched by a finger at the same time or within a predetermined time, a logical sum or a combination of a logical sum and a logical product It may be configured to further include a unit for outputting information having at least one of the information to the display unit.

For example, “South India”, “Lodging” and “Meal”
May be configured to output the South Indian accommodation information and the South Indian meal information when the tags are simultaneously touched.

In particular, when displaying in information units regardless of the page, such a configuration is effective.

For example, in a case where an electronic book or a portable information terminal in which telephone numbers are stored can be searched for and output in telephone number units, when a plurality of telephone number search items are specified in the table of contents,
This includes a case where telephone numbers having a logical sum or logical product relationship are automatically listed in accordance with the designation. That is, for example, when an item having a relation in which a common set of “Hospitals in Area A” is scheduled such as “A District” and “Hospital” is specified, information having a logical product relation is retrieved and output. "A district" and "B district" or "Hospital" and "Library"
For example, when an item having a relationship in which a common set is not scheduled is specified, information having a logical OR relationship may be retrieved and output.

In this embodiment, a memo input screen,
Although illustrated as a full screen such as a photo mode screen, a partial display using a window may be used.

[0179]

[Brief description of the drawings]

FIG. 1 is a functional block diagram of a form information device or an electronic book having a characteristic function of the present invention.

FIGS. 2A, 2B, and 2C are external views of an electronic book according to the present embodiment.

FIG. 3 is a diagram showing an example of a screen displayed when travel information software is set.

FIG. 4 is a diagram illustrating a display example of a map image.

FIG. 5 is a diagram for describing an operation example of a map enlargement gesture according to the present embodiment.

FIGS. 6A and 6B are diagrams illustrating an example of a finger operation in the present embodiment.

FIG. 7 is a diagram for explaining another operation example of the map enlargement gesture according to the present embodiment.

FIG. 8 is a diagram illustrating an operation example of a map scroll gesture according to the present embodiment.

FIG. 9 is a diagram for describing an operation example of a map reduction gesture in the present embodiment.

FIG. 10 is a diagram for describing an operation example of a map rotation gesture according to the present embodiment.

FIG. 11 is a diagram for describing a rotation angle of a map according to the present embodiment.

FIG. 12 is a diagram for describing an example of a search process according to the present embodiment.

FIG. 13 is a diagram for describing an example of a logical product search process according to the present embodiment.

FIG. 14 is a diagram for describing a page turning operation in the present embodiment.

FIG. 15 is a diagram for describing a continuous page turning operation in the present embodiment.

FIG. 16 is a diagram for describing a bookmark insertion operation in the present embodiment.

FIG. 17 is a diagram for describing a bookmark insertion operation in the present embodiment.

FIG. 18 is a diagram for describing a bookmark insertion point reference operation in the present embodiment.

FIG. 19 is a diagram illustrating an example of a screen on which a toolbar is displayed.

FIG. 20 is a diagram for describing an operation example of floating processing according to the present embodiment.

FIG. 21 is a diagram for describing an operation example of floating processing according to the present embodiment.

FIG. 22 is a diagram for describing an example of a drag-and-drop operation in the present embodiment.

FIG. 23 is a diagram illustrating a camera shooting operation screen according to the present embodiment.

FIG. 24 is a diagram for describing still image shooting processing according to the present embodiment.

FIG. 25 is a diagram for describing moving image shooting processing according to the present embodiment.

FIG. 26 is a diagram for explaining a memo input process in the present embodiment.

FIG. 27 shows a drag / drop operation for memo input in the present embodiment.
It is a figure for explaining an AND drop operation.

FIG. 28 is a diagram illustrating a today's folder reference screen according to the present embodiment.

FIG. 29 is a diagram for explaining today's folder reference processing in the present embodiment.

FIG. 30 is a diagram for describing an example of utilization of today's folder in the present embodiment.

FIG. 31 is a diagram illustrating a hardware configuration of the electronic book according to the embodiment.

FIG. 32 is an example of a functional block diagram of an electronic book of the present embodiment.

FIG. 33 is a flowchart illustrating an operation example of the present embodiment.

FIG. 34 is a flowchart illustrating an operation example of the present embodiment.

FIG. 35 is a flowchart illustrating an operation example of the present embodiment.

FIG. 36 is a flowchart illustrating an operation example (input mark operation processing) of the present embodiment.

FIG. 37 is a flowchart illustrating an operation example (map operation processing) of the present embodiment.

FIG. 38 is a flowchart illustrating an operation example (search processing) of the present embodiment.

FIG. 39 is a flowchart illustrating an operation example of the present embodiment (page turning processing).

FIG. 40 is a flowchart illustrating an operation example of this embodiment (continuous page turning processing).

FIG. 41 is a flowchart showing an operation example (various icon processing) of the embodiment.

FIG. 42 is a diagram for describing another operation example of the floating process in the present embodiment.

FIG. 43 is a diagram illustrating an example of a general information search when performing a search by designating a plurality of search conditions.

[Explanation of symbols]

 Reference Signs List 10 finger motion detection unit 20 processing unit 30 operation content judgment unit 40 map operation processing unit 42 enlargement processing unit 44 reduction processing unit 46 rotation processing unit 48 scroll processing unit 50 image generation unit 60 display unit 70 information storage medium 1010 CPU (central processing) Unit) 1020 memory 1030 display controller 1040 touch panel controller 1050 bus 1060 touch panel 1070 display 1080 disk drive controller 1090 disk drive 1100 processing unit 1110 finger motion detection unit 1120 input unit (pen) 1130 imaging unit (camera) 1140 processing content determination unit 1150 various Processing unit 1160 Map operation processing unit 1162 Enlargement processing unit 1164 Reduction processing unit 1166 Rotation processing unit 1168 Scroll processing unit 1170 Search processing 1172 Normal search processing unit 1174 Logical product search processing unit 1182 Page turning processing unit 1184 Continuous page turning processing unit 1186 Bookmark insertion processing unit 1188 Bookmark insertion point reference processing unit 1192 Floating processing unit 1194 Image processing unit 1196 Memo input processing unit 1198 Folder Reference processing unit 1200 Image generation unit 1220 Information storage medium 1230 Storage unit 1232 Folder file 1240 Display unit

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) G06F 15/403 340C (72) Inventor Satoshi Nebashi 3-5-3 Yamato, Suwa-shi, Nagano Prefecture Seiko Epson Corporation (72) Inventor Yoichi Wakai 3-5-5 Yamato, Suwa-shi, Nagano Seiko Epson Corporation F-term (reference) 5B019 DA08 DA10 HC00 HE19 5B075 ND03 ND06 ND12 NK02 NK39 PP10 PP13 PQ02 UU11 UU13 UU40 5E501 AA04 A AC33 AC35 BA05 CA04 CB05 CB11 CB14 CC04 CC14 EA05 EA07 EA08 EA10 EA13 EB05 EB06 FA03 FA04 FA12 FA14 FA15 FB04 FB24 FB32 FB33 FB34

Claims (5)

[Claims] 1. A portable information device including a display unit for displaying search items corresponding to a plurality of search conditions, wherein at least two of the displayed plurality of search items are:
A search input means for inputting a search execution specifying a plurality of search conditions by touching with a finger at the same time or within a predetermined time; and a search condition corresponding to a plurality of search items touched by a finger at the same time or within a predetermined time. Information search means for searching for information having a logical product relationship, wherein the search input means detects a position of a finger that has been brought into contact with a display unit, and based on the detected position of the finger, Means for judging the contacted search item. 2. The information retrieval device according to claim 1, wherein the information retrieval means is configured to determine that there is no information having a logical AND relationship with a search condition corresponding to a plurality of search items touched with a finger simultaneously or within a predetermined time. A portable information device for retrieving information having at least one of a logical sum and a combination of a logical sum and a logical product. 3. The portable information device according to claim 1, wherein the portable information device is used as an electronic book. 4. The image processing apparatus according to claim 3, further comprising a page image output unit that outputs information provided with a page number as image information in page units, wherein the page image output unit describes information satisfying a search condition. A portable information device for outputting an image of a first page. 5. An information storage medium for use in at least one of a portable information device and an electronic book including a display unit for outputting a search item corresponding to a plurality of search conditions, the information storage medium comprising: At least two,
Information for inputting a search execution specifying a plurality of search conditions by touching with a finger at the same time or within a predetermined time, and search conditions corresponding to a plurality of search items touched with a finger at the same time or within a predetermined time Information for searching for information having a logical product relationship, wherein the information for inputting the execution of the search includes information for detecting the position of the finger that has been brought into contact with the display unit, and information of the detected finger. An information storage medium comprising: information for determining a search item touched by a finger based on a position.