JP3501501B2 - Information processing apparatus and method - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus and method thereof.

[0002]

2. Description of the Related Art In recent years, with the development of computer devices and large-capacity memory devices, it has become possible to easily create a database of images, and image data such as photographs owned by an individual can be stored in a large-capacity memory such as an optical memory. An electronic album for recording in a portable memory has been proposed. When creating such an image database, it is important to add a keyword for searching the image data. As an example of having a function like this keyword and retrieving image data based on the information, it has been proposed to store the image data in association with the shutter speed, date, aperture value, etc. of the imaged camera. Japanese Patent Laid-Open No. 4-70735 proposes to store information about the shooting location of the image.

[0003]

However, in the above image database example, the shutter speed, aperture value,
The date and the like are important information when shooting with a camera, but are not suitable as information for retrieving image data thereafter.
It is impossible to use that information as a keyword.
As described above, in the conventional device, since the information that can be used as the keyword is limited, it is not possible to freely assign an arbitrary code as the keyword.

The present invention has been made in view of the above problems, and it is an object of the present invention to provide an information processing apparatus and a method thereof that can easily attach a keyword that an operator can easily understand.

It is another object of the present invention to provide an image search method and apparatus which can search for an image using a keyword that an operator can easily understand.

[0006]

Another object of the present invention is to obtain date and time information, position information, etc. when capturing an image, and to acquire the position information.
And event information based on the date and time information
An object of the present invention is to provide an information processing apparatus and method for storing vent information as a search keyword .

A further object of the present invention is to provide date and time information,
In addition to the position information or the like, to provide input image data, the information processing apparatus and method thereof can perform a search using the keyword based on the event information associated with them.

[0009]

In order to achieve the above object, the information processing method of the present invention comprises the following steps.
That is, the input step of inputting image data, and the position information from the position measuring means when the image data is input in the input step.
An acquisition step of acquiring the date and time information from the time measuring means, and a relationship between the position information and the date and time information and the event information based on the position information and the date and time information acquired in the acquisition step.
A search step for searching event information from a memory to be memorized ,
The image of the event information retrieved in the retrieval step
It is recorded in the memory as a search keyword in association with the data.
And a memory step of remembering .

In order to achieve the above object, the information processing apparatus of the present invention has the following configuration. That is, the input means for inputting the image data, and the position information from the position measuring means when the image data is input by the input means, the time measuring means.
An acquisition unit that acquires time information from, based on the acquired position information and date and time information by the acquisition unit, position information and
From a memory that stores the relationship between date and time information and event information
Search means for searching for event information, search by the searching means
Associate the retrieved event information with the image data
Means for storing in the memory as a search keyword
And are included.

[0011]

[0012]

According to the information processing method and apparatus having the above configuration, when the image data is input, the position is measured by the position measuring means.
The time and date information from the timekeeping means
Location information and date and time based on the location information and date and time information
Information from the memory that stores the relationship between information and event information
Event information, and the retrieved event information is
With the search keyword in association with the input image data of
And store it in memory.

[0013]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT A preferred embodiment of the present invention will now be described in detail with reference to the accompanying drawings.

FIG. 1 is a view showing the outer appearance of a portable information processing apparatus (pen input computer) according to an embodiment of the present invention.

In FIG. 1, reference numeral 1a indicates a main body of the portable information processing apparatus 1, which is a pen input computer here. 2 is a pen for inputting. Reference numeral 3 denotes a display unit made of liquid crystal or the like, and an input unit (digitizer) capable of inputting information or commands by the pen 2 is provided on the surface thereof. An image input unit 4 has a mechanism that can change the direction in which an image is taken by changing the direction of the main body 1a while fixing the main body 1a. For example,
It is also possible to rotate only the image pickup device unit for reading and inputting an image and change the direction. 5 is a telephone unit with a modem. 6 is the GPS (Glob of the spread spectrum communication unit
al Positioning System) Antenna. A portable memory 7 is, for example, a magnetic disk or an optical memory. 8
Is also a portable memory, for example, an IC card memory that houses a general-purpose interface. Reference numeral 9 denotes an operation switch, which includes a power switch and the like.

FIG. 2 is a view showing a state in which the image input section 4 and the telephone section 5 with a modem are removed from the main body 1a. Further, in FIG. 3, only the image input unit 4 is provided in the main body 1a according to a desired function.
FIG. 4 shows a state in which only the telephone 5 with a modem is attached to the main body 1a.

Here, in consideration of portability, each of these units includes the image input unit 4 and the telephone unit 5 with a modem as the main unit 1a.
Instead of connecting with a soft member such as a cord, they are connected with a rigid member and fixed and integrated. Further, in order to dissipate the power consumption and to disperse the weight depending on the connection state, the power supply batteries are provided separately in the main body 1a, the image input unit 4, and the telephone unit 5 with a modem.

FIG. 5 is a pen input computer 1 of this embodiment.
Is a block diagram showing the configuration of and the connection with its peripheral devices.
Portions common to those in the above figures are denoted by the same reference numerals, and description thereof will be omitted.

In FIG. 5, a bus 10 is used by the pen input computer 1 to send and receive various information. CPU1
1 controls the pen input computer 1 as a whole according to a control program stored in the internal memory 12. The internal memory 12 includes a control program executed by the CPU 11, semiconductor memories such as ROM and RAM for storing various data and application programs, a hard disk, and the like. Reference numeral 13 is a clock and calendar function unit, which has a calendar function as well as clocking time. Reference numeral 14 denotes a voice input / output controller, which controls capturing of voice from the microphone 15 or output of voice to a speaker. 16 is a spread spectrum antenna 6
A spread spectrum communication control circuit for processing the signal received in step S1 to reproduce information, and a telephone line control circuit 17 for performing communication through the telephone section 5 with a modem. Reference numeral 18 denotes an external control device interface, which controls data exchange with an external control device 19 such as another computer device. Reference numeral 40 denotes a general-purpose interface, which enables transmission / reception of information to / from the external memory 8 such as the IC card memory described above.

Reference numeral 20 denotes an image input controller, which can read image data from the image input unit 4 and take it in. Reference numeral 21 denotes an input unit, which is created by using a transparent electrode, and can input data and various commands by handwriting with the input pen 2 or by indicating a position. Three
Is a display unit such as a liquid crystal display, which is arranged below the transparent input unit 21 and displays various data such as handwritten characters input to the input unit 21 and various data according to commands. Reference numeral 22 denotes a wireless communication circuit, which enables transmission / reception of information to / from an external peripheral device 23 such as a remote controller. A portable memory drive unit 24 writes or reads information stored in the optical memory 7 or the like. A monitor output circuit 25 is provided for the TV monitor 26.
The contents displayed on the display unit 3 or other information is controlled to be displayed. A printer output circuit 27 can output the contents displayed on the display unit 3 or other information to the printer 28 for printing.

Next, the pen input computer 1 of this embodiment
The function of will be described.

First, as shown in FIG. 2, when the image input unit 4 and the telephone unit 5 with a modem are removed from the main body 1a and used only in the main body 1a, the internal memory 12 or the external IC card memory 8 or the optical memory 7 is used. With the application programs stored above, for example, text creation, drawing, address book registration and search, schedule creation, data search, and calculation can be performed. Further, by using the large-capacity optical memory 7, it can be used as a recording / playback of music, an electronic book, a personal data searcher, or the like.

Further, a spread spectrum antenna (GPS antenna) 6 capable of obtaining the latitude / longitude indicating the current position from signals sent from a plurality of artificial satellites,
By using the information from the spread spectrum communication control circuit 16 and the optical memory 7 recording map information and the like, it can be used as a navigation system.

Further, although the general-purpose interface 40 is the interface section for the IC card memory which is an example of the external memory 8 in the above, by incorporating a TV tuner or a radio tuner using the general-purpose interface 40, a TV program or You can enjoy the radio program and receive and display the information sent by teletext or TV facsimile.

Next, as shown in FIG. 3, the function when the image input section 4 is attached to the main body section 1a will be described.

Image input section 4 and image input controller 20
As a result, a high-detailed digital image is captured in the main body 1a. In this embodiment, it is possible to automatically add a search keyword that is useful for identifying an image when the image is captured.

Here, the medium for storing the image is a rewritable medium, for example, a magneto-optical memory is used as the optical memory 7. In this optical memory 7, event names common to a series of images to be captured from now on are recorded. For example,
In the “athletic meet”, “excursion”, “wedding”, etc., of course, these event names may be input later or may be changed.

Now, a case where an image is captured using the optical memory 7 in which "athletic meet" is recorded as an event name will be described with reference to FIG.

The optical memory 7 is mounted on the portable memory drive unit 24. In the image data of the optical memory 7, the content of the primary keyword added as a file is displayed. Reference numeral 600 denotes an event name recorded in the optical memory 7, and here, "athletic meet" is set as a keyword. Reference numerals 601 and 602 indicate information from the clock of the main body 1a and the calendar function unit 13, and the date “2003.10.10” (601) at the time of capturing an image and the time “PM 1: 3.
0 ”(602), and these are keywords. Further, 603 indicates information from the GPS antenna 6 and the spread spectrum communication control circuit 16, and the latitude of the place when the image is captured is“ North latitude to degree ”. The longitude indicates "west longitude-degree", which is also a keyword, and these keywords are sequentially recorded in the optical memory 7 as a file of keyword information together with image information when an image is captured.

In the present embodiment, the secondary keyword, which is inferred from the primary keyword, is added to the image information as a file.

FIG. 7 shows an example of a secondary keyword inferred from the primary keyword. For example, the secondary keywords “T City in Kanagawa Prefecture” and “J elementary school” are inferred from the map database based on the primary keywords “North latitude-degree”, “West longitude-degree” and “2003.10.10”.

The secondary keyword "daytime" is obtained from the primary keyword "PM 1:30". The secondary keyword “autumn” is obtained from the primary keyword “2003.10.10”. The secondary keyword "physical education day" is obtained from the primary keyword "2003.10.10" by referring to the calendar database. In addition, the secondary keywords “H man” and “Elementary school 4
The “grader” is inferred from the primary keywords “athletic meet”, “north latitude-degree”, “west longitude-degree”, and a database showing a family structure as shown in FIGS. 8 and 9.

FIG. 8 is a schematic diagram of a database showing the family structure, and FIG. 9 is a diagram for explaining an example of the history of each family member.
Here, the history of H man is shown. In addition to this, if there is a geographic database, the keywords corresponding to the place name such as "~ mountain", "~ river", "~ lake" are generated from the latitude / longitude information of the primary keyword, Can be added. Further, if a database regarding event names is used, more accurate keywords can be added.
For example, if there is a travel guide database for the event name “Nara Travel”, the primary keyword “latitude /
From the "longitude" information and the "year / month / day" information, for example, not only map information such as "February" but also keywords such as "Great Buddha" and "Omizutori" that represent famous buildings and events are generated. , Can be added to the image data.

The secondary keywords as described above are analogy to the primary keywords as described above, and it is not clear whether the information is the information that most accurately represents the image data. Therefore, at the time of search, for example, an image searched for by the primary keyword may be displayed first, and may be displayed with a degree of importance different from that of the primary keyword. When the user recognizes that the secondary keyword is an accurate keyword at the time of search (for example, when the user selects that the image data searched by the secondary keyword is the desired image data).
Can promote more accurate keywords automatically by promoting the secondary keyword to the primary keyword or by assigning a rating to the same secondary keyword and increasing the rating of the keyword.

These secondary keywords may be added when the image data is taken in or may be added when searching. Further, when the image data is added when it is taken in, the above-mentioned various databases are stored in advance in the optical memory 7 for storing the image data or in the IC card memory 8. Of course, when searching for image data, another secondary keyword can be added by referring to another database.

FIG. 10 is a flowchart showing a process of inputting image data and registering it in the external memory 8 or the like. A control program for executing this process is stored in the internal memory 12 and executed under the control of the CPU 11. It

First, in step S1, image data is input from the image input unit 4. Then, in step S2, the name (event name or the like) of this image data is input using the input pen 2 or the like, and together with this, the date and time information when this image data was input is also input from the clock and calendar function unit 13. At the same time, position information indicating the current position is input via the spread spectrum antenna 6,
This position information is also input through the control circuit 16. Then, in step S3, the above-mentioned primary keyword is generated according to the date and time, the event name, the position information, and the like. Further proceeding to step S4, referring to a database (for example, a geographic database, a family database, a calendar database, a travel guide database, an event database, etc.) that stores information related to this primary keyword, for example, the aforementioned FIG. A secondary keyword as shown in is generated.
Then, these primary and secondary keywords are associated with the input image data and stored in the external memory 8.

Next, referring to the flow chart of FIG. 11, a process of searching image data using these keywords will be described. A control program for executing this process is stored in the internal memory 12 and executed under the control of the CPU 11.

First, in step S11, a keyword (primary and / or secondary keyword) of image data to be searched is input. The input keyword may be, for example, “athlete H's athletic meet in autumn 2003” or the like. In step S2, it is checked whether or not there is image data having a keyword matching this keyword. If there is no image data, the process proceeds to step S13, the absence of target image data is displayed, and the process ends. In step S12, when there is a matching keyword, the process proceeds to step S14, and it is checked whether or not the image data to be searched can be specified from the input keyword. When the target image data can be specified, the process proceeds to step S17, and the target image data is read from the external memory 8.

On the other hand, when the image data cannot be specified in step S14, the process proceeds to step S15, the database related to the matched keyword is referred to, and the above-mentioned step 2 is performed.
Generates the next keyword. This secondary keyword is compared with the keyword of the image file stored in the external memory 8 to see if there is a matching keyword (step S16). Here, if a matching keyword is found, the process proceeds to step S17, and since the target image data has been specified (it is considered that almost the image data has been specified when the secondary keywords match), the image data is read from the external memory 8. Incidentally, this step S16 is executed when the image data cannot be specified only by the primary keyword, and therefore the operator may be prompted to input the primary or secondary keyword again.

If there is no matching secondary keyword in step S16, the process proceeds to step S19, a list of all the names of the image data with matching keywords at that time is displayed on the display unit 3, and the operator is prompted in step S20. On the other hand, the user is prompted to specify the desired image with the pen 2 or the like. When the image data is designated and specified in this way, the image data is read from the external memory 8.

As described above, according to the present embodiment, since the primary and secondary keywords are automatically added and stored when the image data is taken in, the subsequent image retrieval becomes easy.

Also, when searching for image data, 1
Since not only the next keyword but also the secondary keyword can be input and searched, desired image data can be obtained more accurately.

Further, since it is possible to automatically generate a secondary keyword related to the input keyword and retrieve desired image data, it is expected that the retrieval efficiency is improved.

FIG. 12 is a schematic view showing the structure of a search apparatus according to another embodiment of the present invention, in which the above-mentioned database is stored in another optical memory or a large capacity memory.

In FIG. 12, reference numeral 29 denotes a main body of the retrieval device, which is provided with respective drive units 30 and 31 of memory disks (for example, optical memories) 34 and 35, and a memory disk 34 for storing image data and a database. The stored disk 35 can be mounted.
Further, 32 is a keyboard and 33 is a display unit. Again 3
Reference numeral 6 is a network, and 37 is a large capacity memory connected thereto. Further, the database is also stored in the large capacity memory 37, and the keyword information can be retrieved through the network 36.

Images are searched using the primary and secondary keywords. For example, if the user wants to see the image of the autumn 2003 athletic meet as the desired image, "2003
The keywords "year", "autumn", and "athletic meet" are entered.
Images with the above keywords added to the keyword file are selected, and in order of the number of matching keywords,
Images are displayed on the display unit in the order of the primary keywords.
This allows the user to sequentially view the images.

Next, the operation when the modem-equipped telephone unit 5 shown in FIG. 4 is attached to the main body 1a will be described.

In this connection mode, information such as facsimile communication and personal computer communication is transmitted and received through a telephone line. Of course, the telephone unit 5 with a modem can be used as a mobile phone by itself.

Finally, the operation when both the image input section 4 and the telephone section 5 with a modem shown in FIG. 1 are attached to the main body 1a will be described. In this mode, the main body 1a
The image information taken in is transmitted / received to / from another communication device through the telephone line 5 with the modem through the telephone line. So-called T
V-phone or video conference can be performed.

FIG. 13 shows an example of the display unit 3 at that time. In this example, the child screen 110
As shown in, the image data transmitted to the other party is displayed on the display unit 3.
By displaying the image on a part of the screen, it is possible to confirm what kind of image is being transmitted. Also, child screen 1
It is also possible to call the information stored in the optical memory 7, the IC card memory 8, the internal memory unit 12 and the like by using 10, and then to transmit the information to the other party.

As described above, according to this embodiment, when capturing an image, a primary keyword for specifying the image is automatically added as a file, and a secondary keyword inferred from the above primary keyword is added. Is automatically added as a file and an image is searched using the primary and secondary keywords, so that a keyword that can accurately specify desired image data can be easily added.

Further, it is possible to provide a portable information processing device having a plurality of functions.

Further, the portable information processing device includes a clock, a calendar function unit and a spread spectrum communication unit, and when the image is taken in from the image input unit, the date and time information and the latitude and longitude information are set to 1 By recording and adding to the file as the next keyword, it is possible to easily add a keyword that can accurately specify a desired image when capturing image information.

Furthermore, the image input section and the telephone section with a modem can be attached to and detached from the main body section, and the portability is not lost.

Further, by distributing the batteries of the power source to each, the weight can be distributed, and the image captured by another information processing device can be sent and the image from the other information processing device can be received. There is.

[0057]

As described above, according to the present invention, it is possible to easily attach a keyword that an operator can easily understand.

Further, according to the present invention, it is possible to search for an image using a keyword that the operator can easily understand.

[0059]

[0060]

According to the present invention, there is an effect that image data can be input and searched using keywords based on event information related to date and time information and position information.

[0062]

[Brief description of drawings]

FIG. 1 is an external view of a pen input computer according to an embodiment of the present invention.

FIG. 2 is a diagram illustrating another form of the pen input computer according to the present embodiment.

FIG. 3 is a diagram illustrating another form of the pen input computer according to the present embodiment.

FIG. 4 is a diagram illustrating another form of the pen input computer according to the present embodiment.

FIG. 5 is a block diagram showing a configuration of a pen input computer of the present embodiment.

FIG. 6 is a diagram illustrating a specific example of primary keywords displayed on the display unit when an image is captured in the pen input computer according to the present embodiment.

FIG. 7 is a block diagram illustrating a pen input computer according to the present embodiment,
It is a figure explaining an example of the secondary keyword inferred from the next keyword.

FIG. 8 shows the pen input computer of the present embodiment, 2
It is a figure explaining an example of the database used when estimating the following keyword.

FIG. 9 shows the pen input computer of the present embodiment, 2
It is a figure explaining an example of the database used when estimating the following keyword.

FIG. 10 is a flowchart showing an image input process in the pen input computer of the present embodiment.

FIG. 11 is a flowchart showing an image search process in the pen input computer of the present embodiment.

FIG. 12 is a schematic view showing a search device according to another embodiment of the present invention.

FIG. 13 is a diagram illustrating an example of a display unit when transmitting / receiving image information and the like to / from another device using a telephone line in a pen input computer according to another embodiment.

[Explanation of symbols]

1 pen input computer 1a Pen input computer body 2 Input pen 3 Display 4 Image input section 5 Telephone section with modem 6 Spread spectrum communication antenna 7 Optical memory 8 external memory 13 Clock and calendar functions 16 Spread spectrum communication control circuit 19 General-purpose interface 21 Input section 23 External peripherals 26 TV monitor 28 Printer

─────────────────────────────────────────────────── ─── Continuation of the front page (58) Fields surveyed (Int.Cl. ⁷ , DB name) G06F 17/30 210-419 H04N 5/225 JISST file (JOIS)

Claims (4)

(57) [Claims] 1. An input device for inputting image data, and a position measuring device when the image data is input by the input device.
An acquisition unit that acquires the position information from the row and the date and time information from the timing unit, and the relationship between the position information and the date and time information and the event information based on the position information and the date and time information acquired by the acquisition unit.
Searching means for searching event information from a memory to be stored; and the event information searched by the searching means for the image
It is recorded in the memory as a search keyword in association with the data.
An information processing device comprising: a storage unit that stores the information. 2. The apparatus further comprises designation means for designating the name of the image data, and the storage means is designated by the designation means.
The information processing apparatus according to claim 1, wherein a name is stored in association with the image data . 3. An input step of inputting image data, and a position measuring hand when the image data is input in the input step.
An acquisition step of acquiring position information from the tier and date and time information from the time measuring means, and a relationship between the position information and the date and time information and the event information based on the position information and the date and time information acquired in the acquisition step.
A search step of searching the memory for event information, and the event information searched in the search step for the image
It is recorded in memory as a search keyword in association with data.
And a storing step of storing the information. 4. The method further comprises a designation step of designating the name of the image data, wherein the storage step designates the designation step.
The information processing method according to claim 3 , wherein the name is stored in association with the image data .