JP2000082107A - Image processing apparatus, image processing method, and medium - Google Patents

Abstract

(57) [Summary] [PROBLEMS] By simply imaging a two-dimensional code, it is possible to automatically execute a desired process corresponding to the two-dimensional code. SOLUTION: A business card-like object 100 picked up by a CCD camera is displayed in a finder screen 201 and a code I obtained by recognizing a two-dimensional code 101 printed on the object 100 is displayed.
The image file corresponding to D is read and displayed as, for example, a face image 100. At this time, the display position of the face image 110 is calculated based on the two-dimensional code coordinate data, and the face image 110 is synthesized and displayed so as to overlap the rectangular background portion 120 of the object 100. In this manner, by simply holding the object 100 in front of the CCD camera, a desired image corresponding to the two-dimensional code 101, such as displaying a desired image next to the two-dimensional code 101, can be automatically executed. .

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to an image processing apparatus, an image processing method, and a medium for causing a computer to execute an image processing program, and more particularly to, for example, identification information obtained from a two-dimensional code and the position of the two-dimensional code. The present invention relates to an image processing apparatus, an image processing method, and a medium for causing a computer to execute an image processing program that can acquire information and execute various processes based on the information.

[0002]

2. Description of the Related Art In recent years, a window manufactured by Microsoft Corporation in the United States has been developed.
In an operating system of a personal computer such as s95 (trademark) or Windows 98 (trademark), various task bars are prepared for an application having an active window. As a result, visual cues such as buttons are provided to the user.

The technique relating to the use of the task bar is disclosed in detail in Japanese Patent Application Laid-Open No. 8-255066, and the use of the task bar will be briefly described with reference to the contents thereof.

For example, a button for displaying information about a currently active window is provided on a task bar. The taskbar may also include a start menu button that allows the user to access menus for launching programs, opening documents, and setting the system.

[0005] For example, the operation of the start menu button on the task bar in a computer system including peripheral devices such as a mouse, a keyboard, and a video display and a central processing unit (CPU) will be described. The start menu button is operated when displaying a start menu for accessing programs, documents, system settings, help information, and the like. For example, the start menu is displayed by pointing the start menu button with the mouse cursor and clicking the left mouse button.

The displayed start menu includes, for example, “program”, “search”, “setting”,
Menu items such as “Help” are provided. Among them, for example, by selecting the “program” menu item, it is possible to access the hierarchically displayed program menu from the start menu.
A plurality of application programs and program groups that can be selected by the user are displayed on the program menu.

[0007]

However, the user operates the task bar provided with the above-mentioned start menu button, selects a desired application program, and repeats complicated operations until it is started.

For example, as described above, the user first points the start menu button on the task bar with the mouse cursor and clicks the left mouse button to display the start menu. Then, the user points the "Program" menu item with the mouse cursor from the displayed start menu and clicks the left mouse button to display the program menu. Then, the user points the display of the desired application program on the program menu with the mouse cursor and clicks the left mouse button. If the application program group, point and click further. By such an operation, an application program desired by the user is started by the CPU.

As described above, in order to start an application program desired by the user, there is a problem that the user has to repeat complicated operations. Further, there is a problem that it is difficult to use the user interface in a situation where one hand of the user is blocked by another operation. A similar problem occurs when a menu item such as "help" is clicked from the start menu program to perform a desired process.

By the way, for example, alphanumeric characters indicating an article identification number and the like are converted into bar codes and affixed to the article,
Barcode systems that read the attached barcode with an optical recognition device called a barcode scanner and obtain identification information of articles are widely used in many industrial fields. This system is mainly used in a cash register or the like installed in a merchandise store. For example, an identification number of the merchandise is acquired from a bar code attached to the merchandise, and the corresponding merchandise stored in advance is stored. Is read from the database and displayed on the display unit.

However, this bar code system is used, for example, for the purpose of saving the operator the trouble of inputting an identification number of an article by a key, and is used in a hard disk drive (HDD) of a general-purpose personal computer in advance. It has not been used at all for the purpose of saving the trouble of input operation such as menu selection operation when designating and starting a desired program from stored application programs.

The present invention has been made in view of such a situation, and an image processing apparatus, an image processing method, and an image processing method capable of executing a desired process corresponding to an image simply by giving the image. And a medium for causing a computer to execute the image processing program.

[0013]

An image processing apparatus according to a first aspect of the present invention includes an image acquisition unit for acquiring a target image and a target image pattern corresponding to a predetermined image pattern among the target images acquired by the image acquisition unit. Identification information recognizing means for recognizing identification information, and starting means for starting predetermined processing corresponding to the identification information recognized by the identification information recognizing means from a plurality of pre-registered processes and starting execution of the processing And characterized in that:

According to a twelfth aspect of the present invention, there is provided an image processing method, comprising: an image obtaining step of obtaining a target image; and identifying information corresponding to a predetermined image pattern from the target images obtained in the image obtaining step. An identification information recognizing step, and a start step of starting a predetermined process corresponding to the identification information recognized in the process of the identification information recognition step from a plurality of pre-registered processes and starting execution of the process. It is characterized by including.

According to a thirteenth aspect of the present invention, there is provided a medium for causing a computer to execute an image processing program according to the present invention, wherein an image acquisition step of acquiring a target image and a target image acquired from the image acquisition step are converted into a predetermined image pattern. From the identification information recognition step of recognizing the corresponding identification information, and a predetermined process corresponding to the identification information recognized in the process of the identification information recognition step, from among a plurality of pre-registered processes, start the process. And a starting step to start.

An image processing apparatus according to claim 1, wherein
In a medium that causes a computer to execute the image processing method according to claim 2 and the image processing program according to claim 13, a target image is obtained, and identification information corresponding to a predetermined image pattern is recognized from the target image. Then, a predetermined process corresponding to the recognized identification information is started from a plurality of processes registered in advance, and execution of the process is started.

[0017]

Embodiments of the present invention will be described below. FIG. 1 shows an example of use of a personal computer 1 to which the present invention is applied. The object 100 is a business card in this example.

A two-dimensional code 101 is directly printed on the right side of the object 100, or a label on which the two-dimensional code 101 is printed is attached.

As shown in FIG. 2, the two-dimensional code 101 has a rectangular area having a length of 9.5 blocks in the vertical direction and a length of 7 blocks in the horizontal direction. Inside, a black cell portion A and a logo portion B are arranged one block apart. In the cell section A, square cells are two-dimensionally patterned and arranged in a range of a square having a length of seven blocks in both the vertical direction and the horizontal direction. In the logo portion B, a large rectangular cell having a length of 1.5 blocks in the vertical direction and a length of 7 blocks in the horizontal direction is arranged. A name given to the system, for example, a logo mark such as CyberCode (trademark) is printed in white characters.
The cyber code can be obtained, for example, at the time of filing the present application by using the URL (http://www.sony.co.
jp / sd / ProductsPark / Consumer / PCOM / PCG-C1CAT / cyberco
The homepage on the Internet accessible at de.html) is described as follows.

"Cyber Code" is Sony's unique 2
There are about 16.77 million (24-bit) patterns in dimensional barcodes. Of these, about 1 million (20 bits)
It can be freely registered for starting any program. The remaining code is reserved for future service expansion. The "cyber code" acts as an index to extract the information on the corresponding computer from the one on which it is affixed, and as the program is started through the finder of CyberCode Finder, the "cyber code" is as if It provides a new interface where the corresponding information pops out of the computer from the affixed one. "

The personal computer 1 is a notebook computer, and a CCD video camera 23 is provided on the display unit 3. The personal computer 1 is, for example,
The pattern of the two-dimensional code 101 is recognized from the image data of the object 100 and the two-dimensional code 101 obtained by the imaging by the CCD video camera 23, and a predetermined process corresponding to the pattern is executed. I have.

3 to 8 show examples of the configuration of a portable personal computer to which the present invention is applied. The personal computer 1 is a mini-notebook type personal computer, and basically includes a main body 2 and a display unit 3 which can be opened and closed with respect to the main body 2. 3 is an external perspective view showing a state where the display unit 3 is opened with respect to the main body 2, FIG. 4 is a plan view of FIG. 3, and FIG. 5 shows a state where the display unit 3 is closed with respect to the main body 2. FIG. 6 is a right side view showing a state in which the display unit 3 is opened by 180 degrees with respect to the main body 2, FIG. 7 is a front view of FIG. 5, and FIG.
FIG.

The main body 2 is provided on its upper surface with a keyboard 4 operated when inputting various characters and symbols, and a stick type pointing device 5 operated when moving a mouse cursor. Also,
On the upper surface of the main body 2, there are further provided a speaker 8 for outputting sound and a shutter button 10 operated when capturing an image with the CCD video camera 23 provided on the display unit 3.

A claw 13 is provided at the upper end of the display unit 3. As shown in FIG. 5, when the display unit 3 is closed with respect to the main body 2, Is provided with a hole 6 into which the claw 13 is fitted. A slide lever 7 is provided on the front face of the main body 2 so as to be movable in parallel with the front face. I can do it. By releasing the lock, the display unit 3 can be rotated with respect to the main body 2. Microphone 2 next to claw 13
4 is attached. As shown in FIG. 8, the microphone 24 can also collect sound from the back.

A programmable power key (PPK) 9 is also provided on the front of the main body 2. As shown in FIG. 6, an exhaust hole 11 is provided on the right side surface of the main body 2, and an intake hole 14 is provided on the lower front surface of the main body 2 as shown in FIG. 7. Further, a PCMCIA (Personal Computer Memory Card Internat) is provided on the right side of the exhaust hole 11.
A slot 12 for inserting an ional association) card (PC card) is provided.

An LCD for displaying an image is provided on the front of the display unit 3.
(Liquid Crystal Display) 21 is provided, and an imaging unit 22 is provided at the upper end thereof so as to be rotatable with respect to the display unit 3. That is, this imaging unit 22
It can rotate to any position within a range of 180 degrees between the same direction as D21 and the opposite direction (backward direction). A CCD video camera 23 is attached to the imaging unit 22.

A power lamp is provided on the lower body side of the display unit 3.
PL, battery lamp BL, message lamp ML, other LEDs
Is provided. Reference numeral 40 shown in FIG. 5 is a power switch provided on the left side surface of the main body 2, and reference numeral 25 shown in FIG. 7 is an adjustment ring for adjusting the focus of the CCD video camera 23. Further, FIG.
Reference numeral 26 denotes a lid for covering an opening for mounting an additional memory in the main body 2, and reference numeral 41 denotes a lid 26.
This is a small hole for inserting a pin for removing the lock claw.

FIG. 9 shows an example of the internal configuration of the personal computer 1. The internal bus 51 includes a CPU (Centr
al Processing Unit) 52, PC inserted as needed
A card 53, a RAM (Random Access Memory) 54, and a graphic chip 81 are connected. The internal bus 51 is connected to an external bus 55. The external bus 55 has a hard disk drive (HDD) 56, an I / O
(Input / output) controller 57, keyboard controller 58, stick type pointing device controller 59, sound chip 60, LCD controller 83,
A modem 50 and the like are connected.

The CPU 52 is a controller that controls each function, and the PC card 53 is appropriately mounted when an optional function is added.

Image data captured by the CCD video camera 23 is input to the graphic chip 81 after being processed by the processing unit 82. The graphic chip 81 stores video data input from the CCD video camera 23 via the processing unit 82 into the built-in VRAM 8.
1A, read it out as appropriate, and output it to the LCD controller 83. The LCD controller 83 converts the image data supplied from the graphic chip 81 into the LCD 21
And display it. The backlight 84 is connected to the LCD 21
To be illuminated from behind.

In the RAM 54, when the activation is completed, an e-mail program (application program) 54A, an autopilot program (application program) 54B, and an OS (basic program) 54C are transferred from the HDD 56 and stored. .

The e-mail program 54A is a program for exchanging messages via a network from a communication line such as a telephone line. E-mail program 54A
Has an incoming mail acquisition function as a specific function. This incoming mail acquisition function executes processing for checking with the mail server 93 whether mail addressed to the user (user) has arrived in the mailbox 93A, and acquiring mail if there is any mail addressed to the user. I do.

The autopilot program 54B is a program for sequentially activating and processing a plurality of preset processes (or programs) in a preset order.

OS (basic program software) 54C
Controls the basic operations of a computer, such as Windows 95 and Windows 98 (trademark).

On the other hand, as shown in FIG. 10, an e-mail program 56A and an auto-pilot program 5
6B, OS (basic program software) 56C, two-dimensional code database 56D, finder application program (hereinafter abbreviated as FA program) 5
6E, two-dimensional code associate application program (hereinafter abbreviated as two-dimensional code program) 5
6F and a management tool program 56G are stored.

The two-dimensional code database 56D has 2
In addition to the identification information of the dimensional code 101 (hereinafter, referred to as a code ID), it is set in association with the two-dimensional code 101.
For example, an executable file (program) having an extension such as .exe or .com or a file name of a document file having an extension such as .txt, .htm, or .jpg is stored. These executable files are executable files that are set to be automatically started when the two-dimensional code is recognized (hereinafter referred to as two-dimensional code-related executable files). The document file is 2
When the two-dimensional code-related execution file is recognized, the two-dimensional code-related execution file is automatically started, and a document file (hereinafter, two-dimensional code) set to be automatically opened by the started two-dimensional code-related execution file Code-related document file). In addition,
In the following, when it is not necessary to particularly distinguish the two-dimensional code-related execution file and the two-dimensional code-related document file, the two are collectively referred to simply as a two-dimensional code-related file.

The two-dimensional code database 56D also has information (hereinafter referred to as two-dimensional code memo information) describing the contents of the two-dimensional code-related file, the name of the two-dimensional code-related file, etc., corresponding to the code ID. The information associated with the two-dimensional code 101 is stored. In addition,
Access to the two-dimensional code database 56D is performed in advance by using HD
DDL (Dynamic Link Library) installed in D56
Various kinds of program modules called are used.

The FA program 56E extracts, for example, the image data of the two-dimensional code 101 from the image data stored in the VRAM 81A of the graphic chip 81.
A launcher process (described later) for automatically executing a process corresponding to a two-dimensional code related file, a two-dimensional code extraction process,
And a program for performing processes such as a visual effect process (to be described later) for making these processes easier for a user to use. The FA program 56E also has an API (Application Programming Interface) for exchanging various data such as a code ID with the two-dimensional code program 56F.

The two-dimensional code program 56F is transmitted to the FA program 56E via the API of the FA program 56E.
This is a two-dimensional code-related execution file capable of exchanging data with the two-dimensional code.

The management tool program 56G is a program for registering data necessary for executing the FA program 56E and the two-dimensional code program 56F. The management tool program 56G or a predetermined GUI (Graphical User Interface) is provided.

OS 56 in the hard disk drive 56
C, the auto-pilot program 56B and the e-mail program 56A are sequentially transferred and stored in the RAM 54 in the course of startup (boot-up) processing.

In this example, the two-dimensional code database 56D is stored in the HDD of the personal computer 1.
Although it is stored in the 56, for example, it may be stored in a WWW (World Wide Web) server connected to the Internet 92, and may be a database that can be commonly used by Internet subscribers.

Returning to FIG. 9, the I / O controller 57 has a microcontroller 61, and the microcontroller 61 is provided with an I / O interface 62. The microcontroller 61 includes an I / O interface 62, a CPU 63, a RAM 64, and a ROM 69 connected to each other. The RAM 64 has a key input status register 65, an LED (light emitting diode) control register 66, a set time register 67, and a register 68. The set time register 67 is used to start the operation of the start-up sequence control unit 76 at a time (start-up condition) set by the user in advance. The register 68 stores a correspondence between a preset operation key combination (start condition) and an application program to be started. When the stored operation key combination is input by the user, the register 68 stores the correspondence. The activated application program (for example, e-mail) is activated.

The key input status register 65 stores an operation key flag when the programmable power key (PPK) 9 for one-touch operation is pressed. The LED control register 66 controls the lighting of a message lamp ML that indicates the start-up state of the application program (e-mail) stored in the register 68. The set time register 67 can arbitrarily set a predetermined time.

A backup battery 74 is connected to the microcontroller 61, and the values of the registers 65, 66, and 67 are retained even when the power of the main body 2 is turned off. It has become.

The ROM 69 in the microcontroller 61 stores a wakeup program 70, a key input monitoring program 71, and an LED control program 72 in advance. The ROM 69 is, for example, an EEPROM (electricall
y erasable and programmable read only memory). This EEPROM is also called a flash memory. Further, an RTC (Real-Time Clock) 75 that constantly counts the current time is connected to the microcontroller 61.

The wake-up program 70 in the ROM 69 checks based on the current time data supplied from the RTC 75 whether or not the time set in the set time register 67 has been reached. , A program for starting a predetermined process (or program) or the like. The key input monitoring program 71
9 is a program for constantly monitoring whether or not 9 has been pressed by the user. The LED control program 72 is a program for controlling lighting of the message lamp ML.

The ROM 69 further contains a BIOS (Basic Input / O
utput System) 73 is written. The BIOS refers to a basic input / output system, and is a software program that controls data transfer (input / output) between an OS or application software and peripheral devices (display, keyboard, hard disk drive, etc.).

A keyboard controller 58 connected to the external bus 55 controls input from the keyboard 4. The stick type pointing device controller 59 controls the input of the track point 5.

The sound chip 60 includes the microphone 24
Or an audio signal is supplied to the built-in speaker 8.

The modem 50 can be connected to a communication network 92 such as the Internet, a mail server 93, and the like via a public telephone line 90 and an Internet service provider 91.

The power switch 40 is operated when the power is turned on or off. The half-press switch 85 is turned on when the shutter button 10 is half-pressed, and the full-press switch 86 is turned on when the shutter button 10 is fully pressed. The reversing switch 87 is connected to the imaging unit 2
2 is rotated 180 degrees (CCD video camera 23
It is turned on when it is rotated in the direction of imaging the opposite side of the CD 21).

Next, the processing procedure of the CPU 52 when executing the launcher processing, which is programmed in the FA program 56E, will be described with reference to the flowchart of FIG.

In step S1, the CPU 52
When the FA program 56E stored in the object 6 is activated, the process proceeds to step S2 until the user operates the shutter button 10;
And the two-dimensional code 101 attached to it is a CCD
The image data captured by the video camera 23 and obtained as a result is processed by the processing unit 82 and waits until it is drawn on the VRAM 81A of the graphic chip 81.

For example, when the user enters the object 100
The side on which the two-dimensional code 101 is attached is the CCD
When the shutter button 10 is operated toward the video camera 23, the image data is captured by the CCD video camera 23, drawn on the VRAM 81A of the graphic chip 81, and the image data is output by the graphic chip 81 via the LCD controller 83. As shown in FIG. 12, it is displayed on the finder screen 201 of the LCD 21.

In step S2, the graphic chip 81
When the image data is drawn on the VRAM 81A, step S3
The CPU 52 extracts the image data of the two-dimensional code 101 from the image data drawn on the VRAM 81A,
A process for recognizing the dimension code 101 is performed. The CPU 52
If the recognition of the two-dimensional code 101 is successful, step S
Go to 5. That is, here, the CCD video camera 23
It is recognized that the two-dimensional code 101 exists in the image data captured by the method.

In step S3, if the recognition of the two-dimensional code 101 has failed, the CPU 52 proceeds to step S4, controls the LCD controller 83, and notifies the LCD 21 of the fact.
Is displayed to prompt the user to retry, and the process returns to step S2.

In step S5, the CPU 52 determines, based on the cell pattern of the two-dimensional code 101 recognized in step S3, the code ID and the four corner cells of the two-dimensional code 101 as shown in FIG. Coordinates ((x0, y
0, z0), (x1, y1, z1), (x2, y2, z
2), (x3, y3, z3)) (hereinafter referred to as two-dimensional code coordinate data). In the following, when it is not necessary to distinguish between the code ID and the two-dimensional code coordinate data, both are collectively referred to simply as two-dimensional code recognition information.

Next, in step S6, the CPU 52
Determines whether or not the code ID acquired in step S5 and the corresponding window handle (window ID) of the two-dimensional code program 56F are registered in a predetermined field of the FA program 56E. If it is determined that there is not, the process proceeds to step S7. In addition,
In the following, the code ID registered in a predetermined field of the FA program 56E and the corresponding window handle of the two-dimensional code program 56F are collectively referred to as two-dimensional code program registration information.

In step S7, the CPU 52 searches the two-dimensional code database 56D to determine whether or not the code ID obtained in step S5 is stored. If it is determined that the code ID is stored, the process proceeds to step S8. Further, the two-dimensional code database 56D is searched, and the name of the two-dimensional code related file stored corresponding to the code ID is read. , Which is set in relation to the two-dimensional code 101 is determined.

In step S8, if the CPU 52 determines that a two-dimensional code-related execution file has been set in relation to the two-dimensional code 101, the process proceeds to step S9, where the two-dimensional code-related execution file is stored in the two-dimensional code. It is determined whether or not the program is 56F.

In step S9, the CPU 52 determines that the two-dimensional code-related execution file is
If it is determined to be 6F, the process proceeds to step S10, where 2
Activate the dimension code program 56F.

Next, in step S11, the CPU 52
Registers the window handle of the activated two-dimensional code program 56F in a predetermined field of the FA program 56E in association with the code ID acquired in step S5. From this, the two-dimensional code program 56F
Is registered in the FA program 56E.

At step S12, the CPU 52
A two-dimensional code recognition message indicating that the two-dimensional code 101 has been recognized, that is, in this case, that the two-dimensional code recognition information of the two-dimensional code 101 has been acquired, is sent to the FA.
Output to the window handle registered in the program 56E. As a result, the two-dimensional code recognition message is delivered to the two-dimensional code program 56F.

Next, in step S13, the CPU 52
Supplies the two-dimensional code recognition information of the two-dimensional code 101 acquired in step S5 to the two-dimensional code program 56F via the API. Thus, the processing based on the two-dimensional code recognition information (for example, the two-dimensional code coordinate data of the two-dimensional code 101) is executed by the two-dimensional code program 56F.

After that, when the processing of the two-dimensional code program 56F is completed, in step S14, the CPU 52
Controls the LCD controller 83 and executes the FA program 5
A message prompting deletion of the two-dimensional code program registration information registered in the predetermined field of 6E is displayed, and the user is caused to delete the two-dimensional code program registration information.

In step S15, when the CPU 52 receives a command to delete the two-dimensional code program registration information from the keyboard controller 58 or the stick type pointing device controller 59, the CPU 52 proceeds to step S16 and deletes the two-dimensional code program registration information. Then, the process returns to step S2. On the other hand, if the CPU 52 receives a command not to delete the two-dimensional code program registration information in step S15, it skips step S16 and returns to step S2.

When the two-dimensional code program 56F is executed continuously, the processing can be executed more efficiently by registering the two-dimensional code program registration information in a predetermined field of the FA program 56E without deleting it. Is done.
For example, at this time, in step S6, it is determined that the two-dimensional code program registration information is registered in a predetermined field of the FA program 56E. As a result, steps S7 to S11 are skipped, and the process proceeds to step S12. In the subsequent processing, the newly obtained two-dimensional code recognition information is supplied to the two-dimensional code program 56F, and the two-dimensional code program 56F
By F, a predetermined process is executed.

In step S7, if the CPU 52 determines that the code ID acquired in step S5 is not stored in the two-dimensional code database 56D, the process proceeds to step S17, and starts the management tool program 56G (described later). Then, the process returns to step S2.

If the CPU 52 determines in step S8 that a two-dimensional code-related document file has been designated in relation to the code ID, the process proceeds to step S18, and executes processing for opening the two-dimensional code-related document file. Then, the process returns to step S2.

In step S9, if the CPU 52 determines that an execution file other than the two-dimensional code program 56F has been designated as a two-dimensional code-related execution file, the process proceeds to step S19, where the program is started. It returns to step S2. That is, in this case, the program is started, but thereafter, even if the user inputs the program by himself, the two-dimensional code program 56F
Unlike the above case, nothing is notified from the FA program 56F.

When the two-dimensional code 101 is recognized as described above, the two-dimensional code related file set in association with the two-dimensional code 101 is automatically executed.

Next, the operation of the CPU 52 when performing processing in accordance with the procedure of the two-dimensional code program 56F will be described with reference to FIG.
This will be described with reference to the flowchart of FIG.

When the two-dimensional code program 56F is activated in step S10 of FIG. 11, step S2
1, the CPU 52 includes a two-dimensional code program 56
The window huddle of F is supplied to the FA program 56E and registered (corresponding to step S11).

Next, in step S22, the CPU 52
Receives the two-dimensional code recognition message from the FA program 56E (corresponding to step S12), and in step S23, sends the FA program 56
The two-dimensional code recognition information is obtained from E (step S1)
3).

In step S24, the CPU 52 executes a predetermined process based on the two-dimensional code recognition information obtained in step S23. In this example, FIG.
15, a face image 110 as shown in FIG. 15 is superimposed on a blue rectangular background portion (hatched portion) 120 printed on the left side of the object 100 displayed as shown in FIG. ) Will be described as an example.

It is assumed that a moving image file such as an animated GIF file for displaying the face image 110 shown in FIG. 15 is stored in the HDD 56 or the like in advance.

The CPU 52 obtains the 2
Based on the two-dimensional code coordinate data of the two-dimensional code 101 in the two-dimensional code recognition information of the two-dimensional code 101,
The position on the LCD 21 where the face image 110 is displayed is calculated.
That is, for example, the coordinate values of the four corners of the background portion 120 of the object 100 are obtained corresponding to the two-dimensional code coordinate data of the two-dimensional code 101.

Next, the CPU 52 reads an image file for displaying the face image 110 from the HDD 56, and stores the face image 110 in the VRAM 81A based on the calculated display position of the image of the face image 110. The image is drawn together with the image of the two-dimensional code 101, and the image is synthesized. When the composition is completed, the graphic chip 81
The image data drawn on the VRAM 81A is displayed on the finder screen 201 of the LCD 21 via the LCD controller 83 as shown in FIG.

The face image 110 displayed on the finder screen 201 of the LCD 21 is an animated GIF.
In addition to an animation moving image based on a file or the like, a high-quality moving image based on an MPEG file or the like can be used.
Furthermore, a still image based on a JPEG file may of course be used. Also, by playing an audio file together with a moving image file, it is possible to output audio in synchronization with the moving image.

As described above, two-dimensional code coordinate data acquired as two-dimensional code recognition information,
Since the position information of the two-dimensional code 101 is supplied to the two-dimensional code program 56F, for example, the above-described image composition processing can be performed. Further, if this principle is used, for example, as shown in FIG. 17, when the four menu selection buttons A to D are displayed on the finder screen 201 of the LCD 21, the two-dimensional code 101 is changed to the desired menu. By displaying the menu selection button at the displayed position, a desired menu selection button can be selected. Thus, the user can select a desired menu selection button without operating the keyboard 4 or the stick type pointing device 5, for example.

Next, the above-described two-dimensional code program 5
The procedure of the visual effect processing programmed in the FA program 56E when the 6F (two-dimensional code-related execution file) is executed will be described with reference to FIGS. When the image of the two-dimensional code 101 as shown in FIG. 12 is displayed on the finder screen 201 of the LCD 21, the CPU 52 executes
When the two-dimensional code recognition information 1 is detected (corresponding to step S5), the LCD controller 83 is controlled, and as shown in FIG.
1 is surrounded by a frame 130 and displayed. This allows
The user can be visually notified that the two-dimensional code 101 has been recognized, and can easily confirm the current situation.

Further, the CPU 52 searches the two-dimensional code database 56D and reads out the name of the two-dimensional code-related file stored corresponding to the code ID of the two-dimensional code 101. The handle of the picture icon 121 representing the contents of the file is obtained and displayed on the two-dimensional code 101 via the LCD controller 83 as shown in FIG. In addition, CP
U52 searches the two-dimensional code database 56D,
The two-dimensional code memo information stored corresponding to the code ID is read out, and is read through the LCD controller 83 as shown in FIG.
As shown in (2), the display is displayed on the display unit 202 of the LCD 21.
From these facts, the user can use the 2D code 101 2
The contents of the processing performed by the dimension code related file
You can easily find out.

Here, by making the image of the icon 121 displayed on the two-dimensional code 101 superimposed, for example, as an image of a rotating globe, two-dimensional images are given to the user.
Successful reading of dimension code related files
It is possible to visually notify and easily confirm the current situation.

Further, the CPU 52 controls the LCD controller 83 while the process corresponding to the two-dimensional code related file is being executed, and the frame 130 displayed around the two-dimensional code 101 is changed to a dotted line in FIG. Frames 131, 1 indicated by
As shown in 32 and 133, it is displayed so as to gradually spread in all directions. Thus, the user can easily confirm that the process corresponding to the two-dimensional code related file is being executed.

Next, another procedure of the visual effect processing programmed in the FA program 56E when the processing corresponding to the two-dimensional code related document file is executed will be described with reference to FIGS. I do.

In this case, MD (Mini Disc; trademark) 150
And a two-dimensional code 151 in which an “album” file in which information about a song recorded on the MD 150 is stored as a two-dimensional code-related file.
In a state where the image is captured by the CCD video camera 23 and the image is displayed on the finder screen 201 of the LCD 21 as shown in FIG.
When the two-dimensional code recognition information of the dimension code 151 is obtained (corresponding to step S5), the LCD controller 83 is controlled to display a cross mark at the center of the finder screen 201 as shown in FIG. 2
"Searching" is displayed below 01. From this,
The user can confirm that the two-dimensional code 151 has been recognized.

When the CPU 52 searches the two-dimensional code database 56D and reads out the two-dimensional code memo information stored in correspondence with the code ID of the two-dimensional code 151, the CPU 52 controls the LCD controller 83, and FIG. As shown in (2), "acquisition" is displayed below the finder screen 201, and two-dimensional code memo information is displayed on the display unit 202. In the case of this example, the name of the singer D is displayed on the display unit 202 as two-dimensional code memo information. Thus, the user can easily confirm that the song of the singer D is recorded on the MD 150. Note that an image of the face of the singer D can be displayed as the two-dimensional code memo information.

When starting the process of opening the “album” file, which is a two-dimensional code-related file set in the two-dimensional code 151, the CPU 52 controls the LCD controller 83 and, as shown in FIG. At the bottom of the screen 201, "open" is displayed together with a display for counting the time until the processing is completed. When the "album" file is opened in this manner, information stored in the "album" file, such as a song title and performance time, is displayed as shown in FIG.

Next, the operation of the CPU 52 when executing processing in accordance with the procedure of the management tool program 56G will be described with reference to the flowchart of FIG. In this case, necessary data or commands are shown in FIGS. 26 and 27.
Corresponds to the management tool program 56G as shown in FIG.
The information is transmitted to the CPU 52 via the GUI.

If the code ID of the recognized two-dimensional code 101 is not stored in the two-dimensional code database 56D (step S7 in FIG. 11), the management tool program 56G is automatically started (step S17). The user operates the keyboard 4 or the stick-type pointing device 5 to activate the keyboard. When the management tool program 56G is started in step S31 by any of the methods, step S32
In the CPU 52, the two-dimensional code 101 to be registered
Judge whether the code ID of is specified, the code ID
If is not specified, the process proceeds to step S33.

At step S33, the CPU 52
The controller 83 is controlled to display a two-dimensional code ID setting GUI 300 as shown in FIG. 26 on the LCD 21. In step S34, the code ID of the registered two-dimensional code 101 is input to the two-dimensional code ID input unit 301. Wait until it is done. The user operates the keyboard 4 or the stick-type pointing device 5 to directly input the code ID to the two-dimensional code ID input unit 301 or the two-dimensional code ID feed button 303 to input the code ID.
The two-dimensional code 101 to be registered by any method
Is input to the two-dimensional code ID input unit 301, the process proceeds to step S35, where the CPU 52 stores the input code ID in the two-dimensional code database 56 of the HDD 56.
Store it in D.

If the CPU 52 determines in step S32 that the code ID of the two-dimensional code 101 to be registered has been designated, the process proceeds to step S35. For example, the two-dimensional code 101 is obtained by the process of step S5 in FIG.
In the state where the two-dimensional code recognition information has been acquired, the cell pattern of the two-dimensional code 101 is displayed on the two-dimensional code display part 302, and the code ID of the two-dimensional code 101 is displayed on the two-dimensional code ID input part 301. Is done.
That is, in this case, it is determined that the code ID is specified, and the process proceeds to step S35.

Next, in step S36, the CPU 52
Controls the LCD controller 83 to display a two-dimensional code-related file setting GUI 400 as shown in FIG. 26, and in step S37, associates the two-dimensional code 101 with the two-dimensional code 101 registered in the assigned file name input unit 304. It waits until the name of the file related to the two-dimensional code to be set is input. The user operates the keyboard 4 and the stick pointing device 5 to select a two-dimensional code-related file from the display unit 305 on which the file name of the recently used two-dimensional code-related file is displayed, and to refer to the reference button 306. To select a two-dimensional code-related file from files other than the file displayed on the display unit 305. When the two-dimensional code related file is selected by any method and the file name is input to the assigned file name input unit 304, the CPU 52 proceeds to step S38.

In step S38, the CPU 52
The operation waits until the two-dimensional code setting button 307 of the dimension code related file setting GUI 400 is operated, and when it is operated, the process proceeds to step S39 to control the LCD controller 83, and the setting data creation GUI 500 as shown in FIG.
Is displayed on the LCD 21.

Next, in step S40, the CPU 52
Is the title input unit 401 of the setting data creation GUI 500
Then, the title of the two-dimensional code related file and the two-dimensional code memo information are input to the two-dimensional code memo information input unit 402, and wait until the confirmation button 403 is operated, and the title and the two-dimensional code memo information are input. And
When the confirm button 403 is operated, the process proceeds to step S41, where the file name of the two-dimensional code related file selected in step S37 and the information input in step S40 are associated with the code ID, and the two-dimensional code database is set. 56D.

The importance check button 404 of the setting data creation GUI 500 is operated to prevent the registered two-dimensional code 101 from being automatically deleted. For example, in order to efficiently manage data, when the recording capacity of the two-dimensional code database 56D becomes full, the setting of the two-dimensional code 101 whose access date is the oldest is automatically deleted, Further, the setting of the two-dimensional code registered after the expiration date set in advance is automatically deleted. At this time, the user operates the importance check button 404 so that the important two-dimensional code setting is not deleted, and sets so that the important two-dimensional code is not automatically deleted for such a reason.

Next, in step S42, the CPU 52
Determines whether there has been a detailed data setting command from the keyboard controller 58 or the stick-type pointing device controller 59, and if there is a detailed data setting command, proceeds to step S43 and returns to the corresponding GUI
Is controlled by the LCD controller 83 and displayed on the LCD 21,
The input information is stored in the two-dimensional code database 56D in association with the code ID. Thereafter, the processing is terminated. If the detailed data setting command is not input in step S42, the CPU 52 skips step S43 and ends the process.

As described above, the two-dimensional code related file is set in relation to the two-dimensional code.

Next, the registration processing by the management tool program 56G will be described more specifically. In this case, for example, as shown in FIG. 28, a "call" file that describes the requirements for the user to contact the friend H is created and stored. The "call" file is used as a two-dimensional code-related document file.
Is registered in association with the two-dimensional code 501 attached to the mobile phone 500 as shown in FIG.

Therefore, first, the CCD video camera 2
When the two-dimensional code 501 is imaged by the
Recognizes the two-dimensional code 501 (step S3),
Acquire the code ID of the dimension code 501 (step S
5). Further, the CPU 52 determines that the acquired two-dimensional code ID is not stored in the two-dimensional code database 56D (step S7), and the management tool program 56G
Is started (step S17).

The CPU 52 includes a two-dimensional code related file setting GUI 400 shown in FIG. 26 and a setting data creation GUI 50 shown in FIG.
0 and the LCD controller 83,
To be displayed. The user operates the keyboard 4 or the stick-type pointing device 5 to select the previously saved “calling” file and set it in relation to the two-dimensional code 501.

By doing so, the next time the user enters the two-dimensional code 5
When the CCD video camera 23 picks up an image of the “01”, the launcher process is executed, and the “calling” file is automatically opened as shown in FIG. The user can confirm the request and send the requirement to the friend H without fail.

In the above description, the case where the present invention is applied to a two-dimensional code has been described as an example. However, as shown in FIG.
By taking an image with the video camera 23 and performing image processing such as edge extraction on the image 601, the sign and the gesture of the user are recognized, and when the image pattern as shown in FIG. May be executed.

The medium used to install the program for executing the above-described series of processes in a computer and to make the computer executable can be, for example, a package medium such as a floppy disk, CD-ROM, or DVD. Not only that, the program may be realized by a semiconductor memory or a magnetic disk in which the program is temporarily or permanently stored, and furthermore, a wired and wireless communication medium such as a local area network, the Internet, and digital satellite broadcasting, and the like. May be realized by various communication interfaces such as a router or a modem that transfers or receives a program provided via the communication medium of the present invention, and the medium in the present specification means a broad concept including all these media. Things.

[0106]

According to the image processing apparatus of the first aspect, the image processing method of the twelfth aspect, and the medium for causing a computer to execute the image processing program of the thirteenth aspect, the acquired target image Since the specific information corresponding to the identification information is activated from among a plurality of pre-registered processes, the target image corresponding to the target image can be obtained simply by giving the target image. Processing can be performed automatically.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a usage example of a personal computer 1 to which the present invention has been applied.

FIG. 2 is a diagram illustrating specifications of a two-dimensional code.

FIG. 3 is an external perspective view showing a state in which a display unit of a configuration example of a portable personal computer to which the present invention is applied is opened with respect to a main body.

FIG. 4 is a plan view of FIG. 3;

5 is a left side view showing a state in which the display unit of FIG. 3 is closed with respect to the main body.

FIG. 6 is a right side view showing a state where the display unit of FIG. 3 is opened 180 degrees with respect to the main body.

FIG. 7 is a front view of FIG. 5;

FIG. 8 is a bottom view of FIG. 6;

9 is a diagram showing an internal configuration of the personal computer 1 of FIG.

FIG. 10 is a diagram showing a configuration of an HDD 56 in FIG.

FIG. 11 is a flowchart illustrating a launcher process.

12 is a diagram showing a display example on the LCD 21 of FIG.

FIG. 13 is a diagram illustrating coordinate data of a two-dimensional code.

FIG. 14 is a flowchart illustrating processing of a two-dimensional code program 56F.

FIG. 15 is a diagram illustrating an example of an image stored in a VRAM 81A of FIG. 9;

16 is a diagram showing another display example on the LCD 21 of FIG.

17 is a diagram showing another display example on the LCD 21 of FIG.

18 is a diagram showing another display example on the LCD 21 of FIG.

19 is a diagram showing another display example on the LCD 21 of FIG.

20 is a diagram showing another display example on the LCD 21 of FIG.

21 is a diagram showing another display example on the LCD 21 of FIG.

FIG. 22 is a diagram showing another display example on the LCD 21 of FIG.

FIG. 23 is a diagram showing another display example on the LCD 21 of FIG.

24 is a diagram showing another display example on the LCD 21 of FIG.

FIG. 25 is a flowchart illustrating a two-dimensional code registration process.

FIG. 26 is a diagram showing a display example of a GUI of the management tool program 56G.

FIG. 27 is a diagram showing another display example of the GUI of the management tool program 56G.

28 is a diagram showing another display example on the LCD 21 in FIG.

FIG. 29 is a view showing a mobile phone 500 to which a two-dimensional code 501 is attached.

30 is a diagram showing another display example on the LCD 21 of FIG.

FIG. 31 is a diagram showing another display example on the LCD 21 of FIG. 3;

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 personal computer, 3 display part, 21
LCD, 23 CCD video camera, 52 CPU, 56
HDD, 56D 2D code database, 56E
Finder application program, 56F 2D code associate application program, 8
1 graphic chip, 83 LCD controller,
100 objects, 101 two-dimensional code,
110 face image, 120 background part, 201 finder image, 202 display unit

 ──────────────────────────────────────────────────続 き Continued on the front page (72) Inventor Takahiko Sueyoshi 6-7-35 Kita-Shinagawa, Shinagawa-ku, Tokyo Inside Sony Corporation (72) Inventor Toru Konishi 6-35, Kita-Shinagawa, Shinagawa-ku, Tokyo Sony Corporation

Claims (13)

[Claims] An image acquisition unit that acquires a target image; an identification information recognition unit that recognizes identification information corresponding to a predetermined image pattern from the target image acquired by the image acquisition unit; Starting means for starting predetermined processing corresponding to the identification information recognized by the identification information recognizing means from among the plurality of performed processing, and starting execution of the processing. apparatus. 2. The identification information recognizing means extracts a visible code provided on an object from the target image acquired by the image acquiring means, and identifies identification information corresponding to an image pattern of the visible code. The image processing apparatus according to claim 1, wherein the image processing apparatus recognizes the image. 3. The identification information recognizing means extracts a two-dimensional code provided on an object from the target image acquired by the image acquiring means, and corresponds to an image pattern of the two-dimensional code. The image processing apparatus according to claim 1, wherein the image processing apparatus recognizes identification information. 4. A target image display unit that displays the target image acquired by the image acquisition unit in a predetermined display area, and a relative position of the image pattern corresponding to the target image acquired by the image acquisition unit. Position information detecting means for detecting specific position information; and at the position on the display area corresponding to the position information detected by the position information detecting means, The image processing apparatus according to claim 1, further comprising a drawing unit configured to draw a corresponding image. 5. The drawing means superimposes an image corresponding to the identification information recognized by the identification information recognition means on the target image displayed in the display area by the target image display means. The image processing apparatus according to claim 4, wherein drawing is performed. 6. The drawing means displays an icon, which is activated by the activation means and indicates the content of the processing corresponding to the identification information, superimposed on the target image displayed in the display area. 5. The method according to claim 4, wherein
An image processing apparatus according to claim 1. 7. An animation display of the start of execution of the process corresponding to the identification information, which is started by the start unit, is superimposed on the target image displayed in the display area. The image processing apparatus according to claim 4, wherein: 8. The apparatus according to claim 4, wherein said drawing means draws an image obtained as a result of said processing corresponding to said identification information, activated by said activation means, in said display area. The image processing apparatus according to any one of the preceding claims. 9. The method according to claim 4, wherein the drawing unit draws a moving image obtained as a result of the processing corresponding to the identification information, started by the starting unit, in the display area. An image processing apparatus according to claim 1. 10. The image processing apparatus according to claim 1, further comprising: execution content display means for displaying character information associated with the processing corresponding to the identification information activated by the activation means. . 11. The apparatus according to claim 1, further comprising a registration unit for arbitrarily registering in advance said processing started by said start unit in accordance with said identification information recognized by said identification information recognition unit. 2. The image processing device according to 1. 12. An image acquisition step of acquiring a target image, and an identification information recognition step of recognizing identification information corresponding to a predetermined image pattern from among the target images acquired in the processing of the image acquisition step. Starting a predetermined process corresponding to the identification information recognized in the process of the identification information recognition step from a plurality of processes registered in advance, and starting the execution of the process. Image processing method. 13. An image acquisition step of acquiring a target image, and an identification information recognition step of recognizing identification information corresponding to a predetermined image pattern from among the target images acquired in the processing of the image acquisition step; Starting a predetermined process corresponding to the identification information recognized in the process of the identification information recognition step from a plurality of processes registered in advance, and starting the execution of the process. That causes a computer to execute the image processing program described above.