JP2004032663A - Image processing method by mobile phone - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To allow a portable mobile communication terminal only to simply and efficiently perform processing such as the synthesizing of images. <P>SOLUTION: First a mobile phone uploads processed images being prescribed composite images and background images acting like backgrounds for the processed images to a WEB server being an image composite server on the Internet through operations of buttons of the mobile phone, the server stores the images, selects one processed image among the processed images, displays the selected image on a display of the mobile phone, selects one background image among the background images after that, displays the background image on the display of the mobile phone, and the mobile phone designates a pasted part of the displayed background image, pastes the processed image within a cut range to the pasted part so as to compose the images. The composite image is generated only by operations of a cursor and the buttons of the mobile phone. <P>COPYRIGHT: (C)2004,JPO

Description

[Claims]
1. A method of performing image processing using a network including a mobile phone and an image synthesizing server of a system site communicable via the Internet, comprising:
A processing image selection transmission step of selecting a processing image from among the plurality of processing synthesis images stored in the mobile phone and transmitting the selected processing image to the image synthesis server;
A background image selection transmission step of selecting a background image from among the plurality of processing / composition images stored in the mobile phone, and transmitting the selected background image to the image composition server;
In order to synthesize and process the processing image and the background image stored in the image synthesis server, an activation step of activating an image synthesis processing program of the mobile phone,
A processing image selection display step of displaying a processing image stored on the image synthesis server corresponding to the selected list menu from the list menu displayed on the screen of the display unit of the mobile phone on the screen; When,
A cutout processing step of operating only the cursor and buttons of the mobile phone to specify a cutout range by dots on the processing image displayed on the screen;
A background image selection display step of displaying, on the screen, a background image stored on the image synthesis server corresponding to the selected list menu from a list menu displayed on the screen of the display unit of the mobile phone. When,
Simultaneously displaying the background image, displaying the cutout range on a background image to be pasted;
Selecting a paste position of the displayed cutout range, transmitting the image within the selected cutout range and the background image to which this image is pasted to the image synthesis server,
A processing step of performing image synthesis processing for synthesizing the image within the cutout range and the background image by the image synthesis server;
A composite image display step of displaying a processed composite image on the display unit of the mobile phone based on the composite processing completion notification from the image compositing server;
An image processing method in a mobile phone , comprising :
2. The image processing method according to claim 1, wherein, in the fixing step, an image within the cutout range is fixed after selecting a pasting position and then enlarging or reducing the image within the cutout range .
3. The image according to claim 1, wherein at least a part of each of the images for processing and synthesis to be subjected to the synthesis processing has been obtained by the user by photographing with a mobile phone. Image processing method for mobile phones .
4. An image synthesizing server which transfers an ID of the mobile phone and a URL of an image to be transferred from another site other than the system site to the image synthesizing server of the system site, and receives the transferred data. Locate the users of folders that are registered user, acquires the image derived from the URL data of an image to be transferred after confirmation, claims 1 to 3, characterized in that storing each user folder The image processing method in the mobile phone according to any one of the above.
DETAILED DESCRIPTION OF THE INVENTION
[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an image processing method definitive in mobile phones.
[0002]
[Prior art]
Recently, there are many cases where users of portable mobile communication terminals, for example, cellular phones communicate with each other through images (still images and videos) displayed on a display unit thereof. 2. Description of the Related Art In order to further enjoy conversation between users, a composition processing of a plurality of images is performed. As a conventional image processing method, for example, as disclosed in a communication network system described in JP-A-2001-148839, a user synthesizes a plurality of images with an image data synthesizing device, or So-called frame synthesis that processes an existing image and an arbitrary image created by the user, and transmits the synthesized image data directly or indirectly from the image data synthesizing device to the mobile phone using a relay image distribution device. Then, the received composite image data is displayed on the display unit.
[0003]
[Problems to be solved by the invention]
Although the image processing by the image data synthesizing apparatus can perform advanced processing, the processing always requires the existence of the image data synthesizing apparatus, and there is a difficulty in performing simple image processing. For this reason, conventionally, there has been a desire for a mobile phone user to easily perform a plurality of image combining processes directly on a mobile communication terminal without using an image data combining device.
Therefore, the inventor of the present invention uses a plurality of image data obtained by photographing or the like by himself / herself to determine whether or not it is possible to easily and efficiently perform processing such as image synthesis by user's operation. The research was carried out with an issue of whether the operation could be performed only by a portable mobile communication terminal.
Accordingly, it is an object of the present invention to enable processing such as simple and efficient image synthesis simply by operating a mobile phone as a mobile communication terminal.
[0004]
[Means for Solving the Problems]
The image processing method of the present invention is simple and efficient, and enables a user to perform processing such as image synthesis only by operating a mobile phone. Uploaded to the image synthesis server above, and in the mobile phone , for example, the information of the cutout range, the information of the movement position, the information of the enlargement / reduction, which is the image synthesis information, is operated by operating the cursor and buttons on the mobile phone . It is created and uploaded to the image synthesizing server, and thereafter, the images are synthesized based on a plurality of images for processing and synthesis and image synthesis information.
According to the image transfer method of the present invention, the mobile phone can communicate with the system site and other sites other than the system site via a communication network, and the ID of the mobile phone and the image to be transferred can be transferred from the other site. The URL is transferred to the image compositing server of the present system site, and the image compositing server that receives the transferred data confirms the location of the folder of the user registered as a user, and after confirming the URL data of the image to be transmitted, The obtained image is acquired and stored in each user folder.
[0005]
BEST MODE FOR CARRYING OUT THE INVENTION
As an embodiment of the present invention, a user (a user in this example) uses only a mobile phone as a user interface, and uses still images and still images, which are a plurality of images for processing and synthesis, using still images. An example of performing the combining process will be described with reference to the drawings.
To execute the present system, a communication network including the mobile phone 1 shown in FIG. 1 and the present system site 3 communicable via the Internet (communication network) 2 is used. Other sites (sites 30 and 31 in the figure) other than the system site 3 are incorporated in this communication network.
This system site 3 has an image composition server 4 shown in FIG. The illustrated image synthesizing server 4 includes four WEB (web) servers 4a, six image processing servers 4b, one lath (Remote Access Server) 4c, two mail servers 4d, and one load balancer (load). It is composed of a distribution device 4e, one WEB storage (external storage device) 4f, and one DB (database) server 4g.
Note that the number of devices 4a to 4g configuring the image compositing server 4 is not limited to the illustrated example.
[0006]
In this system, as shown in FIG. 3, processing images X1 and X2 (processing files), which are primary processing image data to be processed by a plurality of processing synthesis images (processing synthesis image data), and , For example, background images Y1 and Y2 (background files), which are secondary processing image data, to create composite images Z1, Z2, Z3 and Z4 (processed files) as composite image data. Is what you do.
Hereinafter, a procedure up to processing into a composite image Z1 using the processing image X1 and the background image Y1 will be described with reference to FIGS.
[0007]
As a pre-processing step, the user prepares a plurality of processing-combining images (processing images X1 and X2 and background images Y1 and Y2) to be used for performing image-combining processing only with the mobile phone 1.
The user prepares an image obtained by appropriate means such as an image copied and downloaded from the WEB server 4a, an image sent from a mail server 4d from an acquaintance or the like as an image for processing and combining. If the user's mobile phone 1 has a camera function, an image captured by the camera is used as a processing / combining image.
The user saves a plurality of prepared and synthesized images for processing and synthesis in the mobile phone 1.
[0008]
The image for processing and synthesis stored in the mobile phone 1 is subjected to the processing of the synthesis processing according to each step shown in FIG. Then, in the process, the user operates while referring to the guidance display on the screen on the display unit 1a of the mobile phone shown in FIG. That is,
An appropriate processing image (processing file) is selected from the processing and synthesis images stored in the mobile phone 1 and transmitted to the image processing server 4b (image synthesis server 4) via the processing image transmission address. (Step 401).
A background image (background file) to be used as the background of the processing image is selected from the processing and synthesis images stored in the mobile phone 1, and the selected background image is stored in the image processing server 4b (the image synthesis server 4). ) Via the background image transmission address (step 402).
As another example of the above-mentioned transmitting means of these images for processing and synthesis, a method of transferring the images to the user-based data area of the image processing server 4b by uploading from the WEB server 4a or uploading by wireless communication may be used.
The processing image and the background image transmitted to the image processing server 4b are stored in the storage area (Step 403).
The image transferred to the data area for each user is stored in the data area for each user.
[0009]
An image processing application (an image processing program in the mobile phone 1) is started in order to combine the processing image and the background image as data stored in the storage area of the image processing server 4b.
Along with this activation, an activation message 5 is displayed on the screen of the display unit 1a of the mobile phone shown in FIG. 5A, and the program name of the image processing application is displayed in the figure.
After the display, a list menu 6 of processing images (processing files) as data is displayed on the screen of the display unit 1a shown in FIG. In the list menu 6, the names of a plurality of processing images transferred and stored by the processing image transmission means (in FIG. 5, from the top to the bottom, "1 image 0, 2 images 1, 3 images 2, 4 images 3 "is displayed.
Then, the user selects a processing image (processing file) from the displayed list menu 6 (step 404).
As shown in FIG. 5C, the selected processing image X1 is displayed on the screen of the display unit 1a (step 405), and an image of a child is displayed in the figure.
Thereafter, the user cuts out the displayed processing image X1 using the cursor operation and button operation of the mobile phone 1 (step 406). In the clipping processing method shown in FIG. 5D, a plurality of points 7 are designated on the processing image X1 by appropriately using a cursor operation and a button operation, and an image in a range surrounded by these designated points is clipped. It is specified as an image X11.
As another method of the cutout processing, there is a range designation by a cutout line and the like.
[0010]
When the specification of the cutout image X11 is completed, a genre list menu 8 of a background image (background file) as data is displayed on the screen of the display unit 1a as shown in FIG. “1 My BG list, 2 landscapes, 3 objects” is displayed as a name corresponding to the genre toward the lower row.
The user selects the genre of the background image from the displayed genre list menu 8. For example, when "1 My BG list" is selected, "My BG list menu" which is a list menu 9 of the selected genre is displayed on the screen of the display section 1a as shown in FIG. The illustrated list menu 9 is “2. image 0, 3. image 1, 4. image 2, 5. image 3” from the top to the bottom.
When the user selects a desired background image (background file) from the list menu 9 (step 407), the selected background image Y1 is displayed on the screen of the display unit 1a as shown in FIG. In the illustrated example, a background image having a cup with a dish is displayed (step 408). At the same time, on the background image Y1 displayed on the screen, a pasting position Y11 corresponding to the position and range corresponding to the cutout image X11 and indicating the pasting range specified by the plurality of points 7a is displayed. You. In the screen shown in FIG. 5 (g), a pasting portion (pasting range) Y11 surrounded by a plurality of points 7a is displayed above the portion occupying the main part of the cup which is the background image Y1.
[0011]
If the cut-out image X11 of the processing image X1 can be pasted on the pasting position Y11 by the point designation in the displayed background image Y1, the background image (background file) Y1 in which the pasting position is specified is carried. The image is transmitted to the image processing server 4b (FIG. 2) by the button operation of the telephone 1 (step 410).
[0012]
The transmitted background image Y1 is subjected to image synthesis processing by the image processing server 4b that has received it. After the completion of the image composition processing, an e-mail notifying the completion of the composition processing is transmitted from the image processing server 4b to the user's mobile phone 1 (step 411), and in FIG. Completed. "Is displayed.
The user makes a web access (WEB ACCESS) to the address described in the body of the mail message 10 displayed on the screen (step 412), thereby synthesizing the display unit 1a as shown in FIG. The processed composite image Z1 is displayed (step 413). The user can see the synthesized image Z1 that has been synthesized through the screen.
[0013]
(Movement of pasting place Y11)
Since the position of the pasting point Y11 shown in FIG. 5 (G) and FIG. 6 (G) is not appropriate, if it is desired to move the pasting point to a desired position on the background image Y1, the mobile phone 1 The cursor is moved to an arbitrary position by the cursor operation and button operation (step 408). In FIG. 6C, the pasted portion Y11 is moved to the lower left position on the screen of the display unit 1a. After the movement, if the cut-out image X11 can be pasted on the pasted location Y11 of the displayed background image, the background image Y1 in which the pasted location is specified is operated by a button operation on the image processing server 4b (FIG. 2). ) (Step 410).
(Enlargement / reduction of the pasted portion Y11)
When the paste position (paste range) Y11 is to be enlarged or reduced, as shown in FIG. 5 (g) and FIG. 6 (g), the cursor operation and the cursor operation are performed on the background image Y1 where the paste position Y11 is displayed. By the button operation, as shown in FIG. 6G, the pasted portion (pasting range), which is the designated point group consisting of the points 7a, is enlarged or reduced (step 409), and the enlarged or reduced pasted portion Y11 is enlarged. Is displayed. After that, if the cut-out image X11 can be pasted on the enlarged or reduced paste portion Y11 on the displayed background image Y1, the background image whose paste portion is specified by the button operation is processed by the image processing server. 4b (FIG. 2) (step 410).
[0014]
The internal processing of the web server 4a will be described with reference to FIG.
As described above, the plurality of processing / combining images X1, X2, Y1, and Y2 uploaded by the user are stored by the WEB server 4a.
In the WEB server 4a, the application reference TOP URL 11 is the first URL folder referenced from the image processing application. The URL folder 11 stores a user data storage location URL list and a background image storage location URL list.
The user data storage location URL list and the background image storage location URL list include the following.
(1) Data contents describing a link destination of a data area for each user, which is referred to by an application, and a background genre for all users, and data contents describing background data. For example,
・ User data storage location URL1, user data storage location URL2
・ Anime, 1, celebrities, 2
-Background image storage location URL1,1, Background image storage location URL2,1,
Background image storage location URL3,2
Is described in the file.
(2) Data contents describing the link destination of the processed data in user units and data content describing the link destination of the background data in user units, which are referred to by the application. For example,
-Processing file 1, processing file 1. JPG, processing file 2,
Processing file 2. JPG
・ Background file 1, background file 1. JPG, background file 2,
1. Background file JPG, background file 3, background file 3. JPG
The application reference TOPURL 11 has, in a tree structure, user folders 12 displayed as “USERS” and folders 13, 14, and 15 displayed as “user 001”, “user 002”, and “user 003”, respectively. ing.
The data stored in the folders 13, 14, and 15 of each user include a file (such as the above-mentioned processing file 1) in which the data contents describing the link destination of the processing data for each user, which is referred to by the application, Uploaded plural processing images (processing file group) such as the processing image X1, multiple background images (background file group) such as the background image Y1, and plural composite images (processed files) such as the composite image Z1 Group) is stored.
These structures may be used in place of the database server 4g or the like.
[0015]
In the above example, the procedure up to creating the combined image Z1 by combining the processing image X1 and the background image Y1 has been described, but the present invention is not limited to this example.
For example, in the example shown in FIG. 3, the following three types of composite images can also be created.
(1) Processing image X2 + background image Y2 → composite image Z2
(2) Processing image X1 + background image Y2 → composite image Z3
(3) Processing image X2 + background image Y1 → composite image Z4
[0016]
As a method for obtaining the image for processing and synthesis, besides uploading an image to each user's folder in the image processing server 4b group, images from the mobile phone 1 to other sites 30 and 31 except the system site 3 shown in FIG. May be used. The user accesses the site 30 or the site 31 via the web, opens the homepage, and displays an image 16a of the homepage on the screen of the display unit 1a of the mobile phone as shown in FIG. Then, when the user presses the processing data button 16b on the screen, the displayed image 16a is stored in the folder of each user as a processing image. Similarly, by pressing the background data button 16c displayed on the screen, the image 16a is stored in each user's folder as a background image.
As a process at the time when the processed data button 16b is pressed, the ID of the mobile phone 1 and the URL of the image to be transferred are transmitted from the site 30, for example, to the WEB server 4a of the image synthesizing server 4 in the system site 3. The WEB server 4a, which has received the transmitted data, confirms the location of each user folder in the case of a registered user, acquires the image derived from the URL data of the image to be transferred after confirmation, and acquires each user folder. Save it inside. Similarly, the processing when the background data button 16c is pressed is the same as described above.
Through these operations, it becomes possible to perform image combining, image uploading, WEB uploading, and image synthesis using only the mobile phone 1 based on images transferred from the other sites 30 and 31.
In this way, by adding a button to transfer and store the image data for processing and synthesis from the web server of another site to the data area of each user to the web server on the Internet which is innumerable, the user can The favorite image referred to above can be immediately transferred to the data area for each user. It goes without saying that the image to be transferred in this type of image transfer system is not limited to an image to be subjected to composition processing.
[0017]
The mobile communication terminal is not limited to the above-mentioned mobile phone. The target of the combining process is not limited to the above-described cutout combining process, cutout moving combining process, and cutout enlargement / reduction process.
[0018]
【The invention's effect】
Since the image processing method of the present invention is configured as described above, in order to process a plurality of images only by operating a mobile phone serving as a user interface of a user, the images are synthesized by an information terminal such as an image data synthesizing apparatus. Later, it can be sent to a mobile phone and the trouble of displaying it can be saved. Then, from the application, all the image synthesizing servers storing the images are subjected to the image processing file, so that the application can have an infinite extent.
[Brief description of the drawings]
FIG. 1 is an overall configuration diagram showing an embodiment of an image processing method in a mobile phone according to the present invention.
FIG. 2 is a configuration diagram showing a composite image server used for an image processing method in a mobile phone according to the present invention.
FIG. 3 is a diagram showing mutual combinations of a processing image, a background image, and a composite image in the image processing method in the mobile phone according to the present invention.
FIG. 4 is a flowchart showing a procedure for processing and combining in the image processing method in the mobile phone according to the present invention.
FIG. 5 is a diagram of a display unit showing steps of processing and synthesis of an image application in the image processing method in the mobile phone according to the present invention in a stepwise manner.
FIG. 6 is a view of a display unit showing step by step the movement and enlargement / reduction of a pasted portion in the processing / combining of an image application in the image processing / processing method in the mobile phone according to the present invention.
FIG. 7 is a diagram showing application folders and files referred to by an application in a WEB server used in the image processing method in the mobile phone according to the present invention.
FIG. 8 is an enlarged front view showing a display unit in a state in which image data for processing and image data for background are transferred from a web server of another site to a data area for each user and stored.
[Explanation of symbols]
1 mobile phone 2 Internet (communication network)
3 System site 4 Image synthesis server 4a Web server 4b Image processing server 7, 7a Point 16a to be specified Image 16b Processing data button 16c Background data button 30, 31 Other sites X1, X2 Processing images (processing synthesis images, processing Image data for synthesis)
X11 Cutout image (image within cutout range)
Y1, Y2 Background image (image for processing and synthesis, image data for processing and synthesis)
Y11 Pasted portions Z1, Z2 Composite image Z3, Z4 Composite image

Claims (9)

An image in a portable mobile communication terminal, wherein a plurality of images for processing and synthesis stored on an image synthesis server are processed only by the mobile communication terminal, and the synthesized image can be displayed on a screen of a display unit thereof. Processing system. 2. The image processing system in the mobile communication terminal according to claim 1, wherein the processing target includes a synthesis processing, a clipping processing, a scaling processing, and other processing for synthesis. 3. The portable mobile device according to claim 1, wherein at least a part of each of the images for processing and synthesis to be subjected to the synthesis process is obtained by the user by photographing with a mobile communication terminal. An image processing system in a communication terminal. 4. The portable mobile communication terminal according to claim 1, wherein each processing / combining image to be subjected to the combining processing is combined and processed by a processing command from the portable mobile communication terminal. Image processing system. 4. The method according to claim 1, wherein only an image within a cutout range designated by a point of the selected processing / combining image is pasted to the processing / combining image of the combining destination only by operating a cursor and a button of the portable mobile communication terminal. An image processing system in the portable mobile communication terminal according to claim 4. Only by operating the cursor and the button of the portable mobile communication terminal, the cut-out range of the selected image for processing and synthesis is designated by a point, and after the designation, the cut-out range is moved to an arbitrary position, and only the image within the moved cut-out range is displayed. The image processing system according to any one of claims 1 to 4, wherein the system is attached to a processing image to be combined. Each processing / combination image to be subjected to the composition processing includes a processing image to be clipped and a background image to be a background of the processing image, and the background image has a clipping range of the processing image. The image processing system in the portable mobile communication terminal according to any one of claims 1 to 6, wherein an image in the inside is pasted. The ID of the mobile communication terminal and the URL of the image to be transferred are transferred from another site other than the system site to the image synthesizing server of the system site, and the image synthesizing server receiving the transferred data registers the user. 8. The method according to claim 1, further comprising: confirming a location of a folder of the user that has been selected, acquiring an image derived from URL data of an image to be transferred after the confirmation, and storing the image in each user folder. An image processing system in a portable mobile communication terminal according to claim 1. The portable mobile communication terminal, the present system site and other sites other than the present system site can communicate with each other via a communication network, and the ID of the portable mobile communication terminal and the URL of the image to be transferred from the other site are described above. The image synthesizing server, which has transferred the data to the image synthesizing server of the system site and received the transferred data, confirms the location of the folder of the user registered as a user, and after the confirmation, deletes the image derived from the URL data of the image to be transmitted. An image transfer system, which acquires and saves it in each user folder.

Images