JP2004007598A - Information equipment, mobile phone, image display method, and image transmission method - Google Patents

Abstract

In an information device, a moving image and a still image, which is a margin around the moving image reproducing portion, are simultaneously displayed with a good appearance as desired by the user.
A creator-side device 21 forms a combination of moving image data and i) still image data or ii) a code used to obtain still image data. The still image data or ii) the combination with the above code is transmitted to the reproducing device 22. Upon obtaining the transmitted moving image data and i) the still image data or ii) the code, the reproducing device 22 obtains the moving image data and i) the still image data or ii) a still image obtained from the code. The data is displayed on the screen of the display unit 91 together with the data.
[Selection] Figure 2

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an information device having an image creation function, an information device having an image display function, an image display method, and an image transmission method.
[0002]
[Prior art]
2. Description of the Related Art Conventionally, when playing back moving image data (that is, video data) on a personal computer, for example, a user selects an arbitrary image from still images prepared by a moving image playback application, and uses the still image as a background for moving images. Image reproduction can be performed in such a manner that the image is surrounded by still images. For example, Non-Patent Document 1 discloses a technique of a partial moving image reproduction application that displays a still image called a skin and a graphic whose movement changes in synchronization with music on a screen.
[0003]
On the other hand, a mobile phone can play a moving image by using the moving image playing function. For example, Non-Patent Document 2 discloses a mobile phone capable of reproducing moving images.
[0004]
[Non-patent document 1]
Windows (registered trademark) Media Player (registered trademark) 7.1 homepage http: // www. Microsoft. com / japan / windows / windowsmedia / software / Playlayer7. asp, "Skins and visual effects"
[0005]
[Non-patent document 2]
Product catalog for mobile phone C5001T (made by Toshiba), KDDI, issued December 2001
[0006]
[Problems to be solved by the invention]
However, the moving image reproducing function of a mobile phone as disclosed in Non-Patent Document 1 has a problem that displayed moving image data is surrounded by a still image area filled with a single color. That is, in the moving image reproduction of the mobile phone, there is a problem that the still image in the margin around the moving image reproduction portion is fixed.
[0007]
In a partial moving image reproduction application of a personal computer as disclosed in Non-Patent Document 2, it is possible to decorate a margin around a moving image reproduction portion with a still image called a skin, but the image is displayed by selecting the reproduction side and transmitted. There is a problem that the side cannot manage.
[0008]
The present invention has been made in view of the above-described circumstances, and an information device, a mobile phone, and an information device that can simultaneously display a moving image and a still image, which is a margin around the moving image reproduction portion, as desired by the user. It is an object to provide an image display method and an image transmission method.
[0009]
[Means for Solving the Problems]
An information device according to the present invention is an information device capable of transmitting an image, and forms a combination of moving image data and i) still image data or ii) a code used to obtain still image data. Data forming means, and data transmitting means for transmitting a combination of the moving image data formed by the data forming means and i) the still image data or ii) the code to another device. I do.
[0010]
Further, the information device according to the present invention includes a display unit, a data acquisition unit for acquiring moving image data and i) still image data or ii) a code used for obtaining still image data, and the data acquisition unit. Data display processing means for displaying the obtained moving image data and i) the still image data or ii) still image data obtained from the code together on a screen of the display means. I do.
[0011]
An image display method according to the present invention is an image display method in an information device, wherein moving image data and i) still image data or ii) a code used to obtain still image data are stored in the information device. Transmitting the moving image data and i) the still image data or ii) still image data obtained from the code, together with the moving image data transmitted to the information device, on the screen of the information device. I do.
[0012]
An image transmission method according to the present invention is an image transmission method for transmitting an image from an information device, wherein a combination of moving image data and i) still image data or ii) a code used to obtain still image data is provided. And transmitting the combination of the formed moving image data and i) the still image data or ii) the code to another device.
[0013]
In addition, the mobile phone according to the present invention includes a data acquisition unit that acquires moving image data and i) still image data or ii) a code used to obtain still image data, a display unit, and a data acquisition unit. Data display processing means for displaying the obtained moving image data and i) the still image data or ii) still image data obtained from the code together on a screen of the display means. I do.
[0014]
Also, the image display method according to the present invention is an image display method in an information device, wherein a code used for determining moving image data and still image data is transmitted from the transmitting device to the information device. The moving image data transmitted to the information device and the still image data determined based on the code are displayed together on a screen of the information device, and the code includes i) the transmitting device. Or ii) an instruction to the information device to use the GPS position information obtained from the transmitting device, and the position information is displayed on the screen of the information device. A still image to be displayed is specified.
[0015]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[0016]
In the embodiment of the present invention, a side that transmits or transmits a moving image and a still image (hereinafter, referred to as a creator) and a side that simultaneously receives or reproduces the generated moving image and the still image (hereinafter, a reproducing side) ) And a means for transferring data between them. However, the terminal on the creating side and the terminal on the reproducing side may be the same, and in this case, the means for transferring data exists inside the terminal.
[0017]
In addition, the terminal has a function of combining a moving image and a still image and a function of simultaneously displaying the combined still image and moving image.
[0018]
The term “terminal” as used herein refers to an information device having a function of reproducing moving images and still images, and includes a mobile phone, a PDA (Personal Digital Assistant), a personal computer, and the like.
[0019]
The transmission and reception of data between the creating side and the reproducing side is generally performed by wireless communication, but may be performed by wired communication (including optical communication) instead. ) And wireless communication.
[0020]
In a normal case where moving image data is displayed in an area smaller than the effective display area of the receiving terminal, still image data corresponding to a blank portion of the moving image surrounds the moving image data. FIG. 1 shows a moving image reproducing portion 12 and a blank portion 13 in a display unit 11 of a terminal (that is, a mobile phone). In this case, the still image display portion 14 in the figure may be a part of the margin portion 13, or the still image display portion 14 may cover the entire margin portion 13.
[0021]
There are two methods for transferring a moving image and a still image from the creating side 21 to the reproducing side 22. The first method is a method in which moving image data and still image data are transferred together, and the second method is a code indicating still image data (identifying a server or a storage medium in which the still image data is stored). And a moving image data).
[0022]
<Example in the case where moving image data and still image data are transferred together from the creating side to the reproducing side> FIG. 2 shows an example in which moving image data and still image data are transferred together from the creating side to the reproducing side. FIG.
[0023]
As shown in FIG. 2, a processing unit 214 is provided on the creation side 21, and the processing unit 214 stores the moving image data in the moving image data storage unit 211 (here, what the transmitting user wants to reproduce). , A combining unit 214a for combining the still image data in the still image storage unit 212 (the one that the transmitting user desires to reproduce) and a check unit 214b for checking the combined data. Will be described later). The transmission process after the check is executed by any of the transmission units 71a to 71c.
[0024]
The processing unit 214 can be realized by, for example, a digital signal processing device such as a microprocessor that executes a program stored in a predetermined storage area.
[0025]
As for the still image data, existing still image data stored in the still image storage unit 212 may be used, or still image data newly formed by the still image data forming device 27 may be used. good. In the latter case, the newly formed still image data is stored in the still image storage unit 212 and is sequentially extracted from the still image storage unit 212. The still image data forming device 27 is an electronic device such as a computer, a digital camera, a mobile phone, or the like, which is connected to the creation side 21 via a wired / wireless network or directly, or a memory card that is detachable from the creation side 21. Storage medium. Alternatively, a landscape or the like may be imaged using a digital camera 28 mounted on the creation side 21, and still image data obtained thereby may be used. The still image creation unit 213 creates still image data to be sent to the processing unit 214 based on still image data in the still image storage unit 121 or still image data obtained from the camera 28.
[0026]
The still image data to be combined with the moving image data can be replaced with a still image code for specifying the still image data. In this case, a process of acquiring the still image data specified by the still image code by the reproduction side 22 or another device is required.
[0027]
On the other hand, as for the moving image data, existing moving image data stored in the moving image data storage unit 211 may be used, or the moving image data formed by the moving image data forming device 26 may be stored in the moving image data storage unit 211. After that, the moving image data may be taken out and used. The moving image data forming device 26 includes an electronic device such as a computer, a video camera, and a mobile phone connected to the creation side 21 directly or via a wired / wireless network, or a memory card detachable from the creation side 21. It corresponds to a storage medium. Also, the processing unit 25 may download desired moving image data from a site on the Internet that provides various moving image data, and use it. Alternatively, the processing unit 25 may be a video camera, and use a captured moving image.
[0028]
Note that information indicating a display position on the still image data where the combined moving image data is to be displayed may be added to the still image data. Note that this information may be added not to the still image data but to the moving image data.
[0029]
FIG. 3 shows an example of a file format when moving image data and still image data are contained in one file. The moving image data and the still image data are contained in one file. The file format at this time conforms to, for example, MP4, and has an area of “management information” and an area of each “data set” (also called a box) as shown in FIG. Each “data set” has areas such as “identifier”, “size”, and “data”. Note that the position of the “management information” does not necessarily have to be the head.
[0030]
In the above file format, moving image data is stored in a “data” area in a certain data set X. The moving image data in this case is in a state of being compressed in the MPEG-4 compression format. The moving image data may have a configuration of only video data, or may have a configuration in which audio data is added to video data. On the other hand, still image data is stored in a “data” area in a certain data set Y. Instead of the still image data, a still image code specifying the still image code may be stored in the “data” area.
[0031]
In the “management information”, information indicating that the moving image data should be displayed on the screen at the time of display is set, and information indicating that the moving image data should be displayed is stored in the position. Have been.
[0032]
It is desirable that the “management information” also include information indicating the position in the file format where the combined moving image data and still image data are stored. In this way, at the time of reproduction, the position of the combined moving image data and still image data in the file format can be easily known.
[0033]
After combining the moving image data and the still image data into one file, the checking unit 214b determines whether the combination is in an appropriate state, for example, at a desired position on the still image (for example, a still image). (In the center of the image) to check whether or not the moving image can be displayed. The check includes (1) a process in which the check unit 214b itself checks whether or not the combined moving image data and still image data are in a state conforming to the file format on the file (furthermore, the file is transmitted to the communication protocol). (A process of confirming whether or not the data is compatible) and (2) displaying the combined moving image data and still image data on the screen of the display unit 29 of the creation side 21 to determine whether the combination is as desired by the user. (For example, a process of receiving information such as OK or NG designation input by the user through the input unit 30) for the user to confirm whether or not (for example, whether or not a moving image is arranged at the center of a still image). Is included. After checking that the combination is appropriate in the above check, the check unit 214b may instruct any of the transmission units 71a to 71c to transmit a file including the combined moving image data and still image data. it can.
[0034]
Here, the operation of the processing unit 214 in FIG. 2 will be described with reference to FIG.
[0035]
The combining unit 214a combines the moving image data and the still image data and stores them in one file (Step S1). The checking unit 214b checks whether (the data set of) the combined moving image data and still image data is in a state conforming to the file format on the file (further, conforms to the communication protocol). (Step S2).
[0036]
Here, if the file format (and the communication protocol) is compatible (Yes in step S3), the check unit 214b displays the combined moving image data and still image data on the screen of the display unit 29, and as desired by the user. (Step S4). For example, the user is asked to confirm whether the combination is OK or not (for example, the user is prompted to specify either OK or NG on the screen).
[0037]
Here, when the user indicates OK (step S5), the check unit 214b instructs any of the check transmission units 71a to 71c to transmit a file including the combined moving image data and still image data (step S6). ).
[0038]
If it does not conform to the file format (and the communication protocol) in step S3 (No in step S3), a measure such as displaying a message (such as an error message) on the screen of the display unit 29 is performed (step S7). Before displaying this message, steps S1 and S2 may be retried.
[0039]
If the user does not indicate OK in step S5 (No in step S5), a measure such as displaying a message (such as a message prompting an operation to change the combination of images) on the screen of the display unit 29 is performed (step S5). S7). The processing related to the user interface at that time will be described below.
[0040]
For example, when displaying a message requesting the user to change the image combination, the processing unit 214 causes the display unit 29 to display a selection menu on which selectable moving image data groups and still image data groups are presented. The user can use the input unit 30 to select desired moving image data and still image data to be combined by looking at the selection menu. When the selection operation by the user is completed, the processing unit 214 executes the processing from step S1 in FIG. 4 again.
[0041]
As described above, by performing the above-described two types of checks, the combined moving image data and still image data can be surely realized in a state suitable for the file format (and the communication protocol) and in the combination desired by the user. In this state, the data can be transmitted directly from the creating side 21 to the reproducing side 22 or via a Web site server 23 or a network 24 such as the Internet.
[0042]
On the reproducing side 22, there are the following three data transmission modes.
(1) The processing unit 221 downloads and plays back combination data of moving image data and still image data stored in the Web homepage server 23 or the like.
(2) The processing unit 222 reproduces the combination data of the moving image data and the still image data received by mail or the like via the network 24 such as the Internet.
(3) The processing unit 223 performs Bluetooth. ^TM For example, the combined data of the moving image data and the still image data received through the PPP (Point to Point Protocol) connection is reproduced. Each of the receiving processes is performed by any of the receiving units 72a to 72c. The combination data reproduced by each of the processing units 221 to 223 is displayed on the screen of the display unit 91.
[0043]
<Example of transferring moving image data and still image data separately>
FIG. 5 is a diagram illustrating an example in which moving image data and still image data are separately transferred.
[0044]
The creator 31 specifies a still image code (at most about 16 bits) in the still image code holding unit 314 and a moving image in the moving image data storage unit 311 for specifying the still image data (the user wants to use when playing the moving image). The data is combined with the data and transmitted to the reproduction side 32 (or transmitted to the server 35 of the communication carrier). The playback side 32 simultaneously plays back still image data and moving image data corresponding to the still image code.
[0045]
When reproducing the still image data on the reproducing side, the following three cases can be cited.
(1) Use still image data stored in the communication carrier server 35
(2) Use the still image data stored in the still image data storage (storage medium such as a memory or an SD card) 321 of the reproduction side 32
(3) Use still image data stored in a server 34 connected to a network provided by a third party
Hereinafter, each case will be described in detail.
[0046]
(1) When Using Still Image Data Stored in the Communication Carrier Server 35 The creator 31 uses the still image code for specifying the still image data held in the communication carrier server 35 and the still image code in the moving image data storage unit 311. The original moving image data is sent to the communication carrier server 35. The communication carrier server 35 extracts the still image data specified by the still image code from the server, and transmits the still image data together with the moving image data sent from the creation side 31 to the reproduction side 32 via the path 37. The processing unit 322 of the playback side 32 simultaneously plays back the received moving image data and still image data.
[0047]
(2) When Using Still Image Data Stored in Still Image Data Storage Unit 321 of Reproduction Side 32
As for the still image data in the still image data storage unit 321, the creation side 31 sends the still image data in the still image data storage unit 312 or the still image data newly created by the still image creation unit 313 to the reproduction side 32 in advance. Or stored in the still image data storage unit 321. The creator 31 identifies the still image data stored in the still image data storage unit 321, the still image code in the still image code holding unit 314 (an ID specifying the storage unit 321 is also added), The moving image data in the moving image data storage unit 311 is transmitted to the reproducing side 32. The processing unit 323 of the playback side 32 reads out the still image data specified by the received still image code from the still image data storage unit 321, and simultaneously plays back the read still image data and the received moving image data.
[0048]
(3) When using still image data stored in a server 34 connected to a network provided by a third party
The still image data in the server 34 is obtained by sending the still image data in the still image data storage unit 312 or the still image data newly created by the still image creation unit 313 to the server 34 in advance. Or existing on the server 34. The creator 31 identifies the still image data stored in the server 34, the still image code in the still image code holding unit 314 (an ID specifying the server 34 is also added), and the moving image data storage unit 311. Is transmitted to the reproducing side 32. The processing unit 324 of the playback side 32 requests the server 34 for still image data specified by the received still image code, and simultaneously plays back the still image data received from the server 34 and the received moving image data.
[0049]
If the still image code specified by the still image code is not obtained from the corresponding storage medium when the still image code is passed to the reproducing side 32, the still image data that is separately prepared is used. May be used in combination with moving image data.
[0050]
By the way, the still image creation unit 213 (313) of the creation side 21 (31) can provide the following functions when creating still image data.
[0051]
・ A function to cut out any range from existing still image data and form still image data
-A function to form still image data by specifying an arbitrary range on the existing still image data and freely specifying the position (with the cursor or mouse locus, etc.) on the plain in the range
・ A function to prepare several types of existing still images (small size images, etc.), use them as parts for creating still images, and combine them appropriately to form still image data
・ Function to form still image data by repeatedly developing existing multiple still images (such as small-sized images) (arranging multiple identical images)
By using these functions, for example, a plurality of existing still image data smaller than the still image data to be displayed are transferred from the creation side to the playback side, and the plurality of existing still image data transferred to the playback side are transferred. It is also possible to arrange the data on the display screen on the reproduction side and to display the moving image superimposed thereon.
[0052]
In addition, by using the above various functions, images (simultaneous reproduction of a still image and a moving image) as shown in FIGS. 16A to 16F are displayed on the screen of the reproducing terminal (in the case of a mobile phone). Can be displayed.
[0053]
In FIGS. 16A and 16B, a still image is displayed in a part 14 of a margin portion 13, and a moving image is displayed in a display area 12 defined according to the still image.
[0054]
In (c) and (e) of FIG. 16, small still image patterns are displayed side by side over the entire margin, and a moving image is displayed so as to overlap therewith.
[0055]
In (d) and (f) of FIG. 16, a still image is displayed on the entire marginal partial image, and a moving image is displayed so as to overlap the still image.
[0056]
Here, an example of a method for forming a still image shown in FIG. 16E will be described with reference to FIG.
[0057]
Creation of a still image is performed using a pointing device (cursor key or pen) on a display screen on the creation side. In this case, the device on the creating side may be the mobile phone shown in FIG. 18A or the PDA shown in FIG. 18B. In addition, a drawing tool for creating a still image is mounted on the creating device. The still image creation function including such a drawing tool corresponds to, for example, the still image creation unit 213 (or the still image data forming device 27) in FIG. 2 or the still image creation unit 313 in FIG.
[0058]
First, an original image serving as a source of a still image is displayed on a screen, and a desired image piece (for example, an image of one fish) is cut out from the image (step T1).
[0059]
Next, an operation for editing (for example, coloring) the cut image piece is executed (step T2). Specifically, the following operation is performed.
[0060]
1. Start the drawing tool
2. Choose a paint color
3. A cell to be painted is specified using a pointing device (for example, a cursor key on a mobile phone in FIG. 18A or a pen on a PDA in FIG. 18B).
4. Coloring cells
5. Repeat the above operation for each cell
6. Saving edited image fragments
The above operation may be performed using the mobile phone shown in FIG. 18A or the PDA shown in FIG. 18B. When a PDA is employed, editing by handwriting using a pen is also possible.
[0061]
Thereafter, on the screen, a plurality of edited image fragments are spread at regular intervals (step T3). Thus, a desired still image can be completed by diverting an image piece cut out from the original image.
[0062]
Instead of laying a plurality of edited image fragments on the screen, a still image consisting of only one image fragment may be created by simply pasting the image fragment (step T3 ').
[0063]
Further, in the present embodiment, by using a function of acquiring position information such as GPS (Global Positioning System), it is possible to automatically select appropriate still image data suitable for the location where the terminal exists. it can. In this case, the automatically selected still image data and moving image data are reproduced simultaneously.
[0064]
Hereinafter, various examples using the GPS function will be described.
[0065]
<When a still image is determined based on position information on the playback side>
A case where a still image is determined based on the position information on the reproduction side will be described with reference to FIGS.
[0066]
In FIG. 6, the creator 41 stores the moving image data in the moving image data storage unit 411 and the still image code holding unit in the still image storage unit 412 requesting to use the position information obtained by the reproducing unit 42. , In the processing unit 413 and transmitted to the reproducing side 42.
[0067]
The correspondence information storage unit 422 of the reproduction side 42 describes items (position, range, still image file name, remarks) that define the correspondence between the position information and the still image data as shown in FIG. Information (table) is stored.
[0068]
On the reproducing side 42, the processing unit 424 determines that the position information of the current location should be used in accordance with the request for the received still image code, and the processing unit 425 acquires the position information by the GPS function 421. The processing unit 426 selects still image data corresponding to the acquired position information from the information in the correspondence information storage unit 422. The processing unit 427 reads the selected still image data from the still image data storage unit 423, and displays the read still image data and the received moving image data together.
[0069]
The processing units 424, 425, 426, and 427 can be realized by, for example, a digital signal processing device such as a microprocessor that executes a program stored in a predetermined storage area.
[0070]
Next, with reference to FIG. 10, the operation on the reproduction side when an image is determined by the position information on the reproduction side will be described.
[0071]
First, in the terminal on the reproducing side (for example, a mobile phone), if there is a GPS function, the relation between the position information and the still image data is set, and the relevant information and the still image data are stored in the storage medium (the reproducing side 42). It is stored in advance (step A1).
[0072]
Upon receiving the moving image data and the still image code from the creating unit 41 (step A2), the reproducing unit 42 issues a command corresponding to a still image reproduction instruction (step A3).
[0073]
Here, it is determined whether or not the received still image code instructs use of the position information (step A4). If it is not an instruction to use the position information, the received moving image data and the still image indicated by the still image code are simultaneously displayed (step A5). On the other hand, if the instruction is to use the position information, it is determined whether the GPS function can be used (that is, whether the GPS satellite signal is valid and the GPS functions properly) (step A6). If the GPS function cannot be used, the received moving image data and predetermined still image data are displayed simultaneously (step A7). On the other hand, if the GPS function can be used, the position information is read by the GPS function (step A8).
[0074]
Still image data related to the read position information is selected with reference to the related information set in advance in the storage medium, and the selected still image data and moving image data are displayed simultaneously (step A9).
[0075]
Next, a case where a still image is determined based on the position information on the creating side will be described. Regarding this, there are (1) a case where still image data is sent from the creating side to the reproducing side, and (2) a case where positional information on the creating side is sent to the reproducing side as a part of the still image code. Hereinafter, each case will be described.
[0076]
<When moving image data and still image data are sent from the creator>
A case where moving image data and still image data are sent from the creating side will be described with reference to FIGS. 8 and 11.
[0077]
In FIG. 8, the correspondence information storage unit 512 of the creation side 51 defines items (position, range, still image file name, remarks) for defining the correspondence between the position information and the still image data as shown in FIG. (Table) in which is described.
[0078]
The creator 51 acquires the position information by the GPS function 511, and selects still image data corresponding to the acquired position information from the information in the correspondence information storage unit 512. Further, the selected still image data is read from the still image data storage unit 513, and the read still image data and the moving image data in the moving image data storage unit 514 are combined by the combining unit 151 and transmitted to the playback side 52.
[0079]
The reproducing unit 52 causes the reproducing unit 521 to simultaneously display the received moving image data and the received still image data.
[0080]
Next, with reference to FIG. 11, an operation on the creating side when still image data and moving image data are sent from the creating side will be described.
[0081]
First, in the terminal of the creating side 51 (for example, a mobile phone), if there is a GPS function, the association between the position information and the still image data is set, and the related information and the still image data are stored in the storage medium (the creating side 51). It is stored in advance (step B1). In addition, the reproducing side 51 creates moving image data (step B2).
[0082]
On the creating side 51, the use of the position information by the GPS function is specified (step B3).
[0083]
Here, it is determined whether the GPS function can be used (step B4). If the GPS function cannot be used, a message indicating that GPS is not available is displayed, the state transits to a state where position information is not used (step B5), and a corresponding process is performed. On the other hand, if the GPS function can be used, the position information is read by the GPS function (step B6).
[0084]
Still image data associated with the read position information is selected with reference to related information preset in the storage medium, and the selected still image data (still image file) is extracted from the database (step B7).
[0085]
On the other hand, the moving image data is compressed, and the still image data is incorporated into the compressed file (step B8).
[0086]
Thus, information combining the still image data and the moving image data is transmitted to the reproducing side 52 (step B9).
[0087]
<When the creator sends a still image code including moving image data and position information>
With reference to FIGS. 9, 12, and 13, a case in which moving image data and a still image code including position information are sent from the creating side will be described.
[0088]
In FIG. 9, the creating side 61 acquires position information by the GPS function 611. The processing unit 612 generates the acquired position information and a code requesting to determine still image data based on the position information as a still image code.
[0089]
The creating unit 61 combines the generated still image code and the moving image data in the moving image data storage unit 613 by the combining unit 614 and transmits the combined image to the playback side 62.
[0090]
The correspondence information storage unit 624 of the playback side 62 describes items (position, range, still image file name, remarks) that define the correspondence between the position information and the still image data as shown in FIG. Information (table) is stored.
[0091]
On the reproducing side 62, the processing unit 621 reads out the position information from the still image code in accordance with the received request for the still image code, and the processing unit 622 replaces the still image data corresponding to the read position information with the corresponding information. A selection is made from the information in the storage unit 624. Further, the processing unit 623 reads out the selected still image data from the still image data storage unit 625, and displays the read still image data and the received moving image data together.
[0092]
The processing units 621, 622, and 623 can be realized by, for example, a digital signal processing device such as a microprocessor that executes a program stored in a predetermined storage area.
[0093]
Next, with reference to FIG. 12, the operation of the creator when the still image code and the moving image data are transmitted from the creator will be described.
[0094]
First, in the terminal of the creating side 61 (for example, a mobile phone), if there is a GPS function, the relation between the position information and the still image data is set, and the related information and the still image data are stored in the storage medium (the reproducing side 62). It is stored in advance (step C1). Also, the creating side 61 creates moving image data in advance (step C2).
[0095]
The creation side 61 specifies the use of the position information by the GPS function (step C3).
[0096]
Here, it is determined whether the GPS function can be used (step C4). If the GPS function cannot be used (for example, if a GPS satellite signal cannot be received), a message indicating that GPS is not available is displayed, the state transits to a state where positional information is not used (step C5), and a corresponding process is performed. . On the other hand, if the GPS function can be used, the position information is read by the GPS function (step C6).
[0097]
A still image code is created by combining the read position information with a code requesting that the still image data be selected and displayed based on the position information (step C7).
[0098]
On the other hand, the moving image data is compressed, and the still image code is incorporated in the compressed file (step C8).
[0099]
Thus, information combining the still image code and the moving image data is transmitted to the reproducing side 62 (step C9).
[0100]
Next, with reference to FIG. 13, the operation of the reproducing side when the still image code and the moving image data are transmitted from the creating side will be described.
[0101]
First, the relationship between the position information and the still image data is set, and the related information and the still image data are stored in the storage medium (reproducing side 62) in advance (step D1).
[0102]
Upon receiving the moving image data and the still image code (step D2), the reproducing side 62 extracts the position information from the still image code (step D3).
[0103]
Here, it is determined whether or not there is still image data corresponding to the extracted position information (step D4). If there is no corresponding still image data, the received moving image data and predetermined still image data are displayed simultaneously (step D5). On the other hand, if there is corresponding still image data, the corresponding still image data is read from the information in the storage medium, and the read still image data and moving image data are displayed simultaneously (step D6).
[0104]
FIG. 14 and FIG. 15 are arranged so that the various data transmission / reception modes between the creation side and the reproduction side described above can be easily grasped. FIG. 14 shows a case where the GPS is not used (including the configurations of FIGS. 2 and 3), and FIG. 15 shows a case where the GPS is used (including the configurations of FIGS. 4, 6 and 7).
[0105]
In each of the figures, the combined moving image data and still image data may be transmitted in a single file, or may be transmitted separately. Transmission and reception of data between the creation side and the reproduction side are performed via a wireless or wired network (including the Internet or the like). In the case of a terminal that requires a dial-up connection, such as a mobile phone, data is transmitted and received via a carrier C line such as a telephone company as shown in each figure. In the case of a terminal that does not make a dial-up connection, data is transmitted and received directly to and from the partner device without passing through the carrier C line.
[0106]
FIG. 14A shows a case where the moving image data and the still image data are transmitted from the creating side to the reproducing side, and the moving image data and the still image data received by the reproducing side are displayed together.
[0107]
In FIG. 14B, the creator transmits moving image data and a still image code for specifying still image data to the server 35 of a predetermined communication carrier, and the server 35 transmits the still image data specified for the still image code. Is read from the storage medium, the still image data and the moving image data are transmitted to the reproducing side, and the reproducing side displays the received moving image data and the still image data together.
[0108]
In FIG. 14C, the creator transmits the moving image data and the still image code for specifying the still image data to the reproducing device, and the reproducing device prepares the still image data specified by the still image code on the reproducing device. In this case, the still image data and the moving image data are read out from the storage medium to be displayed together.
[0109]
In FIG. 14D, the creator transmits moving image data and a still image code for identifying still image data to the reproducing device, and the reproducing device transmits the still image data specified by the still image code to a third party. Shows a case where the still image data and the moving image data are downloaded together from a storage medium provided in a server 34 provided by the company.
[0110]
FIG. 15 (a) shows a mapping table based on the position information obtained by the GPS function on the creating side and a mapping table (as shown in FIG. 7, the items defining the correspondence between the position information and the still image data are described). Read out the still image data from the storage medium using the information table, transmit the still image data and the moving image data to the reproducing side, and display the moving image data and the still image data received on the reproducing side together. It shows the case to do.
[0111]
FIG. 15 (b) shows that the creator obtains position information by the GPS function, transmits a code including the position information and the moving image data to the reproduction side, and the reproduction side performs mapping from the position information included in the received code. A case is shown in which still image data is read from a storage medium using a table, and the still image data and the moving image data are displayed together.
[0112]
FIG. 15C shows that the creator transmits moving image data and a predetermined code (a code including a command indicating that the GPS function should be used to select still image data) to the reproducing side, According to the received code, the position information is obtained by the GPS function, the still image data is read from the storage medium using the mapping table from the position information, and the still image data and the moving image data are displayed together. I have.
[0113]
FIG. 15 (d) illustrates a method of obtaining position information by the GPS function on the creation side and communicating a code including the position information (including a request for selecting still image data and transmitting it to the reproduction side) and moving image data. The transmission to the server 35 of the carrier, the server 35 reads out the still image data from the storage medium using the mapping table from the position information included in the received code, and transmits the still image data and the moving image data to the reproducing side. However, the reproduction side displays the received moving image data and still image data together.
[0114]
FIG. 15 (e) shows that the creator obtains the position information by the GPS function and the code including the position information (the address of the server 34, and the server 34 selects the still image data and transmits it to the reproducing side. And the moving image data to the playback side, and the playback side transmits the code to the server 34, and the server 34 uses the mapping table from the position information included in the received code to stop from the storage medium. The figure shows a case in which image data is read, and the still image data is transmitted to the reproducing side, and the reproducing side displays the received still image data and moving image data together.
[0115]
As described above, according to the present embodiment, when a moving image is reproduced, an arbitrary still image is simultaneously displayed so as to surround the moving image, so that the appearance can be improved.
[0116]
Also, for example, when a moving image is transmitted to a third party by e-mail or the like, a still image desired by the sender can be displayed on the receiver side simultaneously with the moving image.
[0117]
Further, by using a code or the like for specifying still image information when transferring image data to another person, it is possible to reduce the storage area used on the creating side and the data amount at the time of transfer.
[0118]
In addition, by using the GPS function, a still image suitable for the location where the terminal is located can be displayed together with the moving image.
[0119]
In addition, by providing the still image creation unit with various functions, it is possible to finely specify a display mode desired by the user.
[0120]
Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying constituent elements in an implementation stage without departing from the scope of the invention. Various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. For example, some components may be deleted from all the components shown in the embodiment. Further, components of different embodiments may be appropriately combined. For example, it is also possible to form another configuration example by partially combining the various configuration examples shown in the drawings.
[0121]
【The invention's effect】
As described above in detail, according to the present invention, it is possible to simultaneously display a moving image and a still image, which is a margin around the moving image reproduction portion, with a good appearance as desired by the user.
[Brief description of the drawings]
FIG. 1 is an exemplary view for explaining a relationship between a still image and a moving image which are simultaneously displayed on an information device according to an embodiment of the present invention.
FIG. 2 is a diagram showing an example of a case where moving image data and still image data are transferred together from a creating side to a reproducing side.
FIG. 3 is a diagram showing an example of a file format when moving image data and still image data are contained in one file.
FIG. 4 is a flowchart showing the operation of a processing unit 214 in FIG. 2;
FIG. 5 is a diagram showing an example of a case where moving image data and still image data are separately transferred.
FIG. 6 is a diagram illustrating an example of a case where a still image is determined based on position information on a playback side.
FIG. 7 is a diagram showing information that defines a correspondence between position information and still image data.
FIG. 8 is a diagram showing an example of a case where moving image data and still image data are sent from the creating side.
FIG. 9 is a diagram showing an example of a case where moving image data and a still image code including position information are sent from the creating side.
FIG. 10 is a flowchart showing an operation on the reproduction side when an image is determined by position information on the reproduction side.
FIG. 11 is a flowchart showing the operation on the creating side when still image data and moving image data are sent from the creating side.
FIG. 12 is a flowchart showing an operation on the creating side when a still image code and moving image data are sent from the creating side.
FIG. 13 is a flowchart showing an operation on the reproduction side when a still image code and moving image data are transmitted from the generation side.
FIG. 14 is a diagram showing various data transmission / reception modes (in the case where GPS is not used) between the creation side and the reproduction side.
FIG. 15 is a diagram illustrating various data transmission / reception modes (in the case of using GPS) between a creation side and a playback side.
FIG. 16 is a diagram showing an example of an image displayed on a screen of a reproduction-side terminal (in the case of a mobile phone).
FIG. 17 is a view for explaining an example of a method for forming the still image shown in FIG. 16 (e).
FIG. 18 is a diagram showing an example of a device that can be used for creating a still image.
[Explanation of symbols]
11: display part of terminal, 12: moving image reproducing part, 13: blank part, 14: still image displaying part, 21, 31, 41, 51, 61 ... creating device, 22, 32, 42, 52, 62 ... reproducing Side device, 23 Web site server, 24 Network, 25 Processing unit, 26 Moving image data forming device, 27 Still image data forming device, 28 Digital camera, 29 Display unit, 30 Input unit, 34 A server connected to a network provided by a third party, 35 a server of a communication carrier, 71 transmission unit, 72 reception unit, 91 display unit.

Claims (28)

An information device capable of transmitting an image,
Data forming means for forming a combination of moving image data and i) still image data or ii) codes used to obtain still image data;
A data transmitting unit that transmits a combination of the moving image data formed by the data forming unit and i) the still image data or ii) the code to another device;
An information device comprising: The information device according to claim 1, wherein the other device includes a display unit that displays the moving image data and the still image data. The data transmitting means transmits the video data and the code,
The other device includes a predetermined communication carrier, and the predetermined communication carrier transmits the moving image data transmitted from the data transmitting unit and the still image data corresponding to the code to another device. Send,
2. The information device according to claim 1, wherein the another device includes a display unit that displays the moving image data and the still image data transmitted from the predetermined communication carrier. 2. The information device according to claim 1, further comprising a check unit configured to check whether the moving image data and the still image data conform to a file format or a communication format for a file. The information device further includes a display unit,
5. The information device according to claim 4, wherein the check unit includes a unit that displays a combination of the moving image data and the still image data on a screen of the display unit and allows the user to confirm the combination. Display means;
A means connected to the display means, for displaying the moving image data and the still image data formed by the data forming means on the display means,
The information device according to claim 1, further comprising: Display means;
Data acquisition means for acquiring video data and i) still image data or ii) a code used to obtain still image data;
Data display processing means for displaying the moving picture data acquired by the data acquisition means and i) the still picture data or ii) still picture data obtained from the code together on a screen of the display means;
An information device comprising: The data acquisition means acquires the moving image data and i) the still image data or ii) still image data obtained from the code from a device capable of forming an image. Information equipment described. 8. The information device according to claim 7, wherein the data acquisition unit acquires the moving image data and still image data obtained from the code from a predetermined communication carrier. An image display method in an information device,
Transmitting video data and i) still image data or ii) a code used to obtain still image data to the information device;
Displaying the moving image data transmitted to the information device and i) the still image data or ii) still image data obtained from the code together on a screen of the information device;
An image display method comprising: The image display method according to claim 10, wherein, in the transmission, the moving image data and i) the still image data or ii) the code are transmitted from a device capable of generating an image. The image display method according to claim 10, wherein, in the transmission, the moving image data and the code corresponding to the still image data are transmitted from a predetermined communication carrier to the information device. The image display method according to claim 7, wherein the transmission to the information device is performed in a state where the moving image data and the still image data are stored in one file. The image display method according to claim 10, wherein when the code is transmitted to the information device, the still image data specified by the code is read from a predetermined storage medium. i) cutting out an arbitrary range from the existing still image data to form the still image data; and ii) specifying an arbitrary range on the existing still image data and specifying a position and a color in the range. Forming the still image data, iii) forming the still image data by combining a plurality of existing still images, and iv) converting the plurality of existing still image data smaller than the still image data. The image display method according to claim 10, wherein at least one of creating the still image data by arranging is performed to create still image data to be transmitted to the information device. Transmit a plurality of existing still image data smaller than the still image data to the information device,
11. The information processing apparatus according to claim 10, wherein the plurality of existing still image data transmitted to the information device are arranged on a screen of the information device, and the moving image is displayed on the screen while the still image data is superimposed thereon. Image display method. When the code is transmitted to the information device, if still image data specified by the code is not obtained, a still image data stored in the information device is used. The image display method according to claim 10. By the information device, to obtain position information according to the transmitted code,
11. The image display method according to claim 10, wherein when determining the still image data to be displayed, the still image data corresponding to the acquired position information is selected. Transmission to the information device is performed by a transmitting device,
Acquiring location information by the transmitting device,
11. The image display method according to claim 10, wherein when determining the still image data to be transmitted to the information device, the transmitting device selects still image data corresponding to the acquired position information. Transmission to the information device is performed by a transmitting device,
Acquiring location information by the transmitting device,
Transmitting the acquired position information from the transmitting device to the information device,
11. The image display method according to claim 10, wherein when determining the still image data to be displayed, the information device selects still image data corresponding to the transmitted position information. An image transmission method for transmitting an image from an information device,
Forming a combination of video data and i) still image data or ii) codes used to obtain the still image data;
Transmitting the combination of the formed moving image data and i) the still image data or ii) the code to another device;
An image transmission method, characterized in that: Data acquisition means for acquiring video data and i) still image data or ii) a code used to obtain still image data;
Display means;
Data display processing means for displaying the moving picture data acquired by the data acquisition means and i) the still picture data or ii) still picture data obtained from the code together on a screen of the display means;
A mobile phone comprising: 23. The mobile phone according to claim 22, wherein the data display processing unit displays a part of an image of the still image data instead of the acquired moving image data. 23. The mobile phone according to claim 22, wherein the data display processing unit displays the moving image data in a state surrounded by the still image data. 23. The mobile phone according to claim 22, wherein the data display processing means displays the moving image data in a state of being superimposed on the still image data. An image display method in an information device,
From the transmitting device, a code used to determine moving image data and still image data, transmitting to the information device,
The moving image data and the still image data determined based on the code transmitted to the information device are displayed together on the screen of the information device,
The code includes an instruction to the information device to use i) the positional information by GPS obtained from the transmitting device, or ii) the positional information by GPS obtained from the transmitting device; The image display method, wherein the position information specifies a still image displayed on a screen of the information device. 27. The image display method according to claim 26, wherein in said display, said moving image data is displayed in a state surrounded by said still image data. 27. The image display method according to claim 26, wherein in the display, the moving image data is displayed in a state of being superimposed on the still image data.

Images