CN1933630A - Method and apparatus for creating and reproducing media data in a mobile terminal - Google Patents

Abstract

A method and apparatus for creating and reproducing media data in a mobile terminal are provided. Previously stored audio data is selected and media data is created by using at least one image data selected corresponding to the audio data. If a user selects audio data to reproduce, it is determined whether media data corresponding to the audio data exists. If media data corresponding to the audio data exists, the media data is output.

Description

Method and device for creating and reproducing media data in mobile terminal

Technical field

The present application relates to a mobile terminal. More particularly, the present invention relates to a method and apparatus for creating media data in a mobile terminal.

Background technique

As more people use mobile terminals, various functions have been developed in response to users' needs. These functions include outputting and/or reproducing various media data such as personal information, which helps users enjoy their leisure time more actively.

According to conventional functions of mobile terminals, a music reproducing function enables a user to select and reproduce desired music data, and simultaneously displays a preset image on a display unit in response to the reproduced music data. However, it is difficult to display various images at the user's request.

Thus, there is a need for an improved mobile terminal that allows a user to select and reproduce desired music data while displaying various images at the user's request.

Contents of invention

An aspect of exemplary embodiments of the present invention is to address the above-mentioned problems and/or disadvantages and to provide at least the advantages described below. Therefore, an exemplary aspect of the present invention is used to solve the above-mentioned problems occurring in the prior art, and the purpose of the exemplary embodiment of the present invention is to provide a method for creating media data in a mobile terminal, which is based on the MPEG-3 layer (MP3 ) or similar music files are being reproduced to enable the user to create media data on the display unit, thereby producing visual effects.

According to an exemplary aspect of the present invention, there is provided a method of creating and reproducing media data in a mobile terminal. Previously stored audio data is selected and media data is created by using at least one image data selected to correspond to the audio data. If the user selects audio data to be reproduced, it is determined whether media data corresponding to the audio data exists. If media data corresponding to the audio data exists, the media data is also output.

Description of drawings

The above and other exemplary objects, features and advantages of certain exemplary embodiments of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which:

Fig. 1 is a block diagram representing the overall structure of the mobile terminal applied to the present invention;

Fig. 2 is a flowchart representing the process for creating media data according to an exemplary embodiment of the present invention;

3 is a flowchart representing a process for reproducing media data according to an exemplary embodiment of the present invention;

Fig. 4 is a flowchart representing the process for creating media data according to another exemplary embodiment of the present invention; and

FIG. 5 is a flowchart representing a process for reproducing media data according to another exemplary embodiment of the present invention.

Throughout the drawings, like reference numerals will be understood to refer to like components, features and structures.

Detailed ways

To facilitate a comprehensive understanding of the embodiments of the present invention, the contents defined in the descriptions such as detailed structures and components are provided. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the spirit and scope of the invention. Also, descriptions of well-known functions and constructions will be omitted for clarity and conciseness.

In the following exemplary embodiments of the present invention, any data such as music data and voice data that can be output by the audio processor 145 will be defined as audio data. Any data such as moving images and still images that can be displayed by a display unit will be defined as image data. Also, when audio data and image data are synthesized into a specific type of data, it will be defined as media data.

FIG. 1 is a block diagram showing the overall configuration of a mobile terminal to which the present invention is applied. Referring to FIG. 1, a controller 100 is used to control overall functions of the mobile terminal. Specifically, according to an exemplary embodiment of the present invention, when the controller 100 detects the media data input by the user to create a menu, it reads the image data table and the audio data table stored in the memory 120, and controls the display unit 105 to display these kinds of data. Also, the controller 100 synthesizes image data and audio data into media data, and controls the memory 120 to store the synthesized media data. Upon detecting a user input signal having an instruction to reproduce audio data, if media data exists, the controller 100 reproduces media data in which audio data is synthesized with corresponding image data. According to another exemplary embodiment of the present invention, when image data or audio data previously stored in the memory 120 is selected, the controller 100 may create media data by inserting one of the image data and audio data into the other. Alternatively, the controller 100 may create the second media data by synthesizing media data originally created by synthesizing image data and audio data with other audio data and image data.

The display unit 105 displays a current state such as each processing state and operation state under the control of the controller 100 in response to a key input from the key unit 110 . The display unit 105 also displays image data output from the image processor 135 and a user interface for instructing the operation of the photographing function. Here, the display unit 105 may be a liquid crystal display (LCD), wherein the display unit 105 may include, among others, an LCD controller, a memory capable of storing image data, and an LCD pointer device. In case of a touch screen as an example of the LCD, the key unit 110 and the LCD may be used as an input unit. The display unit 105 includes an image data display unit that displays image data. According to an exemplary embodiment of the present invention, when the controller 100 selects a menu for creating media data, the display unit 105 is used to display an audio data table or an image data table for such media data creation. In addition, the display unit 105 serves to output an image portion of media data created through synthesis of audio data and image data.

The camera 140 has a camera sensor to capture image data and convert the captured optical signal into an electrical signal. The camera sensor is assumed to be a Charge Coupled Device (CCD) sensor. The image processor 135 is used to create screen data for displaying image signals. Under the control of the controller 100, the image processor 135 transmits received image signals according to the standard of the display unit 105, and compresses and expands image data. The camera 140 and the image processor 135 may be integrated into a single camera unit. According to an exemplary embodiment of the present invention, the camera 140 and the image processor 135 may function to capture image data such as still and moving images, which are components created as media data.

The radio processor 130 is used to communicate with the mobile communication terminal. The radio processor 130 includes a radio frequency (RF) transmitter for amplifying and frequency upconverting transmitted signals, and an RF receiver for low noise amplifying and frequency downconverting received signals.

Modem or data processor 125 includes: a transceiver for encoding and modulating transmitted signals; and a receiver for demodulating and decoding received signals.

The audio processor 145 may be configured as a codec, which may include: a data codec for processing packet data; and an audio codec for processing audio signals such as voice. The audio processor 145 converts a digital audio signal received at the data processor 125 into an analog signal through an audio codec to reproduce the digital audio signal, or converts an analog audio signal created and transmitted at a microphone into a digital audio signal through an audio codec. audio signal to send the signal to the data processor 125. If media data is set to be reproduced by a user, according to an exemplary embodiment of the present invention, the audio processor 145 is used to output music data included in the media data. When a camera captures a moving image of image data that is a component of creating media data, the audio processor 145 receives audio data of the media data through a microphone connected to the audio processor 145 . The MP3 module 115 may also be provided to output music data included in the media data.

The key unit 110 has input keys for inputting numeric and alphabetic information and function keys for setting various functions. According to an exemplary embodiment of the present invention, the key unit 110 is used to receive a menu for creation of media data from a user. Also, the key unit 110 is used to select music and image data according to creation of media data, and to input a menu for synthesizing the selected data. For the key unit 110, a menu for stopping reproduction of media data or image data to insert another audio or another image data may be input.

The memory 120 stores programs executed by the controller 100, or data processed by the programs. The memory 120 stores various data that can be output from the mobile terminal, such as ringtones, MP3 data, and moving images. Memory 120 also stores other data, such as phone numbers and messages. The memory 120 includes: a read only memory (ROM) for storing an operating program, and an electrically erasable programmable read only memory (EEPROM) and a random access memory (RAM). According to an exemplary embodiment of the present invention, the memory 120 may store a program that executes synthesizing audio data and image data to create media data. The memory 120 also stores audio and image data to be created as media data, and stores media data created by synthesizing audio data and image data.

As described above, a mobile terminal constructed according to an embodiment of the present invention may include: a memory 120 , a key unit 110 and a controller 100 . The memory 120 is used to store audio and image data to be created as media data, and to store programs for synthesizing the audio and image data into media data. With the key unit 110, audio and image data are selected for editing. When data stored in the memory 120 is selected, the controller 100 is adjusted to synthesize the selected data into media data. When setting the reproduction effect of the media data, the controller 100 is adjusted to modify the media data according to the effect and control the overall functions of the functional parts.

FIG. 2 is a flowchart representing a process for creating media data according to an exemplary embodiment of the present invention. Referring to FIG. 2, in step 205, the controller 100 operates in a standby mode. When the controller 100 detects a key input signal from the key input unit 110 in the standby mode, it performs step 210 to determine whether the key input signal is a key signal for a media data menu with an instruction to reproduce or create media data . If the input key signal is not a menu key signal having an instruction to process media data, the controller 100 controls a process of performing a function corresponding to the input key. Alternatively, if the input key is the menu key, the controller 100 performs step 215 to display the media data table stored in the memory 125 . The media data therein includes images such as still and moving images input from the camera 145 or other images input via the radio processor 130 .

The controller 100 performs step 220 to select at least one image data to be created as media data from the display image data table. In step 225, the controller 100 displays the audio data table stored in the memory 125 so that audio data to be displayed together with the image data is selected. The audio data may include MP3 music data, music data from a radio processor, and other audio data such as speech. Then, the controller 100 performs step 230 to select at least one audio data to be reproduced as background audio of the image selected in step 220 from the displayed audio data table. If it is determined that the selection of audio and image data is completed, the controller 100 confirms a reproduction time of the selected image and audio data at step 235 . That is, the total reproduction time of the image data selected in the above step 220 is compared with the total reproduction time of the audio data selected in the above step 230 . When a plurality of audio and image data is selected, before being confirmed, the total reproduction time of the plurality of audio data and the total reproduction time of the plurality of image data are respectively calculated.

In step 235, the controller 100 compares the reproduction time of the image data with the reproduction time of the audio data to determine whether the reproduction time of the image data is equal to the reproduction time of the audio data. If the reproduction time of the image data is equal to the reproduction time of the audio data, the controller 100 determines whether a confirmation key with an instruction to terminate creation of the media data is input at step 250 . If the confirmation key is input, the controller 100 binds the selected audio and image data into a single media data, and stores the created media data in step 255 .

If the reproduction time of the image data is not substantially equal to the reproduction time of the audio data in step 235, the controller 100 determines whether a menu by which the reproduction time period of the image or audio data or the reproduction of the image and audio data is input is entered. Time periods can be selected to create media data. That is, the controller 100 determines whether an edit menu by which different reproduction times of image and audio data may be edited to be equal is input. If it is determined in step 240 that the edit menu has been selected, the controller 100 executes step 245 to select the reproduction part of the audio data corresponding to the reproduction time of the image data according to the substantially equal reproduction time, and select the reproduction part corresponding to the reproduction time of the audio data. the reproduced part of the image data, or select the reproduced part of the image and audio data. When recognizing that the confirmation key for confirming the termination of editing is input, the controller 100 binds the edited data as media data and stores the media data in the memory 125 in step 255 .

As described above, in processing according to an exemplary embodiment of the present invention, image and audio data are selected to create media data selected by a user. Upon confirming the reproduction state of the selected image and audio data, the controller 100 binds the data by editing the data according to the reproduction time, and then stores the resulting media data. Alternatively, the controller 100 may bind the image and audio data as it is into a single media data and then store the media data.

FIG. 3 is a flowchart representing a process of reproducing media data according to an exemplary embodiment of the present invention. Referring to FIG. 3 , the controller 100 operates in a standby mode in step 305 . When the controller 100 detects a key input signal from the key unit 100 in the standby mode, step 310 is performed to determine whether the key input signal is a key signal having an instruction for reproducing an MP3 reproduction menu. If the input key is not an MP3 reproduction menu key, the controller 100 performs step 315 to perform a function corresponding to the input key. Alternatively, if the input key is an MP3 reproduction menu key, the controller 100 performs step 320 to display the audio data table stored in the memory 125 . Then, the controller 100 performs step 325 to select at least one audio data from the displayed audio data table. In step 330, the controller 100 determines whether to display image data on the display unit 105 when the selected audio data is reproduced. That is, the controller 100 determines whether the selected audio data is created as media data. Any audio data created as media data may be indicated with a different icon so that the user can easily recognize it from the displayed audio data table.

If the selected audio data is not media data, the controller 100 reproduces the audio data while displaying a screen stored as a default value such as an equalizer screen in step 340 . Alternatively, if the selected audio data is media data, the controller 100 performs step 335 to determine whether there is any input having an instruction to display the audio data together with preset image data to be reproduced as specific media data. If the selected audio data is not indicated to be reproduced as media data, the controller 100 reproduces the audio data in a similar manner to a case where the media data does not exist. That is, the controller 100 performs step 340 to reproduce audio data while displaying a default-set screen. Alternatively, if the controller 100 is instructed to reproduce the selected audio data as media data in the above step 335, then in step 345, the controller 100 reproduces the audio data while displaying image data corresponding to the audio data on the display unit 105. data.

In step 350, when the audio data is reproduced while displaying image data set correspondingly to the audio data in step 345 or while displaying image data set as a default value in step 340, the controller 100 After the set period of time elapses, it is determined whether the reproduction time of the audio data is terminated.

If the reproduction time of the audio data is terminated, the controller 100 outputs a video or audio message informing the termination of the reproduction of the audio data and then terminates the reproduction of the audio data in step 355 .

FIG. 4 is a flowchart representing a process of creating media data according to another exemplary embodiment of the present invention. In this exemplary embodiment of the present invention, the image or audio data selected by the user for reproduction is defined as first image or audio data, and the image or audio data synthesized with the first image or audio data at a preset time is defined as the second image or audio data. Referring to FIG. 4 , the controller 100 operates in a standby mode in step 405 . When the controller 100 detects a key input signal in the standby mode, step 410 is performed to determine whether the key input signal is a key signal having an instruction to process a media data menu for creating or reproducing media data. If the input key signal is not a menu key signal having an instruction to process a media data menu, the controller 100 performs a function corresponding to the input key at step 415 . Alternatively, if the input key is a menu key, the controller 100 displays an image data table for creating media data at step 420 .

The controller 100 executes step 425 to select the first image data from the displayed image data table. Then, the controller 100 reproduces the selected first image data at step 430 . In step 435, the controller 100 determines whether a data synthesis menu is selected while the first image data is being reproduced. With the data synthesis menu, the first image data can be synthesized with the second image data or the second audio data while being reproduced. In an exemplary embodiment of the present invention, first image data is reproduced and second image data is synthesized with the first image data. If it is determined that a synthesis menu is input to synthesize the first and second image data while the first image data is being reproduced, the controller 100 stops reproduction of the first image data reproduced in step 430 in step 440 at the moment when the synthesis menu is input. - image data. Then, the controller 100 displays the image data table previously stored and used for synthesis of the first and second image data in step 445 .

Then, the controller 100 performs step 450, and the second image data to be combined with the first image data is selected from the displayed image data table. In step 455, the controller 100 determines whether a portion of the selected second image data to be combined with the first image data is selected. A specific portion of the second image data may be combined with the first image data or the entire second image data may be combined with the first image data. Therefore, the controller 100 determines whether the user has selected a partial selection menu through which editing can be performed in response to the combination of the first and second image data, and if the menu is selected, step 460 is performed, and the selection will be combined with the first The image data is composited with the portion of the second image data.

In step 465 , the controller 100 synthesizes the first image data with part or the entire second image data selected in step 460 described above. When the first image data is combined with the second image data, the direction or display effect of the second image data can be selected. After the first image data is synthesized with the selected part of the second image data, if a key input signal having an instruction to synthesize the first image data with the third image data is received, the controller 100 returns to step 430 to display in the synthesis menu The first image data is reproduced after the input time. If no such key input signal is received, the controller 100 stores new media data in which the first image data and the second image data are synthesized in the memory 125 at step 475 .

Although the exemplary embodiment of the present invention has been explained with regard to image data synthesis in which first image data is combined with second image data, if the first and second image data are dynamic image data, any Audio data in the first and second image data may also be synthesized. When the first image data and the second image data are synthesized, audio data included in the second image data may also be synthesized. Furthermore, in the case of synthesizing the first image data with the second image data, the second image data may be displayed to be superimposed on the reproduced first image data.

FIG. 5 is a flowchart representing a process of reproducing media data according to another exemplary embodiment of the present invention. This exemplary embodiment of the present invention will be described with reference to FIG. 5 in the case where MP3 audio data selected by a user is synthesized with a plurality of image data at the user's request to reproduce a package stored in a package with audio data. Media data in . Referring to FIG. 5 , the controller 100 performs step 505 for the user to input an MP3 reproduction menu through which MP3 audio data can be reproduced and reproduce the selected MP3 audio data. In step 510, the controller 100 outputs audio data selected by the user and stored first image data corresponding to the audio data. Then at step 515, the controller 100 determines whether it is time to output the second image data synthesized with the first image data while reproducing the first image data.

If it is time to output the second image data synthesized with the first image data, the controller 100 confirms the second image data to be output in step 520, and then outputs the second image according to its mode of synthesis with the first image data data. Alternatively, if it is not time to output the second image data synthesized with the first image data, the controller 100 determines whether the reproduction of the audio data is terminated at step 525 . If the reproduction of the audio data is not terminated, the controller 100 returns to the above-described step 510 and repeats steps 510 to 525 . If the reproduction of the audio data is terminated in step 525, the controller 100 displays a message informing that the reproduction of the audio data is terminated. Then at step 530, the controller 100 determines whether the user inputs a key signal with an instruction to reproduce the second audio data. If a key signal having an instruction to reproduce the second audio data is input from the user, the controller 100 repeats the above-described process from step 510 based on the audio data selected by the user in step 535 . If the user does not input a key signal for reproducing the second audio signal, the controller 100 terminates the reproduction process of the audio data.

According to certain exemplary embodiments of the present invention as described above, audio (music) and image data are synthesized according to a user's selection to create media data. This makes it possible to display user-desired image data while reproducing music data, thereby enhancing visual effects.

When audio data to be reproduced is selected, the controller determines whether image data corresponding to the audio data exists, and reproduces the audio and image data based on the determination. Alternatively, a list of previously stored media data may be displayed so that the user may select a media data to be reproduced from the list.

Although the present invention has been shown and described with reference to certain exemplary embodiments, it will be understood by workers skilled in the art that various changes in form and details may be made without departing from the spirit and scope of the invention and the invention The spirit and scope are defined by the claims and their equivalents.

Claims (20)

1. A method for creating and reproducing media data in a mobile terminal, the method comprising: enabling previously stored audio data to be selected; creating media data by using at least one image data selected to correspond to said audio data; If the user selects audio data to reproduce, then determine whether there is media data corresponding to the audio data; and If media data corresponding to the audio data exists, the media data is output. 2. The method of claim 1, wherein said step of creating media data comprises: confirm the reproduction time of the selected image and audio data; if the reproduction times are different from each other, synthesizing the audio and image data based on a portion selected corresponding to at least one of the reproduction time of the audio data and the reproduction time of the image data; Bind the synthesized audio and image data into media data, and store the media data in memory. 3. The method of claim 1, wherein said step of creating media data comprises: enabling reproduction of portions of audio data to be selected; enabling the rendering portion of the image data to be selected; The reproduced parts of audio and image data are synthesized and bound as media data, and the media data is stored. 4. The method as claimed in claim 2, wherein in the process of creating the media data, an output direction and a display effect of the image data are set and stored. 5. The method of claim 1, wherein, if the previously stored media data corresponding to the audio data does not exist when the audio data is reproduced, the audio data is reproduced while the audio data is reproduced. Image data to be displayed is selected and displayed on the display unit. 6. The method of claim 1, wherein the audio data includes MPEG-3 layer audio data and voice data, and the image data includes still image data and moving image data. 7. A method for creating and reproducing media data in a mobile terminal, comprising: enabling previously stored first image data to be selected; reproducing the selected first image data; enabling a synthesis menu to be input while reproducing the first image data, the synthesis menu instructing a user to synthesize the first image data and the second image data; Stop reproducing the first image data, enable the second image data to be selected, synthesize the first and second image data, bind the synthesized image data with the audio data selected by the user, and store the bound data as media data ;and If the media data is selected to be reproduced, the stored bound data is output. 8. The method of claim 7, wherein the first image data and the second image data are superimposed on each other when reproduced. 9. The method of claim 7, wherein the step of rendering media data comprises: outputting first image data when reproducing said audio data; determining whether it is time to reproduce the second image data; and Display the second image data. 10. The method of claim 7, wherein, if the second image data to be synthesized contains audio data, the audio data of the second audio data is synthesized together with the second audio data according to a user's setting. 11. The method of claim 7, wherein, in synthesizing the first image data and the second image data, a synthesized part is selected, and the first and second image data are synthesized according to the part. 12. The method according to claim 7, wherein, in the process of synthesizing the first and second image data, if the second image data is dynamic image data including audio data, and if the audio data of the second image data is selected to be combined, the audio data of the second image data is selected and combined with the first image data. 13. The method of claim 3, wherein during the process of creating the media data, the output direction and display effect of the image data are set and stored. 14. A mobile terminal, comprising: a controller for combining audio data and image data to create media data; memory for storing the synthesized media data; and The display unit is used to output the media data. 15. The mobile terminal of claim 14, wherein the controller detects media data input by a user to create a menu and reads an image data table and an audio data table stored in the memory. 16. The mobile terminal of claim 14, wherein the controller creates the second media data by synthesizing media data originally created by synthesizing the image data and the audio data. 17. The mobile terminal of claim 14, wherein the controller confirms a reproduction time of the selected image data and audio data. 18. The mobile terminal of claim 14, wherein the controller binds the selected audio data and image data as media data. 19. The mobile terminal of claim 14, further comprising: A key unit for inputting a key for stopping at least one of the media data and the image data from being reproduced to facilitate insertion of another image data. 20. The mobile terminal as claimed in claim 14, further comprising at least one of a camera inputting image data, a radio receiver inputting audio data, an MP3 module inputting audio data, and a camera inputting audio data recorded when the image data is captured one.

Images