[go: up one dir, main page]

WO2006035399A1 - Method of generating a playlist, playlist-containing device and playback apparatus - Google Patents

Method of generating a playlist, playlist-containing device and playback apparatus Download PDF

Info

Publication number
WO2006035399A1
WO2006035399A1 PCT/IB2005/053187 IB2005053187W WO2006035399A1 WO 2006035399 A1 WO2006035399 A1 WO 2006035399A1 IB 2005053187 W IB2005053187 W IB 2005053187W WO 2006035399 A1 WO2006035399 A1 WO 2006035399A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
playback
playlist
encoding
accessible
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2005/053187
Other languages
French (fr)
Inventor
Rohan Lobo
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Publication of WO2006035399A1 publication Critical patent/WO2006035399A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34Indicating arrangements 

Definitions

  • the invention relates to a method of generating a playlist.
  • the invention further relates to a playlist-containing device.
  • the invention also relates to a playback apparatus comprising a playlist unit and a playback unit, wherein the playlist unit comprises a playlist providing an ordered sequence of at least two playback portions defining a chronology of playing back playback content by the playback unit.
  • the invention also relates to a computer-readable medium. Furthermore, the invention relates to a program element.
  • a “playlist” particularly denotes an assembly of media files to be played back in accordance with a particular chronological order which is defined by the playlist.
  • the media files of a playlist are related to a single type of media data, i.e. to a single content type.
  • an audio playlist is related exclusively to audio data, like music
  • a video playlist is related exclusively to video data, like movies.
  • the plurality of media files of a fixed type of content can be played back, in accordance with the order defined in a corresponding playlist, on a playback device like a hi- fi system, a video recorder, or a computer (PC).
  • Fig. IA shows an audio playlist 100 comprising a header 101 indicating a name of the audio playlist 100 and comprising a list of audio files 102 providing an ordered sequence of playback portions indicating different pieces of music to be played back in accordance with the chronology defined by the ordered sequence of the audio files 102. For instance, according to the audio playlist 100, the media file "Baby, I'm A Want You.mp3" is played back first, followed by the media file "It Don't Matter To Me.mp3", and so forth.
  • Fig. IB shows a video playlist 110 comprising a header 101 indicating a name of the video playlist 1 10 and comprising a list of video files 111 indicating different movies to be played back in accordance with the chronology defined by the ordered sequence of the video files 111. For instance, according to the video playlist 110, the media file "Two_towers.avi” is played back first, followed by the media file "American_Psycho.avi", and so forth.
  • US 2004/0,078,383 Al discloses a method of grouping and navigating media files within a playlist on a computer-readable medium.
  • Software selects media files to define a group from the media files.
  • a playlist may consist of different types of content to be played back one after the other. For instance, an audio file, followed by an image file and then a video file may be played back.
  • US 2004/0,001,704 Al discloses a method of processing data defining a still image slide show with background audio, the system being configured to read video and audio data and to present output signals containing data descriptive of a slide show with background audio.
  • an audio playlist and a video playlist are provided as two separate playlists, which playlists may be processed in conjunction so as to perform a slide show of still images with audio playback.
  • the method of generating a playlist for encoding control information for simultaneously playing back a playback content accessible to a plurality of human senses comprises the steps of providing an ordered sequence of at least two playback portions defining a chronology of playing back playback contact, and providing each of the at least two playback portions with a plurality of content data fields.
  • Each content data field is designated to receive content-encoding data encoding playback content which is accessible to a respective human sense when the playback content is played back.
  • the invention provides a playlist-containing device, a playlist of the playlist-containing device encoding control information for simultaneously playing back a playback content accessible to a plurality of human senses.
  • the device comprises a processor adapted to carry out the above-mentioned method steps.
  • a playback apparatus comprising a playlist unit and a playback unit.
  • the playlist unit comprises a playlist providing an ordered sequence of at least two playback portions defining a chronology of playing back playback content by the playback unit.
  • Each of the at least two playback portions is provided with a plurality of content data fields.
  • Each content data field is designated to receive content-encoding data encoding playback content which is accessible to a respective human sense when the playback content is played back by the playback unit.
  • the playback unit is adapted to simultaneously play back playback content accessible to a plurality of human senses according to the playlist.
  • a computer-readable medium in which a computer program for generating a playlist for encoding control information for simultaneously playing back a playback content accessible to a plurality of human senses is stored, which program, when being executed by a processor, is adapted to carry out the above-mentioned method steps.
  • a program element for generating a playlist for encoding control information for simultaneously playing back a playback content accessible to a plurality of human senses is provided, which program element, when being executed by a processor, is adapted to carry out the above-mentioned method steps.
  • the playlist of the invention can be realized by a computer program, i.e. by software, or by using one or more special electronic optimization circuits, i.e. in hardware, or in hybrid form, i.e. by means of software and hardware components.
  • the characteristic features according to the invention particularly have the advantage that the playlist with its structural division into playlist portions, which, in turn, are subdivided into data field structures, has an extended functionality and enhances the flexibility to combine different types of content (audio content, video content, olfactory content, or the like) to schedule a user-defined multimedia playback show.
  • the user can thus freely arrange any desired combination of multi-sensual stimuli.
  • the invention provides an easily editable platform to reproduce pieces of content related to different content types in a timely simultaneous manner. Pieces of content may be split and/or combined in a user- defined manner so as to allow a user to define a playback chronology in a simplified way.
  • the spreadsheet or table-like playlist of the invention can be edited easily by a user and serves directly as control information for a playback device to play back a plurality of heterogeneous pieces of content in such a manner that, at one point of time, content which is accessible to different human senses is reproduced simultaneously, i.e. timely parallel. For instance, signals can be played back which are accessible to the visual sense (pictures), the acoustical sense (sound) and the tactile sense (feeling).
  • the invention provides a user- friendly interactive playlist which allows combination of different types of content to create an enjoyable multimedia show in parallel.
  • a sense in the meaning of this description is any human physiological perception resulting from a sensory cell type that responds to a specific kind of physical energy and corresponds to a defined region or a group of regions within the human brain where the signals are received and interpreted.
  • Human senses which may be accessed by the invention are particularly seeing, hearing, tasting, smelling, tactition, thermoception, nociception, equilibrioception and proprioception. Seeing or vision describes the ability to detect light.
  • Hearing or audition is the sense of sound perception.
  • Taste or gustation relates to the human tongue having receptors to detect tastes like sweet, salt, sour and bitter.
  • Smell or olfaction relates to olfactory receptor neurons in the nose.
  • Tactition is the sense of pressure perception, generally in the skin.
  • Thermoception is the sense of heat and cold, also by the skin.
  • Nociception is the perception of pain.
  • Equilibrioception is the perception of balance.
  • Proprioception is the perception of body awareness.
  • a plurality of these human senses in any combination may be accessed by respective content included in the content data fields of the playlist of the invention.
  • the invention creates a playlist supporting items with mixed audio and video channels, and/or any other sensory information.
  • a user can create a playlist with favorite movies, but he can overwrite the movie soundtrack with the audio from a music playlist or with a particular audio track from a user.
  • a user can also play a slide show along with the soundtrack from a movie using only the audio data, not the image data of a video file.
  • the playlist of the invention allows playback of only a particular section of the song or movie, or playback of the entire song.
  • Each item or playback portion in the playlist may comprise at least two content data fields, of which, for instance, one may be realized as an audio field and the other as a visual field.
  • at least one additional time field is provided.
  • the playlist can further be extended to include one or more other sensory content data fields, like smell, touch and taste.
  • Each content data field defines which kind or type of content will be rendered therefrom, e.g. content assigned to the audio field will only be rendered as audio data.
  • a user can assign items of any one of the fields in the playlist, so that a particular content type will be played. For example, one can assign a movie to only the audio field of the playlist (leaving all the other fields blank), and when this item is played back, one only hears the audio of that movie. If it was 'assigned to the video field of the playlist as well, one would both hear the audio and see the video from the particular movie.
  • each playlist item may comprise three fields, for instance, an audio data field, a visual data field and an optional time field.
  • a user can assign an item to one or more fields in the playlist. If an item has renderable parts defined in the content data field, then rendering is performed only of the parts that are renderable. It is also possible to playback only a particular section by setting a playback time interval in the time field.
  • the invention provides a method of creating a playlist, in which each item in the playlist comprises main fields (e.g. an audio field, a visual field and an optional time field) and in which an assignment can be carried out, in which assignment content that is renderable is attached to one or more of the main fields and in which it is checked for each main field whether the assigned content of the main field has renderable parts defined by a main field, and a rendering is performed only of the parts that are found to be renderable. For example, if a movie is assigned to the audio field of the playlist, only the audio part of the movie is rendered when the playlist for rendering the content is processed. Thus, a user is not restricted to creating a playlist of only one type of content.
  • main fields e.g. an audio field, a visual field and an optional time field
  • an assignment content that is renderable is attached to one or more of the main fields and in which it is checked for each main field whether the assigned content of the main field has renderable parts defined by a main field, and a rendering is performed only of the parts that
  • the invention creates a multi-dimensional playlist.
  • Each item in the playlist may consist of a separate channel related to audio, video, olfactory, sensory, etc.
  • a user plays back an item playback portion in the playlist, it actually plays back all the elements contained in the corresponding content data fields parallel in time.
  • This embodiment also applies to the playlist-containing device, the playback apparatus, the computer-readable medium, and the program element.
  • Different content data fields of a respective playback portion may be designated to receive content-encoding data encoding playback content which is accessible to different human senses when the playback content is played back.
  • each content data field may be assigned to content which is accessible to a particular human sense.
  • two different content data fields are thus assigned to two different human senses. For instance, a first content data field is assigned to visible content, a second content data field is assigned to hearable content, a third content data field is assigned to smellable data, and so forth.
  • At least two of the plurality of content data fields may receive content- encoding data encoding playback content which is accessible to at least two different human senses. For instance, audio, video and olfactory-related content may be played back simultaneously, or a smell, a taste and a video may be played simultaneously, or a taste and visual information may be reproduced simultaneously.
  • At least one of the plurality of content data fields may be one of the group consisting of an audio content field, a visual content field, a tactile content field, an olfactory content field and a taste-related content field.
  • any other human sense mentioned above can be implemented in the system of the invention.
  • At least one of the plurality of content data fields may receive content- encoding data encoding playback content which is accessible to one of the human senses of the group consisting of a tactile sense, an olfactory sense and a taste-related sense.
  • the consideration and combination of these unconventional senses in the framework of a multi- sensual system create completely new feelings for a human user.
  • At least one of the plurality of content data fields may be related to a special effect.
  • a special effect in the meaning of this description is particularly related to any effect which is not only created by a playback apparatus, but additionally introduces a coupling with one or more external special-effect devices capable of generating such a special effect.
  • a playback apparatus can be coupled with a light-show machine to generate a light show as such a special effect.
  • the apparatus may induce fireworks performed simultaneously with a visual and/or an olfactory content playback according to a user-defined playlist.
  • Other special effects which may be combined with content of different types include, for instance, trick fountains, a laser show, a show including holograms, or the display of textual information such as lyrics or subtitles, etc., or the like.
  • Each of the at least two playback portions may be provided with a time data field, each time data field being designated to receive timing information indicating a time of simultaneously playing back content in accordance with content-encoding data received in at least a part of the plurality of content data fields of the respective playback portion.
  • the time data field may be used to manage the timing of playing back data in accordance with the content included in the content data fields of a particular playback portion.
  • the playlist of the invention may be generated as an electronic schedule comprising rows and columns.
  • the rows may constitute the playback portions, and the columns may constitute the content data fields and the time data fields. This configuration is concise and clearly laid out and allows a user to handle a playlist without any special training or education.
  • Each playback portion may be provided with a plurality of time data fields, each time data field being assigned to a respective one of the content data fields and indicating a time at which the content in accordance with the assigned content data field is played back.
  • a separate time field can be assigned to each content data field.
  • the management of the timing at which the different content must be played back simultaneously can be adjusted in a further refined manner, because also a partial overlap of different parts of content of different types to be played back is made possible.
  • Each of the plurality of content data fields may be adapted to receive a uniform resource locator as content-encoding data addressing a resource containing correlated playback content.
  • Such a uniform resource locator indicates a position or an address of a resource allowing unambiguous access to the resource or download content.
  • a uniform resource locator may be an Internet address, a memory address allowing determinination of the part of a storage device at which the desired content is stored, for instance, the number of a track on a CD or a part of a hard-drive of a computer.
  • the playlist may simply have a unique link or address included in any of the content data fields allowing identification of an address at which the desired content may be accessed. Examples of uniform resource locator schemes are http or ftp.
  • the URL could be used in the playlist, and the content itself could be embedded in this playlist.
  • a video file could be embedded in the playlist.
  • Each of the plurality of content data fields may be adapted to receive a uniform resource locator as content-encoding data addressing a part of a resource, the part containing correlated playback content. For instance, only one particular stream of a multi- stream data source can be addressed by the URL. This means particularly that only the audio track of a video content may be chosen, whereas the visual content is not accessed. Alternatively, only a time interval of content, for instance, the refrain or a particular strophe of a music piece may be accessed by the URL. The opportunity to select only a part of a media piece further enhances the flexibility of the system of the invention.
  • the playback apparatus may comprise a user interface adapted to enable a user to input content-encoding data in at least one of the content data fields (and/or to input timing information in at least one of the optional time data fields, if provided).
  • a user interface may be, for instance, a graphical user interface (GUI) allowing a user to easily edit the playlist interactively on a monitor and to allow editing of the playlist without any special education or knowledge.
  • GUI graphical user interface
  • Figs. IA and IB show playlists according to the prior art.
  • Fig. 2 shows a playlist in accordance with a first embodiment of the invention.
  • Fig. 3 shows a playlist in accordance with a second embodiment of the invention.
  • Fig. 4 shows a playlist in accordance with a third embodiment of the invention.
  • Fig. 5 shows a flow chart illustrating a method of generating a playlist in accordance with a preferred embodiment of the invention.
  • Fig. 6 shows a playback apparatus in accordance with a preferred embodiment of the invention.
  • Fig. 7 shows a playlist in accordance with a fourth embodiment of the invention.
  • a playlist 200 in accordance with a first embodiment of the invention will now be described with reference to Fig. 2.
  • the playlist 200 shown in Fig. 2 is generated in accordance with the method of generating a playlist according to the invention.
  • the playlist 200 is provided for encoding control information which can be supplied to a playback apparatus (not shown) for simultaneously playing back multi-dimensional playback content accessible to a plurality of human senses, namely audio, visual, smell, and touch content.
  • the playlist 200 comprises a header 201 including the name of the playlist
  • the playlist 200 is provided in a table-like structure having rows or playback portions 202 (see first playback portion 202a, second playback portion 202b, third playback portion 202c, etc.) indicating an ordered sequence of different items of playback content, in particular defining a chronology of playing back or rendering playback content.
  • Each playback portion 202 is provided with a plurality of content data fields 203 to 206, and a time data field 207.
  • An audio content data field 203 (comprising a first audio content item 203a, a second audio content item 203b, a third audio content item 203c, etc.) is related to acoustic content data
  • a visual content data field 204 (comprising a first visual content item 204a, a second visual content item 204b, a third visual content item 204c, etc.) is related to optical content data
  • a smell content data field 205 (comprising a first smell content item 205a, a second smell content item 205b, a third smell content item 204c, etc.) is related to olfactory content data
  • a touch content data field 206 (comprising a first touch content item 206a, a second touch content item 206b, a third touch content item 206c, etc.) is related to a tactile content to be played back.
  • each content data field 203 to 206 is designated to receive content-encoding data encoding playback content which is accessible to a respective human sense when the playback content is played back.
  • not all of the content data fields 203 to 206 are filled with content-encoding data.
  • the second visual content data item 204b assigned to the second playback portion 202b is empty.
  • Each time data field 207 (comprising a first time data item 207a, a second time data item 207b, a third time data item 207c, etc., provided for each playback portion 202) is designated to receive timing information indicating a time of simultaneously playing back or rendering content in accordance with content-encoding data received in a part of the content data fields 203 to 206 of the respective playback portion 202.
  • the user-defined playlist 200 shown in Fig. 2, has the following properties.
  • the audio from an m ⁇ 3-file can be played back simultaneously with a video from an avi-file, as shown in row 202a, the first audio content item 203 a and the first visual content item 204a. From the time interval shown in the first time data item 207a, it can be seen that only a particular time interval of both the first audio content item 203a and the first visual content item 204a is set to be played back.
  • the user can further use only the audio from a video file and play another video file along with it, as shown in the third playback portion 202c.
  • the user can also use the audio from an avi-file and play it with a slide show, as shown in item 04, i.e. the fourth playback portion 202d.
  • Each list item can also be linked to other sensory items like a smell or a touch output.
  • An example is given in item 03, or the third playback portion 202c, in which a smell of roses is output when the song "Falling in Love.avi" is played, and also a gentle breeze as a touch output.
  • a playlist 300 in accordance with a second embodiment of the invention will now be described with reference to Fig. 3.
  • the playlist 300 differs from the playlist 200 in that a special-effect content data field 301 (comprising a first special-effect content item 301a, a second special-effect content item 301b, etc.) is provided, in which a special effect like a light show or fireworks can be combined with content from any one of the content data fields 203 to 206. Furthermore, a separate time data field is provided for each content data field 203 to 206, 301 separately, in contrast to a common time data field 207 related to a complete playback portion 202, as in the case of Fig. 2. A separate time field 207 to 211 for each content data field 203 to 206, 301, further enhances flexibility, because even sophisticated time sequences can be included in the playlist 300.
  • a special-effect content data field 301 comprising a first special-effect content item 301a, a second special-effect content item 301b, etc.
  • a separate time data field is provided for each content data field 203 to 206, 301 separately, in contrast to
  • each playback portion 202 in the playlist 300 is constituted by several editable fields 203 to 21 1, 301.
  • These name fields 203 to 206, 301 contain a uniform resource locator (URL) of the appropriate field item, and corresponding time fields 207 to 21 1 can be used in a number of ways.
  • the time fields 207 to 211 may be used to indicate the playback time interval (start time and end time) for this URL item or may be used to indicate a delay, i.e. the time interval in which the URL should be played.
  • a playlist 400 in accordance with a third embodiment of the invention will now be described with reference to Fig. 4.
  • the structure of the playlist 400 is very similar to that of the playlist 300, but includes a plurality of particular contents in the fields 203 to 211, 301.
  • the playlist 400 consists of six playlist items 202, namely items 202a to 202f, each containing five editable fields, namely an audio channel field 203, a video channel field 204, a sensory channel field 206, an olfactory channel field 205 and an effects channel field 301.
  • Each field 203 to 206, 301 may contain a link to an appropriate item and also a start time data and an end time data for playing back a particular item, defined in a respective time field 207 to 211.
  • the audio from the song "I'm a want you.mp3" is played, and the whole song is played because there is no time specified in the corresponding time field 208, i.e. the first time data item 208a, related to the audio content data field 203. While this audio is played, the video from the video file "Mr. Bean goes to town.avi” is played. The video is played back from 3:00 minutes to 6:00 minutes of the video in accordance with the first video channel time field 209a. Since there are no URLs in the sensory field 206 and in the olfactory field 205, they are ignored.
  • playlist item 3 (third playback portion 202c)
  • the audio is played from the video file "Falling in love.avi”
  • the 4:34 minutes of audio are played back from the start of the video file, as indicated by the corresponding third video channel time field.
  • the first 4:34 minutes of the video are played back from the video file "Janes Birthday.avi”.
  • a gentle breeze is played back for one minute, as shown by the URL in the sensory channel 206.
  • a smell of roses is simulated for the whole duration of the song.
  • Fig. 5 shows a flow chart 500 indicating steps of a method for creating a playlist.
  • a step 501 indicates the creation of a new playlist.
  • a step 502 is performed, i.e. for any one of the playlist portions 202 (202a, 202b, 202c, etc.).
  • a URL for the audio field is selected, and in a step 504, a playback time is set (a start time and an end time or a delay time interval).
  • a URL for the video field is selected in a step 505, and in a step 506, the playback time for the video is set.
  • step 507 sensory output information is selected, and in a step 508, the time is set at which the information is to played back and the duration of playback. If required, in a step 509, olfactory output information is selected, and in a step 510, the time interval for playback is set. If there is one or more additional effect to be set for this item, in a step 511, corresponding information is inserted, and in a step 512, the playback time interval is included. If there are more items to be inserted in the playlist (such as information to display textual information like lyrics or subtitles), in a step 513, such additional items may be inserted. The method stops in step 514.
  • the playback apparatus 600 comprises a playlist unit 620 and a playback unit
  • the playlist unit 620 comprises a playlist 601 (like one of the playlists 200, 300, 400) providing an ordered sequence of a plurality of playlist items defining a chronology of playing back playback content by the playback unit 630.
  • the playback unit 630 is provided and adapted to simultaneously play back playback content accessible to a plurality of human senses according to the playlist 601.
  • a user may introduce, via a graphical user interface 616, a playlist 601 stored in a storage medium 615, which is a hard disk of a computer in this case.
  • the playback apparatus 600 comprises a microprocessor 603, which is provided and adapted to control decoding of audio information by means of an audio decoder 605, decoding of video information by means of a video decoder 607, processing of sensory information by means of a sensory processor 609, processing of olfactory information by means of an olfactory processor 611, and/or processing of other additional effects information by means of an effect processor 613.
  • the audio decoder 605 is coupled to an audio renderer 606 of the playback unit 630, which audio renderer 606 plays back audio information as decoded by the audio decoder 605.
  • the video decoder 607 is coupled to a video renderer 608 of the playback unit 630 and is capable of recording video information in accordance with the decoded video.
  • the sensory processor 609 is coupled to a sensory renderer 610 of the playback unit 630 and is capable of playing back sensory information as processed by the sensory processor 609.
  • the olfactory processor 611 is coupled to an olfactory renderer 612 of the playback unit 630 and is capable of producing olfactory effects in accordance with the output of the olfactory processor 611.
  • an effects renderer 614 of the playback unit 630 may produce effects in accordance with an output of the effects processor 613.
  • the playlist 601 is stored on a storage medium 615, namely a hard disk or any other memory medium, for instance, a memory card, flash card, USB-stick, CD-ROM, DVD, etc.
  • the microprocessor 603 starts separate threads to concurrently process the various URLs. If there is a URL in the audio field, the microprocessor 603 decodes the audio information present in this URL in the audio decoder 605. This involves fetching the audio source which could be on the same medium as the playlist 601, or on another medium. The audio information is decoded by the audio decoder 605. Alternatively, the audio information can also be decoded by the processor 603. The decoded audio data is sent to the audio renderer 606 for playback. Depending on the specified audio playback times, this audio is played back by the playback unit 603 via loudspeakers, headphones, or the like.
  • the video processing thread decodes the video information by the video decoder 607, if video information is present in the respective playback portion of the playlist 601. If there is a URL corresponding to the video channel, this URL is fetched and decoded by the processor 603 or by a separate video processor 607 (as in the case shown in Fig. 6) and then sent to the video renderer 608 for playback at an appropriate time as specified in the video playback time interval, using, for instance, a monitor or any other screen or display.
  • the sensory information processing thread processes the sensory information present in the playlist 601. If there is a URL corresponding to this sensory information, this URL is decoded by the processor 603 which in turn sends it to the sensory Tenderer 610 for playback of the sensory information at the appropriate time as specified in the playback time interval of the sensory field.
  • the olfactory information processing thread decodes the URL corresponding to the olfactory information present in the playlist 601. If there is a URL, this URL is decoded by the sensory processor 609, or alternatively by the processor 603, and then sent to the appropriate olfactory renderer 612 for playback at the appropriate time as specified in the playback time interval of the olfactory field.
  • Processing of olfactory information may be based on a scent-emitting device and method as disclosed in US 2001/0,048,641 : "Scent-emitting device", the disclosure of which is herein incorporated by reference.
  • one or more additional effects may be processed in separate threads corresponding to this information and then sent to the respective effects renderer 614 for playback at the appropriate time interval.
  • the system may comprise one or more of such processors or specialized processors such as a separate audio decoder or video decoder and/or one or more special processors for decoding and playback of the other effects information.
  • the URLs in the playlist 601 are not limited to being present on the same medium. There may be a link to data on another medium such as a network computer or a PDA ("personal digital assistant") or a mobile phone or the like, whose data can be accessed by the system.
  • a playlist 700 in accordance with a fourth embodiment of the invention will now be described with reference to Fig. 7.
  • the playlist 700 shows that, for a particular playlist portion 202, the corresponding information according to audio content 203, visual content 204 and smell content 205 is played simultaneously (see simultaneously played content 701).
  • the chronology of the playback is defined by a direction of play 702 in accordance with which the different playback portions 202 are played back one after the other.
  • the invention provides a multi-dimensional playlist.
  • Each item in the playlist 700 may comprise separate audio, video, olfactory, sensory channels, etc.
  • a user plays back an item in the playlist, it actually plays back all the elements of the content data fields of a playback portion simultaneously and not only one of them. It should be noted that the protective scope of the invention is not limited to the embodiments described.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)

Abstract

A method of generating a playlist (200) for encoding control information for simultaneously playing back playback content accessible to a plurality of human senses, the method comprising the steps of providing an ordered sequence of at least two playback portions (202) defining a chronology of playing back playback content, providing each of the at least two playback portions (202) with a plurality of content data fields (203 to 206), wherein each content data field (203 to 206) is designated to receive content-encoding data encoding playback content which is accessible to a respective human sense when the playback content is played back.

Description

Method of generating a playlist, playlist-containing device and playback apparatus
FIELD OF THE INVENTION
The invention relates to a method of generating a playlist. The invention further relates to a playlist-containing device. The invention also relates to a playback apparatus comprising a playlist unit and a playback unit, wherein the playlist unit comprises a playlist providing an ordered sequence of at least two playback portions defining a chronology of playing back playback content by the playback unit.
The invention also relates to a computer-readable medium. Furthermore, the invention relates to a program element.
BACKGROUND OF THE INVENTION
A "playlist" according to the prior art particularly denotes an assembly of media files to be played back in accordance with a particular chronological order which is defined by the playlist. Conventionally, the media files of a playlist are related to a single type of media data, i.e. to a single content type. For instance, an audio playlist is related exclusively to audio data, like music, or a video playlist is related exclusively to video data, like movies. The plurality of media files of a fixed type of content can be played back, in accordance with the order defined in a corresponding playlist, on a playback device like a hi- fi system, a video recorder, or a computer (PC).
Conventional playlists consisting of items with a fixed content type are shown in Figs. IA and IB.
Fig. IA shows an audio playlist 100 comprising a header 101 indicating a name of the audio playlist 100 and comprising a list of audio files 102 providing an ordered sequence of playback portions indicating different pieces of music to be played back in accordance with the chronology defined by the ordered sequence of the audio files 102. For instance, according to the audio playlist 100, the media file "Baby, I'm A Want You.mp3" is played back first, followed by the media file "It Don't Matter To Me.mp3", and so forth.
Fig. IB shows a video playlist 110 comprising a header 101 indicating a name of the video playlist 1 10 and comprising a list of video files 111 indicating different movies to be played back in accordance with the chronology defined by the ordered sequence of the video files 111. For instance, according to the video playlist 110, the media file "Two_towers.avi" is played back first, followed by the media file "American_Psycho.avi", and so forth.
US 2004/0,078,383 Al discloses a method of grouping and navigating media files within a playlist on a computer-readable medium. Software selects media files to define a group from the media files. A playlist may consist of different types of content to be played back one after the other. For instance, an audio file, followed by an image file and then a video file may be played back.
However, according to US 2004/0,078,383 Al, a user is restricted to a fixed scheme of playing back linearly ordered files to be reproduced one after the other.
US 2004/0,001,704 Al discloses a method of processing data defining a still image slide show with background audio, the system being configured to read video and audio data and to present output signals containing data descriptive of a slide show with background audio. According to US 2004/0,001,704, an audio playlist and a video playlist are provided as two separate playlists, which playlists may be processed in conjunction so as to perform a slide show of still images with audio playback.
However, also the method of US 2004/0,001,704 Al restricts a user to a fixed system without giving him sufficient flexibility to create a playlist which meets his individual requirements. Thus, the playlists according to the related art have the drawback of a lack of flexibility.
OBJECT AND SUMMARY OF THE INVENTION
It is an object of the invention to provide a user- friendly playlist having an enhanced flexibility and an extended functionality.
In order to achieve the object defined above, a method of generating a playlist, a playlist-containing device, a playback apparatus, a computer-readable medium and a program element having the features defined in the independent claims are provided.
The method of generating a playlist for encoding control information for simultaneously playing back a playback content accessible to a plurality of human senses comprises the steps of providing an ordered sequence of at least two playback portions defining a chronology of playing back playback contact, and providing each of the at least two playback portions with a plurality of content data fields. Each content data field is designated to receive content-encoding data encoding playback content which is accessible to a respective human sense when the playback content is played back.
Furthermore, the invention provides a playlist-containing device, a playlist of the playlist-containing device encoding control information for simultaneously playing back a playback content accessible to a plurality of human senses. The device comprises a processor adapted to carry out the above-mentioned method steps.
Moreover, a playback apparatus is provided, comprising a playlist unit and a playback unit. The playlist unit comprises a playlist providing an ordered sequence of at least two playback portions defining a chronology of playing back playback content by the playback unit. Each of the at least two playback portions is provided with a plurality of content data fields. Each content data field is designated to receive content-encoding data encoding playback content which is accessible to a respective human sense when the playback content is played back by the playback unit. The playback unit is adapted to simultaneously play back playback content accessible to a plurality of human senses according to the playlist.
Furthermore, a computer-readable medium is provided, in which a computer program for generating a playlist for encoding control information for simultaneously playing back a playback content accessible to a plurality of human senses is stored, which program, when being executed by a processor, is adapted to carry out the above-mentioned method steps.
Moreover, a program element for generating a playlist for encoding control information for simultaneously playing back a playback content accessible to a plurality of human senses is provided, which program element, when being executed by a processor, is adapted to carry out the above-mentioned method steps. The playlist of the invention can be realized by a computer program, i.e. by software, or by using one or more special electronic optimization circuits, i.e. in hardware, or in hybrid form, i.e. by means of software and hardware components.
The characteristic features according to the invention particularly have the advantage that the playlist with its structural division into playlist portions, which, in turn, are subdivided into data field structures, has an extended functionality and enhances the flexibility to combine different types of content (audio content, video content, olfactory content, or the like) to schedule a user-defined multimedia playback show. The user can thus freely arrange any desired combination of multi-sensual stimuli. The invention provides an easily editable platform to reproduce pieces of content related to different content types in a timely simultaneous manner. Pieces of content may be split and/or combined in a user- defined manner so as to allow a user to define a playback chronology in a simplified way.
The spreadsheet or table-like playlist of the invention can be edited easily by a user and serves directly as control information for a playback device to play back a plurality of heterogeneous pieces of content in such a manner that, at one point of time, content which is accessible to different human senses is reproduced simultaneously, i.e. timely parallel. For instance, signals can be played back which are accessible to the visual sense (pictures), the acoustical sense (sound) and the tactile sense (feeling). The invention provides a user- friendly interactive playlist which allows combination of different types of content to create an enjoyable multimedia show in parallel.
A sense in the meaning of this description is any human physiological perception resulting from a sensory cell type that responds to a specific kind of physical energy and corresponds to a defined region or a group of regions within the human brain where the signals are received and interpreted. Human senses which may be accessed by the invention are particularly seeing, hearing, tasting, smelling, tactition, thermoception, nociception, equilibrioception and proprioception. Seeing or vision describes the ability to detect light. Hearing or audition is the sense of sound perception. Taste or gustation relates to the human tongue having receptors to detect tastes like sweet, salt, sour and bitter. Smell or olfaction relates to olfactory receptor neurons in the nose. Tactition is the sense of pressure perception, generally in the skin. Thermoception is the sense of heat and cold, also by the skin. Nociception is the perception of pain. Equilibrioception is the perception of balance. Proprioception is the perception of body awareness. A plurality of these human senses in any combination may be accessed by respective content included in the content data fields of the playlist of the invention. Particularly, the invention creates a playlist supporting items with mixed audio and video channels, and/or any other sensory information. For example, a user can create a playlist with favorite movies, but he can overwrite the movie soundtrack with the audio from a music playlist or with a particular audio track from a user. A user can also play a slide show along with the soundtrack from a movie using only the audio data, not the image data of a video file. Also, the playlist of the invention allows playback of only a particular section of the song or movie, or playback of the entire song.
Thus, the invention provides a simple but sophisticated way of implementing playlists and thus extending their functionality to include multiple sources of content. In other words, an alternative way of creating a playlist, irrespective of the content type, is taught by the invention. Each item or playback portion in the playlist may comprise at least two content data fields, of which, for instance, one may be realized as an audio field and the other as a visual field. Optionally, at least one additional time field is provided. The playlist can further be extended to include one or more other sensory content data fields, like smell, touch and taste. Each content data field defines which kind or type of content will be rendered therefrom, e.g. content assigned to the audio field will only be rendered as audio data. A user can assign items of any one of the fields in the playlist, so that a particular content type will be played. For example, one can assign a movie to only the audio field of the playlist (leaving all the other fields blank), and when this item is played back, one only hears the audio of that movie. If it was 'assigned to the video field of the playlist as well, one would both hear the audio and see the video from the particular movie.
It is also within the scope of the invention to play back only a particular section of the content file (e.g. a piece of music or a movie) by setting a playback time interval in the time field. Only that particular section of the audio or video is then played back.
In the light of the invention, a user is no longer restricted in creating playlists of only one type of content. Users can create playlists the way they want so as to give them maximum flexibility. Thus, the invention allows creation of a playlist irrespective of the content type. In one embodiment, each playlist item may comprise three fields, for instance, an audio data field, a visual data field and an optional time field. A user can assign an item to one or more fields in the playlist. If an item has renderable parts defined in the content data field, then rendering is performed only of the parts that are renderable. It is also possible to playback only a particular section by setting a playback time interval in the time field.
In other words, the invention provides a method of creating a playlist, in which each item in the playlist comprises main fields (e.g. an audio field, a visual field and an optional time field) and in which an assignment can be carried out, in which assignment content that is renderable is attached to one or more of the main fields and in which it is checked for each main field whether the assigned content of the main field has renderable parts defined by a main field, and a rendering is performed only of the parts that are found to be renderable. For example, if a movie is assigned to the audio field of the playlist, only the audio part of the movie is rendered when the playlist for rendering the content is processed. Thus, a user is not restricted to creating a playlist of only one type of content.
The invention creates a multi-dimensional playlist. Each item in the playlist may consist of a separate channel related to audio, video, olfactory, sensory, etc. When a user plays back an item playback portion in the playlist, it actually plays back all the elements contained in the corresponding content data fields parallel in time.
Referring to the dependent claims, further preferred embodiments of the invention will be described hereinafter. A preferred embodiment of the method of the invention will now be described.
This embodiment also applies to the playlist-containing device, the playback apparatus, the computer-readable medium, and the program element.
Different content data fields of a respective playback portion may be designated to receive content-encoding data encoding playback content which is accessible to different human senses when the playback content is played back. In other words, each content data field may be assigned to content which is accessible to a particular human sense. According to this embodiment, two different content data fields are thus assigned to two different human senses. For instance, a first content data field is assigned to visible content, a second content data field is assigned to hearable content, a third content data field is assigned to smellable data, and so forth.
At least two of the plurality of content data fields may receive content- encoding data encoding playback content which is accessible to at least two different human senses. For instance, audio, video and olfactory-related content may be played back simultaneously, or a smell, a taste and a video may be played simultaneously, or a taste and visual information may be reproduced simultaneously.
At least one of the plurality of content data fields may be one of the group consisting of an audio content field, a visual content field, a tactile content field, an olfactory content field and a taste-related content field. Alternatively or additionally, any other human sense mentioned above can be implemented in the system of the invention. At least one of the plurality of content data fields may receive content- encoding data encoding playback content which is accessible to one of the human senses of the group consisting of a tactile sense, an olfactory sense and a taste-related sense. The consideration and combination of these unconventional senses in the framework of a multi- sensual system create completely new feelings for a human user. At least one of the plurality of content data fields may be related to a special effect. A special effect in the meaning of this description is particularly related to any effect which is not only created by a playback apparatus, but additionally introduces a coupling with one or more external special-effect devices capable of generating such a special effect. For instance, a playback apparatus can be coupled with a light-show machine to generate a light show as such a special effect. Alternatively, the apparatus may induce fireworks performed simultaneously with a visual and/or an olfactory content playback according to a user-defined playlist. Other special effects which may be combined with content of different types include, for instance, trick fountains, a laser show, a show including holograms, or the display of textual information such as lyrics or subtitles, etc., or the like.
Each of the at least two playback portions may be provided with a time data field, each time data field being designated to receive timing information indicating a time of simultaneously playing back content in accordance with content-encoding data received in at least a part of the plurality of content data fields of the respective playback portion. The time data field may be used to manage the timing of playing back data in accordance with the content included in the content data fields of a particular playback portion.
The playlist of the invention may be generated as an electronic schedule comprising rows and columns. The rows may constitute the playback portions, and the columns may constitute the content data fields and the time data fields. This configuration is concise and clearly laid out and allows a user to handle a playlist without any special training or education.
Each playback portion may be provided with a plurality of time data fields, each time data field being assigned to a respective one of the content data fields and indicating a time at which the content in accordance with the assigned content data field is played back. Thus, alternatively to a configuration in which a single time field is provided for each playback portion or item, a separate time field can be assigned to each content data field. Thus, the management of the timing at which the different content must be played back simultaneously can be adjusted in a further refined manner, because also a partial overlap of different parts of content of different types to be played back is made possible. Each of the plurality of content data fields may be adapted to receive a uniform resource locator as content-encoding data addressing a resource containing correlated playback content. Such a uniform resource locator (URL) indicates a position or an address of a resource allowing unambiguous access to the resource or download content. For instance, such a uniform resource locator may be an Internet address, a memory address allowing determinination of the part of a storage device at which the desired content is stored, for instance, the number of a track on a CD or a part of a hard-drive of a computer. Thus, the playlist may simply have a unique link or address included in any of the content data fields allowing identification of an address at which the desired content may be accessed. Examples of uniform resource locator schemes are http or ftp.
However, the URL could be used in the playlist, and the content itself could be embedded in this playlist. For example, a video file could be embedded in the playlist. Each of the plurality of content data fields may be adapted to receive a uniform resource locator as content-encoding data addressing a part of a resource, the part containing correlated playback content. For instance, only one particular stream of a multi- stream data source can be addressed by the URL. This means particularly that only the audio track of a video content may be chosen, whereas the visual content is not accessed. Alternatively, only a time interval of content, for instance, the refrain or a particular strophe of a music piece may be accessed by the URL. The opportunity to select only a part of a media piece further enhances the flexibility of the system of the invention.
A preferred embodiment of the playback apparatus of the invention will now be described. This embodiment also applies to the method, the playlist-containing device, the computer-readable medium and the program element.
The playback apparatus may comprise a user interface adapted to enable a user to input content-encoding data in at least one of the content data fields (and/or to input timing information in at least one of the optional time data fields, if provided). Such a user interface may be, for instance, a graphical user interface (GUI) allowing a user to easily edit the playlist interactively on a monitor and to allow editing of the playlist without any special education or knowledge. These and other aspects of the invention are apparent from the non- limiting examples of embodiments to be described hereinafter and will be explained with reference to the accompanying drawings.
BRIEF DESCRIPTION OF THE DRAWINGS In the drawings,
Figs. IA and IB show playlists according to the prior art.
Fig. 2 shows a playlist in accordance with a first embodiment of the invention.
Fig. 3 shows a playlist in accordance with a second embodiment of the invention. Fig. 4 shows a playlist in accordance with a third embodiment of the invention.
Fig. 5 shows a flow chart illustrating a method of generating a playlist in accordance with a preferred embodiment of the invention. Fig. 6 shows a playback apparatus in accordance with a preferred embodiment of the invention.
Fig. 7 shows a playlist in accordance with a fourth embodiment of the invention.
DESCRIPTION OF EMBODIMENTS
The drawings are schematical, and similar or identical elements are denoted by the same reference signs.
A playlist 200 in accordance with a first embodiment of the invention will now be described with reference to Fig. 2. The playlist 200 shown in Fig. 2 is generated in accordance with the method of generating a playlist according to the invention. The playlist 200 is provided for encoding control information which can be supplied to a playback apparatus (not shown) for simultaneously playing back multi-dimensional playback content accessible to a plurality of human senses, namely audio, visual, smell, and touch content. The playlist 200 comprises a header 201 including the name of the playlist
200. The playlist 200 is provided in a table-like structure having rows or playback portions 202 (see first playback portion 202a, second playback portion 202b, third playback portion 202c, etc.) indicating an ordered sequence of different items of playback content, in particular defining a chronology of playing back or rendering playback content. Each playback portion 202 is provided with a plurality of content data fields 203 to 206, and a time data field 207.
An audio content data field 203 (comprising a first audio content item 203a, a second audio content item 203b, a third audio content item 203c, etc.) is related to acoustic content data, a visual content data field 204 (comprising a first visual content item 204a, a second visual content item 204b, a third visual content item 204c, etc.) is related to optical content data, a smell content data field 205 (comprising a first smell content item 205a, a second smell content item 205b, a third smell content item 204c, etc.) is related to olfactory content data, and a touch content data field 206 (comprising a first touch content item 206a, a second touch content item 206b, a third touch content item 206c, etc.) is related to a tactile content to be played back. Thus, each content data field 203 to 206 is designated to receive content-encoding data encoding playback content which is accessible to a respective human sense when the playback content is played back. However, not all of the content data fields 203 to 206 are filled with content-encoding data. For instance, the second visual content data item 204b assigned to the second playback portion 202b (item No. 02) is empty. Each time data field 207 (comprising a first time data item 207a, a second time data item 207b, a third time data item 207c, etc., provided for each playback portion 202) is designated to receive timing information indicating a time of simultaneously playing back or rendering content in accordance with content-encoding data received in a part of the content data fields 203 to 206 of the respective playback portion 202. The user-defined playlist 200, shown in Fig. 2, has the following properties.
The audio from an mρ3-file can be played back simultaneously with a video from an avi-file, as shown in row 202a, the first audio content item 203 a and the first visual content item 204a. From the time interval shown in the first time data item 207a, it can be seen that only a particular time interval of both the first audio content item 203a and the first visual content item 204a is set to be played back.
The user can further use only the audio from a video file and play another video file along with it, as shown in the third playback portion 202c.
The user can also use the audio from an avi-file and play it with a slide show, as shown in item 04, i.e. the fourth playback portion 202d. Each list item can also be linked to other sensory items like a smell or a touch output. An example is given in item 03, or the third playback portion 202c, in which a smell of roses is output when the song "Falling in Love.avi" is played, and also a gentle breeze as a touch output.
A playlist 300 in accordance with a second embodiment of the invention will now be described with reference to Fig. 3.
The playlist 300 differs from the playlist 200 in that a special-effect content data field 301 (comprising a first special-effect content item 301a, a second special-effect content item 301b, etc.) is provided, in which a special effect like a light show or fireworks can be combined with content from any one of the content data fields 203 to 206. Furthermore, a separate time data field is provided for each content data field 203 to 206, 301 separately, in contrast to a common time data field 207 related to a complete playback portion 202, as in the case of Fig. 2. A separate time field 207 to 211 for each content data field 203 to 206, 301, further enhances flexibility, because even sophisticated time sequences can be included in the playlist 300. The playlist 300 structure of Fig. 3 shows that each playback portion 202 in the playlist 300 is constituted by several editable fields 203 to 21 1, 301. These name fields 203 to 206, 301 contain a uniform resource locator (URL) of the appropriate field item, and corresponding time fields 207 to 21 1 can be used in a number of ways. The time fields 207 to 211 may be used to indicate the playback time interval (start time and end time) for this URL item or may be used to indicate a delay, i.e. the time interval in which the URL should be played.
If no URL is present in the name fields 203 to 206, 301, the particular field will be ignored by a playback apparatus in which the playlist 300 is incorporated. If a URL is present, but no time data in respective time fields 207 to 211 is specified, this URL will be played from the start of playback of the current playlist item.
A playlist 400 in accordance with a third embodiment of the invention will now be described with reference to Fig. 4.
The structure of the playlist 400 is very similar to that of the playlist 300, but includes a plurality of particular contents in the fields 203 to 211, 301.
The playlist 400 consists of six playlist items 202, namely items 202a to 202f, each containing five editable fields, namely an audio channel field 203, a video channel field 204, a sensory channel field 206, an olfactory channel field 205 and an effects channel field 301. Each field 203 to 206, 301 may contain a link to an appropriate item and also a start time data and an end time data for playing back a particular item, defined in a respective time field 207 to 211.
As can be seen in Fig. 4 for the first playlist item 1 (i.e. first playback portion 202a), the audio from the song "I'm a want you.mp3" is played, and the whole song is played because there is no time specified in the corresponding time field 208, i.e. the first time data item 208a, related to the audio content data field 203. While this audio is played, the video from the video file "Mr. Bean goes to town.avi" is played. The video is played back from 3:00 minutes to 6:00 minutes of the video in accordance with the first video channel time field 209a. Since there are no URLs in the sensory field 206 and in the olfactory field 205, they are ignored. Simultaneously with the audio and video, there is a special effect "Red lights" mentioned in the effects channel field 301. Since there is no time mentioned in the first special-effect time field 207a, for the whole duration of the song, the red lights will be switched on.
For playlist item 3 (third playback portion 202c), the audio is played from the video file "Falling in love.avi", and the 4:34 minutes of audio are played back from the start of the video file, as indicated by the corresponding third video channel time field. Simultaneously, the first 4:34 minutes of the video are played back from the video file "Janes Birthday.avi". Simultaneously with the audio and video, a gentle breeze is played back for one minute, as shown by the URL in the sensory channel 206. Also as indicated by the olfactory field 205, a smell of roses is simulated for the whole duration of the song.
A method of generating a playlist according to the invention will now be described with reference to Fig. 5.
Fig. 5 shows a flow chart 500 indicating steps of a method for creating a playlist. A step 501 indicates the creation of a new playlist. For each item n=l, 2, ... in the playlist, a step 502 is performed, i.e. for any one of the playlist portions 202 (202a, 202b, 202c, etc.). If present, in a step 503, a URL for the audio field is selected, and in a step 504, a playback time is set (a start time and an end time or a delay time interval). If applicable, a URL for the video field is selected in a step 505, and in a step 506, the playback time for the video is set. If applicable, in a step 507, sensory output information is selected, and in a step 508, the time is set at which the information is to played back and the duration of playback. If required, in a step 509, olfactory output information is selected, and in a step 510, the time interval for playback is set. If there is one or more additional effect to be set for this item, in a step 511, corresponding information is inserted, and in a step 512, the playback time interval is included. If there are more items to be inserted in the playlist (such as information to display textual information like lyrics or subtitles), in a step 513, such additional items may be inserted. The method stops in step 514.
A playback apparatus 600 in accordance with a preferred embodiment of the invention will now be described with reference to Fig. 6. The playback apparatus 600 comprises a playlist unit 620 and a playback unit
630.
The playlist unit 620 comprises a playlist 601 (like one of the playlists 200, 300, 400) providing an ordered sequence of a plurality of playlist items defining a chronology of playing back playback content by the playback unit 630. The playback unit 630 is provided and adapted to simultaneously play back playback content accessible to a plurality of human senses according to the playlist 601.
A user may introduce, via a graphical user interface 616, a playlist 601 stored in a storage medium 615, which is a hard disk of a computer in this case. Furthermore, the playback apparatus 600 comprises a microprocessor 603, which is provided and adapted to control decoding of audio information by means of an audio decoder 605, decoding of video information by means of a video decoder 607, processing of sensory information by means of a sensory processor 609, processing of olfactory information by means of an olfactory processor 611, and/or processing of other additional effects information by means of an effect processor 613.
The audio decoder 605 is coupled to an audio renderer 606 of the playback unit 630, which audio renderer 606 plays back audio information as decoded by the audio decoder 605. The video decoder 607 is coupled to a video renderer 608 of the playback unit 630 and is capable of recording video information in accordance with the decoded video. The sensory processor 609 is coupled to a sensory renderer 610 of the playback unit 630 and is capable of playing back sensory information as processed by the sensory processor 609. The olfactory processor 611 is coupled to an olfactory renderer 612 of the playback unit 630 and is capable of producing olfactory effects in accordance with the output of the olfactory processor 611. Furthermore, an effects renderer 614 of the playback unit 630 may produce effects in accordance with an output of the effects processor 613.
In the playback apparatus 600, the playlist 601 is stored on a storage medium 615, namely a hard disk or any other memory medium, for instance, a memory card, flash card, USB-stick, CD-ROM, DVD, etc. For any item in the playlist 601, the microprocessor 603 starts separate threads to concurrently process the various URLs. If there is a URL in the audio field, the microprocessor 603 decodes the audio information present in this URL in the audio decoder 605. This involves fetching the audio source which could be on the same medium as the playlist 601, or on another medium. The audio information is decoded by the audio decoder 605. Alternatively, the audio information can also be decoded by the processor 603. The decoded audio data is sent to the audio renderer 606 for playback. Depending on the specified audio playback times, this audio is played back by the playback unit 603 via loudspeakers, headphones, or the like.
Simultaneously, while the audio is decoded, the video processing thread decodes the video information by the video decoder 607, if video information is present in the respective playback portion of the playlist 601. If there is a URL corresponding to the video channel, this URL is fetched and decoded by the processor 603 or by a separate video processor 607 (as in the case shown in Fig. 6) and then sent to the video renderer 608 for playback at an appropriate time as specified in the video playback time interval, using, for instance, a monitor or any other screen or display. Simultaneously, the sensory information processing thread processes the sensory information present in the playlist 601. If there is a URL corresponding to this sensory information, this URL is decoded by the processor 603 which in turn sends it to the sensory Tenderer 610 for playback of the sensory information at the appropriate time as specified in the playback time interval of the sensory field.
Simultaneously, the olfactory information processing thread decodes the URL corresponding to the olfactory information present in the playlist 601. If there is a URL, this URL is decoded by the sensory processor 609, or alternatively by the processor 603, and then sent to the appropriate olfactory renderer 612 for playback at the appropriate time as specified in the playback time interval of the olfactory field. Processing of olfactory information may be based on a scent-emitting device and method as disclosed in US 2001/0,048,641 : "Scent-emitting device", the disclosure of which is herein incorporated by reference.
Similarly, one or more additional effects may be processed in separate threads corresponding to this information and then sent to the respective effects renderer 614 for playback at the appropriate time interval.
Although only one processor 603 is shown in the current embodiment of Fig. 6, the system may comprise one or more of such processors or specialized processors such as a separate audio decoder or video decoder and/or one or more special processors for decoding and playback of the other effects information. Also, the URLs in the playlist 601 are not limited to being present on the same medium. There may be a link to data on another medium such as a network computer or a PDA ("personal digital assistant") or a mobile phone or the like, whose data can be accessed by the system.
A playlist 700 in accordance with a fourth embodiment of the invention will now be described with reference to Fig. 7.
The playlist 700 shows that, for a particular playlist portion 202, the corresponding information according to audio content 203, visual content 204 and smell content 205 is played simultaneously (see simultaneously played content 701). The chronology of the playback is defined by a direction of play 702 in accordance with which the different playback portions 202 are played back one after the other. Thus, the invention provides a multi-dimensional playlist. Each item in the playlist 700 may comprise separate audio, video, olfactory, sensory channels, etc. When a user plays back an item in the playlist, it actually plays back all the elements of the content data fields of a playback portion simultaneously and not only one of them. It should be noted that the protective scope of the invention is not limited to the embodiments described. Any reference sign placed between parentheses shall not be construed as limiting the claim. Use of the verb "comprise" and its conjugations does not exclude the presence of elements or steps other than those stated in the claims. Use of the article "a" or "an" preceding an element or step does not exclude the presence of a plurality of such elements or steps.

Claims

1. A method of generating a playlist (200) for encoding control information for simultaneously playing back a playback content accessible to a plurality of human senses, the method comprising the steps of providing an ordered sequence of at least two playback portions (202) defining a chronology of playing back playback content; providing each of the at least two playback portions (202) with a plurality of content data fields (203 to 206, 301); wherein each content data field (203 to 206, 301) is designated to receive content-encoding data encoding playback content which is accessible to a respective human sense when the playback content is played back.
2. The method as claimed in claim 1, wherein different content data fields (203 to 206, 301) of a respective playback portion (202) are designated to receive content-encoding data encoding playback content which is accessible to different human senses when the playback content is played back.
3. The method as claimed in claim 1, wherein at least two of the plurality of content data fields (203 to 206, 301) receive content- encoding data encoding playback content which is accessible to at least two different human senses.
4. The method as claimed in claim 1, wherein at least one of the plurality of content data fields (203 to 206, 301) is one of the group consisting of an audio content field (203), a visual content field (204), a tactile content field (206), an olfactory content field (205), and a taste-related content field.
5. The method as claimed in claim 1, wherein at least one of the plurality of content data fields (203 to 206, 301) receives content- encoding data encoding playback content which is accessible to one of the human senses of the group consisting of a tactile sense, an olfactory sense, and a taste-related sense.
6. The method as claimed in claim 1, wherein at least one of the plurality of content data fields (301) is related to a special effect.
7. The method as claimed in claim 6, wherein the special effect is a light show or fireworks.
8. The method as claimed in claim 1, wherein each of the at least two playback portions (202) is provided with a time data field (207 to 21 1), each time data field (207 to 211) being designated to receive timing information indicating a time of simultaneously playing back content in accordance with content- encoding data received in at least a part of the plurality of content data fields (203 to 206, 301) of the respective playback portion (202).
9. The method as claimed in claim 1, wherein the playlist (200) is generated as an electronic schedule comprising rows and columns, the rows constituting the playback portions (202) and the columns constituting the content data fields (203 to 206, 301) and the time data fields (207 to 211).
10. The method as claimed in claim 1, wherein each playback portion (202) is provided with a plurality of time data fields (207 to 211), each time data field (207 to 21 1) being assigned to a respective one of the content data fields (203 to 206, 301) and indicating a time at which the content in accordance with the assigned content data field (203 to 206, 301) is played back.
11. The method as claimed in claim 1, wherein each of the plurality of content data fields (203 to 206, 301) is adapted to receive a uniform resource locator as content-encoding data addressing a resource containing correlated playback content.
12. The method as claimed in claim 1, wherein each of the plurality of content data fields (203 to 206, 301) is adapted to receive a uniform resource locator as content-encoding data addressing a part of a resource, the part containing correlated playback content.
13. A playlist-containing device (620), wherein a playlist (200) of the playlist- containing device (620) encodes control information for simultaneously playing back a playback content accessible to a plurality of human senses, the device (620) comprising a processor (603) adapted to carry out the following method steps: providing an ordered sequence of at least two playback portions (202) defining a chronology of playing back playback content; providing each of the at least two playback portions (202) with a plurality of content data fields (203 to 206, 301); wherein each content data field (203 to 206, 301) is designated to receive content-encoding data encoding playback content which is accessible to a respective human sense when the playback content is played back.
14. A playback apparatus (600), comprising a playlist unit (620) and a playback unit (630); wherein the playlist unit (620) comprises a playlist (601) providing an ordered sequence of at least two playback portions (202) defining a chronology of playing back playback content by the playback unit (630); each of the at least two playback portions (202) is provided with a plurality of content data fields (203 to 206, 301); each content data field (203 to 206, 301) is designated to receive content- encoding data encoding playback content which is accessible to a respective human sense when the playback content is played back by the playback unit (630); the playback unit (630) is adapted to simultaneously play back playback content accessible to a plurality of human senses according to the playlist (601).
15. The playback apparatus (600) as claimed in claim 14, comprising a user interface (616) adapted to enable a user to input content-encoding data in at least one of the content data fields (203 to 206, 301).
16. A computer-readable medium (615), in which a computer program is stored for generating a playlist for encoding control information for simultaneously playing back a playback content accessible to a plurality of human senses, which program, when being executed by a processor (603), is adapted to carry out the following method steps: providing an ordered sequence of at least two playback portions (202) defining a chronology of playing back playback content; providing each of the at least two playback portions (202) with a plurality of content data fields (203 to 206, 301); wherein each content data field (203 to 206, 301) is designated to receive content-encoding data encoding playback content which is accessible to a respective human sense when the playback content is played back.
17. A program element for generating a playlist (601) for encoding control information for simultaneously playing back a playback content accessible to a plurality of human senses, which program element, when being executed by a processor (603), is adapted to carry out the following method steps: providing an ordered sequence of at least two playback portions (202) defining a chronology of playing back playback content; providing each of the at least two playback portions (202) with a plurality of content data fields (203 to 206, 301); wherein each content data field (203 to 206, 301) is designated to receive content-encoding data encoding playback content which is accessible to a respective human sense when the playback content is played back.
PCT/IB2005/053187 2004-09-30 2005-09-27 Method of generating a playlist, playlist-containing device and playback apparatus Ceased WO2006035399A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP04104810 2004-09-30
EP04104810.9 2004-09-30

Publications (1)

Publication Number Publication Date
WO2006035399A1 true WO2006035399A1 (en) 2006-04-06

Family

ID=35519954

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2005/053187 Ceased WO2006035399A1 (en) 2004-09-30 2005-09-27 Method of generating a playlist, playlist-containing device and playback apparatus

Country Status (1)

Country Link
WO (1) WO2006035399A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8725740B2 (en) 2008-03-24 2014-05-13 Napo Enterprises, Llc Active playlist having dynamic media item groups

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6301845B1 (en) * 1998-11-02 2001-10-16 Cyrus Milanian Amusement and virtual reality ride
GB2380908A (en) * 2000-11-21 2003-04-16 Nec Corp Sounding music accompanied by vibration, for eg a phone terminal

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6301845B1 (en) * 1998-11-02 2001-10-16 Cyrus Milanian Amusement and virtual reality ride
GB2380908A (en) * 2000-11-21 2003-04-16 Nec Corp Sounding music accompanied by vibration, for eg a phone terminal

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
APPLE: "final cut pro tutorial", June 2003, XP002315960 *
AVSTUMPFL: "Wings Platinum 2 : Production and Presentation of Multi-Media Shows and Show Control Application", WWW.AVSTUMPFL.COM, 24 September 2004 (2004-09-24), XP002363050, Retrieved from the Internet <URL:http://www.avstumpfl.com> [retrieved on 20060113] *
ORATRIX: "GRiNS Pro Editor for SMIL 2.0 : Quick Start Guide", WWW.ORATRIX.COM, March 2002 (2002-03-01), XP002320100 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8725740B2 (en) 2008-03-24 2014-05-13 Napo Enterprises, Llc Active playlist having dynamic media item groups

Similar Documents

Publication Publication Date Title
US6395969B1 (en) System and method for artistically integrating music and visual effects
US8644677B2 (en) Network media player having a user-generated playback control record
US20100082727A1 (en) Social network-driven media player system and method
US20100083307A1 (en) Media player with networked playback control and advertisement insertion
KR20080095928A (en) How to create, edit, and play multi-object audio content files for object-based audio services, and how to create audio presets
KR20060131981A (en) How to create content items with specific emotional impacts on users
US8522301B2 (en) System and method for varying content according to a playback control record that defines an overlay
CN1843033A (en) User profile controls reproduction of content information
KR20050092383A (en) Information transmission method and device, information recording or reproduction method and device, and recording medium
Turk Transformation in a New Key: music in vids and vidding
US20080259745A1 (en) Document Recording Medium, Recording Apparatus, Recording Method, Data Output Apparatus, Data Output Method and Data Delivery/Distribution System
US9426524B2 (en) Media player with networked playback control and advertisement insertion
JP6344379B2 (en) Information processing apparatus and information processing method
Beggs et al. Designing web audio
WO2006035399A1 (en) Method of generating a playlist, playlist-containing device and playback apparatus
Case Mix smart: Professional techniques for the home studio
US20130209066A1 (en) Social network-driven media player system and method
Naef et al. Creating custom immersive 360-degree videos for use in clinical and nonclinical settings: Tutorial
Glennon Consumer, Producer, Creator: The mixtape as creative form
US6522863B2 (en) Multiple listening training device and a multiple listening training recording medium
JP2023070353A (en) Video playback device, video playback method, and video playback program
JP4382045B2 (en) DATA OUTPUT DEVICE, DATA OUTPUT METHOD, DATA OUTPUT PROGRAM, AND RECORDING MEDIUM
Jung Traveling Sounds, Embodied Responses: Aesthetic Reflections on TikTok
McElhearn et al. Podcasting Pocket Guide
KR20130092692A (en) Method and computer readable recording medium for making electronic book which can be realized by user voice

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KR KZ LC LK LR LS LT LU LV LY MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 05798938

Country of ref document: EP

Kind code of ref document: A1