WO2014033357A1 - Multitrack media creation - Google Patents
Multitrack media creation Download PDFInfo
- Publication number
- WO2014033357A1 WO2014033357A1 PCT/FI2012/050849 FI2012050849W WO2014033357A1 WO 2014033357 A1 WO2014033357 A1 WO 2014033357A1 FI 2012050849 W FI2012050849 W FI 2012050849W WO 2014033357 A1 WO2014033357 A1 WO 2014033357A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- multitrack
- track
- media
- recording
- computer program
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
- H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
- H04N9/8227—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal the additional signal being at least another television signal
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B27/34—Indicating arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
Definitions
- the present application relates generally to a method and an arrangement for creating multitrack media.
- Media remixing is an application where multiple media recordings are combined in order to obtain a media mix that contains some segments selected from the plurality of media recordings.
- Video remixing is one of the basic manual video editing applications, for which various software products and services are already available. Some automatic video remixing systems depend only on the recorded content, while others are capable of utilizing environmental context data that is recorded together with the video content.
- the context data may be, for example, sensor data received from a compass, an accelerometer, or a gyroscope, and/or global positioning system (GPS) location data.
- GPS global positioning system
- Multitrack video is a single video comprising multiple parallel tracks that has been created by adding video data to different tracks in a video editor.
- the video clips have been time aligned and the video modes and audio effects have been adjusted so that transition between the different tracks are possible. Summary
- a method comprises recording media by an electronic device; determining a primary track of the recording, which primary track indicates the main content; determining one or more secondary tracks, wherein each of the secondary tracks will contain a selected content of the recording; creating a multitrack media of said primary track and said one or more secondary tracks in said electronic device, and transmitting said multitrack media to a remixing server in order to receive a multitrack presentation.
- an apparatus comprises a processor configured to record media by said apparatus; determine a primary track of the recording, which primary track indicates the main content; determine one or more secondary tracks, wherein each of the secondary tracks will contain a selected content of the recording; create a multitrack media of said primary track and said one or more secondary tracks in said apparatus, and to transmit said multitrack media to a remixing server in order to receive a multitrack presentation.
- an apparatus comprises at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following: to record media by said apparatus; determine a primary track of the recording, which primary track indicates the main content; determine one or more secondary tracks, wherein each of the secondary tracks will contain a selected content of the recording; create a multitrack media of said primary track and said one or more secondary tracks in said apparatus, and to transmit said multitrack media to a remixing server is order to receive a multitrack presentation.
- a computer program comprises code for recording media by an electronic device; code for determining a primary track of the recording, which primary track indicates the main content; code for determining one or more secondary tracks, wherein each of the secondary tracks will contain a selected content of the recording; code for creating a multitrack media of said primary track and said one or more secondary tracksin said electronic device, and code for transmitting said multitrack media to a remixing server in order to receive a multitrack presentation.
- a computer-readable medium encoded with instructions that, when executed by a computer, perform: recording media by an electronic device; determining a primary track of the recording, which primary track indicates the main content; determining one or more secondary tracks, wherein each of the secondary tracks will contain a selected content of the recording; creating a multitrack media of said primary track and said one or more secondary tracks in said electronic device, and to transmitting said multitrack media to a remixing server in order to receive a multitrack presentation.
- a server comprises at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following: to receive a multitrack media from an electronic device; said multitrack media comprising primary track indicating the main content and one or more secondary tracks containing selected parts of the recording; to create a multitrack presentation of the received multitrack media and to send the multitrack presentation to said electronic device.
- the multitrack presentation is viewed in the electronic device.
- the primary track is determined automatically.
- the primary track is determined by means of at least one of the following information: direction of the audio, an event type.
- automatically determined primary track is adjusted manually.
- the primary track is determined manually.
- a default number of secondary tracks is determined.
- a content of the recording is placed to a correct track of the one or more secondary tracks by means of a user input.
- a content of the recording is placed to a correct track of the one or more secondary tracks by means of sensor data.
- the sensor data relates to at least one of the following: panning measures, angle of panning, acceleration, orientation.
- a track containing metadata for the tracks is added in the multitrack media.
- the apparatus is a mobile device.
- the computer program is a computer program product comprising a computer-readable medium bearing computer program code embodied therein for use with a computer.
- Figure 1 illustrates an embodiment of an arrangement for media remixing service
- Figure 2 illustrates an embodiment of an electronic device
- Figure 3 illustrates an embodiment of a server
- Figure 4 illustrates an embodiment of a client software for creating multitrack media
- Figure 5 illustrates a flowchart according to an embodiment of a method for creating multiltrack media
- Figure 6 illustrates an example of a primary track.
- the present embodiments provide a solution to create a multitrack presentation of the recorded multitrack media for the device.
- This multitrack media can then be viewed by users, who are able to switch from a first view to a different view and to see the content of the selected view.
- the embodiments provide a framework that allow capture of multitrack (i.e. multiview) media using sensor data.
- the media content to be used in media remixing services may comprise at least video content including 3D video content, still images (i.e. pictures), and audio content including multi-channel audio content.
- video content including 3D video content, still images (i.e. pictures), and audio content including multi-channel audio content.
- the embodiments disclosed herein are mainly described from the viewpoint of creating a video remix from video and audio content of source videos, but the embodiments are not limited to video and audio content of source videos, but they can be applied generally to any type of media content.
- Figure 1 shows a system and devices according to an embodiment.
- the different devices may be connected via a fixed network 210 such as the Internet or a local area network; or a mobile communication network 220 such as the Global System for Mobile communications (GSM) network, 3rd Generation (3G) network, 3.5th Generation (3.5G) network, 4th Generation (4G) network, Wireless Local Area Network (WLAN), Bluetooth®, or other contemporary and future networks.
- GSM Global System for Mobile communications
- 3G 3rd Generation
- 3.5G 3.5th Generation
- 4G 4th Generation
- WLAN Wireless Local Area Network
- Bluetooth® Wireless Local Area Network
- the networks comprise network elements such as routers and switches to handle data (not shown), and communication interfaces such as the base stations 230 and 231 in order for providing access for the different devices to the network, and the base stations 230, 231 are themselves connected to the mobile network 220 via a fixed connection 276 or a wireless connection 277.
- servers 240, 241 and 242 each connected to the mobile network 220, which servers may be arranged to operate as computing nodes (i.e. to form a cluster of computing nodes or a so-called server farm) for the automatic video remixing service.
- Some of the above devices for example the computers 240, 241 , 242 may be such that they are arranged to make up a connection to the Internet with the communication elements residing in the fixed network 210.
- the various devices may be connected to the networks 210 and 220 via communication connections such as a fixed connection 270, 271 , 272 and 280 to the internet, a wireless connection 273 to the internet 210, a fixed connection 275 to the mobile network 220, and a wireless connection 278, 279 and 282 to the mobile network 220.
- the connections 271 -282 are implemented by means of communication interfaces at the respective ends of the communication connection.
- Figures 2 and 3 show devices for video remixing according to an example embodiment.
- the server 240 contains memory 245, one or more processors 246, 247, and computer program code 248 residing in the memory 245 for implementing, for example, video remixing.
- the different servers 241 , 242 of Fig. 1 may contain at least these elements for employing functionality relevant to each server.
- the apparatus 151 shown in Figure 2 contains memory 152, at least one processor 153 and 156, and computer program code 154 residing in the memory 152 (such as a client software according to Fig. 4).
- the apparatus may also have one or more cameras 155 and 159 for capturing image data, for example stereo video.
- the apparatus may also contain one, two or more microphones 157 and 158 for capturing sound.
- the apparatus may also contain sensor for generating sensor data relating to the apparatus' relationship to the surroundings.
- the apparatus may also comprise a display 160 for viewing single-view, stereoscopic (2-view) or multiview (more-than-2- view) images.
- the display 160 may be extended at least partly on the back cover of the apparatus.
- the apparatus 151 may also comprise an interface means (e.g.
- the apparatus may also be connected to another device e.g. by means of a communication block (not shown in Fig. 1 ) able to receive and/or transmit information.
- the elements of the automatic video remixing process may be implemented as a software component residing on one device or distributed across several devices, for example so that the devices form a so-called cloud.
- a video remix can be created in the remixing server according to the preferences of a user.
- the source content refers to all types of media that is captured by users, wherein the source content may involve any associated context data.
- videos, images, audio captured by users may be provided with context data, such as information from various sensors, such as from a compass, an accelerometer, a gyroscope, or information indicating location, altitude, temperature, illumination, pressure, etc.
- a particular sub-type of source content is a source video, which refers to videos captured by the user, possibly provided with the above-mentioned context information. Any user can request from the video remix service a created video remix version from the material available for the service about an event, such as a concert.
- the electronic device relates to to any portable electronic device, such as the one shown in Figure 2: a mobile phone, a mobile terminal, a mobile device, a smartphone, a tablet computer, a personal digital assistant, a digital camera, a digital video camera etc.
- the electronic device may comprise or be connected to media recording means, such as a camera, a video camera, an audio recorder, or their combination.
- the electronic device may also comprise or be connected to one or more sensors being capable of measuring one or more of the following group: panning, angle of panning, acceleration, orientation that further may comprise gyroscope reading and/or compass reading, and providing corresponding sensor data to the electronic device.
- the electronic device may also be capable of connecting to internet via wireless or wired network. It is also appreciated that the following disclosure uses video as an example of media being recorded. However, any other type of media (still image, audio) can also be utilized.
- This application discloses embodiments for creating in the electronic device multiple tracks (i.e. multitrack) for video, or other media, being recorded by means of said electronic device recording an event.
- Each track being created may depend on user input and/or sensor data collected from the electronic device.
- the multitrack creation is based on a primary track (i.e. primary view, front view), which is the view the user perceives to have the most significant content, i.e. the main content.
- the primary view can be determined automatically by the device or manually by the user. In concert, the stage can be the primary view. In party, the primary view can be more distributed and can have equal distribution compared to other views.
- the primary view selection gives media applications important data on how the video data should be processed. For example, primary view selection indicates the selective preferences for certain tracks.
- primary view may include more personalized content than other tracks.
- the primary view can also be used as a default view, when multitrack video is viewed.
- the multitrack is sent from a client (i.e. the electronic device) to the remixing server the primary track content is to be given most importance when constructing the multitrack in the server.
- Multitrack will be constructed in the remixing server from the multitrack captured by the user but the remixing server will also use content captured by other users.
- the remixing server is capable of including more content from primary track as well as assign this primary track as default track in the remix construction (example, capturing the stage side in concert can be primary track).
- the multitrack creation process begins with a device recording an event. After a certain time (0-N seconds), the recording device is configured to make an estimate of the primary view along with the view angle and span of the view. The estimation is shown on a recording screen of the device to the user.
- the user interface shows the start point and the end point for the primary view to the user.
- the start point and the end point concern spatial locations in the view.
- the points can be indicated by circles, one of which is placed on left side (from user's perspective) of the screen and the other one is place on right side of the screen. An example is shown in Figure 6. These two points indicate the span of the primary view. Instead of the points also a line, a rectangle or any other visual indication can be drawn on to the screen to indicate the primary view.
- the user is able to change the location(s) of the visual indication(s) by touching the screen where the visual indication is shown and moving the indication on the screen.
- the user may also pan the camera and/or increase or decrease the view angle and span. If there is no input from the user, the primary view is deemed confirmed. However, the user may modify the primary view anytime later.
- the electronic device may use additional information such as audio intensity coming from a particular direction. Such additional information may reinforce the initial estimation of the primary track. In cases where audio direction and intensity cannot be computed accurately, this feature may simply be ignored.
- Another source for determining a primary track is event place information directly available through maps. Primary views that has be determined in such a manner may act as initial default views, which - however - can be changed by the user according to user's preferences.
- the electronic device is configured to monitor orientation data received from a magnetometer. If the orientation data goes beyond the designated primary cues (i.e. visual indication indicating the primary view), then a pan to the left of the device (from user's perspective) creates a left view (i.e. left track, left channel), a pan to the right of the device creates a right view (i.e. right track, right channel), a pan to above creates a top view (i.e. top track, top channel) and a pan to below creates a bottom view (i.e. bottom track, bottom channel). These tracks are called secondary tracks.
- the user is capable of creating new views (i.e. tracks) and name them appropriately during or prior to the recording.
- new views i.e. tracks
- the track name is given as a property to the created track.
- the views are static, which means that the orientation and location for that track will remain the same. For example, in a concert, the audience position remains the same. Similarly, in a football event, the audience position remains the same.
- the user creates a new track (i.e. view) for certain target content, every time the user pans to that area again, the area is detected and the track is selected as default.
- the available tracks are shown on the screen as selectable thumbnails. Then the user may pan to an area, select one of the available tracks and then continue recording. Due to this, the recorded content is added to the selected track.
- the user can add other properties to the created tracks. For example, if not already designated, the user can designate the track "static" in the properties of the track. So whenever the user pans to the area corresponding to the track, the content within that area is added to this track. The user may also designate a track as "dynamic object" in the properties of the track. This means that the objects within such track are given importance rather than the location. Therefore, whenever selected objects are encountered in video, the system is capable of including such videos to the appropriate track. This is carried out by object recognition within the track. If a conflict occurs between two or more tracks, the system may engage conflict resolution heuristics, e.g. probability measure to a particular track. Instead, the system may also ask user to solve the conflict.
- conflict resolution heuristics e.g. probability measure to a particular track. Instead, the system may also ask user to solve the conflict.
- the property selection of static or dynamic may be a way to indicate that the track properties are locked in case of "static” (static means that if sensor data match a static track, then video is added to that track) or unlocked in case of “dynamic” one. There can be other means as well such as default being static, indicating static via a "lock” track mode etc.
- the number of tracks being created is determined according to the type of the event and/or by the user. For example, if the event is a concert, the stage forms the primary tag, the audience may form an audience track and the concert screen may form an own track. Then three tracks may be enough. In an Olympic game, there can be as many tracks as there are competitions going on the sports field plus the audience track.
- Each event may have a default number of tracks that would be primarily created for the event. Event type determination may happen either through a user input, through event database, map information or through event determination algorithms such as concert detection through audio. Once event type is determined, number of tracks is created as default. The user may, however, remove or add tracks to the default amount of tracks.
- the electronic device will try to determine positions for each track from user capture and/or user input, and assign segments for those tracks. For certain events, such as personal parties, track designation is more at semantic level than structural and depends on the user in order to create the tracks.
- the system may be capable on assisting the user by providing certain templates for creating the tracks.
- a birthday party template may comprise three tracks as default: 1 ) primary track for capturing the person being celebrated; 2) family and friends track; 3) track for party activities. These can be - however - modified later on.
- the electronic device may use historical data received from previous users via the remixing server, which previous users have used the remixing service before. There the primary tracks have been provided corresponding to the location of an arena for example. Such designated primary and other tracks may provide an initial estimation for primary track for the user. But also in this case, the user can modify the primary track to satisfy his/her own preferences.
- Figure 4 illustrates an example of a client software 200 performing the multitrack creation in the electronic device.
- the client software operates with a video recorder 201 of the device and/or one or more other media recorders for capturing media.
- the client software also comprises a user interface manager 202 for managing and controlling various actions occurring on the user interface and relating to the multitrack recording or multitrack control.
- the client software may be configured to receive sensor data 203 from one or more sensors of the electronic device.
- the client software may comprise means for recognizing semantic objects 204. Such recognition means 204 may communicate with semantic query module 205 to receive e.g. user input for e. track designation and object recognition via communication module 206.
- Track manager 207 is configured to control the tracks being recorded. For example track designation can be performed by the track manager.
- the track manager 207 is able to store recognized objects to user object database 208.
- the device also comprise track codecs 209 and multiview track builder 210 which cooperatively create the multiview presentation of the tracks being recorded and stored in a track database 21 1 .
- Multitrack codecs have been disclosed in lETF-standards. Such multitrack codecs are configured to encode multiple tracks so that they are presented in multiplexed manner in the multiview media. Alternatively, in addition to a such multiplexed representation, each track can be separately represented, either on a same view, or on different views, whereby a single track can be quickly extracted from the presentation.
- a track containing metadata can be inserted to the multitrack media, which metadata provides data about segment insertions, view points, view names, semantic object in segments and semantic information - static view or dynamic objects information on each view.
- the electronic device may form a connection to a server.
- the connection may have been formed also before recording or during the recording.
- the multitracks are sent to the server.
- the server may comprise a remixing service, such as applicant's Director's Cut, that creates a video mix for each track or each view from the track information and track data.
- the server may receive multiple multitracks from a plurality of users, from which reveived multitracks a single multitrack presentation is created.
- the server may create one or more multitracks for each user using different remix criterion such as using different primary tracks or even different tracks while extracting track based content from each submission.
- the remixing service is able to create personalized multiview tracks for the user because the multitracks from the single user are personalized and the end points are specified. So, the multiview video mix created for a certain user will be different from the multiview video mix created for another user because their primary tracks and other views are different or calibrated differently during the media capture. Therefore this will be reflected also in the created video mix.
- the remixing service may also be able to query data regarding only a particular view from the client device. So for sourcing content, not all the views need to be uploaded.
- the electronic device starts recording (510) after which a primary track is determined (520).
- the electronic device may use (525) default primary track and/or user input for determining the primary track.
- the recordings out of the primary track are assigned to secondary tracks (530).
- the electronic device may user sensor data and/or user input (535).
- the electronic device is capable of creating (540) multitrack media of the primary and the secondary tracks.
- These multitracks are sent to a server (550) that is configured to generate multitrack presentation and send the presentation to the electronic device.
- the electronic device may view the presentation.
- the embodiments of the present invention concern a client side multitrack media creator. These embodiments represent a substantial advancement compared to existing solutions, because the multview tracks can be created and viewed in a client apparatus (i.e. an electronic device).
- the multiview creator enables user controlled view for track creation.
- the multiview creator enables personal multitrack view remixing by a server side remixing service.
- Embodiments of the present invention may be implemented in software, hardware, application logic or a combination of software, hardware and application logic.
- the software, application logic and/or hardware may reside on the electronic device.
- the application logic, software or an instruction set is maintained on any one of various conventional computer-readable media.
- a "computer-readable medium" may be any media or means that can contain, store, communicate, propagate or transport the instructions for use by or in connection with an instruction execution system, apparatus, or device, such as a computer, with one example of a computer described and depicted in figure 1 .
- a computer-readable medium may comprise a computer-readable storage medium that may be any media or means that can contain or store the instructions for use by or in connection with an instruction execution system, apparatus, or device, such as a computer.
- the different functions discussed herein may be performed in a different order and/or concurrently with each other. Furthermore, if desired, one or more of the above-described functions may be optional or may be combined.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Television Signal Processing For Recording (AREA)
Description
MULTITRACK MEDIA CREATION
Technical field The present application relates generally to a method and an arrangement for creating multitrack media.
Background Multimedia capturing capabilities have become common features in portable devices. Thus, many people tend to record or capture an event, such as a music concert or a sport event, they are attending.
Media remixing is an application where multiple media recordings are combined in order to obtain a media mix that contains some segments selected from the plurality of media recordings. Video remixing, as such, is one of the basic manual video editing applications, for which various software products and services are already available. Some automatic video remixing systems depend only on the recorded content, while others are capable of utilizing environmental context data that is recorded together with the video content. The context data may be, for example, sensor data received from a compass, an accelerometer, or a gyroscope, and/or global positioning system (GPS) location data.
Some video editing systems are also capable of creating multitrack video. Multitrack video is a single video comprising multiple parallel tracks that has been created by adding video data to different tracks in a video editor. In multitrack video, the video clips have been time aligned and the video modes and audio effects have been adjusted so that transition between the different tracks are possible. Summary
Now there has been invented an improved method and technical equipment implementing the method, by which multiple tracks for media can be captured by a single device to create a multitrack media. Various aspects of the invention include a method, an apparatus and a computer-readable medium comprising a computer program stored therein, which are characterized by what is stated in the independent claims. Various embodiments of the invention are disclosed in the dependent claims.
According to a first aspect of the present invention, a method comprises recording media by an electronic device; determining a primary track of the recording, which primary track indicates the main content; determining one or more secondary tracks, wherein each of the secondary tracks will contain a selected content of the recording; creating a multitrack media of said primary track and said one or more secondary
tracks in said electronic device, and transmitting said multitrack media to a remixing server in order to receive a multitrack presentation.
According to a second aspect of the present invention, an apparatus comprises a processor configured to record media by said apparatus; determine a primary track of the recording, which primary track indicates the main content; determine one or more secondary tracks, wherein each of the secondary tracks will contain a selected content of the recording; create a multitrack media of said primary track and said one or more secondary tracks in said apparatus, and to transmit said multitrack media to a remixing server in order to receive a multitrack presentation.
According to a third aspect of the present invention, an apparatus comprises at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following: to record media by said apparatus; determine a primary track of the recording, which primary track indicates the main content; determine one or more secondary tracks, wherein each of the secondary tracks will contain a selected content of the recording; create a multitrack media of said primary track and said one or more secondary tracks in said apparatus, and to transmit said multitrack media to a remixing server is order to receive a multitrack presentation.
According to a fourth aspect of the present invention, a computer program, comprises code for recording media by an electronic device; code for determining a primary track of the recording, which primary track indicates the main content; code for determining one or more secondary tracks, wherein each of the secondary tracks will contain a selected content of the recording; code for creating a multitrack media of said primary track and said one or more secondary tracksin said electronic device, and code for transmitting said multitrack media to a remixing server in order to receive a multitrack presentation.
According to a fifth aspect of the invention, a computer-readable medium encoded with instructions that, when executed by a computer, perform: recording media by an electronic device; determining a primary track of the recording, which primary track indicates the main content; determining one or more secondary tracks, wherein each of the secondary tracks will contain a selected content of the recording; creating a multitrack media of said primary track and said one or more secondary tracks in said electronic device, and to transmitting said multitrack media to a remixing server in order to receive a multitrack presentation.
According to a sixth aspect of the invention, a server comprises at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following: to receive a
multitrack media from an electronic device; said multitrack media comprising primary track indicating the main content and one or more secondary tracks containing selected parts of the recording; to create a multitrack presentation of the received multitrack media and to send the multitrack presentation to said electronic device.
According to an embodiment, the multitrack presentation is viewed in the electronic device.
According to an embodiment, the primary track is determined automatically.
According to an embodiment, the primary track is determined by means of at least one of the following information: direction of the audio, an event type.
According to an embodiment, automatically determined primary track is adjusted manually.
According to an embodiment, the primary track is determined manually. According to an embodiment, a default number of secondary tracks is determined.
According to an embodiment, a content of the recording is placed to a correct track of the one or more secondary tracks by means of a user input.
According to an embodiment, a content of the recording is placed to a correct track of the one or more secondary tracks by means of sensor data.
According to an embodiment, the sensor data relates to at least one of the following: panning measures, angle of panning, acceleration, orientation. According to an embodiment, a track containing metadata for the tracks is added in the multitrack media.
According to an embodiment, the apparatus is a mobile device. According to an embodiment, the computer program is a computer program product comprising a computer-readable medium bearing computer program code embodied therein for use with a computer.
Description of the Drawings
For a more complete understanding of example embodiments of the present invention, reference is now made to the following descriptions taken in connection with the accompanying drawings in which:
Figure 1 illustrates an embodiment of an arrangement for media remixing service;
Figure 2 illustrates an embodiment of an electronic device;
Figure 3 illustrates an embodiment of a server;
Figure 4 illustrates an embodiment of a client software for creating multitrack media;
Figure 5 illustrates a flowchart according to an embodiment of a method for creating multiltrack media, and
Figure 6 illustrates an example of a primary track.
Detailed Description of the Embodiments
In the following, several embodiments of the invention will be described in the context of capturing multitrack media by a single device. In addition, the present embodiments provide a solution to create a multitrack presentation of the recorded multitrack media for the device. This multitrack media can then be viewed by users, who are able to switch from a first view to a different view and to see the content of the selected view. The embodiments provide a framework that allow capture of multitrack (i.e. multiview) media using sensor data.
As is generally known, many portable devices, such as mobile phones, cameras, and tablets, are provided with high quality cameras, which enable to capture high quality video files and still images. The recorded media content can be transmitted to a specific server configured to perform remixing of such content.
The media content to be used in media remixing services may comprise at least video content including 3D video content, still images (i.e. pictures), and audio content including multi-channel audio content. The embodiments disclosed herein are mainly described from the viewpoint of creating a video remix from video and audio content of source videos, but the embodiments are not limited to video and audio content of source videos, but they can be applied generally to any type of media content.
Figure 1 shows a system and devices according to an embodiment. In Fig. 1 , the different devices may be connected via a fixed network 210 such as the Internet or a local area network; or a mobile communication network 220 such as the Global System for Mobile communications (GSM) network, 3rd Generation (3G) network, 3.5th Generation (3.5G) network, 4th Generation (4G) network, Wireless Local Area Network (WLAN), Bluetooth®, or other contemporary and future networks. Different networks are connected to each other by means of a communication interface 280. The networks comprise network elements such as routers and switches to handle data (not shown), and communication interfaces such as the base stations 230 and 231 in order for providing access for the different devices to the network, and the
base stations 230, 231 are themselves connected to the mobile network 220 via a fixed connection 276 or a wireless connection 277.
There may be a number of servers connected to the network, and in the example of Fig. 1 are shown servers 240, 241 and 242, each connected to the mobile network 220, which servers may be arranged to operate as computing nodes (i.e. to form a cluster of computing nodes or a so-called server farm) for the automatic video remixing service. Some of the above devices, for example the computers 240, 241 , 242 may be such that they are arranged to make up a connection to the Internet with the communication elements residing in the fixed network 210.
There are also a number of end-user devices such as mobile phones and smart phones 251 , Internet access devices (Internet tablets) 250, personal computers 260 of various sizes and formats, televisions and other viewing devices 261 , video decoders and players 262, as well as video cameras 263 and other encoders. These devices 250, 251 , 260, 261 , 262 and 263 can also be made of multiple parts. The various devices may be connected to the networks 210 and 220 via communication connections such as a fixed connection 270, 271 , 272 and 280 to the internet, a wireless connection 273 to the internet 210, a fixed connection 275 to the mobile network 220, and a wireless connection 278, 279 and 282 to the mobile network 220. The connections 271 -282 are implemented by means of communication interfaces at the respective ends of the communication connection.
Figures 2 and 3 show devices for video remixing according to an example embodiment. As shown in Fig. 3, the server 240 contains memory 245, one or more processors 246, 247, and computer program code 248 residing in the memory 245 for implementing, for example, video remixing. The different servers 241 , 242 of Fig. 1 may contain at least these elements for employing functionality relevant to each server.
Similarly, the apparatus 151 shown in Figure 2 contains memory 152, at least one processor 153 and 156, and computer program code 154 residing in the memory 152 (such as a client software according to Fig. 4). The apparatus may also have one or more cameras 155 and 159 for capturing image data, for example stereo video. The apparatus may also contain one, two or more microphones 157 and 158 for capturing sound. The apparatus may also contain sensor for generating sensor data relating to the apparatus' relationship to the surroundings. The apparatus may also comprise a display 160 for viewing single-view, stereoscopic (2-view) or multiview (more-than-2- view) images. The display 160 may be extended at least partly on the back cover of the apparatus. The apparatus 151 may also comprise an interface means (e.g. a user interface) which allows a user to interact with the apparatus. The user interface means may be implemented using the display 160, a keypad 161 , voice control, or other structures. The apparatus may also be connected to another device e.g. by
means of a communication block (not shown in Fig. 1 ) able to receive and/or transmit information.
It needs to be understood that different embodiments allow different parts to be carried out in different elements. The elements of the automatic video remixing process may be implemented as a software component residing on one device or distributed across several devices, for example so that the devices form a so-called cloud. A video remix can be created in the remixing server according to the preferences of a user. The source content refers to all types of media that is captured by users, wherein the source content may involve any associated context data. For example, videos, images, audio captured by users may be provided with context data, such as information from various sensors, such as from a compass, an accelerometer, a gyroscope, or information indicating location, altitude, temperature, illumination, pressure, etc. A particular sub-type of source content is a source video, which refers to videos captured by the user, possibly provided with the above-mentioned context information. Any user can request from the video remix service a created video remix version from the material available for the service about an event, such as a concert.
In the following, term "device" relates to to any portable electronic device, such as the one shown in Figure 2: a mobile phone, a mobile terminal, a mobile device, a smartphone, a tablet computer, a personal digital assistant, a digital camera, a digital video camera etc. The electronic device may comprise or be connected to media recording means, such as a camera, a video camera, an audio recorder, or their combination. The electronic device may also comprise or be connected to one or more sensors being capable of measuring one or more of the following group: panning, angle of panning, acceleration, orientation that further may comprise gyroscope reading and/or compass reading, and providing corresponding sensor data to the electronic device. The electronic device may also be capable of connecting to internet via wireless or wired network. It is also appreciated that the following disclosure uses video as an example of media being recorded. However, any other type of media (still image, audio) can also be utilized.
This application discloses embodiments for creating in the electronic device multiple tracks (i.e. multitrack) for video, or other media, being recorded by means of said electronic device recording an event. Each track being created may depend on user input and/or sensor data collected from the electronic device. The multitrack creation is based on a primary track (i.e. primary view, front view), which is the view the user perceives to have the most significant content, i.e. the main content. The primary view can be determined automatically by the device or manually by the user. In concert, the stage can be the primary view. In party, the primary view can be more
distributed and can have equal distribution compared to other views. The primary view selection gives media applications important data on how the video data should be processed. For example, primary view selection indicates the selective preferences for certain tracks. Therefore, primary view may include more personalized content than other tracks. In addition, it is possible to designate a certain view as the primary view for a particular user. The primary view can also be used as a default view, when multitrack video is viewed. When the multitrack is sent from a client (i.e. the electronic device) to the remixing server the primary track content is to be given most importance when constructing the multitrack in the server. Multitrack will be constructed in the remixing server from the multitrack captured by the user but the remixing server will also use content captured by other users. By designating a track as primary, the user is indicating the importance of the content captured within this track. Therefore the remixing server is capable of including more content from primary track as well as assign this primary track as default track in the remix construction (example, capturing the stage side in concert can be primary track).
The multitrack creation process begins with a device recording an event. After a certain time (0-N seconds), the recording device is configured to make an estimate of the primary view along with the view angle and span of the view. The estimation is shown on a recording screen of the device to the user. The user interface shows the start point and the end point for the primary view to the user. The start point and the end point concern spatial locations in the view. The points can be indicated by circles, one of which is placed on left side (from user's perspective) of the screen and the other one is place on right side of the screen. An example is shown in Figure 6. These two points indicate the span of the primary view. Instead of the points also a line, a rectangle or any other visual indication can be drawn on to the screen to indicate the primary view. The user is able to change the location(s) of the visual indication(s) by touching the screen where the visual indication is shown and moving the indication on the screen. The user may also pan the camera and/or increase or decrease the view angle and span. If there is no input from the user, the primary view is deemed confirmed. However, the user may modify the primary view anytime later.
For determining the primary view, the electronic device may use additional information such as audio intensity coming from a particular direction. Such additional information may reinforce the initial estimation of the primary track. In cases where audio direction and intensity cannot be computed accurately, this feature may simply be ignored. Another source for determining a primary track is event place information directly available through maps. Primary views that has be determined in such a manner may act as initial default views, which - however - can be changed by the user according to user's preferences.
After the primary view has been defined, all the views from then on are computed with respect to the primary view. The electronic device is configured to monitor
orientation data received from a magnetometer. If the orientation data goes beyond the designated primary cues (i.e. visual indication indicating the primary view), then a pan to the left of the device (from user's perspective) creates a left view (i.e. left track, left channel), a pan to the right of the device creates a right view (i.e. right track, right channel), a pan to above creates a top view (i.e. top track, top channel) and a pan to below creates a bottom view (i.e. bottom track, bottom channel). These tracks are called secondary tracks. In addition to these, the user is capable of creating new views (i.e. tracks) and name them appropriately during or prior to the recording. For example, there can be a track called "friends view" containing friends of the user, "family view" containing user's family members, "audience view" containing audience views in an event etc. The track name is given as a property to the created track.
By default, the views are static, which means that the orientation and location for that track will remain the same. For example, in a concert, the audience position remains the same. Similarly, in a football event, the audience position remains the same.
Therefore, when the user creates a new track (i.e. view) for certain target content, every time the user pans to that area again, the area is detected and the track is selected as default. In an additional and optional embodiment, the available tracks are shown on the screen as selectable thumbnails. Then the user may pan to an area, select one of the available tracks and then continue recording. Due to this, the recorded content is added to the selected track.
In addition to track names, the user can add other properties to the created tracks. For example, if not already designated, the user can designate the track "static" in the properties of the track. So whenever the user pans to the area corresponding to the track, the content within that area is added to this track. The user may also designate a track as "dynamic object" in the properties of the track. This means that the objects within such track are given importance rather than the location. Therefore, whenever selected objects are encountered in video, the system is capable of including such videos to the appropriate track. This is carried out by object recognition within the track. If a conflict occurs between two or more tracks, the system may engage conflict resolution heuristics, e.g. probability measure to a particular track. Instead, the system may also ask user to solve the conflict. The property selection of static or dynamic may be a way to indicate that the track properties are locked in case of "static" (static means that if sensor data match a static track, then video is added to that track) or unlocked in case of "dynamic" one. There can be other means as well such as default being static, indicating static via a "lock" track mode etc.
The number of tracks being created is determined according to the type of the event and/or by the user. For example, if the event is a concert, the stage forms the primary tag, the audience may form an audience track and the concert screen may form an own track. Then three tracks may be enough. In an Olympic game, there can
be as many tracks as there are competitions going on the sports field plus the audience track. Each event may have a default number of tracks that would be primarily created for the event. Event type determination may happen either through a user input, through event database, map information or through event determination algorithms such as concert detection through audio. Once event type is determined, number of tracks is created as default. The user may, however, remove or add tracks to the default amount of tracks.
If default set of tracks are used, the electronic device will try to determine positions for each track from user capture and/or user input, and assign segments for those tracks. For certain events, such as personal parties, track designation is more at semantic level than structural and depends on the user in order to create the tracks. However, the system may be capable on assisting the user by providing certain templates for creating the tracks. As an example, a birthday party template may comprise three tracks as default: 1 ) primary track for capturing the person being celebrated; 2) family and friends track; 3) track for party activities. These can be - however - modified later on. In addition, the electronic device may use historical data received from previous users via the remixing server, which previous users have used the remixing service before. There the primary tracks have been provided corresponding to the location of an arena for example. Such designated primary and other tracks may provide an initial estimation for primary track for the user. But also in this case, the user can modify the primary track to satisfy his/her own preferences.
Figure 4 illustrates an example of a client software 200 performing the multitrack creation in the electronic device. The client software operates with a video recorder 201 of the device and/or one or more other media recorders for capturing media. The client software also comprises a user interface manager 202 for managing and controlling various actions occurring on the user interface and relating to the multitrack recording or multitrack control. The client software may be configured to receive sensor data 203 from one or more sensors of the electronic device. The client software may comprise means for recognizing semantic objects 204. Such recognition means 204 may communicate with semantic query module 205 to receive e.g. user input for e. track designation and object recognition via communication module 206. Track manager 207 is configured to control the tracks being recorded. For example track designation can be performed by the track manager. Similarly, the track manager 207 is able to store recognized objects to user object database 208. The device also comprise track codecs 209 and multiview track builder 210 which cooperatively create the multiview presentation of the tracks being recorded and stored in a track database 21 1 . Multitrack codecs have been disclosed in lETF-standards. Such multitrack codecs are configured to encode multiple tracks so that they are presented in multiplexed manner in the multiview media. Alternatively, in addition to a such multiplexed representation, each track can be separately represented, either on a same view, or on different views, whereby a single track can be quickly extracted from the presentation. In addition, a track
containing metadata can be inserted to the multitrack media, which metadata provides data about segment insertions, view points, view names, semantic object in segments and semantic information - static view or dynamic objects information on each view.
Once multitrack media has been created, the electronic device may form a connection to a server. The connection may have been formed also before recording or during the recording. The multitracks are sent to the server. The server, may comprise a remixing service, such as applicant's Director's Cut, that creates a video mix for each track or each view from the track information and track data. The server may receive multiple multitracks from a plurality of users, from which reveived multitracks a single multitrack presentation is created. The server may create one or more multitracks for each user using different remix criterion such as using different primary tracks or even different tracks while extracting track based content from each submission.
With respect to creating the video mix, the remixing service is able to create personalized multiview tracks for the user because the multitracks from the single user are personalized and the end points are specified. So, the multiview video mix created for a certain user will be different from the multiview video mix created for another user because their primary tracks and other views are different or calibrated differently during the media capture. Therefore this will be reflected also in the created video mix. The remixing service may also be able to query data regarding only a particular view from the client device. So for sourcing content, not all the views need to be uploaded.
An embodiment of the method disclosed above is illustrated as flowchart in Figure 5. In this embodiment the electronic device starts recording (510) after which a primary track is determined (520). The electronic device may use (525) default primary track and/or user input for determining the primary track. The recordings out of the primary track, are assigned to secondary tracks (530). In order to determine the secondary track, the electronic device may user sensor data and/or user input (535). After having completed the recordings, the electronic device is capable of creating (540) multitrack media of the primary and the secondary tracks. These multitracks are sent to a server (550) that is configured to generate multitrack presentation and send the presentation to the electronic device. After having received (560) the multitrack presentation from the server, the electronic device may view the presentation. The embodiments of the present invention concern a client side multitrack media creator. These embodiments represent a substantial advancement compared to existing solutions, because the multview tracks can be created and viewed in a client apparatus (i.e. an electronic device). In addition, the multiview creator enables user
controlled view for track creation. In addition, the multiview creator enables personal multitrack view remixing by a server side remixing service.
Embodiments of the present invention may be implemented in software, hardware, application logic or a combination of software, hardware and application logic. The software, application logic and/or hardware may reside on the electronic device. In an example embodiment, the application logic, software or an instruction set is maintained on any one of various conventional computer-readable media. In the context of this document, a "computer-readable medium" may be any media or means that can contain, store, communicate, propagate or transport the instructions for use by or in connection with an instruction execution system, apparatus, or device, such as a computer, with one example of a computer described and depicted in figure 1 . A computer-readable medium may comprise a computer-readable storage medium that may be any media or means that can contain or store the instructions for use by or in connection with an instruction execution system, apparatus, or device, such as a computer.
If desired, the different functions discussed herein may be performed in a different order and/or concurrently with each other. Furthermore, if desired, one or more of the above-described functions may be optional or may be combined.
Although various aspects of the invention are set out in the independent claims, other aspects of the invention comprise other combinations of features from the described embodiments and/or the dependent claims with the features of the independent claims, and not solely the combinations explicitly set out in the claims.
It is also noted herein that while the above describes example embodiments of the invention, these descriptions should not be viewed in a limiting sense. Rather, there are several variations and modifications which may be made without departing from the scope of the present invention as defined in the appended claims.
Claims
1 . A method comprising
- recording media by an electronic device;
- determining a primary track of the recording, which primary track indicates the main content;
- determining one or more secondary tracks, wherein each of the secondary tracks will contain a selected content of the recording;
- creating a multitrack media of said primary track and said one or more secondary tracks in said electronic device,
- transmitting said multitrack media to a remixing server in order to receive a multitrack presentation.
2. The method according to claim 1 , further comprising
- viewing the multitrack presentation in the electronic device.
3. The method according to claim 1 or 2, further comprising
- determining the primary track automatically.
4. The method according to claim 3, further comprising
- determining the primary track by means of at least one of the following information: direction of the audio, an event type.
5. The method according to claim 3 or 4, further comprising
- adjusting automatically determined primary track manually.
6. The method according to claim 1 or 2, further comprising
- determining the primary track manually.
7. The method according to any of the previous claims 1 to 6, further comprising
- determining a default number of secondary tracks.
8. The method according to any of the previous claims 1 to 7, further comprising
- placing a content of the recording to a correct track of the one or more secondary tracks by means of a user input.
9. The method according to any of the previous claims 1 to 8, further comprising
- placing a content of the recording to a correct track of the one or more secondary tracks by means of a sensor data.
10. The method according to claim 9, wherein sensor data relates to at least one of the following: panning measures, angle of panning, acceleration, orientation.
1 1 . The method according to any of the previous claims 1 to 10, further comprising
- adding a track containing metadata for the tracks in the multitrack media.
12. An apparatus, comprising:
a processor configured to
- record media by said apparatus;
- determine a primary track of the recording, which primary track indicates the main content;
- determine one or more secondary tracks, wherein each of the secondary tracks will contain a selected content of the recording;
- create a multitrack media of said primary track and said one or more secondary tracks in said apparatus; and
- transmit said multitrack media to a remixing server in order to receive a multitrack presentation.
13. An apparatus, comprising:
at least one processor; and
at least one memory including computer program code
the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following:
- record media by said apparatus
- determine a primary track of the recording, which primary track indicates the main content;
- determine one or more secondary tracks, wherein each of the secondary tracks will contain a selected content of the recording;
- create a multitrack media of said primary track and said one or more secondary tracks in said apparatus; and
- transmit said multitrack media to a remixing server in order to receive a multitrack presentation.
14. The apparatus according to claim 13, further comprising computer program code configured to, with the processor, cause the apparatus to perform at least the following:
- viewing the multitrack presentation in the electronic device.
15. The apparatus according to claim 13 or 14, further comprising computer program code configured to, with the processor, cause the apparatus to perform at least the following:
- determining the primary track automatically.
16. The apparatus according to claim 15, further comprising computer program code configured to, with the processor, cause the apparatus to perform at least the following:
- determining the primary track by means of at least one of the following information: direction of the audio, an event type.
17. The apparatus according to claim 15 or 16, further comprising computer program code configured to, with the processor, cause the apparatus to perform at least the following:
- adjusting automatically determined primary track manually.
18. The apparatus according to claim 13 or 14, further comprising computer program code configured to, with the processor, cause the apparatus to perform at least the following:
- determining the primary track manually.
19. The apparatus according to any of the previous claims 13 to 18, further comprising computer program code configured to, with the processor, cause the apparatus to perform at least the following:
- determining a default number of secondary tracks.
20. The apparatus according to any of the previous claims 13 to 19, further comprising computer program code configured to, with the processor, cause the apparatus to perform at least the following:
- placing a content of the recording to a correct track of the one or more secondary tracks by means of a user input.
21 . The apparatus according to any of the previous claims 13 to 20, further comprising computer program code configured to, with the processor, cause the apparatus to perform at least the following:
- placing a content of the recording to a correct track of the one or more secondary tracks by means of a sensor data.
22. The apparatus according to claim 21 , wherein sensor data relates to at least one of the following: panning measures, angle of panning, acceleration, orientation.
23. The apparatus according to any of the previous claims 13 to 22, further comprising computer program code configured to, with the processor, cause the apparatus to perform at least the following:
- adding a track containing metadata for the tracks in the multitrack media.
24. The apparatus according to any of the previous claims 13 to 23, wherein the apparatus is a mobile device.
25. A computer program, comprising:
- code for recording media by an electronic device;
- code for determining a primary track of the recording, which primary track indicates the main content;
- code for determining one or more secondary tracks, wherein each of the secondary tracks will contain a selected content of the recording;
- code for creating multitrack media of said primary track and said one or more secondary tracks in said electronic device; and
- code for transmitting said multitrack media to a remixing server in order to receive a multitrack presentation,
when the computer program is run on a processor.
26. The computer program according to claim 25, wherein the computer program is a computer program product comprising a computer-readable medium bearing computer program code embodied therein for use with a computer.
27. A computer-readable medium encoded with instructions that, when executed by a computer, perform:
- recording media by an electronic device;
- determining a primary track of the recording, which primary track indicates the main content;
- determining one or more secondary tracks, wherein each of the secondary tracks will contain a selected content of the recording;
- creating multitrack media of said primary track and said one or more secondary tracks in said electronic device; and
- transmitting said multitrack media to a remixing server in order to receive a multitrack presentation.
28. A server comprising
at least one processor; and
at least one memory including computer program code,
the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following:
- to receive a multitrack media from an electronic device; said multitrack media comprising primary track indicating the main content and one or more secondary tracks containing selected parts of the recording;
- to create a multitrack presentation of the received multitrack media to be sent to the electronic device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/FI2012/050849 WO2014033357A1 (en) | 2012-09-03 | 2012-09-03 | Multitrack media creation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/FI2012/050849 WO2014033357A1 (en) | 2012-09-03 | 2012-09-03 | Multitrack media creation |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2014033357A1 true WO2014033357A1 (en) | 2014-03-06 |
Family
ID=50182572
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/FI2012/050849 Ceased WO2014033357A1 (en) | 2012-09-03 | 2012-09-03 | Multitrack media creation |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2014033357A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3120540A4 (en) * | 2014-03-17 | 2017-11-15 | Clipcast Technologies LLC | Media clip creation and distribution systems, apparatus, and methods |
| US11031043B1 (en) | 2020-05-05 | 2021-06-08 | Facebook, Inc. | Video collaboration tool |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040126085A1 (en) * | 2002-08-07 | 2004-07-01 | Mx Entertainment | System for selecting video tracks during playback of a media production |
| US20070234193A1 (en) * | 2006-03-29 | 2007-10-04 | Huan-Hung Peng | Method for simultaneous display of multiple video tracks from multimedia content and playback system thereof |
| US20090087161A1 (en) * | 2007-09-28 | 2009-04-02 | Graceenote, Inc. | Synthesizing a presentation of a multimedia event |
| US20100324919A1 (en) * | 2006-05-24 | 2010-12-23 | Capshore, Llc | Method and apparatus for creating a custom track |
-
2012
- 2012-09-03 WO PCT/FI2012/050849 patent/WO2014033357A1/en not_active Ceased
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040126085A1 (en) * | 2002-08-07 | 2004-07-01 | Mx Entertainment | System for selecting video tracks during playback of a media production |
| US20070234193A1 (en) * | 2006-03-29 | 2007-10-04 | Huan-Hung Peng | Method for simultaneous display of multiple video tracks from multimedia content and playback system thereof |
| US20100324919A1 (en) * | 2006-05-24 | 2010-12-23 | Capshore, Llc | Method and apparatus for creating a custom track |
| US20090087161A1 (en) * | 2007-09-28 | 2009-04-02 | Graceenote, Inc. | Synthesizing a presentation of a multimedia event |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3120540A4 (en) * | 2014-03-17 | 2017-11-15 | Clipcast Technologies LLC | Media clip creation and distribution systems, apparatus, and methods |
| US11031043B1 (en) | 2020-05-05 | 2021-06-08 | Facebook, Inc. | Video collaboration tool |
| EP3910631A1 (en) * | 2020-05-05 | 2021-11-17 | Facebook, Inc. | Video collaboration tool |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| ES2974683T3 (en) | Systems and methods for multimedia swarms | |
| US9652193B2 (en) | Method and apparatus for providing service by using screen mirroring | |
| CN104012106B (en) | Align videos representing different viewpoints | |
| US10230779B2 (en) | Content provision system, information processing apparatus and content reproduction method | |
| EP2816564B1 (en) | Method and apparatus for smart video rendering | |
| US10622020B2 (en) | Point of view video processing and curation platform | |
| KR20220031894A (en) | Systems and methods for synchronizing data streams | |
| US9141190B2 (en) | Information processing apparatus and information processing system | |
| JP2021061035A (en) | Method and system for controlling server | |
| JP2017538320A (en) | Multi-view content capture and composition | |
| US10674183B2 (en) | System and method for perspective switching during video access | |
| KR20150023406A (en) | Enhancing captured data | |
| US20220165308A1 (en) | Point of view video processing and curation platform | |
| US20150208000A1 (en) | Personalized media remix | |
| CN114268823A (en) | A video playback method, device, electronic device and storage medium | |
| US20160100110A1 (en) | Apparatus, Method And Computer Program Product For Scene Synthesis | |
| CN107683604A (en) | Generator | |
| US10778855B2 (en) | System and method for creating contents by collaborating between users | |
| WO2014033357A1 (en) | Multitrack media creation | |
| KR101850501B1 (en) | System for providing history contents | |
| US10474743B2 (en) | Method for presenting notifications when annotations are received from a remote device | |
| US20180376214A1 (en) | Systems and methods for creating and editing multi-component media | |
| US20220053248A1 (en) | Collaborative event-based multimedia system and method | |
| JP2017084161A (en) | Image processing apparatus, display apparatus and control method thereof | |
| JP2010074437A (en) | Method, device and program for adding annotation, and computer readable recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 12883562 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 12883562 Country of ref document: EP Kind code of ref document: A1 |