CN110611824B - Highlight video generation method, highlight video generation device using the same, and medium - Google Patents
Highlight video generation method, highlight video generation device using the same, and medium Download PDFInfo
- Publication number
- CN110611824B CN110611824B CN201810611552.4A CN201810611552A CN110611824B CN 110611824 B CN110611824 B CN 110611824B CN 201810611552 A CN201810611552 A CN 201810611552A CN 110611824 B CN110611824 B CN 110611824B
- Authority
- CN
- China
- Prior art keywords
- video
- highlight
- user
- time
- interval
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 19
- 238000004519 manufacturing process Methods 0.000 claims abstract description 4
- 238000004891 communication Methods 0.000 claims description 24
- 238000003860 storage Methods 0.000 claims description 12
- 238000010586 diagram Methods 0.000 description 15
- 238000005516 engineering process Methods 0.000 description 3
- 238000002372 labelling Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000035484 reaction time Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44222—Analytics of user selections, e.g. selection of programs or purchase activity
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Social Psychology (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Information Transfer Between Computers (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a highlight video generation method and a highlight video generation device using the same. First, a request for a highlight video of a live video is obtained, the request including at least one production condition from a user. And obtaining a plurality of time interval labels marked on the live video by a plurality of associated users, wherein the users have social relations with the associated users, and each time interval label corresponds to a time interval of the live video. Then, a highlight period interval is decided based on the plurality of period labels and the generation condition. Then, a highlight video is generated according to the highlight interval. And finally, sending the highlight video to the user side corresponding to the user.
Description
Technical Field
The present invention relates to a highlight video generation method and a highlight video generation apparatus using the same, and more particularly, to a highlight video generation method and a highlight video generation apparatus using the same, which can generate a highlight video according to a social relationship of a user.
Background
As technologies of intelligent devices and the internet become more mature, emerging media such as live videos are developed rapidly. The live broadcast can be simply carried out by utilizing the smart device at hand regardless of general users or business users, and the live broadcast can interact with users watching live videos.
For users who cannot watch live videos instantly, the users can watch the played back live videos directly or watch selected videos generated by the live videos. However, when a user watches a played back live video, the live video may be tired because it contains too much uninteresting content. In addition, the selection video automatically generated by the computer system cannot accurately generate the selection video from the essence fragment of the live video, so that the user has poor viewing experience.
Disclosure of Invention
Based on at least one embodiment of the present invention, the highlight video generation method and the highlight video generation apparatus provided by the embodiments of the present invention can generate the highlight video according to the time slot tags labeled to the live video by a plurality of associated users having social relations with the user and the generation conditions input by the user. The time interval label is formed by labeling the time interval which arouses interest or contains important information when other users watch the live video, and the highlight video is further generated according to the social relationship among the users, so that the highlight video not only can accurately provide the essence segments of the live video to the users according to the reaction of a plurality of associated users who have social relationship with the users watching the live video, but also can be closer to the ornamental taste of the users by matching the social relationship with the generation condition, and the users have better ornamental experience.
The invention provides a highlight video generation method, which comprises the following steps. First, a request for a highlight video of a live video is obtained, the request including at least one production condition from a user. And obtaining a plurality of time interval labels marked on the live video by a plurality of associated users, wherein the users have social relations with the associated users, and each time interval label corresponds to a time interval of the live video. Then, a highlight period interval is decided based on the plurality of period labels and the generation condition. Then, a highlight video is generated according to the highlight interval. And finally, sending the highlight video to the user side corresponding to the user.
The invention provides a wonderful video generation device which comprises a device end communication module and a device end processing module. The device side communication module is used for obtaining a request of a highlight video of a live video, and the request comprises at least one generation condition from a user. The device-side communication module is further configured to obtain a plurality of time interval tags marked on the live video by a plurality of associated users, where the users have social relationships with the plurality of associated users, and each time interval tag corresponds to a time interval of the live video. The device end processing module is used for determining a wonderful time interval based on a plurality of time interval labels and the generating conditions, generating a wonderful video according to the wonderful time interval and sending the wonderful video to a user end corresponding to a user.
For a better understanding of the nature and technical content of the present invention, reference should be made to the following detailed description of the invention and the accompanying drawings, which are provided for illustration purposes only and are not intended to limit the scope of the invention.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive labor.
FIG. 1 is a schematic illustration of an implementation environment according to an embodiment of the invention;
fig. 2 is a block diagram of an internal structure of a user side according to an embodiment of the present invention;
fig. 3 is a block diagram of an internal structure of a highlight video generating apparatus according to an embodiment of the present invention;
FIG. 4 is a flowchart illustrating the steps of highlight video generation according to an embodiment of the present invention;
fig. 5 is a schematic diagram illustrating a time interval tag marked at a user end by a user according to an embodiment of the present invention;
FIG. 6 is a diagram illustrating a plurality of time interval periods generated corresponding to a live video according to an embodiment of the present invention; and
FIG. 7 is a diagram illustrating a window for ending a live video according to an embodiment of the present invention; and
FIG. 8 is a diagram of a window for a user to view highlight video according to one embodiment of the present invention;
FIG. 9 is a diagram of a window for a user to view highlight video according to another embodiment of the present invention; and
fig. 10 is a diagram illustrating a window for a user to view a highlight video according to another embodiment of the present invention.
Reference numerals
100. 100a, 100 b', 100c user terminal
110 user side processing module
120 user side storage module
130 input/output module
140 user terminal communication module
200 wonderful video generating device
210 device side processing module
220 device end communication module
230 device side memory module
231 operating system
232 highlight video generation routine
240 database
S410 to S450 steps
A. B, B', C user
Interval of V1-V6
300 view window
310 video playing area
320 input area
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
Referring to fig. 1, a schematic diagram of an implementation environment according to an embodiment of the invention is shown, the implementation environment includes a plurality of clients 100(100a, 100 b', and 100c) and a highlight video generation device 200, and the plurality of clients 100 and the highlight video generation device 200 are communicatively connected to each other through a wired or wireless network.
The user end 100 may be a terminal device such as a smart phone, a tablet computer, a notebook computer, a wearable computer, a desktop computer, etc., and the user end 100 may be connected to a website associated with the highlight video generation apparatus 200 or set and run a dedicated application. The user terminal 100 can perform and form a service screen, input data, transmit or receive data, retain data, and the like under the control of a website or a dedicated application. Thus, in one embodiment, each user (A, B, B', C) logs into a website or dedicated application through a respective account through which the user may interact with associated users having social relationships. The social relationship is a friend, a member of the same chat group, a member of the same community, or another user concerned by the user, and the invention is not limited thereto.
The highlight video generation apparatus 200 may be implemented on a platform for providing a social network service (e.g., a chat software service), and the highlight video generation apparatus 200 may provide an application service for generating a highlight video with a generation condition input by a user and a plurality of slot tags corresponding to annotations of live videos by the associated user. In one embodiment, the highlight video generation apparatus 200 may further provide an application service that generates highlight videos with a function associated with a user for a plurality of item tags of live video annotations. For example, highlight video generation device 200 may provide an application service with functionality associated with a user tagging multiple slots of a live video and associated with a user generating highlight video tagging multiple item tags of the live video.
The highlight video generation apparatus 200 as described above can be implemented in a manner of a platform of a social network server for providing a social network service, and can also be established as a system different from the social network server to be implemented in a highlight video generation manner by interlocking with the social network server. Also, at least a part of the structural elements of the highlight video generating apparatus 200 can be implemented as an application provided on the user terminal 100, or can be implemented as a platform for providing services in a client server environment.
Fig. 2 is a block diagram illustrating an internal structure of a user terminal 100 according to an embodiment of the present invention. The client 100 may include a client processing module 110, a client storage module 120, an input/output module 130, and a client communication module 140, wherein the client processing module 110 is electrically connected to the client storage module 120, the input/output module 130, and the client communication module 140.
The client memory module 120 may be a high speed random access memory, a magnetic disk, a static random access memory, a dynamic random access memory, a read only memory, a flash memory or a non-volatile memory. The client storage module 120 can store software modules, instruction sets or other various data required by the operation of the client 100, and can control the operation of accessing the client storage module 120 through the client processing module 110.
The input/output module 130 may be implemented by a display, a keyboard, a mouse, a touch screen, a lens, etc., so that a user can input information to operate the website or the application program through the input/output module 130.
The client communication module 140 provides communication functions with other terminal devices. The user-side communication module 140 may be implemented by a communication circuit of wireless fidelity (WiFi), a mobile communication technology, Long Term Evolution (LTE), Bluetooth (Bluetooth), a Near Field Communication (NFC) technology, a Zigbee protocol (Zigbee), and the like, and the invention is not limited thereto.
The embodiment of fig. 2 is merely an example of the user terminal 100, and the user terminal 100 may omit some components in fig. 2 or have other components not shown, or have a structure or configuration in which more than 2 components are combined. In other embodiments, the user terminal 200 can be implemented by hardware, software, or a combination of hardware and software.
Referring to fig. 3, fig. 3 is a block diagram illustrating an internal structure of a highlight video generation apparatus 200 according to an embodiment of the present invention. The highlight video generation device 200 of the present embodiment may include a device-side processing module 210, a device-side communication module 220, a device-side storage module 230, and a database 240.
In other embodiments, the highlight video generation apparatus 200 may also include more structural elements than those shown in fig. 3, but most of the prior art structural elements need not be explicitly shown, for example, the highlight video generation apparatus 200 may also include other structural elements such as a display or a transceiver.
The device-side communication module 220 may be a hardware structural element of the highlight video generating device 200 connected to a computer network. The device-side communication module 220 may communicatively connect the highlight video generation device 200 with a computer network via a wireless or wired connection. The device-side communication module 220 may be implemented by a communication circuit of wireless fidelity (WiFi), ethernet protocol, etc., and the invention is not limited thereto.
The device-side storage module 230 is a computer-readable storage medium, and may include a random access memory, a read only memory, a disk drive, and other permanent mass storage devices. The device-side storage module 230 may be configured to store program codes of an operating system 231 and a highlight video generation routine 232 required to operate the highlight video generation device 200.
The database 240 may store the live video, a plurality of tags corresponding to the live video, a plurality of item tags, social relationships among users, and the like. Therefore, the device-side processing module 210 can access the corresponding information from the database 240 according to the operation thereof.
The embodiment of the highlight video generation apparatus 200 illustrated in fig. 3 includes the database 240, but the present invention is not limited thereto, and in other embodiments, the embodiment may be omitted according to the implementation manner or environment of the highlight video generation apparatus 200. Alternatively, in other embodiments, part or all of database 240 may be implemented in additional other systems.
The device-side processing module 210 performs basic arithmetic, logic, and input/output operations of the highlight video generation device 200, and is configured to process instructions of a computer program. The instructions may be provided to the device-side processing module 210 by the device-side storage module 230 or by the device-side communication module 220. The device-side processing module 210 is configured to run program code of the highlight video generation routine 232.
The device-side processing module 210 is configured to perform a plurality of steps of fig. 4, and will be further described with reference to fig. 4.
Referring to fig. 4, fig. 4 is a flowchart illustrating steps of a highlight video generation method according to an embodiment of the present invention.
In step S410, the highlight video generation apparatus 200 obtains a request for a highlight video of a live video. During or after the live video is played instantly, the user inputs data of a request through a service frame formed by the user terminal 100, where the request includes at least one generation condition, and the generation condition is at least one of a specific social relationship, a specific object, a video length, a video click rate, and a video logic combination (e.g., a video union or a video intersection), and the invention is not limited thereto. So that the request can be transmitted to the highlight video generating device 200 through the user terminal 100.
In step S420, the highlight video generation apparatus 200 obtains a plurality of slot tags labeled on the live video by a plurality of associated users. The user has a social relationship with a plurality of associated users. Each time slot label is provided with a starting time and an ending time, wherein the starting time and the ending time are respectively one time point of the live video, the time point of the starting time is earlier than the time point of the ending time, and the time interval between the starting time and the ending time forms a time slot interval corresponding to the live video, so that each time slot label corresponds to one time slot interval of the live video.
In one embodiment, the highlight video generation apparatus 200 further obtains an object tag labeled in the live video by the associated user, wherein the object tag corresponds to a time interval of the live video, and therefore a plurality of highlight time intervals can be further determined based on the object tag. The object tag is used to mark at least one specific object corresponding to the live video, where the specific object is, for example, an object such as a smart phone, a watch, a brand, a name of a person, etc. appearing in a picture of the live video, and the invention is not limited thereto.
In step S430, the device-side processing module 210 determines a highlight interval based on the time interval tags and the generation condition. In detail, the device-side processing module 210 selects the time slot tags meeting the generating conditions according to the generating conditions, and the selected time slot tags determine the highlight time slot at the same time, that is, the highlight time slot includes at least one time slot.
For example, the generation condition input by the user C in fig. 1 is a specific social relationship of "friend" and "video click rate", the device-side processing module 210 selects, according to the generation condition, a time slot tag labeled by the user B, B' having the social relationship of "friend" of the user C and having the highest video click rate from the plurality of time slot tags, and the time slot corresponding to the selected time slot tag is the highlight time slot.
In other embodiments, the generation conditions input by the user C in fig. 1 are "friend" and "mobile phone", the device-side processing module 210 selects, according to the generation conditions, a time interval tag labeled by the user B, B' having a social relationship of "friend" with the user C and a time interval tag corresponding to an object tag of the "mobile phone" object from a plurality of time interval tags, and the device-side processing module 210 takes a time interval corresponding to the selected time interval tag as a highlight time interval.
In step S440, the device-side processing module 210 generates a highlight video according to the highlight interval. Further, the device-side processing module 210 determines one or more clip videos based on the highlight interval, the one or more clip videos are associated with the live video, and the clip videos are generated by the device-side processing module 210 according to the at least one time interval label included in the highlight interval. The device-side processing module 210 generates a highlight video from the one or more clip videos. Such as video logically combining (e.g., video union or video intersection) one or more clip videos to produce a highlight video.
In step S450, the device-side processing module 210 enables the device-side communication module 220 to send the highlight video to the user side 100C corresponding to the user C.
Fig. 5 to 8 are illustrative diagrams for explaining a highlight video generation method according to an embodiment of the present invention.
Referring to fig. 5, fig. 5 is a schematic diagram of the user B, B 'labeling the time slot labels with the user terminals 100b and 100 b'. During the instant playback of the live video, the user B can make the user terminal 100B obtain the selected start time and end time by continuously clicking or long-pressing the live video by the user terminal 100B, and accordingly generate the time slot tag. For example, the user B clicks the record button on the touch screen of the user terminal 100B at 01 min 00 sec of the live video, and clicks the record button on the touch screen of the user terminal 100B again at 02 min 50 sec of the live video, so that the user terminal 100B generates the time slot tag with the time point 01 min 00 sec as the start time and the time point 02 min 50 sec as the end time. Or the user B presses the record button on the touch screen of the user terminal 100B for a long time between the time point 01 min 00 s and the time point 02 min 50 s, so that the user terminal 100B generates the time interval tags including the time point 01 min 00 s and the time point 02 min 50 s. In one embodiment, in order to take into account the reaction time required for the user B, B 'to continuously operate the service screen or send content through the touch screen of the user end 100b, 100 b', the start time and the end time of the time slot label may be adjusted accordingly.
Fig. 6 is a schematic diagram of a plurality of time slot tags marked corresponding to live video. The plurality of time period intervals are generated from a plurality of time period tags tagged by a plurality of users B, B' during the live video instant play. The time interval V1-V6 shown in FIG. 6 respectively correspond to a time interval label, wherein the time interval V1-V4 respectively correspond to a plurality of time interval labels labeled by the user B, and the time interval V5-V6 corresponds to a plurality of time interval labels labeled by the user B', and the invention is not limited thereto. In other embodiments, the time interval V1-V6 may further correspond to at least one object tag (e.g., "motorcycle") according to the frame of the live video. It should be noted that the number of the time slot tags in the embodiment is only used for illustrating the present invention, and is not limited to the present invention, and the number of the time slot tags may be determined according to the number of times of generating the time slot tags.
Fig. 7 is a diagram of a window 300 for user C to view highlight video from an application. The window 300 includes a video play area 310 and an input area 320. In an embodiment, after the instant playing of the live video is finished, the video playing area 310 may prompt the user C that the instant playing of the live video is finished, as shown in fig. 7, and prompt the user C with a text of "live finished". The user C can input the generation condition by the input area 320 in a pull-down menu or a string input manner, and the corresponding highlight video starts to be played in the video playing area 310. In another embodiment, during the instant playing of the live video, the user C may input the generation condition in a pull-down menu or a string input manner from the input area 320, and the corresponding highlight video starts to be played in the video playing area 310, wherein the highlight video is generated from the start time of the instant playing of the live video to the time slot tag marked at the current time.
For example, the user C may input the generation conditions of "friend" and "highest video click rate", and the device-side processing module 210 determines the time slot tag labeled by at least one user B, B 'having a friend social relationship with the user C and the time slot tag corresponding to the highest click rate among the time slot tags labeled by at least one user B, B' as the highlight time slot according to the generation conditions. The time interval meeting the generation condition is, for example, a time interval V1 (the start time is 10 minutes 30 seconds at the time point, and the end time is 11 minutes 45 seconds at the time point) corresponding to the time label marked by the user B in fig. 6, and a time interval V5 (the start time is 11 minutes 00 seconds at the time point, and the end time is 12 minutes 50 seconds at the time point) corresponding to the time label marked by the user B'. In addition, or the time interval meeting the generation condition is, for example, the time interval V2 (the start time is 57 minutes 00 seconds, and the end time is 59 minutes 20 seconds) corresponding to the time label marked by the user B in fig. 6 and the time interval V6 (the start time is 57 minutes 00 seconds, and the end time is 59 minutes 20 seconds) corresponding to the time label marked by the user B' (in this embodiment, the start time and the end time corresponding to the time interval V2 and the time interval V6 are the same.
The device-side processing module 210 clips the live video according to the highlight period interval to generate a clip video, where the clip video is, for example, a partial live video corresponding to the period interval V1 and the period interval V5, or a partial live video corresponding to the period interval V2 and the period interval V6. The device-side processing module 210 generates a highlight video from the combination of the clip videos, where the highlight video is, for example, a highlight video with a start time of 10 minutes and 30 seconds and an end time of 12 minutes and 50 seconds, or a highlight video with a start time of 57 minutes and 00 seconds and an end time of 59 minutes and 20 seconds, and the duration of the highlight video is 2 minutes and 20 seconds. The device-side communication module 220 then transmits the finished highlight video to the user side 100 c. As shown in fig. 8, the user C can play the highlight video with a duration of 2 minutes and 20 seconds from the video playing area 310 of the window 300 displayed on the user side 100C.
In another embodiment, the user C may input the generation conditions of "friend", "popular video", and "combine", and the device-side processing module 210 determines the time slot tags labeled by at least one user B, B 'having a friend social relationship with the user C and corresponding to the relatively highest click rate among the time slot tags labeled by at least one user B, B' as the highlight time slot according to the generation conditions. The time interval meeting the generation condition is, for example, the time interval V1 corresponding to the time interval label marked by the user B, the time interval V2 corresponding to the time interval label marked by the user B, the time interval V5 corresponding to the time interval label marked by the user B ', and the time interval V6 corresponding to the time interval label marked by the user B' in fig. 6.
The device-side processing module 210 clips the live video according to the wonderful time interval to generate a clip video, wherein the clip video is a part of the live video corresponding to the time interval V1, the time interval V2, the time interval V5 and the time interval V6. The device-side processing module 210 generates a highlight video by combining the clip videos, where the highlight video is a combination of a part of live video with a start time of 10 minutes and 30 seconds and an end time of 12 minutes and 50 seconds and a part of live video with a start time of 57 minutes and 00 seconds and an end time of 59 minutes and 20 seconds, and thus the highlight video has a time length of 04 minutes and 40 seconds in this embodiment. The device-side communication module 220 then transmits the finished highlight video to the user side 100 c. As shown in fig. 9, the user C can play the highlight video with a duration of 04 minutes and 40 seconds through the video playing area 310 of the window 300 displayed on the user terminal 100C.
In yet another embodiment, the user C may input the generation conditions of "friend" and "repeat video", the device-side processing module 210 selects a plurality of time slot tags that at least partially overlap with the time slots of the time slot tags marked by another user B, B 'and are among the time slot tags marked by the user B, B' having a friend social relationship with the user C according to the generation conditions, and determines the time slot corresponding to the time slots in which the plurality of time slot tags overlap with each other as the highlight time slot. The time interval meeting the generation condition is, for example, a time interval V1 corresponding to the time label marked by the user B and a time interval V5 corresponding to the time label marked by the user B' in fig. 6, the time interval V1 partially overlaps with the time interval of the time interval V5, the start time of the overlapping time interval is, for example, 11 minutes 00 seconds at the time point, the end time of the overlapping time interval is, for example, 11 minutes 45 seconds at the time point, and the length of the overlapping time interval is 45 seconds. The time interval meeting the generation condition is, for example, a time interval V2 corresponding to the time label marked by the user B and a time interval V6 corresponding to the time label marked by the user B' in fig. 6, the time interval V2 and the time interval V6 overlap each other, the start time of the overlapping time interval is 57 minutes 00 seconds, the end time of the overlapping time interval is 59 minutes 20 seconds, and the length of the overlapping time interval is 02 minutes 20 seconds.
The device-side processing module 210 clips the live video according to the wonderful time interval to generate a clip video, wherein the clip video is a part of the live video with a corresponding start time of 11 minutes 00 seconds and an end time of 11 minutes 45 seconds, and a start time of 57 minutes 00 seconds and an end time of 59 minutes 20 seconds. The device-side processing module 210 generates a highlight video by combining the clip videos, where the highlight video is a combination of a part of live video with a start time of 11 min 00 s and an end time of 11 min 45 s and a part of live video with a start time of 57 min 00 s and an end time of 59 min 20 s, and thus the highlight video has a time length of 03 min 05 s in this embodiment. The device-side communication module 220 then transmits the finished highlight video to the user side 100 c. As shown in fig. 10, the user C can play the highlight video with a time duration of 03 minutes and 05 seconds through the video playing area 310 of the window 300 displayed on the user terminal 100C.
In other embodiments, the user C may input the generation condition of "3-5 minutes video", and the device-side processing module 210 may also generate the highlight video of fig. 9 or 10 as described above, and the invention is not limited thereto.
In summary, the highlight video generation method and the highlight video generation apparatus provided by the embodiments of the present invention can generate the highlight video according to the time slot tags labeled to the live video by a plurality of associated users having social relations with the user and the generation conditions input by the user. Because the time interval label is formed by labeling the time interval which arouses interest or contains important information when the user watches the live video, and the highlight video is further generated according to the social relationship among the users, compared with the existing method which takes the video automatically generated by a computer system as the highlight video, the highlight video not only can accurately provide the essence segments of the live video for the user according to the reaction of a plurality of associated users who have social relationship with the user to watch the live video, but also can be closer to the ornamental taste of the user by matching the highlight video generated by the social relationship and the generation condition, so that the user has better ornamental experience.
The above description is only an example of the present invention, and is not intended to limit the scope of the present invention.
Claims (12)
1. A highlight video generation method, comprising:
obtaining a request for the highlight video of a live video, the request including at least one production condition from a user;
obtaining a plurality of time period labels marked on the live video by at least one of a plurality of associated users, wherein the users have social relations with the associated users, the at least one of the plurality of associated users marks the time period labels, wherein the at least one of the plurality of associated users is an associated user selected from the associated users to mark the time period labels based on the at least one production condition, and each time period label corresponds to a time period interval of the live video;
determining a highlight period interval based on the plurality of period labels and a generation condition;
generating the highlight video according to the highlight time interval; and
and sending the highlight video to a user side corresponding to the user.
2. The highlight video generation method according to claim 1, further comprising:
obtaining an item tag tagged to the live video by an associated user, wherein the highlight interval is further determined based on the item tag.
3. The highlight video generation method according to claim 1, wherein said time slot tag has a start time and an end time, said start time and said end time being a time point of said live video, said highlight time slot including at least one time slot.
4. The highlight video generation method according to claim 1, characterized in that said social relationship is a friend, the same chat group member and the same community member or other users interested by said user.
5. The highlight video generation method according to claim 1, wherein said generation condition is a specific social relationship, a specific object, a video length, a video click rate or a video logical combination.
6. The highlight video generation method according to claim 1, wherein the step of generating said highlight video based on said highlight period interval comprises:
determining one or more clip videos based on the highlight period interval, the one or more clip videos associated with the live video; and
generating the highlight video from the one or more clip videos.
7. A computer-readable storage medium containing instructions for performing the highlight video generation method of any one of claims 1 to 6 to cause a computer system to generate the highlight video.
8. A highlight video generation apparatus, comprising:
a device-side communication module, configured to obtain a request for a highlight video of a live video, where the request includes at least one generation condition from a user, and further configured to obtain a plurality of period tags labeled on the live video by at least one of a plurality of associated users, where the user has a social relationship with the associated users, and the associated users are labeled with the period tags, where the associated users are selected from the associated users based on the at least one generation condition, and each period tag corresponds to a period interval of the live video; and
and the device end processing module is used for determining a wonderful time interval based on the time interval labels and the generation conditions, generating the wonderful video according to the wonderful time interval and sending the wonderful video to a user end corresponding to the user.
9. The highlight video generation apparatus according to claim 8, wherein said apparatus-side communication module further obtains an object tag labeled on said live video by an associated user, and said apparatus-side processing module further determines said highlight interval based on said object tag.
10. The apparatus of claim 8, wherein the time slot tag has a start time and an end time, the start time and the end time being a time point of the live video, and the highlight time slot comprises at least one time slot.
11. The apparatus of claim 8, wherein the social relationship is a friend, a same chat group member, and a same community member or other user interested by the user.
12. The highlight video generation device according to claim 8, wherein the generation condition is a specific social relationship, a specific object, a video length, a video click rate, a video union, or a video intersection.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810611552.4A CN110611824B (en) | 2018-06-14 | 2018-06-14 | Highlight video generation method, highlight video generation device using the same, and medium |
| JP2019111005A JP7429099B2 (en) | 2018-06-14 | 2019-06-14 | Server, information processing method and program |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810611552.4A CN110611824B (en) | 2018-06-14 | 2018-06-14 | Highlight video generation method, highlight video generation device using the same, and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110611824A CN110611824A (en) | 2019-12-24 |
| CN110611824B true CN110611824B (en) | 2021-12-24 |
Family
ID=68887454
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810611552.4A Active CN110611824B (en) | 2018-06-14 | 2018-06-14 | Highlight video generation method, highlight video generation device using the same, and medium |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP7429099B2 (en) |
| CN (1) | CN110611824B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000341613A (en) * | 1999-05-25 | 2000-12-08 | Nippon Telegr & Teleph Corp <Ntt> | MPEG video search apparatus based on camera work information and recording medium storing MPEG video search program |
| EP2608137A2 (en) * | 2011-12-19 | 2013-06-26 | Gface GmbH | Computer-implemented method for selectively displaying content to a user of a social network, computer system and computer readable medium thereof |
| CN104350451A (en) * | 2011-11-01 | 2015-02-11 | 谷歌公司 | Integrated social network and stream playback |
| CN105491456A (en) * | 2014-10-11 | 2016-04-13 | 中兴通讯股份有限公司 | Video content recommendation method and device as well as video content evaluation method and device |
| CN105975538A (en) * | 2016-04-29 | 2016-09-28 | 乐视控股（北京）有限公司 | Content recommendation method and device |
| CN106792171A (en) * | 2016-12-14 | 2017-05-31 | 宁夏灵智科技有限公司 | Personalized recommendation method and system in intelligent video app |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4016891B2 (en) * | 2003-06-06 | 2007-12-05 | 日本電信電話株式会社 | Partial content creation method and apparatus, program, and computer-readable recording medium |
| JP5086189B2 (en) * | 2008-06-20 | 2012-11-28 | ヤフー株式会社 | Server, method and program for generating digest video of video content |
| US20120324491A1 (en) * | 2011-06-17 | 2012-12-20 | Microsoft Corporation | Video highlight identification based on environmental sensing |
| US20160180035A1 (en) * | 2014-12-19 | 2016-06-23 | David Maughan | Systems and methods for minimizing revenue leakage by improving comorbidity coding and lowering the mortality index while increasing inpatient revenue |
| KR101777242B1 (en) * | 2015-09-08 | 2017-09-11 | 네이버 주식회사 | Method, system and recording medium for extracting and providing highlight image of video content |
| US10645142B2 (en) * | 2016-09-20 | 2020-05-05 | Facebook, Inc. | Video keyframes display on online social networks |
-
2018
- 2018-06-14 CN CN201810611552.4A patent/CN110611824B/en active Active
-
2019
- 2019-06-14 JP JP2019111005A patent/JP7429099B2/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000341613A (en) * | 1999-05-25 | 2000-12-08 | Nippon Telegr & Teleph Corp <Ntt> | MPEG video search apparatus based on camera work information and recording medium storing MPEG video search program |
| CN104350451A (en) * | 2011-11-01 | 2015-02-11 | 谷歌公司 | Integrated social network and stream playback |
| EP2608137A2 (en) * | 2011-12-19 | 2013-06-26 | Gface GmbH | Computer-implemented method for selectively displaying content to a user of a social network, computer system and computer readable medium thereof |
| CN105491456A (en) * | 2014-10-11 | 2016-04-13 | 中兴通讯股份有限公司 | Video content recommendation method and device as well as video content evaluation method and device |
| CN105975538A (en) * | 2016-04-29 | 2016-09-28 | 乐视控股（北京）有限公司 | Content recommendation method and device |
| CN106792171A (en) * | 2016-12-14 | 2017-05-31 | 宁夏灵智科技有限公司 | Personalized recommendation method and system in intelligent video app |
Non-Patent Citations (1)
| Title |
|---|
| 移动互联背景下视频网站发展趋势及应对;杜建华;《编辑学刊》;20141115(第6期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| JP7429099B2 (en) | 2024-02-07 |
| CN110611824A (en) | 2019-12-24 |
| JP2019220954A (en) | 2019-12-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220150572A1 (en) | Live video streaming services | |
| CN102473189B (en) | Real-time provision of links to media object parts in social network updates | |
| US10235025B2 (en) | Various systems and methods for expressing an opinion | |
| US9787487B2 (en) | Facilitating media streaming with social interaction | |
| US9508032B2 (en) | Method of coding, decoding and usage of three-dimensional code | |
| CN112839249B (en) | Virtual gift display method, device, equipment and storage medium | |
| CN105635764B (en) | Method and device for playing push information in live video | |
| EP2961172A1 (en) | Method and device for information acquisition | |
| CN113992934B (en) | Multimedia information processing method, device, electronic equipment and storage medium | |
| CN104065979A (en) | Method for dynamically displaying information related with video content and system thereof | |
| CN107995515A (en) | The method and device of information alert | |
| CN106204168A (en) | Commodity barrage display system, unit and method | |
| CN103782285B (en) | Collection and management to accurate user preference data | |
| CN111800668B (en) | Barrage processing method, barrage processing device, barrage processing equipment and storage medium | |
| CN109862100B (en) | Method and device for pushing information | |
| CN103416073A (en) | Video processing feedback | |
| CN114025188A (en) | Live broadcast advertisement display method, system, device, terminal and readable storage medium | |
| US20210329310A1 (en) | System and method for the efficient generation and exchange of descriptive information with media data | |
| CN114727143A (en) | Multimedia resource display method and device | |
| CN110659006B (en) | Cross-screen display method and device, electronic equipment and readable storage medium | |
| US20170272793A1 (en) | Media content recommendation method and device | |
| CN104283921A (en) | Method and device for releasing microblog | |
| CN112073738A (en) | Information processing method and device | |
| CN110611824B (en) | Highlight video generation method, highlight video generation device using the same, and medium | |
| CN110475121A (en) | A kind of video data handling procedure, device and relevant device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: Tokyo Patentee after: AI Holding Co.,Ltd. Address before: Tokyo, Japan Patentee before: LINE Corp. |
|
| CP03 | Change of name, title or address | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220118 Address after: Tokyo Patentee after: LINE Corp. Address before: Tokyo Patentee before: AI Holding Co.,Ltd. |
|
| TR01 | Transfer of patent right | ||
| CP03 | Change of name, title or address |
Address after: Tokyo, Japan Patentee after: From Zhongzhong Global Co.,Ltd. Country or region after: Japan Address before: Tokyo, Japan Patentee before: LINE Corp. Country or region before: Japan |
|
| CP03 | Change of name, title or address | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240624 Address after: Tokyo, Japan Patentee after: Aiwanwai Co.,Ltd. Country or region after: Japan Address before: Tokyo, Japan Patentee before: From Zhongzhong Global Co.,Ltd. Country or region before: Japan |
|
| TR01 | Transfer of patent right |