CN110446092B - Virtual auditorium generation method, system, device and medium for sports game - Google Patents
Virtual auditorium generation method, system, device and medium for sports game Download PDFInfo
- Publication number
- CN110446092B CN110446092B CN201910677880.9A CN201910677880A CN110446092B CN 110446092 B CN110446092 B CN 110446092B CN 201910677880 A CN201910677880 A CN 201910677880A CN 110446092 B CN110446092 B CN 110446092B
- Authority
- CN
- China
- Prior art keywords
- picture
- audience
- light
- competition
- field
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 238000012360 testing method Methods 0.000 claims description 43
- 230000011218 segmentation Effects 0.000 claims description 42
- 230000006870 function Effects 0.000 claims description 4
- 239000012141 concentrate Substances 0.000 abstract description 3
- 238000012545 processing Methods 0.000 abstract description 2
- 230000002452 interceptive effect Effects 0.000 abstract 1
- 230000000694 effects Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 238000004590 computer program Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000010191 image analysis Methods 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000008921 facial expression Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006386 memory function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000003973 paint Substances 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 230000003238 somatosensory effect Effects 0.000 description 1
- 238000012876 topography Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a virtual auditorium generation method, a system, a device and a medium for sports games, wherein the method comprises the steps of obtaining a game picture, dividing the game picture according to a preset dividing boundary so as to divide the game picture into a game field part and a real auditorium part, generating a virtual auditorium, replacing the real auditorium part in the game picture by the generated virtual auditorium, and the like. The method of the invention replaces the original real auditorium part in the competition picture by using the generated virtual auditorium, so that the pure competition field part is reserved in the finally played competition picture, the interference of the real auditorium part is avoided, the off-site audience can concentrate on watching the competition, the observability of the competition picture is improved, and the higher interactive experience is provided. The invention is widely applied to the technical field of image processing.
Description
Technical Field
The invention relates to the technical field of image processing, in particular to a virtual auditorium generation method, a system, a device and a medium for sports games.
Background
Television live broadcast and Internet live broadcast technology can be used for rebroadcasting football, basketball, tennis, badminton, table tennis and other sports games, so that spectators outside the game site can watch wonderful game pictures in real time. In live broadcasting of large-scale games such as national sports games, world tournaments and olympics, in addition to shooting by athletes on a comparison field and a game field, real audience on a real audience and a real audience are shot, so that the shot game picture comprises a game field part and a real audience part. As off-site spectators, the game is concerned by the part of the playing field, while the real spectator part has no great significance for the off-site spectators to watch the game picture, even the existence of the real spectator part can cause negative effects such as reducing the viewability of the game picture, increasing the transmission occupied bandwidth of the game picture, and the like.
Disclosure of Invention
In order to solve the technical problems, the invention aims to provide a virtual auditorium generation method, a system, a device and a medium for sports games.
In one aspect, an embodiment of the present invention includes a virtual audience generation method for a sports game, including the steps of:
obtaining a competition picture;
dividing the competition picture according to a preset dividing boundary so as to divide the competition picture into a competition field part and a real audience part;
generating a virtual audience;
and replacing the real audience space part in the competition picture with the generated virtual audience space.
Further, the step of replacing the real audience member portion in the game screen with the generated virtual audience member specifically includes:
deleting the real audience part in the competition picture;
filling the gap formed by deleting the real audience part by using the generated virtual audience.
Further, the segmentation boundary is preset by the following steps:
projecting a first light to a live audience;
projecting a second light to the field playing field;
shooting the live audience and the live competition field, so as to obtain a test picture;
and analyzing the test picture to determine a boundary formed by intersecting the first light projection area and the second light projection area, thereby obtaining the segmentation boundary.
Further, the segmentation boundary is preset by the following steps:
projecting a first light to a live audience;
removing the light projection of the field competition field;
shooting the live audience and the live competition field, so as to obtain a test picture;
and analyzing the test picture to determine the boundary formed by the first lamplight projection area, thereby obtaining the segmentation boundary.
Further, the segmentation boundary is preset by the following steps:
removing the light projection to the on-site audience;
projecting a second light to the field playing field;
shooting the live audience and the live competition field, so as to obtain a test picture;
and analyzing the test picture to determine the boundary formed by the second lamplight projection area, thereby obtaining the segmentation boundary.
In another aspect, an embodiment of the present invention further includes a virtual audience generation system for a sports game, including:
the picture acquisition module is used for acquiring a competition picture;
the picture segmentation module is used for segmenting the competition picture according to a preset segmentation boundary so as to divide the competition picture into a competition field part and a real audience part;
the virtual generation module is used for generating a virtual audience;
and the picture replacing module is used for replacing the real audience part in the competition picture by using the generated virtual audience.
Further, the virtual auditorium generation system for the sports game further comprises a first light module, a second light module and a shooting module;
the first light module is used for projecting first light to the on-site audience;
the second light module is used for projecting second light to the field competition field;
the shooting module is used for shooting the live audience and the live competition field so as to obtain a test picture;
the picture segmentation module is also used for analyzing the test picture and determining the boundary of the first light projection area and the second light projection area so as to obtain the segmentation boundary.
Further, the virtual auditorium generation system for the sports game further comprises a first light module, a second light module and a shooting module;
the first light module is configured to project a first light to the live audience, and the second light module is configured to release the light projection to the live playing field;
the first light module is configured to project a second light to a field playing field when the first light module is configured to disarm the light projection to the field audience;
the shooting module is used for shooting the live audience and the live competition field so as to obtain a test picture;
the picture segmentation module is also used for analyzing the test picture and determining the boundary of the first light projection area or the second light projection area so as to obtain the segmentation boundary.
In another aspect, an embodiment of the present invention further includes a virtual auditorium generation apparatus for a sports game, including a memory for storing at least one program and a processor for loading the at least one program to perform the method of the embodiment of the present invention.
In another aspect, embodiments of the present invention also include a medium having a memory function in which are stored processor-executable instructions that, when executed by a processor, are used to perform the method of the present invention.
The beneficial effects of the invention are as follows: the method in the embodiment of the invention can ensure that the pure competition field part is reserved in the finally played competition picture by using the generated virtual audience to replace the original real audience part in the competition picture, thereby avoiding the interference of the real audience part, ensuring that off-site audiences can concentrate on watching the competition and improving the viewability of the competition picture. When the method in this embodiment is executed by the broadcasting end, since the transmitted competition frame does not include the real audience part, the required transmission bandwidth is small, and network resources are saved. Because the virtual auditorium has stronger interaction performance, the method in the embodiment can provide higher interaction experience.
Drawings
FIG. 1 is a flow chart of a virtual auditorium generation method for a sporting event in accordance with an embodiment of the present invention;
FIG. 2 is a schematic diagram showing the effects of a test or game screen according to an embodiment of the present invention;
FIG. 3 is a schematic diagram showing the effect of a game screen after the real auditorium is deleted according to the embodiment of the invention;
fig. 4 is a schematic diagram showing an effect of a game screen after a virtual auditorium is replaced in an embodiment of the present invention;
fig. 5 is a block diagram of a virtual auditorium generation system for sports events in accordance with an embodiment of the invention.
Detailed Description
The present embodiment includes a virtual auditorium generation method for sports games, referring to fig. 1, including the steps of:
s1, obtaining a competition picture;
s2, dividing the competition picture according to a preset dividing boundary, so as to divide the competition picture into a competition field part and a real audience part;
s3, generating a virtual audience;
s4, replacing the real audience part in the competition picture by using the generated virtual audience.
The present embodiment introduces the virtual auditorium generation method for sports games through a scenario in which: the television station or the internet television operator enters a gym to shoot a match, and sends video signals to a mobile phone or a tablet personal computer and other terminals used by off-site audiences through the medium such as the internet, so that the off-site audiences can watch the match pictures through the terminals.
In this embodiment, a photographing apparatus, a video signal generating apparatus, a communication apparatus, and the like used by a television station are collectively referred to as a broadcasting terminal, and a mobile phone, a tablet computer, and the like used by an off-site viewer are referred to as a broadcasting terminal.
In the virtual auditorium generation method for sports games of this embodiment, all the steps may be performed by the broadcasting end or the playing end.
When all the steps of the method in this embodiment are performed by the broadcasting terminal, the step S1 is that the broadcasting terminal shoots on site to obtain a competition screen, then divides the competition screen into a competition field part and a real audience part, and replaces the real audience part in the competition screen with the generated virtual audience. Finally, the broadcasting end broadcasts and sends the competition pictures subjected to the replacement operation through media such as the Internet, and each broadcasting end receives signals and plays the signals.
When all the steps of the method in the embodiment are executed by the broadcasting terminal, the broadcasting terminal shoots on site to obtain a competition picture, and the competition picture subjected to the replacement operation is broadcast and transmitted through media such as the internet. The step S1 is that the playing end receives the playing image signal, then divides the playing image into a playing field part and a real audience part, and replaces the real audience part in the playing image with the generated virtual audience. Finally, the playing end plays the competition picture subjected to the replacement operation.
The virtual audience may be generated using existing techniques. The virtual auditorium can be an animation generated according to a computer graphic technology, can be a character image with expression generated through an artificial intelligence technology, and can also be generated by collecting facial expression of a user through a camera or a somatosensory device and the like.
The segmentation boundary described in step S2 may be determined from pixel coordinates in a pre-stored set of game frames. The pixels located on the dividing boundary divide the game picture into a playing field portion and a real audience portion. Wherein the playing field part comprises, besides the playing field, athletes and staff playing on the playing field, and sometimes spectators entering into the playing field for activity; the real audience member includes, in addition to the audience facilities such as chairs and stands, audience members and staff sitting or standing on the audience facilities, and sometimes athletes who enter the audience facilities to perform activities.
According to the method, the generated virtual auditorium is used for replacing the original real auditorium part in the competition picture, so that the pure competition field part is reserved in the finally played competition picture, interference from the real auditorium part is avoided, off-site spectators can concentrate on watching the competition, and the viewability of the competition picture is improved. When the method in this embodiment is executed by the broadcasting end, since the transmitted competition frame does not include the real audience part, the required transmission bandwidth is small, and network resources are saved. Because the virtual auditorium has stronger interaction performance, the method in the embodiment can provide higher interaction experience.
Further, as a preferred embodiment, the step S4, that is, the step of replacing the real audience member portion in the game screen with the generated virtual audience member, specifically includes:
s401, deleting the real audience part in the competition picture;
s402, filling the gap formed after the real audience part is deleted by using the generated virtual audience.
In this embodiment, the step S4 specifically includes steps S401 and S402.
First, step S401 is performed, specifically, by dividing a boundary, determining the real audience member in the game screen, and then deleting the real audience member from the game screen, so that only the game field portion is temporarily reserved in the game screen. At this time, since the size of the game screen is unchanged, a gap will be formed after the real audience member is deleted from the game screen. Then, step S402 is executed to adjust the size of the generated virtual auditorium to be the same as the gap through means such as linear scaling, twisting or rotation, and then fill the virtual auditorium into the gap, thereby realizing adjustment of the game screen.
Further as a preferred embodiment, the dividing boundary is preset by:
SP1A, projecting a first light to a live audience;
SP2A, projecting a second light to the field playing field;
SP3A, shooting the live audience and the live competition field, so as to obtain a test picture;
and SP4A, analyzing the test picture, and determining a boundary formed by intersecting the first light projection area and the second light projection area, so as to obtain the segmentation boundary.
The steps SP1A-SP4A are a first preset manner of the dividing boundary, and the steps SP1A-SP4A are performed before the step S1 is performed.
Steps SP1A and SP2A are performed by means of light devices arranged in the field, which are controllable and which can be controlled by the broadcasting or playing end for performing steps S1-S4, the control parameters including light color, brightness, lighting time, etc. Step SP3A is performed by a photographing apparatus installed in the field, and when photographing the test picture and performing steps S1 to S4 to photograph the formal competition picture, photographing parameters such as the position of the photographing apparatus, photographing angle, and focal length are preferably kept the same, so that the division boundary obtained by steps SP1A to SP4A can be directly used for steps S1 to S4.
Step SP1A and step SP2A may be performed simultaneously. The first light projected onto the live audience in step SP1A and the second light projected onto the live playing surface in step SP2A preferably have different colors. In this way, in the test screen obtained by executing step SP3A, the area where the first light and the second light are projected respectively is photographed. The boundary formed by the intersection of the first light projection area and the second light projection area is the segmentation boundary to be detected. The color of each part in the test picture is analyzed through an image analysis technology, the boundary formed by intersecting the first light projection area and the second light projection area can be determined, and the coordinates of each pixel positioned on the boundary are recorded, so that the segmentation boundary can be determined.
Further as a preferred embodiment, the dividing boundary is preset by:
SP1B, projecting a first light to the scene audience;
SP2B, releasing the light projection to the field competition area;
SP3B, shooting the live audience and the live competition field, so as to obtain a test picture;
and SP4B, analyzing the test picture, and determining a boundary formed by the first lamplight projection area so as to obtain the segmentation boundary.
The steps SP1B-SP4B are a second preset manner of the dividing boundary, and the steps SP1B-SP4B are performed before the step S1 is performed.
Steps SP1B and SP2B are performed by means of light devices arranged in the field, which are controllable and which can be controlled by the broadcasting or playing end for performing steps S1-S4, the control parameters including light color, brightness, lighting time, etc. Step SP3B is performed by a photographing apparatus installed in the field, and when photographing the test picture and performing steps S1 to S4 to photograph the formal competition picture, photographing parameters such as the position of the photographing apparatus, photographing angle, and focal length are preferably kept the same, so that the division boundary obtained by steps SP1B to SP4B can be directly used for steps S1 to S4.
Step SP1B and step SP2B may be performed simultaneously. In step SP2B, the light projection is released, which means that all the lights projected to the field playing field are turned off. In this way, in the test screen obtained by executing step SP3B, only the area formed by the first light projection is photographed. The edge of the first light projection area is the segmentation boundary to be detected. The color of each part in the test picture is analyzed through an image analysis technology, the boundary of the first lamplight projection area can be determined, and the coordinates of each pixel positioned on the boundary are recorded, so that the segmentation boundary can be determined.
Further as a preferred embodiment, the dividing boundary is preset by:
SP1C, releasing the light projection to the on-site audience;
SP2C, projecting a second light to the field playing field;
SP3C, shooting the live audience and the live competition field, so as to obtain a test picture;
and SP4C, analyzing the test picture, and determining a boundary formed by the second lamplight projection area so as to obtain the segmentation boundary.
The steps SP1C-SP4C are a third preset manner of the dividing boundary, and the steps SP1C-SP4C are performed before the step S1 is performed.
Steps SP1C and SP2C are performed by means of light devices arranged in the field, which are controllable and which can be controlled by the broadcasting or playing end for performing steps S1-S4, the control parameters including light color, brightness, lighting time, etc. Step SP3C is performed by a photographing apparatus installed in the field, and when photographing the test picture and performing steps S1 to S4 to photograph the formal competition picture, photographing parameters such as the position of the photographing apparatus, photographing angle, and focal length are preferably kept the same, so that the division boundary obtained by steps SP1C to SP4C can be directly used for steps S1 to S4.
Step SP1C and step SP2C may be performed simultaneously. In step SP1C, the light projection is released, which means that all lights projected to the on-site auditorium are turned off. In this way, in the test screen obtained by executing step SP3C, only the area formed by the second light projection is photographed. The edge of the second light projection area is the segmentation boundary to be detected. The color of each part in the test picture is analyzed through an image analysis technology, the boundary of the second lamplight projection area can be determined, and the coordinates of each pixel positioned on the boundary are recorded, so that the segmentation boundary can be determined.
By executing the steps SP1A to SP4A, SP1B to SP4B or SP1C to SP4C, the position of the dividing boundary can be quickly determined, thereby making an accurate cut of the game screen when the game screen is formally photographed. The steps SP1A-SP4A, SP1B-SP4B or SP1C-SP4C are not dependent on the structure or the topography of the playing field, and can be realized only by matching the field lights, so that the method can be suitable for various competition venues and the use cost of the virtual audience mat generation method for the sports competition in the embodiment is reduced.
The following is a more complete implementation of the virtual auditorium generation method for sports events in this embodiment:
(1) The test screen shown in fig. 2 may be obtained by projecting the first light and/or the second light to the live audience and the live playing field, and then photographing the live audience and the live playing field. In fig. 2, 1 is a real audience member portion corresponding to a live audience, and 2 is a playing field portion corresponding to a live playing field.
(2) Analyzing the test picture shown in fig. 2 to determine a boundary formed by the projection areas of the first light and/or the second light, thereby determining a segmentation boundary;
(3) Starting to acquire an actual competition picture; when the same camera position, shooting angle, focal length and other shooting parameters are used, the form of the competition picture is also shown in fig. 2;
(4) Dividing the competition picture shown in fig. 2 by the dividing boundary obtained in the step (2), so as to divide the competition picture into a real audience part and a competition field part;
(5) Deleting the real audience part in the competition frame shown in fig. 2, so that the competition frame only leaves the competition field part shown in fig. 3; when the size of the competition picture is not changed, the original position of the real audience part becomes a gap for filling;
(5) A virtual auditorium is generated and then the real auditorium portion of the game frame is replaced with the generated virtual auditorium, resulting in a game frame as shown in fig. 4. In fig. 4, 2 is a playing field portion, and 3 is a virtual audience.
(6) Playing the game screen as shown in fig. 4.
The present embodiment also includes a virtual auditorium generation system for a sports game, referring to fig. 5, including:
the picture acquisition module is used for acquiring a competition picture;
the picture segmentation module is used for segmenting the competition picture according to a preset segmentation boundary so as to divide the competition picture into a competition field part and a real audience part;
the virtual generation module is used for generating a virtual audience;
and the picture replacing module is used for replacing the real audience part in the competition picture by using the generated virtual audience.
The picture acquisition module, the picture segmentation module, the virtual generation module and the picture replacement module can be hardware modules or software modules with corresponding functions on a computer system.
Further as a preferred embodiment, the virtual auditorium generation system for sports games further comprises a first light module, a second light module and a shooting module. The first light module and the second light module can be two sets of completely independent light modules, and can also be different lamps or luminous bodies in the same set of light modules. The photographing module may be a photographing device such as a video camera.
The following is one use of the first light module, the second light module, and the shooting module in this embodiment:
the first light module is used for projecting first light to the on-site audience;
the second light module is used for projecting second light to the field competition field;
the shooting module is used for shooting the live audience and the live competition field so as to obtain a test picture;
the picture segmentation module is also used for analyzing the test picture and determining the boundary of the first light projection area and the second light projection area so as to obtain the segmentation boundary.
In one application of the first light module, the second light module and the shooting module, the first light module and the second light module work simultaneously, respectively project the first light and the second light with different colors to the on-site auditorium and the on-site competition field, and then shoot by the shooting module to obtain the test picture.
The following is another use of the first light module, the second light module, and the shooting module in this embodiment:
the first light module is configured to project a first light to the live audience, and the second light module is configured to release the light projection to the live playing field;
the first light module is configured to project a second light to a field playing field when the first light module is configured to disarm the light projection to the field audience;
the shooting module is used for shooting the live audience and the live competition field so as to obtain a test picture;
the picture segmentation module is also used for analyzing the test picture and determining the boundary of the first light projection area or the second light projection area so as to obtain the segmentation boundary.
In another application of the first light module, the second light module and the shooting module, the first light module and the second light module do not work simultaneously, that is, when the first light module works, the second light module does not work, and when the second light module works, the first light module does not work. Specifically, when the first light module works, the first light module projects first light to the on-site audience, and the second light module does not work, so that the on-site competition field is not projected by the light, and on the visual effect, the on-site competition field is black; when the second light module works, the second light module projects second light to the field competition field, and the first light module does not work, so that the field auditorium is not projected by the light, and the field auditorium is black in paint on visual effect.
The embodiment also includes a virtual auditorium generation device for a sports game, including a memory for storing at least one program and a processor for loading the at least one program to perform the method of the embodiment of the invention. The virtual auditorium generating device for sports games can be a mobile phone, a tablet computer and other terminals.
The present embodiment also includes a medium having stored therein processor-executable instructions for performing the virtual audience generation method for a sports game of the present invention when executed by a processor.
The virtual auditorium generation system, the virtual auditorium generation device and the virtual auditorium generation medium for the sports game can execute the virtual auditorium generation method for the sports game, and any combination of the embodiments of the executable method can implement the steps, so that the virtual auditorium generation method has the corresponding functions and beneficial effects.
It should be noted that, unless otherwise specified, when a feature is referred to as being "fixed" or "connected" to another feature, it may be directly or indirectly fixed or connected to the other feature. Further, the descriptions of the upper, lower, left, right, etc. used in this disclosure are merely with respect to the mutual positional relationship of the various components of this disclosure in the drawings. As used in this disclosure, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. In addition, unless defined otherwise, all technical and scientific terms used in this example have the same meaning as commonly understood by one of ordinary skill in the art. The terminology used in the description of the embodiments is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The term "and/or" as used in this embodiment includes any combination of one or more of the associated listed items.
It should be understood that although the terms first, second, third, etc. may be used in this disclosure to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element of the same type from another. For example, a first element could also be termed a second element, and, similarly, a second element could also be termed a first element, without departing from the scope of the present disclosure. The use of any and all examples, or exemplary language (e.g., "such as") provided herein, is intended merely to better illuminate embodiments of the invention and does not pose a limitation on the scope of the invention unless otherwise claimed.
It should be appreciated that embodiments of the invention may be implemented or realized by computer hardware, a combination of hardware and software, or by computer instructions stored in a non-transitory computer readable memory. The methods may be implemented in a computer program using standard programming techniques, including a non-transitory computer readable medium configured with a computer program, where the medium so configured causes a computer to operate in a specific and predefined manner, in accordance with the methods and drawings described in the specific embodiments. Each program may be implemented in a high level procedural or object oriented programming language to communicate with a computer system. However, the program(s) can be implemented in assembly or machine language, if desired. In any case, the language may be a compiled or interpreted language. Furthermore, the program can be run on a programmed application specific integrated circuit for this purpose.
Furthermore, the operations of the processes described in the present embodiments may be performed in any suitable order unless otherwise indicated herein or otherwise clearly contradicted by context. The processes (or variations and/or combinations thereof) described in this embodiment may be performed under control of one or more computer systems configured with executable instructions, and may be implemented as code (e.g., executable instructions, one or more computer programs, or one or more applications), by hardware, or combinations thereof, that collectively execute on one or more processors. The computer program includes a plurality of instructions executable by one or more processors.
Further, the method may be implemented in any type of computing platform operatively connected to a suitable computing platform, including, but not limited to, a personal computer, mini-computer, mainframe, workstation, network or distributed computing environment, separate or integrated computer platform, or in communication with a charged particle tool or other imaging device, and so forth. Aspects of the invention may be implemented in machine-readable code stored on a non-transitory medium or device, whether removable or integrated into a computing platform, such as a hard disk, optical read and/or write media, RAM, ROM, etc., such that it is readable by a programmable computer, which when read by a computer, is operable to configure and operate the computer to perform the processes described herein. Further, the machine readable code, or portions thereof, may be transmitted over a wired or wireless network. When such media includes instructions or programs that, in conjunction with a microprocessor or other data processor, implement the steps described above, the invention described in this embodiment includes these and other different types of non-transitory computer-readable media. The invention also includes the computer itself when programmed according to the methods and techniques of the present invention.
The computer program can be applied to the input data to perform the functions described in this embodiment, thereby converting the input data to generate output data that is stored to the non-volatile memory. The output information may also be applied to one or more output devices such as a display. In a preferred embodiment of the invention, the transformed data represents physical and tangible objects, including specific visual depictions of physical and tangible objects produced on a display.
The present invention is not limited to the above embodiments, but can be modified, equivalent, improved, etc. by the same means to achieve the technical effects of the present invention, which are included in the spirit and principle of the present invention. Various modifications and variations are possible in the technical solution and/or in the embodiments within the scope of the invention.
Claims (10)
1. A method of virtual auditorium generation for a sports game, comprising the steps of:
obtaining a competition picture;
dividing the competition picture according to a preset dividing boundary so as to divide the competition picture into a competition field part and a real audience part;
generating a virtual audience;
and replacing the real audience space part in the competition picture with the generated virtual audience space.
2. A method of generating virtual auditoriums for sports games according to claim 1, characterized in that said step of replacing said real auditorium portions in said game frame with said generated virtual auditoriums comprises:
deleting the real audience part in the competition picture;
filling the gap formed by deleting the real audience part by using the generated virtual audience.
3. A virtual auditorium generation method for sports games according to claim 1, characterized in that the segmentation boundaries are preset by the following steps:
projecting a first light to a live audience;
projecting a second light to the field playing field;
shooting the live audience and the live competition field, so as to obtain a test picture;
and analyzing the test picture to determine a boundary formed by intersecting the first light projection area and the second light projection area, thereby obtaining the segmentation boundary.
4. A virtual auditorium generation method for sports games according to claim 1, characterized in that the segmentation boundaries are preset by the following steps:
projecting a first light to a live audience;
removing the light projection of the field competition field;
shooting the live audience and the live competition field, so as to obtain a test picture;
and analyzing the test picture to determine the boundary formed by the first lamplight projection area, thereby obtaining the segmentation boundary.
5. A virtual auditorium generation method for sports games according to claim 1, characterized in that the segmentation boundaries are preset by the following steps:
removing the light projection to the on-site audience;
projecting a second light to the field playing field;
shooting the live audience and the live competition field, so as to obtain a test picture;
and analyzing the test picture to determine the boundary formed by the second lamplight projection area, thereby obtaining the segmentation boundary.
6. A virtual auditorium generation system for a sporting event, comprising:
the picture acquisition module is used for acquiring a competition picture;
the picture segmentation module is used for segmenting the competition picture according to a preset segmentation boundary so as to divide the competition picture into a competition field part and a real audience part;
the virtual generation module is used for generating a virtual audience;
and the picture replacing module is used for replacing the real audience part in the competition picture by using the generated virtual audience.
7. The virtual auditorium generation system for sporting events of claim 6, further comprising a first light module, a second light module, and a capture module;
the first light module is used for projecting first light to the on-site audience;
the second light module is used for projecting second light to the field competition field;
the shooting module is used for shooting the live audience and the live competition field so as to obtain a test picture;
the picture segmentation module is also used for analyzing the test picture and determining the boundary of the first light projection area and the second light projection area so as to obtain the segmentation boundary.
8. The virtual auditorium generation system for sporting events of claim 6, further comprising a first light module, a second light module, and a capture module;
the first light module is configured to project a first light to the live audience, and the second light module is configured to release the light projection to the live playing field;
the first light module is configured to project a second light to a field playing field when the first light module is configured to disarm the light projection to the field audience;
the shooting module is used for shooting the live audience and the live competition field so as to obtain a test picture;
the picture segmentation module is also used for analyzing the test picture and determining the boundary of the first light projection area or the second light projection area so as to obtain the segmentation boundary.
9. A virtual auditorium generation device for a sports game, comprising a memory for storing at least one program and a processor for loading the at least one program to perform the method of any of claims 1-5.
10. A medium having a storage function in which processor-executable instructions are stored, wherein the processor-executable instructions, when executed by a processor, are for performing the method of any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910677880.9A CN110446092B (en) | 2019-07-25 | 2019-07-25 | Virtual auditorium generation method, system, device and medium for sports game |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910677880.9A CN110446092B (en) | 2019-07-25 | 2019-07-25 | Virtual auditorium generation method, system, device and medium for sports game |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110446092A CN110446092A (en) | 2019-11-12 |
| CN110446092B true CN110446092B (en) | 2023-06-20 |
Family
ID=68431538
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910677880.9A Active CN110446092B (en) | 2019-07-25 | 2019-07-25 | Virtual auditorium generation method, system, device and medium for sports game |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110446092B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114173068A (en) * | 2021-10-29 | 2022-03-11 | 北京中联合超高清协同技术中心有限公司 | System for audience and rebroadcasting site remote interaction |
| CN114071180A (en) * | 2021-11-24 | 2022-02-18 | 上海哔哩哔哩科技有限公司 | Live broadcast room display method and device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003333572A (en) * | 2002-05-08 | 2003-11-21 | Nippon Hoso Kyokai <Nhk> | Virtual audience formation apparatus and method, virtual audience formation receiving apparatus and method, and virtual audience formation program |
| CN101604325A (en) * | 2009-07-17 | 2009-12-16 | 北京邮电大学 | Method for classifying sports video based on key frame of main scene lens |
| EP2150057A2 (en) * | 2008-07-29 | 2010-02-03 | Gerald Curry | Camera-based tracking and position determination for sporting events |
| CN104159006A (en) * | 2014-08-22 | 2014-11-19 | 苏州乐聚一堂电子科技有限公司 | Virtual audience image system for live stage background of concert |
| CN106686405A (en) * | 2016-12-28 | 2017-05-17 | 深圳市奥拓电子股份有限公司 | Video rebroadcasting method and system |
| CN107613223A (en) * | 2017-09-11 | 2018-01-19 | 广东欧珀移动通信有限公司 | Image processing method and device, electronic device, and computer-readable storage medium |
| CN108881938A (en) * | 2018-08-02 | 2018-11-23 | 佛山龙眼传媒科技有限公司 | Live video intelligently cuts broadcasting method and device |
| CN108985229A (en) * | 2018-07-17 | 2018-12-11 | 北京果盟科技有限公司 | A kind of intelligent advertisement replacement method and system based on deep neural network |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8625845B2 (en) * | 2005-08-06 | 2014-01-07 | Quantum Signal, Llc | Overlaying virtual content onto video stream of people within venue based on analysis of the people within the video stream |
| KR101270780B1 (en) * | 2011-02-14 | 2013-06-07 | 김영대 | Virtual classroom teaching method and device |
| US9269003B2 (en) * | 2013-04-30 | 2016-02-23 | Qualcomm Incorporated | Diminished and mediated reality effects from reconstruction |
| US9395904B2 (en) * | 2013-08-26 | 2016-07-19 | Venuenext, Inc. | Providing game and facility information to in-stadium spectators |
-
2019
- 2019-07-25 CN CN201910677880.9A patent/CN110446092B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003333572A (en) * | 2002-05-08 | 2003-11-21 | Nippon Hoso Kyokai <Nhk> | Virtual audience formation apparatus and method, virtual audience formation receiving apparatus and method, and virtual audience formation program |
| EP2150057A2 (en) * | 2008-07-29 | 2010-02-03 | Gerald Curry | Camera-based tracking and position determination for sporting events |
| CN101604325A (en) * | 2009-07-17 | 2009-12-16 | 北京邮电大学 | Method for classifying sports video based on key frame of main scene lens |
| CN104159006A (en) * | 2014-08-22 | 2014-11-19 | 苏州乐聚一堂电子科技有限公司 | Virtual audience image system for live stage background of concert |
| CN106686405A (en) * | 2016-12-28 | 2017-05-17 | 深圳市奥拓电子股份有限公司 | Video rebroadcasting method and system |
| CN107613223A (en) * | 2017-09-11 | 2018-01-19 | 广东欧珀移动通信有限公司 | Image processing method and device, electronic device, and computer-readable storage medium |
| CN108985229A (en) * | 2018-07-17 | 2018-12-11 | 北京果盟科技有限公司 | A kind of intelligent advertisement replacement method and system based on deep neural network |
| CN108881938A (en) * | 2018-08-02 | 2018-11-23 | 佛山龙眼传媒科技有限公司 | Live video intelligently cuts broadcasting method and device |
Non-Patent Citations (1)
| Title |
|---|
| 虚拟现实技术在大学生篮球联赛转播中的应用;滑翔;;中国广播电视学刊(12);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110446092A (en) | 2019-11-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105264876B (en) | Method and system for low-cost television production | |
| US10382680B2 (en) | Methods and systems for generating stitched video content from multiple overlapping and concurrently-generated video instances | |
| US11354816B2 (en) | Virtual image processing method, image processing system, and storage medium | |
| US5737031A (en) | System for producing a shadow of an object in a chroma key environment | |
| US9751015B2 (en) | Augmented reality videogame broadcast programming | |
| CN106730815B (en) | Somatosensory interaction method and system easy to realize | |
| CN105939481A (en) | Interactive three-dimensional virtual reality video program recorded broadcast and live broadcast method | |
| CN111357295B (en) | Method and system for fusing user-specific content into video production | |
| WO2016019770A1 (en) | Method, device and storage medium for picture synthesis | |
| US8768099B2 (en) | Method, apparatus and system for alternate image/video insertion | |
| US8885022B2 (en) | Virtual camera control using motion control systems for augmented reality | |
| CN101547316A (en) | Image capture apparatus and method | |
| CN101547309A (en) | Image processing apparatus, image processing method, and program | |
| CN113473207B (en) | Live broadcast method and device, storage medium and electronic equipment | |
| KR20160048178A (en) | A Method and System for Producing a Video Production | |
| JP7542940B2 (en) | Information processing device, information processing method, image processing system, and program | |
| TW201333837A (en) | Image capture method and mobile camera device thereof | |
| CN104104873A (en) | Orbit shooting method, shooting method of object motion trails and mobile terminal | |
| US9154710B2 (en) | Automatic camera identification from a multi-camera video stream | |
| CN110446092B (en) | Virtual auditorium generation method, system, device and medium for sports game | |
| CN106296686A (en) | One is static and dynamic camera combines to moving object three-dimensional reconstruction method frame by frame | |
| CN107734244A (en) | Panorama movie playback method and playing device | |
| CN107333144A (en) | Multichannel picture display process and device based on football race broadcast relay system | |
| CN102740029A (en) | Light emitting diode (LED) display module, LED television and LED television system | |
| CN117974796A (en) | XR augmented reality camera calibration method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20221017 Address after: Room 1602, 16th Floor, Building 18, Yard 6, Wenhuayuan West Road, Beijing Economic and Technological Development Zone, Daxing District, Beijing 100176 Applicant after: Beijing Lajin Zhongbo Technology Co.,Ltd. Address before: 310000 room 650, building 3, No. 16, Zhuantang science and technology economic block, Xihu District, Hangzhou City, Zhejiang Province Applicant before: Tianmai Juyuan (Hangzhou) Media Technology Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |