CN102447869A

CN102447869A - Role replacement method

Info

Publication number: CN102447869A
Application number: CN2011103310167A
Authority: CN
Inventors: 苏飞
Original assignee: Tianjin Samsung Electronics Co Ltd
Current assignee: Tianjin Samsung Electronics Co Ltd
Priority date: 2011-10-27
Filing date: 2011-10-27
Publication date: 2012-05-09

Abstract

The invention discloses a role replacement method. According to the method, a figure in original shooting is replaced and thus a viewer can immerse himself/herself in a TV scene, so that the sense of reality in the TV scene can be realized and the viewer can have a truly immersive experience. The method comprises the following steps that: a role expression database for image replacement is established; when each frame of image is coded, coding is respectively carried out on different figures and image backgrounds; when decoding is carried out, decoding is respectively carried out on the different figures and image backgrounds of each frame of image; when no role replacement is carried out, all frames of decoded images are stored in a display memory and are displayed in order; and when role replacement is carried out, all frames of decoded images are stored in a buffer and figure mode identification is carried out frame by frame; and a role expression that is required to be replaced in the database is invoked and figure replacement is carried out frame by frame; and then, the replaced figure image is stored in the display memory frame by frame and is displayed in order. According to the role replacement method provided in the invention, coding and decoding are carried out respectively on figures and backgrounds; and the replacement method is simple and is easy to be realized.

Description

A kind of role's alternative method

Technical field

The present invention relates to a kind of role's alternative method.

Background technology

Existing playing audio/video can only be play the audio frequency and video source file that has recorded such as television set, STB, DVD etc.Playback equipment is decoded into the image of a frame frame with raw video image in decoder, be stored in the video memory, is presented in the screen after refreshing.Sometimes some user wants in the scene that oneself incorporates program very much; Such as when seeing some spy war sheet, also want to let son in sheet, play the part of the heroic role who is unrivalled in bravery; Also can see own in the athletic competition or other people gallop on the competition field etc.; Because the restriction of prior art, the user can only watch the role in the program that has recorded, and is difficult to user's sensation on the spot in person.

Summary of the invention

The present invention is in order to overcome weak point of the prior art, a kind of role's alternative method to be provided, personage in the original shooting is substituted, thus realize similar will be own or other people incorporate the sense of reality in the tv scene, give user's sensation on the spot in person.

The present invention realizes through following technical proposals:

A kind of role's alternative method is characterized in that, comprises the steps:

(1) role who sets up the replacement image database of expressing one's feelings;

When (2) every two field picture is encoded different personages and image background are encoded respectively;

When (3) decoding different personages and background image in every two field picture are decoded respectively;

(4) do not carry out the role when replacing, decoded every two field picture deposits video memory in and shows in order;

(5) carry out the role when replacing, decoded every two field picture deposits buffer in, by frame original image is carried out personage's pattern recognition, calls role's expression of replacement image in the database, carries out personage's replacement by frame, deposits video memory in and shows in order by frame.

The present invention has following technique effect:

1, can personage in the original shooting be substituted through role's alternative method of the present invention, thereby realize that similar general oneself or other people incorporate the sense of reality in the tv scene, give user's sensation on the spot in person.

2, the role of the present invention method of replacing is carried out Code And Decode respectively with personage and background, and the replacement method is simple, realizes easily.

Description of drawings

Fig. 1 is the flow chart of role's alternative method of the present invention;

Fig. 2 is a remote controller shortcut OSD sketch map.

Embodiment

Below in conjunction with accompanying drawing and specific embodiment the present invention is elaborated.

Fig. 1 is the flow chart of role's alternative method of the present invention, and role's alternative method of the present invention comprises the steps:

(1) role who sets up replacement image (T) database of expressing one's feelings: in internal memory, distribute personage's database of expressing one's feelings separately; Can own or different expression and the postures of relatives and friends be taken pictures in a large number; Aspect the personage:, be divided into role 1, role 2, role 3...... role n as replacing figure according to role one, role two, the role three in the original image (Y) of correspondence ... role N sets up the database that different personages replace image respectively.Expression aspect: replace in the image data base again different personages the expression of role 1, role 2, role 3...... role n is set up the express one's feelings database of replacement image of different personages respectively according to expressions such as pleasure, anger, sorrow, happiness, compassion, sorrow, think ofs.In the coding of replacement image (T), set up information data like this, the replacement image that obtains after peeling off can obtain personage, expression classification, from the database of correspondence, look for then, thereby the system that offers carries out calling after the pattern recognition.

(2) different personages are encoded respectively with image background during every frame original image coding: objects such as character image and background classify as different objects respectively, then these objects are set up database, can replace separately.

The present invention also has requirement to the coding of original image, and needing coding standard is to target type, as H.264, AVS etc.And when image encoding, the high priest is provided with flag bit; Be that the role replaces " role one ", " role two ", " role three " among the OSD " replacement role " ... " role N "; Every two field picture background is encoded separately; Corresponding role just can be selected in the back thereby decode in the terminal, by replacing after the frame pattern identification, requires the terminal to support the corresponding codes standard equally simultaneously.

When (3) decoding different personages and background image in every frame original image are decoded respectively: the video information that has sign " Role Information numbering " coding is decoded by frame.Decoded replacement image is divided into subject image such as character image and background and sorts out respectively, the time only replaces character image in replacement, and does not influence object such as background.

(4) do not carry out the role when replacing, the role replaces the OSD menu and does not carry out the role and select or do not have OSD menu action, decoded every two field picture to deposit video memory in and show in order.

(5) carry out the role when replacing; Decoded every two field picture deposits buffer in; By frame original image is carried out personage's pattern recognition; Call role one, role two, role three in the original image in the database (Y) ... the pairing replacement image of role N, the role who selects to be replaced carries out personage's replacement by frame at the back of expressing one's feelings, and deposits video memory in by frame and show in order.Fig. 2 is a remote controller shortcut OSD sketch map, replaces shortcut through the role on the remote controller and sends role's replacement instruction, on display screen, demonstrates the role and replaces the OSD menu; Role through the remote controller selection is replaced for example will replace " role one ", confirms whether to replace this role; If replacement, system at first will all deposit buffer memory by every two field picture of frame decoding in and " role one " carried out pattern recognition by frame, call personage's replacement image in the database of replacing image of expressing one's feelings then; Select the image of replacement; For example to replace to " role 2 ", then that " role 2 " are corresponding personage's expression and posture replacement " role one ", and background image is constant; And deposit video memory in by frame, show after refreshing.If do not replace, then withdraw from the role and replace state, continue to play original image.

Pattern recognition is a technology existing in the digital picture, mainly the object of formulating in the image is detected, separates and handles.

1. detect: adopt the track algorithm of edge grey scale change, begin scanning, adjust the path of scanning according to given gamma error restriction Decision boundaries, as up and down, left and right etc. from certain random point.And write down the image coordinate of next point, accomplish object scanning after getting back to initial point, thereby detect object.

2. separate: utilize coordinate value that image pixel is corresponding from the coordinate of image of object to take out formation image separately, and the part that original image stays becomes white, accomplishes and separates.

3. handle: can adopt modes such as image processing techniques strengthens, blurs, witch mirror to handle to isolated image.

Size, profile in the replacement process, the border is inconsistent is inevitable, but is not totally different.At first, big or small aspect can compare replacement image (T) and original image (Y), should replacement image T be adjusted into original image Y size, adopts down-sampling or up-sampling mode to carry out, can Rapid Realization.The profile aspect, replacement image T is that different objects is selected with original image Y, profile can be different, also can play different-effect.Border issue, after the size of object was confirmed, the border can coincide naturally.

In addition, there is error coupling in itself, and image is play with the speed of 25HZ in playing process at least, so fast speed permissible error exist and subjective discover less than.

Claims

1. role's alternative method is characterized in that, comprises the steps: