WO2018074658A1 - Terminal and method for implementing hybrid subtitle effect - Google Patents

Abstract

The present invention relates to a terminal and a method for implementing a hybrid subtitle effect. The present invention may comprises: a first accent and syllable sync means (151a) for extracting, from the storage unit (140), a subtitle sentence unit displayed in an original subtitle area (T1) per frame unit, analyzing an accent of each word constituting each subtitle sentence unit or an accent of the entire sentence on the basis of original subtitle information per frame unit, and dividing a syllable part into at least one syllable part in each subtitle sentence unit, and then implementing the hybrid subtitle effect on at least one phonemic part (I1) analyzed by the accent. Therefore, it is possible to specify and display accent, pronunciation, syllable, etc., thereby providing an effect of improving the efficiency of language learning. Furthermore, the accent and syllable part of the subtitle are matched to a sync of audio signals of a video so that it is possible to realize various operation effects, thereby providing an effect of maximizing the English learning effect. In addition, the present invention displays not only the accents on the original subtitles, but also the accents on the basis of the subtitles whose pronunciation is converted into a mother tongue and a multinational language, thereby providing an effect of improving the understanding of language learning through a more intuitive screen configuration as compared with the conventional technology.

Description

Hybrid subtitle effect implementation terminal and method

The present invention relates to a terminal and method for implementing a hybrid subtitle effect, and more particularly, to a terminal and method for implementing a hybrid subtitle effect to provide an effective language learning method by implementing various subtitle effects in a player.

Recently, for more efficient language learning, more and more users are interested in learning through video contents such as foreign movies and dramas.

In this regard, FIG. 1 is a diagram illustrating a user interface (UI) screen in which a caption effect is implemented in a general terminal 1. Referring to FIG. 1, when a language learning subtitle effect is implemented according to the prior art, an original subtitle area T1 for implementing original subtitle information and a translation subtitle area for implementing translated subtitle information translated from a native language into native language ( It can be seen that T2) is provided.

In addition, an area for implementing only original subtitle information or only translated subtitle information translated into each native language is provided.

The language learning through the video content is a dialogue of the character in which the learning standard appears in the video content, and learning such as listening or reading is performed through the pronunciation and text information when the character speaks the dialogue in the video content.

However, in the conventional subtitle structure, the emphasis, pronunciation, and syllable notation of the language corresponding to the original subtitle information is impossible, and it is not easy to separate words or sentences of the corresponding language, and thus missed sentences, There are many words, and eventually there is a problem that there is a limit in learning English using subtitles.

(Prior art document)

(Patent Document 1) Korean Patent Application No. 10-2015-0046366 "METHOD AND APPARATUS FOR PROCESSING CAPTION IN DIGITAL BROADCASTING"

(Patent Document 2) Korean Patent Registration Publication No. 10-0989503 "METHOD AND APPARATUS FOR COMPOSITION OF SUBTITLES"

(Patent Document 3) Korean Patent Laid-Open Publication No. 10-2016-0106302 "Apparatus and Method for Creating Subtitle File for Edited Video (APPARATUS AND METHOD FOR GENERATING CAPTION FILE OF EDITED VIDEO)"

(Patent Document 4) Korean Patent Registration Publication No. 10-1188950 "VIDEO SIGNAL TRANSMITTING APPARATUS AND SUBTITLE REPLACING METHOD"

The present invention is to solve the above problems, and to provide a terminal and method for implementing a hybrid caption effect for displaying the subtitles of the image content in the form of stress, pronunciation, syllables, etc. in the font, color change, and the like.

In addition, the present invention provides a terminal and method for implementing a hybrid subtitle effect for maximizing the English learning effect by enabling the emphasizing, syllable portion of the subtitle is matched to the sync of the audio signal of the image to implement a variety of motion effects.

In addition, the present invention by expressing not only the stress expression for the original subtitle, but also based on the subtitle translated into the native language, to improve the understanding of language learning through a more intuitive screen configuration than the conventional technology A hybrid caption effect implementation terminal and method are provided.

However, the objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned will be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, the hybrid caption effect implementing terminal according to an embodiment of the present invention may include a caption sentence unit displayed in the original caption region T1 or the translation caption region T2 for each frame unit in the storage 140. Extracts and analyzes the stress of each word constituting each subtitle sentence unit or the stress of the entire sentence based on the original subtitle information of each frame unit, and divides the syllable part into at least one syllable part in each subtitle sentence unit. First stress and syllable syncing means 151a for implementing a hybrid subtitle effect on the analyzed at least one phoneme portion I1; It may include.

In this case, the hybrid subtitle effect may be a font effect of up or down of a font unit, a font size or color effect of a phoneme or a character, or an example of each character of the phoneme part I1. It may be a preset operation effect.

The first accent and syllable syncing means 151a may extract sync flag information for outputting at least one or more phoneme portions I1 analyzed as stresses among the divided syllable parts.

In addition, the first accent and syllable sync means 151a may implement effects on at least one or more phoneme portions I1 analyzed as accents matching the sync flag information.

In addition, the first accent and syllable syncing means 151a may implement a hybrid subtitle area T3 on which the font effect or motion effect is implemented, above the original subtitle area T1, or utilize the original subtitle area T1. Can be implemented.

In addition, the first accent and syllable syncing means 151a converts the original subtitle information output to the original subtitle area T1 into Korean pronunciation, and then analyzes the phoneme portion of the Korean pronunciation based on the converted Korean pronunciation. For (I2), the size of the font may be embodied as the original caption area T1 or the hybrid caption area T3 at a magnification set in advance than the reference size.

The present invention also extracts at least one phoneme portion I3 analyzed with accent matching that matches the sync flag information extracted by the first accent and syllable sync means 151a. A second accent and syllable syncing means 151b for applying the hybrid caption effect to only the extracted phoneme part I3 to implement the UI screen on the input / output unit 110 only for the character to which the hybrid caption effect is applied; It may further include.

Also, the second accent and syllable syncing means 151b converts the original subtitle output to the original subtitle area T1 into Korean pronunciation, and then analyzes the phoneme portion of the Korean pronunciation based on the converted Korean pronunciation. After extracting only I4), the hybrid caption effect on only the extracted phoneme part I4 may be applied to implement the UI screen on the input / output unit 110 only for the character to which the hybrid caption effect is applied.

The present invention also recognizes sync flag information (sync flag) for the extracted phoneme portions (I1, I2) by the first stress and syllable sync means (151a), and simultaneously operates the operation codes (I5, I5 '). Third accent and syllable syncing means (151c) displayed above the first character of the phoneme; It may further include.

The present invention also provides sync flag information (sync flag) for outputting at least one or more phoneme parts analyzed as stresses among syllable parts divided by each subtitle sentence unit by the first accent and syllable sync means 151a. If extracted, language conversion means 151d for extracting the original subtitle information implemented in the original subtitle area T1 from the storage unit 140 and converting the original subtitle information to another foreign language or another foreign language pronunciation through a multinational language pronunciation conversion module; It may further include.

In addition, according to the present invention, the language converted by the language conversion means 151d may include any multinational language using a language other than English as a native language.

In addition, the present invention, after extracting the sync flag information (sync flag) for outputting at least one or more phoneme portion (I1 ') analyzed as stress, the accent matching with the sync flag information according to recognition of each sync flag information (sync flag) Speech balloon effect providing means 151e for implementing a hybrid caption effect on at least one phoneme part I1 ′ analyzed into the speech bubble icon I8; It may further include.

The present invention also analyzes the stress of each word constituting each subtitle sentence unit or the stress of an entire sentence based on the original subtitle information of each frame unit, and divides the syllable part into at least one syllable part in each subtitle sentence unit. For example, the hybrid subtitle effect may be implemented on at least one or more phoneme parts analyzed as stresses.

In addition, the hybrid subtitle effect of the present invention may be implemented by the hybrid subtitle alone, or with the original subtitle, or with a subtitle translated into a multilingual language, or may be implemented with a translation subtitle.

In addition, the hybrid subtitle effect implementation method according to an embodiment of the present invention to achieve the above object, at least one syllable portion in each subtitle sentence unit analyzed by the control unit 150 of the hybrid subtitle effect implementation terminal 100 A first step of extracting sync flag information for outputting at least one or more phoneme parts analyzed as stresses among the divided syllable parts; And when the controller 150 implements the caption sentence information consisting of a set of caption sentence units together with a video or an image as the input / output unit 110, the controller 150 matches the extracted sync flag information according to the extracted sync flag information. A second step of implementing a hybrid subtitle effect on the analyzed at least one phoneme portion; It may include.

In this case, the hybrid subtitle effect of the second step may be one of a font size / color effect and an operation effect.

In addition, before the first step, a first preparatory process of the control unit 150 to extract the caption sentence unit displayed in the original caption area (T1) for each frame unit in the storage unit 140; This can be done further.

In addition, between the first preparation process and the first step, the controller 150 stresses each word constituting each subtitle sentence unit based on the original subtitle information for each frame unit implemented in the original subtitle area T1 or A second preparation process of analyzing the stress of the whole sentence; This can be done further.

The terminal and method for implementing a hybrid subtitle effect according to an embodiment of the present invention can specify and display stress, pronunciation, syllable, and the like, thereby providing an effect of improving the efficiency of language learning.

In addition, the terminal and method for implementing a hybrid subtitle effect according to another embodiment of the present invention, by emphasizing the subtitles and syllables of the subtitles to match the sync of the audio signal of the image to implement a variety of motion effects, maximize the English learning effect It can be effective.

In addition, the terminal and method for implementing the hybrid subtitle effect according to another embodiment of the present invention, by expressing the accent not only based on the accent for the original subtitle, but also based on the subtitles converted into the native language and the multilingual language, the prior art Compared to this, more intuitive screen composition is provided to improve the understanding of language learning.

1 is a diagram illustrating a user interface (UI) screen in which a general subtitle effect is implemented.

2 is a diagram illustrating a hybrid caption effect implementing terminal 100 according to an embodiment of the present invention.

3 is a block diagram illustrating the components of the hybrid caption effect providing module 151 of the controller 150 of the hybrid caption effect implementing terminal 100 of FIG. 2.

4 to 8 are diagrams illustrating a user interface (UI) screen implemented in the input / output unit 110 of the hybrid caption effect implementing terminal 100 of FIG. 2.

9 is a diagram illustrating the concept of a hybrid caption effect implementation method according to an embodiment of the present invention.

10 is a diagram illustrating various hybrid caption effect implementation examples according to a hybrid caption effect implementation method according to an embodiment of the present invention.

11 is a reference diagram illustrating an embodiment of a subtitle pattern that can be implemented by a hybrid subtitle effect implementing method according to an embodiment of the present invention.

12 is a reference diagram illustrating a configuration for a systematic configuration platform for each level and level of a language learning method using a hybrid subtitle effect implementation method according to an embodiment of the present invention.

13 is a flowchart illustrating a method of implementing a hybrid subtitle effect according to an embodiment of the present invention.

Hereinafter, the detailed description of the preferred embodiment of the present invention will be described with reference to the accompanying drawings. In the following description of the present invention, detailed descriptions of well-known functions or configurations will be omitted when it is deemed that they may unnecessarily obscure the subject matter of the present invention.

In the present specification, when one component 'transmits' data or a signal to another component, the component may directly transmit the data or signal to another component, and through at least one other component. This means that data or signals can be transmitted to other components.

2 is a diagram illustrating a hybrid caption effect implementing terminal 100 according to an embodiment of the present invention.

Referring to FIG. 2, the hybrid caption effect implementing terminal 100 includes an input / output unit 110, an I / O interface 120, a transceiver 130, a storage 140, and a controller 150. 150 may include a hybrid subtitle effect providing module 151, a preview and screen size control module 152, an online search based dictionary providing module 153, and a speaking providing module 154.

Here, the hybrid caption effect providing module 151 is formed to provide a font size or color change effect and a motion expression effect on phonemes or characters recognized as strong in the caption information.

The preview and screen size control module 152 is formed through the input / output unit 110 to control the preview of the caption information and the screen size setting for the caption areas T1, T2, and T3. Here, the preview setting may be divided into 5 seconds, 30 seconds, 60 seconds, and synchronization, and the screen size setting may be divided into an original, a whole, and subtitle information.

In addition, the present invention is illustrated by separating the subtitle area into an original subtitle area T1, a translation subtitle area T2, and a hybrid subtitle area T3, but the present invention is not limited thereto. Of course, only the original subtitle area T1 may be implemented.

The online search-based dictionary providing module 153 controls the transceiver 130 to perform an online dictionary search through access to a translation service server that provides a translation service site connected to a network. You can provide accent information for the unit.

Speaking providing module 154 is a speech (speaking) function, and provides a voice recording and analysis process for language learning through a microphone formed separately in the hybrid subtitle effect implementation terminal 100 through a listening and speaking / recording service category, A process of receiving, storing, and analyzing a user's text input from the input / output unit 110 that can be formed as a touch screen through a comparison listening / listening / writing service category may be provided.

3 is a block diagram illustrating the components of the hybrid caption effect providing module 151 of the controller 150 of the hybrid caption effect implementing terminal 100 of FIG. 2.

4 to 8 are diagrams illustrating a user interface (UI) screen implemented in the input / output unit 110 of the hybrid caption effect implementing terminal 100 of FIG. 2.

Referring to FIG. 3, the hybrid subtitle effect providing module 151 may include a first accent and syllable sync means 151a, a second accent and syllable sync means 151b, a third accent and syllable sync means 151c, and language conversion. Means 151d and a speech bubble effect providing means 151e.

Hereinafter, the hybrid caption effect implementation terminal 100 will be described in detail with reference to FIGS. 4 to 8, with reference to the configuration of the hybrid caption effect providing module 151 of FIG. 2.

The first accent and syllable syncing unit 151a extracts the caption sentence units represented by the frame-based original caption region T1 and the translation caption region T2 from the storage 140. Subsequently, the first accent and syllable syncing means 151a analyzes the accent of each word constituting each subtitle sentence unit or the accent of the entire sentence based on the original subtitle information for each frame unit through the DB of the storage unit 140. After dividing the syllable part into at least one syllable part in each subtitle sentence unit, sync flag information (sync flag) for output is extracted for at least one or more phoneme parts I1 analyzed as stresses among the divided syllable parts.

The first accent and syllable sync means 151a may be configured to increase or decrease font units of at least one phoneme part I1 analyzed as accent matching with each sync flag information. A variety of motion effects may be implemented, such as a font effect of down), or a waving graphic effect for each character constituting the phoneme part I1 as an example.

In this case, the hybrid subtitle area T3 in which the font effect or motion effect is implemented may be implemented above the original subtitle area T1 or may be implemented by using the original subtitle area T1. Of course, it may be implemented below the original subtitle area T1.

That is, as shown in FIG. 4A, the first accent and syllable syncing means 151a may set the font size to a preset magnification than the reference size for the phoneme portion I1 analyzed as accent in each syllable unit in the original subtitle area T1. It can be largely implemented.

In addition, as shown in FIG. 4B, the first accent and syllable syncing means 151a converts original subtitle information output to the original subtitle area T1 of FIG. 4A into Korean pronunciation, and then, based on the converted Korean pronunciation, The font size of the phoneme portion I2 that is analyzed as strong may be embodied as the original subtitle area T1 or the hybrid subtitle area T3 at a preset magnification than the reference size.

In addition, according to another embodiment of the present invention, not only the change in the font size but also the change in the color of the font may express the stress. The font size and color change can be embodied by distinguishing not only the stress but also the pronunciation (phoneme part constituting the pronunciation) and the display of the syllable.

The second accent and syllable sync means 151b divides the syllable parts into at least one syllable part in each subtitle sentence unit in the same manner as the first accent and syllable sync means 151a, and then analyzes the accents among the divided syllable parts. Sync flag information (sync flag) for outputting the extracted at least one phoneme part is extracted.

The second accent and syllable sync means 151b extracts at least one or more phoneme portions I3 analyzed as accents matching the sync flag information, and then extracts the extracted phoneme portions I3. A font effect of only up or down of a font unit may be implemented as shown in FIG. 5A. In this case, the hybrid subtitle area T3 in which the font effect is implemented may be embodied above the original subtitle area T1 or may replace the original subtitle area embodied in the original subtitle area T1.

In addition, as shown in FIG. 5B, the second accent and syllable syncing unit 151b converts the original subtitle output to the original subtitle region T1 of FIG. 5A into Korean pronunciation, and then, based on the converted Korean pronunciation, After extracting only the phoneme portion I4 analyzed as accentuated, the font size of the extracted phoneme portion I4 can be embodied in the original subtitle area T1 or the hybrid subtitle area T3 at a preset magnification than the reference size. have.

In addition, according to another embodiment of the present invention, not only the change in the size of the font but also the change in the color of the font may express the stress on the phoneme portions I3 and I4.

The third accented and syllable syncing means 151c is the same manner as the first accented and syllable syncing means 151a, in a font unit up to at least one or more phoneme portions I1 and I2 analyzed as accentuated or The same font effect of down can be implemented.

In addition, when the third accent and syllable sync means 151c recognizes sync flag information about the extracted phoneme portions I1 and I2, the third accent and syllable sync means 151c simultaneously displays various operation codes I5 and I5 '. Likewise, it can be displayed above the first character of the phoneme.

On the other hand, the third stress and syllable sync means 151c recognizes not only the extracted phoneme portions I1 and I2 but also sync flag information that indicates the beginning of the syllable and rhythm portions in which the whole sentence is stressed. Likewise, various operation codes I5 and I5 'may be displayed above the first character of the phoneme as shown in FIG. 6.

The language converting means 151d divides the syllable parts into at least one syllable part in each subtitle sentence unit in the same manner as the first accent and syllable sync means 151a, and then at least one or more of the divided syllable parts are analyzed as stresses. Extract sync flag information for the phoneme part.

Further, the language converting means 151d extracts the original caption information implemented in the original caption area T1 from the storage 140 and then pronounces another foreign language or another foreign language through its multinational language pronunciation conversion module. 4 to 6 are Korean, and FIG. 7 is Japanese and Chinese).

In the present invention, only the translation of the original subtitles in English to English, Korean, Japanese, Chinese pronunciation, but not limited to this, of course, it is applicable to all multinational languages that use a language other than English as the mother tongue. Do.

In addition, the language converting means 151d may control the transceiver 130 to receive the translation service subtitle information through access to a translation service site connected to a network by controlling the transceiver 130 in relation to the original subtitle information.

Subsequently, the language converting means 151d analyzes the stress of each word constituting each subtitle sentence unit or the stress of the entire sentence based on the subtitle information translated into the multilingual language per frame through the DB of the storage unit 140. After dividing the syllable parts into at least one syllable part in each subtitle sentence unit, sync flag information (sync flag) for output is extracted for at least one or more phoneme parts I1 analyzed as stresses among the divided syllable parts. .

The language converting means 151d is configured to up or down the font unit for at least one or more phoneme portions I6 and I7 analyzed according to the sync flag recognition. Various motion effects may be implemented, such as a font effect or a wave graphic effect for each character constituting the phoneme portions I6 and I7 as an example.

On the other hand, the language converting means 151d recognizes not only the extracted phoneme portions I6 and I7 but also sync flag information (sync flag) indicating the beginning of a syllable and a rhythm portion in which the whole sentence starts to be stressed. The operation codes I6 and I7 may be displayed above the first character of the phoneme as shown in FIG. 7.

Although FIG. 4 to FIG. 7 show only the state in which the hybrid subtitles, the original subtitles, and the translated subtitles are all sequentially implemented in the video content, the present invention is not limited thereto. Of course, the hybrid subtitles alone or the hybrid subtitles may be implemented. The subtitles may be implemented with subtitles, or may be implemented with subtitles translated into multilingual languages or with subtitles translated. In addition, only original subtitles in which fonts or accents are expressed may be implemented in the image content, or hybrid subtitles and original subtitles in which fonts or accents are expressed may be simultaneously or sequentially implemented.

The speech balloon effect providing unit 151e extracts the caption sentence unit represented by the frame-based original caption region T1 and the translation caption region T2 from the storage unit 140. Thereafter, the speech bubble effect providing unit 151e analyzes the stress of each word constituting each subtitle sentence unit or the stress of the entire sentence on the basis of the original subtitle information for each frame unit through the DB of the storage unit 140, and each subtitle. After dividing the syllable parts into at least one syllable unit, the sync flag information for outputting the at least one phoneme part I1 ′ analyzed as stress among the divided syllable parts is extracted.

The speech bubble effect providing means 151e may be configured to increase or decrease the font unit for at least one or more phoneme portions I1 ′ analyzed according to the sync flag information. To implement a variety of motion effects, such as to implement a font effect, or a waving graphic effect for each character constituting the phoneme part (I1) as an example, in this case, can be implemented inside the speech bubble icon (I8) have.

That is, as shown in FIG. 8A, the speech bubble effect providing unit 151e does not implement the original subtitle area T1 and the translation subtitle area T2, and the balloon icon I8 has a font effect or motion effect in the original subtitle information. Implementation of the implemented phoneme portion I1 ′ may be performed.

In addition, as illustrated in FIG. 8B, the speech balloon effect providing unit 151e converts original subtitle information for implementing font effects or motion effects in the speech balloon icon I8 of FIG. 8A into Korean pronunciation and then based on the converted Korean pronunciation. The font size of the phoneme portion I2 ′ analyzed strongly in Korean pronunciation may be embodied in the speech bubble icon I8 at a preset magnification than the reference size.

As described above, the terminal for implementing the hybrid caption effect according to the embodiment of the present invention analyzes the stress of each word constituting each caption sentence unit or the stress of the whole sentence based on the original caption information of each frame unit, and analyzes the stress of each subtitle sentence unit. After dividing the syllable part into at least one or more, characterized in that to implement a hybrid subtitle effect on at least one or more phoneme parts analyzed as stress.

In addition, according to another embodiment of the present invention, not only the change in the font size but also the change in the color of the font may express the stress. The font size and color change can be embodied by distinguishing not only the stress but also the pronunciation (phoneme part constituting the pronunciation) and the display of the syllable.

In addition, according to another embodiment of the present invention, not only the accent due to the change in the size and color of the font, but also the hybrid subtitles in which the display of the pronunciation and the syllables are divided, or the original subtitles in which the font or accent is expressed may correspond to the video content. Of course, it can also be implemented in a sentence form in a wave form from the mouth of the character who is speaking.

9 is a diagram illustrating the concept of a hybrid caption effect implementation method according to an embodiment of the present invention. 10 is a diagram illustrating various hybrid caption effect implementation examples according to a hybrid caption effect implementation method according to an embodiment of the present invention.

Referring to FIG. 10A, the hybrid subtitle effect providing module 151 may analyze the DB of the storage 140 or the accent information corresponding to the phoneme unit of each word constituting each subtitle sentence unit based on the original subtitle T1. The transceiver 130 is controlled to obtain the query through the stress analysis server connected to the network.

Thereafter, the hybrid subtitle effect providing module 151 extracts the first accent and the second accent information from the accent information, and sets the intermediate font size larger than the preset reference font size for the characters corresponding to the first accent information. Subtitles through differentiation of the font size are set for a character corresponding to the second accent information by a large font set larger than the intermediate font size and implemented in the hybrid subtitle area T3 or the original subtitle area T1 as shown in FIG. 10A. Perform the expression.

Next, the hybrid subtitle effect providing module 151 performs hybrid subtitle area T3 or original subtitle area for each word or sentence classified into first to nth accent information (n is a natural number of 2 or more) from the obtained accent information. As an additional effect when implementing (T1), as shown in FIG. 10B, when each accent information starts, a UI screen for restoring the font size to its original size after changing the font size may be implemented. In this case, the hybrid subtitle effect providing module 151 may extract sync flag information for outputting at least one or more characters which are analyzed as stresses through the original subtitle information of the storage 140.

Next, the hybrid subtitle effect providing module 151 performs hybrid subtitle area T3 or original subtitle area for each word or sentence classified into first to nth accent information (n is a natural number of 2 or more) from the obtained accent information. As another additional effect when implemented in (T1), when each accented information is started as shown in FIG. 10C, a UI screen for changing the size of the font and maintaining the size of the font without returning to the original size may be implemented. In this case, the hybrid subtitle effect providing module 151 may extract sync flag information (sync flag) for outputting at least one or more characters which are analyzed as stresses through the original subtitle information of the storage 140.

Next, the hybrid subtitle effect providing module 151 implements the UI screen as shown in FIG. 10B or 10C and at the same time, the accent belongs to the greatest intensity information as the intensity information among the first to n th stress information described above with reference to FIG. 10A. For the information, various operation icons may be displayed on the upper side with letters.

11 is a reference diagram illustrating seven subtitle patterns that may be implemented by a hybrid subtitle effect implementing method according to an embodiment of the present invention. 12 is a reference diagram illustrating a configuration for a systematic configuration platform for each level and level of a language learning method using a hybrid subtitle effect implementation method according to an embodiment of the present invention.

13 is a flowchart illustrating a method of implementing a hybrid subtitle effect according to an embodiment of the present invention.

Referring to FIG. 13, the controller 150 of the hybrid caption effect implementing terminal 100 extracts a caption sentence unit displayed in the original caption region T1 for each frame unit from the storage 140 (S11). Of course, the storage unit 140 may extract the caption sentence unit represented by the translation caption area T2.

After the step S11, the controller 150 analyzes the stress of each word constituting each subtitle sentence unit or the stress of the entire sentence based on the original subtitle information for each frame unit implemented in the original subtitle area T1 (S12). ).

After step S12, the controller 150 divides the syllable parts into at least one syllable part in each subtitle sentence unit analyzed in step S12, and then, for at least one phoneme part analyzed as stress among the divided syllable parts. Sync flag information (sync flag) for output is extracted (S13).

After the step S13, when the control unit 150 implements the caption sentence information consisting of a set of caption sentence units together with the video or the video content as the input / output unit 110, the sync flag information extracted in the step S13 (sync) flag) implements a font size / color effect and an operation effect on at least one or more phoneme parts analyzed according to the accent matching with the recognition (S14).

In addition, the terminal according to the present invention can give a subtitle in which fonts and accents are expressed in voice, text, image content, and animation, which are reproduced in real time in connection with the Internet.

The invention can also be embodied as computer readable code on a computer readable recording medium. Computer-readable recording media include all kinds of recording devices that store data that can be read by a computer system.

Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disks, optical data storage devices, and the like, which are also implemented in the form of carrier waves (eg, transmission over the Internet). It also includes.

The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. And functional programs, codes and code segments for implementing the present invention can be easily inferred by programmers in the art to which the present invention belongs.

As described above, the present specification and drawings have been described with respect to preferred embodiments of the present invention, although specific terms are used, it is only used in a general sense to easily explain the technical contents of the present invention and to help the understanding of the present invention. It is not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention can be carried out in addition to the embodiments disclosed herein.

Claims (19)

The storage unit 140 extracts a caption sentence unit displayed in the original caption region T1 or the translation caption region T2 for each frame unit. Analyze the stress of each word or the whole sentence that make up each subtitle sentence unit based on the original subtitle information by frame unit, First syllable and syllable syncing means for dividing the syllable portion into at least one syllable unit in each subtitle sentence, and then implementing a hybrid caption effect on the at least one phoneme portion I1 analyzed as stress; Hybrid caption effect implementation terminal comprising a. The method of claim 1, wherein the hybrid subtitle effect, Font effect to up or down in the font unit, font size or color effect for phonemes or characters, or as an example, a preset motion effect on each character of the phoneme part I1. Hybrid caption effect implementation terminal. The method according to claim 1, wherein the first stress and syllable sink means, And extracting sync flag information (sync flag) for outputting at least one phoneme part (I1) analyzed as stress among the divided syllable parts. The method according to claim 3, wherein the first stress and syllable sink means, And a terminal for implementing at least one phoneme part (I1) analyzed as accent matching with each sync flag information. The method according to claim 1, wherein the first stress and syllable sink means, A hybrid subtitle region T3 in which a font effect or motion effect is implemented may be implemented above or below the original subtitle region T1 or may be implemented using the original subtitle region T1. . The method according to claim 1, wherein the first stress and syllable sink means, After converting the original subtitle information output to the original subtitle area T1 into Korean pronunciation, the font size is set in advance than the reference size for the phoneme part I2 that is analyzed as strong among the Korean pronunciation based on the converted Korean pronunciation. A hybrid caption effect implementing terminal, characterized in that the magnification is largely implemented as an original caption region T1 or a hybrid caption region T3. The method according to claim 1, According to the recognition of the sync flag information (sync flag) extracted by the first accent and syllable sync means, at least one or more phoneme parts I3 analyzed as matching accents are extracted, and then the extracted phoneme parts I3 are extracted. A second accent and syllable syncing means for applying the hybrid subtitle effect only to the input / output unit 110 as a UI screen for only the character to which the hybrid subtitle effect is applied; Hybrid caption effect implementation terminal further comprising. The method according to claim 7, wherein the second stress and syllable sink means, After converting the original subtitle output to the original subtitle area T1 into Korean pronunciation, extract only the phoneme part I4 that is analyzed as strong among Korean pronunciations based on the converted Korean pronunciation, and then extract the phoneme part I4. The hybrid caption effect implementation terminal, characterized in that to implement the UI screen on the input and output unit 110 only for the character to which the hybrid caption effect is applied by applying a hybrid caption effect for only. The method according to claim 1, When recognizing sync flag information on the extracted phoneme portions I1 and I2 by the first accent and syllable sync means, simultaneously displaying operation codes I5 and I5 'on the first character of the phoneme. Third stress and syllable sink means; Hybrid caption effect implementation terminal further comprising. The method according to claim 1, When the sync flag information for output is extracted from at least one phoneme part analyzed as stress among syllable parts classified in each subtitle sentence unit by the first accent and syllable sync means, an original subtitle area ( Language conversion means for extracting original subtitle information implemented in T1) from the storage unit 140 and converting the original caption information into another foreign language or another foreign language pronunciation through a multinational language pronunciation conversion module; Hybrid caption effect implementation terminal further comprising. The method according to claim 10, The language converted by the language converting means is a hybrid subtitle effect implementation terminal, characterized in that it includes all the multilingual languages that use a language other than English as the native language. The method according to claim 1, After extracting sync flag information for outputting at least one or more phoneme portions I1 ′ analyzed as accents, at least one analyzed as accents according to sync flag recognition. Speech balloon effect providing means for implementing the hybrid caption effect on the phoneme portion I1 ′ inside the speech bubble icon I8; Hybrid caption effect implementation terminal further comprising. Analyze the stress of each word constituting each subtitle sentence unit or the stress of the entire sentence based on the original subtitle information of each frame unit, divide at least one syllable part from each subtitle sentence unit, and analyze the stress at least Hybrid caption effect implementation terminal, characterized in that for implementing a hybrid caption effect for one or more phonemes. The method according to claim 13, The hybrid subtitle effect may be implemented by a hybrid subtitle alone, or with an original subtitle, or with a subtitle translated into a multinational language, or with a subtitle. . The method of claim 13, wherein the hybrid subtitle effect, A font effect for up or down of a font unit, a font size or color effect for a phoneme or a character, or an operation effect set in advance of each character constituting a phoneme part as an example. Hybrid subtitle effect implementation terminal. The controller 150 of the hybrid caption effect implementing terminal 100 divides at least one syllable part from each analyzed subtitle sentence unit, and then outputs at least one phoneme part analyzed as stress among the divided syllable parts. Extracting sync flag information (sync flag); And When the controller 150 implements the caption sentence information consisting of a set of subtitle sentence units together with a video or an image as the input / output unit 110, the controller 150 matches the corresponding sync flag information according to the extracted sync flag information. A second step of implementing a hybrid subtitle effect on the analyzed at least one phoneme portion; Hybrid subtitle effect implementation method comprising the. The method of claim 16, wherein in the second step, The hybrid subtitle effect is a method of implementing a hybrid subtitle effect, characterized in that one of the font effect of up (up) or down (down), font size or color effects, and motion effects. The method of claim 16, wherein prior to the first step, A first preparation process of the control unit 150 extracting, from the storage unit 140, a caption sentence unit displayed in the original caption area T1 for each frame unit; Hybrid subtitle effect implementation method characterized in that it further comprises. The method according to claim 18, Between the first preparation process and the first step, A second preparation process of the controller 150 analyzing the stress of each word or the stress of the entire sentence constituting each subtitle sentence unit based on the original subtitle information for each frame unit implemented in the original subtitle area T1; Hybrid subtitle effect implementation method characterized in that it further comprises.

Images