WO2022108299A1 - Image service providing device - Google Patents

Abstract

An image service providing device is disclosed. The image service providing device comprises: a page generation unit for generating a plurality of video pages by dividing a video into sentence units or paragraph units of a script for the voice of a video; and a screen configuration unit for configuring a screen including an image display area on which the video of the plurality of video pages is played or captured images for each of the plurality of video pages are displayed, a script display area on which script paragraphs synchronized with the plurality of video pages are displayed, and a chat window area on which question and answer opinions synchronized for each of the script paragraphs of the plurality of video pages are inputted and displayed.

Description

video service providing device

The present invention relates to an apparatus for providing an image service.

In general, an online education service is a service that provides digital learning contents so that anyone can perform desired learning anytime, anywhere using a network. Therefore, online education service users can learn regardless of location through the online education service, and by repeatedly using desired educational content, they can acquire necessary knowledge or prepare for exams through problem solving, etc. Learning and evaluation can be performed.

In general, U-LEARNING is defined as an educational form that allows students to learn anytime, anywhere in their daily life, regardless of time, place, or environment based on a ubiquitous learning environment. In other words, it can be viewed as online education in the ubiquitous computing environment represented by PDA, smart phone, DMB, etc.

These online education services mainly utilize an internet video lecture called 'ingang (internet lecture)' and an analog medium called 'book' that you read while flipping through paper. However, in the case of Internet video lectures, they are fun because they are a video medium, but they are not suitable for active learning because 1) you have to passively watch the lectures of the instructors, and 2) it is not easy to find parts that you did not understand. . On the other hand, in the case of paper books, active learning is possible by turning the pages back and forth at will, but there are disadvantages in that learners become bored or lose concentration.

Therefore, there is a need for a future-oriented educational medium that combines the rich fun of 'Ingang' only with the video medium and the active learning potential of 'paper book'.

In addition to 'Ingang', which provides direct education, recently, video contents such as movies, dramas, and entertainment can also expect indirect educational effects, so they are widely used in foreign language education, job training, and liberal arts classes. Therefore, similarly to video content such as movies, dramas, and entertainment, there is a need for a future-oriented educational medium that combines the advantages of rich fun only video media with the active learning potential of paper books.

An object of the present invention is to provide an apparatus for providing a video service that provides a video service in units of sentences or paragraphs of a script for voice reproduced together with the video.

According to one aspect of the present invention, an apparatus for providing an image service is disclosed.

A video service providing apparatus according to an embodiment of the present invention includes a page generator configured to generate a plurality of video pages by dividing the video into sentence units or paragraph units of a script for audio of a video, and the plurality of video pages A video display area in which a video is played or captured images for each of the plurality of video pages are displayed, a script display area in which a script synchronized with the plurality of video pages is displayed, and a question, answer or question synchronized for each script of the plurality of video pages and a screen configuration unit constituting a screen including a dialog area in which opinions are input and displayed.

When a mode switching command is input, the screen configuration unit switches to a video playback mode in which the plurality of video pages are played or an e-book mode in which the captured images are displayed.

The screen configuration unit, in the video playback mode, plays a previous video page when the image display area or the left area of the script display area is clicked, and when the image display area or the right area of the script display area is clicked, the next When a video page is played, and in the e-book mode, the image display area or the left area of the script display area is clicked, the captured image of the previous video page, the script and the dialog area are displayed, and the video display area or the script is displayed When the area to the right of the area is clicked, it displays the captured image, script and dialog area of the next video page.

The screen configuration unit, when a text view command is input, configures a text view screen in which a page list composed of a captured image for each video page and a script is displayed.

The screen configuration unit, when a bookmark setting command is input, sets the captured image and script of the video page currently playing or displaying the captured image as bookmarks, and when a bookmark collection command is input, the captured image of the video page set as a bookmark and a bookmark collection view screen on which a page list composed of scripts is displayed, and when a bookmark collection sharing command is input, the bookmark collection data including the page list and memo for each bookmark is shared with other designated users.

The screen configuration unit, when a Q&A view command is input, configures a Q&A screen in which questions, answers, or comments of the current video page input through the chat window area are displayed, and when a Q&A view command is input, through the chat window area A Q&A full view screen is configured in which a list of questions, answers, or comments for each video page input, a script composed of scripts for each video page, and a list of questions, answers, or opinions are continuously displayed.

When a book community creation command is input, the screen configuration unit generates the book community by receiving setting information of a book community that a user wants to create and identification information of another user who wants to join the book community as a member of the book community, Only the member's questions and answers are displayed on the Q&A screen or the entire Q&A view screen.

The screen configuration unit, when a mode switching command to the scroll (Scroll) mode is input, configures the screen so that the script list consisting of the scripts for each video page is sequentially displayed using the scroll function in the script display area, but the currently playing The script paragraph of the video page is shaded and located at the top or center of the script display area, and when any one script is selected from the script list, the selected script is shaded and moved to the top or center of the script display area and play a video page corresponding to the selected script.

According to another aspect of the present invention, there is provided an apparatus for providing an image service including a data storage unit for storing an application, and a processor.

The processor receives a plurality of video pages generated by dividing an arbitrary video into sentence units or paragraph units of a script for the voice of the video from the server by executing the application, and the plurality of video pages A video display area in which a video is played or captured images for each of the plurality of video pages are displayed, a script display area in which a script synchronized with the plurality of video pages is displayed, and a question, answer or question synchronized for each script of the plurality of video pages Outputs a screen including a dialog area where opinions are input and displayed.

When a mode switching command is input, the processor switches to a video playback mode in which the plurality of video pages are played or an e-book mode in which the captured images are displayed.

The processor, in the video playback mode, when the image display area or the left area of the script display area is clicked, plays a previous video page, and when the image display area or the right area of the script display area is clicked, the next When a video page is played, and in the e-book mode, the image display area or the left area of the script display area is clicked, the captured image of the previous video page, the script and the dialog area are displayed, and the video display area or the script is displayed When the area to the right of the area is clicked, it displays the captured image, script and dialog area of the next video page.

When a text view command is input, the processor outputs a text view screen in which a page list composed of a captured image for each video page and a script is displayed.

The processor, when a bookmark setting command is input, sets the captured image and script of the video page currently playing or displaying the captured image as bookmarks, and when a bookmark collection view command is input, the captured image of the video page set as a bookmark and A bookmark collection view screen in which a page list composed of scripts is displayed is output, and when a bookmark collection sharing command is input, the bookmark collection data including the page list and notes for each bookmark are shared with other designated users.

When a Q&A view command is input, the processor outputs a Q&A screen in which questions and answers of the current video page input through the chat window area are displayed, and when a Q&A full view command is input, the video input through the chat window area Outputs a Q&A full view screen in which a list of questions and answers for each page, a script composed of a script for each video page, questions, answers, or opinions are continuously displayed.

When a book community creation command is input, the processor generates the book community by receiving setting information of a book community that the user wants to create and identification information of another user who wants to join the book community as a member of the book community, and performs the Q&A Only the member's questions and answers are displayed on the screen or the full Q&A screen.

The processor, when a mode switching command to the scroll mode is input, outputs a screen such that a script list composed of a script for each video page is sequentially displayed in the script display area using a scroll function, but the video currently being played The script of the page is shaded and located at the top or center of the script display area, and when any one script is selected from the script list, the selected script is shaded and moved to the top or center of the script display area, A video page corresponding to the selected script is played.

The video service providing apparatus according to an embodiment of the present invention divides the video into sentence units or paragraph units of a script for voice reproduced together with the video and serves the video page by page, so that a user can read an e-book as if it were an e-book. You can quickly flip through and scan lecture videos as if you were reading, so you can improve learning efficiency and learning convenience. Therefore, it is easy to ask specific questions about specific parts of the lecture content and to receive answers, which can enhance learning participation and interactivity.

In addition, even when consuming video content such as movies, dramas, and entertainment as well as lecture videos, it is possible to improve the convenience, efficiency, and interactivity of video understanding by quickly turning and skimming the videos page by page.

1 is a diagram schematically illustrating the configuration of an apparatus for providing an image service according to an embodiment of the present invention;

2 to 9 are diagrams for explaining an apparatus for providing an image service according to an embodiment of the present invention of FIG. 1;

10 to 12 are views showing a web screen implemented in a PC or a notebook computer.

13 is a diagram illustrating a user terminal in which a live lecture is being performed according to an embodiment of the present invention;

14 is a diagram for explaining a video book live function of an apparatus for providing an image service according to an embodiment of the present invention;

15 is a view for explaining an image service providing system in which an image service providing apparatus according to an embodiment of the present invention is implemented as a server computing device;

As used herein, the singular expression includes the plural expression unless the context clearly dictates otherwise. In this specification, terms such as "consisting of" or "comprising" should not be construed as necessarily including all of the various components or various steps described in the specification, some of which components or some steps are It should be construed that it may not include, or may further include additional components or steps. In addition, terms such as "...unit" and "module" described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software, or a combination of hardware and software. .

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram schematically illustrating the configuration of an apparatus for providing an image service according to an embodiment of the present invention, and FIGS. 2 to 9 are diagrams for explaining the apparatus for providing an image service according to an embodiment of the present invention of FIG. 1 to be. Hereinafter, an apparatus for providing an image service according to an embodiment of the present invention will be described with reference to FIG. 1 , with reference to FIGS. 2 to 9 .

First, referring to FIG. 1 , an apparatus 100 for providing an image service according to an embodiment of the present invention may include a page generating unit 110 and a screen configuring unit 120 .

The image service providing apparatus 100 according to an embodiment of the present invention may be a standalone computing device and may provide various image services. Hereinafter, for the convenience of understanding and description of the present invention, the image service provided by the image service providing apparatus 100 according to the present invention will be referred to as a video book service.

The standalone computing device may be loaded with a videobook software program that performs a function or operation of the image service providing apparatus 100 according to an embodiment of the present invention. That is, the operations or functions performed by the page generating unit 110 and the screen composing unit 120, which are components of the image service providing apparatus 100 described above, may be implemented as a video book software program.

The image service providing apparatus 100 according to another embodiment of the present invention may be a server computing device capable of operating as a server for any user terminal operating as a client terminal.

Here, the server is a computing device that performs various operations for providing the videobook service of the image service providing apparatus 100 according to another embodiment of the present invention, and may be one or more physical entities. When the server is divided into a plurality of physical entities and implemented, the management subject of each physical entity may be different from each other. The server may include a DB, which means a functional and structural combination of software and hardware for storing information corresponding to each database, and the DB may be implemented as at least one table, and retrieve, store, and A separate DBMS (Database Management System) for managing may be further included. In addition, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures that can store information corresponding to the database.

The computing device for a server may be loaded with a video book software program for a server that performs a function or operation of the image service providing apparatus 100 according to another embodiment of the present invention. That is, the operations or functions performed by the page generating unit 110 and the screen composing unit 120, which are the components of the image service providing apparatus 100 described above, may be implemented as a video book software program for a server.

The image service providing apparatus 100 according to another embodiment of the present invention may be a user terminal such as a smart phone, a smart pad, a laptop computer, or a desktop, and the user terminal is the image service providing apparatus 100 according to the embodiment of the present invention. A video book application that performs a function or operation of may be loaded. That is, the operations or functions performed by the page generating unit 110 and the screen composing unit 120, which are components of the image service providing apparatus 100 described above, may be implemented as a video book application.

The image service providing apparatus 100 according to another embodiment of the present invention may provide a video book service by interworking with a server supporting the video book service. For example, the user terminal can download and install the video book application from the server, and request and receive the large amount of image data that is difficult to perform and store in the user terminal from the server, or receive various types of generated data from the server. It can also be uploaded to

The user terminal may provide a video book service through a web service by accessing a website provided by the server by driving the downloaded and installed video book application.

Meanwhile, the user terminal can provide a video book service through a web service by accessing a website provided by the server without downloading a separate video book application.

To this end, the server is a computing device that performs various operations for providing a video book service in conjunction with the image service providing apparatus 100 according to another embodiment of the present invention, and may be one or two or more physical entities. When the server is divided into a plurality of physical entities and implemented, the management subject of each physical entity may be different from each other. The server may include a DB, which means a functional and structural combination of software and hardware for storing information corresponding to each database, and the DB may be implemented as at least one table, and retrieve, store, and A separate DBMS (Database Management System) for managing may be further included. In addition, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures that can store information corresponding to the database.

The image service providing apparatus 100 according to each embodiment of the present invention is a page according to an embodiment implemented in the form of a stand-alone computing device, an embodiment implemented in the form of a computing device for a server, and an embodiment implemented in the form of a user terminal Some functions and operations of the generating unit 110 and the screen composing unit 120 may be modified and implemented as appropriate for a corresponding embodiment.

For example, the functions and operations of the image service providing apparatus 100 according to each embodiment of the present invention may be implemented in a smartphone, and may also be implemented in various user terminals such as a PC and a notebook computer.

That is, smartphones, PCs, laptops, etc. may have slight differences in user interface or screen configuration due to differences in hardware environments, but the basic functions of the image service providing apparatus 100 according to the embodiment of the present invention are the same. can be implemented.

The page generating unit 110 generates a plurality of video pages by dividing one lecture video into paragraph units or sentence units of a script for lecture content. One video page may include a video of the video page, a script paragraph or sentence, and a captured image. Hereinafter, for convenience of understanding and explanation, it is assumed that the lecture video is divided into script paragraphs to generate a plurality of video pages.

Here, the script may be a text converted from voice reproduced in a lecture video, and a paragraph may include at least one sentence, and the size of the paragraph may be preset. For example, one paragraph may consist of a plurality of short sentences or one long sentence. In addition, the captured image is an arbitrary video frame among a plurality of video frames constituting the corresponding video page, and may generally be the first video frame.

That is, the page generating unit 110 divides the lecture video into lecture videos of a length corresponding to a paragraph of a preset size in paragraph units of a script for a lecture voice reproduced together with the video in the lecture video, so that one lecture video It is possible to create a plurality of video pages for each video.

The screen configuration unit 120 configures a basic lecture screen and an additional service screen provided according to an additional user input.

In addition, when the configured basic lecture screen or additional service screen is output, the screen configuration unit 120 performs a process corresponding to a user input input through an input button displayed on the screen or a touch input pattern.

An embodiment in which the image service providing apparatus 100 according to each embodiment of the present invention is implemented in the form of an independent computing device and an embodiment in the form of a computing device for a server are configured and output by the screen configuration unit 120 And, according to an embodiment implemented in the form of a user terminal, it may be appropriately modified and implemented in the display device according to the embodiment.

As shown in FIG. 2 , the screen configuration unit 120 may configure and output a basically configured lecture screen.

Referring to FIG. 2 , the basic lecture screen includes an image display area 210 in which a lecture video is played back or a captured image of a video page is displayed, a button display area 220 in which a plurality of input buttons received from the user are displayed, and lectures. It may be configured to include a script display area 230 in which a script according to voice is displayed and a chat window area 240 in which questions, opinions, and answers are input and displayed.

Here, in the video display area 210, a video of a video page is played and displayed according to a mode set according to a mode switching command input from a user through the button display area 220, or a captured image of a video page can be displayed. have.

And, the script paragraph displayed in the script display area 230 is synchronized with the video page or the captured image displayed in the video display area (210).

In addition, the questions, opinions, and answers displayed in the chat window area 240 are synchronized with a video page or a captured image displayed in the video display area 210 . Since the chat window area 240 is included in the basic lecture screen, the user can directly input a question or opinion about the video page currently being viewed in the lecture video. In other words, if a user comes across a part that he does not understand while watching a lecture video, he or she can post a question on that part and receive an answer later. In addition, the user may check answers to questions posted by other users and share questions and answers. Through this, an effect similar to learning from other people's questions in an offline class can be achieved.

Hereinafter, a screen configured by the screen configuration unit 120 and an operation processed will be described with reference to FIGS. 3 and 4 . Here, FIG. 3 shows a screen in a video playback mode in which a video page is reproduced and displayed, and FIG. 4 shows a screen in an e-book mode in which a captured image of a video page is displayed.

3 and 4, in the button display area 220, the text view button 221, the mode switching button 222, the playback speed conversion button 223, the bookmark setting button 224, the bookmark view button 225 and a table of contents button 226 may be displayed.

When the text view button 221 is clicked and a text view command is input, the screen configuration unit 120 may output the text view screen 500 as shown in FIG. 5 as an additional service screen. That is, the screen configuration unit 120 may configure the text view screen 500 as shown in FIG. 5 as it detects that the text view button 221 is clicked.

Referring to FIG. 5 , on the text view screen 500 , a page list consisting of a captured image 10 and a script paragraph 20 for each video page for the entire lecture video is displayed, and a scroll bar 510 is displayed to display on a single screen. ) may be displayed. In this case, the plurality of video pages may be displayed in an order from top to bottom in the order of the video lecture. Through this, the user can quickly scan the entire lecture video and quickly understand the content, and can move to a desired part and watch it.

Then, when the mode switching button 222 is clicked and a mode switching command is input, the screen configuration unit 120 switches the mode according to the currently set mode. That is, when the currently set mode is the video playback mode, the screen configuration unit 120 switches to the e-book mode when the mode switch button 222 is clicked, and, conversely, when the currently set mode is the e-book mode, the mode switch button When (222) is clicked, it can be switched to the video playback mode.

As described above, FIG. 3 shows a screen in the moving picture playback mode. In the case of FIG. 3, it shows that the moving pictures of the moving picture page are continuously played in units of script paragraphs. Meanwhile, FIG. 4 shows a screen in the e-book mode. In the case of FIG. 4, it shows that captured images of a moving picture page are continuously displayed in units of script paragraphs. That is, the e-book mode can provide the effect of viewing a picture book by showing the captured image and the corresponding script paragraph.

Then, when the playback speed conversion button 223 is clicked and the playback speed conversion command is input, the screen configuration unit 120 converts the double speed of the lecture video playback.

And, when the bookmark setting button 224 is clicked and a bookmark setting command is input, the screen configuration unit 120 sets the captured image and script paragraph of the video page currently playing or displaying the captured image as bookmarks when clicked.

Then, the screen configuration unit 120, when the bookmark collection button 225 is clicked and the bookmark collection command is input, as an additional service screen, the bookmark collection screen 600 as shown in FIG. 6 can be output. have. That is, the screen configuration unit 120 may configure the bookmark view screen 600 as shown in FIG. 6 as it detects that the bookmark view button 225 is clicked.

Referring to FIG. 6 , on the bookmark collection screen 600 , a page list composed of a captured image 10 for each bookmarked video page and a script paragraph 20 may be displayed. Through this, the user can save a specific part or remark as a bookmark while watching a lecture video, and then collect the saved bookmark at a time and view it again, which can be helpful for review.

As an additional embodiment, a bookmark collection share button (not shown) may be further displayed in the button display area 220 . Accordingly, when the bookmark collection share button is clicked and a bookmark collection sharing command is input, the screen configuration unit 120 may share the bookmark collection data including the page list and memo for each bookmark to other designated users. Here, the memo for each bookmark may be written by the user who sets the bookmark for each bookmark. For example, when a bookmark collection sharing command is input, the screen configuration unit 120 may provide the user with a function of writing a memo for each bookmark.

Then, when the table of contents button 226 is clicked and a table of contents display command is input, the screen configuration unit 120 may output a table of contents screen (not shown) for the stored lecture video as an additional service screen. That is, the screen configuration unit 120 may configure the table of contents screen as it detects that the table of contents button 226 is clicked.

On the other hand, the screen configuration unit 120 is the left or right area of the video display area 210 while the video of the video page is continuously played in units of script paragraphs or the captured images of the video page are continuously displayed in units of script paragraphs. When this preset number of times is clicked (eg, double-touched), it moves to the previous or next video page to play the corresponding video page or display the corresponding captured image.

Through this, the user can read the script of the lecture video without missing a single character, so that the user can quickly grasp the contents of the lecture, and can quickly and conveniently move to the desired part of the lecture video and watch it.

On the other hand, when the Q&A full view command is input, the screen configuration unit 120 sequentially displays a list of questions and answers for each video page, a script consisting of a script paragraph for each video page, and questions and answers input through the chat window area 240 . You can configure the displayed Q&A full view screen.

For example, FIG. 7 shows an example of a screen on which questions and answers for a video page input through the chat window area 240 are output. Referring to FIG. 7 , first, when the chat window area 240 is clicked and a Q&A view command is input, the screen configuration unit 120 may configure and output the Q&A screen 710 for the current video page. Here, on the Q&A screen 710 , a chat window area 240 and a Q&A full view button 711 may be displayed along with the questions 50 and answers 60 of the current video page. Next, the screen configuration unit 120, when the Q&A view full button 711 is clicked on the Q&A screen 710 and a Q&A view full command is input, the script paragraph of the entire video page, questions 50 and answers 60 It is possible to configure and output the Q&A full view screen 720 on which a list including . In this case, a button 721 to view only my questions and opinions may be displayed on the Q&A full view screen 720 . Next, the screen configuration unit 120 collects only my questions and opinions when the Collect only my questions and comments button 721 is clicked on the Q&A full view screen 720 and a command to view only my questions and opinions is input. The viewing screen 730 may be configured and output.

On the other hand, when a book community creation command is input, the screen configuration unit 120 receives the setting information of the book community that the user wants to create and the identification information of another user who wants to join as a member of the book community to create the book community. can In this case, the screen configuration unit 120 may display only the questions and answers of the book community members on the Q&A screen 710 or the Q&A full view screen 720 .

For example, FIG. 8 shows an example of a book community setting screen. Referring to FIG. 8 , a book community creation button 715 may be displayed on the Q&A screen 710 or the Q&A full view screen 720 along with questions and answers about the video page. So, when the book community creation button 715 is clicked and a book community creation command is input, the screen configuration unit 120 displays the setting window 717 for creating a book community on the Q&A screen 710 or Q&A full view screen 720 can be displayed above. Then, as shown in FIG. 8 , the screen configuration unit 120 sets the book community setting information such as the book community name, etc. and identification information such as the nickname, email address, and mobile phone number of another user to be joined as a member in the setting window 717 ) to receive input from the user. In addition, the screen configuration unit 120 may create a book community according to the received book community setting information and the book community member identification information, and configure members of the created book community. Accordingly, the screen configuration unit 120 may configure and output the Q&A screen 710 or the Q&A full view screen 720 in which only the questions and answers of the book community members are displayed.

Meanwhile, a button (not shown) for switching to a scroll mode may be further displayed in the button display area 220 . So, when the switch to scroll mode button is clicked and the mode switch command to the scroll mode is input, the screen configuration unit 120 displays a script list consisting of script paragraphs for each video page in the script display area 230 using the scroll function. Thus, the screen can be configured to be displayed sequentially. In this case, the screen configuration unit 120 may shade the script paragraph of the currently playing video page and place it at the top or the center of the script display area 230 . Thereafter, when any one script paragraph is clicked and selected from the script list, the screen configuration unit 120 may shade the selected script paragraph and move it to the top or center of the script display area 230 . In this case, the screen configuration unit 120 may reproduce a video page corresponding to the selected script paragraph.

For example, FIG. 9 shows an example of a scroll mode screen. 9, when a mode switching command from the video playback mode to the scroll mode is input, the script display area 230 displays a script list composed of script paragraphs for each video page and a scroll bar 910 for searching the script list, , in the video display area 210 , a video of a video page that is being played may be reproduced and displayed. That is, as shown on the left side of FIG. 9, the video of the video page of the script paragraph 14 that is currently being played is reproduced and displayed in the video display area 210, and in accordance with this, the script paragraph 14 is shaded and the script display area ( 230) and may be displayed.

Then, as shown on the right side of Fig. 9, when the script paragraph 17 is clicked in the script list, the script paragraph 17 is shaded and moved to the top of the script display area 230 to be displayed, and the video page of the script paragraph 17 is displayed. It can be played and displayed.

The image service providing apparatus 100 has been described so far as a smart phone, but the function of the image service providing apparatus 100 according to the embodiment of the present invention may be implemented in a user terminal such as a PC or a notebook computer. . That is, smartphones, PCs, laptops, etc. may have slight differences in user interface or screen configuration due to differences in hardware environments, but the basic functions of the image service providing apparatus 100 according to the embodiment of the present invention are the same. can be implemented.

10 to 12 are diagrams showing a web screen implemented in a PC or a notebook computer.

Referring to FIG. 10 , an arbitrary keyboard key input for performing a mode switching function between the screen of the video playback mode in which the video page is played and displayed and the e-book mode in which the captured image of the video page is displayed, and a forward/backward movement function A pop-up window for guiding a keyboard key input for execution may be displayed.

In the embodiment, a mode switching function is assigned to the space bar, and a backward movement function is assigned to the direction key. Accordingly, when there is a space bar key input or a mouse click occurs on the space bar button displayed on the screen in the running state of the video playback mode, the mode switching function is performed, and as shown in FIG. 11, the screen of the e-book mode is displayed. is displayed In this case, in the space bar button display area, when the space bar is pressed in order to provide convenience to the user, guide information for notifying that the current e-book mode can be switched back to the video playback mode may be displayed. Here, 'video mode' is indicated as text.

As shown in FIG. 11 , when a right arrow key is input on the keyboard or a mouse click occurs on a right arrow button displayed on the screen while the screen of the e-book mode is displayed, a page image of the next page is displayed on the screen. Similarly, when there is an input of the left arrow key of the keyboard or a mouse click on the left arrow button displayed on the screen while the screen of the e-book mode is displayed, the page image of the previous page is displayed on the screen.

In one area of the screen of the e-book mode, a play button for switching from the e-book mode to the video play mode and simultaneously playing an image may be displayed. Accordingly, when the corresponding play button is clicked by the mouse in the e-book mode, the image is played while switching from the e-book mode to the moving picture play mode.

Here, the play button considers the user's user experience. In other words, users have the expectation that the video will be played naturally when they click the play button. Accordingly, when the play button is clicked in the video mode, the corresponding video is played. If the play button is clicked in the e-book mode, the image is played after switching from the e-book mode to the image play mode, thereby providing a user experience that meets the user's expectations.

On the other hand, as shown in FIG. 11 , when there is a space bar key input or a mouse click occurs on the space bar button displayed on the screen in the running state of the e-book mode, the mode switching function is performed, as shown in FIG. 12 . , The video playback mode screen is displayed. In this case, in the space bar button display area, if the space bar is pressed in order to provide convenience to the user, guide information for notifying that the current video playback mode can be switched back to the e-book mode may be displayed. Here, 'card mode' is indicated as text.

As shown in FIG. 12 , when a right arrow key is input on the keyboard or a mouse click occurs on a right arrow button displayed on the screen while the screen in the video playback mode is displayed, the image of the next page is played on the screen. Similarly, when a left arrow key is input on the keyboard or a mouse click occurs on a left arrow button displayed on the screen while the screen in the video playback mode is displayed, the image of the previous page is played on the screen.

13 is a diagram illustrating a user terminal in which a live lecture is being performed according to an embodiment of the present invention, and FIG. 14 is a diagram for explaining a videobook live function of the image service providing apparatus according to an embodiment of the present invention.

As shown in FIG. 13 , a user may take a live lecture through a live lecture application such as ZOOM or YouTube Live through his/her laptop.

At this time, the video service providing apparatus 100 according to an embodiment of the present invention interworks with the user's live lecture application, and as shown in FIG. 14 , a live lecture recorded image 1101 and a conversation generated by the live lecture application Record 1102 may be acquired and stored.

The acquired live lecture recorded image 1101 and conversation record 1102 may be divided into a plurality of video pages in a paragraph unit or sentence unit of a script, as described above by the page generating unit 110 .

Here, the conversation record 1102 is a record of the conversations of users during the course through the conversation window of the live lecture application, and is displayed on the Q&A screen 710 or the Q&A full view screen 720 as shown in FIG. 14, It may include speaker information 1105 such as the name of the person who entered the conversation, conversation input time information 1106 and conversation content 1107 .

At this time, as shown in FIG. 14 , on the Q&A screen 710 or the Q&A full view screen 720 , a command to request output of the live chat contents of the corresponding conversation record 1102 is input together with the conversation record 1102 . A live chat icon 1108 may be displayed.

That is, when the user inputs a live chat content output request command using the live chat icon 1108, the screen configuration unit 120 displays the corresponding conversation together with the conversation record 1102 in paragraph or sentence unit of the script. The recorded video 1101 of the live lecture of the record 1102 can be output to the screen through a pop-up window.

15 is a diagram for explaining an image service providing system in which an image service providing apparatus according to an embodiment of the present invention is implemented as a server computing device.

Referring to FIG. 15 , the image service providing system 1 according to an embodiment of the present invention may include a communication network 10 , a server 20 , and a user terminal 30 .

The server 20 and the user terminal 30 may be connected to each other through the communication network 10 . The communication network 10 may include a wired network and a wireless network, and specifically, a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), etc. It may include various networks.

The communication network 10 may also include the well-known World Wide Web (WWW). However, the communication network 10 according to the present invention is not limited to the networks listed above, and may include at least one of a well-known wireless data network, a well-known telephone network, and a well-known wired/wireless television network.

The server 20 is a service providing server or a content providing server that implements the functions and operations of the page generating unit 110 and the screen composing unit 120 described in FIG. 1 , and a video book requested by the user terminal 30 . It can perform the function of providing a service. For example, when the server 20 is a web server, the server 20 configures the content for the video book service requested by the user terminal 30 in the form of a web page and provides it to the terminal 30 . can On the other hand, as another example, when the server 20 is a multimedia providing server, the server 20 configures the multimedia content for the video book service requested by the user terminal 30 in the form of a transmission file and sends it to the corresponding user terminal 30 . can provide

The server 20 provides a video book service to the user terminal 30 by performing the functions and operations described in FIGS. 1 to 13 based on the image content stored in the database or the image content uploaded from the user terminal 30 . can

To this end, the server 20 generates a plurality of video pages by dividing the lecture video stored in the database or uploaded from the user terminal 30 into paragraph units or sentence units of a script for the lecture content. One video page may include a video of the video page, a script paragraph or sentence, and a captured image.

Hereinafter, for convenience of understanding and explanation, it is assumed that the lecture video is divided into script paragraphs to generate a plurality of video pages.

Here, the script may be a text converted from voice reproduced in a lecture video, and a paragraph may include at least one sentence, and the size of the paragraph may be preset. For example, one paragraph may consist of a plurality of short sentences or one long sentence. In addition, the captured image is an arbitrary video frame among a plurality of video frames constituting the corresponding video page, and may generally be the first video frame.

That is, the server 20 divides the lecture video into lecture videos of a length corresponding to a paragraph of a preset size in paragraph units of a script for a lecture voice reproduced together with the video in the lecture video, thereby providing a plurality of lecture videos for one lecture video. You can create a video page of

The server 20 configures a basic lecture screen and an additional service screen provided according to an additional user input.

In addition, when the configured basic lecture screen or additional service screen is output, the server 20 performs a process corresponding to a user input input through an input button or touch input pattern displayed on the screen.

The server 20 may provide a plurality of video pages generated by dividing the lecture video in units of script paragraphs to the user terminal 30 .

The user terminal 30 may provide a video book service based on information provided from the server 20 . For example, when the server 20 is a web server, the user terminal 30 may provide a web service type video book service based on the content provided from the server 20 . Meanwhile, as another example, when the server 20 is a multimedia providing server, the user terminal 30 may provide a video book service of a multimedia service method based on the content provided from the server 20 .

The user terminal 30 may download and install an application for providing the video book service described with reference to FIGS. 2 to 14 . In this case, the user terminal 30 may download the corresponding application by accessing an app store, a play store, or the like, or may download the corresponding application through a separate storage medium. Also, the user terminal 30 may download the corresponding application through wired/wireless communication with the server 20 or other devices.

The user terminal 30 may provide a video book service based on image content received from the server 200 or stored in a memory.

To this end, the user terminal 30 may be configured to include a data storage unit for storing an application for providing a video book service, and a processor.

The processor receives a plurality of video pages generated by dividing an arbitrary video into sentence units or paragraph units of a script for the voice of the video by executing the application, from the server, and the video of the plurality of video pages is Video display area where the captured image for each video page is played or multiple video pages are displayed, script display area where script paragraphs synchronized with multiple video pages are displayed, and questions and answers synchronized for each script paragraph of multiple video pages are input and displayed A screen including the chat window area can be output.

The user terminal 30 described in this specification includes a mobile phone, a smart phone, a laptop computer, a desktop computer, a digital broadcasting terminal, personal digital assistants (PDA), and a portable multimedia player (PMP). ), slate PC, tablet PC, ultrabook, wearable device, for example, watch-type terminal (smartwatch), glass-type terminal (smart glass), HMD (head mounted display)) may be included.

As shown in FIG. 2 , the user terminal 30 executes a videobook application installed for the videobook service, and configures and outputs a basically configured lecture screen on the display unit of the user terminal.

The basic lecture screen output to the user terminal 30 is an image display area 210 in which a lecture video is reproduced or a captured image of a video page is displayed, and a button display area 220 in which a plurality of input buttons received from the user are displayed. , it may be configured to include a script display area 230 in which a script according to the lecture voice is displayed and a chat window area 240 in which questions, opinions, and answers are input and displayed.

Here, in the video display area 210, a video of a video page is played and displayed according to a mode set according to a mode switching command input from a user through the button display area 220, or a captured image of a video page can be displayed. have.

And, the script paragraph displayed in the script display area 230 is synchronized with the video page or the captured image displayed in the video display area (210).

In addition, the questions, opinions, and answers displayed in the chat window area 240 are synchronized with a video page or a captured image displayed in the video display area 210 . Since the chat window area 240 is included in the basic lecture screen, the user can directly input a question or opinion about the video page currently being viewed in the lecture video. In other words, if a user comes across a part that he does not understand while watching a lecture video, he or she can post a question on that part and receive an answer later. In addition, the user may check answers to questions posted by other users and share questions and answers. Through this, an effect similar to learning from other people's questions in an offline class can be achieved.

The user terminal 30 may output a screen in a video playback mode in which a video page is reproduced and displayed as shown in FIG. 3 , and as shown in FIG. 4 , in an e-book mode in which a captured image of a video page is displayed. You can print the screen.

Looking at the screen output to the display unit of the user terminal 30, in the button display area 220, a text view button 221, a mode change button 222, a playback speed conversion button 223, and a bookmark setting button 224 ), a bookmark view button 225 and a table of contents button 226 may be displayed.

When the text view button 221 is clicked and a text view command is input, the user terminal 30 may output the text view screen 500 as shown in FIG. 5 as an additional service screen. That is, the user terminal 30 may configure the text view screen 500 as shown in FIG. 5 as it detects that the text view button 221 is clicked.

On the body view screen 500, a page list composed of a captured image 10 and a script paragraph 20 for each video page for the entire lecture video is displayed, and a scroll bar 510 may be displayed to display on a single screen. . In this case, the plurality of video pages may be displayed in a list from top to bottom in the order of the video lecture. Through this, the user can quickly scan the entire lecture video and quickly understand the content, and can move to a desired part and watch it.

When the mode switching button 222 is clicked and a mode switching command is input, the user terminal 30 switches the mode according to the currently set mode. That is, the user terminal 30 switches to the e-book mode when the mode switch button 222 is clicked when the currently set mode is the video playback mode, and, conversely, when the currently set mode is the e-book mode, the mode switch button ( 222) is clicked to switch to the video playback mode.

The user terminal 30 may output a screen in the video playback mode as shown in FIG. 3 so that the videos of the video page are continuously played in units of script paragraphs.

As shown in FIG. 4 , the user terminal 30 may output the screen in the e-book mode so that the captured images of the video page are continuously displayed in units of script paragraphs. That is, the user terminal 30 may provide the effect of viewing a picture book by executing the e-book mode and showing the captured image and the corresponding script paragraph.

When the playback speed conversion button 223 is clicked and a playback speed conversion command is input, the user terminal 30 converts the double speed of playback of the lecture video.

When the bookmark setting button 224 is clicked and a bookmark setting command is input, the user terminal 30 sets the captured image and script paragraph of the video page currently playing or displaying the captured image as bookmarks when clicked.

When the bookmark collection button 225 is clicked and a bookmark collection command is input, the user terminal 30 may output the bookmark collection screen 600 as shown in FIG. 6 as an additional service screen. That is, the user terminal 30 may configure the bookmark view screen 600 as shown in FIG. 6 as it detects that the bookmark view button 225 is clicked.

On the bookmark collection view screen 600 , a page list composed of a captured image 10 for each bookmarked video page and a script paragraph 20 may be displayed. Through this, the user can save a specific part or remark as a bookmark while watching a lecture video, and then collect the saved bookmark at a time and view it again, which can be helpful for review.

The user terminal 30 may further display a bookmark collection share button (not shown) in the button display area 220 . Accordingly, when the bookmark collection share button is clicked and a bookmark collection sharing command is input, the user terminal 30 may share the bookmark collection data including the page list and memo for each bookmark to other designated users. Here, the memo for each bookmark may be written by the user who sets the bookmark for each bookmark. For example, when a bookmark collection sharing command is input, the user terminal 30 may provide the user with a function of writing a memo for each bookmark.

Then, when the table of contents button 226 is clicked and a table of contents display command is input, the user terminal 30 may output a table of contents screen (not shown) for the stored lecture video as an additional service screen. That is, the user terminal 30 may configure the table of contents screen by detecting that the table of contents button 226 is clicked.

On the other hand, the user terminal 30 is the left or right area of the video display area 210 while the video of the video page is continuously played back in units of script paragraphs or the captured images of the video page are continuously displayed in units of script paragraphs. When a preset number of times is clicked (eg, double-touched), it moves to the previous or next video page to play the video page or display the captured image.

Through this, the user can read the script of the lecture video without missing a single character, so that the user can quickly grasp the contents of the lecture, and can quickly and conveniently move to the desired part of the lecture video and watch it.

On the other hand, the user terminal 30 displays a list of questions and answers for each video page, a script consisting of a script paragraph for each video page, and a list of questions and answers input through the chat window area 240 when a Q&A full view command is inputted. You can configure the Q&A full view screen.

For example, as shown in FIG. 7 , the user terminal 30 may output a question and answer for a video page input through the chat window area 240 on the screen. When the chat window area 240 is clicked and a Q&A view command is input, the user terminal 30 may configure and output the Q&A screen 710 for the current video page. Here, on the Q&A screen 710 , a chat window area 240 and a Q&A full view button 711 may be displayed along with the questions 50 and answers 60 of the current video page.

When the user terminal 30 clicks the Q&A full view button 711 on the Q&A screen 710 and a Q&A full view command is input, the list including the script paragraph of the entire video page, the questions 50 and the answers 60 A Q&A full view screen 720 on which is displayed can be configured and output. In this case, a button 721 to view only my questions and opinions may be displayed on the Q&A full view screen 720 .

In the user terminal 30, when the Collect My Questions and Opinions button 721 is clicked on the Q&A All Views screen 720 and the Collect Only My Questions and Opinions command is input, the Collect Only My Questions and Opinions screen 730 ) can be configured and printed.

On the other hand, when a book community creation command is input, the user terminal 30 receives the setting information of the book community that the user wants to create and the identification information of another user who wants to join as a member of the book community to create the book community. have. In this case, the user terminal 30 may display only the questions and answers of the book community members on the Q&A screen 710 or the Q&A full view screen 720 .

For example, the user terminal 30 may output a book community setting screen as shown in FIG. 8 . On the Q&A screen 710 or the full Q&A view screen 720 , a book community creation button 715 may be displayed along with questions and answers about the video page.

When the book community creation button 715 is clicked and a book community creation command is input, the user terminal 30 displays a setting window 717 for creating a book community on the Q&A screen 710 or the Q&A full view screen 720. can

As shown in FIG. 8 , the user terminal 30 sets the book community setting information, such as the book community name, and identification information such as the nickname, e-mail address, and mobile phone number of another user to be joined as a member through the setting window 717. You can get input from the user.

The user terminal 30 may create a book community according to the received book community setting information and book community member identification information, and configure members of the created book community. Accordingly, the user terminal 30 may output a Q&A screen 710 or a full Q&A view screen 720 in which only questions and answers of book community members are displayed.

Meanwhile, a button (not shown) for switching to a scroll mode may be further displayed in the button display area 220 . So, in the user terminal 30, when the switch to scroll mode button is clicked and a mode switch command to the scroll mode is input, the script list composed of script paragraphs for each video page is displayed in the script display area 230 using the scroll function. Screens can be output to be displayed sequentially.

The user terminal 30 may shade the script paragraph of the currently playing video page and place it at the top or the center of the script display area 230 . Thereafter, when any one script paragraph is clicked and selected from the script list, the user terminal 30 may shade the selected script paragraph and move it to the top or center of the script display area 230 . In this case, the user terminal 30 may play a video page corresponding to the selected script paragraph.

For example, the user terminal 30 may output a scroll mode screen as shown in FIG. 9 . When a mode switching command from the video playback mode to the scroll mode is input, the user terminal 30 displays a script list consisting of a script paragraph for each video page and a scroll bar 910 for searching the script list in the script display area 230 and , in the video display area 210 , a video of a video page that is being played may be reproduced and displayed.

That is, as shown on the left side of FIG. 9 , the user terminal 30 reproduces and displays the video of the video page of the currently playing script paragraph 14 in the video display area 210, and shades the script paragraph 14 accordingly. It can be processed and displayed to be located at the top of the script display area 230 .

Thereafter, as shown on the right side of FIG. 9 , when the script paragraph 17 is clicked in the script list, the user terminal 30 shades the script paragraph 17 and moves to the top of the script display area 230 to display the script. The video page in paragraph 17 can be played and displayed.

Meanwhile, in the present embodiment, the user terminal 30 provides the video book service described with reference to FIGS. 2 to 13 in cooperation with the server 20 , but is not necessarily limited thereto, and interworking with the server 20 . It will be apparent to those skilled in the art that the video book service can be independently provided without the need for a video book.

On the other hand, in the embodiment of the present invention, when generating a plurality of video pages by dividing a lecture video, it has been described that the lecture content is divided into paragraph units or sentence units of the script, but the present invention is not limited thereto and preset It can be divided into an appropriate length of the script, and can be appropriately divided based on the number of words or the number of characters constituting the script.

On the other hand, the components of the above-described embodiment can be easily grasped from a process point of view. That is, each component may be identified as each process. In addition, the process of the above-described embodiment can be easily understood from the point of view of the components of the apparatus.

In addition, the technical contents described above may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiments, or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floppy disks. - includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. A hardware device may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

The above-described embodiments of the present invention have been disclosed for purposes of illustration, and various modifications, changes, and additions will be possible within the spirit and scope of the present invention by those skilled in the art having ordinary knowledge of the present invention, and such modifications, changes and additions should be regarded as belonging to the following claims.

Claims (15)

a page generator for generating a plurality of video pages by dividing the video into sentence units or paragraph units of a script for the audio of the video; and A video display area in which moving pictures of the plurality of video pages are played or captured images for each of the plurality of video pages are displayed, a script display area in which script paragraphs synchronized with the plurality of video pages are displayed, and script paragraphs of the plurality of video pages A video service providing device including a screen component that configures a screen including a dialog area where synchronized questions and answers are input and displayed. According to claim 1, The screen component, When a mode switching command is input, the video service providing device, characterized in that the video service providing device, characterized in that the switching to a video playback mode in which the plurality of video pages are reproduced or an e-book mode in which the captured image is displayed. 3. The method of claim 2, The screen component, In the video playback mode, when the video display area or the left area of the script display area is clicked, the previous video page is played, and when the video display area or the right area of the script display area is clicked, the next video page is played, , In the e-book mode, when the image display area or the left area of the script display area is clicked, the captured image of the previous video page, the script paragraph, and the chat window area are displayed, and the image display area or the right area of the script display area is When clicked, the video service providing device, characterized in that for displaying the captured image of the next video page, the script paragraph and the dialog area. According to claim 1, The screen component, When a text view command is input, a video service providing apparatus comprising: configuring a text view screen on which a page list consisting of captured images for each video page and script paragraphs is displayed. According to claim 1, The screen component, When the bookmark setting command is input, the captured image and script paragraph of the video page currently playing or displaying the captured image are set as bookmarks, When a bookmark view command is input, a bookmark view screen is configured in which a page list consisting of a captured image of a video page set as a bookmark and a script paragraph is displayed, When a bookmark collection sharing command is input, the apparatus for providing a video service, characterized in that the bookmark collection data including the page list and the notes for each bookmark are shared with other designated users. According to claim 1, The screen component, When a Q&A view command is input, a Q&A screen is configured in which questions and answers of the current video page input through the dialog area are displayed, When the Q&A full view command is input, the Q&A full view screen in which a list of questions and answers for each video page input through the dialog area, a script composed of a script paragraph for each video page, and a list of questions and answers is continuously displayed A video service providing device, characterized in that. 7. The method of claim 6, The screen component, When a book community creation command is input, the book community is created by receiving the setting information of the book community that the user wants to create and the identification information of another user who wants to join the book community as a member, The apparatus for providing video service, characterized in that only the member's questions and answers are displayed on the Q&A screen or the Q&A full view screen. According to claim 1, The screen component, When a mode switching command to scroll mode is input, the screen is configured so that the script list composed of script paragraphs for each video page is sequentially displayed using the scroll function in the script display area, Shade the script paragraph of the currently playing video page and place it at the top or center of the script display area, When any one script paragraph is selected from the script list, the selected script paragraph is shaded and moved to the top or center of the script display area, Video service providing apparatus, characterized in that the video page corresponding to the selected script paragraph is reproduced. a data storage unit for storing applications; and including a processor; The processor by executing the application, A plurality of video pages generated by dividing an arbitrary video into sentence units or paragraph units of a script for the audio of the video are received from the server, and the videos of the plurality of video pages are played or the plurality of video pages A video display area in which a star captured image is displayed, a script display area in which a script paragraph synchronized with the plurality of video pages is displayed, and a dialog window in which a question, answer, or opinion synchronized for each script paragraph of the plurality of video pages is input and displayed An apparatus for providing an image service, characterized in that it outputs a screen including an area. 10. The method of claim 9, The processor is When a mode switching command is input, the video service providing device, characterized in that the video service providing device, characterized in that the switching to a video playback mode in which the plurality of video pages are reproduced or an e-book mode in which the captured image is displayed. 11. The method of claim 10, The processor is In the video playback mode, when the video display area or the left area of the script display area is clicked, the previous video page is played, and when the video display area or the right area of the script display area is clicked, the next video page is played, , In the e-book mode, when the image display area or the left area of the script display area is clicked, the captured image of the previous video page, the script paragraph, and the chat window area are displayed, and the image display area or the right area of the script display area is When clicked, the video service providing device, characterized in that for displaying the captured image of the next video page, the script paragraph and the dialog area. 10. The method of claim 9, The processor is When a text view command is input, an apparatus for providing video service characterized in that it outputs a text view screen in which a page list consisting of captured images for each video page and script paragraphs is displayed. 10. The method of claim 9, The processor is When the bookmark setting command is input, the captured image and script paragraph of the video page currently playing or displaying the captured image are set as bookmarks, When a bookmark view command is input, a bookmark view screen is displayed in which a page list consisting of a captured image of a video page set as a bookmark and a script paragraph is displayed, When a bookmark collection sharing command is input, the apparatus for providing a video service, characterized in that the bookmark collection data including the page list and the notes for each bookmark are shared with other designated users. 10. The method of claim 9, The processor is When a book community creation command is input, the book community is created by receiving the setting information of the book community that the user wants to create and the identification information of another user who wants to join the book community as a member, Device characterized in that only the questions and answers of the member are displayed on the Q&A screen or the Q&A full view screen. 10. The method of claim 9, The processor is When a mode switching command to the scroll mode is input, the screen is output so that the script list composed of script paragraphs for each video page is sequentially displayed using the scroll function in the script display area, Shade the script paragraph of the currently playing video page and place it at the top or center of the script display area, When any one script paragraph is selected from the script list, the selected script paragraph is shaded and moved to the top or center of the script display area, Device characterized in that it plays a video page corresponding to the selected script paragraph.

Images