KR20160017467A - Method and apparatus for providing product information related to video contents - Google Patents

Abstract

Disclosed are a method and apparatus for providing product information related to video content. The method of the present invention comprises the following steps: receiving metadata of video content from a set-top box; determining product information corresponding to the video content based on the metadata; and receiving current content information of the video content from the set-top box, and transmitting information on a particular product corresponding to the current content information of the video content from the product information to the set-top box. The metadata may include information on correspondence between a plurality of lower video content and the product information which are included in the video content.

Description

TECHNICAL FIELD [0001] The present invention relates to a method and an apparatus for providing product information related to video contents,

The present invention relates to on-demand video content, and more particularly, to a method and apparatus for providing product information related to on-demand video content.

As the proportion of advertising in broadcasting increases, technological advances are being actively made to maximize advertising revenue. One of the recent advertising-related technologies is Targeted Advertising, which provides viewers with only advertisements that match viewer preferences. The target advertisement method is a technique for providing an advertisement specialized for each receiver, and may be expressed by the term client-based advertisement insertion method.

For example, OCAP (OpenCable Application Platform), an interactive cable broadcasting standard in North America, applied a client-based advertisement insertion method called OCAP DPI (Digital Program Insertion) to test broadcasts in some regions of North America. After successful trials in some parts of North America, the relevant specification was published as OCAP1.1-I01. Ad insertion technologies such as OCAP DPI technology can contribute to improving the advertisement revenue of broadcasting contents providers and improve the satisfaction of viewers purchasing products.

Various advertising methods such as research on methods for enhancing advertisement effect by providing advertisements based on video content provided to viewers as well as client-specific customized advertisements are being continuously conducted.

Korean Patent Application No. 10-2012-0139642 [entitled " ADVERTISEMENT SERVICE SYSTEM AND METHOD AND APPARATUS AND OPERATING METHOD THEREFOR]

A first object of the present invention is to provide product information related to video contents.

A second object of the present invention is to provide an apparatus for providing product information related to video contents.

According to an aspect of the present invention, there is provided a method of providing product information related to video content, the method comprising: receiving metadata of the video content from a set-top box; Receiving the current content information of the video content from the set-top box and transmitting specific product information corresponding to the current content information of the video content to the set- The metadata may include information on correspondence between a plurality of lower video contents included in the video contents and the product information. The current content information may indicate a lower video content to be played back on the current display among the plurality of lower video contents. If the product information is displayed on the display, the remaining image excluding the image corresponding to the product information on the display may be a blurred image. Wherein the video content is divided into a pre-start content, a main content, and a post-end content, and when the current content information indicates the pre-start content, the specific product information corresponding to the current content information corresponds to the main content All product information can be included. A method of providing product information associated with video content includes receiving information about a paused screen on the display from a set top box, separating a product image and a background image from the paused screen, Performing contour analysis and detail image information analysis, and transmitting product information corresponding to the product image to the set-top box. The step of performing the contour analysis and the detail image information analysis on the product image includes the steps of determining a final product contour based on the first product contour based on the edge information and the second product contour based on the category information of the product, And analyzing the detailed image information inside the final product contour based on the edge analysis.

According to another aspect of the present invention, there is provided an apparatus for providing product information related to video content according to an aspect of the present invention, the apparatus for providing goods information includes a processor, Receives metadata of the video content from the settop box, determines merchandise information corresponding to the video content based on the meta data, receives current content information of the video content from the settop box, And transmitting the specific product information corresponding to the current content information of the content to the set-top box, wherein the metadata includes information on a correspondence relationship between the plurality of lower video contents included in the video content and the product information . The current content information may indicate a lower video content to be played back on the current display among the plurality of lower video contents. If the product information is displayed on the display, the remaining image excluding the image corresponding to the product information on the display may be a blurred image. Wherein the video content is divided into a pre-start content, a main content, and a post-end content, and when the current content information indicates the pre-start content, the specific product information corresponding to the current content information corresponds to the main content All product information can be included. The processor receives information on a paused screen on the display from the set-top box, separates the product image and the background image from the paused screen, performs the contour analysis on the product image and the detail image information analysis , And transmits the goods information corresponding to the goods image to the set-top box. The processor determines a final product contour based on a first product contour based on edge information and a second product contour based on category information of the product for the contour analysis and performs corner analysis and edge analysis for the detail image information analysis The detailed image information analysis inside the final product contour line can be performed.

As described above, in the method and apparatus for providing product information related to video contents according to the embodiment of the present invention, advertisement effects can be maximized by providing advertisements to viewers in accordance with contents of video contents to be reproduced. The viewer can receive the advertisement information while viewing the video content, and the provider can maximize the advertisement effect to the viewer by performing the advertisement through the video content. In addition, the creator of the video content can reduce the cost for producing the video content with the amount of money to be provided in return for the advertisement from the business entity.

1 is a conceptual diagram illustrating a method of providing goods information according to an embodiment of the present invention.
2 is a conceptual diagram illustrating a method of providing goods information according to an embodiment of the present invention.
3 is a conceptual diagram illustrating a product information providing system according to an embodiment of the present invention.
4 is a flowchart illustrating a product information providing system according to an embodiment of the present invention.
5 is a conceptual diagram illustrating a method of providing goods information according to an embodiment of the present invention.
6 is a conceptual diagram illustrating a goods information providing system according to an embodiment of the present invention.
7 is a flowchart illustrating an operation of an image analysis server according to an embodiment of the present invention.
8 is a conceptual diagram illustrating a method of analyzing product detail image information according to an embodiment of the present invention.
9 is a conceptual diagram illustrating a method of retransmitting product image information according to an embodiment of the present invention.
10 is a conceptual diagram illustrating a method of providing goods information according to an embodiment of the present invention.
11 is a conceptual diagram illustrating a method of providing goods information according to an embodiment of the present invention.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. Like reference numerals are used for like elements in describing each drawing.

The terms first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Hereinafter, the same reference numerals will be used for the same constituent elements in the drawings, and redundant explanations for the same constituent elements will be omitted.

Hereinafter, embodiments of the present invention disclose a method for enhancing the effectiveness of an advertisement through exposure of advertisements upon reproduction of video-on-demand contents provided through a set-top box. However, a method of advertising a product related to video contents according to an embodiment of the present invention may be applied to various video contents as well as on-demand video contents transmitted through a set-top box. As an example, an advertisement of a product related to video content may be exposed to a user before, after, and in a pause state of VOD (video on demand) content. In this case, the exposed advertisement may be an advertisement related to the VOD selected by the user. Hereinafter, an embodiment of the present invention will be described with reference to a method of advertising a product related to specific video contents.

1 is a conceptual diagram illustrating a method of providing goods information according to an embodiment of the present invention.

1 illustrates how an advertisement associated with video content is played on a display when video content is played on a display (hereinafter referred to as display) 100 of a viewer. Hereinafter, in the embodiment of the present invention, the display may be interpreted to include a set-top box.

Referring to FIG. 1, when a viewer watches video contents, information on goods related to the video contents can be provided to the user. For example, when a viewer selects video contents to be reproduced on the display 100 based on the VOD service, information (hereinafter referred to as product information) about the goods associated with the selected video contents is transmitted to the viewer before or after the reproduction of the video contents Can be provided.

In addition, the viewer can stop playing the video content in a specific scene while playing the video content using the pause function. In this case, product information (also referred to as advertisement content) 170 related to previously reproduced video content of the stopping scene and / or the stopping scene may be provided to the viewer. Commodities may include physical and human resources that can be purchased by viewers, such as goods and service events.

Product information 170 associated with video content may be provided to viewers in a variety of ways. For example, the merchandise information 170 of the merchandise 150 corresponding to the specific frame 120 among the frames constituting the video content may be provided to the viewer through the display 100.

The image information of the specific frame 120 to provide the product information corresponding to the specific frame 120 through the display 100 may include an identification image for the product 150 for providing the product information 170 to the viewer (E.g., a highlight for the item, an outline for the item, text for the item, etc.) 140.

For example, if the viewer pauses to receive the product information 170, the paused screen (or the specific frame 120) may include an identification image 140 for the item 150 Can change. The viewer may select the identified item 150 based on the identified image 140 on a particular frame 120. [ For example, a viewer may select an item 150 displayed as an identification image 140 (e.g., highlight) based on the remote control. When the viewer selects a particular item 150 indicated by the identification image 140, specific item information 170 may be transmitted to the viewer. For example, the specific merchandise information 170 provided to the viewer may include a merchandise image, a merchandise price, a coupon that can be used when purchasing merchandise, a billing information, a product review, and the like, which change according to changes in viewing direction.

For example, merchandise information 170 may include information about merchandise such as costumes of performers cast on video content, accessories of performers, furniture for interiors placed on a set, and the like. Or the product information 170 may be information on a content item of another program (drama, entertainment, movie, etc.) in which the performers appear, or may include information on a product or an event of the sponsorship company sponsored for producing the video content .

2 is a conceptual diagram illustrating a method of providing goods information according to an embodiment of the present invention.

FIG. 2 shows a method in which product information is provided before and / or after reproduction of a video content.

For example, the merchandise information may be provided to the viewer with an image representing the audience rating prior to the playback of the video content, an ending credit image after the playback of the video content. Specifically, the video content can be divided into a pre-start content, a main content, and a post-start content. In the case of a movie, the pre-start content may include a product advertisement that is output before the actual main movie content is played, a trailer for another movie, a movie clip of the movie company, and the like. The main content is related to the actual movie, and the content after the end may be a credit image after the actual movie ends. According to the embodiment of the present invention, the current content information may indicate before the start of the main content and before the start of the main content. In this case, the specific product information corresponding to the current content information includes all the goods information corresponding to the main content can do. The current content information may indicate the lower video content to be played back on the current display among the plurality of lower video contents. Or the current content information may be time information corresponding to the lower video content being reproduced in the current display. Current content information may be expressed in terms of current status information in other terms. Also, when the current content information of the video content indicates the main content and before the start of the content after the end, all the goods information corresponding to the main content can be provided to the viewer through the display. If the current content information of the video content is the main content, the product information corresponding to the current content information (for example, the lower video content corresponding to the paused main content) may be provided to the viewer.

The image showing the audience rating, the ending credit image is blurred, and the product information overlaps the blurred image, so that it can be provided to the viewer. Specifically, when the user pauses playback of the video content, the paused image 200 is blurred and the image of the item 250 associated with the paused image 200 is paused 200 to be provided to viewers. The image 250 of the product is clearly processed in the entire image and the portion of the product 250 not corresponding to the product information is blurred so that the viewer can be provided with an image of the product 250 clearly.

As a specific example, it may be assumed that the merchandise information for the handbag included in the temporarily stopped image of the video content is provided. In this case, it is determined that the product information related to the handbag included in the image in which the viewer has been suspended is present through the flickering of the image of the handbag included in the paused image, the color differentiation of the image of the handbag, It can be recognized. The image corresponding to the handbag may be excluded from the entire image, and the remaining portion may be blurred using a blur filter or the like.

Alternatively, after blurring all the video content images displayed on the display to provide the product information, the images corresponding to the product information can be overlapped on the blurred image. The product information may be displayed on a blurred video content image in a pop-up window format.

3 is a conceptual diagram illustrating a product information providing system according to an embodiment of the present invention.

Referring to FIG. 3, the product information providing system may include a moving picture providing unit 300, a metadata unit 310, a customized product information providing unit 320, and a processor 330. Hereinafter, in the embodiment of the present invention, it is assumed that the moving picture providing unit 300, the metadata unit 310, and the customized product information providing unit 320 are included in one product information providing system, . However, the moving picture providing unit 300, the metadata unit 310, and the customized product information providing unit 320 may be implemented as individual components in a separate configuration, and one component may be divided into a plurality of additional components It is possible.

The video providing unit 300 may be implemented to provide video content and / or product information (or advertisement content) to the set-top box 350 of the viewer. The product information may be information associated with the video content as described above. The moving picture providing apparatus 300 may transmit the video contents selected by the viewer and / or the goods information corresponding to the selected video contents to the set-top box 350. The advertisement contents may be transmitted to the set-top box 350 separately from the customized product information providing unit 330 to be described later.

The metadata unit 310 may be implemented to generate metadata information associated with the video content selected by the user. The metadata may be attribute information of the video contents. The metadata of the video contents may be data assigned to the video according to a certain rule in order to efficiently find and use the information found in a large amount of information. For example, the metadata may include the location and content of the video, information about the creator, rights conditions, usage conditions, usage history, and the like. Specifically, the metadata may include information on correspondence between a plurality of lower video contents included in the video contents and product information.

The metadata unit 310 may transmit the metadata to the set-top box 350 of the viewer.

The set-top box 350 may analyze the received metadata and transmit the metadata to the custom merchandise information providing unit 320. The custom merchandise information providing unit 320 may generate the advertisement content based on the metadata. In addition, the set-top box 350 acquires information on the current video content status information, transmits the acquired status information of the current video content to the custom merchandise information providing unit 320, The information on the current video content can be received from the video information providing server. The status information of the current video content may be information on the video content currently being played on the display. The metadata may be directly transmitted from the metadata unit 310 to the customized merchandise information providing unit 320.

The custom merchandise information providing unit 320 can determine the merchandise information corresponding to the video content based on the metadata received from the set-top box 350. For example, the customized product information providing unit 320 transmits metadata to a goods information server (e.g., a goods (or an event, a service) server) and transmits merchandise information corresponding to the meta data from the goods information server Can receive.

Specifically, the custom merchandise information providing unit 320 can determine merchandise information to be exposed at the reproduction time of the specific video content based on the video content status information and the metadata received from the set-top box 350. The custom merchandise information providing unit 320 may provide the determined merchandise information to the set-top box 350.

Or the customized product information providing unit 320 may determine and store product information corresponding to the video content status information and the metadata. Then, only when the video content status information (for example, the frame identifier information for obtaining the product information) for requesting the product information is transmitted to the customized product information providing unit 320 in the set-top box, the customized goods information providing unit 320 The merchandise information corresponding to the video content status information for requesting the merchandise information may be transmitted.

The video content status information for requesting product information in the set-top box (or the current content information of the video content transmitted from the set-top box) may include information indicating the lower video content to be reproduced in the current display among the plurality of lower video contents .

The product information preferentially received in the set-top box 350 may include only the identifier information for the goods. When an identifier for a specific product is selected by the viewer, the set-top box 350 may transmit the identifier information for the selected specific product to the customized product information providing unit 320. [ The custom merchandise information providing unit 320 may transmit additional information about the specific merchandise to the set top box 350 based on the identifier information.

The processor 330 may be implemented to control the operations of the moving image providing unit 300, the metadata unit 310, and the customized product information providing unit 320.

4 is a flowchart illustrating a product information providing system according to an embodiment of the present invention.

4, the flow of data between the moving picture providing unit 400, the metadata unit 420, the customized product information providing unit 440, and the set top box 460 starts.

Referring to FIG. 4, when a viewer selects specific video contents, information on the selected specific video contents can be transmitted to the moving picture providing unit 400 and the metadata unit 420.

The video data providing unit 400 may transmit the video content selected by the viewer to the set-top box through a transmission method such as streaming.

The metadata unit 420 may transmit the metadata corresponding to the video content selected by the viewer to the set-top box 460. The metadata may be directly transmitted to the customized merchandise information providing unit 440.

The set-top box 460 can analyze the received metadata and determine the status information of the currently played video content. The set-top box 460 may transmit status information and metadata of the current video contents to the custom merchandise information providing unit 440.

The custom merchandise information providing unit 440 may transmit the metadata received from the set-top box 460 and the status information of the current video content to the merchandise server. The goods server can transmit the goods information to the customized goods information providing unit 440 based on the metadata and the status information of the current video contents.

The custom merchandise information providing unit 440 may transmit the merchandise information corresponding to the video content status information and the metadata to the set top box 460. For example, the custom merchandise information providing unit 440 can determine the merchandise information to be exposed at the reproduction time of the specific video content, and when the viewer selects a specific merchandise on the video content, To the viewer.

Or the customized product information providing unit 440 may determine and store product information corresponding to the video content status information and the meta data. For example, the metadata may include information on correspondence between a plurality of lower video contents included in the video contents and product information.

Then, only when the video content status information (for example, the identifier information of the frame for obtaining the product information) for requesting the product information is transmitted from the set-top box to the custom merchandise information providing unit 440, The goods information corresponding to the status information may be transmitted. The video content status information for requesting product information in the set-top box (or the current content information of the video content transmitted from the set-top box) may include information indicating the lower video content to be reproduced in the current display among the plurality of lower video contents .

The set-top box 460 can reproduce the video content and / or the product information received from the video providing unit 400 and the customized product information providing unit 440.

5 is a conceptual diagram illustrating a method of providing goods information according to an embodiment of the present invention.

5 illustrates how merchandise information is provided to a viewer via display 500 when video content is played on the viewer's display 500 in real time (e.g., real-time terrestrial, real-time cable, etc.).

For example, a viewer may be provided with merchandise information related to video content transmitted via airwaves. For example, if a viewer wishes to be provided with product information related to a specific screen of video content transmitted to the display 500 in real time, it is possible to use a specific button (e.g., a pause button) A temporary screen stop can be performed. For example, when the viewer presses the pause button, the display 500 can store the frame corresponding to the still picture in a memory and provide it to the viewer.

The display 500 may transmit information on the paused screen to the product information providing unit 550. The information on the paused screen may be, for example, identifier information of a frame corresponding to a paused screen, identifier information of video contents including a paused screen, and the like. The goods information providing unit 550 may provide the goods information corresponding to the video contents.

Alternatively, another network device (for example, a home PC) may display a pause screen from the display 500 without sending the information about the screen in which the display 500 is directly paused to the product information providing unit 550 And may transmit the information to the product information providing unit 550.

The goods information providing unit 550 may receive the information on the paused screen and transmit the goods information related to the paused screen to the display 500. [ Or the product information providing unit 550 may further transmit the product information related to the partial screen reproduced before the paused screen to the display 500. [ For example, the product information providing unit 550 can search for product information that is matched based on the identifier of the content corresponding to the paused screen, the identifier information of the frame, and displays the searched product information on the display 500 Lt; / RTI >

The display 500 can receive the product information from the product information providing unit 550 and reproduce it. The product information may include advertisements for physical goods, human goods (services, events, etc.) as described above.

When information on a specific commodity transmitted to the display 500 is selected by the viewer, the display 500 may transmit an identifier for the commodity selected by the viewer to the commodity information providing unit 550. [ The product information providing unit 550 may transmit additional advertisement information (specific product description information, payment information, and the like) related to the selected specific product to the display 500.

The display 500 may not use the full screen of the display 500 to provide product information to the user, but may use only some screens. For example, a screen for providing product information to a user is limited to a portion of a screen on the upper right side of the entire screen, and an over-the-air broadcast can be provided to a user in real time through the remaining screen.

5, a method of providing product information related to paused video content to a viewer is disclosed, but the same advertisement may be continuously provided through metadata in which video content and an advertisement image are mapped. For example, in the case of 8 o'clock to 10 o'clock in the morning, the providing target of the goods information may be set as the housewife. In this case, the product information providing system can provide not only the product information related to the video contents but also the product information that targets the housewife as the advertisement in relation to the video contents provided at 8:00 am to 10:00 am.

6 is a conceptual diagram illustrating a goods information providing system according to an embodiment of the present invention.

Referring to FIG. 6, the product information providing system may analyze the image on the video content and provide the product information to the viewer.

In the above-described embodiment, only the product information about the predetermined product on the video content can be provided. However, according to the embodiment of the present invention, the product information on the arbitrary product as well as the predetermined product on the video content may be provided.

For example, it may be assumed that a viewer wants to acquire product information for a specific product while watching the video content. In this case, the viewer can perform screen capture of the entire image including the product image. The screen-captured product image may be transmitted from the display 600 to the viewer's communication device (e.g., smartphone) 620. The moving picture information for a certain period may be transmitted to the communication device 620 after the screen capture button is pressed rather than the screen captured image.

The communication device 620 may separate the product image and the background image from the screen-captured image. After the product image and the background image are separated from the screen-captured image, the product image can be displayed on the screen-captured image based on a separate identification image. For example, an identification image, such as an outline, an outline, a highlight, etc., is combined with a product image and displayed on a screen-captured image so that the product image can be identified separately from the background image.

The viewer can select at least one product image among the product images to which the identification image is added based on the interface such as the touch screen on the communication device 620. [ The product image selected by the viewer can be expressed by the term selected product image. An image-based product information search can be performed based on the selected product image. Specifically, the communication device 620 can transmit the image information of the product (object) to the image analysis server 640, and the image analysis server 640 can receive the product information corresponding to the image information of the product (Product name, product dealer, product price, etc.).

The image analysis server 640 may transmit the product information to the viewer's communication device 620. [

6, a method of receiving product information from an image analysis server 640 through a viewer's communication device 620 has been described. However, it is also possible to transmit the image information of the goods directly to the image analysis server 640 on the display 600 without passing through the communication device 620 as an intermediary and to transmit the image of the goods through the display 600 or the viewer's communication device 620 Information on products corresponding to information may be provided, and such embodiments may also be included in the scope of the present invention. In the embodiment of the present invention, a method of transmitting image information of a product to the image analysis server 640 via the communication device 620 as an intermediary for the sake of explanation will be described.

7 is a flowchart illustrating an operation of an image analysis server according to an embodiment of the present invention.

7, a method of acquiring product information based on image information (or product image) of a product received by the image analysis server will be described.

As described above, the communication device can transmit the product image to the image analysis server on the screen-captured image. The image analysis server can obtain the product information through analysis of the image of the product.

Referring to FIG. 7, the image analysis server may preferentially analyze the outline of the product image based on the image of the product (step S700).

The image analysis server can analyze the outline of the product image through edge analysis. For example, the image analysis server can analyze the outline of the object based on the change of luminance, saturation-related data of the pixel with respect to the product image. The image analysis server can further utilize the information on the category of the product in analyzing the outline of the object.

The image analysis server can generate the first product outline information by analyzing the outline of the product based on the change of the luminance and chroma related data of the pixel. In addition, the image analysis server may generate the second product outline information by analyzing the outline of the product based on the information on the category of the product.

The image analysis server may roughly determine the category of the goods to generate the second goods outline information. For example, if the product image is an image for a handbag, the image analysis server can preferentially obtain information that the category of the product corresponds to a handbag through a rough image analysis. The image analysis server may obtain information on the category of the goods and obtain the second goods outline information based on various images (e.g., various images for the handbag) for the goods category.

The portion corresponding to the intersection of the first product outline information and the second product outline information can be determined as the final outline information of the product.

After determining the final outline information of the product, the product detail image information may be analyzed (step S720).

The detail image information of the product can be performed through analysis of corner information and edge information of the product image. Corner information and edge information in the product image can be determined based on the directionality of the image change. The product detail image information may include color information as well as corner information and edge information of the product image. A method of analyzing corner information and edge information of a product image will be described later.

The image analysis server can calculate the matching degree by comparing the analyzed product detail image information with the detail image information of various products located in the image analysis server.

* The image analysis server can determine the image having the highest matching degree and search for the product information (goods dealer, product image of various angles, product price, etc.) associated with the image having the highest matching degree (step S740) .

The image analysis server may deliver product information associated with the image with the highest matching degree of discovery to a display or viewer's communication device.

8 is a conceptual diagram illustrating a method of analyzing product detail image information according to an embodiment of the present invention.

8, a method for analyzing corner information and edge information in a product image based on a search window 800 will be described.

The search window 800 may be moved within the final contour of the article to obtain directionality of the image information change. The search window 800 can obtain surrounding pixel information while moving at specific angles (for example, one pixel unit) up or down, left or right or at a specific angle with a specific position as a reference point. The search method of the search window 800 may be expressed in terms of the peripheral pixel information acquisition procedure of the search window 800.

The size of the search window 800 can be set according to the accuracy of the analysis of the product detail image information.

8, if the position of the search window 800 is not the position of the corner and the edge, the neighboring pixel information obtained based on the neighboring pixel information obtaining procedure of the search window 800 has no direction of change .

8, if the search window 800 is located at the edge position, the neighboring pixel information obtained based on the neighboring pixel information obtaining procedure of the window may have one change direction. In particular, pixels having different properties with respect to the edge may be located on the search window 800. In the case of the interruption of Fig. 8, when the search window 800 is moved from side to side, pixels having different properties around the edge in the vertical direction can be searched. In this case, It is possible to judge that the edge of < RTI ID = 0.0 >

 8, if the search window 800 exists at a corner, the neighboring pixel information obtained based on the neighboring pixel information obtaining procedure of the search window 800 has a plurality of directions of change . Specifically, a pixel having a plurality of change orientations with respect to the corner may be located on the search window 800. In the case of the bottom of FIG. 8, when the search window 800 moves in the left and right direction, pixels having different properties around the vertical edges can be searched. In addition, when the search window 800 moves in the vertical direction, pixels having different properties can be searched around the edges in the horizontal direction.

In this case, it can be determined that the edge is positioned in the upward direction and the left-right direction in the portion where the search window 800 is located, and it can be determined that the corner exists at the point where the edge in the up-down direction and the left-right direction meet.

9 is a conceptual diagram illustrating a method of retransmitting product image information according to an embodiment of the present invention.

9, when the image analysis server 940 fails to acquire the product information based on the image of the received product (for example, when the resolution of the product image is lower), the image analysis server 940 transmits the product The user can request information about the image of the user again. The communication device 920 may newly generate a product image for transmission to the image analysis server 940 when receiving a retransmission request message for the image of the product from the image analysis server 940. [

In order to reproduce the product image, the display 900 may store not only the screen-captured image but also the stored moving picture information (or a plurality of pieces of image information) for a predetermined period after the screen capture button is pressed. For convenience of description, it is assumed that the display 900 stores moving picture information for a certain period after the screen capture button is pressed.

When the communication device 920 receives the re-request message for the image of the product, the communication device 920 may request the display 900 for the moving image information for retransmission of the product image. The display 900 may transmit the moving image information for retransmission of the product image to the communication device 920. [

The communication device 920 can determine the retransmission product image to be retransmitted by tracking the product image included in the moving image information based on the information on the product image previously acquired. As a specific example, the communication device 920 may track an image of the same handbag included in the video based on the image of the previously obtained handbag to obtain a clearer product image for the handbag. The communication device 920 can determine an image including an image for the handbag having the highest resolution among the plurality of images constituting the moving image, and extract image information for the handbag from the image.

9, it is assumed that the operation for retransmitting the product image is performed based on the communication device 920. However, an operation for retransmission of the product image may be performed on the display 900, not the communication device 920. [ For example, the display 900 may determine the retransmission product image to be retransmitted by tracking the product image included in the moving image information based on information on the product image previously obtained directly. Display 900 may also send a direct retransmission product image to image analysis server 940.

10 is a conceptual diagram illustrating a method of providing goods information according to an embodiment of the present invention.

10, if there is no product / advertisement / event information related to video contents, the product information providing system may recommend product / advertisement / event information based on the time information 1000 (for example, current time) .

For example, if the current time is 10:00 am, the product information providing system can recommend product / advertisement / event information suitable for 10 o'clock. As another example, the product information providing system may provide product / advertisement / event information related to a bargain product to housewives in the morning, and product / advertisement / event information related to a nightgown product at night.

In addition, if there is no directly registered merchandise / advertisement / event information associated with the video content, the merchandise information providing system may provide related merchandise / advertisement / event information related to the video content 1020. For example, if the video content 1020 is a child video content, the merchandise information providing system provides child-related merchandise information, and if the video content 1020 is a drama, It is possible to provide the target product / advertisement / event information.

In addition, if there is no directly registered product / advertisement / event information related to the video contents, it may recommend the product / advertisement / event information based on the viewing history 1020 of the existing viewer and the popular keyword. For example, the goods information providing system can analyze the video contents viewed by the existing viewers and determine the goods / advertisement / event information to be provided to the viewers. For example, the merchandise information providing system can provide the viewer with the merchandise / advertisement / event information related to the video content viewed over a certain rate in time among the video contents watched by the viewer. When a viewer watches a lot of music programs, the viewing history related to the music program of the viewer can be delivered to the goods information providing system. The merchandise information providing system can provide the related merchandise information (performance ticket, sound source, etc.) to the viewer based on the viewing history related to the music program of the viewer.

The product information providing system can provide the user with the goods / advertisement / event information related to the popular keyword 1060 when there is no viewing history 1020 of the viewer.

If there is no directly registered merchandise / advertisement / event information associated with the video content, the merchandise / advertisement / event information to be provided to the viewer can be determined by setting priorities for the various criteria described above. For example, the product information providing system may include a product related to the video content 1040 in a first order, a product determined based on a viewing history 1020 in a second order, and a product Information can be provided to the viewer.

In addition, if there is no directly registered merchandise / advertisement / event information associated with the video content, it is possible to provide the viewer with various combinations of merchandise related to the video content, merchandise determined based on the viewing history, Product information can be provided. For example, the merchandise information providing system can provide the merchandise related to the video content and the merchandise related to the viewing history to the viewer in consideration of the merchandise related to the video content and the viewing history.

In addition, the merchandise information providing system can accumulate the log (time, point of view) of the viewer when the viewer purchases / watches / participates the recommended goods / advertisements / events, and can use the goods / advertisements / events when recommending them.

Also, according to the embodiment of the present invention, even if the same video contents are watched, the product information provided for each set-top box may be different. For example, even if the viewer A (or the house A) and the viewer B (the house B) view the same video content on different displays at different places, the personalized recommendation article information is obtained by considering the individual information such as the viewer's personal information Can be provided. The personalized recommended product information may be provided in consideration of the sex, age, The personal information may be provided as separate information to the product information providing system, but the product information providing system may estimate the personal information of the viewer based on the information such as the past purchase history of the product. For example, in the case of a viewer who has purchased a piece of merchandise information and has purchased history, the merchandise information providing system may estimate the viewer's personal information as a woman, thirties, or the like.

In the above description, the case where there is no product / advertisement / event information related to the video contents has been described as an example, but it is only an example for convenience of explanation. Even if there are goods / advertisement / Advertisement / event information may be determined by combining various criteria described above and provided to the user.

11 is a conceptual diagram illustrating a method of providing goods information according to an embodiment of the present invention.

11, various commodity / advertisement / event information providing methods of the commodity information providing system are described.

As described above, the goods information providing system can provide the goods / advertisement / event information at the start time and / or the end time of the video contents. The video contents may be temporarily stopped when providing the product / advertisement / event information, and if there is no additional event (e.g., additional product information request signal) by the viewer after the pause, And the video content may be automatically provided again.

Referring to FIG. 11, a product advertisement may be provided through a user device 1150 in cooperation with a user device such as a smart phone.

For example, brief product information is provided through a main medium such as the TV display 1100, and when there is a request for additional product information by the viewer, the product information providing server 1120 transmits the user's device 1150 Specific product information, billing information, and the like can be provided through the service. That is, the user may provide detailed product / advertisement / event information on the TV display 1100 and, if there is a request from the buyer, specific product / advertisement / event information may be transmitted to the viewer's user device 1150. The product information providing server 1120 can separate and generate and manage the product / advertisement / event information in a simple first format and a specific second format.

In addition, the product / advertisement / event information may be automatically paused in the first entry state, the pause state, and the end state of the video contents. However, if a specific button is pressed, have. That is, when the viewer presses the corresponding button, the related product / advertisement / event is exposed. When a specific button is pressed, exposure of a message indicating that a product, an advertisement, or an event is exposed may be different depending on a reproduction point of the video content, or may be always exposed.

In addition, the information displayed in the initial entry state, the pause state, and the end state of the video contents may be the same or different.

For example, the product / advertisement / event information may be provided in different formats, or may be provided in the same format depending on the initial entry state, the pause state, and the end state, and the product / advertisement / event information provided may be different. For example, advertisements may be exposed prior to the beginning of the video content, products may be paused while the video content is paused, and events may be exposed at the end of the video content. As another example, if the product is exposed before, during, or after the start of the video content, different products may be exposed at each time point.

The present invention has been described above with reference to preferred embodiments. It will be understood by those skilled in the art that the present invention may be embodied in various other forms without departing from the spirit or essential characteristics thereof. Therefore, the above-described embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is indicated by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

Claims (10)

A method for providing product information associated with video content,
Receiving metadata of the video content from a set-top box;
Determining merchandise information corresponding to the video content based on the metadata; And
Receiving the current content information of the video content from the set-top box, and transmitting specific product information corresponding to the current content information of the video content in the product information to the settop box,
Wherein the metadata is related to a video content including information about a correspondence between a plurality of lower video contents included in the video content and the product information. The method according to claim 1,
Wherein the current content information indicates a lower video content to be reproduced in the current display among the plurality of lower video contents. 3. The method of claim 2,
Wherein when the product information is displayed on the display, the remaining image excluding the image corresponding to the product information on the display is a blurring-processed image. 3. The method of claim 2,
The video content is divided into a pre-start content, a main content, and a post-
Wherein when the current content information indicates the pre-start content, the specific product information corresponding to the current content information includes all the product information corresponding to the main content. The method according to claim 1,
Receiving information on a paused screen on the display from a set-top box;
Separating a product image and a background image from the paused screen; And
Performing contour analysis and detail image information analysis on the product image; And
And transmitting the product information corresponding to the product image to the settop box,
Wherein the step of performing contour analysis and detail image information analysis on the product image comprises:
Determining a final product contour based on a first product contour based on edge information and a second product contour based on category information of the product; And
And performing an analysis of detail image information inside the final product contour based on corner analysis and edge analysis. A product information providing apparatus for providing product information related to video contents, the product information providing apparatus comprising a processor,
The processor receives the metadata of the video content from the set-top box,
Determining merchandise information corresponding to the video content based on the metadata,
Receiving the current content information of the video content from the set-top box, and transmitting specific product information corresponding to the current content information of the video content in the product information to the settop box,
Wherein the metadata includes information on correspondence between a plurality of lower video contents included in the video contents and the product information. The method according to claim 6,
Wherein the current content information indicates a lower video content to be reproduced in the current display among the plurality of lower video contents. 8. The method of claim 7,
Wherein when the product information is displayed on the display, the remaining image excluding the image corresponding to the product information on the display is a blurred image. The method according to claim 6,
The video content is divided into a pre-start content, a main content, and a post-
Wherein if the current content information indicates the pre-start content, the specific product information corresponding to the current content information includes all the product information corresponding to the main content. . 10. The apparatus of claim 9,
Receiving information on a paused screen on the display from a set-top box,
A product image and a background image are separated from the temporarily stopped screen,
Performing contour analysis and detail image information analysis on the product image,
And transmits the product information corresponding to the product image to the set-top box,
Wherein the processor determines a final product contour based on a first product contour based on edge information and a second product contour based on category information of the product for the contour analysis for the contour analysis and the detail image information analysis,
Wherein the detail information analysis unit is configured to perform detail image information analysis within the final product contour based on corner analysis and edge analysis for analyzing the detail image information.

Images