JP2019036807A - Browsing system, information processing apparatus, image distribution method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a browsing system for delivering an appropriate image when there are restrictions on the images that can be delivered. A viewing system includes an image distribution device 10 that distributes at least a part of a wide-angle image, and an information processing device 30 that displays at least a part of the wide-angle image. The image distribution device includes a still image generation means for generating one or more still images 5 from the wide-angle image 6 and a distribution means for transmitting either the entire wide-angle image or the still image to the information processing device. The information processing apparatus includes an image acquisition means for acquiring a wide-angle image or a still image, and an image display means for displaying the wide-angle image or the still image acquired by the image acquisition means on the display device. [Selection diagram] Fig. 2

Description

  The present invention relates to a browsing system, an information processing apparatus, an image distribution method, and a program.

  A distribution-type display advertisement in which an advertiser displays an advertisement in an advertisement space provided on a Web page is known. Advertisers can display advertisements for products and services in advertising spaces provided by various websites. Since a viewer who is interested in the product or service displayed in the advertisement frame clicks (or taps) the advertisement frame, the advertiser can call the viewer into his / her website.

  Advertisers want to improve the frequency with which viewers click on advertisements, but the number of advertisements posted on one web page is increasing, and advertisers devise display methods that attract the attention of viewers (For example, refer to Patent Document 1). Patent Document 1 discloses a technique for improving the effect (click rate) of an advertisement by distributing a video advertisement. Since people tend to lose their line of sight to moving objects, it is possible to increase the degree of attention of advertisements and improve the effectiveness of advertisements.

  However, there is a problem that the conventional display advertisement does not consider the case where the moving image cannot be distributed. That is, in order to display a moving image, a script (program) operates on the terminal device, and the advertisement distribution network needs to support the moving image. When the terminal device does not support the display of a moving image, or when the moving image cannot be distributed due to the specifications of the advertisement distribution network, a situation in which the moving image cannot be distributed may occur. If the advertiser stops delivering the video when the video cannot be delivered, the advertising opportunity is lost for the advertiser, and the revenue opportunity is lost for the advertising agency. Although it is considered to distribute a still image instead of a moving image, if the terminal device simply displays a still image, the appeal of the advertisement is reduced.

  An object of this invention is to provide the browsing system which delivers an appropriate image, when the image which can be delivered has restrictions in view of the said subject.

The present invention is a browsing system including an image distribution device that distributes at least a part of a wide-angle image, and an information processing device that displays at least a part of the wide-angle image,
The image distribution device includes: a still image generation unit that generates one or more still images from the wide-angle image; and a distribution unit that transmits either the entire wide-angle image or the still image to the information processing device. And the information processing apparatus includes: an image acquisition unit that acquires the wide-angle image or the still image; and an image display unit that displays the wide-angle image or the still image acquired by the image acquisition unit on a display device. Have.

  It is possible to provide a browsing system that distributes an appropriate image when there are restrictions on images that can be distributed.

It is an example of the figure explaining an omnidirectional image as an example of a wide-angle image. It is an example of the figure explaining the outline of a browsing system. It is an example of the schematic block diagram of a browsing system. It is an example of a block diagram showing a schematic hardware configuration of a terminal device, an advertiser Web server, a partner site Web server, a DSP, an SSP, and an image distribution device. It is an example of the use image figure of a spherical camera. It is a figure explaining the outline | summary of the process until an omnidirectional image is produced from the image imaged with the omnidirectional camera. It is a figure explaining the outline | summary of the process until an omnidirectional image is produced from the image imaged with the omnidirectional camera. It is an example of the figure explaining a viewer's eyes | visual_axis. It is an example of the functional block diagram which shows the function of a terminal device, an advertiser web server, a partner site web server, an image delivery apparatus, SSP, and DSP in a block form. It is an example of the flowchart figure which shows the procedure in which an attention point determination part determines an attention point. It is an example of the figure explaining the partial image of an omnidirectional image. It is a figure which shows an example of the kind of advertising space. A still picture generated for a horizontally long advertising space is schematically shown. It is an example of the flowchart figure which shows the procedure in which a still image production | generation part produces | generates a still image. It is an example of the figure which illustrates typically the information which a web page uses. It is an example of the sequence diagram explaining the procedure which the browsing system delivers the omnidirectional image used as an advertisement. It is an example of the flowchart figure which shows the procedure which an advertisement delivery part selects an omnidirectional image or a still image. It is an example of the sequence diagram which shows the procedure in which an image delivery apparatus updates the click frequency with respect to a still image. It is an example of the flowchart figure which shows the procedure in which the advertisement delivery part of an image delivery apparatus suppresses delivery of the same still image.

  Hereinafter, as an example of an embodiment for carrying out the present invention, a browsing system and an image distribution method performed by the browsing system will be described with reference to the drawings.

<Outline of Electronic Device System of Present Embodiment>
FIG. 1 is an example of a diagram illustrating an omnidirectional image 6 as an example of a wide-angle image. FIG. 1A shows an omnidirectional image 6 represented by a three-dimensional solid sphere CS, and FIG. 1B shows an omnidirectional image 6 represented by an equirectangular projection. The omnidirectional image 6 generated by the omnidirectional camera has a three-dimensional structure in which an image as shown in FIG. The virtual camera IC corresponds to the viewer's viewpoint, and the viewpoint is at the center of the omnidirectional image 6 in FIG. The viewer can display an arbitrary predetermined region T of the omnidirectional image 6 by rotating three axes around the X axis, the Y axis, and the Z axis passing through the virtual camera IC. The predetermined area T can be enlarged or reduced, and the displayed predetermined area T in the omnidirectional image 6 is called an angle of view.

  FIG. 2 is a diagram illustrating an overview of the browsing system 100 of the present embodiment. In this embodiment, a display advertisement by third party distribution will be described. Third-party distribution is a mechanism for distributing advertisements across a plurality of media in order to manage the entire campaign on the advertiser side. The third-party distribution server controls the advertisement distribution frequency and measures the advertisement effect. In FIG. 2, the image distribution apparatus 10 corresponds to a third party distribution server.

In the present embodiment, a browsing system 100 that uses a still image generated from the omnidirectional image 6 for a distributed advertisement will be described. Since the omnidirectional image 6 has a wide angle of view, in order for the viewer to view the omnidirectional image 6 with less distortion, the terminal device needs to execute a script and display the predetermined area T by a rotation operation. However, in the following cases, the terminal device cannot execute the script and cannot display the omnidirectional image.
(i) When the terminal device does not have a function to execute scripts
(ii) When the terminal device turns off the script execution function (or when the browser does not support script execution)
(ii) When a DSP described later does not accept script distribution Therefore, the image distribution apparatus 10 of the present embodiment prepares a still image including a point of interest from an omnidirectional image in advance, and (i) to (iii) If this is the case, the still image is distributed to the terminal device.
(1) When the terminal device 30 opens a Web page having the advertising space 7 with the browser 8, a DSP 20 (Demand Side Platform) that wants to display an advertisement on the terminal device 30 is notified to the terminal device 30. The terminal device 30 requests an advertisement from the DSP 20.
(2) The DSP 20 requests an advertisement from the image distribution apparatus 10.
(3) The image distribution device 10 stores the advertisement request, generates access information 2 for the terminal device 30 to access the own device, and transmits the access information 2 to the DSP 20.
(4) The DSP 20 transmits the received access information 2 to the terminal device 30.
(5) The terminal device 30 requests advertisement data (omnidirectional image 6) from the image distribution device 10 based on the access information 2. The image distribution apparatus 10 according to the present embodiment includes a plurality of attention points P of the omnidirectional image 6 (each attention point is represented by Pn (n: natural number), and arbitrary attention points are simply indicated by “P”) and images. The still image 5 that holds the corner and is cut out at the attention point P and the angle of view is created.
(6) When requested by the access information 2, the image distribution apparatus 10 determines whether or not it corresponds to (i) to (iii), and if so, the still image 5 is not an omnidirectional image. The included advertisement data is transmitted to the terminal device 30.
(7) The terminal device 30 receives the advertisement data and displays the still image 5.

  Although the terminal device 30 displays the still image 5 instead of the omnidirectional image 6, the still image 5 is created so as to include an attention point that easily attracts the viewer's interest. . It is difficult to list the whole celestial sphere image because 360 degrees is taken around it. However, in the browsing system 100 according to the present embodiment, the point of interest can be displayed as the still image 5, so that the advertiser shows it. It makes it easier for the viewer to browse the desired part. Therefore, the advertising effect (click rate) can be improved even if the terminal device 30 cannot display a moving image because the script cannot be executed.

<Terminology>
The attention point P refers to a part (characteristic part) in which a characteristic image is reflected in the omnidirectional image 6. The term “point” is not limited to one pixel but may mean a part. More specifically, the attention point P is a portion where the viewer is assumed to be interested. The attention point P may be determined by, for example, pure image processing, may be detected as a portion where a predetermined subject is captured, or may be statistically determined from a portion actually displayed by the viewer Good.

  The effect of the advertisement is at least attention, but further clicking (or tapping) by the viewer may be referred to as an effect.

  The moving image includes not only that a plurality of images (for example, images that change in time series) are switched, but also that that appears as a moving image by changing the display range of one image.

<System configuration example>
FIG. 3 is an example of a schematic configuration diagram of the browsing system 100. The browsing system 100 includes a terminal device 30, an image distribution device 10, an advertiser Web server 70, a DSP 20, an SSP 50 (Supply Side Platform), and a partner site Web server 60 that can communicate via a network N.

  The network N is constructed by a LAN constructed in a facility where the terminal device 30 is installed, a provider network of a provider that connects the LAN to the Internet, a line provided by a circuit provider, and the like. When the network N has a plurality of LANs, the network N is called a WAN or the Internet. The network N may be constructed by either wired or wireless, and wired and wireless may be combined. Further, when the terminal device 30 is directly connected to the public network, it can be connected to the provider network without going through the LAN.

  The terminal device 30 is an information processing device that operates as a client terminal in the present embodiment. In the terminal device 30, the browser 8 or application software having an equivalent function is operating, and the Web page requested by the terminal device 30 is received from the partner site Web server 60 and displayed (LCD: Liquid Crystal Display described later). To display.

  The terminal device 30 is, for example, a PC (Personal Computer), a tablet device, a smartphone, a PDA (Personal Digital Assistant), a game machine, a navigation terminal, a wearable PC, or the like, as long as it can display a Web page. For example, the printer may be used as the terminal device 30 when the printer has a function for displaying a Web page or a display. Digital signage may display a web page. Digital signage is a system, display device, or information that is displayed using electronic display devices such as a display in places where people can pass or exist, such as outdoors, stores, public spaces, and transportation facilities. Say. In the present embodiment, it is assumed that the web application is included in the web page. The web application refers to software used on the web browser or a mechanism thereof, which operates when a program in a programming language (for example, JavaScript (registered trademark)) that operates on the web browser and a program on the web server side cooperate. .

  The terminal device 30 may be connected to the network N via a wired LAN or wireless LAN access point, or connected to the network N by switched line type communication such as 3G, 4G or LTE (Long Term Evolution). Also good.

  The partner site Web server 60 is a server (general information processing device) that provides information and functions to a client computer (a terminal device 30 of the present embodiment) used by a viewer through a network. An advertisement frame 7 is provided on a web page provided by the advertiser web server 70. The partner site Web server 60 requests the SSP 50 to display an advertisement on the advertisement space 7.

  The advertiser Web server 70 is also a server (general information processing apparatus) that provides information and functions through a network to a client computer (terminal apparatus 30 of the present embodiment) used by a viewer. When the viewer clicks (or taps) the advertising space 7 on which the still image is displayed, the terminal device 30 accesses the advertiser Web server 70. The advertiser web server 70 is operated by the advertiser, and requests the DSP 20 to purchase the advertising space 7 for displaying the advertisement of its product or service, and requests the image distribution apparatus 10 to generate the advertisement and display the advertisement. ing.

  The advertiser web server 70 and partner site web server 60 communicate with the terminal device 30 using, for example, a communication protocol of HTTP or HTTPs. In response to the request from the terminal device 30, the advertiser Web server 70 and the partner site Web server 60 transmit screen information to the terminal device 30. The screen information is a program described in HTML, script language, and CSS (cascading style sheet). The structure of the Web page is specified mainly by HTML, the operation of the Web page is specified by the script language, and the Web is specified by CSS. The page style is specified. In the present embodiment, it is a script language that reflects the operation of the browser on the Web page in the omnidirectional image 6. Specifically, a program language called JavaScript (registered trademark) or ECMAScript is known as the script language.

  Both the advertiser web server 70 and the partner site web server 60 record cookies on the terminal device 30. Advertiser Web server 70 records both its own cookies and DSP 20 cookies, and partner site Web server 60 records both its own cookies and SSP 50 cookies.

  The SSP 50 is a mechanism for maximizing profits by selling the advertising space 7 by the partner site Web server 60 on which the advertising space 7 is posted. Although shown as one device in the figure, it is a network of one or more information processing devices. The partner site Web server 60 requests the SSP 50 to sell the advertising space 7. Specifically, an advertisement tag issued by the SSP 50 is described in the advertisement space 7, and when the terminal device 30 displays a web page of the partner site web server 60, the advertisement tag requests the SSP 50 to distribute an advertisement (advertisement request). . The SSP 50 transmits access information 1 for the terminal device 30 to request an advertisement to the DSP 20 to the terminal device 30.

  The DSP 20 is a mechanism for performing efficient and effective advertisement distribution for advertisers, such as purchase of advertisement space 7 and advertisement distribution. Although shown as one device in the figure, it is a network of one or more information processing devices. That is, the DSP 20 acquires a cookie (referred to as an SSP cookie for distinction) from the SSP 50, and determines the attributes of the viewer based on the correspondence information between the DSP cookie and the SSP cookie managed by the DSP 20. Then, a bid is placed on the SSP 50 at a price determined based on the advertisement distribution setting from the advertiser requested based on the viewer's attributes, budget, and the like. When the bid is successful, the DSP 20 notifies the image distribution apparatus 10 of the advertisement request, and obtains access information 2 for requesting the advertisement data from the image distribution apparatus 10 to the image distribution apparatus 10. The advertisement data includes a display program for displaying the omnidirectional image 6 and an operation history program for acquiring an operation history.

  The DSP 20 transmits access information 2 for requesting advertisement data to the image distribution device 10 to the terminal device 30. The DSP 20 charges the advertiser according to the contract. Billing according to the contract is performed between the image distribution apparatus 10 and the advertiser. However, whether or not the user is charged only when the advertisement is displayed differs depending on the contract.

  The image distribution apparatus 10 is one or more information processing apparatuses that provide advertisement data including an advertisement material (global image 6) that is optimal for the viewer's attribute to the advertisement space 7 purchased by the DSP 20. The image distribution apparatus 10 holds input materials such as banners and texts and advertisement images. The advertisement data may be just a banner (an image made up of characters, photos or pictures), or may include a script language in addition to the image. In the present embodiment, the display program for rotating the omnidirectional image 6 or reflecting the operation of the viewer on the omnidirectional image 6 in the display mode of the omnidirectional image 6, and the omnidirectional image 6 An operation history program for recording an operation history is included. Both are described in a script language. However, when a still image is distributed, the script may not be distributed.

  When the terminal device 30 requests the advertisement data from the image distribution device 10 based on the access information 2, the image distribution device 10 transmits the advertisement data to the terminal device 30. The advertisement data includes at least one of the still image and the omnidirectional image 6. The still image includes at least the URL (Uniform Resource Locator) of the advertiser Web server 70. When the omnidirectional image 6 is included, the display program and the operation history program are included in the advertisement data, and the display program rotates the omnidirectional image, and the user's operation or automatically enlarges it. Or shrink. In addition, the operation history program transmits an operation history for the omnidirectional image 6 to the image distribution apparatus 10 together with a cookie (referred to as an image cookie for distinction) of the image distribution apparatus 10 and an image ID. The operation history is information indicating which viewing angle of view is displayed, for example. Since this operation history is used to determine the attention point, when the operation history is not used to determine the attention point, the operation history may not be transmitted.

  When the operation history program is transmitted together with the still image, the operation history program transmits to the image distribution apparatus 10 that the operation history program is clicked together with a still image ID described later. The image distribution device 10 generates one or more still images from one omnidirectional image 6, and only the still images with a high click rate can be distributed by monitoring the click rate of each still image. .

<Hardware configuration example>
FIG. 4 is a block diagram illustrating a schematic hardware configuration of the terminal device 30. The terminal device 30 can be generally implemented as a personal computer, a workstation, or an appliance server. The terminal device 30 includes a CPU 201 and a memory 202 that enables high-speed access of data used by the CPU 201. The CPU 201 and the memory 202 are connected to other devices or drivers of the terminal device 30, for example, a graphics driver 204 and a network device (NIC) 205 via the system bus 203.

  The graphics driver 204 is connected to an LCD (display device) 206 via a bus and monitors a processing result by the CPU 201. A touch panel may be integrally disposed on the LCD 206. In this case, the viewer can operate the terminal device 30 using a finger as an operation means.

  The network driver 205 connects the terminal device 30 to the network N at the transport layer level and the physical layer level to establish a session with the advertiser Web server 70 and the like.

  An I / O bus bridge 207 is further connected to the system bus 203. On the downstream side of the I / O bus bridge 207, a storage device such as an HDD 209 is connected by an IDE, ATA, ATAPI, serial ATA, SCSI, USB, etc. via an I / O bus 208 such as PCI. . Instead of the HDD 209 or together with the HDD 209, an SSD (Solid State Drive) may be included.

  The HDD 209 stores a program 209p for controlling the entire terminal device 30. The program 209p includes screen information transmitted by the advertiser Web server 70, the partner site Web server 60, and the DSP 20 in addition to the browser 8. The terminal device 30 executes the display program and the operation history program included in the browser 8 and the screen information. The program 209p includes an advertisement tag, access information 1, 2 and the like.

  Further, an input device 210 such as a keyboard and a mouse (referred to as a pointing device) is connected to the I / O bus 208 via a bus such as a USB, and accepts inputs and commands by an operator such as a viewer. .

  The hardware configuration diagram of the advertiser Web server 70, the partner site Web server 60, the SSP 50, the DSP 20, and the image distribution apparatus 10 is the same as or different from that in FIG. It shall not be a problem. Advertiser Web server 70, partner site Web server 60, DSP 20, and image distribution device 10 are preferably compatible with cloud computing. Cloud computing refers to a usage pattern in which resources on a network are used without being aware of specific hardware resources. In this case, the hardware configuration shown in FIG. 4 does not have to be housed in a single housing or provided as a single device, and is not limited to the advertiser web server 70, partner site web server 60, DSP 20, And hardware elements that the image distribution apparatus 10 preferably includes. In addition, in order to support cloud computing, the physical configurations of the advertiser Web server 70, partner site Web server 60, DSP 20, and image distribution apparatus 10 of this embodiment may not be fixed, and load may be increased. Accordingly, it may be configured by dynamically connecting / disconnecting hardware resources.

<About spherical image 6>
The omnidirectional image 6 will be described with reference to FIGS. FIG. 5 is a usage image diagram of the omnidirectional camera 9. As shown in FIG. 5, the omnidirectional camera 9 is used for the user to take an image of a subject around the user with his / her hand. The omnidirectional camera 9 has a structure in which the back surfaces of two imaging elements are opposed to each other, and obtains two hemispherical images by imaging a subject around the user.

  Next, an outline of processing until an omnidirectional image 6 is created from an image captured by the omnidirectional camera 9 will be described with reference to FIGS. 6 and 7. 6A shows a hemispheric image (front side) captured by the omnidirectional camera 9, FIG. 6B shows a hemispheric image captured by the omnidirectional camera 9 (rear side), and FIG. 6C. FIG. 4 is a diagram showing an image represented by equirectangular projection (hereinafter, referred to as “equal equirectangular image”). FIG. 7A is a conceptual diagram showing a state in which a sphere is covered with an equirectangular image, and FIG. 7B is a diagram showing an omnidirectional image 6.

  As shown in FIG. 6A, the image obtained by the omnidirectional camera 9 is a hemispherical image (front side) curved by the fisheye lens. Also, as shown in FIG. 6B, the image obtained by the omnidirectional camera 9 is a hemispherical image (rear side) curved by the fisheye lens. Then, the hemispherical image (front side) and the hemispherical image inverted by 180 degrees (rear side) are synthesized by the omnidirectional camera 9, and as shown in FIG. Created.

  Then, by using OpenGL ES (Open Graphics Library for Embedded Systems), as shown in FIG. 7A, the equirectangular image is pasted so as to cover the spherical surface, and FIG. The omnidirectional image 6 as shown in FIG. Thus, the omnidirectional image 6 is represented as an image in which the equirectangular image is directed toward the center of the sphere. OpenGL ES is a graphics library used to visualize 2D (2-Dimensions) and 3D (3-Dimensions) data. The omnidirectional image 6 may be a still image or a moving image.

  The advertisement data distributed by the image distribution device 10 may include the omnidirectional image 6. Since the omnidirectional image 6 is an image pasted so as to cover the spherical surface, it is curved and has a sense of incongruity when viewed by humans. Therefore, the terminal device 30 displays a predetermined region T of the omnidirectional image 6 as a flat image with a small curvature so as not to give a sense of incongruity to humans. The predetermined area T is indicated by coordinates (X, Y, Z) in a three-dimensional virtual space. On the other hand, since the LCD 206 is a two-dimensional plane, the terminal device 30 cannot be displayed in the predetermined area T. Therefore, the terminal device 30 obtains the predetermined region T by perspective projection conversion in which a three-dimensional object is projected onto a two-dimensional plane using a 3D computer graphic technique. As described above, as shown in FIG. 1, the predetermined area T of the omnidirectional image 6 is displayed on the LCD 206 as a display area.

  FIG. 8 is an example of a diagram illustrating a viewer's line of sight. Since the omnidirectional image 6 has three-dimensional coordinates, the line-of-sight direction is specified by information for specifying the three-dimensional coordinates or the coordinates of the sphere such as latitude and longitude. In the present embodiment, the center cp of the predetermined region T is the line-of-sight direction.

  The viewer can change the line-of-sight direction by operation, but assuming that the virtual camera IC does not move in parallel, the virtual camera IC is a rigid body that rolls (rotates around the Z axis) and yaw (centers around the Y axis). Rotation) and pitch (rotation around the X axis) are possible. The line-of-sight direction changes regardless of which of these three rotations occurs. For example, when the viewer rotates the omnidirectional image 6 in the horizontal direction, the yaw angle changes. When the viewer rotates it in the vertical direction, the pitch angle changes, and when the omnidirectional image 6 is rotated about the center of the LCD 206. The roll angle changes. In the present embodiment, a browser operation on the web page is reflected in the viewing direction (roll angle, yaw angle, pitch angle) and the like. It is assumed that how it is reflected is described in advance in the display program.

<About functions>
FIG. 9 is an example of a functional block diagram illustrating the functions of the terminal device 30, the advertiser Web server 70, the partner site Web server 60, the image distribution device 10, the SSP 50, and the DSP 20 in a block form.

<< Advertiser Web Server 70, Partner Site Web Server 60 >>
The advertiser web server 70 and the partner site web server 60 have a web page providing unit 71. These functions of the advertiser Web server 70 and the partner site Web server 60 are functions or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202.

  The web page providing unit 71 interprets the HTTP request from the terminal device 30, constructs a web page, and transmits it to the terminal device 30 as an HTTP response. If necessary for the processing, the application server is requested to perform the processing, and the processing result is arranged on the Web page and transmitted. The web page of the advertiser web server 70 includes an advertiser cookie and a DSP cookie. This is because the advertiser Web server 70 requests the DSP 20 to distribute advertisements. Thereby, a retargeting advertisement or the like becomes possible. The web page of the partner site web server 60 includes a partner site cookie and an SSP cookie. This is because the partner site Web server 60 requests the SSP 50 to sell the advertising space 7.

<< SSP50 >>
The SSP 50 includes an advertisement request acquisition unit 52, an advertisement request unit 51, an access information transmission unit 53, and a successful bid unit 54. Each of these functions of the SSP 50 is a function or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202.

  The advertisement request acquisition unit 52 acquires the advertisement request requested together with the SSP cookie by executing the advertisement tag associated with the advertisement space 7 by the terminal device 30. The advertisement request acquisition unit 52 sends an advertisement request including the SSP cookie to the advertisement request unit 51.

  The advertisement request unit 51 transmits an advertisement request to the DSP 20. The advertisement request includes the SSP cookie, the domain of the partner site Web server 60, the advertisement space ID, the advertisement space size, the advertisement format (supported image format), script ON / OFF, browser type, OS type, and the like. .

  The successful bid unit 54 accepts bids from the DSP 20, and basically conducts an auction for selling the advertising space 7 to the DSP 20 with the highest bid amount (some advertisers' products and services do not accept bids). The successful bid section 54 generates a successful bid ID and notifies the DSP 20 of it.

  The access information transmission unit 53 generates access information 1 for requesting an advertisement to the DSP 20 that has made a successful bid, and transmits it to the terminal device 30 together with the successful bid ID. The access information 1 includes the URL (at least the IP address) of the DSP 20.

<< DSP20 >>
The DSP 20 includes a request reception unit 21, a bid determination unit 22, a bid unit 23, an advertisement request reception unit 24, and an image request unit 25. Each of these functions of the DSP 20 is a function or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202.

  In the storage unit 29, a cookie information DB 291 and a distribution setting DB 292 are constructed. The storage unit 29 is realized by the HDD 209 or the memory 202 shown in FIG.

Table 1 schematically shows information stored in the cookie information DB 291. The cookie information DB 291 associates the DSP cookie and the SSP cookie, and the visit domain visited by the viewer is registered. The association between the DSP cookie and the SSP cookie is possible by a technique called a cookie sink. The visit domain is obtained by a visitor visiting a Web site to which the DSP 20 has attached a tag (behavior monitoring tag). Therefore, the DSP 20 can specify the DSP cookie from the SSP cookie, and can determine what Web site the viewer is interested in.

Table 2 schematically shows information stored in the distribution setting DB 292. In the distribution setting DB 292, an advertiser ID, an advertisement target attribute, and a non-advertisement target attribute are registered. The advertiser ID is identification information for specifying or identifying the advertiser. Note that ID is an abbreviation of Identification and means an identifier or identification information. ID refers to a name, a code, a character string, a numerical value, or a combination of one or more of these used to uniquely distinguish a specific target from a plurality of targets. The same applies to the following IDs. The advertisement target attribute is an attribute of a viewer that the advertiser wants to distribute the advertisement, and the non-advertisement target attribute is an attribute of a viewer that the advertiser does not want to distribute the advertisement. The DSP 20 compares the browser attribute determined from the cookie information DB 291 and the like with the information in the distribution setting DB 292, digitizes the browser attribute, and determines the bid amount. In addition, various information, such as a time slot | zone, a day of the week, a visitor's area, etc., may be considered in the determination of a bid price.

(Function of DSP 20)
The request reception unit 21 receives an advertisement request from the SSP 50. Basic information such as the advertising space ID of the terminal device 30 is obtained from the request information.

  The bid determination unit 22 determines the bid amount by evaluating the advertisement request received by the request reception unit 21 with reference to the cookie information DB 291 and the distribution setting DB 292 (there may not be a bid). As described above, the DSP cookie is identified from the SSP cookie, and the bid amount is determined by how much the attribute information stored in association with the DSP cookie matches the advertiser request stored in the distribution setting DB 292. To do.

  The bidding unit 23 bids on the SSP 50 with the determined bid amount. If successful bid is obtained, a successful bid ID is acquired and associated with the advertisement request.

  The advertisement request receiving unit 24 acquires an advertisement request (successful bid ID, DSP cookie) from the terminal device 30 based on the access information 1. The advertisement request receiving unit 24 specifies an advertisement request by the successful bid ID. The DSP cookie may not be used, and is used when the SSP cookie and the DSP cookie are not associated with each other.

  The image request unit 25 requests the image distribution apparatus 10 for the access information 2 together with the DSP cookie, the advertiser ID, and the request content. The advertiser is specified by the advertiser ID. The advertising space 7 is specified by the advertising space ID of the request content. Further, the viewer's attribute may be transmitted to the image distribution apparatus 10. Thereby, the image delivery apparatus 10 can deliver the omnidirectional image 6 suitable for the viewer.

<< Terminal device 30 >>
The terminal device 30 includes a web page acquisition unit 31, a web page analysis unit 32, a web page display unit 33, an operation reception unit 34, and a script execution unit 35. Each of these functions of the terminal device 30 is a function or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202.

  The operation receiving unit 34 receives various operations on the terminal device 30. Specifically, an operation for a browser executed by the terminal device 30 is accepted. When the Web page has a program (the above script) described in the script language, an operation on the Web page triggered by the script is accepted. In this embodiment, it is not strictly distinguished whether the operation target is the terminal device 30, the browser, or the web page, and the operation on the terminal device 30, the operation on the browser, or the operation on the web page has the same meaning. .

  The web page acquisition unit 31 communicates with the advertiser web server 70 or the partner site web server 60 by a browser operation or a script operation, and obtains a web page from the advertiser web server 70 and the partner site web server 60. .

  The Web page analysis unit 32 reads the HTML included in the screen information in order from the top, and analyzes the structure of text and image data included in the HTML. In addition, a link between HTML text and image data described in CSS is detected, and the style of text and image data included in HTML is associated. Further, the Web page analysis unit 32 detects a script tag from HTML and extracts a script described in a script language. The web page analysis unit 32 sends HTML and CSS to the web page display unit 33 and sends the script to the script execution unit 35.

  The web page display unit 33 displays web pages on the LCD 206 in the order in which the analysis is completed from the top of the HTML. In addition, the web page is updated according to an operation on the web page.

  The script execution unit 35 executes the script extracted by the web page analysis unit 32. The specific content of the script varies depending on the Web page. In the present embodiment, as a script, an advertisement tag associated with the advertising space 7, access information 1 acquired from the SSP 50, access information 2 acquired from the DSP 20, and advertisement data distributed from the image distribution device 10 are detected. The script execution unit 35 is realized by the CPU 201 illustrated in FIG. 4 executing the program 209p. Each function or means of the script execution unit 35 is realized by the CPU 201 executing the script.

  The advertising space detection unit 36 is a function realized by the terminal device 30 executing an advertising tag associated with the advertising space 7 included in the screen information acquired by the Web page acquisition unit 31. The advertisement space detection unit 36 transmits an advertisement request to the SSP 50 together with the SSP cookie based on the URL associated with the advertisement space 7.

  The access information acquisition unit 37 acquires access information 1 from the SSP 50. Access information 1 is described in a script. The advertisement request unit 38 accesses the DSP 20 based on the URL included in the access information 1 and requests an advertisement together with the successful bid ID and the DSP cookie. In response to this request, the advertisement request unit 38 acquires the access information 2 and the advertisement opportunity ID. Access information 2 is also described by a script.

  Based on the URL of the image distribution device 10 included in the access information 2, the advertisement acquisition unit 39 specifies an advertisement opportunity ID and requests the image distribution device 10 for advertisement data. Since the image distribution apparatus 10 generates advertisement data, the advertisement acquisition unit 39 acquires advertisement data. The advertisement data of this embodiment may be a still image only or a script including the omnidirectional image 6. That is, since the still image is distributed when the terminal device 30 cannot execute the script, only the still image is distributed. Since a script is required to display the omnidirectional image 6, the omnidirectional image 6, the display program, and the operation history program are distributed. The display program displays the omnidirectional image 6 by rotating the omnidirectional image 6 or the like. The operation history program receives an operation on the omnidirectional image 6 and transmits the operation history to the image distribution apparatus 10. The operation history program and the display program are also described in a script language, and are executed by the script execution unit 35.

  The advertisement display unit 40 displays the advertisement data acquired from the image distribution device 10. The advertisement display unit 40 is mainly realized by a display program, and displays the omnidirectional image 6 (that is, advertisement) in the advertisement frame 7 and automatically rotates it so as to follow the point of interest. Further, the display mode of the omnidirectional image 6 is changed according to the operation on the omnidirectional image 6.

  By acquiring the advertisement data from the image distribution device 10, the terminal device 30 can acquire the cookie of the image distribution device 10 and store it in the storage unit 49. When the advertisement acquisition unit 39 transmits the image cookie to the image distribution device 10, the image distribution device 10 can associate the DSP cookie with the image cookie.

  The operation history recording unit 41 is mainly realized by an operation history program, and records an operation history for the omnidirectional image 6. Details of the operation history will be described in the image distribution apparatus 10. The operation history transmission unit 42 is realized mainly by an operation history program, and distributes an operation history for the omnidirectional image 6 displayed in the advertising space 7 together with an image cookie and an image ID (identifies the omnidirectional image 6). Transmit to device 10.

<< Image distribution device 10 >>
The image distribution apparatus 10 includes an image information response unit 11, an advertisement distribution unit 12, an operation history analysis unit, an attention point determination unit 13, a still image generation unit 15, and an operation history acquisition unit 14. These functions of the image distribution apparatus 10 are functions or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202.

  Further, the image distribution apparatus 10 includes the storage unit 19 realized by the HDD 209 or the memory 202 illustrated in FIG. In the storage unit 19, a distribution history DB 191, an operation history DB 192, a cookie correspondence DB 193, an advertisement image DB 194, a click number DB 195, and an image determination DB 196 are constructed.

Table 3 schematically shows information stored in the operation history DB 192. In the operation history, a history of what operation each viewer has performed on the omnidirectional image 6 is recorded. In the operation history DB 192, items of image ID, viewing time, image cookie, viewing angle of view 1 to 3, and clicked angle of view are recorded. The image ID is information for specifying the omnidirectional image 6. The image cookie becomes information for determining the identity of the viewer operating the terminal device 30 or the terminal device 30 (an example of device identification information). The viewing angle of view 1 to 3 is an angle of view when the viewer browses the omnidirectional image 6. Each viewing angle of view 1 to 3 stores the viewing time, the presence / absence of enlargement, the angle of view after enlargement when enlarged, and the presence / absence of reduction. In this way, the angle of view that the viewer is considered interested in is recorded for each image. The viewing angle of view 1 to 3 is an angle of view in which the time during which the viewer is stationary without rotating the omnidirectional image 6 is a predetermined time (for example, 1 second) or more. The operation history recording unit 41 of the terminal device 30 records the upper three angles of view when the stationary time is reached. There may be only one or four or more. Similarly, the operation history recording unit 41 records whether or not the viewer is enlarged or reduced at each viewing angle of view 1 to 3. The angle of view at the time of clicking is the angle of view that was displayed when the viewer clicked the omnidirectional image (not a still image).

  The image distribution apparatus 10 can determine the attention point P based on such an operation history. Further, if an image cookie is associated with an image ID, a retargeting advertisement is possible.

Table 4 schematically shows information stored in the advertisement image DB 194. In the advertisement image DB 194, information related to the omnidirectional image 6 to be advertised is registered. In the advertisement image DB 194, an advertiser ID, an image ID, a priority, and a target attribute are registered in association with each other. Since the advertiser is determined by the DSP 20, among the images that the advertiser wants to distribute, an image to be distributed is determined based on the matching degree and priority of the attributes of the viewer and the target attributes in Table 4. In the case of a retargeting advertisement, an image associated with an image cookie in the operation history DB 192 is distributed.

Table 5 schematically shows information stored in the cookie correspondence DB 193. In the cookie correspondence DB 193, a DSP cookie and an image cookie are associated. The DSP cookie is notified from the DSP 20, and the image cookie is notified from the terminal device 30. By associating both, the image distribution apparatus 10 can discriminate the viewer by using only the DSP cookie.

Table 6 schematically shows information registered in the click number DB 195. In the click number DB 195, the number of clicks is registered for each combination of the attention point P and the angle of view of the omnidirectional image 6. In Table 6, four attention points P are associated with one omnidirectional image, but the number of attention points P is not limited to four for one omnidirectional image 6, and may be three or less or five or more. Good. Further, the omnidirectional image 6 may vary. In Table 6, the angle of view is set in three stages for each point of interest P. A combination of the attention point ID and the view angle ID is referred to as a still image ID. The number of clicks is the number of clicks by the viewer for each angle of view of each attention point. That is, the image distribution device 10 displays the same attention point P of the same omnidirectional image 6 on the plurality of terminal devices 30 with the same angle of view, and records the number of times the terminal device 30 has been clicked. By doing so, it is possible to gradually avoid the distribution of still images by combining the attention point with the low click rate and the angle of view. Note that the number of clicks is preferably recorded for each attribute (gender, age, family structure, etc.) of the viewer. As a result, a still image having a large number of clicks with respect to the attribute of the viewer can be distributed.

Table 7 schematically shows information registered in the distribution history DB 191. In the distribution history DB 191, the image ID and still image ID of the omnidirectional image 6 distributed in association with the image cookie are registered. When an image cookie is registered in the terminal device 30 when the image distribution device 10 transmits advertisement data, the image distribution device 10 can acquire the image cookie from the terminal device 30. The image distribution device 10 can avoid distributing the same omnidirectional image 6 to the same viewer or distributing the same still image of the same omnidirectional image 6. Conversely, retargeting delivery is also possible.

Table 8 schematically shows information registered in the image determination DB 196. Table 8 (a) shows DSP script correspondence information indicating whether or not the DSP 20 supports scripts. In the DSP script correspondence information, a script correspondence state is set for the DSP type. Table 8 (b) shows browser script correspondence information indicating whether each version of the browser supports a script. In the browser script correspondence information, a script correspondence state is set for the browser type for each version.

(About history management server functions)
The image information response unit 11 assigns an advertising opportunity ID to the DSP cookie, the advertiser ID, and the request content acquired from the DSP 20, and returns them to the DSP 20 together with the access information 2. An advertisement distribution opportunity can be specified for each advertisement space 7 of the terminal device 30 by the advertisement opportunity ID.

  When the advertisement data is requested from the terminal device 30 together with the advertisement opportunity ID, the advertisement distribution unit 12 determines whether to distribute the omnidirectional image 6 or the still image to be distributed, and the omnidirectional image 6 or the still image is determined to be distributed. To deliver. First, it is determined whether or not the script ON is included in the advertisement request. If included, it is determined whether or not the DSP 20 that requested the advertisement corresponds to the script with reference to the DSP script corresponding information in the image determination DB 196. If it corresponds, the browser script correspondence information in the image determination DB 196 is referred to and it is determined whether or not the browser type included in the advertisement request corresponds to the script. In this case, since the omnidirectional image 6 can be distributed, the advertisement distribution unit 12 determines the omnidirectional image 6 associated with the advertiser ID acquired from the DSP 20 from the advertisement image DB 194. Preferably the attributes of the viewer are taken into account. The viewer's attribute may be notified from the DSP 20 or may be accumulated by the image distribution apparatus 10 in association with the image cookie.

  When it is determined that the omnidirectional image 6 cannot be distributed, the advertisement distribution unit 12 similarly determines the omnidirectional image 6 to be distributed, but further determines the still image to be distributed. The advertisement distribution unit 12 refers to the click number DB 195 and determines one still image from the plurality of still images of the omnidirectional image 6. For example, the still image with the largest number of clicks is determined, or is arbitrarily determined from still images with the number of clicks equal to or greater than a threshold. It is preferable that the viewer's attributes are taken into consideration when determining a still image.

  The operation history acquisition unit 14 acquires an operation history together with an image cookie and an image ID (may further include a still image ID) from the terminal device 30, and sets the operation history in the operation history DB 192. There are two types of operation history: an operation history for determining a point of interest and an operation history for updating the number of clicks (clicked). You may use for the update of the frequency | count of an operation history (view angle at the time of a click) for determining an attention point. In this case, the click count is updated by associating the click angle of view with the closest view angle ID.

  Note that the image distribution device 10 may have the operation history recording unit 41 of the terminal device 30. Since the operation history recording unit 41 requires time-series operation content, it may be difficult for the image distribution apparatus 10 to acquire depending on a communication band or the like. On the other hand, since the operation history recording unit 41 of the terminal device 30 only needs to transmit only the final operation history to the image distribution device 10, the communication load can be reduced.

  The attention point determination unit 13 determines the attention point P of the omnidirectional image 6. Various methods for determining the attention point P can be considered, and details will be described later.

  The still image generation unit 15 generates a still image having large, medium, and small angles of view from the attention point P determined by the attention point determination unit 13. At this time, the advertisement frame size is taken into consideration. Details will be described later. The still image generation unit 15 registers the still image ID of the generated still image in the click number DB 195.

<Determination of attention point P>
<< Method of determining the point of interest P from the feature quantity >>
FIG. 10 is an example of a flowchart illustrating a procedure in which the attention point determination unit 13 determines the attention point P. In step S1001, the point-of-interest determination unit 13 defines a regular polyhedron having a center in common with the unit sphere, and performs perspective projection conversion with the normal direction of each surface as the line-of-sight direction to obtain a partial image. FIG. 11A shows an example in which a regular octahedron is defined as the projection plane of the omnidirectional image, and FIG. 11B shows an example in which a regular dodecahedron is defined as the projection plane of the omnidirectional image.

  In step S1002, the attention point determination unit 13 extracts a predetermined feature amount from each partial image obtained in step S1001. Since the input image is divided by the above-described method and the feature amount is calculated from the partial image with less distortion, it is possible to robustly process an ultra-wide-angle image exceeding 180 degrees. As the feature quantity, color, edge, saliency, object position / label, and the like can be used.

  In subsequent step S1003, the point-of-interest determination unit 13 calculates the importance for each position (pixel) of the input image from the feature amount extracted from each partial image using a predetermined regression model. Although details are omitted, the importance and the feature amount for each position are expressed by a function by regression. It should be noted that importance g as output (teacher data) is determined in advance using training data by an appropriate method, and the relationship between the feature quantity and importance g is obtained.

  In subsequent step S1004, the likelihood of the attention point P based on the importance distribution calculated in step S1003 under the design concept that the attention point determination unit 13 has the user attention point P in the direction of higher importance. Calculate the distribution. For example, after defining a region R that passes the viewpoint on the unit image plane, an added value obtained by adding the importance of each position in the region R can be calculated as the attention point likelihood of the viewpoint.

  In subsequent step S1005, the attention point determination unit 13 calculates the attention point P based on the attention point likelihood distribution. In the present embodiment, for example, a position corresponding to the imaging direction corresponding to the maximum likelihood value of the attention point likelihood is calculated as the attention point P.

  In this way, several attention points P can be calculated. The attention point determination unit 13 identifies a predetermined number of attention points P or attention points P that are equal to or greater than a threshold value among the N upper attention points P. Then, a still image combining the attention point P and the angle of view is registered in the click number DB 195.

<< Determining the person as the point of interest P >>
A person can be considered as a subject to be noticed by a person. Face recognition is known as a person detection method. For face recognition, a known method of pattern matching by detecting FOG feature values or Haar-like feature values can be used. The attention point determination unit 13 detects the center of the face as the attention point P. When the number of faces is large, the number of faces may be reduced to a fixed number by considering the faces that are close to each other as one.

<< Determine smile as attention point P >>
A person's smile can be considered as a subject that people pay attention to. As a method for detecting a smile, in addition to the above face recognition, a known method for pattern matching using a smile pattern held in advance can be used. When the number of faces is large, only the smile may be set as the attention point P. In addition to a smile, faces such as sadness, anger, and confusion may be determined as the attention point P.

<< A child is determined as a point of interest P >>
When a child exists in an adult, a person may pay attention to the child. Or, conversely, when there are adults among many children, a person may pay attention to the adults. The position of the face can be used as a method for detecting children or adults. If the face position specified by the above face recognition is lower than other face positions, it is estimated that the child is a child, and if the face position specified by face recognition is higher than the other face positions, it is an adult. It is estimated to be. When clicked, the angle of view at the time of clicking may be set as the attention point P.

<< Determine an arbitrary subject as the point of interest P >>
It is considered that the advertiser knows the attention point P that the advertiser wants the viewer to browse. Therefore, the attention point determination unit 13 can detect the subject designated by the advertiser and set it as the attention point P. For example, an advertiser's product or service, such as an automobile, furniture, or food, is detected by pattern recognition and set as the attention point P.

<< Use operation history >>
As described above, the image distribution apparatus 10 records the operation history of each omnidirectional image 6 in the operation history DB 192. The viewing angle of view of this operation history can be set as the attention point P. Since operation histories are transmitted from a plurality of viewers to the same omnidirectional image 6, the viewing angle of view with close coordinates is regarded as the same viewing angle of view, and each viewing angle of view is pointed. A longer point is given as the stationary time is longer, and a larger point is given to the clicked viewing angle. For each omnidirectional image, the higher viewing point of view with a large total point is determined as the attention point P.

<Generation of still images>
FIG. 12 is a diagram illustrating an example of the types of advertisement space. 12A shows a vertically long advertisement frame, FIG. 12B shows a horizontally long advertisement frame, and FIG. 12C shows a square or close advertisement frame. The still image generating unit 15 generates a still image by cutting out the attention point P with a large, medium, and small angle of view for each type of advertisement frame. In the example of FIG. 12, there are a total of 15 types (sizes) of advertising spaces. In this embodiment, as an example, a large, medium, and small angle of view is set for one point of interest.

  The advertisement frame size that the advertisement frame 7 can take is determined, and the still image generation unit 15 generates a still image for each advertisement frame size that the advertisement frame 7 can take. For example, the still image generation unit 15 generates 15 × 3 = 45 still images for each point of interest.

  In addition, it is considered to use the advertising space effectively for the vertical and horizontal advertising space. It is considered that the attention point of the omnidirectional image is often present in a range in which the vertical and horizontal widths are approximately the same as in the case where the vertical and horizontal widths are spread. Therefore, the still image generation unit 15 divides the vertically long and horizontally long advertisement frames into two or more, and generates a plurality of still images for the divided advertisement frames.

  FIG. 13 schematically shows a still image generated for a horizontally long advertising space. FIG. 13A shows the omnidirectional image 6, and FIG. 13B shows two still images displayed in the advertisement frame 7. Two attention points P-1 and P-3 in FIG. 13A are arranged in the advertising space 7 in FIG. Thus, since two or more still images can be displayed in one advertising space 7, it becomes easy to improve the advertising effect.

  Even if the advertising space 7 is divided, the number of generated still images does not increase. This is because the still image generation unit 15 generates a still image by combining the attention point P and the angle of view, and the number of types of the advertising space 7 does not increase even if it is divided as long as it is equally divided.

  FIG. 14 is an example of a flowchart illustrating a procedure in which the still image generation unit 15 generates a still image. The process in FIG. 14 is executed for each omnidirectional image.

  First, the still image generation unit 15 determines one omnidirectional image (S1401).

  Next, the still image generation unit 15 determines one attention point determined by the attention point determination unit 13 (S1402).

  Next, the still image generation unit 15 determines one of the large, medium, and small field angles (S1403).

  Next, the still image generation unit 15 determines the advertising space 7 (S1404).

  The still image generation unit 15 determines whether the advertising space 7 is vertically long or horizontally long (S1405). As an example of a judgment criterion, when the aspect ratio (vertical / horizontal ratio) is 1: 2 or more (vertical / horizontal = 2 or more), it is determined that the aspect ratio is horizontal, and when the aspect ratio is 2: 1 or less (vertical / horizontal = 0). .5 or less) Judged as vertically long.

  When the determination in step S1405 is Yes, the still image generation unit 15 divides the advertising space so that the aspect ratio is less than 2 or more than 0.5 (S1406). First, it is equally divided into two to determine whether the aspect ratio is less than 2 or more than 0.5. When it is not less than 2 or more than 0.5, the number of divisions is increased so as to be divided into three equal parts and four equal parts.

  The still image generation unit 15 generates a still image according to the size of the advertising space 7 (S1407). When the image is divided equally, a still image is generated in accordance with the size of the divided advertising space 7. Specifically, since the omnidirectional image has three-dimensional coordinates, it is converted into a flat image by perspective projection conversion.

  Next, the still image generation unit 15 determines whether or not a still image has been created for all the advertising spaces 7 (S1408). If the determination in step S1408 is No, the process returns to step S1404, and a still image is generated in the next advertising space 7.

  If the determination in step S1408 is Yes, the still image generation unit 15 determines whether a still image has been created at all angles (S1409). If the determination in step S1409 is No, the process returns to step S1403 to generate a still image at the next angle of view.

  If the determination in step S1409 is Yes, the still image generation unit 15 determines whether or not a still image has been created with all the points of interest (S1410). If the determination in step S1410 is No, the process returns to step S1402 to generate a still image at the next point of interest. If the determination in step S1410 is Yes, the process in FIG. 14 ends.

  As described above, the still image generation unit 15 generates a still image in advance for each size of the advertisement frame 7 and for each combination of the attention point P and the angle of view. The advertisement distribution unit 12 can distribute a still image generated in advance by referring to the advertisement frame size included in the advertisement request.

<Information used by Web page>
FIG. 15 is an example of a diagram schematically illustrating information used by a Web page. FIG. 1A shows a web page provided by the partner site web server 60. The web page provided by the partner site web server 60 has one or more advertising spaces 7. The terminal device 30 holds an SSP cookie and a DSP cookie in advance. The advertisement frame 7 is associated with the URL of the SSP 50 and the advertisement frame ID. The browser (advertisement space detection unit 36) of the terminal device 30 transmits the SSP cookie and the request content to the SSP 50. Further, the access information 1 including the URL of the DSP 20 that has made a successful bid for the advertising space 7 and the successful bid ID are transmitted from the SSP 50 to the terminal device 30.

  FIG. 15B is a diagram for explaining the operation of the access information 1. The access information 1 transmits a successful bid ID and a DSP cookie to the DSP 20 based on the URL of the DSP 20. The DSP 20 specifies the advertisement request with the successful bid ID, and acquires the access information 2 including the URL of the image distribution device 10 and the advertisement opportunity ID from the image distribution device 10. The terminal device 30 acquires the access information 2 and the advertisement opportunity ID from the DSP 20.

  FIG. 15C illustrates the operation of the access information 2. The access information 2 transmits an advertisement opportunity ID to the image distribution device 10 based on the URL of the image distribution device 10. The image distribution apparatus 10 generates advertisement data based on an advertisement request specified by the advertisement opportunity ID, and transmits the advertisement data to the terminal device 30 together with the image cookie and the advertisement frame ID. In this way, a still image is displayed in the advertising space 7 of the Web page.

<Operation procedure>
FIG. 16 is an example of a sequence diagram illustrating a procedure in which the browsing system 100 distributes the omnidirectional image 6 serving as an advertisement.

  S1601: First, the viewer operates the terminal device 30 so as to connect to the partner site Web server 60. The operation reception unit 34 of the terminal device 30 receives the operation, and the web page acquisition unit 31 acquires the web page.

  S1602: The web page analysis unit 32 of the terminal device 30 analyzes the web page and extracts HTML, CSS, and script, and the web page display unit 33 displays the web page based on the HTML and CSS.

  S1603: The advertisement space detection unit 36 of the terminal device 30 transmits an advertisement request to the SSP 50 by executing the advertisement tag (script) associated with the advertisement space 7. The advertisement request includes, for example, the SSP cookie, the domain of the partner site Web server 60, the advertisement space ID, the advertisement space size, the advertisement format, the browser type, the OS type, and the like.

  S1604: The advertisement request acquisition unit 52 of the SSP 50 acquires an advertisement request, and the advertisement request unit 51 receives the advertisement request. The advertisement request unit 51 detects the SSP cookie, notifies the DSP 20 of the advertisement request, and sells the advertisement space 7.

  S1605: The request reception unit 21 of the DSP 20 sends an advertisement request to the bid determination unit 22. The bid determination unit 22 of the DSP 20 refers to the cookie information DB 291 to identify the DSP cookie from the SSP cookie.

  S1606: The bid determination unit 22 determines the attribute from the DSP cookie. The visit domain of the cookie information DB 291 may be referred to, or the attribute information of the viewer specified by the DSP cookie may be referred to as appropriate.

  S1607: The bid determination unit 22 refers to the distribution setting DB 292 and identifies an advertiser whose distribution target is an attribute that matches the attribute of the viewer.

  S1608: The bid determination unit 22 determines the bid amount according to the advertiser's budget, the degree of matching of attributes, and the like.

  S1609: The bidding unit 23 of the DSP 20 bids on the SSP 50. The successful bid section 54 of the SSP 50 determines the DSP 20 that applied for the highest bid amount as a successful bidder in principle for bids from a plurality of DSPs 20.

  S1610: Here, it is assumed that the illustrated DSP 20 makes a successful bid. The SSP 50 notifies the DSP 20 of the successful bid ID.

  S1611: The access information transmission unit 53 of the SSP 50 transmits the access information 1 together with the successful bid ID to the terminal device 30.

  S1612: The advertisement request unit 38 of the terminal device 30 executes the access information 1 to transmit an advertisement request together with the successful bid ID to the DSP 20.

  S1613: The advertisement request receiving unit 24 of the DSP 20 specifies the advertisement request by the successful bid ID. The image request unit 25 requests an image from the image distribution apparatus 10 together with the advertiser ID, the DSP cookie, and the advertisement request.

  S1614: When receiving the image request, the image information response unit 11 of the image distribution apparatus 10 generates an advertisement opportunity ID for specifying the advertisement request.

  S1615: The image information response unit 11 transmits the access information 2 associated with the advertisement opportunity ID to the DSP 20.

  S1616: The image request unit 25 of the DSP 20 receives the access information 2, and the advertisement request receiving unit 24 transmits it to the terminal device 30.

  S1617: The advertisement acquisition unit 39 of the terminal device 30 transmits an advertisement request (advertisement opportunity ID) based on the URL of the image distribution device 10 included in the access information 2. When the terminal device 30 holds an image cookie, the image cookie can be transmitted. An advertisement request (such as script ON / OFF) may be transmitted at this timing.

  S1618: The advertisement distribution unit 12 of the image distribution apparatus 10 identifies the image request by the advertisement opportunity ID.

  S1619: The advertisement distribution unit 12 determines an attribute from the DSP cookie or determines an attribute from the image cookie.

  S1620: The advertisement distribution unit 12 specifies the omnidirectional image 6 or the still image to be distributed based on the advertiser ID and the attribute. Details will be described with reference to FIG.

  S1621: When transmitting a still image, the advertisement distribution unit 12 transmits advertisement data including a still image, an image ID, a still image ID, an image cookie, and an advertisement frame ID to the terminal device 30. When the omnidirectional image 6 is transmitted, advertisement data (including a script) including the omnidirectional image 6, the image ID, the image cookie, and the advertising space ID is transmitted to the terminal device 30. The URL of the advertiser Web server 70 is associated with the still image or the omnidirectional image 6.

  S1622: The advertisement acquisition unit 39 of the terminal device 30 acquires the advertisement data, and the advertisement display unit 40 displays the omnidirectional image 6 or the still image in the advertisement frame 7. When the viewer clicks on the advertising space 7, the operation reception unit 34 receives the Web page acquisition unit 31 and starts communication with the advertiser Web server 70.

<Selection of spherical image or still image>
FIG. 17 is an example of a flowchart illustrating a procedure in which the advertisement distribution unit 12 selects an omnidirectional image or a still image.

  The advertisement distribution unit 12 determines whether or not the script ON is included in the advertisement request (S1701).

  If the determination in step S1701 is Yes, the advertisement distribution unit 12 determines whether the DSP 20 supports a script with reference to the DSP script corresponding information in the image determination DB 196 (S1702).

  When the determination in step S1702 is Yes, the advertisement distribution unit 12 refers to the browser script correspondence information in the image determination DB 196 and determines whether the browser type included in the advertisement request corresponds to the script (S1703).

  If the determination in step S1703 is Yes, the advertisement distribution unit 12 determines that the omnidirectional image 6 can be distributed (S1710). The advertisement distribution unit 12 determines the omnidirectional image 6 associated with the advertiser ID acquired from the DSP 20 from the advertisement image DB 194.

  If it is determined No in any of steps S1701 to S1703, the advertisement distribution unit 12 determines to distribute a still image (S1704).

  First, the advertisement distribution unit 12 acquires the advertisement frame size from the advertisement request (S1705). Then, it is determined whether the advertising space is vertically long or horizontally long (S1706). This is because a plurality of still images are determined when the advertisement frame 7 is vertically long or horizontally long.

  When the advertising space 7 is not vertically long or horizontally long (No in S1706), only one still image needs to be determined. The advertisement distribution unit 12 determines the omnidirectional image 6 associated with the advertiser ID acquired from the DSP 20 from the advertisement image DB 194. Then, the still image (combination of the attention point ID and the view angle ID) having the largest number of clicks is specified from the click number DB 195 for the omnidirectional image 6 (S1707). Or you may specify at random from the still image (combination of attention point ID and angle-of-view ID) of the click frequency more than a threshold value.

  Next, the advertisement distribution unit 12 specifies a still image generated for the advertisement frame size included in the advertisement request among the still images having the attention point ID and the view angle ID determined in step S1707 (S1708).

When the advertising space is vertically long or horizontally long (Yes in S1706), two or more still images are determined. The two still images are
-It may be generated from the same omnidirectional image 6-It may be generated from another omnidirectional image 6. Hereinafter, a case where the advertising space 7 is divided into two will be described, but the same applies to a case where the advertising space 7 is divided into three or more. The advertisement distribution unit 12 determines the number of divisions in the same manner as the still image generation unit 15 divides the advertising space. That is, the number of divisions is uniquely determined with respect to the advertisement frame size included in the advertisement request.

  When generated from the same omnidirectional image 6, the advertisement distribution unit 12 determines the omnidirectional image 6 associated with the advertiser ID acquired from the DSP 20 from the advertisement image DB 194. Then, the combination of the attention point ID and the field angle ID with the top two clicks for the omnidirectional image 6 is specified from the click number DB 195 (S1709-1). Or you may specify two at random from the combination of attention point ID and angle of view ID of the frequency | count of click more than a threshold value.

  The advertisement distribution unit 12 specifies the still image generated for the divided advertisement frame size among the still images with the attention point ID and the view angle ID determined in step S1709-1 (S1709-2).

  When generated from another omnidirectional image 6, the advertisement distribution unit determines two omnidirectional images 6 associated with the advertiser ID acquired from the DSP 20 from the advertisement image DB 194. For example, the celestial sphere image with the highest and next evaluation based on the matching degree and priority of the attributes of the viewer and the target attributes in Table 4 is determined. Then, the still image of the combination of the attention point ID and the angle of view ID having the largest number of clicks in each omnidirectional image is specified from the click number DB 195 (S1709-3). Or you may specify at random from the combination of attention point ID and angle of view ID of the frequency | count of click more than a threshold value.

  The advertisement distribution unit 12 specifies a still image generated for the divided advertisement frame size among the still images with the attention point ID and the view angle ID determined in step S1709-3 (S1709-4).

  The advertisement distribution unit 12 synthesizes two still images by arranging them on the left and right or top and bottom to generate one still image. Which still image is arranged on the left, right, or top and bottom may be arbitrary.

  As described above, when only the still image can be distributed, the browsing system 100 according to the present embodiment can distribute a still image optimal for the advertisement frame size based on the number of clicks.

<Updating the number of clicks for each still image>
FIG. 18 is an example of a sequence diagram illustrating a procedure in which the image distribution apparatus 10 updates the number of clicks for a still image.

  S1801: It is considered that the viewer browses the still image displayed in the advertising space 7, and clicks (or taps) the advertising space 7 when interested. The operation reception unit 34 of the terminal device 30 receives a click. When a plurality of still images are arranged in the advertisement frame 7, it is detected which still image is clicked.

  S1802: The operation history recording unit 41 records an operation of clicking, and transmits to the image distribution apparatus 10 that the operation history transmission unit 42 has been clicked. The transmission of the click may be performed immediately after the click or when the communication addition is small. This notification includes an image ID, a still image ID, and an image cookie. The presence of image cookies makes it possible to record the number of clicks for each attribute. Since no script is attached to the still image, a link is pasted to the still image.

  S1803: The operation history acquisition unit 14 of the image distribution apparatus 10 acquires that the click has been made, and increases (updates) the number of clicks associated with the image ID and the still image ID in the click number DB 195 by one. Alternatively, the attribute is determined based on the image cookie, and the number of clicks is increased for each attribute.

  By such processing, the number of clicks is accumulated for each still image, and the number of clicks of a still image that is easy to click increases. In other words, a still image that is difficult to click becomes clear. Accordingly, it becomes possible to distribute a still image with a gradually increasing number of clicks (highly effective advertisement).

<Switching still images when distributing the same image to the same viewer>
A viewer whose image cookie is registered in the distribution history DB 191 has viewed a still image of the omnidirectional image 6. When the viewer browses a web page of the partner site web server 60 or a web page of another web server, the image delivery apparatus 10 may deliver the omnidirectional image 6. In this case, the image distribution device 10 can improve the click rate by changing the still image.

  FIG. 19 is an example of a flowchart illustrating a procedure in which the advertisement distribution unit 12 of the image distribution apparatus 10 suppresses distribution of the same still image.

  First, the advertisement distribution unit 12 acquires a request for advertisement data (image cookie) (S1901). In the past, in the case of the terminal device 30 that has received the distribution of the omnidirectional image 6, since the image cookie is stored, the image distribution device 10 can determine the viewer.

  The advertisement distribution unit 12 determines whether there is a distribution history of the omnidirectional image 6 to be distributed (S1902). That is, the omnidirectional image 6 is determined according to the attribute or the like, and it is determined whether or not the image ID of the omnidirectional image 6 is recorded in the distribution history DB 191.

  If the determination in step S1902 is No, the advertisement distribution unit 12 distributes a still image with a high number of clicks as described above (S1903).

  If the determination in step S1902 is Yes, the advertisement distribution unit 12 distributes a still image different from the still image recorded in the distribution history DB 191 (S1904). For example, out of the determined combination of the attention point P and the angle of view of the omnidirectional image 6, the attention point P and the angle of view that have already been distributed are excluded, and the still image of the attention point P and the angle of view having the largest number of clicks is removed. Decide to deliver.

  In the case of a retargeting advertisement, the same still image of the omnidirectional image 6 recorded in the distribution history DB 191 is distributed. By displaying the same still image to the same viewer after a while, the appeal of the advertisement can be improved.

<Summary>
When the browsing system 100 of this embodiment must distribute the still image 5 (a script (program) does not operate on the terminal device 30 in order to display a moving image, or an advertisement distribution network corresponds to a moving image. However, since the still image 5 is created so as to include an attention point that easily attracts the viewer's interest, an advertisement that easily attracts the viewer's interest can be displayed. It is difficult to list the whole celestial sphere image because 360 degrees is taken around it. However, in the browsing system 100 according to the present embodiment, the point of interest can be displayed as the still image 5, so that the advertiser shows it. It makes it easier for the viewer to browse the desired part. In addition, since still images are gradually selected according to the number of clicks, advertisements can be distributed as still images that are easily clicked over time. Therefore, the effect (click rate) of the advertisement can be improved.

<Other application examples>
The best mode for carrying out the present invention has been described above with reference to the embodiments. However, the present invention is not limited to these embodiments, and various modifications can be made without departing from the scope of the present invention. And substitutions can be added.

  For example, in the present embodiment, an example in which a still image is displayed in the advertisement frame 7 has been described, but the still image may not be displayed as an advertisement. For example, the still image displayed on the web page provided by the advertiser web server 70 may be generated so as to include the attention point P.

  Further, the application of the terminal device 30 that displays the omnidirectional image or still image is not limited to the browser 8, and any application software may display the omnidirectional image or still image.

  Moreover, although the example in which a still image is used for an advertisement has been described in the present embodiment, the still image does not have to be used for an advertisement.

  In addition, as described with reference to FIG. 16, in this embodiment, the terminal device 30 accesses the DSP 20 and then accesses the image distribution device 10 to acquire advertisement data. However, the DSP 20 may acquire advertisement data directly from the image distribution device 10 and transmit it to the terminal device 30. Since the terminal device 30 can acquire the advertisement data only by accessing the DSP 20, the time until the advertisement is displayed can be shortened.

  Further, the DSP 20 and the image distribution device 10 may be configured integrally, and the DSP 20 may distribute the advertisement data (omnidirectional image) to the terminal device 30.

  Further, the advertisement distribution unit 12 may evaluate the display pattern not by the number of clicks but by the click rate. Alternatively, evaluation may be performed using an index that can be evaluated, such as the number of times the “like button” is pressed.

  In addition, the advertisement distribution method in which the SSP 50, the DSP 20, and the image distribution apparatus 10 described in the present embodiment cooperate with each other is merely an example, and there is no intention to limit the process until the terminal apparatus 30 displays the advertisement. For example, as a simple process, the partner site Web server 60 may store advertisement data from an advertiser and distribute it to the terminal device 30. In this case, the SSP 50, the DSP 20, and the image distribution device 10 are not necessary.

  Further, in the present embodiment, it has been described that the omnidirectional image capable of capturing 360 degrees around the omnidirectional camera is arranged on the web page, but the image data of the web page may be a wide-angle image. The wide-angle image of the present embodiment refers to an image having a portion that cannot be displayed in the advertisement frame. For example, a panoramic image having an angle of view of about 180 degrees only in the horizontal direction may be used.

  In addition, the omnidirectional image is not limited to the case where the two images are created by a method in which the two images are pasted together. . That is, the method for creating the omnidirectional image is not limited.

  Further, in this embodiment, for convenience of explanation, it is described that a part of the omnidirectional image 6 is a still image, but a still image having an angle of view that covers the entire omnidirectional image may be generated.

  In addition, the configuration example such as FIG. 9 shown in the above embodiment is divided according to main functions in order to facilitate understanding of the processing of the browsing system 100. However, the present invention is not limited by the way of dividing or the name of each processing unit. The browsing system 100 can also be divided into more processing units according to the processing content. Moreover, it can also divide | segment so that one process unit may contain many processes.

  The still image generation unit 15 is an example of a still image generation unit, the advertisement distribution unit 12 is an example of a distribution unit, the advertisement acquisition unit 39 is an example of an image acquisition unit, and the advertisement display unit 40 is an image display unit. The attention point determination unit 13 is an example of a feature part determination unit, the operation history transmission unit 42 is an example of an operation history transmission unit, and the operation history acquisition unit 14 is an example of an operation history recording unit. The operation reception unit 34 is an example of an operation reception unit. The terminal device 30 is an example of a second information processing device.

7 Advertising space 10 Image distribution device 20 DSP
30 terminal device 40 advertisement display unit 50 SSP
60 Partner Site Web Server 70 Advertiser Web Server 100 Browsing System

JP 2008-192115 A

Claims (12)

A browsing system comprising: an image delivery device that delivers at least a part of a wide-angle image; and an information processing device that displays at least a part of the wide-angle image,
The image distribution device includes:
Still image generating means for generating one or more still images from the wide-angle image;
Distribution means for transmitting either the entire wide-angle image or the still image to the information processing apparatus,
The information processing apparatus includes:
Image acquisition means for acquiring the wide-angle image or the still image;
And a display system that displays the wide-angle image or the still image acquired by the image acquisition unit on a display device. The image distribution apparatus has a characteristic part determining means for determining a characteristic part from the wide-angle image,
The browsing system according to claim 1, wherein the still image generation unit generates the still image including the characteristic part determined by the characteristic unit determination unit. The information processing apparatus includes:
An operation history transmitting means for transmitting information related to a viewing angle of view or a predetermined operation of the wide-angle image displayed by the operation of the viewer to the image distribution device;
The image distribution device includes:
Operation history recording means for recording the viewing angle of view of the wide-angle image or the predetermined operation in association with the identification information of the wide-angle image,
The browsing system according to claim 2, wherein the feature determination unit determines a characteristic part from the wide-angle image based on at least one of a viewing angle of view of the wide-angle image or the predetermined operation. The still image generating means generates a plurality of the still images from one wide-angle image for each combination of the characteristic portion determined by the feature determining means and a plurality of angle of view,
The browsing system according to claim 3, wherein the distribution unit transmits the still image determined by a predetermined method from the plurality of the still images to the information processing apparatus. The information processing apparatus includes:
Operation receiving means for receiving a predetermined operation on the still image displayed by the image display means;
The operation history transmitting means transmits the identification information of the wide-angle image, the identification information of the combination of the characteristic part and the angle of view, and the fact that the predetermined operation has been received to the image distribution device,
The operation history recording unit of the image distribution device records the number of times that the predetermined operation has been performed in association with the identification information of the wide-angle image and the identification information of the combination of the characteristic part and the angle of view. And
The browsing system according to claim 4, wherein the distribution unit transmits the still image whose number of times is equal to or greater than a threshold value to the information processing apparatus. The still image generating means is configured to select a part of the wide-angle image or a frame size that can be taken by a frame in which the still image is displayed in the information processing apparatus, according to a combination of the characteristic part and the angle of view. Generating a still image from the wide-angle image;
The distribution unit transmits the still image suitable for a part of the wide-angle image acquired from the information processing device or a frame size of a frame in which the still image is displayed to the information processing device. The browsing system described. When a frame size that can be taken by a part of the wide-angle image or a frame in which the still image is displayed is horizontally long or vertically long,
The still image generating unit divides the frame size, and generates the still image corresponding to the combination of the characteristic part and the angle of view from the wide-angle image for the divided frame size,
When the frame size of a frame in which a part of the wide-angle image acquired from the information processing apparatus or the still image is displayed is horizontally long or vertically long, the distribution unit adds 1 still image of the number of divisions determined by the frame size. The browsing system according to claim 5 or 6, wherein the browsing system synthesizes the still image and transmits it to the information processing apparatus. The information processing device transmits device identification information for identifying the information processing device to the image distribution device,
The image distribution device holds identification information of a combination of the characteristic portion and the angle of view distributed to the information processing device in association with the device identification information.
The distribution means, when the information processing device holding the device identification information requests the wide-angle image or the still image, the combination of the characteristic part associated with the device identification information and the angle of view. The browsing system according to any one of claims 4 to 7, wherein the still image having a combination of the characteristic part different from the angle of view and the angle of view is transmitted to the information processing apparatus. The distribution means determines whether the information processing apparatus can display the wide-angle image;
The browsing system according to claim 1, wherein when it is determined that the wide-angle image cannot be displayed, the still image is transmitted, and when it is determined that the wide-angle image can be displayed, the wide-angle image is transmitted. . Image acquisition means for acquiring a wide-angle image or a still image generated from the wide-angle image;
An information display device connected via a network to a second information processing device having an image display means for displaying the wide-angle image or the still image acquired by the image acquisition means on a display device,
Still image generating means for generating one or more still images from the wide-angle image;
An information processing apparatus comprising: distribution means for transmitting either the entire wide-angle image or the still image to the information processing apparatus. An image distribution method performed by a browsing system having an image distribution device that distributes at least a part of a wide-angle image and an information processing device that displays at least a part of the wide-angle image,
The image distribution device includes:
A still image generating means for generating one or more still images from the wide-angle image;
A distribution means for transmitting either the entire wide-angle image or the still image to the information processing apparatus;
The information processing apparatus includes:
An image acquisition means for acquiring the wide-angle image or the still image;
And a step of displaying the wide-angle image or the still image acquired by the image acquisition unit on a display device. Image acquisition means for acquiring a wide-angle image or a still image generated from the wide-angle image;
An information display device connected via a network to a second information processing device having an image display means for displaying the wide-angle image or the still image acquired by the image acquisition device on a display device;
Still image generating means for generating one or more still images from the wide-angle image;
A program for functioning as a distribution unit that transmits either the entire wide-angle image or the still image to the information processing apparatus.