JP2011078008A - Content sharing apparatus, content editing apparatus, content sharing program, and content editing program - Google Patents

Abstract

An object of the present invention is to identify a subject with certainty and easily manage composition and camera work.
A content sharing device 20 associates content captured by a photographing device with metadata and stores it as content data, and a metadata extraction unit 203 that reads content data and extracts metadata. And determining the subject position of the subject in the content based on the shooting position information, shooting direction information, and shooting distance information included in the metadata, as well as the imaging surface size, shooting distance information, focal length, and zoom included in the metadata. A metadata analysis unit 205 that obtains a shooting range size by shooting a subject based on the magnification and obtains the subject size, and a content related information storage unit 204 that stores shooting position information, a subject position, and a shooting range size in association with the content. And equipped with.
[Selection] Figure 5

Description

  The present invention relates to a content sharing device, a content editing device, a content sharing program, and a content editing program.

  In recent years, with the spread of digital still cameras and digital video cameras (referred to as digital cameras) and the cost reduction of recording media for recording image data, users of digital cameras are not only traveling for vacations and the like. Opportunities to take many photographs and videos in daily life and use the content data in various scenes have increased. In particular, with the widespread use of mobile phones with camera functions equipped with digital cameras, photography and video capture and utilization have become more common in daily life. In the field of camera-equipped mobile phones, mobile terminals equipped with GPS (Global Positioning System), acceleration sensors, and magnetic sensors have been commercialized. Since this portable terminal can acquire information related to the shooting location and shooting direction of photos and videos, the range of utilization of content data can be expanded.

  With regard to utilization of content data, in recent years, a website called CGM (Consumer Generated Media) that uses personal information transmission as media has been actively used. There are also photo sharing sites and video sharing sites on the Internet. These photo sharing sites and video sharing sites allow other users to view photos (still image data) and videos (video data) uploaded from general users who are the owners of photos and videos, and obtain permission to use them. It is a site that can be downloaded on the condition. A CGM user may acquire and use content data from a site available by downloading the content data.

  The content produced by amateur creators published on these photo sharing sites and video sharing sites and the content published on CGM are often high quality. This indicates not only the spread of digital cameras, editing devices, editing software, etc. due to higher functionality and lower prices, but also the widespread style of editing and enjoying photographed photos and videos.

  A TV program producer called a professional as a content creator for CGM amateur creators conducts pre-shooting surveys and interviews to determine the composition and scenario of the program, and based on that scenario, cuts and composition In many cases, many materials are photographed under various conditions in consideration of editing, such as camera work and subject movement. In addition, a TV program producer may perform additional shooting when a new material is required at the editing stage. A television program is generally produced by repeating such operations.

  In order to complete a single content by editing photos and videos, not just professional or amateur creators, it is necessary to select materials suitable for the production intention from multiple materials and arrange them in the desired order. is there. Currently, EXIF (EXchangeable Image File format) is known as a metadata format of still image data, and information related to shooting such as shooting date / time, resolution, shooting location, etc. is formatted and managed by adding it to still image data of a photo. Is. As for video data, MXF (Material eXchange Format) is known as a professional use container format such as a broadcasting station. Like EXIF, video data can be managed together with metadata related to shooting.

By using these metadata, content data can be easily searched. For example, a content management technique for searching for desired content data from a large number of content data using a time attribute in metadata is known (see, for example, Patent Document 1).
Among the photo sharing sites, there is a photo data sharing site that displays photos posted using GPS location information described in EXIF data on a map and performs simple navigation.

  In content production, it is difficult for an amateur creator to produce content by using the same production method as a professional producer from the viewpoint of cost and labor. For example, in the production of a content work that uses photos and videos taken at a travel destination as materials, if you need a material shot with a composition that is different from the shot, go back to the travel destination and take a picture. It is unrealistic to redo. In such a case, if the technique disclosed in Patent Document 1 is used or a photo sharing site that can be used secondarily is used, photo data uploaded by another person can be downloaded and used for editing.

JP 2006-107260 A

  However, with the technology disclosed in Patent Document 1 and content sharing technology such as a photo sharing site, it is possible to specify the shooting date / time and location of a photo using EXIF data added to the content. It is difficult to specify what the subject is, and it is difficult to reliably obtain a photograph of the desired subject.

  Further, since the photograph captures the instantaneous situation at the time of shooting, the content content and the EXIF data content match. However, since the video has a time width and there may be movement of at least one of the subject and the photographing device, the management method using EXIF data cannot sufficiently show the content. Also, information regarding composition and camera work cannot be acquired from the EXIF data.

  In addition, when creating content with workability by connecting multiple materials, not only pay attention to the subject of each material, but also the relationship between materials regarding elements such as composition, camera work, season, time zone, etc. Is important for improving the quality of the entire content and expressing its work. However, conventionally, when creating content by connecting materials, it has not been possible to acquire content data in consideration of the relationship between materials for various elements.

  Therefore, the present invention has been made in view of the above problems, and for content data to be shared, the subject of each content can be reliably identified, and information relating to composition and camera work can be easily managed. Content sharing device, content editing device, content that can be requested and presented for content data considering the relationship between materials for various elements when creating content data by combining materials An object is to provide a shared program and a content editing program.

In order to solve the above problems, one aspect of the present invention provides the following means [1]-[6].
[1] The content sharing apparatus stores the content photographed by the photographing apparatus, the photographing position information, the photographing direction information, the photographing distance information, the focal distance, and the zoom magnification that are obtained by the photographing apparatus in association with each other. The content storage unit, the metadata extraction unit that extracts the shooting position information, the shooting direction information, the shooting distance information, the focal length, and the zoom magnification from the content storage unit, and the metadata extraction unit extracted Based on the photographing position information, the photographing direction information, and the photographing distance information, the subject position of the subject shown in the content is obtained, and the photographing surface size of the photographing device and the photographing distance extracted from the metadata extraction unit. Based on the information, the focal length, and the zoom magnification, a shooting range size for shooting the subject is obtained, and the obtained A metadata analysis unit for obtaining a subject size based on a photographing range size, the photographing position information extracted by the metadata extraction unit, and the subject position and the subject size obtained by the metadata analysis unit, respectively. And a content-related information storage unit that stores the content-related information as a content-related information.
Here, the shooting position information is, for example, information on latitude, longitude, and altitude, which is the position of the shooting apparatus. The shooting direction information is information on the azimuth angle of the optical axis of the optical system of the shooting apparatus and the tilt angle with respect to the horizontal plane.
The metadata analysis unit includes, for example, information on the extracted shooting distance information (subject distance L), shooting position information (latitude, longitude, and altitude h1 of the shooting apparatus) and shooting direction information (tilt angle θ1, azimuth angle θ2). Based on this, the subject position (latitude, longitude, and altitude h2) is obtained as follows. The inclination angle θ1 is an inclination angle of the optical axis with respect to the horizontal plane in a plane orthogonal to the horizontal plane and including the optical axis of the optical system of the photographing apparatus. With respect to the value of the inclination angle θ1, the upward inclination angle with respect to the horizontal plane is positive, and the downward inclination angle is negative. Further, the azimuth angle θ2 is a counterclockwise angle with respect to the positive direction of the X axis in the planar rectangular coordinate system described later.
That is, the metadata analysis unit obtains the altitude h2 of the subject position based on the subject distance L, the inclination angle θ1, and the altitude h1 of the imaging device. Further, the metadata analysis unit converts the latitude / longitude of the imaging device into coordinate values (x1, y1) in the plane rectangular coordinate system, and the coordinate values (x1, y1) and the imaging device on the plane rectangular coordinate plane Based on the distance (L · cos θ1) to the subject and the azimuth angle θ2, the coordinate value (x2, y2) of the subject is obtained, and the latitude and longitude of the subject are further obtained.
In addition, the metadata analysis unit captures an area of the imaging range in a focused plane (where the subject is located) based on the imaging surface size, focal length, and subject distance of the imaging device mounted on the imaging device. By calculating the range size, the subject size in the captured image is obtained. As an example, the metadata analysis unit obtains the type of subject size by classifying the shooting range size in various content data obtained by shooting the same subject. That is, the subject size represents a composition related to the shooting distance.

[2] In the content sharing apparatus according to [1], when the content is moving image data, the metadata analysis unit is configured to extract the shooting position information, the shooting direction information, and the shooting direction information extracted by the metadata extraction unit. Based on the shooting distance information, the focal length, and the zoom magnification, a shooting operation and a shooting operation direction of the shooting device with respect to a subject shown in the content are further obtained, and the content-related information storage unit includes the metadata analysis unit. The obtained shooting operation and shooting operation direction are included in the content-related information and stored.
Here, the photographing operation of the photographing apparatus is, for example, fixing, zooming in / out, tilting, and panning. The shooting operation direction is from bottom to top in the case of tilt or vice versa, and from left to right in the case of pan or vice versa.
The moving image data included in the content data includes one or more scenes, and metadata is associated with each of the start frame image and the end frame image of each scene. The metadata analysis unit calculates the difference between the zoom rate, the latitude, longitude, altitude, azimuth angle, and tilt angle of the imaging device between the metadata corresponding to the start frame image and the metadata corresponding to the end frame image. The shooting operation and the shooting operation direction are obtained.

[3] The content sharing apparatus according to [2] described above includes shooting position information, shooting direction information, shooting distance information, focal length, and zoom magnification corresponding to the first content that is still image data or moving image data. Based on the request information receiving unit that receives the presentation request information including the shooting position information, the shooting direction information, the shooting distance information, the focal distance, and the zoom magnification extracted from the received presentation request information, Based on the shooting distance information, the focal length, the zoom magnification, and the imaging plane size corresponding to the first content, the shooting operation and the shooting operation direction of the shooting apparatus with respect to the subject reflected in the first content are obtained. To obtain a shooting range size corresponding to the first content, and to obtain a subject size based on the obtained shooting range size A first information feature, which is represented by the subject size, the photographing operation, and the photographing operation direction obtained by the information analyzing unit, the request information analyzing unit, and the first content before or after the first content. A rule database unit that stores the relationship between the content features of the second content, the shooting range size corresponding to the first content obtained by the request information analysis unit, the shooting operation, and the shooting operation direction. A feature of the second content is obtained with reference to the rule database unit, content related information matching the feature is selected from the content related information storage unit, and presentation information is selected based on the selected content related information. A presentation information generation unit for generating, and a presentation information transmission unit for transmitting the generated presentation information to the transmission side of the presentation request information. And features.

[4] The content editing apparatus displays presentation request information including shooting position information, shooting direction information, shooting distance information, focal length, and zoom magnification at the time of shooting corresponding to the first content that is still image data or moving image data. A presentation request information generation unit to be generated and the presentation request information generated by the presentation request information generation unit are transmitted, and the presentation request information and the first content received on the reception side of the presentation request information are transmitted. Based on the corresponding imaging surface size, a shooting operation and a shooting operation direction of the shooting apparatus for the subject reflected in the first content and a subject size corresponding to the first content are obtained, and the obtained subject size is obtained. And the feature of the first content represented by the shooting operation and the shooting operation direction, and before or after the first content. The feature database of the second content is obtained by referring to the rule database section that stores the relationship with the feature of the second content, and the content related information that matches the feature is selected. And a communication unit that receives the transmitted presentation information when instruction information is generated and transmitted based on the content related information.

[5] The content sharing program causes the computer to associate the content captured by the imaging device, the imaging position information, the imaging direction information, the imaging distance information, the focal length, and the zoom magnification at the time of imaging acquired by the imaging device. A content storage unit that stores the metadata, a metadata extraction unit that extracts the shooting position information, the shooting direction information, the shooting distance information, the focal length, and the zoom magnification from the content storage unit, and the metadata extraction unit The subject position of the subject shown in the content is obtained based on the shooting position information, the shooting direction information, and the shooting distance information extracted by the camera, and is extracted from the imaging surface size of the shooting apparatus and the metadata extraction unit. Shooting range in which the subject is shot based on the shooting distance information, the focal length, and the zoom magnification A metadata analysis unit for obtaining a subject size based on the obtained shooting range size, the shooting position information extracted by the metadata extraction unit, the subject position obtained by the metadata analysis unit, and A content-related information storage unit that stores the subject size in association with the content as content-related information;

[6] The content editing program presents the computer including shooting position information, shooting direction information, shooting distance information, focal length, and zoom magnification at the time of shooting corresponding to the first content that is still image data or moving image data. A presentation request information generation unit that generates request information, and the presentation request information generated by the presentation request information generation unit, and at the reception side of the presentation request information, the received presentation request information and the first Based on the imaging surface size corresponding to the content, the photographing operation and the photographing operation direction of the photographing device for the subject shown in the first content and the subject size corresponding to the first content are obtained and obtained Features of the first content and the first container represented by the subject size, the shooting operation, and the shooting operation direction. The feature of the second content is obtained by referring to the rule database section storing the relationship with the feature of the second content to be connected before or after the item, and the content related information matching the feature is selected, Further, when instruction information is generated and transmitted based on the selected content-related information, the communication unit functions as a communication unit that receives the transmitted presentation information.

According to the present invention, it is possible to reliably specify the subject of each content in the content data to be shared, and to easily manage the subject size, which is a composition related to the shooting distance, and information relating to camera work. Further, according to the present invention, when content data is created by combining materials, it is possible to make a content data acquisition request and presentation in consideration of the relationship between materials for various elements.
Therefore, according to the present invention, the efficiency of content production can be improved and the quality of the content work can be improved.

1 is an overall configuration diagram of a content sharing system to which an embodiment of the present invention is applied. FIG. 3 is a block diagram illustrating a functional configuration of the imaging device in the embodiment. In the same embodiment, it is the figure which showed the example of the data format of the metadata which the metadata production | generation part of an imaging device produces | generates. In the embodiment, it is the figure which showed typically the correspondence of video data and metadata. FIG. 3 is a block diagram showing a functional configuration of a content sharing apparatus in the same embodiment. In the same embodiment, it is a figure which shows the data structure of the content relevant information memorize | stored in the content relevant information storage part. In the same embodiment, it is a figure for demonstrating calculation of the imaging | photography range size by a metadata analysis part. In the embodiment, it is the figure which showed the data structure of the presentation information which a presentation information generation part produces | generates. It is a data block diagram of the shot matrix and rule table which are contained in the rule database part in the embodiment. In the same embodiment, it is the figure which showed typically the principal part of the operation interface of an editing apparatus. 3 is a block diagram illustrating a functional configuration of the editing device in the embodiment. FIG. In the embodiment, it is a data block diagram of the presentation request information which a presentation request information generation part produces | generates. 5 is a flowchart showing a procedure of a presentation request process executed by the editing apparatus in the embodiment. 6 is a flowchart showing a procedure of content data request processing executed by the editing apparatus in the embodiment. 6 is a flowchart illustrating a procedure of presentation processing executed by the content sharing apparatus in the embodiment. 5 is a flowchart illustrating a procedure of content data candidate selection processing executed by the content sharing apparatus in the embodiment.

Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the drawings. FIG. 1 is an overall configuration diagram of a content sharing system to which an embodiment of the present invention is applied. As shown in the figure, the content sharing system 1 includes photographing apparatuses 10-1, 10-2, and 10-3 (referred to as photographing apparatuses 10 respectively) connected via a network 40, respectively. The content sharing apparatus 20 includes editing apparatuses (content editing apparatuses) 30-1 and 30-2 (referred to as editing apparatuses 30 respectively).
In addition, the imaging device 10 may be one or any plurality. When there are a plurality of imaging devices 10, the users of each imaging device 10 may be the same person in whole or in part. Similarly, the editing apparatus 30 may be one or any plural number.

  The imaging device 10 is a digital camera that is set to a photo shooting mode or a video shooting mode and takes a photo or video. The photographing apparatus 10 acquires and manages photographing information such as subject distance, focal length, zoom rate, photographing date and time for each photographed content.

In addition, the photographing apparatus 10 has a function of acquiring photographing position information indicating a photographing position (latitude, longitude, altitude) of the own apparatus and photographing direction information indicating a photographing direction (azimuth angle, inclination angle). Then, the photographing apparatus 10 generates metadata including photographing information, photographing position information, and photographing direction information, and adds the photographed data or the video data to generate content data. The imaging device 10 uploads the content data to the content sharing device 20 via the network 40 or transfers it to another information processing device (not shown) connected to the network 40.
In addition, after the content data of the imaging device 10 is replicated offline to the other information processing device, the content data may be uploaded from the information processing device to the content sharing device 20.

The content sharing device 20 stores the uploaded content data, analyzes the metadata added to the content, identifies the subject, composition, and camera work, and stores them in association with the content data. However, the camera work is specified and stored only when the content is video.
Further, the content sharing apparatus 20 extracts and presents content candidates that match the presentation request content in response to a content candidate presentation request from the editing apparatus 30, or responds to a content request from the editing apparatus 30. Supply specified content data.
The editing device 30 performs non-linear editing of content using video and photographs using content data supplied from the image capturing device 10 and content data downloaded from the content sharing device 20.
The network 40 is a communication network that can communicate by, for example, IP (Internet Protocol), and includes the Internet, an intranet, or both. The network 40 may be wireless communication or wired communication.

  Next, a more detailed configuration of the imaging device 10, the content sharing device 20, and the editing device 30 of the content sharing system 1 will be described. FIG. 2 is a block diagram illustrating a functional configuration of the photographing apparatus 10. As shown in the figure, the photographing apparatus 10 includes an optical system 101, an imaging unit 102, an image processing unit 103, a positioning unit 104, an azimuth angle measuring unit 105, a tilt angle measuring unit 106, and metadata generation. The unit 107 and the transmission unit 108 are included.

The imaging unit 102 includes an imaging device such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and forms an image on an imaging surface of the imaging device by an optical system 101 including a lens group and a focus adjustment unit. The captured subject image is captured. Then, the imaging unit 102 converts the captured image into a captured image signal that is an electrical signal and supplies the captured image signal to the image processing unit 103. Further, the imaging unit 102 acquires shooting information and supplies it to the metadata generation unit 107.
The image processing unit 103 converts the captured image signal into digital image data, performs data compression processing, and generates compressed image data. The image processing unit 103 performs digital zoom processing by enlarging or reducing the digital image data at a desired magnification. Further, the image processing unit 103 adds the metadata supplied from the metadata generation unit 107 to the compressed image data, generates content data, and supplies the content data to the transmission unit 108. The transmission unit 108 converts the content data into an IP packet and transmits it to the content sharing apparatus 20.

  The positioning unit 104 has, for example, a GPS function, measures the longitude, longitude, and altitude indicating the position of the photographing apparatus 10 and supplies the measured position information to the metadata generation unit 107 as photographing position information. The azimuth measuring unit 105 is, for example, a magnetic sensor, detects the azimuth angle of the optical axis of the optical system 101 with reference to geomagnetism, and supplies the detected azimuth angle to the metadata generation unit 107. The azimuth is a clockwise angle with the north direction of geomagnetism being 0 degrees. The tilt angle measurement unit 106 is, for example, a triaxial acceleration sensor, and detects a tilt angle of the optical axis with respect to the horizontal plane on a plane that is orthogonal to the horizontal plane and includes the optical axis of the optical system 101, and generates a metadata generation unit 107. To supply. The azimuth angle and tilt angle supplied to the metadata generation unit 107 are referred to as shooting direction information.

  The metadata generation unit 107 generates metadata and supplies it to the image processing unit 103. That is, the metadata generation unit 107 acquires shooting information from the imaging unit 102, acquires shooting position information from the positioning unit 104, acquires shooting direction information from the azimuth angle measuring unit 105 and the tilt angle measuring unit 106, and performs meta data. Data is generated and supplied to the image processing unit 103.

FIG. 3 is a diagram illustrating an example of a data format of metadata generated by the metadata generation unit 107. As shown in the figure, the metadata includes shooting information and position / direction information. The shooting information includes subject distance, focal length, subject location, zoom rate, shooting date and time, and model information. The subject distance (shooting distance information) is a distance measured by an autofocus mechanism included in the focus adjustment unit of the optical system 101. The focal length is an optical focal length of the lens group of the optical system 101. The subject location is text information that is manually input by operating an operation unit (not shown) or input by communication from the outside. This subject location is an optional input item. The zoom rate is a zoom magnification when the photographing apparatus 10 performs digital zoom processing. The shooting date / time is date / time information measured by an internal clock (not shown) when the imaging unit 102 takes an image. The model information is information on the model name or model number of the photographing apparatus 10.
Further, in the same figure, the position / direction information includes latitude, longitude, altitude, azimuth angle, and tilt angle. The latitude, longitude, and altitude in the position / direction information are the shooting position information. Further, the azimuth angle and the inclination angle in the position / direction information are the shooting direction information.
As a metadata format, EXIF standardized by the Japan Electronics Industry Promotion Association (JEIDA) or MXF defined by the SMPTE standard can be applied.

  The metadata generation unit 107 associates one piece of metadata with one piece of photo data in the photo content data. On the other hand, the metadata generation unit 107 includes one piece of metadata for a predetermined frame image (for example, motion JPEG) or a predetermined GOP (Group of Pictures) (for example, MPEG) for video content data. To be matched. This is because, when one piece of metadata is associated with one piece of video data, if a video taken for a long time or a video composed of a plurality of scenes is one video data, Since there may be a discrepancy between the attribute information of the metadata, the association is different from the content data of the photo.

For example, the metadata generation unit 107 associates video data and metadata as follows. FIG. 4 is a diagram schematically showing the correspondence between video data and metadata. The figure shows an example in which one video data is composed of two scenes (scene 1 and scene 2). The first frame image of scene 1 is a frame image F1s, and the last frame image is a frame image F1e. The first frame image of scene 2 is a frame image F2s, and the last frame image is a frame image F2e. The metadata generation 107 associates four pieces of metadata with video data having such a frame configuration. That is, the metadata generation unit 107 associates the metadata MD1s with the frame image F1s, the metadata MD1e with the frame image F1e, the metadata MD2s with the frame image F2s, and the metadata MD2e with the frame image F2e.
Note that the metadata generation unit 107 may associate metadata in units of scenes.

  Next, the configuration of the content sharing apparatus 20 will be described. FIG. 5 is a block diagram illustrating a functional configuration of the content sharing apparatus 20. As shown in the figure, the content sharing apparatus 20 includes a content data registration unit 21 and a presentation unit 22. The content data registration unit 21 stores the uploaded content data, analyzes the metadata added to the content, identifies the subject, the composition, and the camera work when the content is video, and stores the content related information. Store in association with content data. In response to the content candidate presentation request from the editing device 30, the presentation unit 22 extracts and presents content candidates that match the content of the presentation request, or is designated in response to the content request from the editing device 30. Or supply content data.

  The content data registration unit 21 includes a content reception unit 201, a content storage unit 202, a metadata extraction unit 203, a content related information storage unit 204, and a metadata analysis unit 205.

  The content receiving unit 201 receives content data uploaded and transmitted from the imaging device 10 or other information processing devices. The content storage unit 202 stores the content data received by the content receiving unit 201. The content storage unit 202 stores the content data of a photograph (still image data) in the still image data storage unit 202a and the content data of video (moving image data) according to the content type of the content data. To remember. The content storage unit 202 is configured using, for example, a hard disk device. The still image data storage unit 202a and the moving image data storage unit 202b may be configured as two physically separated content storage units. However, the content storage unit 202 is configured by a single hard disk device, and The data storage unit 202a and the moving image data storage unit 202b may be logically divided by partition.

The metadata extraction unit 203 reads content data from the content storage unit 202 and extracts metadata added to the content data.
The content related information storage unit 204 associates the metadata extracted by the metadata extraction unit 203 and the information analyzed by the metadata analysis unit 205 with the content data stored in the content storage unit 202 as content related information. Remember.

FIG. 6 is a diagram illustrating a data configuration of content related information stored in the content related information storage unit 204. In the figure, content-related information includes content ID, storage destination address, type, shooting date / time, shooting position (location / name), shooting position (latitude), shooting position (longitude), and shooting position. (Altitude), subject (location / name), subject position (latitude), subject position (longitude), subject position (altitude), subject size, shooting operation, and shooting operation direction The data is structured with the content ID as the primary key.
In the figure, for convenience of drawing, the content related information is divided into upper and lower two stages, but the actual content related information is a single table in which upper and lower records are connected by * part.

  The information of each item of the shooting date / time, shooting position (latitude), shooting position (longitude), shooting position (altitude), and subject (location / name) in FIG. 6 is extracted by the metadata extraction unit 203. The shooting date / time, latitude, longitude, altitude, and subject location in the data. The content ID is an identifier that associates a record of content-related information with content data stored in the content storage unit 202. The storage destination address is storage destination address information of content data in the content storage unit 202. The type indicates the type of content and takes a value of either “photo” or “video”. This type is information obtained from the content attribute recorded in the file header of the content data. The type may be obtained based on the storage destination addresses in the still image data storage unit 202a and the moving image data storage unit 202b. The shooting position (location / name) is text information written by an operation unit (not shown). Further, the shooting position (location / name) may be obtained from an external map database based on information of each item of the shooting position (latitude, longitude, altitude). The subject (location / name) can also be obtained in the same manner as the shooting position (location / name). Information on each item of the subject position (latitude, longitude, altitude), subject size, shooting operation, and shooting operation direction is information obtained as a result of analysis by the metadata analysis unit 205.

Returning to the description of FIG. 5, the metadata analysis unit 205 converts the shooting date / time, latitude, longitude, altitude, and subject location information of the metadata extracted by the metadata extraction unit 203 into the shooting date / time of the content related information, Each of the shooting position (latitude, longitude, altitude) and subject (location / name) items is recorded and registered in the content related information storage unit 204.
Further, the metadata analysis unit 205 analyzes the metadata and classifies the latitude, longitude, and altitude representing the position of the subject, and the shooting range size, the subject size, the shooting operation, and the shooting operation. Information on the direction is recorded in each item of the subject position (latitude, longitude, altitude), subject size, photographing operation, and photographing operation direction of the content-related information, and is registered in the content-related information storage unit 204.

Specifically, for example, the metadata analysis unit 205 obtains the coordinate value (x1, y1) of the planar rectangular coordinate system from the latitude and longitude of the imaging device 10. Note that a method for calculating mutual conversion between latitude / longitude and coordinate values of the plane rectangular coordinate system is a well-known technique, and therefore, description thereof is omitted here.
Next, the metadata analysis unit 205 includes a subject distance L that is a distance between the photographing apparatus 10 and the subject, a coordinate value (x1, y1) of the photographing apparatus 10, an altitude h1 of the photographing apparatus 10, and an inclination angle θ1. Based on the azimuth angle θ2, the coordinate value (x2, y2) and altitude h2 of the plane rectangular coordinate system of the subject are calculated by the following equation (1). Note that the inclination angle θ1 is an inclination angle of the optical axis with respect to the horizontal plane in a plane orthogonal to the horizontal plane and including the optical axis of the optical system 101 of the photographing apparatus 10. The azimuth angle θ2 is a counterclockwise angle with respect to the positive direction of the X axis.

That is, the metadata analysis unit 205 obtains the altitude h2 of the subject position based on the subject distance L, the inclination angle θ1, and the altitude h1 of the imaging device. Further, the metadata analysis unit 205 converts the latitude / longitude of the photographing apparatus 10 into the coordinate values (x1, y1) of the plane rectangular coordinate system, and captures the coordinate value x2 of the planar rectangular coordinate system corresponding to the latitude of the subject. It is determined based on the distance (L · cos θ1) between the apparatus 10 and the subject on the plane rectangular coordinate plane, the azimuth angle θ2, and the coordinate value x1 of the photographing apparatus 10. In the same manner, the metadata analysis unit 205 calculates the coordinate value y2 of the plane rectangular coordinate system corresponding to the longitude of the subject on the distance (L · cos θ1) on the plane rectangular coordinate plane between the imaging device 10 and the subject. And the azimuth angle θ2 and the coordinate value y1 of the photographing apparatus 10 are obtained.
The metadata analysis unit 205 obtains the latitude / longitude of the subject from the coordinate values (x2, y2) of the subject after the calculation according to the equation (1).

  In addition, the metadata analysis unit 205 calculates the shooting range size using the area of the shooting range on the focused plane (that is, the place where the subject exists). FIG. 7 is a diagram for explaining calculation of the shooting range size by the metadata analysis unit 205. Describing with reference to the figure, the metadata analysis unit 205 calculates the shooting width W and the shooting height H of the shooting range 71 by the equation (2), and calculates the shooting area SS of the shooting range 71. This shooting area SS is the shooting range size. In Expression (2), SW is the width dimension (imaging surface width, imaging surface size) of the imaging surface 72 of the imaging device corresponding to the imaging width W, and SH is the height of the imaging surface 72 corresponding to the imaging height H. It is a dimension (imaging surface height, imaging surface size). SD is a subject distance, FL is a focal length, and ZR is a zoom rate.

That is, the metadata analysis unit 205 determines the area of the shooting range 71 at the location where the subject exists based on the imaging surface size of the imaging surface 72 of the imaging device, the ratio between the focal length and the subject distance, and the zoom rate. calculate. Note that the subject distance SD, the focal length FL, and the zoom rate ZR in Expression (2) are the subject distance, the focal length, and the zoom rate obtained from the shooting information of the metadata. The imaging surface width SW and the imaging surface height SH of the imaging device are values obtained by the metadata analysis unit 205 based on the model information described in the imaging information of the metadata. That is, the metadata analysis unit 205 stores in advance an imaging device-to-imaging device table in which the model name of the imaging device, the type of the imaging device mounted on the imaging device, and the size of the imaging surface 72 are associated with each other. The size of the imaging surface 72 is acquired from the imaging device vs. imaging element table using the model name described in the model information of the metadata as a search key.
However, the metadata analysis unit 205 does not calculate Expression (2) when the subject distance SD = ∞ (infinity).

  Then, the metadata analysis unit 205 classifies a plurality of content data obtained by photographing the same subject based on the subject distance SD and the photographing area SS. For example, the metadata analysis unit 205 creates a set (long) of only content data whose subject distance SD is infinite. Then, except for the set (long), the difference between the maximum value and the minimum value of the shooting area SS is calculated, and the predetermined number of classifications (for example, middle, loose, full, knee, and up, which are compositions related to the shooting distance) In the case of classification, five sets are created by dividing by the number of classifications = 5). That is, the metadata analysis unit 205 classifies content data into six types of subject sizes: long, middle, loose, full, knee, and up.

In addition, when the metadata extracted by the metadata extraction unit 203 relates to video content, the metadata analysis unit 205 identifies camerawork based on the metadata. The camera work is a shooting operation and a shooting operation direction of the shooting device 10 for a subject in a video content. The photographing operation includes, for example, fixing, zooming in / out, tilting, and panning. The shooting operation direction is, for example, an up / down direction in the case of tilt, and a left / right direction in the case of pan.
For example, in the example of the scene 1 illustrated in FIG. 4, the metadata analysis unit 205 obtains a difference between the metadata MD1s and the metadata MD1e, and the photographing apparatus 10 with respect to the subject has an inclination angle of 40 degrees. The shooting operation and the shooting operation direction are specified as being tilted up to a degree. Further, the metadata analysis unit 205 similarly obtains a difference for the zoom rate, latitude, longitude, altitude, and azimuth, and in the example of the scene 1 in FIG. The shooting operation that is not performed is specified.

  Returning to the description of FIG. 5 again, the presentation unit 22 of the content sharing apparatus 20 includes a communication unit 211, a request information reception unit 212, a request information analysis unit 213, a presentation information generation unit 214, a rule database unit 215, The presentation information transmission unit 216, the content transmission unit 217, and the authentication unit 218 are configured.

  The communication unit 211 communicates with the editing device 30, receives the presentation request information or content request information transmitted from the editing device 30, and also responds to the presentation information or content request information that is a response to the presentation request information. This is a communication interface for transmitting content data. The request information receiving unit 212 receives the presentation request information or the content request information received by the communication unit 211. The authentication unit 218 authenticates the sender of the presentation request information or content request information received by the request information receiving unit 212 and the editing device 30.

  When the request information analysis unit 213 receives the presentation request information or the content request information authenticated by the authentication unit 218 from the request information reception unit 212, the request information analysis unit 213 classifies them. Then, the request information analysis unit 213 analyzes the content of the presentation request information to identify the position and composition of the subject and the shooting operation of the shooting device 10, and the content request information includes the content ID included in the content request information To 217. Details of the presentation request information and the content request information supplied from the editing device 30 will be described later.

  The presentation information generation unit 214 selects content IDs of candidate content data from the content related information storage unit 204 based on the analysis result of the request information analysis unit 213 and the rule database unit 215, and uses this content ID. The presentation information is generated by selecting content data from the content storage unit 202 as a key. This presentation information is created by creating content for presentation with a small amount of data from the selected content data so that the content of the selected content data can be visually confirmed. .

  FIG. 8 is a diagram illustrating a data configuration of the presentation information generated by the presentation information generation unit 214. As shown in the figure, the presentation information is a container file including a header, usage information, and presentation content, and one container file per content data. The header includes a content ID that is identification information of content data and a content sharing device ID that is unique identification information assigned to the content sharing device 20. The usage information includes information for using the content data, including metadata corresponding to the presentation content, usage conditions, and billing information. The use condition indicates a condition for using the content data corresponding to the presentation content, and various types of conditions such as a frequency limit, a time limit, and a content limit can be applied. For example, the frequency limit includes a limit on the number of downloads from the content sharing apparatus 20 and a limit on the number of copies on the editing apparatus 30 side. In addition, as a time limit, there is a limit on the use time from the first download. Furthermore, as a content restriction, there is a restriction that permits / denies editing of the content data itself.

  The billing information defines a fee required for the user of the editing apparatus 30 to use the content data corresponding to the presentation content. The presentation content includes a thumbnail image or a low resolution video. The thumbnail image is a thumbnail generated from the still image data when the content data is still image data, and is a thumbnail generated from a representative image in the video when the content data is video data. . The low-resolution video is video content in which, when the content data is video data, encoding processing is performed with the resolution of the image being lower than the resolution of the video data, and the playback time length is limited to a certain time for presentation.

  Returning to the description of FIG. 5 again, the rule database unit 215 is a database that manages rules for determining the content to be presented by the presentation information generation unit 214 based on the analysis result in the request information analysis unit 213. The rule database unit 215 stores information that rules editing know-how and techniques in content production.

Specifically, the rule database unit 215 includes a shot matrix 215a and a rule table 215b. The shot matrix 215a classifies and stores features related to content shooting based on a two-dimensional matrix of a composition type in the photographing apparatus 10 and a combination type of photographing operation and photographing operation direction of the photographing apparatus 10. The presentation information generation unit 214 can extract features related to content shooting by referring to the shot matrix 215 a using the composition specified by the request information analysis unit 213, the shooting operation and the shooting operation direction of the shooting apparatus 10.
The rule table 215b is a table for selecting content candidates suitable for arranging next to or before a plurality of temporally continuous content. The contents of the table reflect one or more features relating to the shooting of content candidates to be connected to the next or previous, reflecting the rules of editing know-how and techniques in content production for the input sequence of features relating to shooting of one or more contents. Or a plurality of outputs.

  Editing know-how and technique rules in content production are rules for changing any combination of composition, shooting operation, or shooting operation direction based on video production techniques and video production know-how of professional video producers. Is. For example, if an up shot is followed by an up shot as the composition of the subject, what materials can be connected, such as changing to loose next, or up after zooming in as a shooting operation, etc. This systematizes whether the video will be easy to see. Another important element of systematization is to exclude shooting operations that are likely to be difficult to see, such as continuous panning in the same direction.

FIG. 9 is a data configuration diagram of the shot matrix 215a and the rule table 215b included in the rule database unit 215. FIG. 4A shows an example of the data structure of the shot matrix, and FIG. 4B shows an example of the data structure of the rule table. The shot matrix in FIG. 11A is a combination of composition types such as “1 long” and “2 middle”, and shooting operations and shooting operation directions such as “A fixed” and “B pan (right → left)”. The features relating to the shooting of content are classified according to a two-dimensional matrix table of types.
In the rule table of FIG. 7B, taking a line with “rule ID” = “000002” as an example, when two contents whose characteristics regarding content shooting are “2A” and “5F” are arranged. (“Input1” = “2A”, “Input2” = “5F”), and “5A” and “4A” are candidates (“Output1” = “5A”, “Output2” = “4A”). The order of “Output1, Output2,...” Corresponds to the order from the highest priority of the content data to be presented.

  Returning to the description of FIG. 5 again, the presentation information transmission unit 216 transmits the presentation information through the communication unit 211 to the editing apparatus 30 that has transmitted the presentation request information. The content transmission unit 217 reads content data from the content storage unit 202 using the content ID included in the content request information as a key, and causes the editing apparatus 30 that has transmitted the content request information to transmit the content data from the communication unit 211.

Next, the editing device 30 will be described. The editing device 30 receives supply of content data from the imaging device 10 or the information processing device or downloads content data from the content sharing device 20 and stores the content data in its own device. It is also a device that produces (edits) content using “.
Note that the editing device 30 also has editing functions such as an image processing function for video data and still image data itself, a special effect processing function such as fade and wipe, a super processing function, and the like. Since it is a well-known technique and independent of the present embodiment, the description thereof is omitted.

  In order to facilitate the understanding of the editing process in the present embodiment, the operation interface of the editing device 30 will be described before the configuration of the editing device 30 is described. FIG. 10 is a diagram schematically illustrating a main part of a GUI (Graphical User Interface) that is an operation interface of the editing apparatus 30. As shown in the figure, a GUI screen 1000 displayed on a display unit (not shown) of the editing apparatus 30 includes a source monitor 1010, a program monitor 1020, a timeline 1030, a material area 1040, and a presentation request area 1050. It is comprised including. A cursor 1060 is displayed on the GUI screen 1000. Each GUI part of the GUI screen 1000 is designated, determined, and dragged and dropped by a cursor 1060 that is freely moved on the screen in accordance with an operation of a pointing device (not shown).

  The source monitor 1010 is a monitor area that displays the content of the material selected from the material area 1040 and sets the in / out timing of the scene according to the operation of the slider 1011. The program monitor 1020 is a monitor area for displaying content (edited content) being edited on the timeline 1030, and a desired scene of the edited content can be confirmed according to the operation of the slider 1021. The timeline 1030 is a content editing work area, and is a work area for creating content by arranging materials dragged and dropped from the material area 1040 in a desired order. As in the example of FIG. 10, materials can be arranged for each resource like videos 1, 2, 3 and audios 1, 2. Each timeline and each area in the timeline can be arbitrarily changed by a drag and drop operation. This figure shows a state in which the scene 1031 of video 2 is selected by the cursor 1060.

  The material area 1040 displays the thumbnail image, the icon of the material stored in the editing device 30, or the content for presentation of the presentation information received from the content sharing device 20. In FIG. 10, “Local” indicates a material stored in the editing apparatus 30, and “Remote” indicates a presentation content.

  The presentation request area 1050 is a work area in which a content data candidate presentation request is made to the content sharing apparatus 20. Specifically, the presentation request area 1050 is a pop-up menu type GUI area, and a scene (original scene) that is a source of the presentation request from the timeline 1030 and a material (original source) of the presentation request from the material area 1040. When the (material) (however, only “Local”) is dragged and dropped, a presentation request information input menu 1051 is popped up. In this presentation request information input menu 1051, setting items for condition setting are displayed. After an input of a presentation request for requesting content data that matches an original material and an original scene (these contents are called original contents) and what conditions are requested by the operation of the presentation request information input menu 1051, the decision is made. When key 1052 is clicked, the content of the presentation request is determined and presentation request information is generated. Details of the presentation request information and the generation process thereof will be described later.

  Next, the configuration of the editing device 30 will be described. FIG. 11 is a block diagram showing a functional configuration of the editing apparatus 30. As shown in FIG. The configuration of the editing device 30 will be described below with reference to FIGS. 10 and 11 together. As illustrated in FIG. 11, the editing device 30 includes an operation unit 301, a content reproduction unit 302, a content information display unit 303, a content editing unit 304, a content related information storage unit 305, and a metadata extraction unit 306. A content storage unit 307, a content reception unit 308, a condition setting unit 309, a presentation request information generation unit 310, a content request information generation unit 311, a user / terminal information management unit 312, and a communication unit 313. Consists of.

  The operation unit 301 is an interface for operating the editing apparatus 30 and is, for example, a pointing device such as a mouse, a keyboard, or a remote control. The operation unit 301 displays a cursor 1060 on the GUI screen 1000 and operates each GUI part. The content reproduction unit 302 reproduces the content data stored in the content storage unit 307. A source monitor 1010 and a program monitor 1020 on the GUI screen 1000 correspond to the content playback unit 302. The content information display unit 303 displays the content data stored in the content storage unit 307 and the content for presentation of the presentation information supplied from the content sharing device 20. Further, the content information display unit 303 stores the presentation information received from the content sharing device 20. A material area 1040 on the GUI screen 1000 corresponds to the content information display unit 303.

  The content editing unit 304 edits content data stored in the content storage unit 307. A timeline 1030 on the GUI screen 1000 corresponds to the content editing unit 304. The content related information storage unit 305 stores the metadata extracted by the metadata extraction unit 306 in association with the content data stored in the content storage unit 307. The metadata extraction unit 306 extracts metadata added to the content data stored in the content storage unit 307.

  The content storage unit 307 stores content data acquired from the imaging device 10 and the information processing device and content data downloaded from the content sharing device 20. The content storage unit 307 stores the photo content data in the still image data storage unit 307a and the video content data in the moving image data storage unit 307b according to the content type of the content data. The content storage unit 307 is configured using, for example, a hard disk device. The still image data storage unit 307a and the moving image data storage unit 307b may be configured as two physically separated content storage units. However, the content storage unit 307 is configured by a single hard disk device, The data storage unit 307a and the moving image data storage unit 307b may be logically divided by partition.

  The content receiving unit 308 is an interface that captures content data from the photographing apparatus 10, the information processing apparatus, or the recording medium. When making a content data candidate presentation request to the content sharing apparatus 20, the condition setting unit 309 sets a matching condition for the requested content data. In other words, it is set what kind of conditions the content data candidate matches with the original content. The presentation request information generation unit 310 acquires the metadata of the original content from the content related information storage unit 305, and if the matching condition is set by the condition setting unit 309, acquires it from the condition setting unit 309. The user ID and the device ID of the editing device 30 are acquired from the user / terminal information management unit 312. Then, the presentation request information generation unit 310 generates presentation request information including the acquired information and causes the communication unit 313 to transmit the presentation request information. A presentation request area 1050 on the GUI screen 1000 corresponds to the condition setting unit 309 and the presentation request information generation unit 310. Details of the presentation request information will be described later.

  The content request information generation unit 311 generates content request information specifying the content ID and content sharing apparatus ID of the presentation content selected by the editor from the presentation content displayed on the content information display unit 303, Transmission is performed from the communication unit 313. The user / terminal information management unit 312 stores a user ID that is user identification information of the editing device 30 and a device ID that is device identification information of the editing device 30. The communication unit 313 communicates with the content sharing apparatus 20, transmits presentation request information or content request information to the editing apparatus 30, and presentation information or content that is a response to the presentation request information from the editing apparatus 30. It is a communication interface that receives content data that is a response to request information.

  Next, the presentation request information will be described. The presentation request information is obtained by storing three types of information including user information, one or more material information, and condition information in one data file. However, the condition information is arbitrary information. The data file is described in, for example, an XML (extensible Markup Language) format having high affinity for network communication. The presentation request information may be divided into a plurality of data files. In this case, file identification information relating each data file is stored in each data file.

  FIG. 12 is a data configuration diagram of the presentation request information generated by the presentation request information generation unit 310. In the same figure, (a) is a data configuration diagram of user information, (b) is a data configuration diagram of material information, and (c) is a data configuration diagram of condition information. The user information in FIG. 5A is information used for authentication in the content sharing apparatus 20, and includes a user ID and a device ID. The presentation request information generation unit 310 acquires a user ID and a device ID from the user / terminal information management unit 312 and generates user information.

The material information in FIG. 12B is information used for analysis in the request information analysis unit 213 of the content sharing apparatus 20, and is generated based on the metadata of the original content of the presentation request. The “type” in the material information describes whether the material information is “still image” (“photo”) or “video”. Further, “from:” and “to:” in the case where the “type” in the material information is “video” indicates information of each metadata in the start frame image and the end frame image of the original content. By managing in this way, it is possible to express the movement of the photographing device 10 in the original content and the relationship between the photographing device 10 and the subject.
When the “type” in the material information is “still image” (“photo”), there is only one metadata, so that “from:” and “to:” are described separately as described above. There is no need, and “from = to:” is described, or “from:” and “to:” are not described.

  The condition information in FIG. 12C is information used for extracting content candidates in the presentation information generation unit 214 of the content sharing apparatus 20, and the matching condition between the original content and the content candidates set by the condition setting unit 309. It is generated based on. In FIG. 9C, an item for which “1” is set means that a matching condition is set, and an item for which “0” is set means that no matching condition is set.

  In FIG. 12C, the “target” of the subject refers to the subject location. For example, “size” = “1” means that the subject size (loose, up, etc.) is the same for the subject shown in the original content. Further, “time zone” = “1” and “season” = “1” mean that the time zone and season in which the subject is photographed are the same. The “time zone” is defined in advance by dividing the time zone into, for example, morning, afternoon, and night time zones, or dividing the time zone every three hours. The “season” defines, for example, division of years, with March to May as spring, June to August as summer, September to November as autumn, and December to February as winter.

  Next, the operation of the content sharing system 1 will be described. Here, the main operations of the content sharing system 1 will be described by dividing them into “presentation request processing”, “content data request processing” of the editing device 30, and “presentation processing” of the content sharing device 20. As for the presentation process, a “content data candidate selection process” in which a part of the process is extracted will be described.

The editing device 30 uses the content data stored in the content storage unit 307 to perform non-linear editing of content according to the operation of the GUI screen 1000 shown in FIG. For example, the editor operates the GUI screen 1000 as follows to perform content editing work. The editor operates the operation unit 301 and drags and drops a desired thumbnail image or icon (limited to “Local”) in the material area 1040 to the source monitor 1010 to display content ( Material) is displayed on the source monitor 1010.
In this way, the editor checks the contents of the visualized material, and when a material used for content editing is found, drag and drop the thumbnail image or icon of the material from the material area 1040 to the timeline 1030. Incorporate into editing content. The editor repeatedly performs such work appropriately considering the contents of the material, time conditions, composition, and camera work when the material is video content.
When the content data desired to be incorporated into the edited content is not stored in the content storage unit 307, the editing device 30 requests the content sharing device 20 to present content candidates. Next, this presentation request process will be described.

[Presentation request processing]
FIG. 13 is a flowchart showing the procedure of the presentation request process executed by the editing apparatus 30. In step S <b> 101, the presentation request information generation unit 310 selects original content that is a scene or material that is a source of the presentation request, by operating the GUI screen 1000 of the editor. The selection of the original content by the editor is performed as follows. In the GUI screen 1000 of FIG. 10, when the content data of the scene to be arranged next to the scene 1032 of the video 2 in the timeline 1030 is to be acquired, the editor drags and drops the scene 1031 to the presentation request area 105, and then Drag and drop the scene 1032 to the presentation request area 1050. The presentation request information generation unit 310 recognizes that the two original scenes are in the order of the scene 1031 → the scene 1032 by the drop operations of the scenes 1031 and 1032.

  Next, in step S102, the presentation request information generation unit 310 moves to the process of step S103 when the operation for setting the matching condition is performed in the operation of the editor GUI screen 1000 (S102: YES). Is not performed (S102: NO), the process proceeds to step S104. That is, the presentation request information generation unit 310 pops up the presentation request information input menu 1051 in the presentation request area 1050 based on the drop operation of the scene 1031 that is the first drop operation. When the setting item of the presentation request information input menu 1051 is operated by an operation by the editor, the presentation request information generation unit 310 passes control to the condition setting unit 309 and proceeds to the process of step S103. On the other hand, when none of the setting items of the presentation request information input menu 1051 is operated and the enter key 1052 is selected, the matching condition is not set and the process proceeds to step S104.

  In step S103, the condition setting unit 309 sets a matching condition for the content candidate requested to be presented. That is, the condition setting unit 309 sets a matching condition between the scenes 1031 and 1032 and the content candidate requested for presentation by the setting item of the presentation request information input menu 1051 and the operation of the determination key 1052 by the editor. Specifically, the condition setting unit 309 sets a matching condition for each item every time the setting item (“type”, “subject”, “shooting time”, etc.) of the presentation request information input menu 1051 is selected and operated. Set to “1” or “0”. Then, the condition setting unit 309 finishes setting the matching condition when the determination key 1052 is selected, and returns control to the presentation request information generation unit 310.

  In step S104, the presentation request information generation unit 310 reads the metadata of the original content from the content related information storage unit 305 and generates material information. In addition, when the matching condition is set by the condition setting unit 309, the presentation request information generation unit 310 acquires the request from the condition setting unit 309 and generates the condition information. Further, the presentation request information generation unit 310 acquires the user ID and the device ID of the editing device 30 from the user / terminal information management unit 312 and generates user information. Then, the presentation request information generation unit 310 stores the generated user information, material information, and condition information in one data file, and generates presentation request information. The data format of the presentation request information is shown in FIG.

  Next, in step S <b> 105, the presentation request information generation unit 310 designates the content sharing device 20 and causes the communication unit 313 to transmit the presentation request information. Next, when the presentation information is transmitted from the content sharing device 20 in step S106, the communication unit 313 of the editing device 30 receives the presentation information and supplies it to the content information display unit 303. Next, in step S107, the content information display unit 303 stores the presentation information. On the GUI screen 1000, the presentation content is displayed as “Remote” in the material area 1040.

[Content data request processing]
Next, content data request processing of the editing apparatus 30 will be described. Presented by operation of the operation unit 301 in a state where the presentation information is stored in the content information display unit 303 of the editing apparatus 30, that is, in a state where the presentation content is displayed as “Remote” in the material area 1040 of the GUI screen 1000. When the content for use is selected, the editing apparatus 30 executes content data request processing.
FIG. 14 is a flowchart illustrating a procedure of content data request processing executed by the editing apparatus 30. In step S201, when the presentation content is selected by the operation unit 301, the content information display unit 303 proceeds to the process of step S202. This operation indicates that the presentation content (“Remote”) displayed in the material area 1040 of the GUI screen 1000 is selected by the operation unit 301.

  Next, in step S202, the content request information generation unit 311 reads the content ID and content sharing device ID of the selected presentation content from the content information display unit 303, and obtains the user ID and the device ID of the editing device 30. The content request information is generated by reading from the user / terminal information management unit 312. Next, in step S <b> 203, the content request information generation unit 311 transmits content request information from the communication unit 313. Next, in step S <b> 204, when content data is transmitted from the content sharing apparatus 20, the communication unit 313 of the editing apparatus 30 receives the presentation information and supplies it to the content storage unit 307. Next, in step S205, the content storage unit 307 stores the content data supplied from the communication unit 313.

[Presentation processing]
Next, the presentation process of the content sharing apparatus 20 will be described. When the content sharing device 20 receives the presentation request information from the editing device 30, the content sharing device 20 analyzes the content, selects a content candidate that is related to the original material of the presentation request or the original content that is the original scene, and generates the presentation information. Then, the presentation information is transmitted to the editing device 30 that is the transmission source of the presentation request information. In addition, when the content sharing apparatus 20 receives the content request information from the editing apparatus 30, the content sharing apparatus 20 transmits the specified content data to the editing apparatus 30 that is the transmission source of the content request information.

  FIG. 15 is a flowchart showing the procedure of the presentation process executed by the content sharing apparatus 20. In step S <b> 301, when the communication unit 211 receives the request information of presentation request information or content request information transmitted from the editing device 30, the communication unit 211 supplies the request information to the request information receiving unit 212. In step S <b> 302, the authentication unit 218 reads out user information from the request information received by the request information reception unit 212 and authenticates it. If the authentication by the authentication unit 218 is successful (S303: YES), the request information receiving unit 212 supplies the request information to the request information analysis unit 213, and the process proceeds to step S304. On the other hand, if the authentication by the authentication unit 218 has failed (S303: NO), the process of this flowchart ends.

  In step S304, the request information analysis unit 213 identifies the supplied request information, that is, presentation request information or content request information. If it is presentation request information, the process proceeds to step S305. The process proceeds to S309.

  In step S305, the request information analysis unit 213 extracts a plurality of material information from the presentation request information, analyzes the contents for each material information, and specifies the position of the subject, the composition, the photographing operation of the photographing apparatus 10, and the like. Specifically, the request information analysis unit 213 uses the above-described formula (1) based on the subject distance and the position / direction information (latitude, longitude, altitude, azimuth angle, and tilt angle of the imaging device 10) of the material information. To calculate the position of the subject. Further, the request information analysis unit 213 obtains the subject size by using the method in which the metadata analysis unit 205 described above calculates the shooting range size and classifies the content data. Further, the request information analysis unit 213 obtains the difference between the data in the start frame image and the data in the end frame image of each item with respect to the zoom rate and the position / direction information of the material information, and the photographing operation of the photographing apparatus 10 Is identified.

  Next, in step S306, the presentation information generation unit 214 reads the content candidate content from the content related information storage unit 204 of the content data registration unit 21 based on the analysis result of the request information analysis unit 213 and the rule database unit 215. Get an ID. The processing in step S306 will be described in detail in the description of content data candidate selection processing described later.

  Next, in step S307, the presentation information generation unit 214 reads the content data from the content storage unit 202 using the content data ID of the content candidate selected in the process of step S306 as a search key, and generates presentation information. Specifically, when the read content data is still image data, the presentation information generation unit 214 generates a thumbnail image by performing data compression processing together with resizing of the image size. Also, if the read content data is video data, a thumbnail image is generated from the representative image of the video, or encoding is performed with the resolution of the image being lower than the resolution of the video data, and the playback time length is presented. The low-resolution video is generated for a limited time. Then, the presentation information generation unit 214 generates presentation information including the header, the usage information, and the generated presentation content shown in FIG. Next, in step S <b> 308, the presentation information transmission unit 216 designates the editing device 30 that is the transmission source of the presentation request information and causes the communication unit 211 to transmit the presentation information.

  On the other hand, in step S309, the content transmission unit 217 reads content data from the content storage unit 202 using the content ID included in the content request information as a search key. Next, in step S <b> 310, the content transmission unit 217 causes the editing unit 30 that is the transmission source of the content request information to transmit content data from the communication unit 211.

[Content data candidate selection process]
Next, the process of step S306 will be described in more detail. FIG. 16 is a flowchart showing a content data candidate selection process performed by the content sharing apparatus 20. In step S401, the presentation information generation unit 214 substitutes the composition and shooting operation for each material information, which is the analysis result of the request information analysis unit 213, into the shot matrix 215a of the rule database unit 215, and extracts features for each original content. .

  With respect to this processing, the analysis result output from the request information analysis unit 213 includes a composition (middle) and shooting operation (fixed) for the original content A, and a composition (up) and shooting operation (zoom in) for the original content B. Therefore, the case where the rule database shown in FIG. 9 is used as the rule database 215 will be specifically described as an example. In step S401, the presentation information generation unit 214 substitutes (composition, shooting operation) = (middle, fixed) for the original content A, which is the analysis result of the request information analysis unit 213, into the shot matrix 215a of the rule database unit 215. To extract the feature “2A”. Next, the presentation information generation unit 214 substitutes (composition, shooting operation) = (up, zoom-in) for the original content B into the shot matrix 215a of the rule database unit 215, and extracts the feature “5F”.

  Next, in step S402, the presentation information generation unit 214 refers to the input column of the rule table 215b of the rule database unit 215 using the extraction result of the shot matrix 215a, and reflects the editing know-how and technique rules in content production. One or more features of the selected content candidates are extracted. Specifically, the presentation information generation unit 214 uses the features “2A” and “5F” extracted from the shot matrix of FIG. 9A to refer to the input string of the rule table of FIG. A row of “rule ID” = “000002” is searched as an input string to be executed. Then, the presentation information generation unit 214 extracts “Output1” = “5A” and “Output2” = “4A” as the feature of the content candidate from the output column of the row. The feature of the content candidate in FIG. 5B has higher priority for Output 1 than for Output 2.

  Next, in step S403, the presentation information generation unit 214 determines whether or not there is condition information in the presentation request information. If it is determined that there is condition information, the process proceeds to step S404, and there is no condition information. If it is determined, the process proceeds to step S405.

  In step S404, the presentation information generation unit 214 refers to the content-related information storage unit 24 using the content candidate features and condition information extracted from the rule table 215b, and from the content-related information, the content candidate features and condition information. One or a plurality of content IDs are extracted for the content that matches the item for which the matching condition is set. When multiple items are extracted, the priority order to be presented to the content ID is given according to the priority order of the feature of the content candidate.

  In step S405, the presentation information generation unit 214 refers to the content related information storage unit 24 using the feature of the content candidate extracted from the rule table 215b, and the content about the content that matches the feature of the content candidate from the content related information. One or more IDs are extracted. When multiple items are extracted, the priority order to be presented to the content ID is given according to the priority order of the feature of the content candidate.

As described above, the content sharing apparatus according to the present embodiment uses the metadata including the shooting information, the shooting position information, and the shooting direction information included in the uploaded content data to determine the position of the subject, the shooting range size (composition). ), The photographing operation and photographing direction of the photographing device can be obtained and managed together with the content.
In addition, the editing apparatus to which the present embodiment is applied acquires a material that is connected to the next or previous one material or a plurality of already connected materials when content is created and edited by connecting a plurality of materials. In order to do this, presentation request information generated based on material information on one or more materials (original content) already used for edited content is transmitted to the content sharing apparatus.
In addition, when the presentation request information is supplied from the editing device, the content sharing device according to the present embodiment has ruled material information regarding one or more original contents included therein and editing know-how and techniques in content production. Based on the information, it is possible to present content candidates related to the original content.
Furthermore, after a content candidate is presented, the content sharing apparatus according to the present embodiment can provide content data based on the request when the content is requested from the editing apparatus.

  Therefore, according to the present embodiment, the content sharing apparatus can reliably manage the subject included in the content data and the camera work of the photographing apparatus with respect to the subject. An editing device that uses a content sharing device can easily acquire content having a relationship with local content data in the editing device from the content sharing device in content production / editing. High content can be produced efficiently.

  The quality of production content is further improved by using not only the position, composition, and camera work of the subject obtained from the metadata included in the content data, but also various factors such as the time length, resolution, and color tone of the content. . For example, by using a time length, when it is desired to produce content with a predetermined time length, it is possible to select content data that falls within that time length. Further, by using the resolution, it is possible to select content data of a high-definition image. Also, by using the color tone, it is possible to exclude monochrome photographs or select content data of a desired tone. In this way, by describing various elements in the content-related information, it is possible to present content candidates that suit the editor's intention.

  Further, in the present embodiment, an example has been described in which an editing device that creates and edits content is used as the content requesting device that transmits the presentation request information and the content request information to the content sharing device 20. The embodiment of the present invention can be applied to a content display device such as a digital photo frame capable of programmably reproducing and displaying content data, instead of the editing device, in addition to the above-described embodiments. it can.

Further, the control function of the content sharing apparatus according to the above-described embodiment may be realized by a computer. In this case, the content sharing program for realizing the control function is recorded on a computer-readable recording medium, and the content sharing program recorded on the recording medium is read into the computer system and executed. Also good.
Similarly, the control function of the editing apparatus according to the above-described embodiment may be realized by a computer. In this case, the content editing program for realizing the control function is recorded on a computer-readable recording medium, and the content editing program recorded on the recording medium is read into the computer system and executed. Also good.
Here, the “computer system” includes an OS (Operating System) and hardware of peripheral devices. The “computer-readable recording medium” refers to a portable recording medium such as a flexible disk, a magneto-optical disk, an optical disk, and a memory card, and a storage device such as a hard disk built in the computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case may be included and a program that holds a program for a certain period of time may be included. Further, the above program may be for realizing a part of the functions described above, or may be realized by a combination with the program already recorded in the computer system. .

  As mentioned above, although embodiment of this invention was explained in full detail with reference to drawings, the concrete structure is not restricted to this embodiment, The design etc. of the range which does not deviate from the summary of this invention are included.

DESCRIPTION OF SYMBOLS 1 Content sharing system 10-1, 10-2, 10-3 Image pick-up device 20 Content sharing device 21 Content data registration part 22 Presentation part 30-1, 30-2 Editing apparatus 40 Network 101 Optical system 102 Imaging part 103 Image processing part DESCRIPTION OF SYMBOLS 104 Positioning part 105 Azimuth angle measuring part 106 Inclination angle measuring part 107 Metadata production | generation part 108 Transmission part 201 Content receiving part 202 Content storage part 202a Still image data storage part 202b Movie data storage part 203 Metadata extraction part 204 Content related information storage Unit 205 metadata analysis unit 211 communication unit 212 request information reception unit 213 request information analysis unit 214 presentation information generation unit 215 rule database unit 215a shot matrix 215b rule table 216 presentation information transmission unit 217 Contents transmission unit 218 Authentication unit 301 Operation unit 302 Content playback unit 303 Content information display unit 304 Content editing unit 305 Content related information storage unit 306 Metadata extraction unit 307 Content storage unit 307a Still image data storage unit 307b Movie data storage unit 308 Content Reception unit 309 Condition setting unit 310 Presentation request information generation unit 311 Content request information generation unit 312 User / terminal information management unit 313 Communication unit

Claims (6)

A content storage unit that stores the content captured by the imaging device, the imaging position information, the imaging direction information, the imaging distance information, the focal length, and the zoom magnification at the time of imaging acquired by the imaging device in association with each other;
A metadata extraction unit that extracts the shooting position information, the shooting direction information, the shooting distance information, the focal length, and the zoom magnification from the content storage unit;
Based on the shooting position information, the shooting direction information, and the shooting distance information extracted by the metadata extraction unit, a subject position of a subject reflected in the content is obtained, and an imaging surface size of the shooting device, and the metadata A metadata analysis unit for obtaining a photographing range size for photographing the subject based on the photographing distance information extracted from the extraction unit, the focal length, and the zoom magnification, and obtaining the subject size based on the obtained photographing range size; ,
A content-related information storage unit that stores the shooting position information extracted by the metadata extraction unit and the subject position and the subject size respectively obtained by the metadata analysis unit as content-related information in association with the content;
A content sharing apparatus comprising: When the content is moving image data, the metadata analysis unit is based on the shooting position information, the shooting direction information, the shooting distance information, the focal length, and the zoom magnification extracted by the metadata extraction unit. And further obtaining a photographing operation and a photographing operation direction of the photographing device with respect to a subject reflected in the content,
The content sharing apparatus according to claim 1, wherein the content related information storage unit stores the shooting operation and the shooting operation direction obtained by the metadata analysis unit in the content related information. A request information receiving unit that receives presentation request information including shooting position information, shooting direction information, shooting distance information, focal length, and zoom magnification at the time of shooting corresponding to the first content that is still image data or moving image data;
Based on the shooting position information, the shooting direction information, the shooting distance information, the focal length, and the zoom magnification extracted from the received presentation request information, the shooting of the shooting device with respect to the subject shown in the first content An operation and a shooting operation direction are determined, and a shooting range size corresponding to the first content is determined based on the shooting distance information, the focal length, the zoom magnification, and an imaging surface size corresponding to the first content. A request information analysis unit for obtaining a subject size based on the obtained shooting range size;
Features of the first content represented by the subject size, the shooting operation, and the shooting operation direction obtained by the request information analysis unit, and features of the second content connected before or after the first content A rule database section for storing the relationship between
Based on the shooting range size, the shooting operation, and the shooting operation direction corresponding to the first content obtained by the request information analysis unit, the feature of the second content is obtained by referring to the rule database unit. A presentation information generating unit that selects content related information that matches the feature from the content related information storage unit, and generates presentation information based on the selected content related information;
A presentation information transmission unit that transmits the generated presentation information to the transmission side of the presentation request information;
The content sharing apparatus according to claim 2, further comprising: A presentation request information generating unit that generates presentation request information including shooting position information, shooting direction information, shooting distance information, focal length, and zoom magnification at the time of shooting corresponding to the first content that is still image data or moving image data; ,
While sending the presentation request information generated by the presentation request information generation unit,
On the receiving side of the presentation request information, based on the received presentation request information and the imaging surface size corresponding to the first content, the photographing operation and photographing operation of the photographing device for the subject appearing in the first content A direction and a subject size corresponding to the first content are obtained, and the characteristics of the first content and the first content represented by the obtained subject size, the photographing operation, and the photographing operation direction The characteristic of the second content is obtained by referring to the rule database section that stores the relationship with the characteristic of the second content to be connected before or after, and the content related information that matches the characteristic is selected. When the instruction information is generated and transmitted based on the selected content-related information, the transmitted presentation information A communication unit that receives,
A content editing apparatus comprising: Computer
A content storage unit that stores the content captured by the imaging device, the imaging position information, the imaging direction information, the imaging distance information, the focal length, and the zoom magnification at the time of imaging acquired by the imaging device in association with each other;
A metadata extraction unit that extracts the shooting position information, the shooting direction information, the shooting distance information, the focal length, and the zoom magnification from the content storage unit;
Based on the shooting position information, the shooting direction information, and the shooting distance information extracted by the metadata extraction unit, a subject position of a subject reflected in the content is obtained, and an imaging surface size of the shooting device, and the metadata A metadata analysis unit for obtaining a photographing range size for photographing the subject based on the photographing distance information extracted from the extraction unit, the focal length, and the zoom magnification, and obtaining the subject size based on the obtained photographing range size; ,
A content-related information storage unit that stores the shooting position information extracted by the metadata extraction unit and the subject position and the subject size respectively obtained by the metadata analysis unit as content-related information in association with the content;
Content sharing program to function as Computer
A presentation request information generating unit that generates presentation request information including shooting position information, shooting direction information, shooting distance information, focal length, and zoom magnification at the time of shooting corresponding to the first content that is still image data or moving image data; ,
While sending the presentation request information generated by the presentation request information generation unit,
On the receiving side of the presentation request information, based on the received presentation request information and the imaging surface size corresponding to the first content, the photographing operation and photographing operation of the photographing device for the subject appearing in the first content A direction and a subject size corresponding to the first content are obtained, and the characteristics of the first content and the first content represented by the obtained subject size, the photographing operation, and the photographing operation direction The characteristic of the second content is obtained by referring to the rule database section that stores the relationship with the characteristic of the second content to be connected before or after, and the content related information that matches the characteristic is selected. When the instruction information is generated and transmitted based on the selected content-related information, the transmitted presentation information A communication unit that receives,
Content editing program to function as

Images