JP2009146012A - Three-dimensional shape display and recording device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a three-dimensional shape display and recording device for enabling a user to acquire information to know a location under consideration. <P>SOLUTION: This three-dimensional shape display and recording device is provided with: an image management part for storing a frame image data group configured of a plurality of frame image data configured of images acquired from the plurality of angles of a three-dimensionally shaped object; an input part for inputting the selection of frame image data from a user device; an image display control part for acquiring the selected frame image data inputted by the input part from an image storage part, and for outputting the access fact and access time of the selected frame image data; an access recording acquisition part for calculating the display time and the display frequency of each frame image data on the basis of the access fact and the access time of the selected frame image data, and for outputting the display time and the display frequency; and an access recoding analyzing part for arithmetically operating statistical mathematical processing about the display time and the display frequency for each frame image data, and for outputting the processing result. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention shows a display history for each still image displayed when a three-dimensional object is rotated and displayed in various directions requested by a user using a plurality of still images. The present invention relates to a three-dimensional shape display recording apparatus for creating

  Three-dimensional computer graphics (hereinafter referred to as three-dimensional CG) is known as means for displaying a three-dimensional object, and is used in many fields such as industry, games, and movies.

  A feature of the three-dimensional CG is that an image of an object can be displayed from a designated viewpoint or rotated on a screen in accordance with a user request. By using this feature and analyzing the display mode of the three-dimensional shape, it is considered that useful data relating to the user's preferences can be obtained.

  When a three-dimensional object is displayed in a display mode requested by the user, the user often repeatedly displays a target part of the object or stops rotation at that part. That is, the user's preference is greatly reflected in the display mode. Therefore, if data that objectively evaluates the user's preferences can be obtained from the display mode, it will be useful in, for example, design development of articles and the like.

With regard to a device that displays a two-dimensional image or moving image, a technique that attempts to objectively evaluate the user's preferences from various factors and uses it is known (for example, Patent Document 1). Patent Document 1 describes a moving image recording / reproducing apparatus. The technique disclosed in Patent Document 1 is a recording / playback unit that performs recording and playback processing of a moving image, a control unit that controls the recording / playback unit, a moving image storage device that stores a moving image, and a control used by the control unit. A control information storage unit for storing information, dividing the video to be recorded for each scene change, selecting a representative screen from each divided scene, and the importance of each scene based on the user input operation type And a representative screen of a scene with high importance is displayed as image summary information.
Japanese Patent Laid-Open No. 10-8526

  However, the invention described in Patent Document 1 is not intended for three-dimensional CG, and even if an attempt is made to display a three-dimensional object with the prior art and evaluate the user's taste, a large burden is placed on the user. Besides being forced, it is difficult to objectively evaluate user preferences. That is, in the moving image recording / reproducing apparatus described in Patent Document 1, even if the user performs reverse reproduction or the like, in principle, the user does not reproduce the divided moving images in an arbitrary order. Play videos in a predetermined order. Therefore, even when the three-dimensional shape is rotated and displayed, the order in which the portions are displayed is determined, and the user needs a lot of time and operation to find the angle and position that suits his taste. In addition, since the number of times of reproduction is inevitably increased for a moving image up to an angle / position that matches the taste, it is difficult to accurately evaluate the user's taste.

  As described above, there has been no device that evaluates which part of a target object displayed in a three-dimensional shape is objectively focused, reflecting the user's preference.

  Therefore, the present invention has an object of providing a three-dimensional shape display recording apparatus capable of acquiring information that allows the user to know the position that the user has noticed when rotating a three-dimensional object. And

  The three-dimensional shape display recording apparatus of the present invention includes an image management unit storing a frame image data group composed of a plurality of frame image data composed of images acquired from a number of angles of a three-dimensional shape object, and a user device The input unit to which the selection of the frame image data is input, and the selected frame image data input from the input unit is acquired from the image storage unit, and the access fact and access time of the selected frame image data are obtained. Access record acquisition that calculates the display time and the number of times of display for each frame image data based on the image display control unit to be output, the access fact and the access time of the selected frame image data, and outputs the display time and the number of times of display Statistical mathematics processing is performed on the display time and display count for each frame image data, and the processing results are output. And having an access record analyzer for.

  According to the present invention, by creating a display history for each still image displayed on the user device, the display history accurately determines the angle and direction that the user has noticed when viewing a three-dimensional object. Therefore, it is possible to obtain objective information about a part that attracts the user's attention.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram showing an outline of a system including a three-dimensional shape display recording apparatus of the present embodiment. As shown in the figure, a plurality of user devices 200 are connected to the three-dimensional display recording device 100 of the present embodiment via a network 300 such as the Internet. The user device 200 may be a personal computer or a mobile terminal owned by the user, for example.

  The user can access the 3D display recording apparatus 100 via the network 300. In addition, the user can perform predetermined data input and operation on the 3D display recording apparatus 100 using the user apparatus 200 and can browse images output from the 3D display recording apparatus 100.

  FIG. 2 is a block diagram showing a functional configuration of the three-dimensional shape display recording apparatus of the present embodiment. The three-dimensional shape display recording apparatus 100 of the present embodiment outputs at least one or more still images to the image display unit in each display mode. At this time, by creating a display history for each still image output to the image display unit, it is possible to accurately determine a position or the like to which the user pays attention when viewing a three-dimensional object based on the display history. Therefore, it is possible to obtain objective information about the part that attracts the user's attention.

  The three-dimensional shape display recording apparatus 100 of the present embodiment includes an image management unit 30, an image display control unit 40, an image display unit 50, an access record acquisition unit 60, an output unit 70, and an access record analysis unit 80. Is provided.

  The input unit 20 is connected to the user device 200, and when viewed from a predetermined angle to be displayed on a three-dimensional object from an input unit (eg, mouse, keyboard, microphone, etc.) of the user device 200, and A display mode instruction is input, and when the instruction is input from the user device 200, the instruction is output to the image display control unit 40.

  The image management unit 30 includes a storage unit 31 and a management unit 32. The storage unit 31 has a plurality of frame image data (hereinafter, also referred to as a frame image data group) acquired by imaging a three-dimensional object, for example, at predetermined angle intervals from all directions while changing the vertical angle. Is stored.

  FIG. 3 is an explanatory diagram illustrating an example of the configuration of the frame image data group stored in the storage unit 31. As shown in the figure, the frame image data group is composed of a plurality of frame image data arranged in a matrix. In addition, in FIG. 3, the example of a motor vehicle is shown as an example of the target object of a three-dimensional shape.

  In the horizontal direction of the matrix-like frame image data group of the present embodiment, frame image data of a total of 12 frames from the Ath frame to the Lth frame obtained by sequentially imaging an object from all directions at a predetermined angle with a predetermined angle. Are aligned.

  In the vertical direction of the matrix-like frame image data group of the present embodiment, frame image data of a total of 5 angles from the first angle to the fifth angle in which the object is sequentially imaged at different vertical angles in a predetermined orientation is aligned. Yes.

  Thus, by arranging the frame image data in a matrix, the shape of the object from all angles is aligned and converted into data. In the following description, the frame image data selected by the user is specified by “(angle) (frame)” (for example, “1A”, “2B”, etc.) using the coordinates in the matrix. The frame image data group according to the present embodiment has a matrix configuration, and thus includes a total of 60 frame image data “1A” to “5L”.

  In this embodiment, the frame image data group is a matrix of 12 frames and 5 angles, and a total of 60 frame image data from “1A” to “5L”. However, the number of frames and the number of angles are not limited to this. Absent.

  An example of an image acquisition apparatus that acquires the frame image data described above will be briefly described with reference to FIG. FIG. 4 is a longitudinal sectional view and a plan view showing a configuration of an image acquisition apparatus that can be used to acquire a plurality of frame image data according to the present embodiment.

  As shown in FIG. 4, the image acquisition device 2 includes a rotation unit 7 attached to the installation base 6, an imaging unit 9 attached to the arrangement instruction unit 8, and a housing that stores the components of the image acquisition device 2. And a body 5. The rotating unit 7 includes a rotating electric motor 10 fixed to the lower surface of the installation table 6 and a turntable 11 provided above the installation table 6. The turntable 11 functions as a mounting table for mounting an object, and can rotate the object with respect to the imaging unit 9 by driving the electric motor 10 for rotation.

  The arrangement support portion 8 includes a rod-shaped male screw portion 12 erected in the vertical direction, and an elevating motor 13 for rotating the male screw portion 12. The arrangement support unit 8 includes a lifting plate 14 that supports the imaging unit 9 and moves up and down by the rotation of the male screw unit 12.

  The imaging unit 9 is attached to the right end of the lifting plate 14 via a tilt mechanism unit 14a. The tilt mechanism 14a changes the shooting angle of the shooting unit 9. The photographing unit 9 includes a CCD camera including an imaging lens, an optical system, a CCD imaging device, an electronic circuit, and the like, and a video decoder that converts an analog video signal output from the CCD camera into image data. .

  The image acquisition device 2 includes a computer (not shown) and a plurality of position sensors (not shown). Each time the turntable 11 is rotated by a predetermined angle (for example, 11.25 °) by the control of the electric motor 10 for rotation, the imaging unit 9 An object is imaged. That is, a plurality (for example, 12 frames) of frame image data is acquired by imaging the object from all directions at a predetermined angular interval. Further, by controlling the elevating motor 13 and the tilt mechanism unit 14a in each direction, the object is imaged while changing the height and tilt of the imaging unit 9, and a plurality of (for example, 5 angles) having different vertical angles are captured. Get frame image data.

  Note that the image acquisition device 2 has shown the one that rotates the object with respect to the imaging unit 9, but conversely, even if the imaging unit 9 is turned with respect to the object, a plurality of frame image data is acquired. Is possible. Of course, the object may be rotated and photographed individually one by one without depending on such an apparatus. The method for imaging an object is not limited to these image imaging devices as long as frame image data obtained by imaging a three-dimensional object at predetermined angular intervals from all directions can be obtained. Furthermore, the frame image data can be handled in the same manner as the frame image data acquired by the image acquisition device 2 even when a three-dimensional object is generated by CG, for example, regardless of the imaging unit 9.

  The plurality of frame image data acquired as described above is input from the user device 200 via the input unit 20 and converted into the matrix-like data shown in FIG. It is stored in the storage unit 31 of the management unit 30.

  The management unit 32 centrally manages the plurality of frame image data stored in the storage unit 31 so as not to be dissipated, and the corresponding frame image from the storage unit 31 based on an instruction from the image display control unit 40 described later. Data is extracted and output to the image display control unit 40.

  When an instruction for inputting, for example, the frame image data “1A” in FIG. 3 to the image display control unit 40 is input from the image display control unit 40 to be described later, the management unit 32 receives the instruction from the storage unit 31. The frame image data “1A” corresponding to is extracted and output to the image display control unit 40.

  The image display control unit 40 extracts frame image data corresponding to a user instruction input via the input unit 20 from the frame image data stored in the image management unit 30 via the management unit 32, and The image data is output to the image display unit 50 described later.

  For example, when an instruction to display “3C” frame image data of the frame image data group in FIG. 3 is input from the user device 200 via the input unit 20, the image display control unit 40 displays the image management unit 40. An instruction for extracting “3C” frame image data from the storage unit 31 and inputting it to the management unit 32 is output. When “3C” frame image data is input from the management unit 32, the image display control unit 40 outputs the “3C” frame image data to the image display unit 50.

  The image display control unit 40 manages the nth frame image data (for example, frame image data “3C”) currently displayed. The image display control unit 40 then displays the (n + 1) th frame image data to be displayed next (for example, frame image data “2C”, “3B”, “3D”, or “4C”) and the previous The displayed (n-1) th frame image data (for example, frame image data “3D”) is managed.

  The image display control unit 40 also records the fact that the currently displayed nth frame image data (for example, frame image data “3C”) is displayed as an image (hereinafter referred to as access fact) and the access time. The data is output to the acquisition unit 60.

  The image display unit 50 is controlled by the image display control unit 40 and outputs frame image data instructed from the user device 200 via the user input unit 20 to a display device (for example, a display) of the user device 200. FIG. 5 is a display example of the frame image data “3B” displayed on the user device 200.

  As shown in the figure, the frame image data “3B” is displayed on the display of the user apparatus 200. The user moves the pointer of the mouse on the display of the user device 200 in the up / down / left / right and diagonal directions, so that the frame image data adjacent to the frame image data “3B”, that is, “4A”, “4B” in FIG. “4C”, “3A”, “3C”, “2A”, “2B”, and “2C” can be selected. The selected frame image data is then displayed on the display of the user device 200.

  The access record acquisition unit 60 creates an access record for each frame image data displayed on the image display unit 50 based on the access fact and access time input from the image display control unit 40 and outputs them to the output unit 70. To do. Here, the access record includes a display time and a display count for each frame image data displayed on the image display unit 40 in accordance with a user instruction.

  Further, the access record acquisition unit 60 stores an access record for each frame image data. Specifically, the display count and display time for each frame image data are stored.

  The output unit 70 receives an end instruction for ending acquisition of the access record from the user via the input unit 20. Further, when an end instruction is input, the output unit 70 extracts an access record for each frame image data stored in the access record acquisition unit 60 and outputs the access record to the access record analysis unit 80.

  The access record analysis unit 80 analyzes the access record for each frame image data input from the output unit 70. Specifically, the access record analysis unit 80 performs statistical mathematical processing such as integration, average, distribution, and deviation on each of the image display time and the number of image display times of each frame image data, and extracts significant information. . Further, the access record analysis unit 80 outputs information acquired by statistical mathematical processing of each frame image data to the image display unit 50.

  Next, the operation of the three-dimensional shape display storage device 1 of the present embodiment will be described with a specific example. FIG. 6 is a flowchart for explaining the operation of the three-dimensional shape display storage device 1. FIG. 7 is a diagram showing a path of a frame image selected by the user with the mouse in the frame image data group of FIG.

  As indicated by arrows in FIG. 7, “3C” (first), “3D” (second), “3E” (third), “3F” (fourth), “4E” (fifth), “4D” (6th), “3D” (7th), “2D” (8th), “1D” (9th), “1C” (10th), “2B” (11th), “3B ”(12th),“ 3C ”(13th),“ 3D ”(14th),“ 3E ”(15th),“ 3F ”(16th),“ 3G ”(17th), and“ 2G The case where the frame image data is displayed in the order of “18th” will be described.

  For convenience of explanation, the description will be made from the point in time when the frame image data “3E” (third) is selected by the user.

  In step S <b> 1, when an instruction of frame image data “3E”, which is a still image, is input from the user apparatus 200 via the input unit 20, the image display control unit 40 sends the management unit 31 of the image management unit 30 to the management unit 31. The frame image data “3E” to be displayed next is selected, and the output of the frame image data “3E” is instructed.

  The management unit 32 to which the instruction from the image display control unit 40 is input selects and extracts the frame image data “3E” to be displayed from the storage unit 31, and outputs it to the image display control unit 40.

  In step S <b> 2, the image display control unit 40 outputs the frame image data “3E” input from the management unit 32 of the image management unit 30 in step S <b> 1 to the image display unit 50.

  In step S <b> 3, the image display control unit 40 outputs the access fact and access time of the displayed frame image data “3E” to the access record acquisition unit 60. The access record acquisition unit 60 starts creating an access record of the frame image data “3E” displayed on the image display unit 50 by the image display control unit 40. Specifically, an access record is created based on the access fact and access time of the frame image data “3E” displayed on the image display unit 50.

  Table 1 shows access facts and access times stored in the access record acquisition unit 60.

  The calculation of the display time of the frame image data will be described in detail. The access record acquisition unit 60 sets the time (year / month / day and hour / minute / second) when the display of the previous frame image data “3D” (second) on the image display unit 50 is ended in advance in the clock (not shown). When the display of the third frame image data “3E” (third) on the image display unit 50 is completed, the current time is read from the clock, and the third image is displayed from the difference between the two times. The display time of the frame image data “3E” displayed on the unit 50 is calculated.

  In step S4, the access record acquisition unit 60 stores the number of display times and the display time as the access record for the displayed frame image data “3E”.

  When Step 1 to Step 4 are executed for the displayed frame image data “3E”, the access record acquisition unit 60 increments the counter corresponding to the displayed frame image data “3E” (1 is added). ), And stored as the number of display times.

  Similarly, when step 1 to step 4 are executed for the displayed frame image data “3E”, the access record acquisition unit 60 sets the image display time in the storage area corresponding to the displayed frame image data “3E”. Store.

  Table 2 shows the number of display times and the display time stored in the access record acquisition unit 60.

  Next, in step S5, the access record acquisition unit 60 waits for an instruction input from the user.

  In step S <b> 6, the output unit 70 determines whether an end instruction is input from the user device 200. If no end instruction is input, step S1 to step S5 are repeated for the next frame image data “3F” (fourth). Thereafter, steps S1 to S6 are repeated for the frame image data “4E” (fifth) to “2G” (18th).

  On the other hand, if an end instruction is input, the process proceeds to step S7, and the access record is analyzed.

  In step S7, the output unit 70 sets the total display count and the total display time of each frame image data “3C” (first) to “2G” (18th) stored in the access record storage unit 60, respectively. The data is extracted and output to the access record analysis unit 80.

  The access record analysis unit 80 uses statistical mathematics such as average, distribution, and deviation for each of the display count and display time for each input frame image data “3C” (first) to “2G” (18th). Process and extract significant information.

  Hereinafter, an example of statistical mathematical processing will be described. Assuming that the total display count of a certain image is C, the total display time is t, and the attention level of the image is x, the relationship can be expressed as follows using a predetermined function f. .

  Next, the degree of attention x is calculated for each of all n images to obtain an arithmetic average.

  Further, a standard deviation σ is obtained.

  This standard deviation σ can also be expressed as a deviation value T as an example.

  Furthermore, if a sufficient amount of data of attention level x is collected, the standard normal distribution N is obtained.

  From these, it is possible to discard frame image data that deviates from ± 2σ from the arithmetic mean, or conversely, estimate the probability that predetermined frame image data falls within ± 1σ.

  The information obtained in step S7 is output to the image display unit 50 by the access record analysis unit 80 and displayed on the display of the user device 200. FIG. 8 is a graph showing an example of the distribution of the total number of display times of images displayed on the display of the user device 200. As can be seen from the figure, it can be seen that the image that is objectively noticed by the user is “3D” and its vicinity.

  As described above, according to the three-dimensional shape display storage device of the present embodiment, by creating a display history for each still image displayed on the user device, an object having a three-dimensional shape is represented by the display history. Since it is possible to accurately determine the angle and direction in which the user has paid attention when viewing, it is possible to obtain objective information about the portion that has attracted the user's attention.

It is a figure which shows the outline | summary of the system containing the three-dimensional shape display recording device of this embodiment. It is a block diagram which shows the functional structure of the three-dimensional shape display memory | storage device of this embodiment. It is explanatory drawing which shows the structure of the frame image data group stored in the storage part of this embodiment. It is a figure which shows an example of an imaging device. It is an example of a display of the frame image data output from the image display part of this embodiment. It is a flowchart explaining operation | movement of the three-dimensional shape display memory | storage device of this embodiment. It is a figure explaining the example of the order of selection of the frame image data of the three-dimensional shape display memory | storage device of this embodiment. 6 is a graph showing the distribution of the number of times an image is displayed on the display of the user apparatus 200.

Explanation of symbols

100: three-dimensional shape display storage device 20: input unit 30: image management unit 31: storage unit 32: management unit 40: image display control unit 50: image display unit 60: access record acquisition unit 70: output unit 80: access record Analysis part

Claims (3)

An image management unit storing a frame image data group composed of a plurality of frame image data composed of images obtained from a number of angles of a three-dimensional object;
An input unit for inputting selection of frame image data from the user device;
The selected frame image data input from the input unit is acquired from the image storage unit, and an image display control unit that outputs an access fact and access time of the selected frame image data;
Based on the access fact and access time of the selected frame image data, an access record acquisition unit that calculates a display time and a display count for each frame image data, and outputs the display time and the display count;
An access record analysis unit that performs statistical mathematical processing on the display time and the display count for each frame image data, and outputs the processing results;
A three-dimensional shape display recording device characterized by comprising:   The frame image data stored in the image storage unit is a data in which frame image data obtained by imaging a three-dimensional object at a predetermined angle interval from all directions while changing the vertical angle is arranged in a matrix. The three-dimensional shape display recording apparatus according to claim 1, wherein: The three-dimensional shape display storage device according to claim 1 or 2, wherein the frame image data stored in the image storage unit is frame image data created by computer graphics.