JP2018169714A - Image display system and image display program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily view correspondence relation between an indication part of a body and additional information associated with the part on a display screen even after a view point changes.SOLUTION: An image generation part 4 generates a body image corresponding to a view point based upon model data defining a shape of a body. An additional information storage part 3 stores additional information, input by a user, associatively with an indicated part on the body indicated by the user. An indicator generation part 6 generates an indicator indicating a display position of the indicated part corresponding to the additional information. A display processing part 7 generates a display screen having the body image, additional information and the indicator put together.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image display system and an image display program for displaying an object image corresponding to a viewpoint, and more particularly to display of additional information of an object.

  For example, Patent Document 1 discloses a structure confirmation information providing system that realizes a structure consultant and a structure description creation at the drawing stage when creating a structure consultant and a structure description related to an apparatus. In this system, safety confirmation is performed based on model information (three-dimensional model) representing a device included in design information in a drawing, and a safety confirmation result is added to the model information. As shown in FIG. 7, as the safety confirmation result, an arrow indicating that there is an indicated item is used inside the apparatus, and a sentence including a comment is added to a part of the symbol display including the arrow.

JP 2002-342391 A

  However, although the above-mentioned Patent Document 1 describes that the three-dimensional model is operated at any time to change the angle and position of examining the model, the arrow that associates the indicated part with the comment can be displaced. There is no description on how the arrows are displayed, including the presence or absence.

  Accordingly, an object of the present invention is to make it possible to easily visually recognize the correspondence between an indicated part of an object and additional information related to the part even if the viewpoint changes.

  In order to solve this problem, the first invention provides an image display system including an image generation unit, an additional information storage unit, an indicator generation unit, and a display processing unit. The image generation unit generates an object image corresponding to the viewpoint based on the model data that defines the shape of the object. The additional information storage unit stores additional information associated with the designated part on the object. The indicator generation unit is provided corresponding to the additional information, and generates an indicator indicating the display position of the indicated part that is displaced according to the viewpoint. The display processing unit generates a display screen that combines the object image, the additional information, and the indicator.

  Here, in the first invention, the indicator may be an instruction line that connects the display position of the additional information and the display position of the pointing part. The indicator generation unit generates a first indicator when the indicated part is exposed as a part of the object image, and displays the first indicator when the indicated part is not exposed as a part of the object image. Preferably, different second indicators are generated. Furthermore, it is preferable that the display position of the additional information is fixedly set regardless of the viewpoint of viewing the object.

  The second invention provides an image display program. This program performs a first step of generating an object image corresponding to the viewpoint based on the model data that defines the shape of the object, and the additional information associated with the indicated part on the object according to the viewpoint. The computer is caused to execute a process including a second step of generating an indicator indicating the display position of the designated part to be performed, and a third step of generating a display screen in which the object image, the additional information, and the indicator are combined.

  Here, in the second invention, the indicator may be an instruction line connecting the display position of the additional information and the display position of the indicated part. The second step includes a step of generating a first indicator when the pointing portion is exposed as part of the object image, and a first indicator when the pointing portion is not exposed as part of the object image. Preferably has a step of generating a second indicator having a different display form. Furthermore, it is preferable that the display position of the additional information is fixedly set regardless of the viewpoint of viewing the object.

  According to the present invention, when the pointing part on the object is displaced due to the change of the viewpoint, the indicator indicating the display position of the pointing part is also displaced following this. In this way, by causing the indicator to follow the displacement of the designated part, the user can easily visually recognize the correspondence between the additional information and the designated part from the indicator displayed on the display screen.

Block diagram of image display system Explanatory drawing of additional information associated with the indicated part Illustration of the virtual layer that forms the display screen Figure showing the display screen The figure which shows an example of the display screen which changed the viewpoint The figure which shows another example of the display screen which changed the viewpoint The figure which shows the display screen in the prior art

  FIG. 1 is a block diagram of an image display system according to the present embodiment. The image display system 1 displays a three-dimensional shape of an object corresponding to a viewpoint and also displays additional information such as comments, requests, and instructions input by a user for an arbitrary part on the object. As an application of the system 1, for example, it is assumed that the user additionally fills in the specifications of the article to be manufactured and shares information among the parties concerned. In addition, as another application of the system 1, for example, when displaying a three-dimensional shape of an object in which the specification of an article or the like is input in advance, a viewer of this display can show the correspondence between additional information and an indicated part. It is expected that it can be easily seen and distinguished.

  The image display system 1 mainly includes an additional information input unit 2, an additional information storage unit 3, an image processing unit 4, an additional information generation unit 5, an indicator generation unit 6, and a display processing unit 7. The display screen is generated based on the model data (including model data with additional information). Such an image display system 1 is typically realized by executing a predetermined computer program installed in a computer. However, an ASIC (Application Specific Integrated Circuit) or an FPGA (Field-Programmable Gate Array) is used. It may be realized in hardware.

  In this embodiment, three-dimensional model data that defines a three-dimensional shape of an object is handled as an example of “model data” that defines the shape of an object. Three-dimensional CAD data (file extensions are IGES, STEP , PARASOLID, SAT, JT, VDA, etc.), 3DCG (three-dimensional computer graphics) data, or point cloud data expressing a three-dimensional surface shape with a large number of points.

  The additional information input unit 2 receives a part (instructed part) on the object and additional information such as text data. The user designates a part on the object and inputs additional information. As shown in FIG. 2, the user instructs and inputs these pieces of information while referring to the display screen on which the object A is displayed. For example, the user designates the designated portion a1 on the upper surface of the object A with the mouse, and inputs text data such as “dimensional tolerance OO” as additional information regarding the designated portion a1. Further, the user designates the designated portion a2 on the upper surface of the object A with the mouse, and inputs text data such as “polishing accuracy OO” as additional information regarding the designated portion a2. By repeating such an instruction and input, n pieces (n ≧ 1) of additional information with designation of the display position are set for the object A displayed on the display screen. Note that the two-dimensional coordinates (display position) of the designated part on the image plane are converted into three-dimensional coordinates on the three-dimensional model data.

  The additional information storage unit 3 stores the designated part (three-dimensional coordinates) specified by the user and the additional information input by the user in association with each other. Typically, these pieces of information are stored in a form added to model data that defines the shape of the object A. The model data with additional information is stored as one file in a storage device (not shown). Note that the data in which the designated part and the additional information are associated may be managed in a file for managing additional information provided separately from the model data, on the assumption that the designated part is associated with an identifier that designates the model data.

  Based on the model data that defines the shape of the object A, the image processing unit 4 generates an object image that changes according to the viewpoint, that is, an image that three-dimensionally represents the object on a two-dimensional image plane. Thereby, among the virtual layers L1 to L3 as shown in FIG. 3, the “object image layer L1” is formed. Here, each of the virtual layers L1 to L3 has the same size as the display screen, and a display screen is generated by superimposing these layers. In the object image layer L1, a specified part a1 is converted from the three-dimensional coordinates (x1, y1, z1) defined by the model data to coordinates on the display screen, that is, display positions (X1, Y1). Further, another designated part a2 is converted from the three-dimensional coordinates (x2, y2, z2) defined by the model data to the coordinates on the display screen, that is, the display position (X2, Y2).

  The additional information generation unit 5 specifies and generates additional information to be displayed at a predetermined position on the display screen. As a result, the “additional information layer L2” shown in FIG. 3 is formed. In this additional information layer L2, the additional information 1 is set at a preset display position b1, and the additional information 2 is set at a preset display position b2. The display positions b1 and b2 may be changed by a user operation.

  The indicator generation unit 6 generates an indicator indicating the (designated display position) corresponding to the additional information. As a result, the “indicator layer L3” shown in FIG. 3 is formed. In this indicator layer L3, an indicator C1 indicating the display position (X1, Y1) of the pointing part a1 corresponding to the additional information 1 and an indicator C2 indicating the display position (X2, Y2) of the pointing part a2 corresponding to the additional information 2 And are set. Specifically, the indicator C1 is set as an instruction line that connects the display position b1 of the additional information 1 and the display position (Y1, Y2) of the instruction site a1. The indicator C2 is set as an instruction line that connects the display position b2 of the additional information 1 and the display position (X2, Y2) of the instruction site a2. The display form of the indicators C1 and C2 includes any notation (symbol) as long as the correspondence between the two can be identified, including an indication line with an arrow, an indication line without an arrow, and a block arrow. Also good.

  The display processing unit 7 combines the object image generated by the image processing unit 4, the additional information generated by the additional information generation unit 5, and the indicator generated by the indicator generation unit 6. As a result, the object image layer L1, the additional information layer L2, and the indicator layer L3 shown in FIG. 3 are overlapped to generate the display screen shown in FIG. The generated display screen (composite image) is displayed on a display device (not shown). In the present embodiment, the method of generating the display screen by superimposing the object image layer L1, the additional information layer L2, and the indicator layer L3 has been described. However, the method of generating the display screen includes the object image, Any method may be used as long as it generates a display screen in which additional information and an indicator are combined.

  FIG. 5 is a diagram showing an example of a display screen with the viewpoint changed, and shows a state where the object A displayed in FIG. 4 is rotated about the Z axis (a state where the viewpoint is rotated clockwise). The display positions of the incidental information 1 and the incidental information 2 (b1, b2 shown in FIG. 3) are independent of the viewpoint of viewing the object A in order to ensure the readability of the information. It is fixedly set without following. On the other hand, as the viewpoint changes, the display position (X1, Y1) of the designated part a1 is displaced from the state shown in FIG. 4, and the display position (X2, Y2) of the designated part a2 is also changed from the state shown in FIG. Displace. However, the indicators C1 and C2 also change so as to follow the displacement of the designated portions a1 and a2 and continue to indicate them. Therefore, the user can easily visually recognize and discriminate the correspondence between the additional information and the indicated part based on the indicators C1 and C2 displayed on the display screen.

  In addition, the indicator generator 6 determines whether or not the designated portions a1 and a2 are exposed as part of the object image, and changes the display form of the indicators C1 and C2 according to the determination result. Examples of the change in display form include a change in line type (solid line and broken line) and a change in color. In the example shown in the figure, since the designated part a1 is exposed as a part of the object A, a solid line is indicated as the indicator C1, and the designated part a2 is not exposed (hidden) as a part of the object A. The indicator C2 is indicated by a broken line (or a partial broken line). Thus, by changing the display form of the indicators C1 and C2 depending on whether or not the indicated part is exposed, the user can clearly recognize even if the indicated part a2 is hidden on the display screen.

  FIG. 6 is a diagram illustrating another example of the display screen in which the viewpoint is changed. In the example shown in the figure, the indication part a2 on the back side of the object A can be clearly recognized by displaying the object A transparent or translucent. In this case, the additional information of the designated part a2 may be displayed semi-transparently to clearly indicate that it is the back side.

  As described above, according to the present embodiment, when the pointing part on the object A is displaced due to the change of the viewpoint, the indicator indicating the display position of the pointing part is also displaced following the change. In this way, by causing the indicator to follow the displacement of the designated part, the user can easily visually recognize the correspondence between the additional information and the designated part from the indicator displayed on the display screen.

  In addition, according to the present embodiment, the user can specify any part on the object and can arbitrarily set additional information (text data or the like) related to the indicated part, so that the addition of additional information can be performed with a high degree of freedom. It can be carried out. At the same time, additional information added by a certain user can be shared with other users who exchange model data.

  In the embodiment described above, the additional information input by the user has been described as an example. However, the present invention is not limited to this, and the additional information is associated with the indicated part on the object. If it is, it may not be input by the user. For example, the service operator inputs the additional information to the designated part on the object, and then allows the user of the service to browse the model data to which the additional information is attached.

DESCRIPTION OF SYMBOLS 1 Image display system 2 Additional information input part 3 Additional information storage part 4 Image processing part 5 Additional information generation part 6 Indicator generation part 7 Display processing part

Claims (8)

In the image display system,
An image generation unit that generates an object image corresponding to a viewpoint based on model data that defines the shape of the object;
An additional information storage unit that stores additional information associated with the indicated region on the object;
An indicator generating unit that is provided corresponding to the additional information and generates an indicator that indicates a display position of the pointing portion that is displaced according to a viewpoint;
An image display system comprising: a display processing unit that generates a display screen in which the object image, the additional information, and the indicator are combined.   The image display system according to claim 1, wherein the indicator is an instruction line that connects a display position of the additional information and a display position of the pointing part.   The indicator generation unit generates a first indicator when the pointing portion is exposed as a part of the object image, and generates a first indicator when the pointing portion is not exposed as a part of the object image. The image display system according to claim 1, wherein the second indicator having a different display form is generated.   The image display system according to any one of claims 1 to 3, wherein the display position of the additional information is fixedly set regardless of a viewpoint of viewing the object. In the image display program,
A first step of generating an object image corresponding to a viewpoint based on model data defining the shape of the object;
A second step of generating an indicator indicating the display position of the indicated part that is displaced according to the viewpoint for additional information associated with the indicated part on the object;
An image display program that causes a computer to execute a process including a third step of generating a display screen obtained by combining the object image, the additional information, and the indicator.   The image display program according to claim 5, wherein the indicator is an instruction line that connects a display position of the additional information and a display position of the indicated part. The second step includes
Generating the first indicator if the pointing portion is exposed as part of the object image;
7. The method according to claim 5, further comprising: generating a second indicator having a display form different from that of the first indicator when the pointing portion is not exposed as a part of the object image. Image display program.   The image display program according to any one of claims 5 to 7, wherein the display position of the additional information is fixedly set regardless of a viewpoint of viewing the object.

Images