JP2017208070A - Information sharing system, information sharing method, terminal device, and information processing program - Google Patents

Abstract

The present invention facilitates confirmation of surrounding conditions by a plurality of users.
According to one embodiment, an information sharing system includes a management device and a plurality of terminal devices. At least the first terminal device among the plurality of terminal devices includes first position information indicating a position of the first terminal device, direction information indicating a direction of the target first terminal device, and a distance to the target. And shared information including the distance information shown. The management device obtains second position information indicating the position of the target based on the shared information acquired from the first terminal device, generates target information including the second position information, and generates the generated target information Send to terminal device.
[Selection] Figure 10

Description

  The present invention relates to an information sharing system, an information sharing method, a terminal device, and an information processing program.

  Using a mobile terminal that can be connected to the network, such as a smartphone (multi-function mobile terminal), the location information indicating your current location is obtained using GNSS (Global Navigation Satellite System), etc. A technique for superimposing on map information acquired from a network of the above is known. In such a mobile terminal, the coordinates of a specific latitude and longitude are specified, and information such as an image, text, and a link to a website is transmitted to the network together with the specified latitude and longitude information. A technique that enables information to be shared with mobile terminals is also known.

  In Patent Literature 1, based on position information and orientation information when a plurality of users capture an image of a registration target using, for example, a mobile terminal, a position where the imaging directions of the registration targets of the respective users overlap is registered as a registration target position. Techniques to do this are disclosed. According to Patent Document 1, when a plurality of users register information on the same target point in the server, it is possible to avoid information such as reviews relating to the same position from fluctuating at different positions, and information sharing by a plurality of users Becomes easy.

  In a mobile terminal having a GNSS function, position information indicating the current position can be acquired with an easy operation. On the other hand, the object that the user wants to share information with other users is generally at a distance of several meters to several tens of meters that the user is viewing, not the position where the user is currently. Therefore, for example, even if the position information is acquired by visually observing the target with a head-mounted display terminal, there is a problem that the acquired position information is different from the position information indicating the position of the target for which information is to be shared.

  On the other hand, according to Patent Document 1 described above, it is possible to specify a position several m away from a user based on position information and direction information by a plurality of users. However, in the technique of Patent Document 1, information from a plurality of mobile terminals is necessary to specify the accurate position information of the target. If there is only one user who can see the target, the position information of the target There is a problem that it is difficult to specify the location information of the target among a plurality of users.

  The present invention has been made in view of the above, and an object of the present invention is to facilitate confirmation of surrounding conditions by a plurality of users.

  In order to solve the above-described problems and achieve the object, the present invention is an information sharing system including a management device and a plurality of terminal devices, and at least the first terminal device among the plurality of terminal devices is: An acquisition unit that acquires shared information including first position information indicating a position of the first terminal device, direction information indicating a direction with respect to the target first terminal device, and distance information indicating a distance to the target. A management unit that obtains second position information indicating the position of the target based on the shared information acquired from the first terminal apparatus, and generates target information including the second position information; And a transmission unit that transmits the information to a plurality of terminal devices.

  According to the present invention, there is an effect that it is easy for a plurality of users to check surrounding conditions.

FIG. 1 is a diagram illustrating an exemplary configuration of an information sharing system according to the first embodiment. FIG. 2 is a perspective view illustrating an appearance of an example of the terminal device according to the first embodiment. FIG. 3 is a schematic diagram schematically showing a state in which the eyeglass unit in the terminal device according to the first embodiment is mounted on a person's head from the left side of the head. FIG. 4 is a diagram illustrating an example of a configuration of a display system incorporated in the eyeglass unit of the terminal device that can be applied to the first embodiment. FIG. 5 is a block diagram illustrating an example of a hardware configuration of a spectacle unit applicable to the first embodiment. FIG. 6 is a block diagram illustrating an example of a hardware configuration of the information processing unit according to the first embodiment. FIG. 7 is a functional block diagram of an example for explaining functions of the terminal device according to the first embodiment. FIG. 8 is a block diagram illustrating an example of a hardware configuration of a management server applicable to the first embodiment. FIG. 9 is an exemplary functional block diagram for explaining functions of the management server according to the first embodiment. FIG. 10 is a sequence diagram illustrating an example of processing in the information sharing system according to the first embodiment. FIG. 11 is a diagram for explaining a screen displayed on the display of the eyeglass unit included in the terminal device according to the first embodiment. FIG. 12 is a flowchart of an example showing a method for generating shared information according to the first embodiment. FIG. 13 is a diagram for schematically explaining an example of input of distance information by a gesture applicable to the first embodiment. FIG. 14 is a diagram illustrating an example of a screen on which a map image on which a marker image indicating a target is added and displayed according to the first embodiment is displayed. FIG. 15 is a diagram illustrating an example of an attribute information table that stores an attribute and information indicating an attribute in association with each other according to a modification of the first embodiment. FIG. 16 is a diagram for schematically explaining the configuration of the information sharing system according to the second embodiment. FIG. 17 is a block diagram illustrating a configuration example of an information processing unit included in a terminal device applicable to the second embodiment. FIG. 18 is a block diagram illustrating an example of a hardware configuration of a commander terminal according to the second embodiment. FIG. 19 is a functional block diagram for explaining functions of the commander terminal according to the second embodiment. FIG. 20 is a functional block diagram illustrating an example of functions of the management server applicable to the second embodiment. FIG. 21 is a diagram illustrating an example of a screen displayed on the display of the terminal device according to the second embodiment. FIG. 22 is a diagram illustrating an example of a screen displayed on the display of the terminal device according to the second embodiment. FIG. 23 is a diagram illustrating an example of a screen displayed on the display of the commander terminal according to the second embodiment. FIG. 24 is a diagram illustrating an example of a screen when a desired position on a map image is designated on the commander terminal according to the first modification of the second embodiment. FIG. 25 is a diagram illustrating an example in which a marker image indicating a target is superimposed on a map image on a screen of a commander terminal according to a second modification of the second embodiment. FIG. 26 is a diagram illustrating an example of a screen displayed on the display of the terminal device when a desired position is designated on the commander terminal according to the third modification of the second embodiment. FIG. 27 is a diagram illustrating an example of a screen on which an arbitrary message transmitted from the commander terminal is displayed according to a fourth modification of the second embodiment. FIG. 28 is a perspective view illustrating an appearance of an example of a terminal device according to the third embodiment. FIG. 29 is a diagram illustrating a mounting example of the spectacles unit on the head in the terminal device according to the third embodiment. FIG. 30 is a diagram illustrating an example of a configuration of a display system built in the eyeglass unit according to the third embodiment. FIG. 31 is a diagram illustrating a configuration of an example of a dimming filter applicable to the third embodiment. FIG. 32 is a diagram illustrating a configuration example of a spectacle unit including an illuminance sensor according to the third embodiment. FIG. 33 is a block diagram illustrating an example of a hardware configuration of the eyeglass unit according to the third embodiment. FIG. 34 is a functional block diagram illustrating an example of functions of the eyeglass unit according to the third embodiment. FIG. 35 is a diagram illustrating an example of a change in transmittance of a light control filter applicable to the third embodiment. FIG. 36 is a diagram illustrating a configuration of an example of an information sharing system according to the fourth embodiment. FIG. 37 is a perspective view illustrating an appearance of an example of a terminal device according to the fourth embodiment. FIG. 38 is a block diagram illustrating an example of a hardware configuration of a spectacle unit from which a camera is omitted. FIG. 39 is a block diagram illustrating an example of a hardware configuration of an information processing unit applicable to the fourth embodiment. FIG. 40 is a functional block diagram illustrating an example of functions of the terminal device according to the fourth embodiment. FIG. 41 is a sequence diagram illustrating an example of processing in the information sharing system according to the fourth embodiment. FIG. 42 is a diagram more specifically showing an example of a screen of the terminal device according to the fourth embodiment. FIG. 43 is a flowchart of an example showing more specifically the position marker display processing by each terminal device according to the fourth embodiment. FIG. 44 is a diagram for explaining display control according to the movement of the head around the vertical axis according to the fourth embodiment. FIG. 45 is a diagram for explaining display control according to the movement of the head around the horizontal axis according to the fourth embodiment. FIG. 46 is a diagram for explaining display control according to the movement of the head around the longitudinal axis according to the fourth embodiment. FIG. 47 is a diagram for explaining label display control according to the fourth embodiment. FIG. 48 is a flowchart illustrating an example of label display processing according to the fourth embodiment. FIG. 49 is a diagram for explaining switching of information display on the screen according to the state of the user wearing the terminal device, which can be applied to the fourth embodiment. FIG. 50 is a diagram for explaining walking state detection by the terminal device according to the fourth embodiment. FIG. 51 is a diagram showing an example of display on the screen of the commander terminal applicable to the fourth embodiment. FIG. 52 is a diagram illustrating an example of a display method of command information in the terminal device according to the fourth embodiment.

  Exemplary embodiments of an information sharing system, an information sharing method, a terminal device, and an information processing program will be described below in detail with reference to the accompanying drawings.

(First embodiment)
FIG. 1 shows an exemplary configuration of an information sharing system according to the first embodiment. The information sharing system shown in FIG. 1 includes a plurality of terminal devices 10a, 10b, 10c and 30 used by users A, B, C and D, respectively, and a management server 40A. The terminal devices 10a, 10b, 10c and 30 and the management server 40A are communicably connected to each other via the network 50. The network 50 is, for example, the Internet. Not limited to this, the network 50 may be a LAN (Local Area Network).

  In the example of FIG. 1, the terminal devices 10a, 10b, and 10c are small, lightweight, and easy to carry mobile terminals, and include eyeglass-type devices that are used by wearing them like glasses on a human head. Although details will be described later, the spectacle-type device is capable of displaying an image using the lens portion of the spectacles as a display, and is also called a head-mounted display. The terminal devices 10a, 10b, and 10c can be connected to the network 50 through wireless communication. Furthermore, in the example of FIG. 1, the terminal device 30 is a non-mobile terminal used on a desk or the like, for example, and is a general computer. The terminal device 30 is connected to the network 50 by, for example, wired communication. However, the terminal device 30 may be connected to the network 50 by wireless communication.

  The management server 40A is a server device having a configuration equivalent to a general computer, and the terminal devices 10a, 10b, 10c, and 30 communicate with each other via the management server 40A.

  At least one of the terminal devices 10a, 10b, and 10c, which is a glasses-type device, corresponds to the GNSS (Global Navigation Satellite System), receives a signal transmitted from the satellite 60 by the GNSS, and based on the received signal, Position information indicating the position of the apparatus can be acquired. For example, the terminal device 10a can transmit the acquired position information to the management server 40A together with identification information for identifying the terminal device 10a. For example, the management server 40A can transmit the position information and the identification information transmitted from the terminal device 10a to the other terminal devices 10b, 10c, and 30.

  On the display of each terminal device 10a, 10b and 10c, for example, a screen 70 including a map image and position information indicating the position of the terminal device 10a can be displayed. Similarly, the terminal device 30 can display a screen 71 including a map image and position information indicating the position of the terminal device 10a.

  In the example of FIG. 1, the information sharing system is illustrated as including four terminal devices 10a, 10b, 10c, and 30, but this is not limited to this example. The information sharing system only needs to include at least two terminal devices, at least one of which is the glasses-type device according to the first embodiment.

  Examples of configurations of the terminal devices 10a, 10b, and 10c as eyeglass-type devices applicable to the first embodiment will be described with reference to FIGS. FIG. 2 is a perspective view illustrating an appearance of an example of the terminal device 10 corresponding to each of the terminal devices 10a, 10b, and 10c according to the first embodiment. In the following description, the terminal devices 10a, 10b, and 10c are represented by the terminal device 10 when there is no need to particularly distinguish the terminal devices 10a, 10b, and 10c.

  In FIG. 2, the terminal device 10 includes a spectacle unit 1A as a spectacle-type device constituted by a front 11A and a temple 12 provided approximately symmetrically on the left and right, and a spectacle unit 1A via a cable 21. Information processing unit 20A to be connected. The spectacles unit 1A is a head-mounted display device that is mounted on the user's head and projects an image on the user's eyeball and its surroundings.

  In the spectacle unit 1A, the front 11A can be constituted by, for example, a transmissive light guide plate 2. The temple 12 includes a display system, a 9-axis sensor 22, a camera 23, and a configuration for controlling them. An operation unit 24 for receiving a predetermined user operation on the terminal device 10 is provided on the side surface of the temple 12. The operation unit 24 may be a switch that operates by pressing or the like, or may be a touch pad that operates by touching with a finger or the like.

  The information processing unit 20 </ b> A includes a power supply unit for supplying power to the eyeglass unit 1 </ b> A and an information processing unit that processes information transmitted / received via the eyeglass unit 1 </ b> A and the cable 21. In FIG. 2, the terminal device 10 is illustrated as a configuration in which the spectacle unit 1A and the information processing unit 20A are separated, but this is not limited to this example. That is, the information processing unit 20A can be configured to be small and can be built in the temple 12 of the eyeglass unit 1A.

  FIG. 3 schematically shows a state in which the eyeglass unit 1A in the terminal device 10 shown in FIG. As described above, the spectacles unit 1A is used by being mounted on the head 80 so that the outside can be seen through the light guide plate 2 from both eyes (only the left eye 80L is shown in FIG. 3). In other words, light from outside enters the eyeball through the light guide plate 2.

  In the eyeglass unit 1A, the camera 23 is provided in the eyeglass unit 1A so as to take an image in the same direction as the line of sight of the front when the eyeglass unit 1A is correctly attached to the head 80.

  Here, the spectacles unit 1A is assumed to be attached to the head 80 by the vines hung on both ears of the user as in the case of normal spectacles, but this is not limited to this example. For example, the spectacle unit 1A may have a shape in which the front 11A is attached to a heel portion of a hat or a helmet, or a shape in which the front 11A protrudes from a headphone-like pattern. Moreover, although the spectacles unit 1A has the type seen with one eye and the type seen with both eyes, any one may be applied.

  FIG. 4 shows an example of the configuration of a display system incorporated in the front 11A and the temple 12 of the eyeglass unit 1A of the terminal device 10 that can be applied to the first embodiment. FIG. 4 shows the configuration of the front 11A and the temple 12 on the left eye side of the eyeglass unit 1A. The configurations of the front 11A and the temple 12 on the right eye side can be realized by a configuration symmetrical to that of FIG.

  In FIG. 4, the display system included in the front 11 </ b> A and the temple 12 includes a display element 3, a light source 4, and an optical unit 5. The optical unit 5 includes a lens unit 6 composed of one or more lenses, and a mirror 7 that totally reflects light incident from the lens unit 6. The light guide plate 2 includes a half mirror 8 formed as a concave mirror.

  The display element 3 includes, for example, a light modulation element that modulates light from the light source 4 for each pixel according to an image. The display element 3 may further include color filters of R (red), G (green), and B (blue) colors. Video light obtained by modulating light from the light source 4 according to an image is converted into parallel light by the lens unit 6 and reflected by the mirror 7 in the direction of the light guide plate 2. The image light reflected by the mirror 7 is further reflected by the reflecting surface provided inside the light guide plate 2, passes through the light guide plate 2, and enters the half mirror 8. The half mirror 8 reflects incident video light toward the left eye 80L. The image light reflected by the half mirror 8 and the external light transmitted through the half mirror 8 are combined and incident on the left eye 80L.

  As described above, the half mirror 8 projects the image light in which the light of the light source 4 is modulated by the display element 3 according to the image. Hereinafter, unless otherwise specified, the half mirror 8 will be described as a display in the spectacle unit 1A.

  FIG. 5 shows an example of the hardware configuration of the eyeglass unit 1A applicable to the first embodiment. The eyeglass unit 1A includes the display element 3, the 9-axis sensor 22, the camera 23, and the operation unit 24, a CPU (Central Processing Unit) 1000, a memory 1001, a data interface (I / F) 1002, and a display element drive. Circuit 1003.

  The memory 1001 includes, for example, a ROM (Read Only Memory) area and a RAM (Random Access Memory) area. The CPU 1000 controls the overall operation of the eyeglass unit 1A using the RAM area as a work memory in accordance with a program stored in advance in the ROM area of the memory 1001.

  The data I / F 1002 is connected to the cable 21 and transmits / receives data to / from the information processing unit 20A via the cable 21. For example, when power is supplied from the information processing unit 20A via the cable 21, the data I / F 1002 supplies the supplied power to each unit of the spectacle unit 1A.

  The display element driving circuit 1003 generates a display driving signal for driving the display element 3 in accordance with the display control signal generated by the CPU 1000 according to the image. The display element driving circuit 1003 supplies the generated display driving signal to the display element 3. The display element 3 is driven by a display drive signal supplied from the display element drive circuit 1003, and modulates light from the light source 4 for each pixel according to an image.

  In FIG. 5, the 9-axis sensor 22 includes a gyro sensor (angular velocity sensor), an acceleration sensor, and a geomagnetic sensor that perform detection on three axes of x, y, and z, respectively. Based on the detection output of the geomagnetic sensor of the 9-axis sensor 22 incorporated in the spectacle unit 1A, the direction in which the front 11A of the spectacle unit 1A is facing, for example, can be detected with high accuracy. Further, based on the detection outputs of the 9-axis sensor 22 from the gyro sensor and the acceleration sensor, the angle of the spectacle unit 1A relative to the horizontal can be detected with high accuracy.

  Therefore, based on the detection output of the 9-axis sensor 22, the direction (posture) including the direction of the spectacle unit 1A can be detected with high accuracy. In other words, it can be said that the direction of the line of sight of the user through the front 11A of the spectacle unit 1A can be measured.

  The camera 23 can capture a moving image, and outputs a captured image at a predetermined frame rate such as 60 fps (frame per second). However, the present invention is not limited to this, and the camera 23 may capture a still image.

  FIG. 6 shows an example of the hardware configuration of the information processing unit 20A according to the first embodiment. In FIG. 6, the information processing unit 20A includes a CPU 2000, a ROM 2001, a RAM 2002, a storage 2003, a GNSS unit 2004, a power supply unit 2005, a data I / F 2006, a communication I / F 2007, and a voice I / F 2008. And an audio / image analysis unit 2009, and these units are communicably connected to each other via a bus 2020.

  As the storage 2003, a nonvolatile semiconductor memory such as a flash memory can be used. Not limited to this, a hard disk drive may be applied as the storage 2003. The CPU 2000 controls the overall operation of the information processing unit 20A using the RAM 2002 as a work memory in accordance with a program stored in advance in the ROM 2001 or the storage 2003.

  The GNSS unit 2004 corresponds to the GNSS, receives radio waves from the satellite 60 by the GNSS, and acquires position information indicating the current position based on information included in the received radio waves. For example, the GNSS unit 2004 acquires position information as latitude and longitude information. The GNSS unit 2004 can acquire time information indicating the current time together with the position information.

  The power supply unit 2005 supplies power to each unit of the information processing unit 20A using, for example, a battery. In addition, the power supply unit 2005 supplies power to the data I / F 2006 for supply to the eyeglass unit 1A via the cable 21.

  The data I / F 2006 is connected to the data I / F 1002 of the spectacle unit 1A via the cable 21 and transmits / receives data to / from the spectacle unit 1A. The data I / Fs 1002 and 2006 may be based on a general-purpose standard such as USB (Universal Serial Bus) or may be an original method.

  A communication I / F 2007 communicates with the network 50 by wireless communication. The audio I / F 2008 inputs and outputs audio signals. For example, the audio I / F 2008 includes an ADC (Analog to Digital Converter), and converts an analog audio signal supplied from a microphone (MIC) 2030 or the like into a digital audio signal. The audio I / F 2008 includes a DAC (Digital to Analog Converter), converts the supplied digital audio signal into an analog audio signal, and outputs the analog audio signal.

  The sound / image analysis unit 2009 performs sound signal analysis and image analysis. For example, the sound / image analysis unit 2009 analyzes the supplied sound signal and detects a specific word included in the sound signal. Further, for example, the sound / image analysis unit 2009 analyzes the supplied image, detects a specific object included in the image, and detects a specific movement of the detected object.

  FIG. 7 is an exemplary functional block diagram for explaining functions of the terminal device 10 according to the first embodiment. In FIG. 7, the eyeglass unit 1 </ b> A includes a display information input unit 100, a display control unit 101, a 9-axis detection unit 102, a detection information output unit 103, an imaging control unit 104, and an image information output unit 105. .

  The display information input unit 100, the display control unit 101, the 9-axis detection unit 102, the detection information output unit 103, the imaging control unit 104, and the image information output unit 105 are realized by a program that operates on the CPU 1000. Not limited to this, some or all of the display information input unit 100, the display control unit 101, the nine-axis detection unit 102, the detection information output unit 103, the imaging control unit 104, and the image information output unit 105 cooperate with each other. It may be configured by a hardware circuit that operates.

  The display information input unit 100 receives display information supplied from the information processing unit 20A to the eyeglass unit 1A via the cable 21 and displayed on the display element 3. The display control unit 101 generates a display control signal for controlling the display by the display element 3 based on the display information input to the display information input unit 100. The 9-axis detection unit 102 converts each sensor output of the gyro sensor, acceleration sensor, and geomagnetic sensor by the 9-axis sensor 22 into digital data. The detection information output unit 103 transmits each sensor output of the 9-axis sensor 22 converted into digital data by the 9-axis detection unit 102 from the data I / F 1002.

  The imaging control unit 104 controls the imaging operation of the camera 23 according to an instruction from the CPU 1000, for example, and acquires a captured image output from the camera 23. The imaging control unit 104 can acquire captured images output from the camera 23 at predetermined time intervals as moving images. For example, the imaging control unit 104 may acquire a captured image as a still image at a timing according to an operation on the operation unit 24 of the spectacles unit 1A. The image information output unit 105 transmits the captured image acquired by the imaging control unit 104 from the data I / F 1002.

  In FIG. 7, the information processing unit 20A includes a receiving unit 200, a transmitting unit 201, a position information acquiring unit 202, a shared information generating unit 203, a display information generating unit 204, an input processing unit 205, and a detection information input. Unit 206, head movement detection unit 207, and display information output unit 208.

  These receiving unit 200, transmitting unit 201, position information acquiring unit 202, shared information generating unit 203, display information generating unit 204, input processing unit 205, detection information input unit 206, head movement detection unit 207, and display information output unit 208 Is realized by a program operating on the CPU 2000. Not limited to this, the reception unit 200, the transmission unit 201, the position information acquisition unit 202, the shared information generation unit 203, the display information generation unit 204, the input processing unit 205, the detection information input unit 206, the head movement detection unit 207, and the display A part and all of the information output unit 208 may be configured by a hardware circuit that operates in cooperation with each other.

  The receiving unit 200 receives information transmitted from the management server 40A via the network 50, for example. The receiving unit 200 passes the received information to the display information generation control unit 204. The transmission unit 201 transmits the shared information generated by the shared information generation unit 203, which will be described later, to the management server 40A via the network 50, for example. The shared information is information for sharing among the terminal devices 10a, 10b, 10c, and 30, for example.

  The location information acquisition unit 202 controls the GNSS unit 2004 to acquire the current location using GNSS. The position information acquisition unit 202 may acquire time information indicating the current time together with the position information by GNSS. The position information acquisition unit 202 passes the acquired position information indicating the current position to the shared information generation unit 203 and the display information generation unit 204.

  The input processing unit 205 analyzes the captured image output from the image information output unit 105 and passes the analysis result to the shared information generation unit 203. For example, when the input processing unit 205 detects a specific gesture or the like from the captured image by analyzing the captured image, the input processing unit 205 outputs information associated with the gesture in advance as an analysis result.

  In addition, for example, a digital audio signal can be input to the input processing unit 205 as audio information. The input processing unit 205 analyzes the input voice information and passes the analysis result to the shared information generation unit 203. For example, when a specific word or the like is detected from the voice information by analyzing the voice information, the input processing unit 205 outputs information associated with the word in advance as an analysis result.

  In the first embodiment, it is assumed that distance information indicating the distance to the observation target of the user of the terminal device 10 is input by gesture or voice. The input processing unit 205 outputs distance information input by the gesture or voice information as the analysis result of the gesture or voice information.

  The detection information input unit 206 functions as an input interface for each sensor output of the 9-axis sensor 22 output from the detection information output unit 103, and outputs each sensor output input from the 9-axis sensor 22 to the head movement detection unit 207. hand over. The head movement detection unit 207 sequentially analyzes each sensor output of the 9-axis sensor 22 passed from the detection information input unit 206, and detects the movement of the eyeglass unit 1A attached to the head 80.

  For example, the head movement detection unit 207 analyzes the output of the geomagnetic sensor among the sensor outputs passed from the detection information input unit 206, and calculates the direction in which the front 11A of the eyeglass unit 1A is facing. Further, the head movement detection unit 207 can calculate the inclination of the front 11A with respect to the vertical direction based on the output of the acceleration sensor among the outputs of the sensors in parallel with the calculation of the direction based on the output of the geomagnetic sensor.

  The head movement detection unit 207 can obtain posture information indicating the posture of the spectacle unit 1A as three-dimensional information by calculating the direction in which the front 11A is facing and the inclination of the front 11A. Thereby, the direction of the user's line of sight via the front 11A of the spectacle unit 1A can be measured with high accuracy. The head movement detection unit 207 passes the acquired posture information indicating the posture of the eyeglass unit 1 </ b> A to the shared information generation unit 203.

  The shared information generation unit 203 analyzes the positional information passed from the positional information acquisition unit 202, the posture information passed from the head movement detection unit 207, and the analysis result of the captured image or audio information passed from the input processing unit 205. Are entered. The shared information generation unit 203 generates shared information based on the position information, the posture information, and the analysis result. The shared information generation unit 203 passes the generated shared information to the transmission unit 201.

  Thus, the shared information is acquired by the position information acquisition unit 202, the shared information generation unit 203, the input processing unit 205, the detection information input unit 206, and the head movement detection unit 207 in the information processing unit 20A. An acquisition unit is configured.

  The display information generation unit 204 generates display information to be displayed on the display element 3 based on the position information and time information passed from the position information acquisition unit 202 and the information passed from the reception unit 200. For example, the display information generation unit 204 includes a video memory having a capacity corresponding to at least the number of pixels of the display element 3, and writes and draws pixel information to the video memory according to the generated display information. Display information generated by the display information generation unit 204 is transmitted to the eyeglass unit 1A via the display information output unit 208 and input to the display information input unit 100.

  An information processing program for realizing each function of the information processing unit 20A according to the first embodiment is a file in an installable format or an executable format, which is a CD (Compact Disk), a flexible disk (FD), a DVD ( Provided on a computer-readable recording medium such as Digital Versatile Disk). However, the present invention is not limited thereto, and the information processing program may be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. The information processing program may be provided or distributed via a network such as the Internet.

  The information processing program includes the above-described units (reception unit 200, transmission unit 201, position information acquisition unit 202, shared information generation unit 203, display information generation unit 204, input processing unit 205, detection information input unit 206, head movement detection. Module 207 and display information output unit 208). As actual hardware, the CPU 2000 reads the information processing program from a storage medium such as the storage 2003 and executes the information processing program, whereby the above-described units are loaded onto the main storage device such as the RAM 2002, and the reception unit 200 and the transmission unit 201 are loaded. The position information acquisition unit 202, the shared information generation unit 203, the display information generation unit 204, the input processing unit 205, the detection information input unit 206, the head movement detection unit 207, and the display information output unit 208 are generated on the main storage device. It has become so.

  FIG. 8 shows an example of the hardware configuration of the management server 40A applicable to the first embodiment. The management server 40A can apply the same configuration as a general server device. For example, as illustrated in FIG. 8, the management server 40A includes a CPU 4000, a ROM 4001, a RAM 4002, a storage 4003, and a communication I / F 4004, and these units are connected to each other via a bus 4010 so as to communicate with each other.

  The storage 4003 is a storage medium that stores information in a nonvolatile manner, and a hard disk drive can be applied. For example, a non-volatile semiconductor memory such as a flash memory may be used as the storage 4003. The CPU 4000 controls the overall operation of the management server 40A using the RAM 4002 as a work memory according to a program stored in the ROM 4001 or the storage 4003 in advance. The communication I / F 4004 performs communication via the network 50.

  FIG. 9 is a functional block diagram illustrating an example of the function of the management server 40A according to the first embodiment. In FIG. 9, the management server 40 </ b> A includes a reception unit 400, a shared information acquisition unit 401, a map information acquisition unit 402, a position calculation unit 403, an attribute information storage unit 404, and a transmission unit 405. The reception unit 400, the shared information acquisition unit 401, the map information acquisition unit 402, the position calculation unit 403, and the transmission unit 405 are realized by a program that operates on the CPU 4000. The attribute information storage unit 404 is formed in a predetermined area on the storage 4003, for example.

  Not limited to this, a part or all of the receiving unit 400, the shared information acquiring unit 401, the map information acquiring unit 402, the position calculating unit 403, and the transmitting unit 405 are configured by hardware circuits that operate in cooperation with each other. May be.

  The receiving unit 400 receives information transmitted via the network 50. The transmission unit 405 transmits information to the network 50. The shared information acquisition unit 401 acquires the shared information when the information received by the receiving unit 400 includes the above-described shared information.

  The map information acquisition unit 402 acquires map information via the network 50, for example. The map information acquisition unit 402 can acquire map information using a map information providing service provided via the network 50. Not limited to this, map information may be stored in advance in the storage 4003 or the like in the management server 40A, and the map information acquisition unit 402 may acquire the map information stored in the management server 40A.

  The position calculation unit 403 calculates position information indicating the target position based on the shared information acquired by the shared information acquisition unit 401. The attribute information storage unit 404 stores an attribute information table in which attribute information indicating a target attribute is associated with a marker image representing the attribute.

  In such a configuration, for example, the user A wears the terminal device 10a on the head 80 and faces the direction of the observation target. Thereby, the user A can visually observe the target through the front 11A of the eyeglass unit 1A in the terminal device 10a. The terminal device 10a sequentially executes acquisition of position information by the position information acquisition unit 202 and acquisition of posture information by the head movement detection unit 207, and the acquired position information and posture information, and the terminal device 10a. The shared information including the identification information for identifying is transmitted to the management server 40A via the network 50.

  The management server 40A receives the shared information transmitted from the terminal device 10a. The management server 40A acquires map information including the position indicated by the position information, for example, based on the position information included in the received shared information by the map information acquisition unit 402. The management server 40 </ b> A transmits map information, position information, and attitude information to the terminal devices 10 b, 10 c, and 30 via the network 50 by the transmission unit 405.

  The terminal devices 10b, 10c, and 30 receive map information, position information, and posture information transmitted from the management server 40A. The terminal devices 10b, 10c, and 30 superimpose a predetermined image indicating the terminal device 10a on the position corresponding to the position information on the map image based on the map information in accordance with the received position information. Further, the terminal devices 10b, 10c, and 30 can display the direction in which the front 11A of the terminal device 10a is facing (that is, the direction that the user A is viewing) according to the direction information included in the received posture information. .

  Thus, in each terminal device 10b, 10c, and 30, it is possible to share the position of the terminal device 10a and the direction that the user A is viewing.

  In the terminal device 10a, the position information acquired by the position information acquisition unit 202 and the posture information acquired by the head movement detection unit 207 can be processed inside the terminal device 10a. Therefore, the terminal device 10a does not use the information transmitted from the management server 40A to display the position of the device itself and the direction in which the device is facing (the direction in which the front 11A of the glasses unit 1A is facing). In addition, it can be executed by the information acquired in the terminal device 10a.

  Furthermore, the terminal device 10a can analyze the gesture and voice input by the user A by the input processing unit 205, and can acquire distance information indicating the distance to the target. The terminal device 10a transmits the acquired distance information to the management server 40A together with the above-described position information, posture information, and identification information. The management server 40A calculates the target position by the position calculation unit 403 based on the position indicated by the position information transmitted from the terminal device 10a, the direction (attitude) indicated by the attitude information at the position, and the distance information. To do. The target position is calculated as coordinate information using, for example, latitude and longitude.

  The management server 40A uses the position information calculated by the position calculation unit 403 as target information indicating the target, together with the map information and the position information and orientation information regarding the terminal device 10a, by the transmission unit 405 via the network 50. Transmit to devices 10b, 10c and 30. In addition, the management server 40A can acquire a marker image from the attribute information storage unit 404 and transmit it to the terminal devices 10b, 10c, and 30 together with the information. Thus, the position calculation unit 403 functions as a generation unit that generates target information.

  Each terminal device 10b, 10c, and 30 is located at a position corresponding to the position information on the map image based on the map information based on the map information, the position information, and the posture information transmitted from the management server 40A in the same manner as described above. Then, a predetermined image showing the terminal device 10a is superimposed. Further, each terminal device 10b, 10c, and 30 superimposes a predetermined marker image indicating a target at a position corresponding to the target information on a map image based on the map information, based on the target information transmitted from the management server 40A. Let When a marker image is transmitted from the management server 40A, this marker image can be used. Thereby, in the terminal devices 10b, 10c, and 30, the target position can be shared.

  FIG. 10 is a sequence diagram illustrating an example of processing in the information sharing system according to the first embodiment. In FIG. 10, the same reference numerals are given to the same parts as those in FIG. 1 described above, and detailed description thereof is omitted. In FIG. 10, the terminal device 10 a is illustrated as “terminal device A”, and the terminal device 10 b is illustrated as “terminal device B”.

  Further, it is assumed that the terminal device 10a transmits shared information including target information, and the terminal device 10b receives the shared information generated by the management server 40A based on the shared information. In this case, the other terminal devices 10c and 30 connected to the information sharing system can execute processes similar to those of the terminal device 10b in parallel with each other. Hereinafter, the terminal devices 10b, 10c, and 30 will be described by using the terminal device 10b as a representative.

  First, in step S10 and step S30, the terminal devices 10a and 10b each establish a session with the management server 40A. As a result, the terminal devices 10a and 10b can communicate with the management server 40A via the network 50, respectively.

  When the terminal device 10a becomes communicable with the management server 40A, the position information acquisition unit 202 included in the terminal device 10a causes the position information indicating the position of the terminal device 10a itself and the glasses unit 1A (front 11A) of the terminal device 10a. ) Is acquired (step S11). The terminal device 10a may further acquire time information indicating the current time. Similarly, the terminal device 10b acquires position information and direction information (step S31).

  Thereafter, unless otherwise specified, the position information and direction information are collectively referred to as position / direction information, the position / direction information acquired by the terminal device 10a is the position / direction information A, and the position / direction information acquired by the terminal device 10b is The position / direction information B will be described.

  In the example of FIG. 10, the position / direction information acquisition processing in step S11 and step S31 is shown to be executed after the session establishment in step S10 and step S30, but this is not limited to this example. That is, the terminal devices 10a and 10b can acquire position / direction information regardless of whether or not a session is established with the management server 40A.

  In the above description, for example, the terminal device 10a has been described as acquiring position information using GNSS, but this is not limited to this example. For example, the terminal device 10a can acquire position information based on a beacon signal transmitted indoors or the like by a wireless LAN or the like.

  On the other hand, the management server 40A acquires map information by the map information acquisition unit 402 (step S20). For example, in the management server 40A, map information in a predetermined range is stored in advance in the storage 4003 or the like, and the map information acquisition unit 402 acquires the stored map information. When map information is acquired by the map information providing service via the network 50, the management server 40A acquires a predetermined range of map information from, for example, the map information providing service. The range of the map information to be acquired is set in advance by predicting the location of the terminal devices 10a and 10b.

  When the terminal device 10a acquires the position / direction information A in step S11, the terminal device 10a transmits the acquired position / direction information A and identification information for identifying the terminal device 10a to the management server 40A (step S12). Similarly, when the terminal device 10b acquires the position / direction information B in step S31, the terminal device 10b transmits the acquired position / direction information B and identification information for identifying the terminal device 10b to the management server 40A (step S32). ).

  When the management server 40A receives the position / direction information A transmitted from the terminal device 10a in step S12, the management server 40A transmits the map information and the position / direction information A to the terminal device 10b (step S22). In addition, when the management server 40A receives the position / direction information B transmitted from the terminal device 10b in step S32, the management server 40A transmits the map information and the position / direction information B to the terminal device 10a (step S21).

  Upon receiving the map information and the position / direction information B from the management server 40A, the terminal device 10a uses the display information generation unit 204 based on the position / direction information B and the position / direction information A acquired by the terminal device 10a itself. The range displayed on the map image is adjusted based on the map information (step S13). For example, the display information generation unit 204 has the range centered on the position indicated by the position information included in the position / direction information A and includes the position indicated by the position information included in the position / direction information B. adjust.

  Based on the map information, the terminal device 10a generates a map image of the range adjusted in step S13 by the display information generation unit 204, and the position / direction information A and B included in the generated map image, respectively. Predetermined marker images indicating the terminal devices 10a and 10b are superimposed on the positions indicated by the information. This marker image is stored in advance by the display information generation unit 204, for example. The terminal device 10a displays the map image on which the marker image is superimposed on the display of the spectacle unit 1A included in the terminal device 10a (step S14).

  Similarly, when the terminal device 10b receives the map information and the position / direction information A from the management server 40A, for example, based on the position / direction information A and the position / direction information B acquired by the terminal device 10b itself, The range displayed on the map image is adjusted based on the map information so that the position shown in the position information included in the position / direction information A is included with the position indicated in the position information included in the direction information B as the center. (Step S33).

  The terminal device 10b creates a map image in the range adjusted in step S33, and at each position indicated by the position information included in the position / direction information B and A with respect to the generated map image, the terminal device 10b. And 10a are respectively superimposed. The terminal device 10b displays the map image on which the marker image is displayed on the display of the spectacle unit 1A provided in the terminal device 10b (step S34).

  A screen displayed on the display of the spectacle unit 1A included in the terminal device 10a according to the first embodiment will be described with reference to FIG. As illustrated in FIG. 11A, it is assumed that the user A is wearing the eyeglass unit 1A of the terminal device 10a on the head and is viewing the target 500.

  FIG.11 (b) shows the example of the screen displayed on the display of the spectacles unit 1A with which the terminal device 10a is provided in this case. In FIG. 11B, the screen 70 displayed on the display includes a map image 700. In the map image 700, a self-device marker 702 that is a marker image indicating the self-device (terminal device 10a) is superimposed and displayed at a position corresponding to the position information acquired by the position information acquisition unit 202. At this time, the self-device marker 702 is displayed so as to indicate the direction in which the eyeglass unit 1A is directed in accordance with the direction information detected by the head movement detection unit 207.

  In the map image 700, a marker image 703b indicating the terminal device 10b and identification information for identifying the terminal device 10b are superimposed and displayed at a position corresponding to the position information included in the position / direction information B. In this example, the user name (user B) who uses the terminal device 10b is used as the identification information of the terminal device 10b. Similarly, for the terminal device 10c, a marker image 703c indicating the terminal device 10c at a position corresponding to the position information included in the position / direction information of the terminal device 10c, and identification information (user C) identifying the terminal device 10c, Are superimposed and displayed.

  For the terminal device 30 that is a non-mobile terminal, if the terminal device 30 can acquire its own location information, the map image 700 corresponding to the position of the terminal device 30 is the same as the terminal devices 10b and 10c that are mobile terminals. The marker image 703d can be displayed superimposed on the upper position.

  Further, the user A can further display a captured image captured by the camera 23 of the terminal device 10a on the screen 70. In the example of FIG. 11B, an image 701 based on the captured image is displayed on the screen 70 with a part thereof superimposed on the map image 700. In step S12, the captured image is transmitted to the management server 40A together with the position / direction information A and the identification information, so that the image 701 can be displayed on the screen 70 of each of the terminal devices 10b and 10c. Similarly, the image 701 can be displayed on the screen 71 of the terminal device 30.

  In addition, the process of step S11-step S14 in the terminal device 10a mentioned above, the process of step S31-step S34 in the terminal device 10b, and the process of step S21 and step S22 in the management server 40A are respectively performed for a predetermined time, for example. It is executed repeatedly at intervals.

  Returning to FIG. 10, the terminal device 10 a generates shared information by the shared information generation unit 203 when, for example, the user A gives an instruction to start sharing information to share the target information with the terminal device 10 b. (Step S15). The terminal device 10a transmits the generated shared information to the management server 40A (step S16).

  More specifically, the shared information generation unit 203 acquires the direction information detected by the head movement detection unit 207 and the position information acquired by the position information acquisition unit 202. Furthermore, the shared information generation unit 203 acquires distance information indicating the distance from the user A to the target by a method described later. The shared information generation unit 203 generates shared information including the acquired direction information, position information, and distance information (step S15), and acquires shared information. The terminal device 10a transmits the shared information acquired by the shared information generation unit 203 to the management server 40A (step S16).

  In step S23, the management server 40A receives the shared information transmitted from the terminal device 10a, and obtains the position of the target 500 based on the received shared information. More specifically, the management server 40A uses the position information and direction information of the user A included in the shared information and distance information indicating the distance from the user A to the target 500 as latitude information of the target 500. And calculate longitude.

  Based on the position information and direction information at the reference position, and the distance information from the reference position to the object in the direction indicated by the direction information, for example, Vincenty's formula or Hubeny's formula is used as a method for obtaining the latitude and longitude of the target. The calculation method used is known.

  The management server 40A transmits the target information including the position information indicating the position of the target 500 as the shared information obtained in step S23 to the terminal devices 10a and 10b, respectively (step S24 and step S25).

  The terminal device 10a receives the target information transmitted from the management server 40A. On the map image corresponding to the position information indicating the position of the target 500 included in the received target information, the terminal device 10a is on the map image on which the marker images indicating the terminal devices 10a and 10b are superimposed in step S14. A marker image indicating the object 500 is further superimposed on the position (step S17). The terminal device 10a displays a map image on which a marker image indicating the target 500 is further superimposed on the display of the glasses unit 1A provided in the terminal device 10a.

  Similarly, the terminal device 10b receives the target information transmitted from the management server 40A. On the map image corresponding to the position information indicating the position of the target 500 included in the received target information, the terminal device 10b is placed on the map image on which the marker images indicating the terminal devices 10b and 10a are superimposed in step S34. The marker image indicated by the object 500 is further superimposed on the position (step S35). The terminal device 10b displays a map image on which a marker image indicating the target 500 is further superimposed on the display of the glasses unit 1A provided in the terminal device 10b.

  FIG. 12 is a flowchart of an example showing a method for generating shared information according to the first embodiment. With reference to the flowchart of FIG. 12, the process of step S11-step S16 of the terminal device 10a in the sequence diagram of FIG. 10 mentioned above is demonstrated in detail. Here, the description will be made on the assumption that the user A is sharing information with respect to the target 500 viewed through the front 11A of the terminal device 10a attached to the head 80.

  In FIG. 12, in step S <b> 100, the terminal device 10 a uses the position information acquisition unit 202 to acquire position information indicating the position of the terminal device 10 a itself. In the next step S101, the terminal device 10a acquires direction information indicating the direction in which the eyeglass unit 1A (front 11A) of the terminal device 10a is directed by the head movement detection unit 207. In the next step S102, the terminal device 10a transmits the position information acquired in step S100 and the direction information acquired in step S101, together with identification information for identifying the terminal device 10a, to the management server 40A.

  In the next step S103, the terminal device 10a determines whether or not the user A has given an instruction to start information sharing. For example, when the terminal device 10a detects a predetermined operation on the operation unit 24 provided in the spectacles unit 1A, the terminal device 10a determines that an information sharing start instruction is given. When it is determined that the information sharing start instruction is not given (step S103, “No”), the terminal device 10a returns the process to step S100.

  On the other hand, if it is determined in step S103 that an instruction to start information sharing is given (step S103, “Yes”), the terminal device 10a shifts the process to step S104. In step S <b> 104, the terminal device 10 a performs imaging with the camera 23. At this time, the user A wearing the terminal device 10a looks at the target 500 through the front 11A of the eyeglass unit 1A with the face facing the target 500 where information is to be shared and the line of sight facing the front. To do. In this state, imaging is performed in step S104.

  Here, as described above, when the glasses unit 1A of the terminal device 10a is correctly mounted on the head 80, the camera 23 is provided in the glasses unit 1A so as to capture the same direction as the line of sight when looking at the front. . Therefore, it can be considered that the captured image obtained by imaging with the camera 23 corresponds to a sight in the line-of-sight direction when the user A looks at the front.

  The spectacles unit 1 </ b> A transfers a captured image obtained by capturing with the camera 23 to the information processing unit 20 </ b> A via the cable 21. The information processing unit 20A stores the captured image transferred from the eyeglass unit 1A in, for example, the storage 2003.

  In the next step S105, the terminal device 10a starts accepting input of distance information indicating the distance from the user A to the target 500. Here, the terminal device 10a accepts the input of distance information according to the voice of the user A wearing the glasses unit 1A of the terminal device 10a or a predetermined gesture of the user A.

  An example of inputting distance information by voice will be schematically described. In the terminal device 10a, for example, a microphone 2030 is connected to the audio I / F 2008 of the information processing unit 20A. For example, the user A visually measures the distance to the object 500 and utters a keyword indicating the measured distance so that the microphone 2030 can collect sound. It is conceivable that the keyword is composed of a combination of a numerical value and a unit, for example. As an example, if the distance to the object 500 is 5 m (meters), the user A speaks to the microphone 2030 as “remember”.

  In the terminal device 10a, the input processing unit 205 converts an analog audio signal output from the microphone 2030 and input from the audio I / F 2008 into a digital audio signal, and uses this audio signal using a known audio analysis technique. And analyze. Based on this analysis, the input processing unit 205 recognizes a keyword representing a distance from the speech signal, that is, speech based on a combination of a numerical value and a unit, and converts the recognized speech into text information. The input processing unit 205 further converts this text information into distance information and passes it to the shared information generation unit 203.

  An example of distance information input by a gesture applicable to the first embodiment will be schematically described with reference to FIG. In FIG. 13, the same reference numerals are given to the portions common to FIG. 11 described above, and detailed description thereof is omitted. As shown in FIG. 13A, the user A wears the eyeglass unit 1A of the terminal device 10a on the head 80 and measures the distance to the target 500 by, for example, eye measurement. The user A executes a gesture expressing the measured distance so as to be captured by the camera 23 provided in the eyeglass unit 1A. Note that the camera 23 performs imaging with a moving image having a predetermined frame rate.

  FIG. 13B shows an example in which a confirmation image 710 captured by the camera 23 for confirming a gesture by the hand 501 of the user A is superimposed on the map image 700 and displayed. As an example, in a gesture in which the finger of the hand 501 of the user A is raised, it is conceivable to express the distance by the number of fingers that are standing. In the example of FIG. 13B, the image 710 includes an image of the hand 501 with two fingers raised, and the distance to the target 500 is approximately 2 m.

  In the example of FIG. 13B, a message display 704 indicating the distance input by the gesture is displayed on the right end side of the screen. The user A can confirm the input distance value with reference to the message display 704.

  In the terminal device 10a, the input processing unit 205 receives the captured image output from the image information output unit 105, analyzes the input captured image, and recognizes a gesture representing a distance from the captured image. More specifically, the input processing unit 205 performs analysis using a known image analysis technique such as pattern matching based on the shape of a finger. When the input processing unit 205 detects from this analysis that a finger is raised in the hand 501 from the captured image, the input processing unit 205 determines that a gesture representing a distance has been recognized. The input processing unit 205 detects the number of fingers standing from the captured image, converts the detected number into distance information, and passes it to the shared information generation unit 203.

  The gesture for inputting the distance may be only one hand, or both hands may be used. It is also possible to input the distance by a plurality of gestures. In this case, it is possible to input a value having a larger number of digits. Further, the distance may be expressed using a predetermined movement of the hand 501.

  Returning to the description of the flowchart of FIG. 12, in the terminal device 10a, the input processing unit 205 determines whether or not there is a voice input in step S106. For example, the input processing unit 205 determines that there is a voice input when a voice signal of a predetermined level or higher is input from the voice I / F 2008. When the input processing unit 205 determines that there is a voice input (step S106, “Yes”), the process proceeds to step S107.

  In step S107, the input processing unit 205 analyzes the input voice signal, and determines whether or not an utterance including a keyword representing a distance is recognized from the voice signal based on the analysis result. When the input processing unit 205 determines that the utterance including the keyword representing the distance is not recognized (step S107, “No”), the process returns to step S105. On the other hand, when it is determined that the utterance including the keyword representing the distance is recognized (step S107, “Yes”), the input processing unit 205 generates distance information based on the voice, and the generated distance information is used as the shared information generation unit. Then, the process proceeds to step S120.

  If the input processing unit 205 determines in step S106 described above that there is no voice input, the input processing unit 205 shifts the processing to step S110. In step S110, the input processing unit 205 determines whether or not there is a gesture input by the user A based on the captured image. For example, the input processing unit 205 analyzes the input captured image, and determines that there is a gesture input when the captured image includes a predetermined image (for example, the image of the hand 501).

  If the input processing unit 205 determines that there is no gesture input (step S110, “No”), the process returns to step S105. On the other hand, if the input processing unit 205 determines that there is a gesture input (step S110, “Yes”), the process proceeds to step S111. In step S111, the input processing unit 205 analyzes the captured image and determines whether or not a gesture representing a distance from the captured image has been recognized based on the analysis result.

  If the input processing unit 205 determines that the gesture representing the distance is not recognized (step S111, “No”), the process returns to step S110. On the other hand, if the input processing unit 205 determines that the gesture representing the distance has been recognized (step S111, “Yes”), the input processing unit 205 generates distance information based on the gesture, and passes the generated distance information to the shared information generation unit 203. Then, the process proceeds to step S120.

  In step S120, the shared information generation unit 203 generates shared information including the distance information passed from the input processing unit 205 in step S107 or step S111 and the position / direction information A acquired in step S11 of FIG. . The shared information generation unit 203 can further include a captured image obtained by capturing the target 500 in the shared information. In next step S121, the shared information generation unit 203 transmits the generated shared information to the management server 40A by the transmission unit 201. When the shared information is transmitted to management server 40A, the process returns to step S100.

  In the above description, the distance information is input by voice or gesture, but this is not limited to this example. For example, the distance information may be input by operating the operation unit 24 provided in the eyeglass unit 1A.

  FIG. 14 illustrates an example of a screen 70 on which a map image 700 on which a marker image indicating the target 500 is additionally displayed according to the first embodiment is displayed. In FIG. 14, the same reference numerals are given to the portions common to FIG. 11B described above, and detailed description thereof is omitted. FIG. 14 shows an example of a screen 70 displayed on the display of the eyeglass unit 1A of the terminal device 10a.

  In FIG. 14, as in the example of FIG. 11B described above, the own device marker 702 indicating the user A using the terminal device 10 a is displayed at the center of the map image 700 displayed on the screen 70. . The own apparatus marker 702 indicates the position of the user A and the direction in which the user A is facing (the direction in which the front 11A of the spectacle unit 1A is facing). In addition, marker images 703b, 703c, and 703d indicating other users B, C, and D are displayed, and the positions of these users B, C, and D are shown on the map image 700.

  Further, based on the shared information transmitted from the user A to the management server 40A, a target marker 720 that is a marker image indicating the target 500 is displayed at a position on the map image 700 corresponding to the position of the target 500. Furthermore, in the example of FIG. 14, the image 721 of the target 500 captured by the user A's terminal device 10 a is displayed in association with the target marker 720 indicating the target 500.

  Information such as the target 500 shown in FIG. 14 is shared between terminal devices used by users other than the user A connected to the information sharing system. For example, in the display of the glasses unit 1A of the terminal device 10b used by the user B, a marker image indicating the direction in which the user B is facing is used as the marker image 703b indicating the user B in the map image 700 similar to FIG. The marker image indicating the position of the user A is simply used as the own apparatus marker 702 indicating the user A. Also in this case, according to the shared information, the target marker 720 indicating the target 500 is displayed at a position on the map image 700 corresponding to the position of the target 500, and the image 721 of the target 500 is associated with the target marker 720. Displayed.

  Thus, in the information sharing system according to the first embodiment, the positions of the terminal devices 10a, 10b, 10c and 30 between the terminal devices 10a, 10b, 10c and 30 connected to the information sharing system, and , The position of the object 500 and the image can be shared. Further, in the information sharing system according to the first embodiment, the position of the target 500 can be acquired based on information acquired by, for example, one terminal device 10a among the plurality of terminal devices 10a, 10b, and 10c. .

(Modification of the first embodiment)
Next, a modification of the first embodiment will be described. In the modified example of the first embodiment, the position of the target 500 and information indicating the attribute of the target 500 are displayed on the map image 700.

  FIG. 15 shows an example of an attribute information table according to a modification of the first embodiment, in which attributes and information indicating attributes are stored in association with each other. In the example of FIG. 15, the attribute information table stores attribute names “destination”, “dangerous goods”, “collapsed house”, and “rescued person” indicating attribute information. In the attribute information table, each marker name corresponding to the attribute information is stored in association with each attribute name as information indicating each attribute. The management server 40A stores this attribute information table in the attribute information storage unit 404 in advance.

  Note that the attribute name (attribute information) and the marker image are not limited to the example of FIG. For example, as the attribute information, a type such as a building (residence, store, temple, etc.) or a state such as a road (depression, crack, flooding, etc.) can be applied. Moreover, the marker image can use the image corresponding to each attribute information suitably.

  For example, the user A who uses the terminal device 10a inputs an attribute name corresponding to the state of the target 500 to the terminal device 10a. The attribute name may be input by operating the operation unit 24, or may be input by voice or gesture. At this time, the terminal device 10a preferably stores in advance each attribute name “destination”, “dangerous goods”, “collapsed house”, and “rescue person” stored in the attribute information table. In this case, the user A who uses the terminal device 10a can select and input the attribute information of the target 500 from each of the attribute names stored in advance, and input mistakes or referencing attribute names in the attribute information table An error can be prevented.

  The terminal device 10a includes the input attribute name in the shared information and transmits it to the management server 40A (steps S15 and S16 in FIG. 10). Upon receiving the shared information, the management server 40A calculates position information indicating the position of the target 500 based on the position / direction information A and the distance information included in the shared information (step S23 in FIG. 10). Also, the management server 40A refers to the attribute information table based on the attribute name included in the shared information, and acquires a marker image associated with the attribute name.

  The management server 40A transmits the calculated position information and the marker image acquired from the attribute information table to the terminal devices 10a, 10b, 10c, and 30 as target information (steps S24 and S25 in FIG. 10). When each of the terminal devices 10a, 10b, 10c and 30 receives the target information from the management server 40A, the marker image included in the target information at a position on the map image 700 indicated by the position information included in the received target information. Are superimposed and displayed. Each user A, B, C, and D using each terminal device 10a, 10b, 10c, and 30 can intuitively grasp the attribute of the target 500 based on the marker image.

(Second Embodiment)
Next, a second embodiment will be described. In the second embodiment, one of the terminal devices connected to the information sharing system has at least a part of the functions of the management server 40A according to the first embodiment.

  Referring to FIG. 1 as an example, in the second embodiment, one of the terminal devices 10a, 10b, 10c and 30 has a function of calculating at least the position of the target 500 among the functions of the management server 40A. Is responsible for. Hereinafter, a terminal device that bears a part of the functions of the management server 40A is called a commander terminal, and a user who uses the commander terminal is called a commander. Any of the terminal devices 10a, 10b, 10c, and 30 may be applied to the commander terminal. However, in consideration of processing load, it is preferable to apply the terminal device 30 that is a non-mobile terminal to the commander terminal. .

  The configuration of the information sharing system according to the second embodiment will be schematically described with reference to FIG. 16, the information sharing system includes terminal devices 10a, 10b,... Used by users A, B,..., A commander terminal 30B used by the commander, and a management server 40B. The terminal devices 10a, 10b,... Are connected to the management server 40B via a wireless communication network. The commander terminal 30B may be connected to the management server 40B via a wired communication network or a wireless communication network. However, in consideration of communication stability, the commander terminal 30B is connected to the management server 40B via a wired communication network. It is preferred that

  Further, it is possible to perform communication using voice between the terminal devices 10a, 10b,... And the commander terminal 30B. The communication using the voice may be performed via the network via the management server 40B, or may be performed via another route without via the management server 40B. Communication using voice may be performed using a public telephone line.

  Further, each terminal device 10a, 10b,... Can transmit distance information indicating the distance to the target 500 to the commander terminal 30B via the management server 40B. In the example of FIG. 16, the terminal device 10a transmits distance information indicating the distance to the target 500.

  FIG. 17 illustrates an exemplary configuration of an information processing unit 20B included in each terminal device 10a, 10b,... Applicable to the second embodiment. Note that, in FIG. 17, the same reference numerals are given to portions common to FIG. 6 described above, and detailed description thereof is omitted.

  In FIG. 17, the information processing unit 20 </ b> B is connected to an audio I / F 2008 via an earphone 2041 via a volume control device (VOL) 2040. The audio I / F 2008 converts, for example, a digital audio signal supplied from the CPU 2000 into an analog audio signal and outputs the analog audio signal. The audio signal output from the audio I / F 2008 is input to the earphone 2041 via the volume control device 2040. The volume control device 2040 adjusts the level of the audio signal input to the earphone 2041 according to a user operation. The volume control device 2040 may be built in the information processing unit 20B.

  Thereby, the user can hear the sound by the audio | voice signal transmitted via the network and received by communication I / F2007 with the earphone 2041, for example. Further, the user can pick up the voice uttered by the microphone (MIC) 2030 and transmit it via the communication I / F 2007 via the network.

  The eyeglass unit 1A included in each terminal device 10a, 10b,... According to the second embodiment can be applied with the same configuration as that described with reference to FIG. . Further, as the functions of the eyeglass unit 1A and the information processing unit 20B, the functions described with reference to FIG. 7 can be similarly applied except for the above-described voice communication function, and thus the description thereof is omitted here.

  FIG. 18 shows an example of the hardware configuration of the commander terminal 30B according to the second embodiment. In FIG. 18, the commander terminal 30B includes a CPU 3000, a ROM 3001, a RAM 3002, a graphics I / F 3003, a storage 3005, a data I / F 3006, a communication I / F 3009, and a voice I / F 3010. Each unit is communicably connected to each other via a bus 3020. Thus, the commander terminal 30B according to the second embodiment can be realized by using a general computer.

  The storage 3005 is a non-volatile storage medium such as a hard disk drive or a flash memory, and stores programs and data. The CPU 3000 controls the overall operation of the commander terminal 30B using the RAM 3002 as a work memory according to programs stored in the storage 3005 and the ROM 3001.

  The graphics I / F 3003 is connected to a display 3004 and generates a display signal that can be displayed on the display 3004 based on display control information generated by the CPU 3000 according to a program. The data I / F 3006 is an interface for external data supplied from the outside of the commander terminal 30B. The data I / F 3006 can be connected to a pointing device 3007 such as a mouse and a keyboard 3008. As the data I / F 3006, for example, USB (Universal Serial Bus) can be applied. A communication I / F 3009 is connected to a network and performs communication via the network.

  The audio I / F 3010 inputs and outputs audio signals. For example, the audio I / F 3010 includes an ADC, and converts an analog audio signal supplied from a microphone (MIC) 3030 or the like into a digital audio signal. The audio I / F 3010 includes a DAC, converts the supplied digital audio signal into an analog audio signal, and outputs the analog audio signal. The audio signal output from the audio I / F 3010 is supplied to, for example, a speaker (SP) 3031.

  FIG. 19 is a functional block diagram for explaining the functions of the commander terminal 30B according to the second embodiment. The commander terminal 30B according to the second embodiment has substantially the same function as the management server 40A according to the first embodiment described above. That is, the commander terminal 30B includes a reception unit 300, a shared information acquisition unit 301, a map information acquisition unit 302, a position acquisition unit 303, an attribute information storage unit 304, and a transmission unit 305.

  The reception unit 300, the shared information acquisition unit 301, the map information acquisition unit 302, the position acquisition unit 303, and the transmission unit 305 are realized by a program that operates on the CPU 3000. The attribute information storage unit 304 is formed in a predetermined area on the storage 3005, for example. Not limited to this, a part or all of the reception unit 300, the shared information acquisition unit 301, the map information acquisition unit 302, the position acquisition unit 303, and the transmission unit 305 are configured by hardware circuits that operate in cooperation with each other. May be.

  The reception unit 300, the shared information acquisition unit 301, the map information acquisition unit 302, the attribute information storage unit 304, and the transmission unit 305 are respectively the reception unit 400, the shared information acquisition unit 401, and the map information in the management server 40A illustrated in FIG. The acquisition unit 402, the attribute information storage unit 404, and the transmission unit 405 have substantially the same functions.

  That is, the receiving unit 300 receives information transmitted via the network. When the shared information described above is included in the information received by the receiving unit 300, the shared information acquiring unit 301 acquires the shared information. The map information acquisition unit 302 acquires map information stored in advance in the commander terminal 30B via the network.

  The attribute information storage unit 304 stores an attribute information table in which attribute information indicating a target attribute is associated with a marker image representing the attribute. The transmission unit 305 transmits the target information including the position information calculated by the position acquisition unit 303 to the terminal devices 10a and 10b via the network.

  The position acquisition unit 303 acquires position information indicating the position of the target 500. For example, when distance information indicating the distance from the terminal device 10 a to the target 500 is transmitted, the position acquisition unit 303 determines the position of the target 500 based on the distance information and the shared information acquired by the shared information acquisition unit 301. And position information indicating the position is acquired.

  Further, the position acquisition unit 303 may calculate the position of the target 500 based on distance information acquired by voice communication between the terminal device 10a and the commander terminal 30B, for example.

  For example, the user A of the terminal device 10a estimates the distance to the target 500 by visual observation through the front 11A of the eyeglass unit 1A, and utters information indicating the estimated distance by the microphone 2030 so that sound can be collected. The terminal device 10a transmits to the commander terminal 30B a voice signal that is collected by the microphone 2030 and includes voice information including information indicating the distance.

  A user (commander) who operates the commander terminal 30 </ b> B listens through the speaker 3031 for sound based on the sound signal acquired by the sound communication. The commander inputs distance information to the commander terminal 30B by operating the keyboard 3008, for example, based on the information indicating the distance included in the voice. The position acquisition unit 303 calculates the position of the target 500 using the distance information input in this way and the shared information transmitted from the terminal device 10a, and acquires position information indicating the position of the target 500.

  An information processing program for realizing each function of the commander terminal 30B according to the second embodiment is a file in an installable format or an executable format, which is a CD (Compact Disk), a flexible disk (FD), a DVD ( Provided on a computer-readable recording medium such as Digital Versatile Disk). However, the present invention is not limited thereto, and the information processing program may be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. The information processing program may be provided or distributed via a network such as the Internet.

  The information processing program has a module configuration including the above-described units (reception unit 300, shared information acquisition unit 301, map information acquisition unit 302, position acquisition unit 303, and transmission unit 305). As actual hardware, the CPU 3000 reads the information processing program from a storage medium such as the storage 3005 and executes the information processing program, whereby the above-described units are loaded on the main storage device such as the RAM 3002, and the reception unit 300 acquires the shared information. The unit 301, the map information acquisition unit 302, the position acquisition unit 303, and the transmission unit 305 are generated on the main storage device.

  FIG. 20 is a functional block diagram illustrating an example of functions of the management server 40B applicable to the second embodiment. The hardware configuration of the management server 40B can be the same configuration as that of the management server 40A according to the first embodiment described with reference to FIG. 8, and thus the description thereof is omitted here.

  In FIG. 20, the management server 40B includes a reception unit 410 and a transmission unit 411. The receiving unit 410 receives information transmitted from the terminal devices 10a, 10b,... And the commander terminal 30B to the management server 40B via the network, for example. The transmitting unit 411 transmits information to, for example, the terminal devices 10a, 10b,... And the commander terminal 30B via the network.

  In the configuration as described above, each of the terminal devices 10a, 10b,... Receives position information indicating its own position and direction information indicating the direction in which the terminal device (the front 11A of the spectacle unit 1A) is facing. It transmits to the management server 40B with the identification information to identify. The management server 40B receives position information, direction information, and identification information transmitted from each terminal device 10a, 10b,. The management server 40B transmits the received position information and direction information to the commander terminal 30B in association with the corresponding identification information.

  The commander terminal 30B receives the position information, direction information, and identification information of each terminal device 10a, 10b,... Transmitted from the management server 40B. The commander terminal 30B acquires map information based on the received position information of each terminal device 10a, 10b,. The commander terminal 30B receives the map information and the position information, direction information and identification information of the terminal devices 10a, 10b,... Received from the management server 40B via the management server 40B. Send to.

  Each of the terminal devices 10a, 10b,... Receives the map information transmitted from the management server 40B and the position information, direction information, and identification information of each of the terminal devices 10a, 10b,. Each terminal device 10a, 10b,... Is displayed by superimposing information indicating each terminal device 10a, 10b,... On the map image based on the received map information, based on each position information, direction information, and identification information. Let

  FIG. 21 shows an example of a screen 70a displayed on the display of the terminal device 10a according to the second embodiment. The screen 70a includes a map image 700. In the map image 700, the device marker 702 is displayed superimposed on the position on the map image 700 corresponding to the position information indicating the position of the terminal device 10a. The own device marker 702 is displayed so as to indicate the direction in which the eyeglass unit 1A of the terminal device 10a faces according to the direction information indicating the direction of the terminal device 10a.

  The position information and the direction information related to the terminal device 10a may use information transmitted from the commander terminal 30B via the management server 40B, or the position information acquisition unit 202 and the head movement detection unit in the terminal device 10a. Information acquired and detected in 207 may be used.

  In addition, in the map image 700, the marker image 703b indicating the terminal device 10b and the identification information (for example, use) that identifies the terminal device 10b at a position corresponding to the position information indicating the position of another terminal device (for example, the terminal device 10b). The name “user B”) is superimposed and displayed. Further, similarly for other terminal devices, marker images (for example, marker images 703c and 703d) indicating the respective terminal devices and identification information for identifying the respective terminal devices (for example, marker images 703c and 703d) are provided at the positions corresponding to the position information of the respective terminal devices. For example, user C and user D) are superimposed and displayed.

  Further, the commander terminal 30B obtains the time information indicating the current time acquired at the commander terminal 30B together with the map information, the position information, the direction information, and the identification information of each of the terminal devices 10a, 10b,. , Can be transmitted to each terminal device 10a, 10b,... Via the management server 40B. The terminal device 10a displays a message display 730 indicating the received time information on the screen 70a.

  FIG. 22 shows an example of a screen 70b displayed on the display of the terminal device 10b according to the second embodiment. In this case, the map image 700 is common to the map image 700 displayed on the screen 70a of the terminal device 10a, and the own device marker 702 is located at a position on the map image 700 corresponding to the position information indicating the position of the terminal device 10b. Are superimposed and displayed. In addition, a marker image (for example, marker images 703a, 703c, and 703d) indicating each of the other terminal devices at a position on the map image 700 of another terminal device other than the terminal device 10b and an identification for identifying each of the other terminal devices. Information (for example, user A, user C, user D) is superimposed and displayed.

  Further, on the screen 70b, a message display 730 indicating time information by the commander terminal 30B is displayed in common with the screen 70a displayed on the display of the terminal device 10a described above.

  FIG. 23 shows an example of a screen 71 displayed on the display of the commander terminal 30B according to the second embodiment. The commander terminal 30B, based on the position information, direction information, and identification information received from the terminal devices 10a, 10b,..., At the positions corresponding to the position information on the map image 700, the terminal devices 10a, 10b. ,... Are superimposed on marker images 705a, 705b, 705c, and 705d, respectively. At this time, in the commander terminal 30B, each marker image 705a, 705b, 705c, 705d is sent to the glasses unit 1A of each terminal device 10a, 10b,... According to each direction information of each corresponding terminal device 10a, 10b,. It is displayed to point in the direction you are facing.

  The commander can know which direction the users A, B,... Of each terminal device 10a, 10b,. Moreover, the commander can know how the users A, B,... Of the terminal devices 10a, 10b,... , B,... Can be estimated.

(Application example of the information sharing system according to the second embodiment)
As an example to which the information sharing system according to the second embodiment is applied, there is a rescue operation at a large-scale disaster site. When large-scale disasters such as earthquakes, floods, and heavy snowfall occur, rescue workers are gathered from all over the country, and it is necessary for strangers to work together in a strange land. There are also places where there is a possibility of secondary disasters such as bad road conditions and landslides. Furthermore, rescue operations are a matter of time, and it is a waste of time for another member to visit a location that another member has already investigated.

  As described above, according to the information sharing system according to the second embodiment, the display of each terminal device 10a, 10b,..., The common map image 700, the own device marker 702 indicating the position of the own device, Marker images indicating other terminal devices (for example, if the device is the terminal device 10a, marker images 703b, 703c,...) Are displayed at positions on the map image 700 of the corresponding terminal devices. Further, on the display of the commander terminal 30B used by the commander, the marker images 705a, 705b,... Showing the directions of the terminal devices 10a, 10b,. Is displayed.

  Therefore, by applying the information sharing system according to the second embodiment to such a scene, each member can easily grasp the location where he / she is and the direction to which he / she is going, and other members It is possible to easily grasp the place where there is. Thereby, each member can take an appropriate action with reduced waste. Furthermore, the commander can easily grasp the positions of all the members on the screen 71 of the commander terminal 30B. For example, the commander can give accurate instructions by communicating with each member using voice communication. .

  Further, since the terminal devices 10a, 10b,... Used by each member are spectacle-type devices that are used by being mounted on the head 80, information can be obtained in a state where both hands can be used. Therefore, information can be confirmed even when a rescue tool is held by hand or when climbing a steep slope with both hands and feet.

  An application example of the information sharing system according to the second embodiment is not limited to disaster relief. For example, the information sharing system according to the second embodiment can be applied to an amusement such as a survival game. In this case, since the position of the ally is known, a strategic element can be added to the game by moving cooperatively when taking the flag of the enemy base. Since survival games often have guns in both hands, displaying information in a state where both hands can be used with a glasses-type device is very effective. By applying the information sharing system according to the second embodiment to group competitions such as snowball fights as well as survival games, it is possible to add strategy to the competition and increase the competition value.

(First Modification of Second Embodiment)
Next, a first modification of the second embodiment will be described. The 1st modification of 2nd Embodiment is an example in the case of designating the desired position on the map image 700 in the commander terminal 30B. For example, the commander uses the pointing device 3007 connected to the commander terminal 30B while referring to the screen 71 displayed on the display 3004 of the commander terminal 30B, to select a desired one on the map image 700 in the screen 71. Specify the position. In addition, the commander terminal 30B can input a message corresponding to the designated position using the keyboard 3008, for example.

  FIG. 24 shows an example of a screen 71 when a desired position on the map image 700 is designated on the commander terminal 30B according to the first modification of the second embodiment. A marker image 706 is superimposed at a designated position of the map image 700 in the screen 71, and an input message (in this example, “destination”) is displayed near the marker image 706.

  The commander terminal 30B further acquires specified position information (latitude and longitude) that is position information corresponding to the specified position, for example, by the position acquisition unit 303, based on the map information displaying the map image 700. The commander terminal 30B transmits the acquired designated position information and a message corresponding to the designated position to the terminal devices 10a, 10b,... Via the management server 40B. This makes it possible to notify the users A, B,... Of the terminal devices 10a, 10b,.

  When the information sharing system according to the first modification of the second embodiment is applied to disaster relief as described above, a plurality of members are quickly notified of a certain position in common. be able to. In addition, since the position information indicating the designated position is displayed on the display of the spectacle unit 1A, even if the information is updated and the designated position is changed, each member quickly responds to the update of the position information. Is possible.

(Second modification of the second embodiment)
Next, a second modification of the second embodiment will be described. In the second modification of the second embodiment, position information indicating the position of the object 500 is shared between the terminal devices 10a, 10b,... And the commander terminal 30B, and each terminal device 10a. This is an example of sharing between 10b,.

  For example, the user A who uses the terminal device 10a visually observes the target 500 via the front 11A in the eyeglass unit 1A of the terminal device 10a, and starts sharing information regarding the target 500. The user A measures the distance from the terminal device 10a to the target 500, for example, visually, and inputs distance information indicating the measured distance to the terminal device 10a by voice or gesture. Since the method described with reference to FIG. 12 can be applied to the method of inputting distance information by voice or gesture, description thereof is omitted here.

  The terminal device 10a transmits the input distance information in association with the identification information of the terminal device 10a to the commander terminal 30B via the management server 40B. It is assumed that the position information, the direction information, and the identification information of the terminal device 10a are transmitted to the commander terminal 30B via the management server 40B prior to the transmission of the distance information.

  When the commander terminal 30B receives the distance information and the identification information transmitted from the terminal device 10a, the position acquisition unit 303 receives the received distance information and the previously received position information and direction information of the terminal device 10a. Based on the above, position information indicating the position of the object 500 is acquired. The commander terminal 30B superimposes a marker image indicating the target 500 on a position on the map image 700 corresponding to the acquired position information of the target 500.

  FIG. 25 illustrates an example in which a target marker 722 that is a marker image indicating the target 500 is superimposed on the map image 700 on the screen 71 of the commander terminal 30B according to the second modification of the second embodiment. Show. In this example, attribute information indicating the attribute of the target 500 is transmitted from the terminal device 10a, and the commander terminal 30B sets the target marker 722 corresponding to this attribute information from the attribute information table stored in the attribute information storage unit 304. Obtained and superimposed on the map image 700.

  The commander terminal 30B transmits the acquired position information indicating the position of the target 500 and the target marker 722 corresponding to the attribute of the target 500 to each terminal device 10a, 10b,... Via the management server 40B. Each terminal device 10a, 10b,... Has a target marker 722 at a position on the map image 700 corresponding to the position information indicating the position of the target 500 on the display screen 70a, 70b,. Superimpose.

  When the information sharing system according to the second modification of the second embodiment is applied to disaster relief as described above, the location of a dangerous spot or the like discovered by one member can be easily set by a plurality of members. Can be notified. In addition, for example, even when a disaster is being rescued on a mountain road where there is no mark at all, it is possible to easily notify the location of a dangerous location or the like, and it is possible to protect the safety of each member.

  In the above, in the second modification of the second embodiment, the position of the target 500 is acquired based on the distance information transmitted from the terminal device 10a via the management server 40B. It is not limited to. For example, the terminal device 10a may transmit distance information to the commander terminal 30B using voice communication using the voice of the user A. The commander inputs the distance information acquired by the voice communication to the commander terminal 30B by operating, for example, the keyboard 3008. The commander is not limited thereto, and the commander directly uses the pointing device 3007 or the like on the map image 700 in the screen 71 displayed on the display 3004 of the commander terminal 30B based on the distance information acquired by voice communication. 500 positions may be specified.

(Third Modification of Second Embodiment)
Next, a third modification of the second embodiment will be described. The third modified example of the second embodiment is the same as the first modified example or the second modified example of the second embodiment described above, and further, a desired position or object 500 from the terminal devices 10a, 10b,. It is an example which calculates | requires each distance information which shows the distance to. The commander terminal 30B, for example, by the position acquisition unit 303, based on the position information indicating the desired position or the position of the target 500 and the position information indicating the position of each terminal device 10a, 10b,. A linear distance from the object 500 to each terminal device 10a, 10b,... Is calculated.

  The commander terminal 30B transmits position information indicating a desired position or the position of the target 500 to each of the terminal devices 10a, 10b,. In addition, the commander terminal 30B sends distance information indicating the linear distance from each of the terminal devices 10a, 10b,... To a desired position or the position of the target 500 to the terminal devices 10a, 10b,. Send.

  Each of the terminal devices 10a, 10b,... Superimposes a predetermined marker image on the position on the map image 700 corresponding to the position information transmitted from the commander terminal 30B. Further, each of the terminal devices 10a, 10b,... Displays distance information corresponding to the own device among the distance information transmitted from the commander terminal 30B on the screens 70a, 70b,. FIG. 26 shows an example of a screen 70a displayed on the display of the terminal device 10a when a desired position is designated on the commander terminal 30B according to the third modification of the second embodiment. On the screen 70a, a marker image 706 is superimposed at a position on the map image 700 corresponding to a desired position, and a message display 740 indicating distance information is displayed.

  The marker image 706 is superimposed on the map image 700 according to the desired position or the position of the target 500, so that the approximate distance from each terminal device 10a, 10b,. It is possible to estimate the time required to reach

  In the third modified example of the second embodiment, the actual distance from each terminal device 10a, 10b,... To the desired position or the position of the target 500 is further displayed, and the display value is set to each terminal device 10a, The remaining distance to the desired position or the position of the target 500 is clarified by sequentially updating with the movement of 10b,. Further, a message display 730 indicating time information indicating a common time is displayed on each screen 70a, 70b,... Of each terminal device 10a, 10b,. Therefore, the estimated arrival time at the desired position or the position of the target 500 can be estimated with high accuracy.

  In addition, existing car navigation systems and the like calculate distances on the assumption that they pass through roads. On the other hand, in the information sharing system according to the third modification of the second embodiment, the linear distance between each user A, B,... And the desired position or the position of the target 500 is displayed. As a result, for example, when the information sharing system according to the third modification of the second embodiment is applied to disaster relief or the like, it is difficult to travel normally on a road such as a disaster site. By showing the straight line distance (absolute distance), each member becomes easy to understand.

(Fourth modification of the second embodiment)
Next, a fourth modification of the second embodiment will be described. In the fourth modification of the second embodiment, in the second embodiment and each modification described above, the commander displays the screens 70a, 70b,... Displayed on the displays of the terminal devices 10a, 10b,. In this example, messages transmitted from the terminal 30B are displayed in common.

  FIG. 27 shows an example of a screen 70a on which a message display 741 based on an arbitrary message transmitted from the commander terminal 30B according to a fourth modification of the second embodiment is displayed. For example, the commander operates the keyboard 3008 to input an arbitrary message to the commander terminal 30B. The commander terminal 30B transmits the input message to each terminal device 10a, 10b,... Via the management server 40B. When receiving the message transmitted from the commander terminal 30B, each terminal device 10a, 10b,... Displays a message display 741 including the received message on each screen 70a, 70b,.

  Contact between the users A, B,... Of each of the terminal devices 10a, 10b,... And the commander can be communicated earliest by using voice communication. However, depending on the environment where there are users A, B,... In this case, it is preferable that the content of the communication can be conveyed by characters instead of voice. By displaying the content of the communication from the commander as character information on the display of the spectacle unit 1A included in each terminal device 10a, 10b,..., The content of the communication can be more reliably transmitted.

(Third embodiment)
Next, a third embodiment will be described. The third embodiment is a dimmer that adjusts the amount of light that passes through the front 11 </ b> A with respect to the glasses unit 1 </ b> A according to the first and second embodiments described above and the modifications of each embodiment. Is provided.

  An example of the configuration of the terminal device including the eyeglass-type device according to the third embodiment will be described with reference to FIGS. FIG. 28 is a perspective view illustrating an appearance of an example of the terminal device 10 ′ according to the third embodiment. FIG. 29 shows an example of mounting the spectacles unit 1B on the head 80 in the terminal device 10 'according to the third embodiment. FIG. 30 shows an example of the configuration of a display system built in the front 11B and the temple 12 of the eyeglass unit 1B according to the third embodiment. 28 to 30, the same reference numerals are given to the portions common to FIGS. 2 to 4 described above, and detailed description thereof is omitted.

  28-30, the spectacles unit 1B is provided with the light control filter 1010 which can control the transmittance | permeability in the incident side of the light-guide plate 2 with respect to the front 11B. That is, in the third embodiment, light from the outside enters the eyeball via the light control filter 1010 and the light guide plate 2.

  FIG. 31 shows an example of the configuration of a light control filter 1010 applicable to the third embodiment. In FIG. 31, the dimming filter 1010 can have a cell structure in which a titanium oxide particle film 901 and a display layer 902 are formed on a display substrate 900, and a counter substrate 904 is bonded through a spacer 903 of about 10 μm. . In the cell structure, for example, 1-ethyl-3-methylimidazolium tetracyanoborate is enclosed as an electrolytic solution.

  As the display substrate 900, for example, a film substrate with an ITO (Indium Tin Oxide) conductive film of about 150 mm × 80 mm can be used. The titanium oxide particle film 901 can be formed, for example, by applying a titanium oxide nanoparticle dispersion liquid on the display substrate 900 by a spin coating method or the like and performing an annealing process at a temperature of about 120 ° C. for about 15 minutes.

  The display layer 902 is, for example, a spin coat method using a 1 wt% 2,2,3,3-tetrafluoropropanol solution of a compound represented by the following structural formula (1) on the titanium oxide particle film 901 as a coating solution. Apply by. Then, by performing an annealing process at a temperature of about 120 ° C. for about 10 minutes, an electrochromic compound can be adsorbed and formed on the surface of the titanium oxide particles constituting the titanium oxide particle film 901.

  The eyeglass unit 1B according to the third embodiment can further include an illuminance sensor that detects the illuminance of light irradiated on the front 11B. FIG. 32 shows a configuration example of an eyeglass unit including an illuminance sensor according to the third embodiment. In FIG. 32, an illuminance sensor 1011 is provided on the front 11B of the spectacle unit 1B near the center in the left-right direction. In FIG. 32, the illuminance sensor 1011 is provided on the left eye side, but the illuminance sensor 1011 may be provided on the right eye side. The illuminance sensor 1011 is not limited to this position as long as the illuminance sensor 1011 can accurately detect the illuminance of light incident on both eyes via the front 11B with the spectacles unit 1B mounted on the head 80. .

  In FIG. 32, the external light quantity A, the transmitted light quantity B obtained by reducing the external light quantity A by the light control filter 1010, and the image of the light (video) emitted from the half mirror 8 (display) included in the front 11B. The relationship with the light quantity C is shown. As the image light amount C is larger than the transmitted light amount B, the image displayed on the display becomes easier to see. On the other hand, if the transmitted light amount B becomes too small, it is difficult to see the surrounding real image due to the external light transmitted through the front 11B.

  Therefore, in the third embodiment, the ambient light amount A is monitored by the illuminance sensor 1011, and the transmittance of the light control filter 1010 and the light amount of the image light irradiated on the half mirror 8 are controlled according to the monitoring result. To do. As a result, the amount of external light and image light emitted to the eyeball is appropriately irradiated, and the user can easily recognize the scene of the external light and the image of the image light even under different external light environments. Is possible.

  FIG. 33 shows an example of the hardware configuration of the eyeglass unit 1B according to the third embodiment. 33, the same reference numerals are given to the portions corresponding to those in FIGS. 5 and 32 described above, and the detailed description thereof will be omitted. The eyeglass unit 1B shown in FIG. 33 has a dimming filter 1010, an illuminance sensor 1011, and a dimming control circuit 1012 added to the eyeglass unit 1A shown in FIG. The dimming control circuit 1012 controls the transmittance of the dimming filter 1010 and the amount of light emitted from the light source 4 according to the control of the CPU 1000.

  FIG. 34 is a functional block diagram illustrating an example of functions of the eyeglass unit 1B according to the third embodiment. In FIG. 34, parts common to those in FIG. 7 described above are denoted by the same reference numerals, and detailed description thereof is omitted. Further, in the terminal device 10 ′ according to the third embodiment, the information processing unit 20 </ b> A can apply the configuration and function described with reference to FIGS. 6 and 7 as they are, and thus the description thereof is omitted here.

  In FIG. 34, the spectacle unit 1B has an illuminance detection unit 1020 and a dimming control unit 1021 added to the functions described with reference to FIG. The illuminance detection unit 1020 receives the illuminance detection result output from the illuminance sensor 1011 and passes it to the dimming control unit 1021. The dimming control unit 1021 controls the transmittance of the dimming filter 1010 and the light amount of the light source 4 based on the illuminance detection result passed from the illuminance detection unit 1020.

  The dimming control unit 1021 includes, for example, a dimming table that associates the illuminance detection result by the illuminance sensor 1011, the transmittance of the dimming filter 1010, and the light amount of the light source 4. For example, the dimming table may be stored in advance in the ROM area of the memory 1001 provided in the spectacle unit 1B. The dimming control unit 1021 refers to the dimming table based on the illuminance detection result passed from the illuminance detecting unit 1020, and acquires the corresponding transmittance and light amount. The dimming control unit 1021 controls the dimming filter 1010 and the light source 4 according to the acquired transmittance and light amount.

  FIG. 35 shows an example of a change in transmittance of the light control filter 1010 applicable to the third embodiment. In the example of FIG. 35, the display layer 902 of the light control filter 1010 is colored by applying a constant voltage of 2V. 35, for example, if the transmittance of the dimming filter 1010 is to be 30%, the dimming control unit 1021 applies a constant voltage of 2 V to the dimming filter 1010 for 1.5 seconds. If the transmittance of the dimming filter 1010 is to be 10%, the dimming control unit 1021 applies a constant voltage of 2 V to the dimming filter 1010 for 5 seconds. In this way, by controlling the transmittance of the dimming filter 1010 by the dimming control unit 1021, the above-described transmitted light amount B can be adjusted.

  On the other hand, the image light amount C in the display of the spectacle unit 1B can be adjusted by controlling the light amount (intensity) of the light emitted from the light source 4 by the dimming control unit 1021. For example, consider a case where an LED (Light Emitting Diode) is used as the light source 4 and the light source 4 is driven by a power source based on PWM (Pulse Width Modulation). In this case, the dimming control unit 1021 can adjust the light amount of the light source 4 by changing the pulse width (duty ratio) for turning on / off the LED as the light source 4.

  One of the sites to which the information sharing system according to each embodiment is applied is a wide outdoor location. In the case of the glasses-type device according to the prior art, the brightness of external light (sunlight) is overwhelmingly strong with respect to the brightness of the display, and it may be extremely difficult to clearly recognize the display image. Many. Therefore, in the eyeglass-type device according to the prior art, measures such as attaching a light shielding sheet to the display surface are necessary. In this case, the density of the light-shielding sheet is constant, and it is difficult to adjust depending on the outdoor brightness. Also, if you want to act without seeing the image shown on the display, you must remove the light-shielding sheet to obstruct the field of view.

  The eyeglass unit 1B according to the third embodiment controls the transmittance of the light control filter 1010 and the light amount of the light source 4 according to the intensity of external light. Therefore, by using the terminal device 10 ′ including the eyeglass unit 1B according to the third embodiment, the user can put the eyeglass unit 1B in an appropriate state outdoors and indoors without using a separate light shielding unit. Can be used.

(Fourth embodiment)
Next, a fourth embodiment will be described. In the first embodiment, the second embodiment, the third embodiment, and the modifications of each of the above-described embodiments, the terminal device 10 that is a glasses-type device or the display of the terminal device 10 ′ is used. The map information is displayed, and the position information indicating the position of each terminal device 10 or terminal device 10 ′ is displayed superimposed on the map information.

  In contrast, in the fourth embodiment, the display of a terminal device that is a spectacle-type device is used in a transparent state, and information indicating the position of another terminal device can be transmitted through the display and viewed in the real world. An image (hereinafter referred to as a real image) is displayed superimposed on a position corresponding to the position. As a result, a user wearing the terminal device according to the fourth embodiment (hereinafter referred to as a wearer) can know information such as the position of other terminal devices while ensuring the visibility of the real image.

  FIG. 36 shows a configuration of an example of an information sharing system according to the fourth embodiment. In FIG. 36, parts common to those in FIG. 1 described above are denoted by the same reference numerals, and detailed description thereof is omitted. The information sharing system according to the fourth embodiment includes a plurality of terminal devices 10a ′, 10b ′, 10c ′, and 30C used by users A ′, B ′, C ′, and D ′, respectively, and a management server 40C. . The terminal devices 10a ', 10b', 10c 'and 30C and the management server 40C are connected to each other via a network 50 so as to be able to communicate with each other.

  The terminal devices 10a ′, 10b ′ and 10c ′ shown in FIG. 36 include eyeglass-type devices corresponding to the terminal device 10 ′ including the front part 11B provided with the light control unit according to the third embodiment. It is possible to communicate with the network 50 by wireless communication. In the fourth embodiment, the terminal device 10 ′ corresponds to GNSS, and can acquire position information indicating the position of the own device based on a signal transmitted from the satellite 60 by GNSS.

  In FIG. 36, the terminal device 30C is, for example, a commander terminal used by a user D 'who is in a position to give commands to the users A', B 'and C'. Hereinafter, the terminal device 30C is referred to as a commander terminal 30C. The management server 40C corresponds to the management server 40A of FIG. 1, and each terminal device 10a ', 10b' and 10c 'is connected to the commander terminal 30C via the management server 40C. The commander terminal 30C can display, on the screen 75, a map image including the positions where the terminal devices 10a ', 10b', and 10c 'are present, for example.

  Each terminal device 10a ', 10b', and 10c 'includes a display having the same optical structure as the display system described with reference to FIG. Each screen 13a, 13b, and 13c displayed on the display of each terminal device 10a ′, 10b ′, and 10c ′ is an orientation in which the own device is directed to a real-world scene (real image) that has passed through the half mirror 8. Is displayed superimposed on a position marker 1301 and a label 1302 indicating information related to a terminal device using a spectacle-type device other than its own device. In the following description, it is assumed that a real image that appears through the half mirror 8 to the user's eyes is also displayed on the display for convenience.

(Configuration applicable to the fourth embodiment)
Next, an example of the configuration of the terminal devices 10a ′, 10b ′, and 10c ′ applicable to the fourth embodiment will be described with reference to FIGS. In the following description, the terminal devices 10a ′, 10b ′, and 10c ′ are represented by the terminal device 10a ′ unless otherwise specified. Also, in FIGS. 38 to 40, the same reference numerals are given to the portions common to FIGS. 6, 33, and 34 described above, and detailed description thereof is omitted.

  FIG. 37 is a perspective view showing an appearance of an example of the terminal device 10a 'according to the fourth embodiment. As illustrated in FIG. 37, the terminal device 10a 'includes a glasses unit 1C and an information processing unit 20C connected to the glasses unit 1C via a cable 21. The eyeglass unit 1C has a configuration in which the camera 23 is omitted from the eyeglass unit 1B shown in FIG. FIG. 38 shows an example of the hardware configuration of the eyeglass unit 1C in which the camera 23 is omitted from the eyeglass unit 1B of FIG.

  FIG. 39 shows an example of the hardware configuration of an information processing unit 20C applicable to the fourth embodiment. As shown in FIG. 39, the information processing unit 20C omits the audio I / F 2008 to which the MIC 2030 is connected to the information processing unit 20A of FIG. In addition, with the omission of the audio I / F 2008 and the omission of the camera 23 in the eyeglass unit 1C, the audio / image analysis unit 2009 is also omitted.

  FIG. 40 is a functional block diagram illustrating an example of functions of the terminal device 10a ′ according to the fourth embodiment. In FIG. 40, in the eyeglass unit 1C, the imaging control unit 104 and the image information output unit 105 are omitted from the eyeglass unit 1B shown in FIG. 34 due to the omission of the camera 23 and the audio I / F 2008. Similarly, in the information processing unit 20B, the input processing unit 205 is omitted from the information processing unit 20A illustrated in FIG.

  On the other hand, the display information generation unit 204 ′ includes a function as a display control unit that generates the position marker 1301 and the label 1302 according to the fourth embodiment and displays them on the screen 13 a, for example. The function of the display information generation unit 204 'will be described later. Further, the head movement detection unit 207 ′ uses the output of the geomagnetic sensor by the 9-axis sensor 22 to calculate the direction in which the terminal device 10 a ′ is facing. The head movement detection unit 207 ′ further outputs a correction value for correcting the inclination with respect to each direction using each of the roll angle, the yaw angle, and the pitch angle acquired from the output of the gyro sensor by the 9-axis sensor 22.

  In the information sharing system according to the fourth embodiment, the commander terminal 30C can be realized with the same hardware configuration and function as the commander terminal 30B described with reference to FIGS. The description in is omitted. The commander terminal 30C can omit the voice I / F 3010, the microphone 3030, and the speaker 3031 from the configuration of FIG. Further, the management server 40C applicable to the fourth embodiment can be realized by the same hardware configuration and function as the management server 40A described with reference to FIGS. 8 and 9, and thus description thereof is omitted here. To do.

  FIG. 41 is a sequence diagram illustrating an example of processing in the information sharing system according to the fourth embodiment. In FIG. 41, parts common to those in FIG. 36 described above are denoted by the same reference numerals, and detailed description thereof is omitted. In FIG. 41, the terminal devices 10a ', 10b' and 10c 'are also shown as "terminal device A'", "terminal device B '" and "terminal device C'", respectively.

  Hereinafter, it is assumed that position information is shared among the terminal device 10a ′ worn by the user A ′, the terminal device 10b ′ worn by the user B ′, and the terminal device 10c ′ worn by the user C ′. Give an explanation. Further, the user D ′ is browsing the positions of the users A ′, B ′, and C ′ simultaneously using the commander terminal 30C as a commander for the users A ′, B ′, and C ′. To do.

  When the terminal device 10a 'makes an initial access to the management server 40C (step S50), the management server 40C generates identification information (ID) for identifying the terminal device 10a' (step S51). The management server 40C stores the generated ID and returns the ID to the terminal device 10a '(step S52). Similarly, for the terminal devices 10b ′ and 10c ′, the management server 40C generates IDs for identifying the terminal devices 10b ′ and 10c ′ according to the first access (step S60 and step S70) (step S61). Step S71), the generated IDs are stored, and the IDs are returned to the terminal devices 10b ′ and 10c ′, respectively (Steps S62 and S72). Here, it is assumed that the management server 40C generates “U001”, “U002”, and “U003” as the IDs of the terminal devices 10a ′, 10b ′, and 10c ′, respectively.

  The commander terminal 30C also makes an initial access to the management server 40C (step S80). In FIG. 41, the management server 40C is shown not to generate an ID for the commander terminal 30C, but this is not limited to this example, and the management server 40C assigns an ID to the commander terminal 30C. It may be generated.

  Furthermore, in FIG. 41, the first access to the management server 40C is executed in the order of the terminal device 10a ′, the terminal device 10b ′, the terminal device 10c ′, and the commander terminal 30C. This is an illustrative example. In addition, the order of the initial access from the terminal devices 10a ′, 10b ′, and 10c ′ and the commander terminal 30C to the management server 40C is not limited to the order illustrated in FIG.

  When the management server 40C receives initial access from the terminal devices 10a ′, 10b ′, and 10c ′ and the commander terminal 30C, the management server 40C communicates with the terminal devices 10a ′, 10b ′, and 10c ′, and the commander terminal 30C. Sessions are established between them (step S81). When the session is established, each of the terminal devices 10a ', 10b' and 10c 'and the commander terminal 30C are in a state where communication with the management server 40C via the network 50 is possible. Accordingly, for example, the terminal devices 10a ', 10b', and 10c 'can share the position information of the other terminal devices via the network 50 and the management server 40C.

  In FIG. 41, the session is established after receiving the initial access from each of the terminal devices 10a ', 10b' and 10c 'and the commander terminal 30C, but this is not limited to this example. For example, the management server 40C can establish a session by receiving initial access from at least two terminal devices of the terminal devices 10a ', 10b', and 10c '.

  When the session with the management server 40C is established, the commander terminal 30C acquires map information (step S82). The commander terminal 30 </ b> C displays a map image based on the acquired map information on the screen 75.

  The next step S90 shows the position information acquisition and position marker update processing in each of the terminal devices 10a ', 10b', and 10c '. In step S90, steps S90a, S90b, and S90c show examples of processing corresponding to the position information acquisition processing in the terminal devices 10a ', 10b', and 10c ', respectively.

  The process of step S90a will be described. In step S90a, the terminal apparatus 10a 'acquires position information indicating the position of the own apparatus using GNSS (step S900). The position information is acquired as latitude and longitude information. The terminal device 10a 'transmits the acquired position information and the ID (= U001) of the own device to the management server 40C (step S901).

  When the management server 40C receives the position information and ID from the terminal device 10a ', the management server 40C transmits the received position information and ID to the other terminal devices 10b' and 10c ', respectively (steps S902 and S904). Although details will be described later, the management server 40C can store the attribute information of the terminal devices 10a ′, 10b ′, and 10c ′ in association with the IDs of the terminal devices 10a ′, 10b ′, and 10c ′. . In this case, the management server 40C can transmit this attribute information to the other terminal devices 10b 'and 10c' together with the position information and ID of the terminal device 10a '.

  When the terminal device 10b ′ receives the position information and ID of the terminal device 10a ′ for the first time from the management server 40C, the terminal device 10b ′ generates a position marker indicating the terminal device 10a ′, and the generated position marker is displayed on the terminal device 10a on the screen 13b. It is displayed at the position corresponding to the position information of '(step S903). In addition, the terminal device 10b 'displays a label including information (for example, ID) indicating the terminal device 10a' at a position corresponding to the position marker on the screen 13b. When the attribute information of the terminal device 10a 'is transmitted from the management server 40C together with the position information and the ID, the terminal device 10b' can display the information included in the attribute information in a label.

  When the terminal device 10b ′ receives the position information and ID of the terminal device 10a ′ after the initial reception from the management server 40C, the terminal device 10b ′ uses a position marker indicating the position of the terminal device 10a ′ already displayed on the screen 13b. The display position and the display position of the label including information indicating the terminal device 10a ′ are updated according to the received position information. The terminal device 10b 'also updates the display position of the information indicating the terminal device 10a' according to the display position of the position marker of the terminal device 10a '.

  The terminal device 10c ′ also performs the same process as the terminal device 10b ′. That is, when the terminal device 10c ′ receives the position information and ID of the terminal device 10a ′ for the first time from the management server 40C, the terminal device 10c ′ generates a position marker and a label corresponding to the terminal device 10a ′, and the terminal device 10a ′ on the screen 13c. Is displayed at a position corresponding to the position information (step S905). Similarly, when the terminal device 10b ′ receives the position information and ID of the terminal device 10a ′ after the initial reception from the management server 40C, the terminal device 10b ′ also includes a position marker corresponding to the terminal device 10a ′ already displayed on the screen 13c, and The display position of the label is updated according to the received position information.

  The management server 40C further transmits the position information and ID of the terminal device 10a 'received from the terminal device 10a' in step S901 to the commander terminal 30C (step S906). The commander terminal 30C sets the terminal device 10a ′ at a position corresponding to the position information on the map image displayed on the screen 75 based on the position information and ID of the terminal device 10a ′ received for the first time from the management server 40C. The marker to be displayed is displayed (step S907).

  When the commander terminal 30C receives the position information and ID of the terminal device 10a ′ after the first reception from the management server 40C, the commander terminal 30C displays a marker indicating the position of the terminal device 10a ′ already displayed on the screen 75. The position is updated according to the received position information.

  In step S90b and step S90c, processing similar to that in step S90a described above is executed in accordance with the acquisition of position information by the terminal device 10b 'and the terminal device 10c', respectively. That is, in step S90b, the terminal device 10b ′ uses GNSS to acquire position information indicating the position of the own apparatus (step S910), and the acquired position information is managed together with the ID (= U002) of the own apparatus. It transmits to 40C (step S911). The management server 40C transmits the position information and ID received from the terminal device 10b 'to the terminal devices 10a' and 10c '(steps S912 and S914).

  Note that the terminal device 10b ′ includes the position information indicating the position of the own device acquired in step S910 and the position information indicating the position of another terminal device, for example, the position of the terminal device 10a ′ received from the management server 40C in step S902. The distance between the own device and another terminal device can be calculated based on the position information indicating The terminal device 10b 'can display the calculated distance on a label corresponding to the other terminal device.

  Each of the terminal devices 10a 'and 10c' generates a position marker indicating the terminal device 10b 'based on the position information and ID of the terminal device 10b' acquired at the first reception from the management server 40C. The terminal devices 10a 'and 10c' display the generated position markers at positions corresponding to the position information of the terminal device 10a 'on the screens 13a and 13c, respectively (steps S913 and S915). In addition, the terminal devices 10a 'and 10c' display labels including information indicating the terminal device 10b 'at positions corresponding to the position markers on the screens 13a and 13c, respectively.

  When the terminal devices 10a ′ and 10c ′ receive the position information and ID of the terminal device 10b ′ after the initial reception from the management server 40C, the terminal devices 10b ′ already displayed on the screens 13a and 13c, respectively. The display position of the position marker indicating the position of the label and the display position of the label including information indicating the terminal device 10b ′ are updated according to the received position information.

  The management server 40C further transmits the position information and ID of the terminal device 10b 'received from the terminal device 10b' in step S911 to the commander terminal 30C (step S916). The commander terminal 30C displays or updates the marker indicating the terminal device 10b ′ on the map image information displayed on the screen 75 based on the position information and ID of the terminal device 10b ′ received from the management server 40C ( Step S917).

  Similarly, in the process in step S90c, the position information indicating the position of the own apparatus acquired by the terminal apparatus 10c ′ in step S920 is transmitted via the management server 40C together with the ID of the terminal apparatus 10c ′ (step S921). 10a 'and 10b' are transmitted (step S922, step S924). Based on the positional information and ID of the terminal device 10c ′ received from the management server 40C, the terminal devices 10a ′ and 10b ′ provide a position marker indicating the position of the terminal device 10c ′ if it is the first reception from the management server 40C. If it is generated and displayed on the screens 13a and 13b and received after the initial reception, the display of the position marker indicating the position of the terminal device 10c ′ already displayed on the screens 13a and 13b is updated (step S923). Step S925).

  Further, the management server 40C transmits the position information and ID received from the terminal device 10c 'to the commander terminal 30C (step S926). The commander terminal 30C updates the position of the marker corresponding to the terminal device 10c 'on the map image displayed on the screen 75 in accordance with the information transmitted from the management server 40C (step S927).

  In the above description, for the sake of explanation, the processing is shown to be executed in the order of step S90a, step S90b, and step S90c, but this is not limited to this example. That is, the processes of step S90a, step S90b, and step S90c are executed every time position information is updated in the terminal devices 10a ', 10b', and 10c '. Therefore, the processing order of steps S90a, S90b, and S90c depends on the acquisition status of the position information from the satellite 60 by the GNSS and the communication environment between the terminal devices 10a ′, 10b ′, and 10c ′ and the management server 40C. It is changed according to the situation. Further, the processes in step S90a, step S90b, and step S90c can be executed in parallel without waiting for the end of each process.

  Through the processing described above, the terminal devices 10a ', 10b', and 10c 'can acquire position information indicating the positions of the other terminal devices in accordance with changes in the positions of the other terminal devices. Thereby, the terminal devices 10a ′, 10b ′, and 10c ′ display the display positions of the position markers indicating the positions of the other terminal devices displayed on the screens 13a, 13b, and 13c, respectively. It can be updated according to the movement of 10b ′ and 10c ′.

  FIG. 42 shows more specifically examples of the screens 13a, 13b, and 13c of the terminal devices 10a ′, 10b ′, and 10c ′ according to the fourth embodiment. In FIG. 42, the screens 13a, 13b, and 13c are represented by the screen 13a. FIG. 42 (b) shows an example of the situation of the user A ′ wearing the terminal device 10a ′ for displaying the screen 13a, and FIG. 42 (a) shows an example of the display of the screen 13a in the situation of FIG. 42 (b). Indicates.

  In FIG. 42B, it is assumed that the upper right direction indicates the north direction. Further, an object 14 that is, for example, a building exists in the north direction with respect to the user A ′. The user B ′ wearing the terminal device 10b ′ exists behind the object 14 as viewed from the user A ′, and the user C ′ wearing the terminal device 10c ′ is located slightly further to the west side than the user B ′. Existing. Each terminal device 10a ′, 10b ′ and 10c ′ detects the position of its own device using GNSS in accordance with the processing of step S900 and step S901, step S910 and step S911, and step S920 and step S921 of FIG. Then, the position information indicating the detected position is transmitted to the management server 40C together with the ID of the own apparatus.

  In the fourth embodiment, in the situation of FIG. 42B, the image of the object 14 is transmitted and displayed as a real image on the screen 13a by the terminal device 10a '. For the other terminal devices 10b 'and 10c', position markers 1301a and 1301b indicating the respective positions and labels 1302a and 1302b including attribute information are superimposed on the real image and displayed.

  The position markers 1301a and 1301b are respectively displayed on the screen 13a at positions corresponding to the directions of the terminal devices 10b 'and 10c' with reference to the position of the terminal device 10a '. The position markers 1301a and 1301b are displayed in a size corresponding to the distance between the terminal device 10a 'and the terminal devices 10b' and 10c '. In the example of FIGS. 42A and 42B, since the user B ′ is closer to the user A ′ than the user C ′, the position marker 1301a corresponding to the user B ′ is the user C ′. Is displayed larger than the position marker 1301b corresponding to.

  The labels 1302a and 1302b are displayed on the screen 13a at positions corresponding to the position markers 1301a and 1301b of the corresponding users B 'and C', respectively. At this time, the labels 1302a and 1302b correspond to the user A '(terminal device 10a'), the user B '(terminal device 10b') and C '(terminal device 10c') with respect to the respective position markers 1301a and 1301b. It is displayed at a height position corresponding to the distance between In this example, the label 1301a corresponding to the user B 'is displayed at a position lower than the label 1302b corresponding to the user C'.

  In the lower part of the screen 13a, an azimuth display 1300 indicating the azimuth in which the terminal device 10a 'is facing is displayed. When the direction in which the terminal device 10a 'is facing is changed, the display of the orientation display 1300 is also changed according to the orientation of the terminal device 10a'. In the example of FIG. 42A, the azimuth display 1300 indicates that 0 ° (N) is displayed at the center in the horizontal direction of the screen 13a, and the terminal device 10a ′ faces north (N). .

  The azimuth display 1300 displays information in an appropriate range according to the angle of view of the screen 13a. In the example of FIG. 42A, the angle of view of the screen 13a is 46 ° (23 ° left and right with respect to the center of the screen 13a), and the azimuth display 1300 is also displayed in the range of 46 °. The azimuth display 1300 can be displayed with a wider angle of view than the angle of view of the screen 13a. In this case, the presence of the user (terminal device) can be confirmed over a wider range, while the position markers 1301a and 1301b are directions of the terminal devices 10b ′ and 10c ′ in the real image displayed through the screen 13a. Will be displayed in a different direction.

  In this way, there is little information that can be displayed on the screen 13a, but whether the display of the position marker is displayed so as to match the orientation, or whether the display of the position marker does not match the orientation but more information is displayed on the screen 13a. Can be selected as appropriate.

  Further, for example, on the screen 13a of the terminal device 10a ′, the display of the position markers 1301a and 1301b of the other terminal devices 10b ′ and 10c ′ is the same as that of the terminal devices 10b ′ and 10c ′ as described with reference to FIG. Updated according to position. For example, consider a case where at least one of the users A ′, B ′, and C ′ moves by walking or the like. In this case, the relative positional relationship between the user A ′ and the users B ′ and C ′ changes, and the position marker 1301a corresponding to the users B ′ and C ′ on the screen 13a according to the change in the positional relationship. And 1301b are dynamically changed.

  Further, on the screen 13a, labels 1302a and 1302b including information on the users B 'and C' are displayed at positions corresponding to the corresponding position markers 1301a and 1301b, respectively. When the positions of the position markers 1301a and 1301b are changed, the display positions of the labels 1302a and 1302b are changed following the change.

  Thus, in the information sharing system according to the fourth embodiment, the position markers 1301a and 1301b indicating the positions of the other users B ′ and C ′ are real images on the screen 13a of the terminal device 10a ′ of the user A ′. Overlay and display. Therefore, for example, even when the users B ′ and C ′ exist behind the object 14 when viewed from the user A ′, the user A ′ knows the existence and approximate position of the users B ′ and C ′. it can.

  For example, in a system that requires image recognition, a position marker cannot be displayed for an object that a user wearing a spectacle-type device cannot see. In contrast, in the information sharing system according to the fourth embodiment, a position marker indicating the position of another terminal device is displayed based on the position information of each terminal device detected using GNSS. Therefore, for example, as shown in FIG. 42B, even if the object 14 such as a building exists as a shield between the user A ′ and the users B ′ and C ′, the user A The position markers 1301a and 1301b indicating the positions of the users B 'and C' and labels 1302a and 1302b corresponding to the positions are displayed on the screen 13a of the terminal device 10a to be worn by '. Therefore, the user A ′ can grasp how far and in what direction the users B ′ and C ′, who are hidden behind the shielding and cannot see, are seen from the user A ′.

  Further, the terminal device 10a 'displays the markers 1301a and 1301b corresponding to the users B' and C ', respectively, on the screen 13a with a size corresponding to the distance between the users B' and C '. Therefore, the user A ′ can intuitively grasp which of the users B ′ and C ′ is closer.

  Further, for example, the terminal device 10a ′ according to the fourth embodiment uses a display in a transmissive state, and displays a real image in which position markers 1301a and 1301b indicating the other terminal devices 10b ′ and 10c ′ are transmitted through the display. Are superimposed and displayed. Therefore, the user A ′ wearing the terminal device 10 a ′ can easily see the outside world including the object 14.

(Details of each display process according to the fourth embodiment)
Next, each display process according to the fourth embodiment will be described in more detail. FIG. 43 shows more specific processing of displaying position markers by the terminal devices 10a ′, 10b ′, and 10c ′ according to the fourth embodiment in step S90a, step S90b, and step S90c of the sequence diagram of FIG. 41 described above. It is a flowchart of an example shown in. Here, each terminal device 10a ′, 10b ′, and 10c ′ will be described by being represented by the terminal device 10a ′. Each of the terminal devices 10a ′ to 10c ′ has already established a session with the management server 40C through the processes of Step S50 to Step S52, Step S60 to Step S62, and Step S70 to Step S72 of FIG. Assume that IDs are acquired from the management server 40C.

  In step S200, the terminal apparatus 10a 'uses the GNSS to acquire position information indicating the position of the terminal apparatus 10a' itself using the position information acquisition unit 202 (step S900 in FIG. 41). The position information is acquired by latitude and longitude. The terminal device 10a 'transmits the acquired position information and the ID of the own device to the management server 40C. In the next step S201, the terminal device 10a 'uses the receiving unit 200 to acquire the position information and ID of other terminal devices (terminal devices 10b' and 10c ') from the management server 40C.

  In the next step S202, the terminal device 10a ′ uses the display information generation unit 204 ′ to obtain the position information indicating the position of the own device acquired in step S200 and the other terminal devices 10b ′ and 10c ′ acquired in step S201. Based on each position information, the azimuth | direction and distance of other terminal device 10b 'and 10c' with respect to an own apparatus are calculated.

As an example, the azimuth | direction and distance with respect to an own device of the terminal device (for example, terminal device 10b ') made into the object which displays a position marker among other terminal device 10b' and 10c 'coordinate the position of an own device (x ₁ , y ₁ ) and the position of the terminal device 10 b ′ is the coordinates (x ₂ , y ₂ ), the distance d between the own device, that is, the terminal device 10 a ′ and the terminal device 10 b ′ is expressed by the following formula ( It can be calculated by 1). In equation (1), the constant r is the earth radius and r≈6378.137 km.

Further, the orientation θ of the target terminal device viewed from the terminal device 10a ′ can be calculated by the following equation (2). In Expression (2), Δx = x ₂ −x ₁ .

In the next step S203, the terminal device 10a ′ uses the display information generation unit 204 ′ to perform coordinate conversion based on the distance d and the azimuth θ calculated in step S202, and the position marker 3 indicating the position of the target terminal device. A three-dimensional coordinate (x, y, z) in the dimensional space is obtained. Here, assuming that the vertical axis is the y-axis, the y-value is a fixed value (c _const ), the position of the terminal device 10b ′ in the y-axis direction is the same height as the own device. The three-dimensional coordinates of the position marker of the target terminal device when the position of the own device is the coordinate (0, c _const , 0) are expressed as target (x, y, z) by the following equation (3). It can be calculated.

  In the next step S204, the terminal device 10a 'determines whether or not drawing of the position marker of the target terminal device is the first drawing by the display information generation unit 204'. If the display information generation unit 204 'determines that the drawing is the first drawing (step S204, "Yes"), the process proceeds to step S205. In step S205, the display information generation unit 204 ′ generates a marker object for displaying a position marker corresponding to the target terminal device, and sets the target (x, y) obtained in step S203 to the generated marker object. , Z) is given as coordinate information for drawing.

  On the other hand, in the terminal device 10a ′, the display information generation unit 204 ′ determines that the drawing of the position marker of the target terminal device is not the first drawing, that is, the target terminal device already on the screen 13a of the terminal device 10a ′. If it is determined that the position marker is already displayed, the process proceeds to step S206. In step S206, the display information generation unit 204 ′ obtains the coordinate information indicating the position of the position marker of the target terminal device already displayed, and the value of the target (x, y, z) obtained in step S203. Update to

  When the process of step S205 or step S206 ends, the process proceeds to step S207. In step S207, the display information generation unit 204 ′ displays the marker image by the marker object of the position marker indicating the position of the target terminal device as the position of the target (x, y, z) given in step S205 or step S206. To draw. Thereby, the position marker indicating the position of the target terminal device (in this example, the terminal device 10b ′) on the screen 13a of the terminal device 10a ′ corresponds to the orientation in the screen 13a where the terminal device exists. Are displayed in a size corresponding to the distance from the terminal device 10a ′.

  In step S207, the display information generation unit 204 'displays a label including information on the target terminal device in the direction corresponding to the marker object of the position marker of the target terminal device. On the label, for example, the ID of the target terminal device and the distance d from the own device to the target terminal device can be displayed. Further, the attribute information of the target terminal device is transmitted from the management server 40C to the terminal device 10a ′ in association with the ID of the target terminal device, so that the attribute information can be further displayed on the label. it can.

  When the marker object image of the position marker is drawn in step S207, the process returns to step S200, and the processes from step S200 described above are executed. Thereby, even if the own device and the target terminal device move, the position marker or label of the target terminal device can be drawn by dynamically changing the position in the screen 13a. The user A ′ wearing the terminal device 10a ′ roughly indicates in what direction and how far away the users B ′ and C ′ wearing the other terminal devices 10b ′ and 10c ′ from the user A ′. You can check in real time.

(Display control according to the movement of the head according to the fourth embodiment)
Next, display control of the screen 13a according to the movement of the head 80 of the user A ′ wearing the terminal device 10a ′ according to the fourth embodiment will be described. In the following, it is assumed that the user A ′ correctly wears the eyeglass unit 1C on the head 80, and the direction of the head 80 is synonymous with the direction of the front 11B in the eyeglass unit 1C. Also, in the following FIGS. 44 to 46, the same reference numerals are given to the portions corresponding to FIG. 42A described above, and detailed description thereof will be omitted. Further, it is assumed that the users A ′, B ′, and C ′ are in the positional relationship shown in FIG.

  Based on the output of the head movement detection unit 207 ′ corresponding to the detection output of the 9-axis sensor 22, the terminal device 10a ′, for example, a position marker corresponding to each of the users B ′ and C ′. Display information for displaying 1301a and 1301b and corresponding labels 1302a and 1302b on the screen 13a is generated. In addition, the display information generation unit 204 ′ displays, on the screen 13a, an orientation display 1300 that indicates the orientation in which the head 80 faces based on the output of the head movement detection unit 207 ′ according to the detection output of the 9-axis sensor 22. Display information to be generated.

  First, display control according to the movement of the head 80 around the vertical axis according to the fourth embodiment will be described with reference to FIG. The movement of the head 80 around the vertical axis corresponds to an operation of rotating the head 80 left and right. In the movement of the head 80 around the vertical axis, the pitch angle and the roll angle do not change and only the yaw angle changes in the eyeglass unit 1C. 44 (a) to 44 (c) show display examples of the screen 13a when the pitch angle and the roll angle are fixed and only the yaw angle changes.

  Based on the detection output of the gyro sensor included in the 9-axis sensor 22, the terminal device 10a 'can estimate whether the head 80, that is, the front 11B of the spectacle unit 1C is moving in the left-right direction. Further, based on the detection output of the geomagnetic sensor included in the 9-axis sensor 22, the heading direction of the head 80 can be estimated. Therefore, the terminal device 10 a ′ can estimate the movement of the head 80 around the vertical axis based on the detection outputs of the gyro sensor and the geomagnetic sensor included in the 9-axis sensor 22.

  FIG. 44 (b) corresponds to the state of FIG. 42 (b) described above. In this case, the head 80 (gaze direction) faces north (N) and the gyro sensor of the 9-axis sensor 22 In the detection output, the yaw angle = 0 °. In the azimuth display 1300, north (N) is set to 0 ° in azimuth, and the angle increases clockwise.

  FIG. 44 (c) shows an example of display on the screen 13a when the head 80 is turned in the east direction around the vertical axis at an angle of 20 ° with respect to the state of FIG. 44 (b). For example, the user A ′ rotates the head 80 around the vertical axis and looks to the right by an angle of 20 ° from the state of FIG. The terminal device 10a ′ estimates that the head 80 has turned in the east direction around the vertical axis based on the detection output of the gyro sensor and the geomagnetic sensor included in the 9-axis sensor 22, and displays the screen 13a according to the estimation result. Update.

  In the example of FIG. 44C, the center of the azimuth display 1300 indicates the azimuth 20 °, and the position marker 1301a and the label 1302a corresponding to the user B ′ existing in the direction substantially north with respect to the user A ′ are the azimuth display 1300. Corresponding to the north (N) position of the screen 13a, the screen is moved to the left in the screen 13a. On the screen 13a, the position marker 1301b and the label 1302b are moved out of the screen 13a and are not displayed. This means that the user C 'corresponding to the position marker 1301b and the label 1302b does not exist in the direction toward the user A'.

  FIG. 44 (a) shows an example of display on the screen 13a when the head 80 changes its direction in the west direction around the vertical axis at an angle of 20 ° with respect to the state of FIG. 44 (b). For example, the user A ′ rotates the head 80 around the vertical axis and looks left by an angle of 20 ° from the state shown in FIG. The terminal device 10a ′ estimates that the head 80 has turned in the west direction around the vertical axis based on the detection output of the gyro sensor and the geomagnetic sensor included in the 9-axis sensor 22, and displays the screen 13a according to the estimation result. Update.

  Also in this case, as in the example of FIG. 44C, the center of the azimuth display 1300 indicates the azimuth 340 ° (−20 °) and corresponds to the user C ′ existing in the west direction with respect to the user A ′. The position marker 1301b and the label 1302b are moved and displayed in the right direction of the screen 13a. On the screen 13a, the position marker 1301a and the label 1302a are moved out of the screen 13a and are not displayed. This means that the user B 'corresponding to the position marker 1301a and the label 1302a does not exist in the direction toward the user A'.

  As described above, the terminal device 10a ′ according to the fourth embodiment corresponds to other users B ′ and C ′ based on the detection result of the movement of the head 80 around the vertical axis by the head movement detection unit 207 ′. The display positions of the position markers 1301a and 1301b and the labels 1302a and 1302b on the screen 13a are controlled so as to coincide with the directions around the vertical axes of the users B ′ and C ′ as viewed from the user A ′. Therefore, even if the user A ′ rotates the head 80 left and right, the direction of the position markers 1301a and 1301b corresponding to the other users B ′ and C ′ and the real image displayed through the front 11B are displayed. The positional relationship becomes fixed, and the user A ′ can intuitively grasp the positions of the users B ′ and C ′.

  Next, display control according to the movement of the head 80 around the horizontal axis according to the fourth embodiment will be described with reference to FIG. The movement of the head 80 around the horizontal axis corresponds to an operation of tilting the head 80 up and down. In the movement of the head 80 around the horizontal axis, in the eyeglass unit 1C, the yaw angle and roll angle do not change, but only the pitch angle changes. 45A to 45C show display examples of the screen 13a when the yaw angle and roll angle are fixed and the pitch angle changes.

  The terminal device 10 a ′ can estimate whether or not the head 80 is moving in the vertical direction based on the detection output of the gyro sensor included in the 9-axis sensor 22. Further, the direction in which the head 80 is facing can be estimated based on the detection result of the geomagnetic sensor included in the 9-axis sensor 22. Therefore, the terminal device 10 a ′ can estimate the movement of the head 80 around the horizontal axis based on the detection outputs of the gyro sensor and the geomagnetic sensor included in the 9-axis sensor 22.

  FIG. 45 (b) corresponds to the state of FIG. 42 (b) described above. In this case, the head 80 (gaze direction) faces the horizontal direction, and the detection output of the gyro sensor of the 9-axis sensor 22 is shown. , The pitch angle = 0 °.

  FIG. 45 (c) shows an example of display on the screen 13a when the head 80 is turned downward around the horizontal axis with respect to the state of FIG. 45 (b). The terminal device 10a ′ estimates that the head 80 has turned downward about the horizontal axis based on the detection output of the gyro sensor and the geomagnetic sensor included in the 9-axis sensor 22, and updates the display of the screen 13a according to the estimation result. To do.

  In the example of FIG. 45C, the labels 1302a and 1302b corresponding to the users B ′ and C ′ displayed on the upper side of the screen 13a of FIG. 45B are moved out of the screen 13a and are not displayed. It is said. Further, the position markers 1301a and 1301b corresponding to the users B 'and C' move to the upper side of the screen 13a and are displayed at the positions to be looked up. In addition, the display area of the azimuth display 1300 is wider than that in the example of FIG.

  FIG. 45A shows a display example of the screen 13a when the head 80 is turned upward around the horizontal axis with respect to the state of FIG. 45B. In this case, the position markers 1301a and 1301b and the labels 1302a and 1302b corresponding to the users B 'and C' are moved and displayed on the lower side of the screen 13a. The orientation display 1300 is not displayed.

  As described above, the terminal device 10a ′ according to the fourth embodiment corresponds to the other users B ′ and C ′ based on the detection result of the movement of the head 80 around the horizontal axis by the head movement detection unit 207 ′. The display positions of the position markers 1301a and 1301b and the labels 1302a and 1302b on the screen 13a are controlled so as to coincide with the directions around the horizontal axes of the users B ′ and C ′ viewed from the user A ′. Therefore, even if the user A ′ moves the head 80 up and down, the direction of the position markers 1301a and 1301b corresponding to the other users B ′ and C ′ and the position of the real image displayed through the front 11B The relationship becomes fixed, and the user A ′ can intuitively grasp the positions of the users B ′ and C ′.

  Next, display control according to the movement of the head 80 around the longitudinal axis according to the fourth embodiment will be described with reference to FIG. The movement of the head 80 around the front-rear axis corresponds to, for example, an operation of tilting the head 80 while facing the front. In the movement around the front-rear axis of the head 80, the yaw angle and the pitch angle do not change and only the roll angle changes in the eyeglass unit 1C. 46A to 46C show display examples of the screen 13a when the yaw angle and the pitch angle are fixed and the roll angle changes.

  The terminal device 10 a ′ can estimate the inclination of the head 80 based on the detection output of the gyro sensor included in the 9-axis sensor 22. Further, the direction in which the head 80 is facing can be estimated based on the detection result of the geomagnetic sensor included in the 9-axis sensor 22. Therefore, the terminal device 10 a ′ can estimate the movement of the head 80 around the front-rear axis based on the detection outputs of the gyro sensor and the geomagnetic sensor included in the 9-axis sensor 22.

  FIG. 46B corresponds to the state of FIG. 42B described above. In this case, the head 80 stands upright, and the roll angle = 0 ° in the detection output of the gyro sensor of the 9-axis sensor 22. It has become.

  FIG.46 (c) shows the example of a display of the screen 13a when the head 80 is inclined leftward with respect to the state of FIG.46 (b). Based on the detection output of the gyro sensor and the geomagnetic sensor included in the 9-axis sensor 22, the terminal device 10a ′ estimates that the head 80 has turned to the left around the front-rear axis, and displays the screen 13a according to the estimation result. Update.

  In the example of FIG. 46C, the position marker 1301a and the label 1302a corresponding to the user B ′ and the position marker 1301b and the label 1302b corresponding to the user C ′ are maintained in the positional relationship within the screen 13a. Rotate clockwise. By this control, the position marker 1301a and the label 1302a in the screen 13a, and the position marker 1301b and the label 1302b are kept horizontal with respect to the real image. In the example of FIG. 46C, the right end side of the orientation display 1300 protrudes outside the screen 13a and is not displayed.

  FIG. 46A shows an example of the screen 13a in which the head 80 is tilted to the right with respect to the state of FIG. In this case, the position marker 1301a and the label 1302a, and the position marker 1301b and the label 1302b rotate counterclockwise while maintaining the mutual positional relationship within the screen 13a. By this control, the position marker 1301a and the label 1302a in the screen 13a, and the position marker 1301b and the label 1302b are kept horizontal with respect to the real image. In the example of FIG. 46A, the left end side of the orientation display 1300 protrudes outside the screen 13a and is not displayed.

  The human eyeball is equipped with a mechanism that prevents the brain from perceiving the horizontal and tilt of a real-world visual target (real image) by moving so as to compensate for the movement of the head 80. The control described with reference to FIGS. 46A to 46C uses this characteristic.

  As described above, the terminal device 10a ′ according to the fourth embodiment corresponds to the other users B ′ and C ′ based on the detection result of the movement around the front-rear axis of the head 80 by the head movement detection unit 207 ′. The display positions of the position markers 1301a and 1301b and the labels 1302a and 1302b on the screen 13a are controlled so as to be kept horizontal with respect to the real image while maintaining the mutual positional relationship. Therefore, even when the user A ′ tilts the head 80, the positional relationship between the direction of the position markers 1301a and 1301b corresponding to the other users B ′ and C ′ and the real image that is transmitted through the front 11B is displayed. The user A ′ can intuitively grasp the positions of the users B ′ and C ′.

  The display control described with reference to FIGS. 44 to 46 includes, for example, an area in which image information is output from a video memory included in the display information generation unit 204 ′. It is possible by setting based on the result.

  As an example, the video memory included in the display information generation unit 204 ′ has a capacity capable of drawing an image having an angle of view larger than the angle of view of the screen 13 a. The display information generation unit 204 ′ generates each position marker corresponding to all the terminal devices in accordance with the position information of all the terminal devices received from the management server 40C, and image information for displaying all the generated position markers. Is written in the video memory, and image information is drawn. The display information generation unit 204 ′ cuts out image information corresponding to the display area of the screen 13a from the image information drawn in the video memory based on the detection result of the movement of the head 80 by the head movement detection unit 207 ′. Output.

  Next, display control of a label including information related to another user according to the fourth embodiment will be described with reference to FIG. In the screen 13a of the terminal device 10a 'illustrated in FIG. 47, the origin is the upper left corner, the horizontal direction is the x axis whose coordinate value increases in the right direction, and the vertical direction is the y axis whose coordinate value increases in the downward direction. . Here, it is assumed that the users A ′, B ′, C ′, and E are wearing the terminal devices according to the fourth embodiment, respectively.

  When the difference between the orientations of the users B ′ and C ′ when viewed from the user A ′ is small, the position markers 1301a and 130 ′ corresponding to the users B ′ and C ′ respectively on the screen 13a of the terminal device 10a ′ worn by the user A ′ The display position 1301b approaches. Further, as the display positions of the position markers 1301a and 1301b approach, the labels 1302a and 1302b corresponding to these may be displayed in a partially overlapped manner. In this case, of the labels 1302a and 1302b, the contents of the label displayed on the back surface may be hidden by the label displayed on the front surface of the label, making recognition difficult.

  Therefore, in the fourth embodiment, the background of each label 1302a and 1302b is translucent (for example, transmittance 40% to 60%). At the same time, in the fourth embodiment, the y-coordinates on the screen 13a of the labels 1302a and 1302b are determined according to the distance between the users B ′ and C ′ corresponding to the labels 1302a and 1302b and the user A ′. Change. Thereby, it is possible to easily confirm the contents of each label corresponding to a plurality of users having a small difference in orientation when viewed from a certain user.

  Further, consider a user E wearing the terminal device according to the fourth embodiment, which is closer to the user A 'and closer to the user B', and is further away. For example, it is assumed that the distance between the user A ′ and the user B ′ is 50 m, the distance between the user A ′ and the user C ′ is 250 m, and the distance between the user A ′ and the user E is 1.2 km. In this case, as illustrated in FIG. 47, the position marker corresponding to the user E is on the back surface of the position marker 1301a of the user B 'and is not displayed on the screen 13a. On the other hand, the label 1302c corresponding to the user E is displayed on the screen 13a above the label 1302a corresponding to the user B 'whose background is translucent. Therefore, the user A ′ can intuitively grasp that the user E exists in a direction closer to the user B ′ and further away from the user B ′.

  Here, the background of each of the labels 1302a to 1302c is translucent, but this is not limited to this example. For example, the position markers 1301a and 1301b may be further translucent. In this case, the user A 'can confirm the position marker corresponding to the user E through the position marker 1301a.

  FIG. 48 is a flowchart illustrating an example of label display processing according to the fourth embodiment. Here, description will be made assuming the state of FIG. That is, it is assumed that the users A ′, B ′, C ′, and E wearing the terminal device according to the fourth embodiment are in the positional relationship described with reference to FIG. Hereinafter, the label display process will be described by taking the terminal device 10a 'worn by the user A' as an example. Hereinafter, for convenience, a terminal device worn by the user E is referred to as a terminal device E, and a position marker corresponding to the terminal device E is referred to as a position marker E.

  Prior to the processing of the flowchart of FIG. 48, the processing described using steps S50 to S72 of FIG. 41 is executed, and the terminal devices 10a ′, 10b ′, and 10c ′ of the users A ′, B ′, C ′, and E are performed. The terminal device E makes an initial access to the management server 40C and is given an ID. Further, the terminal devices 10a ′, 10b ′, and 10c ′, and the terminal device E manage the attribute information of the users A ′, B ′, C ′, and E to be attached at the first access to the management server 40C. Transmit to server 40C.

  48, in step S300, in the terminal device 10a ′, the display information generation unit 204 ′ performs the terminal devices 10a ′, 10b ′, and 10c ′ of the other users B ′, C ′, and E acquired from the management server 40C, In addition, the distance between the user A ′ and each of the users B ′, C ′ and E is calculated based on the position information of the terminal device E, and the positions of the terminal devices 10b ′ and 10c ′ and the terminal device E are respectively shown The position markers 1301a and 1301b and the position marker E are generated. The display information generation unit 204 ′ writes the generated position markers 1301a and 1301b and the position marker E to the video memory included in the display information generation unit 204 ′, and draws the position markers 1301a and 1301b and the position marker E. Do.

  In the next step S301, the display information generation unit 204 'acquires a direction in which the own device (terminal device 10a') faces from the head movement detection unit 207 '. In this case, the direction in which the device is facing includes the directions around the vertical axis, the horizontal axis, and the front-rear axis. The terminal device 10a ′ is displayed on the screen 13a by the display information generation unit 204 ′ based on the direction of the own device, the terminal devices 10b ′ and 10c ′ acquired from the management server 40C, and the position information of the terminal device E. The number of position markers (j) to be displayed is counted.

  That is, in step S301, out of the position marker 1301a and 1301b and the position marker E out of the screen 13a based on the direction in which the device is facing, the position markers 1301a and 1301b, and the position of the position marker E. The position marker located at is not counted. In the example of FIG. 47, since the position markers 1301a and 1301b are displayed in the screen 13a, and the position marker E exists at a position hidden behind the position marker 1301a, the number of position markers (j) = 3. At this time, the display information generation unit 204 'displays the position markers 1301a and 1301b in the screen 13a.

  In the next step S302, the display information generation unit 204 ′ obtains information indicating the position markers 1301a and 1301b and the position marker E included in the screen 13a, the own device, the terminal devices 10b ′ and 10c ′, and Sort based on the distance to the terminal device E. Here, the sorting is performed in descending order, and each of the terminal devices 10b ′ and 10c ′, and the terminal device E, a variable that increases by 1 from 1 in order from the position marker corresponding to the terminal device that is closest to the own device. (I) is associated as information indicating a position marker.

  Here, referring to FIG. 47, variable (i) = 1 is associated with the position marker 1301a indicating the terminal device 10b ′ closest to the terminal device 10a ′, and hereinafter, the variable (i) = 2 is associated with the position marker 1301b. The variable (i) = 3 is associated with the position marker E corresponding to the terminal device E farthest from the terminal device 10a ′. In the following, unless otherwise specified, the position marker 1301a is the position marker (1), the position marker 1301b is the position marker (2), the position marker E is the position marker (3), and each of the position markers (1) to (3). Are collectively referred to as a position marker (i).

  In the next step S303, the display information generation unit 204 'acquires the coordinate x (i) in the horizontal direction (x-axis direction) on the screen 13a of each position marker (i) included in the screen 13a.

  In the next step S304, the display information generation unit 204 'initializes the variable (i) to 1. In the next step S305, the display information generation unit 204 'determines whether or not the variable (i) is equal to the number of position markers (j). When the display information generation unit 204 'determines that the variable (i) is equal to the number of position markers (j) (step S305, "Yes"), the process returns to step S300.

If the display information generation unit 204 ′ determines that the variable (i) and the number of position markers (j) are different in step S305 (step S305, “No”), the process proceeds to step S306. In step S306, the display information generation unit 204 ′ sets y = c _const − (a × i) as the vertical coordinate y (i) of the label with respect to the position marker (i) included in the screen 13a. Here, the constant a is assumed to be a predetermined value of 1 or more. The constant a may be determined according to the number of pixels (number of lines) in the vertical direction of the screen 13a, for example, a = 20. The value c _const is the y coordinate of the position marker.

  In the next step S307, the display information generation unit 204 'draws the label (i) corresponding to the position marker (i) at the coordinates (x (i), y (i)) in the screen 13a. At this time, when the label (i) corresponding to the position marker (i) has already been drawn in the screen 13a, the display information generation unit 204 ′ displays the display of the label (i) of the position marker (i). Update according to the coordinate x (i).

  In the example of FIG. 47, label (i), that is, labels (1) to (3) respectively correspond to labels 1302a, 1302b, and 1302c.

  In the next step S308, the display information generation unit 204 'adds 1 to the variable (i), and returns the process to step S305.

  This will be described more specifically with reference to FIG. As an example, it is assumed that the resolution of the screen 13a is 1280 pixels × 720 lines. The x coordinate of the position marker 1301a of the user B ′ is x = 400 (pixels), the x coordinate of the position marker 1301b of the user C ′ is x = 360, and the position corresponding to the user E on the back of the position marker 1301a of the user B ′. Assume that the x coordinate of the marker E is x = 410.

  In step S302, the position marker 1301a and 1301b in the screen 13a and the information of the position marker E using the distances between the terminal device 10a ′ and the terminal devices 10b ′ and 10c ′ and the terminal device E as keys. Sort in descending order. In this example, each of the position markers 1301a and 1301b and the position marker E is sorted in the order of the position marker 1301b and the position marker 1301a, starting with the position marker E. The position marker E, the position marker 1301b, and the position marker 1301a are given a variable (i) that increases one by one according to the descending sort order, and the position marker (1), the position marker (2), and the position marker (3) To do.

  In step S304, the variable (i) as a loop variable is initialized to 1, and the variable (i) is incremented by 1 each time. The loop processing in steps S305 to S308 corresponds to each position marker (i). Each label (i) is drawn at coordinates (x (i), y (i)). More specifically, referring to FIG. 47, the label 1302c corresponding to the position marker E is drawn at the coordinates (410, 20) in the screen 13a with the variable (i) = 1. With variable (i) = 2, a label 1302b corresponding to the position marker 1301b is drawn at coordinates (360, 40) in the screen 13a. Further, with variable (i) = 3, a label 1302a corresponding to the position marker 1301a is drawn at coordinates (400, 60) in the screen 13a.

  By such display control, a label for the position marker indicating the position of the other terminal device at a distance close to the own device is displayed at the lower part of the screen 13a, and is displayed on the front surface when the labels overlap. As a result, the user A 'of the own device (terminal device 10a') can intuitively check the label corresponding to the terminal device located near the own device among the plurality of other terminal devices.

  Next, display control of the screen 13a on the terminal device 10a 'according to an operation such as movement of the user A' wearing the terminal device 10a 'according to the fourth embodiment will be described. In general, a human always takes a behavior such as walking while visually searching for surrounding information by moving his / her head and eyes. Therefore, for example, even when the visibility to the outside world is ensured by making the screen 13a of the terminal device 10a 'transparent and displaying information such as a position marker on the real image on the screen 13a. Compared to the case where the information superimposed on the screen 13a is not displayed, attention to the surroundings is neglected.

  In consideration of this point, for example, the terminal device 10a ′ detects whether the user A ′ wearing is stationary or walking, and switches the information display on the screen 13a according to the detected state. This is preferable.

49, switching of information display on the screen 13a according to the state of the user A ′ wearing the terminal device 10a ′, for example, applicable to the fourth embodiment will be described. FIG. 49B schematically shows a state where the state of the user A ′ transitions from the stationary state (left side) to the walking state (right side). FIG. 49A shows an example of the screens 13a ₁₀ , 13a ₁₁ and 13a ₁₂ of the terminal device 10a ′ in each state of the walking state while the user A ′ is in the stationary state, the transition from the stationary state to the walking state. .

For example, if the user A ′ is in a stationary state, it is considered that attention is paid to surrounding information as compared to the case of walking, and the user A ′ needs the surrounding information. Therefore, as illustrated in the screen 13a _10, as usual, position markers 1301a and 1301b, labels 1302a and 1302b, and to display the azimuth display 1300.

When the user A ′ starts walking, the user A ′ decides which direction to proceed and needs to pay attention to surrounding information during the walking. Therefore, when it is detected that the state of the user A ′ transitions from the stationary state to the walking state, the position markers 1301a and 1301b, the labels 1302a and 1302b, and the direction display 1300 displayed in the stationary state are displayed. Permeate gradually. Screen 13a ₁₁ shows an example of position markers 1301a ′ and 1301b ′, labels 1302a ′ and 1302b ′, and orientation display 1300 ′ that are semi-transparent to the display of screen 13a ₁₀ .

When the state of the user A ′ becomes a walking state, it is necessary to pay more attention to surrounding information. Therefore, as illustrated in the screen 13a ₁₂ , the display of the position markers 1301a and 1301b, the labels 1302a and 1302b, and the orientation display 1300 is completely transmitted and hidden. Thereby, the visibility of the user A ′ to the outside world is enhanced, and the user A ′ can walk safely.

If the state of the user A 'becomes quiescent state again, returns the display screen 13a on the state of the screen 13a _10, position markers 1301a and 1301b, labels 1302a and 1302b, and to display the azimuth display 1300 again. As a result, the user A ′ can confirm again what is in which direction. Whether or not such control is possible is preferably set by the user A ′.

  The walking state detection by the terminal device 10a 'according to the fourth embodiment will be described with reference to FIG. The terminal device 10a 'detects, for example, the stationary state and walking state of the user A' wearing the terminal device 10a 'by using the output of the acceleration sensor by the 9-axis sensor 22 by the head movement detection unit 207'.

  In FIG. 50, the vertical axis indicates the acceleration a in the vertical direction and the horizontal axis indicates the time t, and the characteristic line 1400 indicates the acceleration in the vertical direction (for example, y) among the three-axis accelerations that can be acquired from the output of the 9-axis sensor 22. The value in the axial direction is plotted against time t. The change of the acceleration a in the vertical direction with respect to the time t in the stationary state Stp and the walking state Wk of the user A ′ is very large with respect to the stationary state Stp. Further, the change in the acceleration a in the walking state Wk repeats increase and decrease periodically with respect to the time t. At this time, one step of walking corresponds to one cycle of a change in acceleration a.

For example, the terminal device 10a ′ constantly acquires the acceleration a in the vertical direction based on the output of the 9-axis sensor 22 according to the head movement detection unit 207 ′. The terminal device 10a ′ divides the acquired acceleration a by a predetermined time Δt, and calculates the average value of the acceleration a within the divided time Δt, so that the current state is the walking state and the stationary state. Which can be estimated. Based on the result of this state estimation, the terminal device 10a ′ can execute the display control of the screens 13a _{10 to} 13a ₁₂ described with reference to FIG.

(Display example of the commander terminal according to the fourth embodiment)
Next, a display example of the screen 75 in the commander terminal 30C according to the fourth embodiment will be described. First, the information transmitted / received between each terminal device 10a ′, 10b ′ and 10c ′ and the management server 40C will be described using Table 1 and Table 2.

  Table 1 shows an example of information transmitted from the terminal device 10a 'to the management server 40C. As shown in Table 1, the information transmitted to the management server 40C by the terminal device 10a 'includes information on each item of "ID", "latitude", and "longitude".

  The item “ID” is an ID (= U001) for identifying the terminal device 10a ′, and is given from the management server 40C, for example, in the first access (step S50 to step S52 in FIG. 41) to the management server 40C. Further, the information on the items “latitude” and “longitude” is position information indicating the position of the terminal device 10a ′, and is acquired by the position information acquisition unit 202 using GNSS in step S900 of FIG.

  The information in Table 1 is transmitted from the terminal device 10a 'to the management server 40C in step S901 of FIG. Note that the information transmitted from the terminal devices 10b 'and 10c' to the management server 40C in step S911 and step S921 in FIG. 41 includes the same items as in Table 1, and thus the description thereof is omitted here. The management server 40C manages the location information of each terminal device 10a ′, 10b ′, and 10c ′ based on the information in Table 1 transmitted from each terminal device 10a ′, 10b ′, and 10c ′ that has established a session. .

  Table 2 shows an example of information transmitted from the management server 40C to the terminal device 10a '. As shown in Table 2, the information transmitted from the management server 40C to the terminal device 10a 'includes information on items of "ID", "name", "latitude", and "longitude".

  The item “ID” is an ID for identifying a target other than the own device. When the own device is the terminal device 10a ′, the other terminal device 10b ′ that has established a session with the management server 40C. And ID of 10c ′ (U002, U003). The management server 40C generates IDs of these other terminal devices 10b 'and 10c' in response to the first access from the other terminal devices 10b 'and 10c' (steps S61 and S71 in FIG. 41).

  In addition, the item “ID” in Table 2 is an ID for identifying a target other than each terminal device 10a ′, 10b ′, and 10c ′ that has established a session with the management server 40C (in the example of Table 2). ID = L001, L002).

  In Table 2, the item “name” indicates a name associated with each ID. The items “latitude” and “longitude” indicate target position information corresponding to each ID.

  Of the names indicated by the item “name”, the names associated with the IDs indicating the terminal devices 10a ′, 10b ′, and 10c ′ are set in the commander terminal 30C, for example, as will be described later, from the commander terminal 30C. It is transmitted to the management server 40C. Not limited to this, the names associated with the IDs indicating the terminal devices 10a ′, 10b ′, and 10c ′ are respectively input in the terminal devices 10a ′, 10b ′, and 10c ′. For example, step S50 in FIG. It can also be transmitted to the management server 40C at the first access in S60 and step S70.

  The information of the items “latitude” and “longitude” associated with the IDs indicating the terminal devices 10a ′, 10b ′, and 10c ′ in Table 2 are, for example, the terminal devices 10a of step S901, step S911, and step S921 in FIG. Updated by communication with '10b' and 10c '.

  In Table 2, information for identifying objects other than the terminal devices 10a ′, 10b ′, and 10c ′ and items “name”, “latitude”, and “longitude” associated with the ID are, for example, commanders The data is input at the terminal 30C and transmitted to the management server 40C. Targets other than the terminal devices 10a ′, 10b ′, and 10c ′ are destinations and landmarks, for example. In general, the values of the items “latitude” and “longitude” are not automatically updated. .

  The information in Table 2 is transmitted from the management server 40C to the terminal devices 10b 'and 10c' in step S902 and step S904 in FIG. Note that the information transmitted in steps S912 and S914 and steps S922 and S924 of FIG. 41 from the management server 40C to the terminal devices 10b ′ and 10c ′ includes the same items as in Table 2, The description of is omitted.

  By transmitting target information other than the terminal devices 10a ′, 10b ′ and 10c ′ from the management server 40C to the terminal devices 10a ′, 10b ′ and 10c ′, the terminal devices 10a ′, 10b ′ and In 10c ′, a position marker indicating the position of the target, that is, the destination or the landmark can be displayed on each of the screens 13a, 13b, and 13c. Thereby, even if the destination or landmark is in a position where it cannot be visually recognized from each user A ′, B ′ and C ′ wearing each terminal device 10a ′, 10b ′ and 10c ′, each user A ′, B ′ and C ′ can intuitively confirm in which direction and at what distance these destinations and landmarks are located.

  FIG. 51 shows an example of display on the screen 75 of the commander terminal 30C applicable to the fourth embodiment. Here, it is assumed that the commander terminal 30C is used by the user D '.

  The commander terminal 30C displays the map image 750 on the screen 75 in, for example, step S82 of FIG. The commander terminal 30C acquires, for example, a map image 750 including a predetermined range in advance and stores it in a storage provided in the commander terminal 30C. For example, the commander terminal 30C may acquire the map image 750 from the management server 40C in step S82 of FIG. 41, or may acquire the map image 750 from another server device connected to the network 50 or the like. May be. The commander terminal 30C can execute scrolling, zooming in, zooming out, etc. of the map image 750 in response to a user operation on the commander terminal 30C.

  The commander terminal 30C, for example, displays each terminal on the map image 750 according to the ID and position information of each terminal device 10a ′, 10b ′, and 10c ′ acquired from the management server 40C in step S906, step S916, and step S926 in FIG. Markers 753a, 753b, and 753c indicating the positions of the devices 10a ′, 10b ′, and 10c ′ are displayed superimposed on the map image 750, respectively. In addition, labels including corresponding names are displayed in the vicinity of the markers 753a, 753b, and 753c, respectively.

  For example, in step S906, step S916, and step S926 of FIG. 41, the management server 40C refers to the information in Table 2 described above, and displays the ID, the position information and the name associated with the ID, and the commander terminal 30C. Send to. The commander terminal 30C causes the markers 753a, 753b, and 753c, and labels to be superimposed on the map image 750 and displayed according to the ID, position information, and name transmitted from the management server 40C.

  The commander terminal 30C updates the positions of the markers 753a, 753b, and 753c and the positions of the labels on the map image 750 in response to the transmission of the position information from the terminal devices 10a ', 10b', and 10c '.

  For example, in step S901, step S911, and step S921 of FIG. 41, ID and position information are transmitted from each terminal device 10a ', 10b', and 10c 'to the management server 40C. In step S906, step S916, and step S926 in FIG. 41, these IDs and position information are transmitted from the management server 40C to the commander terminal 30C. The commander terminal 30C updates the positions of the markers 753a, 753b and 753c and the labels on the map image 750 based on the IDs and the position information received from the management server 40C.

  In addition, the commander terminal 30C acquires the ID, position information, and name of the target other than the terminal devices 10a ′, 10b ′, and 10c ′ from the management server 40C in step S906, step S916, and step S926 in FIG. . According to the acquired ID, position information, and name of the target, the commander terminal 30C displays markers 751 and 752 indicating the positions of the targets and labels corresponding to the markers 751 and 752 on the map image 750. Each is displayed superimposed on the map image 750.

  In this manner, the markers 753a, 753b and 753c of the terminal devices 10a ′, 10b ′ and 10c ′ and the labels are superimposed on the map image 750 displayed on the screen 75 of the commander terminal 30C. Display. In addition, the commander terminal 30C superimposes and displays the markers 751 and 752 and the labels of the objects other than the terminal devices 10a ′, 10b ′, and 10c ′ on the map image 750. Thereby, the user D ′ using the commander terminal 30C confirms the positions and positional relationships of the users A ′, B ′, and C ′ wearing the terminal devices 10a ′, 10b ′, and 10c ′ from a bird's-eye view. Is possible.

  In FIG. 51, an area 760 displays ID, name, position information, and text information. Among the IDs, IDs indicating the terminal devices 10a ', 10b', and 10c 'can be acquired from the management server 40C. Moreover, among IDs, IDs (ID = L001, L002 in the example of FIG. 51) indicating objects other than the terminal devices 10a ′, 10b ′, and 10c ′ may be input on the commander terminal 30C. You may acquire from the management server 40C.

  The area 760 includes input areas 761, 762, and 763 in which information can be input by an operation on the commander terminal 30C. In the input area 761, a name corresponding to each ID is input. In the input area 762, position information (latitude and longitude) corresponding to each ID is input. The position information input to the input area 762 can also be acquired from the management server 40C.

  In a region 763, text information is input. For example, the user D ′ can input text information for each ID in each column of the input area 763 by operating the commander terminal 30 </ b> C. When the corresponding ID corresponds to each terminal device 10a ′, 10b ′, and 10c ′, the text information includes, for example, each user A ′, B ′ that wears each terminal device 10a ′, 10b ′, and 10c ′, and This is a command for C ′. For example, the commander terminal 30C can transmit the text information input in the input area 763 to the terminal device corresponding to the ID associated with the text information.

  When the corresponding ID indicates a target other than the terminal devices 10a ', 10b', and 10c ', the text information is, for example, information on the target.

  The commander terminal 30C can transmit each piece of information input to each input area 761 to 763 to the management server 40C in response to a predetermined operation on the commander terminal 30C.

  Next, the terminal devices 10a ′, 10b ′, and 10c ′ when the command information is transmitted from the commander terminal 30C to the terminal devices 10a ′, 10b ′, and 10c ′ according to the fourth embodiment. A method of notifying command information to the will be described. The command information transmitted from the commander terminal 30C is transmitted to the designated terminal device among the terminal devices 10a ', 10b' and 10c 'via the management server 40C.

  Here, the terminal devices 10a ', 10b', and 10c 'will be described by being represented by the terminal device 10a'. Further, for example, when the text information is input to the field corresponding to the terminal device 10a ′ in the input area 763 shown in FIG. 51, the commander terminal 30C designates the terminal device 10a ′ as the destination of the command information. The text information is transmitted to the designated destination as command information.

  FIG. 52 shows an example of a command information display method in the terminal device 10a 'according to the fourth embodiment. If long text information such as command information is suddenly displayed on the screen 13a of the terminal device 10a ', there is a risk of hindering visual search to the outside world. Therefore, the user A ′ wearing the terminal device 10a ′ is in a stationary state, and the user A ′ who has confirmed the safety of the surroundings takes action to acquire the command information by himself, thereby acquiring the command information. Such control is desirable.

  In the example of FIG. 52, the user A ′ wearing the terminal device 10a ′ controls the display of the command information on the screen 13a by moving the head 80 up and down in a stationary state.

  More specifically, in the terminal device 10 a ′, the display information generation unit 204 ′ is based on the detection output of the head movement detection unit 207 ′ using the detection result of the acceleration sensor included in the 9-axis sensor 22. Determine whether 'is stationary. When the display information generation unit 204 ′ determines that the user A ′ is in a stationary state, the head movement detection unit 207 ′ based on the detection output of the gyro sensor included in the 9-axis sensor 22 performs the vertical movement of the head 80. The display of the command information on the screen 13a is controlled according to the detection result.

  For example, the head 80 (line-of-sight direction) of the user A ′ is oriented in the horizontal direction, and as illustrated in FIG. 52 (a), the position of the other terminal device is set with respect to the screen 13a of the terminal device 10a ′. It is assumed that a position marker 1301 to be shown, a label 1302 corresponding to the position marker 1301, and an orientation display 1300 are displayed. When the terminal device 10a 'receives the command information in this state, a notification icon 1310 indicating reception of the command information is displayed on the screen 13a. The notification icon 1310 is displayed at a position that does not interfere with the position marker 1301, the label 1302, and the orientation display 1300 on the screen 13a, for example, at the upper right corner of the screen 13a.

  When the notification icon 1310 is displayed on the screen 13a, the user A 'tilts the head 80 upward. As illustrated in FIG. 52B, when the direction of the head 80 (the line-of-sight direction) exceeds a predetermined angle α with respect to the horizontal direction, the terminal device 10a ′ causes the display information generation unit 204 ′ to display the screen 13a. The position marker 1301, label 1302, and orientation display 1300 are not displayed. Then, the display information generation unit 204 'displays the aiming marker 1311 at the center of the screen 13a and displays the screen switching selection panel 1312a at the upper end of the screen 13a. The notification icon 1310 is fixedly displayed in the upper right corner of the screen 13a.

  Here, the aiming marker 1311 is displayed with its position fixed at the center of the screen 13a. That is, the aiming marker 1311 is fixedly displayed at the center of the screen 13a even if the head 80 is tilted further upward, for example, from the state of FIG. On the other hand, the position of the screen switching selection panel 1312a is moved in the screen 13a according to the movement of the head 80.

  When the user A ′ further tilts the head 80 upward by a predetermined angle β from the state of FIG. 52B, the aiming marker 1311 overlaps the screen switching selection panel 1312a as illustrated in FIG. 52C. It becomes a state. Based on the coordinate information in the screen 13a of the screen switching selection panel 1312a, the display information generation unit 204 ′ overlaps the aiming marker 1311 and the screen switching selection panel 1312a, and the state is kept for a predetermined time (for example, 2 seconds). ) Determine whether it is maintained.

  When the display information generation unit 204 ′ determines that the state where the aiming marker 1311 and the screen switching selection panel 1312a overlap is maintained for a predetermined time, the display information generating unit 204 ′ deletes the aiming marker 1311 and the screen switching selection panel 1312a from the screen 13a. The command information transmitted from the operator terminal 30C via the management server 40C is displayed on the screen 13a. FIG. 52D shows an example in which the command information 1320 is displayed on the screen 13a.

  The display information generation unit 204 'controls the display of the command information 1320 so that the command information 1320 is fixedly displayed at a predetermined position on the screen 13a even if the head 80 is returned to the horizontal direction. Also, when the command information 1320 is displayed on the screen 13a, the display information generation unit 204 'deletes the notification icon 1310 from the screen 13a.

  When the direction of the head 80 exceeds a predetermined angle with respect to the horizontal direction based on the output of the head movement detection unit 207 ′ with the command information 1320 displayed on the screen 13a, the display information generation unit 204 ′ Similarly to 52 (b), the aiming marker 1311 is displayed at the center of the screen 13a, and the screen switching selection panel 1312b (see FIG. 52 (e)) is displayed at the upper end side of the screen 13a.

  When the user A ′ further tilts the head 80 upward by a predetermined angle, the aiming marker 1311 is overlaid on the screen switching selection panel 1312b as illustrated in FIG. Based on the coordinate information in the screen 13a of the screen switching selection panel 1312b, the display information generation unit 204 ′ overlaps the aiming marker 1311 and the screen switching selection panel 1312b, and the state is kept for a predetermined time (for example, 2 seconds). ) Determine whether it is maintained.

  If the display information generation unit 204 ′ determines that the state where the aiming marker 1311 and the screen switching selection panel 1312 b overlap is maintained for a predetermined time, the display information generating unit 204 ′ deletes the aiming marker 1311 and the screen switching selection panel 1312 b from the screen 13 a. In addition, the display information generation unit 204 ′ displays again the position marker 1301 indicating the position of the other terminal device, the label 1302 corresponding to the position marker 1301, and the orientation display 1300 on the screen 13 a.

  At this time, when the command information includes the ID, name, and position information of the target other than the other terminal device, the display information generation unit 204 ′ displays the screen 13a as illustrated in FIG. 52 (f). In addition, a position marker 1304 indicating the position of the target and a label 1303 corresponding to the position marker 1304 and including target information are displayed.

  When the head 80 is tilted upward in the states of FIGS. 52 (b), 52 (c), and 52 (e), the vertical acceleration value changes, which has been described with reference to FIG. There is a possibility that the estimation of the stationary state and the walking state may be affected. Therefore, the display information generation unit 204 ′ determines whether the head 80 is tilted upward using the output of the gyro sensor included in the 9-axis sensor 22 based on the detection result of the head movement detection unit 207 ′. Is estimated. When it is estimated that the head 80 is inclined upward, the display information generation unit 204 ′ controls the display information generation unit 204 ′ as an exception to the stationary state and walking state estimation processing.

  The terminal devices 10a ', 10b', and 10c 'according to the fourth embodiment have an advantage that they can be used hands-free by using the eyeglass unit 1C mounted on the head 80. By performing the control as described above, each user A ′, B ′, and C ′ can acquire necessary information only by movement of the head 80.

  In the above description, the terminal devices 10a ′, 10b ′, and 10c ′ according to the fourth embodiment are respectively connected to the terminal device 10 ′ that includes the front unit 11B that is provided with the light control unit according to the third embodiment. Although described to include a corresponding glasses-type device, this is not limited to this example. That is, as the terminal devices 10a ′, 10b ′, and 10c ′ according to the fourth embodiment, glasses-type devices corresponding to the terminal device 10 according to the first embodiment having the front part 11A that does not include the dimming unit. May be included.

(Other embodiments)
Note that the information sharing system according to the fourth embodiment described above includes the management server 40C, performs communication between the terminal devices 10a ′, 10b ′, and 10c ′ and the management server 40C, and each terminal device 10a. The IDs and position information of “10b” and 10c ”are transmitted and received. This is not limited to this example, and the information sharing system may be configured not to include the management server 40C.

  In this case, for example, the session establishment in step S81 of FIG. 41 is performed between the terminal devices 10a ′, 10b ′ and 10c ′, and between the terminal devices 10a ′, 10b ′ and 10c ′ and the commander terminal 30C. Each will be done. The IDs of the terminal devices 10a ', 10b' and 10c 'are stored in advance in the terminal devices 10a', 10b 'and 10c'.

  For example, in step S90a of FIG. 41, the terminal device 10a 'directly transmits the position information acquired in step S900 to each of the terminal devices 10b' and 10c 'and the commander terminal 30C. The same applies to step S90b and step S90c.

  Each of the above-described embodiments is a preferred embodiment of the present invention, but is not limited thereto, and various modifications can be made without departing from the gist of the present invention.

1A, 1B, 1C Glasses unit 2 Light guide plate 3 Display element 4 Light source 8 Half mirror 10, 10 ', 10a, 10b, 10c, 10a', 10b ', 10c', 30 Terminal device 11A, 11B Front 12 Temple 13a, 13b , 13c, 70, 70a, 70b, 71, 75 Screen 20A, 20B Information processing unit 21 Cable 22 9-axis sensor 23 Camera 24 Operation unit 30B, 30C Commander terminal 40A, 40B, 40C Management server 50 Network 101 Display control unit 102 9-axis detection unit 104 Imaging control unit 202 Position information acquisition unit 203 Shared information generation unit 204, 204 ′ Display information generation unit 205 Input processing unit 207, 207 ′ Head movement detection unit 301, 401 Shared information acquisition unit 302, 402 Map Information acquisition unit 303 Position acquisition unit 304, 404 Attribute information storage unit 4 3 position calculating unit 500 subject 700, 750 map image 702 own device markers 703a, 703b, 703c, 703d, 705a, 705b, 705c, 705d,
706 Marker image 704, 730, 740, 741 Message display 720 Target marker 1010 Dimming filter 1300 Direction display 1301, 1301a, 1301b Position marker 1302, 1302a, 1302b, 1302c Label 1310 Notification icon 1311 Aiming marker 1312a, 1312b Screen switching selection panel

JP 2011-215676 A

Claims (27)

An information sharing system including a management device and a plurality of terminal devices,
At least a first terminal device among the plurality of terminal devices is:
Acquisition of shared information including first position information indicating a position of the first terminal device, direction information indicating a direction of a target with respect to the first terminal device, and distance information indicating a distance to the target With an acquisition unit
The management device
A generating unit that obtains second position information indicating the position of the target based on the shared information acquired from the first terminal device, and generates target information including the second position information;
An information sharing system comprising: a transmission unit that transmits the target information to the plurality of terminal devices. The acquisition unit
Further acquiring attribute information indicating the target attribute,
The generator is
The information sharing system according to claim 1, wherein the target information further including the attribute information acquired from the first terminal device is generated. The management device
An attribute information storage unit that stores the attribute information and the marker information in association with each other;
The generator is
The information sharing system according to claim 2, wherein the target information further includes the marker information associated with the attribute information acquired from the first terminal device. The generator is
The information sharing system according to claim 1, wherein the target information further including time information indicating the current time is generated. The first terminal device is:
An image capturing unit that captures an image of the subject and outputs a captured image;
The shared information is
The information sharing system according to any one of claims 1 to 4, further including the captured image obtained by capturing the target. The information sharing system according to claim 5, wherein the captured image is a moving image. The first terminal device is:
A voice input unit for inputting voice;
The shared information is
The information sharing system according to claim 1, further comprising information based on the voice. The second terminal device among the plurality of terminal devices is:
The information sharing system according to any one of claims 1 to 7, comprising the acquisition unit, the generation unit, and the transmission unit. At least the first terminal device of the plurality of terminal devices is
The information sharing system according to any one of claims 1 to 8, further comprising a head-mounted display device including a display unit configured to display an image on the eyeball and its periphery by being mounted on the head. The display unit
The information sharing system according to claim 9, further comprising a light control element capable of controlling the transmittance. The information sharing system according to claim 10, wherein the dimming element is an electrochromic element. An information sharing method in an information sharing system including a management device and a plurality of terminal devices,
First position information indicating a position of a first terminal device among the plurality of terminal devices, direction information indicating a direction of a target with respect to the first terminal device, distance information indicating a distance to the target, An acquisition step for acquiring shared information including:
A step of obtaining second position information indicating the position of the target based on the shared information acquired from the first terminal device, and generating target information including the second position information;
A transmission step of transmitting the target information to the plurality of terminal devices. An acquisition unit that acquires shared information including first position information indicating a position of the own device, direction information indicating a direction of a target with respect to the own device, and distance information indicating a distance to the target;
A receiving unit that receives target information including second position information indicating the position of the target obtained by the management device based on the shared information;
And a display unit capable of displaying based on the target information received by the receiving unit. An acquisition step of acquiring shared information including first position information indicating a position of the own device, direction information indicating a direction of a target with respect to the own device, and distance information indicating a distance to the target;
A receiving step of receiving target information including second position information indicating the position of the target determined by the management device based on the shared information;
An information processing program for causing a computer to execute a display step of performing display based on the target information received in the reception step. A terminal device including a head-mounted display device provided with a display unit capable of projecting an image on the eyeball and its periphery by being mounted on the head and transmitting external light,
A position information acquisition unit that acquires first position information indicating the position of the device;
A target information acquisition unit for acquiring target information including at least second position information indicating the position of the target;
Based on the first position information and the second position information, a marker indicating the target at a position corresponding to the direction of the target with respect to the position indicated by the first position information on the display unit A display control unit for displaying an image;
A terminal device comprising: The display control unit
A distance between the position indicated by the first position information and the position indicated by the second position information is obtained based on the first position information and the second position information, and the marker image is determined according to the distance. The terminal device according to claim 15, wherein the terminal device is displayed on the display unit with a predetermined size. The target information further includes attribute information of the target,
The display control unit
The label including the attribute information of the target is further displayed on the display unit at a position corresponding to the direction of the target with reference to the position indicated by the first position information. Terminal equipment. The display control unit
A distance between the position indicated by the first position information and the position indicated by the second position information is obtained based on the first position information and the second position information, and the label corresponds to the label. The terminal device according to claim 17, wherein the marker image is displayed with an interval corresponding to the distance. The display control unit
The terminal device according to claim 17 or 18, wherein the label is displayed as a translucent background of a display portion on which the attribute information of the label is displayed. The display control unit
The terminal device according to any one of claims 15 to 19, wherein the marker image is displayed on the display unit at an angle corresponding to an inclination of the head around a longitudinal axis. The display control unit
The terminal device according to claim 15, wherein whether or not to display the marker image on the display unit is controlled according to predetermined information. The display control unit
The user who wears the head-mounted display device estimates whether or not the user is in a stationary state, and when it is estimated that the user is not in the stationary state, the marker image is not displayed on the display unit. Terminal equipment. The display control unit
It is estimated whether or not the head to which the head-mounted display device is mounted is tilted upward by a predetermined angle or more, and when it is estimated that the head is tilted by the predetermined angle or more, the marker image The terminal device according to claim 21, wherein the terminal device is not displayed on the display unit. The display control unit
The terminal device according to claim 23, wherein notification information acquired from the outside is displayed on the display unit when the head is estimated to be inclined at the predetermined angle or more. The display control unit
The terminal device according to claim 24, wherein a notification icon indicating acquisition of the notification information is displayed on the display unit when the notification information is acquired from the outside. The terminal device according to any one of claims 15 to 25, wherein the display unit includes a light control element capable of controlling transmittance. An information sharing system including a plurality of terminal devices,
At least one terminal device among the plurality of terminal devices is:
A head-mounted display device that includes a display unit that projects an image on the eyeball and its surroundings by being mounted on the head and is capable of transmitting external light;
A position information acquisition unit that acquires first position information indicating the position of the device;
A transmitter for transmitting the first position information;
A target information acquisition unit for acquiring target information including at least second position information indicating the position of the target;
Based on the first position information and the second position information, a marker indicating the target at a position corresponding to the direction of the target with respect to the position indicated by the first position information on the display unit A display control unit for displaying an image;
An information sharing system comprising: