JP2016110296A - Wearable device, information processing method, and program - Google Patents

Abstract

A technique capable of realizing a useful function using a wearable device is provided. A wearable device displays a display object indicating a relative positional relationship between a user's current location and the position of an object, detects a user's physical state, and displays the display object according to the detected physical state. Control to change the degree of visibility on the display unit. [Selection] Figure 3

Description

  The present invention relates to information processing technology.

  In recent years, various wearable devices have been developed. A wearable device is a device that is assumed to be worn by a user on a body (for example, an arm or a head). For example, Patent Document 1 discloses a glasses-type wearable device worn on the head.

JP 2014-086905 A

  A wearable device is a device characterized in that it is worn on a user's body, and a technology that can realize a useful function using such a feature is expected.

  The present invention has been made in view of the above, and an object thereof is to provide a technology capable of realizing a useful function using a wearable device.

The wearable device according to the present invention includes a display unit that displays a display object indicating a relative positional relationship between the current location of the user and the position of the object, a detection unit that detects the physical state of the user,
Display control means for controlling to change the degree of visibility of the display object displayed by the display means in accordance with the detected physical condition.

  The information processing method according to the present invention includes a display step of displaying a display object indicating a relative positional relationship between the current location of the user and the position of the object, a detection step of detecting the physical state of the user, and the detection. A display control step of controlling the display object displayed in the display step so as to change the degree of visibility according to the physical state.

  The program according to the present invention includes a display step of displaying a display object indicating a relative positional relationship between the current location of the user and the position of the object, a detection step of detecting the physical state of the user, and the detected body A display control step is executed to control the display object displayed by the display step so as to change the degree of visibility according to the state.

  The program of the present invention can be installed or loaded on a computer through various recording media such as an optical disk such as a CD-ROM, a magnetic disk, and a semiconductor memory, or via a communication network. .

  ADVANTAGE OF THE INVENTION According to this invention, the technique which can implement | achieve the useful function using a wearable device can be provided.

It is a conceptual diagram which shows the hardware constitutions of the information processing system in one Embodiment. It is a figure which shows the external appearance structure of the spectacles type device in one Embodiment. It is a figure which shows the function structure of the spectacles type device in one Embodiment. It is a figure which shows the example of a display on the display part of the spectacles type device in one Embodiment. It is a figure which shows the example of a display on the display part of the spectacles type device in one Embodiment. It is a figure which shows the example of a display on the display part of the spectacles type device in one Embodiment. It is a flowchart which shows the example of the process performed by the spectacles type device in one Embodiment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. However, the scope of the invention is not limited to these.

[Hardware configuration]
With reference to FIG. 1, an example of a hardware configuration of an information processing system according to an embodiment will be described. The information processing system 1 is a system for providing various services using wearable devices. The information processing system 1 mainly includes a server device 10, a glasses-type device 20, and a mobile terminal 30. The glasses-type device 20 and the portable terminal 30 can communicate with the server apparatus 10 via the network N. The eyeglass-type device 20 can communicate with the mobile terminal 30 (for example, via Bluetooth (registered trademark) or Wi-Fi (registered trademark)). For example, the information processing system 1 can provide various information providing services based on map information to a user who wears the glasses-type device 20 that is a wearable device and carries the mobile terminal 30.

  The network N is a communication line for transmitting and receiving information between the server apparatus 10 and the glasses-type device 20 and the mobile terminal 30. The network N may be, for example, the Internet, a LAN, a dedicated line, a packet communication network, a telephone line, a corporate network, another communication line, or a combination of at least a part of these, and is it wired? It does not matter whether it is wireless (or a combination thereof).

  The server device 10 is configured by an information processing device such as a dedicated or general-purpose server computer. The server device 10 may be constituted by a single information processing device or may be constituted by a plurality of information processing devices distributed on a network.

  The server device 10 mainly includes a control unit 11, a communication unit 12, and a storage unit 13. The control unit 11 mainly includes a CPU (Central Processing Unit) 11a and a memory 11b. The description of each configuration will be described later. For example, the server device 10 functions as various function implementing means by the CPU 11a executing a predetermined program stored in the memory 11b or the like. Note that FIG. 1 only shows a main configuration included in the server apparatus 10, and the server apparatus 10 includes other configurations included in a general information processing apparatus.

  The spectacle-type device 20 is a wearable device having a spectacle-type shape. The wearable device is a device (information processing apparatus) that is assumed to be used by being worn on the body (for example, an arm or a head) by a user. That is, since the spectacle-type device 20 has a spectacle-type shape, the user can use the spectacle-type device 20 while wearing the spectacle-type device 20 on the head like wearing spectacles. The eyeglass-type device 20 mainly includes a control unit 21, a communication unit 22, a storage unit 23, an operation unit 24, a display unit 25, a camera 26, a sensor 27, and a microphone 28. The control unit 21 mainly includes a CPU 21a and a memory 21b. For example, the glasses-type device 20 functions as various function realizing means when the CPU 21a executes a predetermined program stored in the memory 21b or the like. Since the user wears each of these configurations included in the glasses-type device 20 when the glasses-type device 20 is worn, each of these configurations can be regarded as a wearable device in a narrow sense. Each of these components will be described later.

  FIG. 2 shows an example of the external appearance of the eyeglass-type device 20. In this example, as shown in FIG. 2A, it is shown that the eyeglass-type device 20 includes an operation unit 24, a display unit 25, and a camera 26 in appearance. The operation unit 24 is located on the outer side of the eyeglass-type device 20. The user can issue an operation instruction to the glasses-type device 20 by swiping or tapping the operation unit 24.

  The display unit 25 is configured to be installed at a position where a user wearing the spectacle-type device 20 can visually recognize display contents by a prism or the like. In this example, as shown in FIG. 2B, the display unit 25 is a monocular display device, and when the user wearing the glasses-type device 20 looks at the upper right of the right lens of the glasses-type device 20. It is installed in a position where you can check the display contents. The area 25a in the display unit 25 is an area (displayable area) where a display target such as an image can be displayed.

  The camera 26 is directed in the direction of the line of sight of the user wearing the spectacle-type device 20, and is installed at a position where it is possible to capture / capture what is estimated to be viewed by the user (present at the estimated gaze point). Configured as follows.

  In the example of FIG. 2, the display unit 25 is a monocular display device, but is not limited thereto. The display unit 25 may be a binocular display device, and may be configured so that a user wearing the glasses-type device 20 can check display contents with both eyes. Specifically, the display unit 25 may be configured by installing a transmissive display in the lens portion of both eyes of the eyeglass-type device 20.

  Returning to the description of FIG. The mobile terminal 30 is a portable information processing device such as a mobile phone (including a smartphone), a tablet terminal, a PDA (Personal Digital Assistants), a navigation device, and a personal computer. The portable terminal 30 mainly includes a control unit 31, a communication unit 32, a storage unit 33, an operation unit 34, a display unit 35, and a positioning unit 36. The control unit 31 mainly includes a CPU 31a and a memory 31b. The description of each configuration will be described later. For example, the portable terminal 30 functions as various function realizing means by the CPU 31a executing a predetermined program stored in the memory 31b or the like.

  The control units 11, 21, 31 control operations of various configurations of the information processing apparatuses including these, and control execution of various processes. Details of processing executed in the control units 11, 21, 31 will be described later. The communication units 12, 22, and 32 are communication interfaces for communicating with other information processing apparatuses. The storage units 13, 23, and 33 are configured by a storage device such as a hard disk. The storage units 13, 23, and 33 store various programs and various information necessary for executing processing in each information processing apparatus. The operation units 24 and 34 are user interfaces for receiving operation instructions from the user. The display units 25 and 35 are user interfaces for displaying various images and processing results obtained by the information processing apparatuses.

The camera 26 is a device that can capture / capture still images / moving images.
The sensor 27 is composed of various sensors. The sensor 27 can include, for example, a gyro sensor, an acceleration sensor, a geomagnetic sensor, and / or an image sensor. By the sensor 27, for example, based on the direction in which the face of the user wearing the spectacle-type device 20 is facing, the azimuth of the direction of the line of sight of the user (the angle in the horizontal direction between the reference azimuth) An estimated value can be detected, or an estimated value of an elevation angle (an angle in the vertical direction with respect to the horizontal) in the direction of the user's line of sight can be detected based on the inclination of the user's head. The sensor 27 may be configured to detect the estimated values of the azimuth angle and the elevation angle in the user's line-of-sight direction from the movement of the user's eyeball. The sensor 27 can also detect blinking based on the movement of the eyelid of the user wearing the glasses-type device 20. The sensor 27 can also detect whether the user is moving or has stopped moving.
The microphone 28 is a device that converts voice / sound produced by a user wearing the glasses-type device 20 into an electrical signal.

  The positioning unit 36 specifies the position (for example, latitude and longitude) of the mobile terminal 30 based on a signal received from a GPS satellite or a communication device (for example, a base station or a router), and specifies the date and time when the position is specified. Processing (that is, specifying positioning information) is performed.

  As described above, in the present embodiment, the information processing system 1 includes the server device 10, the glasses-type device 20, and the mobile terminal 30, but is not limited thereto, and can include any device. In addition, a configuration having a part or all of the configurations of the server device 10, the glasses-type device 20, and the mobile terminal 30 can be grasped as an information processing system. For example, a part of the configuration of the glasses-type device 20 can be grasped as an information processing system, and a configuration in which a part of the configuration of the glasses-type device 20 and a part of the configuration of the portable terminal 30 are combined. Can be grasped as an information processing system.

[Function configuration]
The functional configurations of the server device 20 and the eyeglass device will be described below.
1. Server Device First, an example of a functional configuration of the server device 10 according to an embodiment will be described. Although not shown, the server device 10 includes a database and an object search function as main functions.

  The database stores various information such as information necessary for processing executed in the server device 10 and information generated by the processing. The database 120 stores, for example, map information and facility information. The map information includes road information, railway line information, building information, terrain information, address information, and other geographical information. The facility information includes information about facilities such as convenience stores, cafes, stations, fast food, restaurants, buildings (buildings), and the like. The facility information includes information on products and / or services handled at the facility. The facility information may be information included in the map information.

  The object search function refers to the database according to the input search conditions, and searches for objects that exist in the real environment (for example, facilities classified as convenience stores, cafes, stations, fast food, or restaurants). It is a function to perform.

2. Eyeglass Type Device Next, an example of a functional configuration of the eyeglass type device 20 according to an embodiment will be described with reference to FIG. The eyeglass-type device 20 includes a search unit 211, a body state detection unit 212, a display control unit 213, an action detection unit 214, and a voice recognition unit 215 as main functional configurations. Details of each functional configuration will be described below.

  The search unit 211 searches for an object existing in the real environment in response to an operation instruction from the user. Specifically, the search unit 211 transmits a search process execution instruction to the server device 10 in response to an operation instruction from the user of the eyeglass-type device 20, and executes the search process execution result (information about the object). ). The instruction for executing the search processing includes the current location of the glasses-type device 20, the distance from the current location of the search target, the type of search target (for example, convenience store, cafe, station, fast food or restaurant), and other search conditions. Is included. The search processing execution instruction may be given via the mobile terminal 30, and the glasses-type device 20 may receive the search result from the mobile terminal 30.

  Further, the current location information is acquired from the mobile terminal 30. Since the user of the mobile terminal 30 also carries the glasses-type device 20, the current location information of the mobile terminal 30 can be regarded as the current location information of the glasses-type device 20. Further, the current location information is acquired from the mobile terminal 30, but the present location information is not limited to this, and the current location information may be specified by the eyeglass-type device 20 including a positioning processing unit and performing positioning processing.

  The body state detection unit 212 detects the user's body state using the sensor 27. The detected body condition includes the direction in which the user is facing, whether the user is moving, the inclination of the user's head, and the like. In addition, the tilt of the user's head includes the tilt of the head in the front-rear direction (that is, the user's line of sight moves in the elevation angle direction, such as when the user tilts the head in the direction of looking down or looking up And the tilt of the head in the horizontal direction (relative to the vertical direction).

  The display control unit 213 controls to display the search result by the search unit 211 on the display unit 25. In addition, the display control unit 213 controls the search results to be displayed by various methods. For example, the display control unit 213 can control the information about each object obtained by the search to be displayed in a card-shaped area (display object). In addition, the display control unit 213 can control to display a map (display object) indicating a relative positional relationship between the current location of the user and the position of the object obtained by the search. Furthermore, the display control unit 213 can perform control so as to change the display of the display object in accordance with the user's physical state detected by the physical state detection unit 212. For example, the visibility of the display of the display object can be changed according to the physical state.

  4 to 6 show examples of screens displayed on the area 25a of the display unit 25 under the control of the display control unit 213. FIG.

  FIG. 4 shows that information about each object in the search result is displayed in a card-shaped area. In the figure, for example, in a card-shaped area 42, information on the type of facility, the name of the facility, and information on the handling product is shown as information about one object obtained by the search. Also, the card shapes 41 and 43 show information about other objects of the search result. In addition, the display content can be scrolled under the control of the display control unit 213 according to the direction in which the user is detected detected by the body state detection unit 212. For example, in the state of the display example shown in FIG. 4, when the user turns to the right, the display content can be scrolled so that the card shape 43 is displayed at the center of the area 25a.

  FIG. 5 shows a map 50 (radar display) showing the relative positional relationship between the current location of the user and the position of the object obtained by the search, in addition to the information about the object shown in the card-shaped area. This is shown in region 25a.

  This map 50 shows the relative positional relationship between the current location 51 of the user and the positions 52 to 56 of the objects of the search results. The card-shaped area and the icon indicating the position on the map are color-coded so that the correspondence between the object whose information is shown in the card-shaped areas 41 to 43 and the object whose position is shown in the map 50 can be understood. Or a symbol. Thus, in addition to the information about the object (card-shaped areas 41 to 43), the user can display the information about the object by displaying the map 50 indicating the relative positional relationship between the current location and the position of the object. The position of the object can be confirmed while confirming.

  FIG. 6 shows an example in which the display of the radar display map 50 is changed according to the inclination of the user's head detected by the body state detection unit 212. In this example, as the inclination of the user's head increases, the map 50 is such that the upper part of the map 50 virtually placed in parallel with the screen in the three-dimensional space falls back and the lower part comes to the front. The display angle of the surface (or the size of the display area of the surface) changes. In other words, in this example, the larger the inclination of the user's head detected by the body state detection unit 212, the smaller the size of the map 50 (display object) and the lower the degree of visibility. In order to reduce the degree of visibility, instead of changing the display angle (the size of the display object) in this way, the display transparency of the map 50 is increased and finally disappears (non-display) Control). As described above, the tilt of the user's head includes the tilt of the head in the front-rear direction (that is, the user's line of sight such as when the user tilts the head in the direction of looking down or looking up). The tilt of the head when moving in the elevation angle direction) and the tilt of the head in the horizontal direction (relative to the vertical direction) are included.

  Also, instead of gradually changing the degree of visibility according to the tilt of the user's head, the map 50 is hidden when the tilt angle of the head exceeds a predetermined threshold, and when the tilt is below the threshold You may control to display. Furthermore, in the example of FIG. 6, the degree of visibility of the map 50 is lowered as the inclination of the user's head increases. As another example, as the inclination of the user's head increases, The degree of visibility may be increased. Moreover, you may change the visibility degree of the display of the information about the object shown in FIG. 4 according to the change of the inclination of a user's head. Moreover, although the degree of visibility is changed according to the inclination of the user's head, the present invention is not limited to this, and the user's other physical state (for example, the user is moving or stopped). The degree of visibility may be changed accordingly.

  As described above, according to the present embodiment, the degree of visibility of what is displayed on the display unit 25 can be changed according to the user's physical condition (for example, the inclination of the head). As a result, it is possible to realize a highly convenient function that allows the user to operate the glasses-type device 20 without performing an operation input to the operation unit 24.

  The action detection unit 214 detects a predetermined action of the user of the eyeglass-type device 20 in addition to the input to the operation unit 24. The predetermined action includes, for example, the blinking of the user or the movement of the predetermined hand by the user in front of the glasses-type device 20. An arbitrary method can be used as a method for detecting these predetermined actions, and for example, a conventional detection technique can be used.

  The voice recognition unit 215 recognizes a voice uttered by the user of the eyeglass-type device 20 and specifies an operation instruction from the user.

[Processing flow]
Next, an example of a flow of processing executed in the eyeglass-type device 20 will be described with reference to FIG. Each processing step included in the processing flow described below can be executed in any order or in parallel as long as there is no contradiction in the processing contents. Steps may be added. Further, a step described as one step for convenience can be executed by being divided into a plurality of steps, while a step described as being divided into a plurality of steps for convenience can be grasped as one step. Note that details of the processing of each processing step have already been described, and are omitted here.

  First, in step S11, the control unit 21 searches for an object existing in the real environment in accordance with an operation instruction from the user.

  In step S <b> 12, the control unit 21 performs control so that the search result in step S <b> 11 is displayed on the display unit 25. For example, a display object indicating the relative positional relationship between the current location of the user and the position of the object of the search result is displayed on the display unit 25.

  In step S <b> 13, the control unit 21 determines whether or not the sensor 27 detects a predetermined body state (for example, tilt of the head) of the user of the eyeglass-type device 20. If it is determined that it has been detected, the process proceeds to step S14.

  In step S <b> 14, the control unit 21 changes the degree of visibility on the display unit 25 of the screen indicating the relative positional relationship between the current location of the user and the position of the object according to the detected physical state of the user. To do.

  In step S15, the control unit 21 determines whether or not to end the display on the display unit 25. If not, the process proceeds to step S13.

  As described above, according to the present embodiment, the degree of visibility of what is displayed on the display unit 25 can be changed according to the user's physical condition (for example, the inclination of the head). As a result, it is possible to realize a highly convenient function that allows the user to operate the glasses-type device 20 without performing an operation input to the operation unit 24.

[Other Embodiments]
The present invention is not limited to the above-described embodiment, and can be implemented in various other forms without departing from the gist of the present invention. The above-described embodiment is merely an example in all respects, and is not construed as limiting.

  10 server device, 20 glasses-type device, 30 portable terminal, 11, 21, 31 control unit, 11a, 21a, 31a CPU, 11b, 21b, 31b memory, 12, 22, 32 communication unit, 13, 23, 33 storage unit 24, 34 Operation unit, 25, 35 Display unit, 26 Camera, 27 Sensor, 28 Microphone, 36 Positioning unit

Claims (8)

Display means for displaying a display object indicating a relative positional relationship between the current location of the user and the position of the object;
Detecting means for detecting the user's physical condition;
A wearable device comprising: display control means for controlling to change the degree of visibility of the display object displayed by the display means in accordance with the detected body condition.   The wearable device according to claim 1, wherein the display control unit performs control so as to change a size of the display object according to the detected body state.   The wearable device according to claim 1, wherein the display control unit performs control so as to hide the display object according to the detected body state.   The wearable device according to any one of claims 1 to 3, wherein the display control unit performs the control according to an inclination of the user's head detected by the detection unit.   The wearable device according to claim 4, wherein the display control unit performs control so that the degree of visibility of the display object increases as the detected tilt of the user's head increases.   The wearable device according to claim 4, wherein the display control unit performs control so that the degree of visibility of the display object decreases as the detected tilt of the user's head increases. A display step for displaying a display object indicating a relative positional relationship between the current location of the user and the position of the object;
A detection step of detecting the physical condition of the user;
An information processing method comprising: a display control step for performing control so as to change a degree of visibility of the display object displayed in the display step according to the detected physical state. A display step for displaying a display object indicating a relative positional relationship between the current location of the user and the position of the object;
A detection step of detecting the physical condition of the user;
A display control step for performing control to change the degree of visibility of the display object displayed in the display step according to the detected body condition.