WO2021246258A1 - Information processing device, information processing method, and program - Google Patents

Abstract

[Problem] To provide an information processing method, information processing device, and program, capable of improving usability of a main device and operation device capable of being connected to each other. [Solution] The information processing device of the present invention is provided with an information acquiring unit and a controlling unit. The information acquiring unit acquires connection position information with respect to the connection part between a first device with a first display part and a second device with a second display part, which are connected to each other and can adopt a plurality of different connection forms, the connection position information relating to the connection position in the first device and the connection position in the second device. The controlling unit controls the image displayed on at least one of the first display part and the second display part, or controls starting of an application on the first device, on the basis of the connection position information.

Description

Information processing equipment, information processing methods and programs

This technology relates to information processing devices, information processing methods and programs.

Patent Document 1 proposes a technique in which an operating device is detachably configured on a main body device, and operation data on the operating device is transmitted between the main body device and the operating device regardless of the form of attachment / detachment.

Further, in recent years, terminal devices capable of using functions according to various uses such as smartphones have become widespread. For example, when playing a game on a smartphone, there are problems that the operability of the game is poor, such as the fact that there is no handle and it is difficult to operate, and the screen is hidden by a finger and difficult to see.
To deal with such problems, external grips that can be attached to smartphones when using games are on the market.

Japanese Unexamined Patent Publication No. 2019-171100

It is desired that the main body device and the operation device that can be attached to and detached from the main body device can be connected in various shapes specialized for the functions of individual applications.

In view of the above circumstances, an object of the present technology is to provide an information processing method, an information processing device, and a program capable of improving the usability of a main body device and an operating device that can be connected to each other.

In order to achieve the above object, the information processing apparatus according to one embodiment of the present technology includes an information acquisition unit and a control unit.
The information acquisition unit is a connection point between a first device having a first display unit and a second device having a second display unit, which can be connected to each other and have a plurality of different connection shapes. The connection position information related to the connection position in the device of 1 and the connection position in the second device is acquired.
The control unit controls a display image displayed on at least one of the first display unit or the second display unit based on the connection position information, or the application in the first device. Control startup.

The control unit controls the display image by using the connection position information and the connection shape information between the first device and the second device prepared in advance for each application, or the application. You may control the activation of.

The control unit estimates the connection shape between the first device and the second device based on the connection position information, and controls the display image by using the estimation result and the connection shape information. Alternatively, the activation of the above application may be controlled.

The control unit may control the display image for explaining the connection shape between the first device and the second device.

The control unit may determine whether or not there is a defect in the connection location based on the connection position information, and control the display image based on the determination result.

The control unit may control the display image or control the activation of the application by adding the information of the user who operates the second device.

There are a plurality of connection points for connecting the first device and the second device, and the information acquisition unit uses the first device and the first device provided for each connection point as the connection position information. The detection information of each of the detection mechanisms for detecting the connection with the device of 2 may be acquired.

Each of the plurality of detection mechanisms has a detection object and a detection unit, the detection object is provided in the first device, the detection unit is provided in the second device, and the plurality of detection mechanisms are provided. Each object may be identified by the detection unit and configured to be detectable.

At least one of a resistor, a magnet, infrared light, a photoreflector, and a tactile switch may be used for the detection mechanism.

The first device may have a terminal device having a display unit and a holding unit for holding the terminal device.

In order to achieve the above object, the information processing method according to one embodiment of the present technology has a first device having a first display unit that can be connected to each other at a plurality of connection points and a second display unit having a second display unit. The connection position information relating to the connection position in the first device and the connection position in the second device for each of the plurality of connection points with the device is acquired, and based on the connection position information, the first device is used. It controls the display image of at least one of the display unit and the second display unit, or controls the activation of the application on the first device.

In order to achieve the above object, the program according to one embodiment of the present technology includes a first device having a first display unit and a second device having a second display unit that can be connected to each other at a plurality of connection points. The first step based on the step of acquiring the connection position information relating to the connection position in the first device and the connection position in the second device for each of the plurality of connection points, and the connection position information. The information processing apparatus is made to execute a step of controlling the display image or at least one of the display images of the display unit or the second display unit, or a step of controlling the activation of the application in the first device.

It is a perspective view of the main body apparatus and the operation apparatus constituting the information processing system which concerns on embodiment. It is a perspective view of the main body apparatus in the said information processing system. It is a perspective view of the operation device in the said information processing system. It is a functional block diagram of the information processing system. It is a figure explaining an example of the connection shape of each apparatus in the said information processing system. It is a figure explaining another example of the connection shape of each apparatus in the said information processing system. It is a figure explaining the positional relationship between the connection concave portion and the connection convex portion for each connection location when the connection shape 1 is taken in the information processing system. It is a figure explaining the positional relationship between the connection concave portion and the connection convex portion for each connection location when the connection shape 2 is taken in the information processing system. It is a flow diagram of the information processing method at the time of starting an application in the said information processing system. It is a flow diagram of the information processing method which concerns on the guide display of the connection method in the said information processing system. It is a guide display example which presents the connection shape of each apparatus in the said information processing system. This is an example of a detection mechanism that detects a connection between each device in the above information processing system. It is a display example which presents the connection failure part in the said information processing system. It is a guide display example which presents the connection shape of each apparatus when the connection failure part in the said information processing system is detected. It is a figure which shows the example of the use form of each apparatus in the said information processing system. It is a figure which shows the example of the connection shape in the said information processing system. It is a figure which shows the example of the connection shape in the said information processing system. It is a figure which shows the example of the connection shape in the said information processing system.

Hereinafter, the information processing system according to the present technology will be described with reference to the drawings.
[Outline configuration of information processing system]
FIG. 1 is a perspective view of a main body device 2, an operating device A4, and an operating device B7 constituting the information processing system 1.
As shown in FIG. 1, the information processing system 1 has a main body device 2 as a first device, and an operation device A4 and an operation device B7 as a second device. The devices 2, 4 and 7 may be connected to each other to form a plurality of different connection shapes.
The main body device 2 has a case 20 as a holding portion and a smartphone 3 as a terminal device held in the case 20. The case 20, the operating device A4, and the operating device B7 form a controller unit. Here, a smartphone is taken as an example as a terminal device, but the present invention is not limited to this.
The case 20 of the main body device 2 and the operation device A4 can be physically connected at the connection point, and are configured to be detachable.
The case 20 of the main body device 2 and the operation device B7 can be physically connected at the connection point, and are configured to be detachable.
The operating device A4 and the operating device B7 can be physically connected at the connection point, and are configured to be detachable.
An image corresponding to the application is displayed on the main body device 2. In this embodiment, an example in which a game application is executed will be given, but the type of application is not limited to this. In the present embodiment, an example is given in which an input operation screen for an image displayed on the main body device is displayed on the display unit of the operation device. By displaying the screen for input operation on an operation device different from the main body device in this way, a part of the image displayed on the main body device may be hidden by the user's finger or the like during the input operation. It is possible to improve the operability.

In each figure, the X-axis, Y-axis, and Z-axis are orthogonal to each other.
Although the details will be described later, the main body device 2 is configured by holding a smartphone 3 having a display unit 35 as a first display unit. Each of the operating device A4 and the operating device B7 has a display unit 5 and a display unit 8 as a second display unit.
In each figure, the display unit is located on the XY plane, and the thickness direction of each device corresponds to the Z-axis direction. Further, in the main body device and the operating device, the direction from the back surface side opposite to the display unit toward the display unit is the Z-axis positive direction.
The smartphone 3 has a thin thickness in the Z-axis direction and a substantially rectangular shape in the XY plane, and has a USB connection terminal (reference numeral 30 in FIG. 2B) on the side surface corresponding to the short side of the rectangle. A power button (reference numeral 39 in FIG. 2B) and a volume button (reference numeral 38 in FIG. 2B) are provided on the side surface on the long side. The main body device 2 having the form in which the smartphone 3 is fitted in the case 2 has a side surface facing the side surface (reference numeral 2f in FIG. 2B) where the USB connection terminal 30 of the smartphone 3 is located correspondingly (FIG. 2A). ) Has the reference numeral 2e). The direction from the side surface 2e to the side surface 2f is the positive X-axis direction. The main body device 2 has a side surface (reference numeral 2d in FIG. 2B) on which the power button 39 and the volume button 38 of the smartphone 3 are located and a side surface (reference numeral 2c in FIG. 2B). The direction from the side surface 2c to the side surface 2d is the positive Y-axis direction.

A known connection mechanism can be used as the connection mechanism that constitutes the connection point between each device (main unit 2, operation device A4, operation device B7) that constitutes the information processing system 1. Typically, a snap-fit mechanism is used. In addition, a magnet, a magic tape (registered trademark), a hook, a suction cup, or the like may be used, or a mechanism may be used in which one is physically sandwiched by the other, or a slide type may be used.
In the present embodiment, of the two devices physically connected to each other, one device is provided with a connection recess, the other device is provided with a connection protrusion, and a snap-fit mechanism is used to provide a connection recess in the connection recess. An example in which the convex portion for connection is fitted will be described. In the present embodiment, in the connection between the devices 2, 4 and 7, a connection recess is provided in the main body device 2, and the connection convex portion inserted into the connection recess is the operation device A4 and the operation device B7. However, the present invention is not limited to this. The main body device 2 may be provided with a connecting convex portion, and the operating device A4 and the operating device B7 connected to the main body device 2 may be provided with a connecting concave portion.

(Configuration of main unit)
The configuration of the main body device 2 will be described with reference to FIGS. 1 and 2. 1 and 2 are perspective views of a main body device 2 in which a smartphone 3 is held in a case 20. FIG. 2A is a perspective view of the main body device 2 when the display unit 35 of the smartphone 3 is arranged so as to be located on the upper side. 2 (B) is a perspective view of the main body device 2 when the figure of FIG. 2 (A) is rotated by 180 degrees on the XY plane. FIG. 2C is a perspective view of the main body device 2 when the display unit 35 is positioned on the lower side.

The smartphone 3 has a display unit 35 that serves as both an input operation surface and a display surface. Further, the smartphone 3 has a USB connection terminal 30, a camera 37, a voice button 38, and a power button 39. The functional configuration of the smartphone 3 will be described later.
The case 20 has a frame portion for holding the side surface of the smartphone 3 and a bottom surface portion for holding the surface opposite to the display portion 35 of the smartphone 3. The bottom surface portion has a substantially rectangular outer shape, and the frame portion extends substantially perpendicular to the bottom surface portion. The smartphone 3 can be held in a space surrounded by a bottom surface portion and a frame portion.

As shown in FIGS. 1 and 2 (A) to 2 (C), the main body device 2 has a substantially rectangular parallelepiped shape. The main body device 2 has a top surface 2a, a bottom surface 2b, and side surfaces 2c to 2f.
The upper surface 2a is a surface on the side where the display unit 35 of the smartphone 3 is located.

The bottom surface 2b is composed of a bottom surface portion of the case 20. In the main body device 2, the bottom surface 2b is configured to substantially cover the bottom surface portion of the smartphone 3. As shown in FIG. 2C, the bottom surface of the case 20 constituting the bottom surface 2b has a hole 17 penetrating in the Z-axis direction corresponding to the camera 37 of the smartphone 3 and a plurality of connection recesses 13a to 13x. It is provided. By providing the hole 17, the camera 37 can be used even when the smartphone 3 is fitted in the case 20.
The plurality of connecting recesses 13a to 13x are configured so that the connecting protrusions provided in the operating device A4 and the operating device B7 can be inserted. By inserting the connecting convex portion into the connecting concave portion, the main body device 2 is connected to the operating device A4 and the operating device B7. The operating device A4 and the operating device B7 are attached to and detached from the main body device 2 by inserting and removing the connecting convex portion into the connecting concave portion.
A plurality of connection recesses 13a to 13x are provided so that the operation device A4 and the operation device B7 can be connected to the main body device 2 in various shapes.
Hereinafter, when it is not necessary to particularly distinguish between the plurality of connection recesses 13a to 13x provided on the bottom surface 2b, it is referred to as a connection recess 13.

The side surfaces 2c to 2f are composed of a frame portion of the case 20. The side surface 2c and the side surface 2d are arranged to face each other. The side surface 2e and the side surface 2f are arranged to face each other.
As shown in FIG. 2A, four connection recesses 11a to 11d are provided on the side surface of the case 20 constituting the side surface 2c. The four connecting recesses 11a to 11d are located at equal intervals along the X axis. Hereinafter, when it is not necessary to particularly distinguish between the plurality of connection recesses 11a to 11d provided on the side surface 2c, it is referred to as a connection recess 11.
As shown in FIG. 2B, the side surface of the case 20 constituting the side surface 2d corresponds to a hole 18 penetrating in the Y-axis direction located corresponding to the voice button 38 of the smartphone 3 and a power button 39. A hole 19 penetrating in the Y-axis direction and three connection recesses 12a, 12c, and 12d are provided. By providing the holes 18 and 19, the voice button 38 and the power button 39 can be operated even when the smartphone 3 is fitted in the case 20. The connection recess 12a is located so as to face the connection recess 11a on the side surface 2c along the Y-axis direction. The connection recess 12c is located so as to face the connection recess 11c on the side surface 2c along the Y-axis direction. The connection recess 12d is located so as to face the recess 11d on the side surface 2c along the Y-axis direction.
As shown in FIG. 2B, a hole 16 penetrating in the X-axis direction corresponding to the USB connection terminal 30 of the smartphone 3 is provided on the side surface of the case 20 constituting the side surface 2f. By providing the hole 16, the USB connection terminal 30 can be used even when the smartphone 3 is fitted in the case 20.

(Structure of operating device A and operating device B)
The configurations of the operating device A4 and the operating device B7 will be described with reference to FIGS. 1 and 3. The operating device A4 and the operating device B7 have the same shape.
FIG. 3A is a perspective view of the operating device A4 (operating device B7) when the display unit 5 (8) described later is positioned on the upper side. FIG. 3B is a perspective view of the operating device A4 (operating device B7) when the figure of FIG. 3A is rotated 180 degrees on the XY plane. FIG. 3C is a perspective view of the operating device A4 (operating device B7) when the display unit 5 (8) is positioned on the lower side.

As shown in FIGS. 1 and 3, the operation device A4 (operation device B7) has a display device having a display unit 5 (8) having both an input operation surface and a display surface, and a housing 40 (70). The housing 40 (70) holds a display device.
The functional configurations of the operating device A4 and the operating device B7 will be described later.

As shown in FIGS. 1 and 3 (A) to 3 (C), the operating device A4 (operating device B7) has a substantially rectangular parallelepiped shape. The operating device A4 (operating device B7) has an upper surface 4a (7a) on which the display unit 5 (8) is located, a bottom surface 4b (7b), and side surfaces 4c to 4f (7c to 7f).

As shown in FIG. 3A, eight connecting convex portions 41a to 41h (71a to 71h) are provided on the outer peripheral portion of the upper surface 4a (7a). The eight connecting protrusions 41a to 41h (71a to 71h) are located outside the display unit 5 (8). The connecting protrusions 41a to 41d (71a to 71d) are arranged along the X axis. The connecting protrusions 41e to 41h (71e to 71h) are arranged along the X axis. When it is not necessary to particularly distinguish a plurality of connecting convex portions 41a to 41h provided on the upper surface 4a (7a), it is referred to as a connecting convex portion 41.
The distance between the connecting convex portion 41a (71a) and the connecting convex portion 41b (71b) (distance between the centers of the two connecting convex portions), the connecting convex portion 41c (71c) and the connecting convex portion 41d (71d). ), The distance between the connecting convex portion 41e (71e) and the connecting convex portion 41f (71f), and the distance between the connecting convex portion 41g (71g) and the connecting convex portion 41h (71h) are the same. Is. Further, these intervals are the distance between the connection recess 13e and the connection recess 13f (distance between the centers of the two connection recesses), the distance between the connection recess 13g and the connection recess 13h in the main body device 2. The distance between the connection recess 13i and the connection recess 13j, the distance between the connection recess 13k and the connection recess 13l, the distance between the connection recess 13m and the connection recess 13n, and the distance between the connection recess 13o and the connection recess 13p. The distance is the same as the distance between the connection recess 13q and the connection recess 13r, and the distance between the connection recess 13s and the connection recess 13t.
The distance between the connection convex portion 41a (71a) and the connection convex portion 41e (71e), the distance between the connection convex portion 41b (71b) and the connection convex portion 41f (71f), the connection convex portion 41c (71c). The distance between the and the connecting convex portion 41g (71g) and the distance between the connecting convex portion 41d (71d) and the connecting convex portion 41h (71h) are the same. Further, these intervals are the interval between the connection recess 13a and the connection recess 13b, the interval between the connection recess 13c and the connection recess 13d, and the interval between the connection recess 13e and the connection recess 13g in the main body device 2. , The distance between the connection recess 13f and the connection recess 13h, the distance between the connection recess 13i and the connection recess 13k, the distance between the connection recess 13j and the connection recess 13l, the connection recess 13m and the connection recess 13o. , The distance between the connection recess 13n and the connection recess 13p, the gap between the connection recess 13q and the connection recess 13s, the gap between the connection recess 13r and the connection recess 13t, the gap between the connection recess 13u and the connection recess 13u. The distance from 13v and the distance between the connection recess 13w and the connection recess 13x are the same.
The distance between the connecting convex portion 41b (71b) and the connecting convex portion 41c (71c) and the distance between the connecting convex portion 41f (71f) and the connecting convex portion 41g (71g) are the same. Further, these intervals are the interval between the connection recess 13f and the connection recess 13g, the interval between the connection recess 13j and the connection recess 13k, and the interval between the connection recess 13n and the connection recess 13o in the main body device 2. , The distance between the connection recess 13r and the connection recess 13s is the same.

As shown in FIG. 3C, the bottom surface 4b (7b) is a flat surface having no holes or recesses.
The side surface 4c (7c) and the side surface 4d (7d) are arranged to face each other. The side surface 4e (7e) and the side surface 4f (7f) are arranged to face each other.

As shown in FIG. 3A, two connecting protrusions 42a (72a) and 42b (72b) are provided on the side surface 4c (7c) along the X-axis direction. When it is not necessary to particularly distinguish the plurality of connecting convex portions 42a and 42b (72a and 72b) provided on the side surface 4c (7c), it is referred to as a connecting convex portion 42 (72).
As shown in FIG. 3B, two connecting recesses 43a and 43b (73a and 73b) are provided on the side surface 4d (7d) along the X-axis direction. The connecting recess 43a (73a) is located so as to face the connecting convex portion 42a (72a) on the side surface 4c (7c) along the Y-axis direction. The connecting concave portion 43b (73b) is located so as to face the connecting convex portion 42b (72b) on the side surface 4c (7c) along the Y-axis direction. When it is not necessary to particularly distinguish between the plurality of connection recesses 43a (73a) and 43b (73b) provided on the side surface 4d (7d), it is referred to as a connection recess 43 (73).
The distance between the connection concave portion 43a (73a) and the connection concave portion 43b (73b) is the same as the distance between the connection convex portion 42a (72a) and the connection concave portion 42b (72b). Further, these intervals are the interval between the connection recess 11a and the connection recess 11b, the interval between the connection recess 11c and the connection recess 11d, and the interval between the connection recess 12c and the connection recess 12d in the main body device 2. Is the same as.

The two operating devices A4 and the operating device B7 can be connected so that the side surface 4c (side surface 4d) of the operating device A4 and the side surface 7d (side surface 7c) of the operating device B7 are in contact with each other. In a state where the two operating devices A4 and the operating device B7 are connected, the connecting protrusions 42a (72a) and 42b (72b) provided on the side surfaces 4c (7c) of the operating device A4 (operating device B7) are respectively. It is inserted into each of the connecting recesses 43a (73a) and 43b (73b) provided on the side surface 4d (7d) of the operating device B7 (operating device A4). In this case, as shown in FIGS. 18B and 18E, the operating device A4 and the operating device B7 are connected so that their long sides are in contact with each other.

As shown in FIG. 3A, two connecting protrusions 44a (74a) and 44b (74b) located along the Z-axis direction are located on the side surface 4e (7e) along the Z-axis direction. Two connecting recesses 45a (75a) and 45b (75b) are provided.
As shown in FIG. 3 (B), on the side surface 4f (7f), two connecting protrusions 46a (76a) and 46b (76b) located along the Z-axis direction are located along the Z-axis direction. Two connecting recesses 47a (77a) and 47b (77b) are provided.
The distance between the connection convex portion 44a (74a) and the connection convex portion 44b (74b), the distance between the connection concave portion 45a (75a) and the connection concave portion 45b (75b), and the connection with the connection convex portion 46a (76a). The distance between the convex portion 46b (76b) and the concave portion 47a (77a) for connection and the concave portion 47b (77b) for connection are the same.
The distance between the connection convex portion 44a (74a) and the connection concave portion 45a (75a), the distance between the connection convex portion 44b (74b) and the connection concave portion 45b (75b), and the connection with the connection convex portion 46a (76a). The distance between the concave portion 47a (77a) and the convex portion 46b (76b) for connection and the concave portion 47b (77b) for connection are the same.
When it is not necessary to particularly distinguish a plurality of connecting convex portions 44a (74a) and 44b (74b), it is referred to as a connecting convex portion 44 (74). When it is not necessary to particularly distinguish between the plurality of connection recesses 45a (75a) and 45b (75b), it is referred to as a connection recess 45 (75). When it is not necessary to particularly distinguish a plurality of connecting convex portions 46a (76a) and 46b (76b), it is referred to as a connecting convex portion 46 (76). When it is not necessary to particularly distinguish between the plurality of connection recesses 47a (77a) and 47b (77b), it is referred to as a connection recess 47 (77).

The side surface 4e or side surface 4f of the operating device A4 and the side surface 7f or side surface 7e of the operating device B7 are in contact with each other and can be connected to each other.
In a state where the side surface 4e of the operating device A4 and the side surface 7f (7e) of the operating device B7 are in contact with each other and the two operating devices A and B are connected, the connecting protrusions 44a and 44b provided on the side surface 4e of the operating device A4 are connected. Each is inserted into the connecting recesses 77a (75a) and 77b (75b) provided on the side surface 7f (7e) of the operating device B7. The connecting protrusions 76a (74a) and 76b (74b) provided on the side surface 7f (7e) of the operating device B7 are inserted into the connecting recesses 45a and 45b provided on the side surface 4e of the operating device A4, respectively.
In a state where the side surface 4f of the operating device A4 and the side surface 7f (7e) of the operating device B7 are in contact with each other and the two operating devices A and B are connected, the connecting protrusions 46a and 46b provided on the side surface 4f of the operating device A4 are connected. Each is inserted into each of the connecting recesses 77a (75a) and 77b (75b) provided on the side surface 7f (7e) of the operating device B7. The connecting protrusions 76a (74a) and 76b (74b) provided on the side surface 7f (7e) of the operating device B7 are inserted into the connecting recesses 47a and 47b provided on the side surface 4f of the operating device A4, respectively.
In these cases, as shown in FIG. 18A, the operating device A4 and the operating device B7 are connected so that their short sides are in contact with each other.

As described above, in the present embodiment, in addition to the connection between the main body device and the operation device, the connection between a plurality of operation devices is also possible. Further, in the information processing system 1, the main body device 2, the operation device A4, and the operation device B7 are configured so as to be able to physically take various connection shapes, and are specialized in the function of the application to be executed. It can be a connection shape. As a result, the input operability according to the function of the application can be improved, and the usability of the main body device and the operation device that can be connected to each other can be improved.

(Detection mechanism)
The information processing system 1 is provided with a detection mechanism for detecting the connection between the connection convex portion and the connection concave portion at each connection location. Each of the plurality of detection mechanisms has a detection target and a detection unit. The information processing system 1 has a plurality of detection objects and a plurality of detection units. The detection unit detects the object to be detected. In the present embodiment, each of the plurality of detection objects is identified by the detection unit and configured to be detectable.

The main body device 2 is provided with an object to be detected, and the operation device A4 and the operation device B7 connected to the main body device 2 are provided with a detection unit. Further, in order to detect the connection between two different operating devices (here, the operating device A4 and the operating device B7), one operating device is provided with a detection target, and the other operating device is provided with a detection unit. Will be.

The detection target corresponds to each of a plurality of connection recesses 11a to 11d, 12a, 12c, 12d, 13a to 13x provided in the main body device 2, and is provided in close proximity to the corresponding connection recesses. Further, the detection target is a plurality of connection recesses 43a (73a), 43b (73b), 45a (75a), 45b (75b), 47a (77a), 47b ( 77b) Corresponding to each, provided in close proximity to the corresponding connection recess.
The detection unit includes a plurality of connecting convex portions 41a to 41h (71a to 71h), 42a (72a), 42b (72b), 44a (74a), 44b (74b) provided in the operating device A4 (operating device B7). It corresponds to each of 46a (76a) and 46b (76b), and is provided in close proximity to the corresponding convex portion for connection.

FIG. 12 is a specific example of the detection mechanism. FIG. 12A is a schematic diagram when a magnet is used as the detection mechanism. FIG. 12B is a schematic diagram when a resistor is used as the detection mechanism. FIG. 12C is a schematic diagram when a photoreflector is used as the detection mechanism.

As shown in FIG. 12A, the detection mechanism 9 may be configured to include a magnet 92 as a detection target and a magnetic sensor 91 as a detection unit.
In the main body device 2, the magnet 92 is provided for each of a plurality of connection recesses 11a to 11d, 12a, 12c, 12d, 13a to 13x, and is embedded in the main body device 2. In the operating device A4 and the operating device B7, the magnet 92 is provided for each of a plurality of connecting recesses 43a, 43b, 45a, 45b, 47a, 47b, 73a, 73b, 75a, 75b, 77a, 77b, and the operating device A4, It is embedded in the operating device B7.
In the information processing system 1, the plurality of magnets 92 include magnets having different magnetic forces from each other. Here, for the sake of clarity, the magnetic forces of the magnets 92 are assumed to be different from each other.
In the operating device A4 and the operating device B7, the magnetic sensor 91 has the connecting protrusions 41a to 41h, 42a, 42b, 44a, 44b, 46a, 46b, 71a to 71h, 72a, 72b, 74a, 74b, 76a, 76b, respectively. It is provided corresponding to. The magnetic sensor 91 senses the magnitude of the magnetic field of the magnet 92.
Here, since the magnetic forces of the plurality of magnets 92 are different from each other, the magnetic sensor 91 detects a different value for each connection recess. Therefore, based on the detection result of the magnetic sensor 91, it is possible to know which connection concave portion the connection convex portion located corresponding to the magnetic sensor 91 is inserted into. In this way, since the magnets that are the plurality of detection objects have different magnetic forces, the plurality of magnets provided for each connection recess can be identified and detected by the magnetic force sensor that is the detection unit, and thus can be detected. The position of each connection recess can be identified. Therefore, from the detection result of each magnetic sensor 91, that is, the detection information, it is possible to acquire the connection position information in each device for each connection location of the devices 2, 4 and 7.
Here, an example is given in which the magnetic forces of the magnets 92 are different from each other, but the present invention is not limited to this. Since the combination of the connection positions of the connection concave portion and the connection convex portion is limited by the connection shape that can be taken between the devices, among the magnets 92 provided for each of the plurality of connection concave portions, the magnet 92 having the same magnetic force is used. There may be.

As shown in FIG. 12B, the detection mechanism 9 includes a resistor 95 as a detection object, a connection detector 98 as a detection unit, and an electronic contact 96 electrically connected to the connection detector 98. It may be composed of.
In the main body device 2, the resistance 95 is provided for each of a plurality of connection recesses 11a to 11d, 12a, 12c, 12d, 13a to 13x, and is embedded in the main body device 2. In the operating device A4 and the operating device B7, the resistor 95 is provided for each of the plurality of connecting recesses 43a, 43b, 45a, 45b, 47a, 47b, 73a, 73b, 75a, 75b, 77a, 77b, and the operating device A4 and the operating device B7. It is embedded in the operating device B7. The resistor 95 is electrically connected to the terminal 94 exposed on the surface.
In the information processing system 1, the plurality of resistors 95 include resistors having different resistance values from each other. Here, in order to make the explanation easy to understand, it is assumed that the resistance values of the respective resistors 95 are different from each other.
In the operating device A4 and the operating device B7, the connection detector 98 is electrically connected to the power supply 97 and the electronic contact 96 exposed on the surface. The electronic contacts 96 and the connection detector 98 correspond to the connecting protrusions 41a to 41h, 42a, 42b, 44a, 44b, 46a, 46b, 71a to 71h, 72a, 72b, 74a, 74b, 76a, 76b, respectively. It will be provided.
When the connecting convex portion is inserted into the connecting concave portion and the two devices are physically connected, the electronic contact 96 and the terminal 94 come into contact with each other. A current is passed from the power supply 97 in a state where the electronic contact 96 and the terminal 94 are in contact with each other, and the resistance value is measured by the connection detector 98. Here, since the resistance values of the resistors 95 are different from each other, the connection detector 98 detects different values for each connection recess. Therefore, based on the detection result of the connection detector 98, it is possible to know which connection concave portion the connection convex portion located corresponding to the connection detector 98 is inserted into. In this way, since the resistors that are the plurality of detection objects have different resistance values, the connection detector that is the detection unit can identify and detect the plurality of resistors provided for each connection recess. As a result, the position of each connection recess can be identified. Therefore, from the detection result of each connection detector 98, it is possible to acquire the connection position information in each device for each connection location of each device 2, 4 and 7.
Here, an example is given in which the resistance values of the respective resistors 95 are different from each other, but the present invention is not limited to this. Since the combination of the connection positions of the connection concave portion and the connection convex portion is limited by the connection shape that can be taken between the devices, the resistance 95 having the same resistance value among the resistance 95 provided for each of the plurality of connection concave portions is limited. There may be.

As shown in FIG. 12C, the detection mechanism 9 includes a connection recess 11 (12, 13, 43, 45, 47, 73, 75, 77) as a detection target and a photo reflector 99 as a detection unit. It may be composed of and.
In the main body device 2, a plurality of connection recesses 11a to 11d, 12a, 12c, 12d, 13a to 13x as detection objects are configured so that the depths of the recesses (hereinafter, may be referred to as recess depths) are different. Will be done. In the operating device A4 and the operating device B7, a plurality of connecting recesses 43a, 43b, 45a, 45b, 47a, 47b, 73a, 73b, 75a, 75b, 77a, 77b as detection objects have different recess depths from each other. It is composed of. Here, for the sake of clarity, the depths of the connecting recesses are assumed to be different from each other.
In the operating device A4 and the operating device B7, the photoreflector 99 has the connecting protrusions 41a to 41h, 42a, 42b, 44a, 44b, 46a, 46b, 71a to 71h, 72a, 72b, 74a, 74b, 76a, 76b, respectively. It is provided corresponding to. The photoreflector 99 is an electronic component composed of an infrared LED as a light emitting unit and a phototransistor as a light receiving element. When the connecting convex portion is inserted into the connecting concave portion and the two devices are physically connected, the light emitted from the infrared LED is reflected by the inner bottom surface of the connecting concave portion and received by the phototransistor. The output current changes depending on this received light value. Here, since the recess depths of the connection recesses are different from each other, the photoreflector 99 detects a different value for each connection recess. Therefore, based on the detection result of the photoreflector 99, it is possible to know which connection concave portion the connecting convex portion located corresponding to the photoreflector 99 is inserted into. As described above, since the connection recesses that are the plurality of detection objects have different recess depths, it is possible to identify and detect each connection recess by the photoreflector that is the detection unit. Therefore, from the detection result of each photoreflector 99, it is possible to acquire the connection position information in each device for each connection point of each device 2, 4 and 7.
Here, an example is given in which the depths of the concave portions for connection are different from each other, but the present invention is not limited to this. Since the combination of the connection positions of the connection concave portion and the connection convex portion is limited by the connection shape that can be taken between the devices, there may be a connection concave portion having the same concave depth among the plurality of connection concave portions.

As described above, various detection mechanisms for detecting the connection can be applied. Further, the present invention is not limited to the detection mechanisms shown in FIG. For example, an infrared light emission pattern or a pressure sensor may be used as the detection mechanism.
When an infrared light emission pattern is used, an infrared LED can be used as a detection target and a phototransistor can be used as a detection unit. Infrared LEDs are provided corresponding to each connection recess. The phototransistor is provided corresponding to each convex portion for connection. Each infrared LED emits light having a light emission pattern having different blinking speeds, and the phototransistor receives the light from the infrared LED. By making the light emission pattern emitted from each infrared LED different, based on the detection result by the photoreflector, which connection concave portion the connecting convex portion located corresponding to the photoreflector was inserted was inserted. Recognize.
When a pressure sensor is used, the photoreflector 99, which is the detection mechanism of FIG. 12C, may be used as the pressure sensor. The pressure sensor may be a tactile switch as long as it is a sensor having a long stroke whose value changes continuously depending on the degree of pushing. The pressure sensor is connected to the power supply 97 and the connection detector 98 as in the detection mechanism of FIG. 12 (B). As shown in FIG. 12C, the depths of the connection recesses 11 (12, 13, 43, 45, 47, 73, 75, 77) as the detection target are different from each other. The depth of the recess at this time is detected by the pressure sensor as the pushing amount. Therefore, based on the detection result of the pressure sensor, it can be known to which connection concave portion the connection convex portion located corresponding to the pressure sensor is inserted.

Hereinafter, a case where the resistor 95 shown in FIG. 12B is used as the detection mechanism will be described as an example.

[Example of functional configuration of information processing system]
The functional configuration of the information processing system 1 will be described with reference to FIG.
FIG. 4 is a schematic configuration and a functional block diagram of the information processing system.
The information processing system 1 has a main body device 2, an operating device A4, and an operating device B7.

(Functional configuration of the main unit)
As shown in FIG. 4, the main body device 2 has a case 20 and a smartphone 3 as an information processing device.
The case 20 is provided with a plurality of resistors 95, which are detection objects of the detection mechanism. As described above, resistors 95 having different resistance values are provided corresponding to each of the plurality of connection recesses 11a to 11d, 12a, 12c, 12d, and 13a to 13x. In FIG. 4, a reference numeral 951 is attached to distinguish the plurality of resistors 95 provided in the main body device 1 from the plurality of resistors 95 provided in the operating device. Further, reference numerals 951A to 951X are added for convenience in order to distinguish the plurality of resistors 951 provided in the main body device 2 from each other. When it is not necessary to distinguish between the resistors 951A to 951X, the resistors 951A will be described.

The smartphone 3 has a communication unit 31, an information acquisition unit 32, a control unit 33, a display unit 35, a touch panel 36, and a storage unit 37.

The communication unit 31 includes, for example, a wide area communication module and a narrow area communication module (not shown). The wide area communication module has a function of connecting to a public network such as the Internet for communication. The narrow-range communication module has a function of communicating with other devices using wireless LAN (Local Area Network), Bluetooth (registered trademark), infrared communication, RFID (Radio Frequency IDentification), and the like. The smartphone 3 can communicate with the operation device A4 and the operation device B7 via the communication unit 31. For example, the smartphone 3 communicates with the operating device A4 and the operating device B7 by short-range wireless communication conforming to the Bluetooth standard.

The display unit 35 is composed of a display device using, for example, a liquid crystal display or EL (Electro-Luminescence), and displays a display image generated by the display control unit 332, which will be described later. The display unit 35 is integrally configured with the touch panel 36.
The touch panel 36 is an input operation unit that receives an input operation from the user. As the touch panel, a capacitance type touch panel, a resistance film type touch, or the like can be used. Examples of the operator for operating the smartphone 3 include a finger and a stylus.
As described above, the display unit 35 of the smartphone 3 has both a function as an input operation surface for receiving an operation by the user and a function as a display surface.

The information acquisition unit 32 relates to the connection position in the main body device 2 and the connection position in the operation device A4 for each connection point between the main body device 2 and the operation device A4 acquired by the operation device A4 via the communication unit 31. Get connection position information.
The information acquisition unit 32 relates to the connection position in the main body device 2 and the connection position in the operation device B7 for each connection point between the main body device 2 and the operation device B7 acquired by the operation device B7 via the communication unit 31. Get connection position information.
The information acquisition unit 32 is the connection position and operation in the operation device A4 for each connection point between the operation device A4 and the operation device B7 acquired by at least one of the operation device A4 or the operation device B7 via the communication unit 31. Acquires the connection position information related to the connection position in the device B7.
The connection position information includes the detection results of each of the plurality of connection detectors 98.
The information acquisition unit 32 acquires input operation information performed by the user at at least one of the operation device A4 and the operation device B7 via the communication unit 31.
These information are output to the control unit 33.

The control unit 33 is a program control device such as a CPU, and executes a program stored in the storage unit 37. The control unit 33 executes an application program such as a game application and a program related to an operation device service using connection position information.
The service for the operating device is a service related to the connection between the main body device 2 and at least one of the operating device A4 or the operating device B7, and the connection between the operating device A4 and the operating device B7. In the present embodiment, as described above, it is possible to acquire connection position information using a plurality of detection mechanisms, and it is possible to provide a service for an operating device using the connection position information. This makes it possible to improve the usability of the main body device and the operating device that can be connected to each other.

The control unit 33 has an estimation unit 331, a display control unit 332, and an application activation control unit 333.

The estimation unit 331 estimates the connection shape between the main body device 2, the operation device A4, and the operation device B7 based on the connection position information acquired by the information acquisition unit 32. The estimation result of the connection shape is used when providing the service for the operating device.
The estimation unit 331 determines whether or not there is a connection failure at the connection location based on the connection position information.

The display control unit 332 controls the display image of the display unit 35.
The display control unit 332 generates a display image for displaying an image corresponding to the game application on the display unit 35.
The display control unit 332 generates a display image to be displayed on the display unit 35 based on the input operation information performed by the user in the operation device A4 and the operation device B7. The game progresses based on the input operation information. Further, the display control unit 332 generates a display image to be displayed on the display unit 35 based on the input operation information performed by the user in the main unit device 2.
The display control unit 332 generates a display image of the connection shape guide screen by using the estimation result of the connection shape by the estimation unit 331 and the connection shape information prepared in advance, which will be described later. The display image is displayed on at least one of the display unit 35, the display unit 5, and the display unit 8.
Further, when the estimation unit 331 determines that there is a connection failure portion, the display control unit 332 generates a display image for presenting the connection failure portion to the user. The display image is displayed on at least one of the display unit 35, the display unit 5, and the display unit 8.
Further, when the estimation unit 331 determines that there is a connection failure portion, the display control unit 332 generates a display image of a guide screen of another connection shape avoiding the connection at the connection failure portion. The display image is displayed on at least one of the display unit 35, the display unit 5, and the display unit 8.

The application start control unit 333 controls the start of the application based on the estimation result of the estimation unit 331.
More specifically, it is estimated by the estimation unit 331 using the connection shape information (sometimes referred to as connection shape information) taken when using the application associated with each application, which is prepared in advance. Start the application associated with the connection shape.
When there are a plurality of corresponding applications, a selected image for selecting them may be displayed on the display unit 35, for example. The user can see the selected image and perform an input operation to select a desired application.

The storage unit 37 is a memory device such as RAM, a disk device, or the like, and stores a program executed by the control unit 33. The storage unit 37 also operates as a work memory of the control unit 33, and stores data used by the control unit 33 in the process of program execution.

(Functional configuration of operating device)
As shown in FIG. 4, the operating device A4 (operating device B7) is provided with a plurality of electronic contacts 96 connected to each of the plurality of connection detectors 98. Each electronic contact 96 is provided corresponding to each of a plurality of connecting protrusions 41a to 41h, 42a, 42b, 44a, 44b, 46a, 46b, 71a to 71h, 72a, 72b, 74a, 74b, 76a, 76b.
In FIG. 4, a plurality of electronic contacts 96 provided in the operating device A4 are indicated by reference numerals 961A, 961B, 961C ... For convenience. A plurality of electronic contacts 96 provided in the operating device B7 are indicated by reference numerals 962A, 962B, 962C ... For convenience. When it is not necessary to distinguish electronic contacts 961A, 961B, 961C, etc., the electronic contacts 961 will be described. When it is not necessary to distinguish electronic contacts 962A, 962B, 962C, etc., the electronic contacts 962 will be described.
The operating device A4 (operating device B7) is provided with a plurality of resistors 95, which are detection objects of the detection mechanism. In the operating device A4 (operating device B7), the resistors 95 having different resistance values correspond to a plurality of connecting recesses 43a, 43b, 45a, 45b, 47a, 47b (73a, 73b, 75a, 75b, 77a, 77b), respectively. Is provided. In FIG. 4, reference numeral 952 (953) is used to distinguish the plurality of resistors 95 provided in the operating device A4 (operating device B7) from the plurality of resistors 95 provided in the main body device 2 and the operating device B7 (operating device A4). Is attached. Further, reference numerals 952A, 952B, 952C ... (953A, 953B, 953C ...) Are added for convenience in order to distinguish the plurality of resistors 952 (953) provided in the operating device A4 (operating device B7). ing. When it is not necessary to make a distinction such as resistors 952A, 952B, 952C ... (953A, 953B, 953C ...), the resistors 952 (953) will be described.

The operation device A4 (operation device B7) has a display unit 5 (8), a touch panel 51 (81), and a microcomputer 56 (86).

The display unit 51 (81) is composed of a display device using, for example, a liquid crystal display or EL (Electro-Luminescence). The display unit 51 (81) displays a display image generated by the display control unit 562 (862), which will be described later. The display unit 5 (8) is integrally configured with the touch panel 51 (81).
The touch panel 51 (81) is an input operation unit that receives an input operation from the user. As the touch panel, a capacitance type touch panel, a resistance film type touch, or the like can be used. Examples of the operator for operating the operation device A4 (operation device B7) include a finger and a stylus.
Similar to the main body device 2, the display unit 5 (8) and the touch panel 51 (81) are integrally configured. The display unit 5 (8) of the operation device A4 (operation device B7) has a function as an input operation surface for receiving an operation by the user and a function as a display surface.
In the present embodiment, the display units 5 and 8 of the operation device A4 and the operation device B7 display, for example, a GUI (Graphical User Interface) such as a cross key or an input operation button as an input operation screen. In addition, the display unit 5 (8) of the operation device A4 (operation device B7) may display a guide image of the connection shape, an image showing a connection failure portion in the operation device, and the like. Further, as described later with reference to FIG. 6, the display unit 5 of the operation device A4 and the display unit 8 of the operation device B7 may display, for example, an item in the game instead of the cross key or the input operation button.

The microcomputer 56 (86) includes a communication unit 560 (860), an estimation unit 561 (861), a display control unit 562 (862), an input unit 563 (863), and an output unit 564 (864). Have.

The communication unit 560 (860) includes, for example, a narrow area communication module (not shown). The narrow-range communication module has a function of communicating with the main unit 2 using a wireless LAN (Local Area Network), Bluetooth (registered trademark), infrared communication, RFID (Radio Frequency IDentification), or the like.

The detection result of the connection detector 98 connected to each electronic contact 961 (962) is output to the microcomputer 56 (86).
When the estimation unit 561 (861) of the microcomputer 56 (86) does not detect the resistance value by the connection detector 98 (when it is not detected), the connection convex portion located corresponding to the connection detector 98 is It is determined that the device is not connected. When the estimation unit 561 (861) detects the resistance value with the connection detector 98, the estimation unit 561 (861) determines that the connection convex portion located corresponding to the connection detector 98 is in the connected state.
As described above, the estimation unit 561 (861) is connected to the main body device 2 and the operation device B7 (operation device A4) based on the detection result of the connection detector 98 connected to each electronic contact 961 (962). Estimate the presence or absence. The estimation unit 561 (861) estimates the positional relationship between the main body device 2 and the operation device A4 (operation device B7) itself. That is, it is estimated at which connection position the operating device A4 (operating device B7) is connected to the main body device 2 and the operating device B7 (operating device A4), and by extension, in what direction. The orientation of the operating device A4 (operating device B7) is estimated.

Further, the estimation unit 561 (861) acquires the connection position information in which the position information of the connection detector and the detection result detected by the connection detector are associated with each connection location where the connection is detected. This connection position information indicates the connection position information in each device for each connection point between two different devices.
The connection position information acquired by the estimation unit 561 (861) is transmitted to the main unit 2 via the communication unit 560. The content to be transmitted may be changed depending on the band of the communication standard and the processing performance of the microcomputer of the operating device. If the band of the communication standard is narrow and the amount of communication is limited, only the result of estimating the shape by the microcomputer on the operating device side is sent, and if the amount of communication is large, all the connection status of each contact is sent to the main body. There may be. When the processing performance of the microcomputer of the operation unit is inferior, the estimation unit of the operation device does not estimate the shape, only the connection position information is transmitted to the main body device, and the estimation unit on the main body side estimates the shape.

The display control unit 562 (862) controls the display image of the display unit 5 (8).
Specifically, the display control unit 332 displays a GUI display image such as a cross key or an input operation button used for playing a game application started by the main unit device 2 for display on the display unit 5 (8). Generate. At this time, a display image corresponding to the orientation of the operation device A4 (operation device B7) estimated by the estimation unit 561 (861) is generated.
For example, in the connection shape shown in FIG. 5C, the main body device 2 is arranged horizontally, and the operation device A4 and the operation device B7 are arranged vertically. In the game play with this connection shape, the user typically holds the operation device A4 with the left hand and the operation device B7 with the right hand, and the game is displayed on the display unit 35 of the main body device 2 located sideways. Operate the game while looking at the screen. In the example shown in FIG. 5C, for example, a cross key (direction key) 52 is displayed on the operation device A4, and two operation buttons 53 are displayed on the operation device B7. The cross key 52 and the operation button 53 are displayed so as to be operable corresponding to the display screen of the display unit 35 of the main body device 2. The cross key 52 is used to move the character displayed on the display unit 35. For example, the character of the display unit 35 can be moved upward by the user touching the convex portion of the four convex portions extending in all directions constituting the cross key 52. , You can move the character to the right by touching the convex part that is convex to the right. In this way, the cross key 52, the operation button 53, and the like can be displayed on the display units 5 and 8 in the direction suitable for the input operation based on the information on the orientation of the operation device A4 and the operation device B7.
The display image generated by the display control unit 562 (862) is output to the output unit 564.

The input unit 563 (863) acquires input operation information by the user on the touch panel 51 (81) as an input operation unit and outputs the input operation information to the communication unit 560. The input operation information is transmitted to the main unit device 2. In the main body device 2, the game progresses based on the input operation information performed by the operation device such as the value input by the GUI.
The output unit 564 (864) outputs the display image generated by the display control unit 562 (862) to the display unit 5 (8). The display image is displayed on the display unit 5 (8).
The operation device A4 (operation device B7) can be used as a GUI that changes depending on the application, or can be used as an external display.

[Example of connection shape of each device]
In the information processing system 1, by providing a plurality of connection concave portions and a plurality of connection convex portions, the connection shapes of the devices 2, 4 and 7 can be made various.
16 (A) to 16 (C) are examples of connection shapes. In either form, a game screen is typically displayed on the main unit 2, and a GUI related to operation input such as a cross key or an operation button is displayed on the operation device A4 and the operation device B7. For example, the user grips the operating device A4 with his left hand, grips the operating device B7 with his right hand, and plays while watching the game screen of the main body device 2.

16 (A) is a plan view of the information processing system 1 shown in the perspective view of FIG. 5 (B). In the example shown in FIG. 16A, the main body device 2 is positioned horizontally, and the operating device A4 and the operating device B7 are positioned vertically. The operating device A4 and the operating device B7 are positioned so as to project from one long side of the main body device 2 having a substantially rectangular planar shape, and the operating device A4 and the operating device B7 are separated from each other.
In the example shown in FIG. 16A, the connection recess 13 provided on the bottom surface 2b of the main body device 2 and the connection convex portion provided on the top surface 4a (7a) of the operation device A4 (operation device B7). 41 (71) is connected. In a plan view, the main body device 2 and the operation device A4 and the operation device B7 partially overlap each other.
In the embodiment shown in FIG. 16A, there are two connection points between the main body device 2 and the operation device A4, and two connection points between the main body device 2 and the operation device B7. The connection point between the operating device A4 and the operating device B7 is 0.

The example shown in FIG. 16B is similar to the example shown in FIG. 16A, but the overlapping range of the main body device 2 with the operating device A4 and the operating device B7 in a plan view is shown in FIG. 16 (B). It is larger than the example shown in A). Therefore, in the example shown in FIG. 16B, the lengths of the operating device A4 and the operating device B7 protruding from one side of the main body device 2 are shorter than those in the example shown in FIG. 16A. This makes it easier to operate, for example, for a child whose hand is smaller than that of an adult.
In the example shown in FIG. 16B, the connection recess 13 provided on the bottom surface 2b of the main body device 2 and the connection convex portion provided on the top surface 4a (7a) of the operation device A4 (operation device B7). 41 (71) is connected. In a plan view, the main body device 2 and the operation device A4 and the operation device B7 partially overlap each other.
In the embodiment shown in FIG. 16B, there are four connection points between the main body device 2 and the operation device A4, and four connection points between the main body device 2 and the operation device B7. The connection point between the operating device A4 and the operating device B7 is 0.

In the example shown in FIG. 16C, the main body device 2, the operating device A4, and the operating device B7 are positioned sideways. The operating device A4 and the operating device B7 are positioned in contact with one long side of the main body device 2 having a substantially rectangular planar shape, and the operating device A4 and the operating device B7 are positioned in contact with each other. The main body device 2 and the operation device A4 and the operation device B7 do not overlap each other in a plan view.
In the example shown in FIG. 16C, the connection recess 11 (or the connection recess 12 provided on the side surface 2d) provided on the side surface 2c of the main body device 2 and the operation device A4 (operation device B7). It is connected to the connecting convex portion 42 (72) provided on the side surface 4c (7c) of the above. Each of the connecting convex portion and the connecting concave portion provided on the side surface 4e or the side surface 4f of the operating device A4 is connected to each of the connecting concave portion and the connecting convex portion provided on the side surface 7e or 7f of the operating device B7. ..
In the example shown in FIG. 16C, when the operation device is connected using the connection recess 11 provided on the side surface 2c of the main body device 2, the connection point between the main body device 2 and the operation device A4 is 2. There are two connection points between the main body device 2 and the operation device B7. When the operation device is connected using the connection recess 12 provided on the side surface 2d of the main body device 2, there are two connection points between the main body device 2 and the operation device A4 (or the operation device B7), and the main body device. There is only one connection point between 2 and the operating device B7 (or operating device A4). There are four connection points between the operation device A4 and the operation device B7.

The connection shape in which the main unit 2 and the operation device A4 and the operation device B7 are connected is given as an example, but depending on the type of the game application, the main unit and the operation device are not physically connected and are between the two operation devices. It can also be configured to take a connection shape that physically connects. For example, as shown in the example shown in FIG. 6A, it is possible to take a connection shape in which the operation device A4 and the operation device B7 are connected along the longitudinal direction.
In the embodiment shown in FIG. 6A, the connection point between the main body device 2 and the operation device A4 and the operation device B7 is 0. There are four connection points between the operation device A4 and the operation device B7.

[Explanation of connection shape information prepared in advance]
As described above, the connection shape information (hereinafter referred to as connection shape information) to be taken when using the application associated with each application is prepared in advance. Hereinafter, the connection shape shown in FIG. 5 (hereinafter referred to as connection shape 1) and the connection shape shown in FIG. 6 (hereinafter referred to as connection shape 2) will be taken as examples, and the connection prepared in advance for each game application will be taken as an example. The shape information will be described. The connection shape information is information on a combination of the position of the connection concave portion and the position of the connection convex portion for each connection location of each of the devices 2, 4 and 7.

For each game application, connection shape information of each device 2, 4 and 7 taken when playing the game application is prepared in advance. The connection shape information for each application exists in the operation device service.
Hereinafter, the connection shape information in each of the connection shape 1 and the connection shape 2 will be described.

(Connection shape 1)
This will be described with reference to FIGS. 5 and 7.
FIG. 5A shows each device 2, 4 and 7 before connection. FIGS. 5 (B) and 5 (C) show a state in which the devices 2, 4 and 7 are connected by the connection shape 1. FIG. 5C shows a state in which the game application is started, the game screen is displayed on the display unit 35, the cross key 52 is displayed on the display unit 5, and the operation button 53 is displayed on the display unit 8. The game application here is referred to as a game application A. In the play of the game application A, it is assumed that the connection shape 1 can be taken.

FIG. 7 shows a combination pattern (hereinafter, simply referred to as a pattern) of the connection concave portion (resistance side) and the connection convex portion (electronic contact, connection detector side) when the information processing system 1 takes the connection shape 1. There is.) Is shown. The combination pattern shown in FIG. 7 is connection shape information corresponding to the game application A.
The "top", "bottom", "right", and "left" used in the following description of the connection shape 1 are based on the plan view shown in FIG. 16 (A).

In the example shown in FIG. 5, the operating device A4 and the operating device B7 are set in the vertical orientation, and each operating device is located below the main body device in the horizontal orientation. Here, in the connection shape 1 shown in FIGS. 5 (B) and 5 (C), the operation device A4 (operation device B7) may be set so that the side surface 4e (7e) thereof is positioned on the upper side. It is also possible to set it so that it is located on the lower side. Further, although FIG. 5 shows an example in which the operating device A4 is located on the left side and the operating device B7 is located on the right side, the operating device A4 may be set to be located on the right side and the operating device B7 may be located on the left side. do. Here, the case where the main body device 2 is arranged so that the side surface 2c is located on the upper side and the side surface 2d is located on the lower side will be described as an example, but the side surface 2c is set to be located on the upper side. In addition, it may be possible to set it to be located on the lower side.

As shown in FIG. 7, when the side surface 2c of the main body device 2 is located on the upper side and the information processing system 1 takes the connection shape 1, the main body device 2 has connection recesses 13a to 13e, 13g, 13j as connection points. , 13 liters are used.
As shown in FIG. 7, when the connection shape 1 is formed by using these connection recesses 13, there are eight patterns that the operation device A4 and the operation device B7 can take.
Patterns 1 to 4 show a case where the operating device A4 is located on the left side and the operating device B7 is located on the right side. Patterns 5 to 8 show a case where the operating device B7 is located on the left side and the operating device A4 is located on the right side.
Patterns 1 and 5 show a case where the side surface 4e of the operating device A4 is located on the upper side and the side surface 7e of the operating device B7 is located on the upper side.
Patterns 2 and 6 show a case where the side surface 4e of the operating device A4 is located on the lower side and the side surface 7e of the operating device B7 is located on the lower side.
Patterns 3 and 7 show a case where the side surface 4e of the operating device A4 is located on the upper side and the side surface 7e of the operating device B7 is located on the lower side.
Patterns 4 and 8 show a case where the side surface 4e of the operating device A4 is located on the lower side and the side surface 7e of the operating device B7 is located on the upper side.

(Connection shape 2)
This will be described with reference to FIGS. 6 and 8.
In the example shown in FIG. 6, the game screen corresponding to the game application to be started is displayed on the display unit 35, and the items appearing on the game screen are displayed on the display units 5 and 8.
In the example shown in FIG. 6, in playing a game application, the devices 2, 4 and 7 may have two types of connection shapes shown in FIGS. 6A and 6B. The game application here is referred to as a game application B. In the play of the game application B, it is possible to take two types of connection shapes including the connection shape 2.
FIG. 6A shows a state in which the operating device A4 and the operating device B7 are physically connected by the connection shape 2.
FIG. 6B shows a state in which the operating device A4 and the operating device B7 are in a state of being physically connected to a separated state.

In FIGS. 6A and 6B, the sword and the sheath (item) possessed by the character on the game screen displayed on the display unit 35 are displayed on the display units 5 and 8. In the example shown in FIG. 6, the sword and scabbard are displayed so that their longitudinal directions coincide with the longitudinal direction of the operating device.
As shown in FIG. 6A, the state in which the operating device A4 and the operating device B7 are physically connected indicates a sword in which the sword is housed in a sheath.
As shown in FIG. 6B, the state in which the operating device A4 and the operating device B7 are physically separated indicates that the sword is pulled out from the sheath.
In this way, the operation by the user to separate the physically connected operation device A4 and the operation device B7 can express the sword withdrawal by the character on the display unit 35. Further, the operation by the user to physically connect the operation device A4 and the operation device B7 can express the sword delivery by the character on the display unit 35.
As described above, the present technology is also applied to the connection between the operation device A4 (first device) and the operation device B7 (second device) without connecting to the main body device 2.

Such a state change of physical connection and non-connection between the operation device A4 and the operation device B7 can be determined by the control unit 33 based on the connection position information. Then, the control unit 33 processes the physical connection state change between the two operating devices as input operation information by the user, and the display unit 35 displays the game screen according to the connection state change.
Prior to game play, pairing is performed in which the main body device 2 and the operation device A4 (operation device B7) recognize each other in advance. As a result, wireless communication between the main body device 2 and the operation device A4 (operation device B7) becomes possible. The connection position information at the connection point between the operation device A4 and the operation device B7 acquired at least on the other side of the operation device A4 and the operation device B7 is transmitted to the main body device 2. The control unit 33 of the main body device 2 determines the change in the connection state between the operation device A4 and the operation device B7 based on the connection position information, and generates a display image to be displayed on the display unit 35.

FIG. 8 shows a combination pattern of the connection concave portion (resistance side) and the connection convex portion (electronic contact, connection detector side) when the information processing system 1 takes the connection shape 2. The combination pattern shown in FIG. 8 is connection shape information corresponding to the game application B.
In the information processing system 1 having the connection shape 2 shown in FIG. 6A, the side surface 4f of the operating device A4 can be connected to any of the side surface 7e or the side surface 7f of the operating device B7, and the operating device can be connected. It is assumed that the side surface 4e of A4 can be connected to any of the side surface 7e or the side surface 7f of the operating device B7.

As shown in FIG. 8, when the information processing system 1 adopts the connection shape 2, there are four patterns that the operating device A4 and the operating device B7 can take.
The pattern 1 shown in FIG. 8 shows a case where the side surface 4f of the operating device A4 and the side surface 7e of the operating device B7 are in contact with each other and connected to each other.
Pattern 2 shows a case where the side surface 4e of the operating device A4 and the side surface 7f of the operating device B7 are in contact with each other and connected to each other.
Pattern 3 shows a case where the side surface 4f of the operating device A4 and the side surface 7f of the operating device B7 are in contact with each other and connected to each other.
The pattern 4 shows a case where the side surface 4e of the operating device A4 and the side surface 7e of the operating device B7 are in contact with each other and connected to each other.

[Information processing method]
Hereinafter, an example of an information processing method related to an operation device service in the information processing system 1 will be described.

(Information processing method related to launching game application)
An example of starting the game application based on the connection shape information of the game application A shown in FIG. 7 will be described with reference to FIGS. 5 and 9. FIG. 9 is a flow chart of an information processing method related to the activation of a game application.

As shown in FIG. 9, the operation device service is activated in the main unit 2 (ST1). It is assumed that the operation device A4 and the operation device B7 are connected to the main body device 2 by the user.
Next, the connection is made based on the detection result of each connection detector 98 provided corresponding to each of the plurality of connection protrusions by the microcomputer 56 of the operation device A4 (microcomputer 86 of the operation device B7). It is determined whether or not the connection between the electronic contact 961 (962) electrically connected to the detector 98 and the terminal 94 of the main body device 2 or the operating device B7 (operating device A4) is detected (ST2).

Further, the orientation of the operating device A4 and the operating device B7 is estimated by the microcomputer 56 of the operating device A4 (microcomputer 86 of the operating device B7) based on the detection result of each connection detector 98. Which electronic contact is electrically connected to the terminal 94 of the main body device 2 or the operation device B7 (operation device A4) in the operation device A4 (operation device B7) based on the detection result of each connection detector 98. Therefore, the orientations of the operating device A4 and the operating device B7 can be estimated.

Further, the information of the detection result of each connection detector 98 provided corresponding to each of the plurality of connection convex portions acquired by the microcomputer 56 of the operation device A4 (microcomputer 86 of the operation device B7) is obtained. It is transmitted to the main body device 2. The information is connection position information in each device for each connection location of each device 2, 4 and 7. The connection position information transmitted to the main unit 2 is acquired by the information acquisition unit 32 and output to the control unit 33.
Here, an example is given in which the microcomputer 56 of the operating device A4 (microcomputer 86 of the operating device B7) estimates the orientation of the operating device A4 (operating device B7), but the present invention is not limited to this. For example, even if the control unit 33 of the main unit 2 estimates the orientation of the operating device based on the connection position information acquired from each operating device and the estimated orientation information of the operating device is transmitted to each operating device. good.

If it is determined that it has been detected in ST2 (YES), the process proceeds to ST3. If it is determined that it has not been detected (NO), the process returns to ST2 and the process is repeated.

In ST3, the main body device is connected to each electronic contact 96 provided in the operation device A4 (operation device B7) for which the connection is detected by the estimation unit 331 of the main body device 2 based on the acquired connection position information. 2 and the position of the terminal in the operation device B7 (operation device A4), that is, the connection position is identified.

Next, the estimation unit 331 of the main body device 2 estimates the connection shapes of the devices 2, 4 and 7 using the result identified by ST3. Then, the estimation unit 331 determines whether or not the estimated connection shape matches the pattern of the connection shape information shown in FIG. 7 existing in the service for the operating device (ST4).
If it is determined that they match (YES), the process proceeds to ST5. If it is determined that they do not match (NO), the process proceeds to ST8.

In ST8, the display control unit 332 generates a display image of an error message for presenting to the user that the connection shape is incorrect. The display image is output to the display unit 35, and the display unit 35 displays an error message screen. Here, the guide screen presenting the correct connection shape may be displayed together with the error message. The display of the guide screen will be described later.
Next, the process returns to ST2 and the process is repeated.

When it is determined in ST4 that they match, the main body device 2 communicates with the operating device A4 (operating device B7) (ST5), and corresponds to the orientation of the operating device A4 (operating device B7) with respect to the operating device A4 (operating device B7). The specified GUI or the like is displayed on the display unit 5 (8) (ST6).
Specifically, the control unit 33 of the main body device 2 instructs the operation device A4 (operation device B7) to display a specified GUI or the like according to the orientation of the operation device. Upon receiving the instruction, the display control unit 562 (862) of the operation device A4 (operation device B7) displays a display image to be displayed on the display unit 5 (8) based on the orientation information of the operation device acquired by itself. Generate. For example, as shown in FIG. 5C, the display unit 5 (8) displays the cross key 52 (operation button 53) according to the orientation of the operation device A4 (operation device B7).

Next, the application activation control unit 333 of the main unit 2 activates a game application corresponding to the connection shape pattern determined to match in ST4 (ST7).
For example, in the example shown in FIG. 5, when it is determined in ST4 that the estimated connection shape matches the pattern shown in FIG. 7, the game application A corresponding to the connection shape pattern is started.
If there are a plurality of corresponding game applications, the title names of the plurality of corresponding game applications are displayed on the display unit 35, for example, by pop-ups, and the user selects which game application to start from these. You may be able to do it. In addition to displaying such a selection screen on the display unit 35, it may be displayed on the display units 5 and 8 of the operating device.

As described above, the connection shapes of the devices 2, 4 and 7 are estimated, and the game application corresponding to the estimated connection shape can be started by using the connection shape information prepared in advance. can.
In this way, the game application is automatically started according to the connection shapes of the devices 2, 4 and 7, so that the usability is improved.

It should be noted that there may be a function of allowing the user to input the age when starting the service for the operating device. For example, for adults and children, connection shape information as shown in FIG. 7 is prepared in advance, and it is determined whether the estimated connection shape matches the pattern existing in the service for the operating device. At that time, the age information may be taken into consideration in the determination.
As an example, information on the connection shape shown in FIG. 16B is prepared in advance as a connection shape when used by a child, and information on the connection shape shown in FIG. 16A is prepared in advance as a connection shape when used by an adult. .. In the connection shape shown in FIG. 16 (B), the region to be the grip portion is smaller than in the case of the connection shape shown in FIG. 16 (A), the overall shape is smaller, and the hand is smaller than an adult. The structure is suitable for children.

Further, there may be a function of inputting the user's dominant hand information when starting the service for the operating device. For example, for right-handed and left-handed people, connection shape information as shown in FIG. 7 is prepared in advance, and it is determined whether the estimated connection shape matches the pattern existing in the service for the operating device. When it is performed, the dominant hand information may be taken into consideration in the determination.
Further, the image displayed on each of the display device and the operation device may be controlled by adding the dominant hand information. For example, in the example shown in FIG. 6, as a display image for a right-handed user, a character with a sword hung on the left hip is displayed on the display unit 35 of the main body device 2, and a sheath is attached to an operating device that is gripped by the left hand during play. Display and display the sword on the operating device that is gripped with the right hand. On the other hand, as a display image for a left-handed user, a character with a sword hung on the right hip is displayed on the display unit 35 of the main body device 2, the sword is displayed on the operation device held by the left hand during play, and the operation is held by the right hand. Display the sheath on the device. As a result, the user can perform an operation suitable for his / her dominant hand, and can enhance the immersive feeling in the game. In this way, usability can be improved.

In addition, when the service for the operating device is activated, the user's status information such as the user being moving and environmental information such as raining can be obtained from the sensing results of various sensors provided in the smartphone 3. It may have a function. If you are on the move or in the rain, you cannot use both hands freely. In each of such an exceptional situation and a normal situation, the connection shape information as shown in FIG. 7 is prepared in advance, and whether the estimated connection shape and the pattern existing in the service for the operating device match. When the determination is made, the situation in which the user is placed and the surrounding environment information of the user may be taken into consideration in the determination.

Further, there may be a function of allowing the user to input the number of operating devices to be used when starting the service for operating devices. For example, it may be known in advance that one operating device has failed and only the other operating device can be used. For example, connection shape information as shown in FIG. 7 is prepared in advance for each number of operating devices to be used, and it is determined whether or not the estimated connection shape matches the pattern existing in the operating device service. At that time, the information on the number of operating devices to be used may be taken into consideration in the determination. As a result, the game can be operated even if the number of operating devices used is limited.

In this way, information related to the user (referred to as user information) such as user age information, user's dominant hand information, user's situation information, user's surrounding environment information, and information on the number of operating devices that can be used by the user. .) May be added. As a result, it is possible to provide the user with a connection shape suitable for each user, and the usability is further improved. The registered user may be selected when the service for the operating device is started. If it is a new user, options that can be newly registered may be displayed.

(Information processing method related to game application startup)
A guide screen that presents to the user the connection shapes of the devices 2, 4 and 7 corresponding to the application may be displayed on the display unit. Hereinafter, the game application A will be taken as an example and will be described with reference to FIGS. 10 and 11.
FIG. 10 is a flow chart of an information processing method related to the guide screen display.
FIG. 11 shows an example of a guide screen that presents the connection shape to the user.

As shown in FIG. 10, the operation device service is started in the main body device 2 (ST11).
Next, the main unit 2 determines whether or not the application has been started (ST12).
If it is determined that it has been activated (YES), the process proceeds to ST13. If it is determined that the device has not started (NO), the process returns to ST12 and the process is repeated.

In ST13, the estimation unit 331 of the main unit 2 is based on the connection position information acquired by the microcomputer 56 of the operation device A4 (microcomputer 86 of the operation device B7) acquired by the information acquisition unit 32 of the main unit 2. The position of the terminal in the main body device 2 and the operation device B7 (operation device A4) connected to each electronic contact 96 provided in the operation device A4 (operation device B7) for which the connection is detected, that is, the connection position is identified. Will be done.
In the operation device A4 (operation device B7), the orientation of the operation device A4 and the operation device B7 is estimated by the microcomputer 56 (microcomputer 86) based on the detection result of each connection detector 98.

Next, the estimation unit 331 of the main body device 2 determines whether or not the operation device A4 and the operation device B7 are connected to the main body device 2 using the result identified by ST13 (ST14).
If it is determined that the connection is established (YES), the process proceeds to ST15. If it is determined that the connection is not established (NO), the process proceeds to ST17.

In ST15, the estimation unit 331 of the main body device 2 estimates the connection shapes of the devices 2, 4 and 7 using the result identified in ST13. Then, it is determined whether or not the estimated connection shape matches the pattern shown in FIG. 7 existing in the service for the operating device.
If it is determined that they match (YES), the process proceeds to ST16. If it is determined that they do not match (NO), the process proceeds to ST18.

In ST16, the main body device 2 communicates with the operation device A4 (operation device B7), and the display unit 5 (8) displays a specified GUI or the like according to the orientation of the operation device to the operation device A4 (operation device B7). Display. For example, as shown in FIG. 5C, the display unit 5 (8) displays the cross key 52 (operation button 53) according to the orientation of the operation device A4 (operation device B7).

In ST17, the display control unit 332 generates a display image of the guide screen that presents to the user how to connect the devices 2, 4 and 7, and outputs the display image to the display unit 35. The guide screen is displayed on the display unit 35. After that, the process returns to ST13 and the process is repeated. A specific display example of the guide screen will be described later.

In ST18, the display control unit 332 generates a display image of the guide screen that presents to the user how to connect the devices 2, 4 and 7, and outputs the display image to the display unit 35. The guide screen is displayed on the display unit 35. After that, the process returns to ST13 and the process is repeated. A specific display example of the guide screen will be described later.
In this way, a guide screen for explaining the connection shapes of the devices 2, 4 and 7 may be presented to the user.

Specific guide screen examples in ST17 and ST18 will be described with reference to FIG. 11 (A) to 11 (D) show an example of a guide screen for explaining the connection shape shown in FIG. 16 (C). It should be noted that the present invention is not limited to these examples.
As shown in FIGS. 11A and 11B, the same numbers or symbols may be displayed at the connection positions connected to each other between the devices 2, 4 and 7. The user can connect the devices 2, 4 and 7 by matching the same numerical values or the same symbols with each other.
As shown in FIG. 11C, a plurality of lines having different colors may be displayed instead of numbers and symbols. The user can connect the devices 2, 4 and 7 so that the lines of the same color are butted against each other.
Further, as shown in FIG. 11D, the display unit 35 may display the states of the devices 2, 4, and 7 after the connection. The user can see the display screen and connect the devices 2, 4 and 7.
By displaying the guide screen in this way, the user can intuitively grasp the connection shape visually.

Further, the method of presenting the connection shape to the user is not limited to the form shown in FIG. For example, a blinking pattern may be used to indicate a butt-to-connect position. Further, the protrusion of the snap-fit mechanism, which is the connection mechanism, may be deformed. Further, when a sensor capable of detecting a proximity state is provided in the vicinity of the connection point, a display indicating the degree of approach may be displayed using the sensing result of the sensor until the connection is completed. Further, when the physical connection such as the insertion of the connection convex portion into the connection concave portion is insufficient, an error message indicating to that effect may be displayed to the user.

As described above, if the connection shapes of the devices 2, 4 and 7 are estimated based on the connection position information and the connection shape does not match the pattern in the connection shape information prepared in advance for each application, it is correct. A guide screen can be presented to the user so that the connection can be made in a connection shape. The user can easily connect according to the guide screen, and the usability is improved.

It should be noted that the user may be asked to input the age when the application is started, and the guide screen may be displayed so that the connection shapes of the devices 2, 4 and 7 are formed according to the age. When used by children, the guide screen is displayed so that the overall shape after connection is smaller than that for adults, considering the size of the child's hand. For example, in the case of an adult, the guide screen is displayed so as to have the connection shape shown in FIG. 16 (A), and in the case of a child, the guide screen is displayed so as to have the connection shape shown in FIG. 16 (B). Will be done. In this case, the connection shape information as shown in FIG. 7 is prepared in advance for each of the adult and the child.

Further, when the application is started, there may be a function of inputting the user's dominant hand information and guiding the user to a connection shape suitable for the right hand or the left hand. In this case, the connection shape information as shown in FIG. 7 is prepared in advance for each of the right-handed person and the left-handed person. Further, the images displayed on the display unit 35 of the main body device 2, the display unit 5 of the operation device A4, and the display unit 8 of the operation device B7 may be different depending on the dominant hand.

In addition, when the application is started, from the sensing results of various sensors provided in the smartphone 3, the situation information where the user is placed such as the user is moving, and the user's surrounding environment such as raining. There may be a function for obtaining information. With these information added, a guide screen for the connection shape may be displayed. For example, when moving or raining, it is determined that both hands cannot be used freely, and the guide screen is displayed so that the connection shape can be handled with only one hand. In this case, the connection shape information as shown in FIG. 7 is prepared in advance in each of the exceptional situation and the normal situation.
Further, there may be a function of automatically changing the connection form based on the user's status information and the surrounding environment information. For example, when it is determined that the vehicle is moving or it is raining, the connection mode is automatically changed so that the input operation can be performed with one hand.

Further, there may be a function that allows the user to input the number of operating devices to be used when starting the application. For example, it may be known in advance that one operating device has failed and only the other operating device can be used. Even in such a case, a guide screen of the connection shape may be displayed so that the game can be operated using the operating device. In this case, connection shape information as shown in FIG. 7 is prepared in advance for each number of operating devices to be used.

In this way, it is appropriate based on user information such as user's age information, user's dominant hand information, user's situation information, user's surrounding environment information, and information on the number of operating devices that can be used by the user. The connection shape may be presented to the user, or the connection form may be changed automatically. As a result, it is possible to provide the user with a connection shape and a connection form suitable for each user, and the usability is further improved. The registered user may be selected when the service for the operating device is started. If it is a new user, options that can be newly registered may be displayed.

Further, the control unit 33 may estimate the connection failure location based on the acquired connection position information. Then, as shown in FIG. 13, a display image for explaining the connection failure portion of the operation device A4 (operation device B7) may be generated. 13 (A) to 13 (D) are display image examples for explaining the connection failure location. The case where the connection detector (detection unit) or the like corresponding to the connection convex portion located at the lower left on the drawing is out of order is shown. As shown in FIG. 13A, the position corresponding to the failure location may be indicated by a color. As shown in FIG. 13B, the faulty part may be pointed by an arrow. As shown in FIG. 13C, the faulty part may be indicated by characters. As shown in FIG. 13 (D), a diagram of the entire operating device may be displayed on the display unit to indicate the faulty part by enclosing it in a circle.

Further, as shown in FIG. 14, a guide screen explaining the connection shape may be displayed so as to connect the devices 2, 4 and 7 while avoiding the failure location. 14 (A) to 14 (C) give an example in which the operating device A4 has a failure. As shown in these figures, the display unit of the operating device is displayed to indicate the faulty part, and the devices 2, 4 and 7 are displayed with numbers, symbols and lines indicating which part is to be connected. ..

Failures of operating devices can be broadly divided into two types.
The first type is a situation in which communication between the operating device and the main body device is possible, but the detection mechanism is out of order as described with reference to FIG. 13 above. For example, when the detection mechanism shown in FIG. 12B is used, the connection detector (detection unit) is out of order, or the electronic contacts and wiring connected to the connection detector are defective. In such a case, the faulty part of the operating device is presented as described with reference to FIG. 13, the faulty part of the operating device is presented as described with reference to FIG. 14, and the connection shape is presented. .. When there are many failed detectors, the number of connectable operating devices may be configured so that the user can input from the operating device service in the main unit 2, and the main unit 2 has a new connection shape based on this information. May be presented.
In the second type, the detection mechanism is not out of order and the connection shape can be recognized, but the communication between the operating device and the main body device cannot be performed. In such a case, if the operation device cannot communicate with the main unit even after a certain period of time has passed since the shape was recognized by the estimation unit, an error message such as "Cannot communicate with the main unit" is displayed on the display unit of the operation device. May be displayed. Note that shape recognition is estimation of the orientation of the operating device. After that, the number of connectable operating devices may be configured to be input by the user from the operating device service in the main body device 2, and the main body device 2 may present a new connection shape based on this information. ..

[Modification example]
In the above embodiment, an example is given in which a game screen is displayed on the display unit of the main unit and a cross key, an operation button, or the like is displayed on the display unit of the operation device. In this example, the main screen is displayed on the display unit of the main unit, and the auxiliary screen is displayed on the display unit of the operation device. On the other hand, the connection form may be configured such that the main screen is displayed on the display unit of the operating device and the auxiliary screen is displayed on the main body device so that the screens are interchanged. An example is shown in FIG.

FIG. 15 is a perspective view of the information processing system 1 when a document creation application is started as an application.
In the example shown in FIG. 15A, the document creation screen which is the main screen is displayed on the display unit of the main unit 2, and the keyboard which is the input operation unit is displayed as the auxiliary screen on the display units of the operation device A4 and the operation device B7. Will be done. The connection shape shown in FIG. 15 (A) is the same as that shown in FIG. 16 (C).
In the example shown in FIG. 15B, the document creation screen is displayed on the display unit of the operation device A4, and the keyboard is displayed on the main unit device 2. In the connection shape shown in FIG. 15B, there are two connection points between the main body device 2 and the operation device A4.
In this way, the main unit and the operation device may be connected in such a way that the main screen and the auxiliary screen are interchanged.
For example, in the information processing method related to the activation of the application, a function may be provided so that the user can input which is the main screen when the operation device service is activated. When the main screen is the main screen and when the operation device is the main screen, connection shape information is prepared in advance, and it is determined whether the estimated connection shape matches the pattern existing in the service. At that time, it is possible to make a judgment by adding information on which main screen to use.
Further, in the information processing method related to the display of the guide screen of the connection shape, a function may be provided so that the user can input which is the main screen when the application is started. When using the main screen as the main screen and when using the operating device as the main screen, prepare information on the shape of each connection pattern in advance, and add information on which main screen to use to guide the connection shape. The screen can be displayed.
Further, the guide screen of the connection shape may be displayed based on the information on the number of operating devices to be used input from the user, the information on the connection failure location of the operating device, and the like.

The embodiment of the present technology is not limited to the above-described embodiment, and various changes can be made without departing from the gist of the present technology.
For example, in the above-described embodiment, the number of operating devices is two, but the number is not limited and may be one or more.

Further, for example, in the above-described embodiment, an example is given in which a series of processes related to the service for the operating device is performed by the control unit 33 of the smartphone 3 as the information processing device, but the present invention is not limited to this. For example, it may be performed by an external device such as a cloud server different from the main body device and the operation device.

Further, the example of the connection shape of each of the devices 2, 4 and 7 is not limited to the above-mentioned form. For example, as shown in FIGS. 17 and 18, the devices 2, 4 and 7 in the information processing system 1 can be configured to have various connection shapes.
In the connection shape shown in FIG. 17A, each of the devices 2, 4 and 7 is set sideways. The main body device 2 and the operating devices A4 and B7 partially overlap each other in the thickness direction (Z-axis direction). The operating device A4 and the operating device B7 are in contact with each other and connected to each other.
In the connection shape shown in FIG. 17B, each of the devices 2, 4 and 7 is set sideways. The operating devices A4 and B7 are connected to the main body device 2 in a shape separated from each other.
In the connection shape shown in FIG. 17C, the main body device 2 is set to be horizontally oriented, and the operating device A4 and the operating device B7 are set to be vertically oriented. The operating device A4 and the operating device B7 are connected to the main body device 2 in a shape separated from each other.
In the connection shape shown in FIG. 17D, the main body device 2 and the operating device B7 are set to be horizontal, and the operating device A4 is set to be vertical. The operating devices A4 and B7 are connected to the main body device 2 in a shape separated from each other.
In the connection shape shown in FIG. 17 (E), the main body device 2 is set to be horizontally oriented, and the operating devices A4 and B7 are set to be vertically oriented. The main body device 2 and the operating devices A4 and B7 partially overlap each other in the thickness direction (Z-axis direction). The operating devices A4 and B7 are connected to the main body device 2 in a shape separated from each other.
FIG. 18A is the same as the connection shape described with reference to FIG.
In the connection shape shown in FIG. 18B, the operation device A4 and the operation device B7 are in contact with each other so as to be parallel to each other in the longitudinal direction and are connected to each other. The operating device A4 and the operating device B7 are not connected to the main body device 2.
In FIG. 18C, only one operating device A4 is connected to the main body device 2, and the other operating device B7 has a shape separated from the main body device 2 and the operating device A4.
FIG. 18D is the same as the connection shape described in FIG. 15B.
In FIG. 18E, each of the devices 2, 4 and 7 is set sideways. The main body device 2 and the operating device A4 are in contact with each other and connected, and the operating device B7 is connected only to the operating device A4.

Further, in the above-described embodiment, the connection shape is presented to the user by displaying the connection shape guide screen, but in addition to this, the voice guide may be used together.

Further, for example, in the above-described embodiment, the main body device in which the terminal device is held by the case has been described as an example, but the present invention is not limited to this. A case may not be used, and the terminal device itself may function as a main body device, and the terminal device may be provided with a connection recess and a detection object (resistor or the like) constituting a part of the detection mechanism.

As described above, in the present technology, the main body device and the operation device are configured so that various connection shapes can be obtained between the main body device and the operation device, or the operation device, so that various connection shapes according to the application can be provided. It will be possible. As a result, the user can perform the operation in the device form (connection shape) suitable for the application to be executed, and the operability is improved.
Since various connection shapes between devices can be estimated using the connection position information, the application can be started using the estimated connection shape and the prepared connection shape information, and usability is achieved. Is improved.
Further, by using the connection position information and the connection shape information, it is possible to present a guide image (display image) for explaining the connection shape, a display image for notifying the connection failure, and the like to the user. As a result, the user can easily connect the main body device and the operation device so as to have a connection shape suitable for the application, and the usability is improved.

The present technology can have the following configurations.
(1)
The connection position in the first device of the connection point between the first device having the first display unit and the second device having the second display unit which can be connected to each other and have a plurality of different connection shapes. An information acquisition unit that acquires connection position information related to the connection position in the second device, and
Control to control the display image displayed on at least one of the first display unit or the second display unit based on the connection position information, or control to control the activation of the application on the first device. An information processing device equipped with a unit.

(2)
The information processing device according to (1) above.
The control unit controls the display image by using the connection position information and the connection shape information between the first device and the second device prepared in advance for each application, or the application. An information processing device that controls the startup of.

(3)
The information processing device according to (2) above.
The control unit estimates the connection shape between the first device and the second device based on the connection position information, and controls the display image by using the estimation result and the connection shape information. Alternatively, an information processing device that controls the activation of the above application.

(4)
The information processing apparatus according to any one of (1) to (3) above.
The control unit is an information processing device that controls the display image for explaining the connection shape between the first device and the second device.

(5)
The information processing apparatus according to any one of (1) to (4) above.
The control unit is an information processing device that determines whether or not there is a connection failure at the connection location based on the connection position information, and controls the display image based on the determination result.

(6)
The information processing apparatus according to any one of (1) to (5) above.
The control unit is an information processing device that controls the display image or controls the activation of the application by adding the information of the user who operates the second device.

(7)
The information processing apparatus according to any one of (1) to (6) above.
It has multiple connection points,
The information acquisition unit is an information processing device that acquires the detection information of each of the detection mechanisms for detecting the connection between the first device and the second device provided for each connection location as the connection position information.

(8)
The information processing device according to (7) above.
There are a plurality of connection points for connecting the first device and the second device.
The detection object is provided in the first device, and the detection unit is provided in the second device.
An information processing device configured so that each of the plurality of detection objects can be identified and detected by the detection unit.

(9)
The information processing apparatus according to (7) or (8) above.
An information processing device in which at least one of a resistor, a magnet, infrared light, a photoreflector, and a tactile switch is used in the detection mechanism.

(10)
The information processing apparatus according to any one of (1) to (9) above.
The first device is an information processing device having a terminal device having a display unit and a holding unit for holding the terminal device.

(11)
Connection in the first device for each of the plurality of connection points between a first device having a first display unit and a second device having a second display unit that can be connected to each other at a plurality of connection points. Acquire the connection position information related to the position and the connection position in the second device, and obtain the connection position information.
An information processing method for controlling at least one display image of the first display unit or the second display unit, or controlling the activation of an application on the first device, based on the connection position information.

(12)
Connection in the first device for each of the plurality of connection points between a first device having a first display unit and a second device having a second display unit that can be connected to each other at a plurality of connection points. The step of acquiring the connection position information related to the position and the connection position in the second device, and
Information on a step of controlling the display image of at least one of the first display unit and the second display unit, or a step of controlling the activation of the application on the first device based on the connection position information. A program to be executed by the processing device.

2 ... Main unit (first device)
3 ... Smartphones (information processing devices, terminal devices)
4 ... Operating device A (second device)
5 ... Display unit (second display unit)
7 ... Operating device B (second device)
8 ... Display unit (second display unit)
9 ... Detection mechanism 32 ... Information acquisition unit 33 ... Control unit 35 ... Display unit (first display unit)
91 ... Magnetic sensor (detector)
92 ... Magnet (detection target)
95 ... Resistance (detection target)
98 ... Connection detector (detector)
99 ... Photo reflector (detector)

Claims (12)

The connection position in the first device of the connection point between the first device having the first display unit and the second device having the second display unit which can be connected to each other and have a plurality of different connection shapes. An information acquisition unit that acquires connection position information related to the connection position in the second device, and
Control to control the display image displayed on at least one of the first display unit or the second display unit based on the connection position information, or control to control the activation of the application on the first device. An information processing device equipped with a unit. The information processing apparatus according to claim 1.
The control unit controls the display image by using the connection position information and the connection shape information between the first device and the second device prepared in advance for each application, or the application. An information processing device that controls the startup of. The information processing apparatus according to claim 2.
The control unit estimates the connection shape between the first device and the second device based on the connection position information, and controls the display image by using the estimation result and the connection shape information. Alternatively, an information processing device that controls the activation of the application. The information processing apparatus according to claim 3.
The control unit is an information processing device that controls the display image for explaining the connection shape between the first device and the second device. The information processing apparatus according to claim 3.
The control unit is an information processing device that determines whether or not there is a connection failure at the connection location based on the connection position information, and controls the display image based on the determination result. The information processing apparatus according to claim 2.
The control unit is an information processing device that controls the display image or controls the activation of the application by adding the information of the user who operates the second device. The information processing apparatus according to claim 1.
There are a plurality of connection points for connecting the first device and the second device.
The information acquisition unit is an information processing device that acquires detection information of each of the detection mechanisms for detecting the connection between the first device and the second device provided at each connection location as the connection position information. The information processing apparatus according to claim 7.
Each of the plurality of detection mechanisms has a detection target and a detection unit.
The detection object is provided in the first device, and the detection unit is provided in the second device.
An information processing device configured so that each of the plurality of detection objects can be identified and detected by the detection unit. The information processing apparatus according to claim 8.
An information processing device in which at least one of a resistor, a magnet, infrared light, a photoreflector, and a tactile switch is used in the detection mechanism. The information processing apparatus according to claim 1.
The first device is an information processing device having a terminal device having a display unit and a holding unit for holding the terminal device. The connection position in the first device of the connection point between the first device having the first display unit and the second device having the second display unit which can be connected to each other and have a plurality of different connection shapes. The connection position information related to the connection position in the second device is acquired, and the connection position information is acquired.
An information processing method for controlling at least one display image of the first display unit or the second display unit, or controlling the activation of an application on the first device, based on the connection position information. The connection position in the first device of the connection point between the first device having the first display unit and the second device having the second display unit which can be connected to each other and have a plurality of different connection shapes. The step of acquiring the connection position information related to the connection position in the second device, and
Information on a step of controlling at least one display image of the first display unit or the second display unit, or a step of controlling the activation of an application on the first device, based on the connection position information. A program to be executed by the processing device.

Images