WO2023073759A1 - 操作デバイス - Google Patents
操作デバイス Download PDFInfo
- Publication number
- WO2023073759A1 WO2023073759A1 PCT/JP2021/039276 JP2021039276W WO2023073759A1 WO 2023073759 A1 WO2023073759 A1 WO 2023073759A1 JP 2021039276 W JP2021039276 W JP 2021039276W WO 2023073759 A1 WO2023073759 A1 WO 2023073759A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- node mechanism
- node
- link
- operating device
- link shaft
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/24—Constructional details thereof, e.g. game controllers with detachable joystick handles
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
Definitions
- the present invention relates to an operation device.
- Patent Document 1 discloses an operation device used for operating a game device. This operation device is provided with operation members such as operation buttons, direction keys, and operation sticks.
- the present invention has been made in view of the above problems, and one of its purposes is to provide an operation device with a high degree of freedom of operation by the user.
- An example of an operation device proposed in the present disclosure is an operation device that outputs a signal to a computer in accordance with a change in posture due to a user's operation, and includes a plurality of link shafts and a plurality of link shafts forming a lattice together with the plurality of link shafts. wherein each node mechanism part holds one end of at least two or more link shafts among the plurality of link shafts so that attitudes of the two or more link shafts can be changed. and first detection means for detecting directions in which the two or more link shafts extend with respect to the node mechanism.
- FIG. 4 is a perspective view showing one node mechanism and four link shafts held by the node mechanism;
- FIG. 4 is a perspective view showing a state in which a part of the exterior of the node mechanism is removed;
- FIG. 4 is an exploded perspective view showing a state where the link shaft is removed from the node mechanism;
- FIG. 4 is a cross-sectional view showing how a magnet arranged to face the three-dimensional magnetic sensor is displaced; It is a figure which shows typically the wiring structure of the display control system which concerns on this embodiment.
- FIG. 4 is a diagram showing position coordinates of each part of the node mechanism section; It is a top view which shows a mode that the operation device was attached to the jig
- FIG. 4 is a side view showing how the operation device is attached to the jig; It is a figure which shows the example of a display of the display object displayed in this embodiment. It is a figure which shows the pick-up operation
- 4 is a flow chart showing a processing flow in the information processing apparatus of the embodiment; It is a figure which shows the example of a display of the display object displayed in this embodiment. It is a figure which shows the example of a display of the display object displayed in this embodiment. It is a figure which shows the example of a display of the display object displayed in this embodiment.
- FIG. 1 is a diagram showing an example of the physical configuration of a display control system according to this embodiment.
- FIG. 2 is a perspective view showing the operating device of this embodiment.
- FIG. 3 is a functional block diagram showing an example of functions realized by the information processing apparatus of this embodiment.
- the display control system 100 includes an operation device 10 , an information processing device (computer) 20 and a display device 40 .
- the operation device 10 is, as shown in FIG. 2, a lattice-like device having multiple node mechanism parts ND and multiple link shafts SF.
- the operation device 10 outputs a signal to the information processing apparatus 20 according to a change in posture due to user's operation. Note that the operation device 10 is preferably large enough for the user to grasp both ends thereof with both hands.
- the operation device 10 has a three-dimensional magnetic sensor 50, an IMU 60, and a position sensor 70, as shown in FIG.
- the position coordinates of each node mechanism unit ND can be acquired by these various sensors, and the shape of the entire operation device 10 can be recognized. Details of the configurations and functions of various sensors and the overall configuration of the operation device 10 will be described later.
- one node mechanism unit ND is provided with four three-dimensional magnetic sensors 50, but in FIG. , only one three-dimensional magnetic sensor 50 is shown.
- the information processing device 20 may be, for example, a game device having a game program execution function, a moving image reproduction function, a communication function via the Internet, and the like.
- the information processing device 20 includes a processor 21 , a storage section 22 , a communication section 23 and an input/output section 24 .
- the processor 21 is a program-controlled device such as a CPU that operates according to a program installed in the information processing device 20, for example.
- the processor 21 has a function of executing a program and generating a moving image as a result of the execution.
- the storage unit 22 is, for example, a storage element such as ROM or RAM, or a hard disk drive.
- the storage unit 22 stores programs and the like executed by the processor 21 .
- the communication unit 23 is, for example, a communication interface for wired communication or wireless communication.
- the input/output unit 24 is, for example, an input/output port such as an HDMI (registered trademark) (High-Definition Multimedia Interface) port or a USB port.
- HDMI registered trademark
- High-Definition Multimedia Interface High-Definition Multimedia Interface
- the operation device 10 is capable of wired communication or wireless communication with the communication unit 23 included in the information processing device 20 .
- the display device 40 may be, for example, a liquid crystal display or the like. Moreover, the display device 40 may be a head-mounted display that the user can wear on the head.
- the information processing device 20 implements an acquisition unit 31 , a calculation unit 32 , and a display control unit 33 .
- the acquisition unit 31 is implemented mainly by the processor 21 and the communication unit 23 .
- the calculation unit 32 and the display control unit 33 are realized mainly by the processor 21 .
- Each of these functions is implemented by a computer executing the program according to the present embodiment. This program may be stored in a computer-readable information storage medium.
- the acquisition unit 31 acquires the position coordinates of each of the plurality of lattice points included in the operation device 10.
- the position coordinates of the plurality of grid points correspond to the position coordinates of the plurality of node mechanism parts ND.
- the position coordinates of the plurality of node mechanism units ND are obtained based on information detected by various sensors included in the operation device 10.
- the calculation unit 32 calculates the positional coordinates of the plurality of control points pre-associated with the lattice points. Note that each of the plurality of control points may be associated in advance with a portion of the display object.
- the display control unit 33 determines the display mode of each of the plurality of elements included in the display object based on the position coordinates of the plurality of grid points pre-associated with each of the plurality of elements. Further, the display control unit 33 causes the display device 40 to display the display object based on the positional coordinates of the plurality of control points respectively corresponding to the positional coordinates of the plurality of lattice points.
- FIG. 2 shows the operating device 10 in its basic posture.
- the “basic posture” of the operation device 10 means that the plurality of node mechanism portions ND are all at the same position in the vertical direction, and the plurality of node mechanism portions ND are spaced equally apart in the front-rear direction and the left-right direction. It is the posture in which it is placed.
- the operation device 10 has multiple node mechanisms ND and multiple link shafts SF.
- the node mechanism part ND holds the end of the link shaft SF so that the posture of the link shaft SF can be changed.
- One node mechanism portion ND holds ends of at least two or more link shafts SF. Both ends of the SF of all link shafts are held by the node mechanism portion ND.
- FIG. 2 shows an example in which five node mechanism units ND are arranged side by side in the front-rear direction and the left-right direction. That is, an example in which the operation device 10 has 25 node mechanism units ND is shown. Due to such arrangement, the outer shape of the operation device 10 is substantially rectangular.
- FIG. 2 shows a state in which the node mechanism portion ND and the link shaft SF are exposed to the outside, but when actually used by the user, the entire operation device 10 is covered with a covering member such as cloth. May be covered.
- the covering member may be made of a size and material that can be deformed or expanded and contracted according to changes in the posture of the operation device 10 . .
- the node mechanism unit ND provided at the front end and left end of the lattice-shaped operation device 10 is denoted by "ND11".
- the number of the reference numerals is increased as the distance from the node mechanism unit ND11 to the rear or to the right is increased. That is, for example, the node mechanism portion ND adjacent to the rear side of the node mechanism portion ND11 is indicated by the reference numeral "ND21”, and the node mechanism portion ND adjacent to the right side of the node mechanism portion ND11 is indicated by the reference numeral "ND12". is added.
- it will simply be referred to as "node mechanism unit ND" when there is no particular need to distinguish it.
- Both ends of the link shaft SF are held by the node mechanism portions ND, and the node mechanism portions ND adjacent to each other among the plurality of node mechanism portions ND are connected to each other.
- the link shaft SF connects the node mechanism portions ND adjacent to each other in the left-right direction, and connects the node mechanism portions ND adjacent to each other in the front-rear direction.
- the shaft that extends in the left-right direction and connects the node mechanism portions ND that are adjacent to each other in the left-right direction is denoted by "SF1".
- a shaft that extends in the front-rear direction and connects node mechanism portions ND that are adjacent to each other in the front-rear direction is denoted by a reference numeral “SF2”.
- link shaft SF when there is no particular need to distinguish between them, they will simply be referred to as "link shaft SF”.
- two link shafts SF are held in the node mechanisms ND11, ND15, ND51, and ND55 arranged at the corners of the lattice-shaped operation device 10, respectively.
- Three link shafts SF are held in the node mechanism portions ND12 to ND14 and the like arranged at the ends other than the corners.
- the four link shafts SF are respectively held by the node mechanism portions ND22 and the like arranged at the ends.
- the number of link shafts SF held in the node mechanism portion ND differs depending on the arrangement of the node mechanism portion ND, but it is assumed that one node mechanism portion ND holds at least two or more link shafts. good.
- FIG. 4 is a perspective view showing one node mechanism and four link shafts held by the node mechanism.
- FIG. 5 is a perspective view showing a state in which a part of the exterior of the node mechanism is removed.
- FIG. 6 is an exploded perspective view showing a state where the link shaft is removed from the node mechanism.
- FIGS. 4 and 5 show a node mechanism portion ND to which four link shafts SF extending forward, rearward, leftward, and rightward are attached. 5 shows a state in which the node mechanism section shown in FIG. 4 is vertically inverted and at least the lower plate 12 and the mounting section 132 are removed.
- the node mechanism part ND has an upper plate 11, a lower plate 12, and a holding part 13 sandwiched between the upper plate 11 and the lower plate 12 and holding the end of the link shaft SF.
- the holding portion 13 is fixed to the upper plate 11 and the lower plate 12 .
- four holding units 13 are provided in one node mechanism unit ND. This is to enable connection via the link shaft SF to each of the node mechanism portions ND that are adjacent in the left-right direction and the front-rear direction.
- the holding portion 13 has a housing portion 131 that houses a spherical portion B that is an end portion of the link shaft SF, which will be described later, and that has an inner wall along the shape of the spherical portion B. .
- an opening 131h that opens the accommodating portion 131 and has a smaller diameter than the diameter of the spherical portion B is formed in the holding portion 13 .
- the holding portion 13 is arranged so that the link shaft SF2 extending forward from the node mechanism portion ND is rotated ⁇ 45° around the X axis and ⁇ 45° around the Z axis with the holding portion 13 as a starting point. Holds angle changes tolerable.
- the link shaft SF2 extending rearward from the node mechanism portion ND, the link shaft SF1 extending leftward, and the link shaft SF1 extending rightward are similarly held by the holding portion 13 so as to allow the change in angle. ing.
- the holding section 13 includes a first member 131a and a second member 131b that form a housing section 131, and an attachment section 132 to which they are attached.
- each of the holding portions 13 is provided with a three-dimensional magnetic sensor 50 as first detection means for detecting the extending direction of the link shaft SF with respect to the node mechanism portion ND. Since four holders 13 are provided in one node mechanism ND, four three-dimensional magnetic sensors 50 are provided in one node mechanism ND.
- the direction in which the link shaft SF extends with respect to the node mechanism portion ND is, in other words, the inclination angle of the link shaft SF with respect to the node mechanism portion ND.
- the three-dimensional magnetic sensor 50 is preferably provided facing the magnet M so as to be able to detect changes in the magnetic field generated by the magnet M provided inside the spherical portion B of the link shaft SF, which will be described later.
- the three-dimensional magnetic sensor 50 capable of detecting magnetic signals in the X-axis, Y-axis, and Z-axis directions will be described as an example of the first detection means.
- a magnetic sensor capable of detecting a magnetic signal in the axial direction may be provided respectively.
- the first detection means is not limited to the magnetic sensor, and may be any sensor having a function of detecting the direction in which the link shaft SF extends with respect to the node mechanism portion ND.
- a configuration including a magnetism suppressing wall is adopted as part of the holding portion 13 .
- the mounting portion 132 is configured with a magnetic suppression wall made of an iron plate that reduces the magnetic influence of the magnet M. As shown in FIG. As a result, the three-dimensional magnetic sensor 50 can be prevented from being magnetically affected by magnets M other than the magnets M arranged to face the three-dimensional magnetic sensor 50 .
- the magnetic suppression wall may be made of a high magnetic permeability material such as permalloy containing iron and nickel as main components.
- the upper plate 11 is mounted with an IMU (Inertial Measurement Unit) 60, which is a second detection means for detecting the attitude of the node mechanism part ND.
- the IMU 60 includes a gyro sensor and an acceleration sensor, and detects angular velocity and acceleration of the node mechanism unit ND.
- an IMU will be described as an example of the second detection means, but the present invention is not limited to this, and any sensor having a function of detecting the orientation of the node mechanism unit ND may be used.
- a microprocessor may be mounted on the lower plate 12 .
- various information such as the inclination angle of the link shaft SF and the length of the link shaft SF may be calculated based on the output values of the various sensors. Since each node mechanism unit ND is equipped with a microprocessor in this manner, real-time sensing can be ensured.
- FIG. 7 is a cross-sectional view showing how a magnet arranged to face the three-dimensional magnetic sensor is displaced.
- the link shaft SF has an extending portion E extending in the left-right direction or the front-rear direction, and a spherical portion B forming an end portion of the extending portion E.
- the extending portion E is configured to be stretchable. It is preferable that the extending portion E is configured by two members that are slidably provided relative to each other so as to be able to expand and contract.
- the extending portion E arranged to extend in the left-right direction can be stretched in the left-right direction, and the extending portion E arranged to extend in the front-rear direction can be stretched in the front-rear direction.
- the maximum length of the extended portion E is preferably about 1.4 times its minimum length.
- a position sensor 70 which is a third detecting means for detecting displacement of the extending portion E, is attached to the extending portion E.
- Position sensor 70 may be, for example, a resistive position sensor and include a variable resistor that converts changes in mechanical position into analog electrical signals.
- the displacement of the extending portion E detected by the position sensor 70 is output to the information processing device 20 as information regarding the distance between the two node mechanism portions ND holding both ends of the link shaft SF having the extending portion E. good.
- a magnet M is embedded in the spherical portion B.
- Magnet M is preferably a permanent magnet.
- the magnet M is preferably provided so as to face the three-dimensional magnetic sensor 50 provided in the node mechanism section ND.
- the orientation of the magnet M changes as the direction in which the link shaft SF extends with respect to the node mechanism portion ND changes.
- the magnetic field detected by the three-dimensional magnetic sensor 50 changes.
- a change in the magnetic field detected by the three-dimensional magnetic sensor 50 may be output to the information processing device 20 as information regarding the direction in which the link shaft SF extends with respect to the node mechanism portion ND.
- the solid line in FIG. 7 indicates the link shaft SF in the state where the operation device 10 is in the basic posture
- the broken line in FIG. 7 indicates the link shaft SF in the state inclined with respect to the node mechanism portion ND.
- the magnetic field detected by the three-dimensional magnetic sensor 50 differs between the solid line state in FIG. 7 and the broken line state in FIG. 7 because the attitude of the magnet M with respect to the three-dimensional magnetic sensor 50 is different.
- FIG. 8 is a diagram schematically showing the wiring configuration of the display control system according to this embodiment. Although the node mechanism portion ND and the link shaft SF are partially omitted in FIG. 8, their arrangement is the same as that shown in FIG.
- the three-dimensional magnetic sensor 50 and the IMU 60 are mounted in each of the multiple node mechanism units ND.
- a position sensor 70 is mounted on each of the shafts SF. Signals detected by these sensors are output to the information processing device 20 . If signal lines are individually connected to each of the plurality of node mechanism portions ND, the wiring becomes complicated.
- a configuration is adopted in which five node mechanism units ND arranged in the front-rear direction output signals to the information processing device 20 through a common transmission path.
- a common signal line SL is connected to five node mechanism units ND arranged in the front-rear direction. That is, in this embodiment, five signal lines SL arranged in the horizontal direction are employed.
- a host node mechanism unit NDh which is an information aggregating unit for aggregating signals sent through the five signal lines SL.
- signals from 25 node mechanism units ND can be aggregated by one host node mechanism unit NDh and output to the communication unit 23 of the information processing device 20 via the host node mechanism unit NDh (see FIG. 1).
- the term "host node mechanism unit NDh" is used here for convenience, the configuration of the host node mechanism unit NDh is different from that of the node mechanism unit ND. That is, the host node mechanism unit NDh does not have various sensors and the like.
- the power supply line should preferably have the same wiring configuration as the signal line SL shown in FIG. In other words, power should be supplied through a common power line to the five node mechanism units ND arranged in the front-rear direction.
- the signal may be sent to the information processing apparatus 20 by wireless communication without being limited to this.
- each node mechanism unit ND should be equipped with a wireless communication circuit. By using wireless communication technology in this way, wiring becomes unnecessary, and the posture of the operation device 10 can be changed more flexibly.
- FIG. 9 is a diagram showing the positional coordinates of each part of the node mechanism section.
- a node number is given to each of the plurality of node mechanism units ND. That is, as shown in FIG. 2, in an example in which there are 25 node mechanism units ND, each node mechanism unit ND is given a node number from 1 to 25.
- FIG. FIG. 9 shows a node mechanism part ND with a node number n and a node mechanism part ND with a node number n+1 adjacent to the node mechanism part ND.
- FIG. 9 shows how the link shaft SF connecting the node mechanism part ND with the node number n and the node number n+1 is tilted, and the posture of the node mechanism part ND with the node number n+1 is tilted. Acquisition of the position coordinates of the node mechanism unit ND with the node number n+1 in this state will be described below.
- P n (X n , Y n , Z n ) be the coordinates of the central position of the node mechanism unit ND with the node number n.
- P n+1 (X n+1 , Y n+1 , Z n+1 ) be the coordinates of the center position of the node mechanism unit ND with the node number n+1. Further, in this embodiment, the coordinates of the central position of the node mechanism portion ND are used as the position coordinates of the node mechanism portion ND.
- the coordinates of the holding positions of the four link shafts SF held in the node mechanism portion ND with the node number n are expressed as PJ m (J m X n , J m Y n , J m Z n ) (m is the shaft number 1-4).
- the holding position is the center of the spherical portion B of the shaft SF.
- the first holding position PJ1 is located on the opposite side of the third holding position PJ3 with respect to the central position of the node mechanism portion ND.
- the second holding position PJ -2 is located on the opposite side of the fourth holding position PJ- 4 with respect to the central position of the node mechanism portion ND.
- the coordinates of the holding positions of the four link shafts SF held in the node mechanism portion ND with the node number n+1 are expressed as PJ m (J m X n+1 , J m Y n+1 , J m Z n+1 ) (m is the shaft numbers 1-4).
- the angle of the link shaft SF held in the node mechanism portion ND with the node number n around the V-axis (yaw axis) and the H-axis (pitch axis) shown in FIG. 4 is AJ m (J m V n , J m H n ).
- W be the length between the first holding position PJ- 1 and the third holding position PJ -3 in each node mechanism portion ND. Also, from the first holding position PJ1 of the link shaft SF, one end of which is held by the node mechanism portion ND of node number n, to the third holding position PJ1 of the link shaft SF, of which the other end is held by the node mechanism portion ND of node number n+1. to the holding position PJ3 is Rn .
- the length W is a preset fixed length, and the length Rn is a length that varies according to the length of the telescopic link shaft SF.
- the coordinates of the central position of the node mechanism part ND with the node number n are (0, 0, 0)
- the coordinates of the first holding position PJ 1 in the node mechanism part ND are (J 1 X n , J 1 Y n , J 1 Z n ) becomes (W/2, 0, 0).
- the coordinates (J 2 X n , J 2 Y n , J 2 Z n ) of the second holding position PJ2 are (0, -W/2, 0), and the coordinates of the third holding position PJ3 ( J 3 X n , J 3 Y n , J 3 Z n ) becomes ( ⁇ W/2, 0, 0), and the coordinates of the fourth holding position PJ 4 (J 4 X n , J 4 Y n , J 4 Z n ) becomes (0, W/2, 0).
- the coordinates (J 3 X n+1 , J 3 Y n+1 , J 3 Z n+1 ) of the third holding position PJ 3 in the node mechanism unit ND with node number n+1 are the node mechanism unit with node number n.
- the polar coordinate conversion is expressed as follows: be done.
- J 3 X n+1 J 1 X n +R n *sin(90° ⁇ J 1 V n )*cos(J 1 H n )
- J 3 Y n+1 J 1 Y n +R n *sin(90° ⁇ J 1 V n )*sin(J 1 H n )
- J 3 Z n+1 J 1 Z n +R n *cos(90° ⁇ J 1 V n )
- the coordinates P (X n+1 , Y n+1 , Z n+1 ) of the center position of the node mechanism portion ND with node number n+1 are the coordinates ( J 3 X n+1 , J 3 Y n+1 , J 3 Z n+1 ) are expressed as follows.
- Xn +1 J3Xn +1 +W/2*sin(90°-Vn +1 )*cos(Hn +1 )
- Y n+1 J 3 Y n+1 +W/2*sin(90° ⁇ V n+1 )*sin(H n+1 )
- Z n+1 J 3 X n+1 +W/2*cos(90° ⁇ V n+1 )
- the position coordinates of the node mechanism part ND with the node number n+1 include the position coordinates of the node mechanism part ND with the node number n, the inclination of the posture of the node mechanism part ND with the node number n+1, the node number n can be calculated based on the inclination angle of the link shaft SF with respect to the node mechanism portion ND and the length of the link shaft SF. By performing such calculation according to the number of node mechanism parts ND, the position coordinates of all node mechanism parts ND can be obtained.
- the inclination angle of the link shaft SF is detected based on the output value of the three-dimensional magnetic sensor 50, and the length of the link shaft SF is detected based on the output value of the position sensor 70.
- the tilt of the attitude of the node mechanism unit ND itself is detected based on the output value of the IMU 60 .
- FIG. 10 is a top view showing how the operation device is attached to the jig.
- FIG. 11 is a side view showing how the operation device is attached to the jig.
- the node mechanism portion ND and the link shaft SF are partially omitted in FIG. 10, their arrangement is the same as that shown in FIG.
- the three-dimensional magnetic sensor 50 detects the direction in which the link shaft SF extends with respect to the node mechanism portion ND based on the detected magnetic field. That is, the tilt angle of the link shaft SF is detected. Then, the display control system 100 acquires the position coordinates of the node mechanism unit ND based on various sensor outputs including information about the tilt angle of the link shaft SF, and displays the display object based on the acquired position coordinates.
- each link shaft SF (each three-dimensional magnetic sensor 50) is calibrated in advance so as to reduce the influence of these individual differences. It is preferable to The individual difference is caused by, for example, the tolerance of the position of the magnet M and the variation in magnetic specificity of the magnet M itself.
- a dedicated jig 80 is used to collectively perform calibration for a plurality of link shafts SF held by one node mechanism portion ND.
- the jig 80 includes mounting portions 81 for mounting the same number of node mechanism portions ND as the number of node mechanism portions ND. At least one of the plurality of mounting portions 81 is vertically movable along the Z-axis and rotatable about the Z-axis as a central axis. By operating the mounting portion 81 in this manner, each link shaft SF can be set at an arbitrary angle.
- the movable mounting portion 81 is indicated as a "mounting portion 81a", and the manner in which the node mechanism portion ND33 is mounted on the mounting portion 81a is shown.
- FIG. 10 shows how the tilt angles of the four link shafts SF held by the node mechanism part ND33 change as the mounting part 81a on which the node mechanism part ND33 is mounted rotates around the Z axis. showing.
- the tilt angle is changed in this way, it is preferable to acquire the output values of the four three-dimensional magnetic sensors 50 provided in the node mechanism unit ND.
- the inclination angle of the link shaft SF in increments of 5°, it is preferable to acquire the output value in each state.
- the lengths of the four link shafts SF held by the node mechanism portion ND33 are extended as the inclination angle of the node mechanism portion ND33 changes.
- FIG. 11 shows how the inclination angles of the four link shafts SF held by the node mechanism part ND33 change due to the upward movement of the placing part 81a on which the node mechanism part ND33 is placed.
- It shows how the tilt angle of the link shaft SF changes.
- FIG. 12 is a diagram showing a display example of display objects displayed in this embodiment.
- 13A and 13B are diagrams showing a user's picking up operation of the node mechanism unit.
- FIG. 12 is a diagram showing a display example of display objects displayed in this embodiment.
- 13A and 13B are diagrams showing a user's picking up operation of the node mechanism unit.
- FIG. 12 schematically shows how the user operates the operation device 10, and also shows display objects that change according to the operation.
- FIG. 12 shows a face, which is a three-dimensional object, as a display object displayed on the screen of display device 40 .
- the face before change is shown on the left side of the figure. That is, it shows the face displayed when the operation device 10 is in the basic posture.
- the face after the change is shown on the right side of the figure. That is, the face displayed when the operation device 10 has changed from the basic posture is shown.
- a plurality of control points are associated in advance with the face, which is a three-dimensional object. Also, each of the plurality of control points is associated in advance with the plurality of grid points of the operation device 10 .
- FIG. 12 shows grid points a to c and control points a' to c' previously associated with the grid points a to c.
- FIG. 12 shows an example in which the control point a' is associated with the vicinity of the nose on the face, and the control points b' and c' are associated with the vicinity of the mouth of the face.
- the information processing device 20 acquires the position coordinates of the grid points a to c of the operation device 10 using the acquisition unit 31 . That is, the position coordinates of the node mechanism part ND corresponding to the grid points a to c are obtained.
- the information processing device 20 calculates the position coordinates of the control points a' to c' by the calculation unit 32 based on the position coordinates of the lattice points a to c.
- the information processing device 20 causes the display control unit 33 to display the face, which is a three-dimensional object, on the display device 40 based on the position coordinates of the control points a' to c'.
- FIG. 12 shows how the lattice point b and the lattice point c are separated from each other in the horizontal direction by changing the posture of the operation device 10 so as to expand the operation device 10 in the horizontal direction.
- the posture of the operation device 10 By changing the posture of the operation device 10 in this way, the distance between the control point b' and the control point c' is widened, so that the face, which is a three-dimensional object, is displayed spread out in the horizontal direction.
- the outer shape of the display object and the outer shape of the operation device 10 do not have to match. That is, the outer shape of the display object may be dissimilar to the outer shape formed by connecting a plurality of grid points.
- the position coordinates of a control point may be determined according to the amount of movement of a grid point associated with the control point in advance. That is, the position coordinates of the control point may be determined according to the difference between the position coordinates of the grid point before movement and the position coordinates of the grid point after movement.
- the pick-up operation means an operation of the user picking up a predetermined node mechanism part ND and lifting it upward, as shown in FIG. 13 .
- the four link shafts SF held by the node mechanism portion ND33 are tilted by the weight of the four node mechanism portions ND adjacent to the node mechanism portion ND33 in the front, rear, left, and right directions.
- the four link shafts SF held by the picked up node mechanism portion ND33 are lengthened by the weight of the four node mechanism portions ND adjacent to the picked up node mechanism portion ND33 in the front, rear, left, and right directions. It will grow.
- grid point a is associated with control point a' corresponding to the vicinity of the nose on the face. Therefore, by moving the lattice point a upward, the facial expression is deformed so that the face is pulled forward.
- the node mechanism part ND33 When the user releases the node mechanism part ND33 from the state shown in FIG. 13, the node mechanism part ND33 should move downward due to its own weight. As a result, the operation device 10 is in the state before the pick-up motion is performed. Along with this, the face displayed on the display device 40 should return to the expression shown on the left side in FIG. Thus, in this example, the shape of the face (display object) can be changed not only two-dimensionally but also three-dimensionally. As a result, it is possible to diversify the variation of the change in the shape of the face.
- FIG. 14 is a flow chart showing the processing flow in the information processing apparatus of this embodiment.
- the acquisition unit 31 acquires the position coordinates of a plurality of lattice points of the operation device 10 (step S1).
- the calculation unit 32 calculates the position coordinates of the plurality of control points based on the position coordinates of the plurality of grid points (step S2).
- the display control unit 33 causes the display device 40 to display the display object based on the position coordinates of the plurality of control points (step S3).
- FIG. 15 is a diagram showing a display example of display objects displayed in this embodiment.
- FIG. 15 schematically shows how the user operates the operation device 10, and also shows display objects that change according to the operation.
- display objects displayed on the screen of the display device 40 three cylindrical objects (hereinafter referred to as cylindrical objects) are shown as parts constituting a three-dimensional object.
- the three cylindrical objects are associated in advance with control points a' to c', respectively.
- the display control unit 33 integrates the three cylindrical objects and displays a new object.
- FIG. 15 shows a state in which three cylindrical objects are integrated to display one large cylindrical object by bringing the control point b' and the control point c' close to each other.
- control points a' to c' are newly associated with one large cylindrical object.
- the posture of the operation device 10 is changed by the user's operation, thereby changing the shape of one large cylindrical object.
- FIG. 15 shows an example in which a new object is displayed according to the intervals between a plurality of control points, that is, the density of a plurality of lattice points
- the present invention is not limited to this.
- a new object may be displayed based on the movement amount or movement speed of the lattice points.
- FIG. 16 and 17 are diagrams showing display examples of display objects displayed in this embodiment.
- FIG. 16 schematically shows how the user operates the operation device 10, and also shows display objects that change according to the operation.
- FIG. 17 shows a two-dimensional object including characters or images as a display object displayed on the screen of the display device 40 .
- the part of the two-dimensional object is preferably associated with one of the lattice points of the operation device 10 in advance.
- FIG. 16 shows an example in which a portion of the two-dimensional object that includes characters or an image of "56789" is preliminarily associated with grid point a.
- FIG. 16 shows how a portion including the characters or image of "56789" is enlarged and displayed.
- FIG. 17 shows the operation of the operation device 10 by the user and the display objects that change according to the operation.
- FIG. 17 shows a two-dimensional object including characters or images as a display object displayed on the screen of the display device 40 .
- FIG. 17 shows how the two-dimensional object portion is enlarged and displayed as the operation device 10 is expanded in the horizontal direction.
- the operation device 10 has a high degree of freedom of operation by the user.
- display objects are displayed based on the positional coordinates of each grid point of the operation device 10, which has a high degree of freedom in operation, so that the user can intuitively operate the display objects using the tactile sensation. realizable.
- various display modes can be represented by changing the display object three-dimensionally based on the position coordinates of a plurality of lattice points.
- n and m are preferably integers of at least 3 or more.
- n and m may be different numbers.
- the number of node mechanism units ND included in the operation device 10 may be variable. For example, among the node mechanism portions ND shown in FIG. 2, n and m are set to 6 or more by holding the link shaft SF in the node mechanism portion ND including the holding portion 13 that does not hold the link shaft SF. may be possible. For this purpose, regardless of the number of link shafts SF held, the configuration itself of the node mechanisms ND should be common to each other. Moreover, the manufacturing cost can be suppressed by sharing the configuration of the node mechanism unit ND. Further, regarding the link shafts SF as well, regardless of their arrangement and orientation, it is preferable that the configuration itself be common to each other.
- the four adjacent node mechanism portions ND and the four link shafts SF connecting them form a square lattice shape
- the present invention is not limited to this.
- polygonal grids may be arranged so as to form a triangular grid or a pentagonal grid.
- the link shaft SF may be rotatable about a roll axis (a dashed line shown in FIG. 4) when the V axis shown in FIG. 4 is the yaw axis and the H axis is the pitch axis. That is, the node mechanism part ND may hold the link shaft SF so as to allow rotation about the extension direction of the link shaft SF. By adopting such a configuration, it is possible to further improve the flexibility of the attitude of the operation device 10 .
- the operation device 10 includes various sensors and acquires the position coordinates of the node mechanism unit ND.
- the position coordinates of the node mechanism unit ND may be acquired using a camera or the like that photographs the operation device 10 from the outside. In this case, it is preferable to use a camera capable of acquiring three-dimensional position data.
- the operation device 10 may change its shape due to the weight of the node mechanism portion ND.
- one of the node mechanism portion ND11 and the node mechanism portion ND12 shown in FIG. 2 holds the link shaft SF1 so that the extending direction of the link shaft SF1 held by itself changes due to the weight of the other. I hope you are. Therefore, for example, in a state where the operation device 10 is placed on a placement surface on which unevenness is formed, the shape of the operation device 10 may be changed so as to follow the unevenness.
- the operation device 10 preferably does not have biasing means or the like for returning its shape to its original shape. That is, the operation device 10 preferably maintains its shape except when the user performs an operation to change its shape. For example, as shown on the right side of FIG. 17, when the user releases the operation device 10 while the display object is partially enlarged, the enlarged display may be maintained.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Position Input By Displaying (AREA)
Abstract
Description
まず、図1~3を参照して、本実施形態に係る表示制御システム100の概要について説明する。図1は、本実施形態に係る表示制御システムの物理構成の一例を示す図である。図2は、本実施形態の操作デバイスを示す斜視図である。図3は、本実施形態の情報処理装置で実現される機能の一例を示す機能ブロック図である。
次に、主に図2を参照して、本実施形態の操作デバイス10の構成について説明する。図2においては、基本姿勢にある操作デバイス10を示している。本実施形態において、操作デバイス10の「基本姿勢」とは、複数のノード機構部NDが上下方向において全て同じ位置にあり、かつ複数のノード機構部NDが前後方向及び左右方向において互いに等間隔に配置されている状態にある姿勢である。
次に、図4~図6を参照して、ノード機構部NDの構成の詳細について説明する。図4は、1つのノード機構部と、そのノード機構部に保持される4つのリンクシャフトを示す斜視図である。図5は、ノード機構部の外装の一部を取り除いた状態を示す斜視図である。図6は、ノード機構部からリンクシャフトを取り外した状態を示す分解斜視図である。図4、図5においては、前方、後方、左方、右方のそれぞれに向けて延びる4つのリンクシャフトSFが取り付けられるノード機構部NDを示している。なお、図5は、図4に示すノード機構部を上下方向で反転させると共に、少なくとも下板12及び取り付け部132を取り除いた状態を示している。
次に、図4~図7を参照して、リンクシャフトSFの構成の詳細について説明する。図7は、三次元磁気センサに対向して配置される磁石が変位する様子を示す断面図である。
次に、図8を参照して、本実施形態に係る表示制御システム100の伝送路について説明する。図8は、本実施形態に係る表示制御システムの配線構成を模式的に示す図である。なお、図8においては、ノード機構部ND及びリンクシャフトSFを一部省略して図示しているが、それらの配置は図2で示したものと同じである。
次に、図9を参照して、ノード機構部NDの位置座標の取得について説明する。図9は、ノード機構部の各部の位置座標を示す図である。ここで、複数のノード機構部NDにそれぞれノード番号を付与する。すなわち、図2に示すように、ノード機構部NDが25個ある例においては、各ノード機構部NDにはノード番号1~25のいずれかが付与される。図9においては、ノード番号nのノード機構部NDと、そのノード機構部NDに隣り合うノード番号n+1のノード機構部NDを示している。
J3Xn+1=J1Xn+Rn*sin(90°-J1Vn)*cos(J1Hn)
J3Yn+1=J1Yn+Rn*sin(90°-J1Vn)*sin(J1Hn)
J3Zn+1=J1Zn+Rn*cos(90°-J1Vn)
Xn+1=J3Xn+1+W/2*sin(90°-Vn+1)*cos(Hn+1)
Yn+1=J3Yn+1+W/2*sin(90°-Vn+1)*sin(Hn+1)
Zn+1=J3Xn+1+W/2*cos(90°-Vn+1)
次に、図10、図11を参照して、本実施形態におけるリンクシャフトSFの傾き角度と三次元磁気センサ50の出力値の関係について説明する。図10は、操作デバイスが治具に取り付けられた様子を示す上面図である。図11は、操作デバイスが治具に取り付けられた様子を示す側面図である。なお、図10においては、ノード機構部ND及びリンクシャフトSFを一部省略して図示しているが、それらの配置は図2で示したものと同じである。
次に、図12、図13を参照して、本実施形態に係る表示制御システム100における表示オブジェクトの表示例を説明する。図12は、本実施形態において表示される表示オブジェクトの表示例を示す図である。図13は、ユーザによるノード機構部の摘まみ上げ動作を示す図である。
次に、図14を参照して、情報処理装置20における処理フローを説明する。図14は、本実施形態の情報処理装置における処理フローを示すフローチャートである。
以上説明した本実施形態に係る操作デバイス10においては、伸縮及び折り曲げによる複雑な形状変化が可能である。そのため、操作デバイス10は、ユーザによる操作の自由度が高い。また、本実施形態においては、操作の自由度の高い操作デバイス10の各格子点の位置座標に基づいて表示オブジェクトを表示することより、ユーザの触覚を利用して感覚的に表示オブジェクトの動作を実現できる。また、本実施形態においては、複数の格子点の位置座標に基づいて三次元的に表示オブジェクトを変化させることにより、様々な表示態様を表現することができる。
本実施形態においては、前後方向に並ぶノード機構部NDの個数をn個、左右方向に並ぶノード機構部NDの個数をm個とした場合、n=5、m=5である例を説明した。ただしこれに限られず、nとmは、少なくとも3以上の整数であるとよい。また、nとmは異なる数であってもよい。
Claims (11)
- ユーザの操作による姿勢の変化に応じてコンピュータに信号を出力する操作デバイスであって、
複数のリンクシャフトと、
前記複数のリンクシャフトと共に格子状を成す複数のノード機構部であって、当該各ノード機構部は、前記複数のリンクシャフトのうち少なくとも2つ以上のリンクシャフトの一端を、当該2つ以上のリンクシャフトの姿勢を変化可能にそれぞれ保持する複数のノード機構部と、
前記ノード機構部に対する前記2つ以上のリンクシャフトが延伸する方向をそれぞれ検出する第1検出手段と、
を有する、
操作デバイス。 - 前記第1検出手段は、前記ノード機構部に対して、当該ノード機構部に保持される前記リンクシャフトが延伸する方向に応じて変化する磁界を検出する磁気センサを含む、
請求項1に記載の操作デバイス。 - 前記2つ以上のリンクシャフトのうち第1のリンクシャフトには第1の磁石が設けられており、
前記2つ以上のリンクシャフトのうち第2のリンクシャフトには第2の磁石が設けられており、
前記ノード機構部には、前記第1の磁石から生じる磁界を検出する第1の磁気センサと、前記第2の磁石から生じる磁界を検出する第2の磁気センサとが設けられると共に、前記第1の磁石から前記第2の磁気センサへの磁気的影響を抑制する磁気抑制壁が設けられている、
請求項2に記載の操作デバイス。 - 前記ノード機構部には、その姿勢を検出する第2検出手段が設けられている、
請求項1~3のいずれか1項に記載の操作デバイス。 - 前記ノード機構部は、前記リンクシャフトの延伸方向を回転軸とする回転を許容するように前記リンクシャフトを保持している、
請求項4に記載の操作デバイス。 - 前記リンクシャフトは、互いに隣り合う前記ノード機構部間の距離を可変に伸縮可能である、
請求項1~5のいずれか1項に記載の操作デバイス。 - 前記リンクシャフトには、互いに隣り合う前記ノード機構部間の距離を検出する第3検出手段が設けられている、
請求項6に記載の操作デバイス。 - 前記複数のノード機構部は、第1の方向にn個並んで配置されており、第1の方向に直交する第2の方向にm個並んで配置されており、
n及びmは3以上の整数である、
請求項1~7のいずれか1項に記載の操作デバイス。 - 前記第1の方向に延びると共に、前記第2の方向に並ぶ複数の伝送路を含み、
前記複数のノード機構部のうち前記第1の方向に並ぶ少なくとも2つ以上の前記ノード機構部は、共通の前記伝送路を通じて前記コンピュータに前記信号を出力する、
請求項8に記載の操作デバイス。 - 前記複数のノード機構部に接続される1つの情報集約部を含み、
前記信号は前記情報集約部を介して前記コンピュータに出力される、
請求項1~9のいずれか1項に記載の操作デバイス。 - 前記複数のリンクシャフトは、一端が第1のノード機構部に保持されると共に他端が第2のノード機構部に保持されるリンクシャフトを含み、
前記第1のノード機構部及び前記第2のノード機構部の一方は、他方の自重により自身が保持する前記リンクシャフトの延伸する方向が変化するように、当該リンクシャフトを保持している、
請求項1~10のいずれか1項に記載の操作デバイス。
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/JP2021/039276 WO2023073759A1 (ja) | 2021-10-25 | 2021-10-25 | 操作デバイス |
| US18/700,280 US20250010178A1 (en) | 2021-10-25 | 2021-10-25 | Operating device |
| JP2023555889A JP7653538B2 (ja) | 2021-10-25 | 2021-10-25 | 操作デバイス |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/JP2021/039276 WO2023073759A1 (ja) | 2021-10-25 | 2021-10-25 | 操作デバイス |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023073759A1 true WO2023073759A1 (ja) | 2023-05-04 |
Family
ID=86157497
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2021/039276 Ceased WO2023073759A1 (ja) | 2021-10-25 | 2021-10-25 | 操作デバイス |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US20250010178A1 (ja) |
| JP (1) | JP7653538B2 (ja) |
| WO (1) | WO2023073759A1 (ja) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012150833A (ja) * | 2008-01-21 | 2012-08-09 | Sony Computer Entertainment America Llc | タッチスクリーンとデジタル触覚ピクセルを備えた携帯型デバイス |
| WO2014061362A1 (ja) * | 2012-10-15 | 2014-04-24 | 株式会社ソニー・コンピュータエンタテインメント | 操作デバイス |
| JP2020170311A (ja) * | 2019-04-02 | 2020-10-15 | 船井電機株式会社 | 入力装置 |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101339431B1 (ko) * | 2010-11-19 | 2013-12-09 | 도시바삼성스토리지테크놀러지코리아 주식회사 | 게임 컨트롤러, 게임기 및 게임 컨트롤러를 채용한 게임 시스템 |
| JP6027554B2 (ja) * | 2014-01-21 | 2016-11-16 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置、情報処理システム、ブロックシステム、および情報処理方法 |
| DE102017207450A1 (de) * | 2017-05-03 | 2018-11-08 | Holger Wild | Eingabegerät für Daten |
-
2021
- 2021-10-25 WO PCT/JP2021/039276 patent/WO2023073759A1/ja not_active Ceased
- 2021-10-25 US US18/700,280 patent/US20250010178A1/en active Pending
- 2021-10-25 JP JP2023555889A patent/JP7653538B2/ja active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012150833A (ja) * | 2008-01-21 | 2012-08-09 | Sony Computer Entertainment America Llc | タッチスクリーンとデジタル触覚ピクセルを備えた携帯型デバイス |
| WO2014061362A1 (ja) * | 2012-10-15 | 2014-04-24 | 株式会社ソニー・コンピュータエンタテインメント | 操作デバイス |
| JP2020170311A (ja) * | 2019-04-02 | 2020-10-15 | 船井電機株式会社 | 入力装置 |
Also Published As
| Publication number | Publication date |
|---|---|
| JP7653538B2 (ja) | 2025-03-28 |
| US20250010178A1 (en) | 2025-01-09 |
| JPWO2023073759A1 (ja) | 2023-05-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3721284B1 (en) | Selective tracking of a head-mounted display | |
| US9703102B2 (en) | Information processing device including head mounted display | |
| JP5959047B2 (ja) | 表示制御システム、表示制御方法、表示制御プログラム、および表示制御装置 | |
| US8947356B2 (en) | Suspended input system | |
| US7123214B2 (en) | Information processing method and apparatus | |
| WO2008007261A2 (en) | Orientation sensing in a multi part device | |
| KR20120007970A (ko) | 입력 장치 | |
| CN103443746A (zh) | 用户控制装置的在空间中的三维跟踪 | |
| US20120268493A1 (en) | Information processing system for augmented reality | |
| EP3156110A1 (en) | Information processing device provided with head-mounted display | |
| JP2013222399A (ja) | 操作方法、制御装置及びプログラム | |
| JP2012088764A (ja) | 入力装置、入力制御システム、情報処理方法及びプログラム | |
| EP1808210B1 (en) | Storage medium having game program stored thereon and game apparatus | |
| CN108885493A (zh) | 体感控制器控制云台的方法、云台、体感控制器和系统 | |
| US20150042563A1 (en) | Control method, control apparatus, and program | |
| JPWO2016181469A1 (ja) | シミュレーションシステム | |
| US6246391B1 (en) | Three-dimensional tactile feedback computer input device | |
| WO2023073759A1 (ja) | 操作デバイス | |
| JP5920861B2 (ja) | 制御装置、制御方法及びプログラム | |
| WO2023073760A1 (ja) | 表示制御システム、表示制御方法、及びプログラム | |
| US20020196232A1 (en) | Input device with two elastic fulcrums for six degrees of freedom data input | |
| US20070216650A1 (en) | Data Recording Device for Data Processing Units | |
| JP5870818B2 (ja) | 入力装置、制御システム、校正方法及びプログラム | |
| JP2000207114A (ja) | 力覚提示方法及び力覚ペンタブレット | |
| US20240112421A1 (en) | System and method of object tracking for extended reality environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21962310 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2023555889 Country of ref document: JP Kind code of ref document: A |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 18700280 Country of ref document: US |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 21962310 Country of ref document: EP Kind code of ref document: A1 |