WO2015033967A1 - Emulation device, emulation method, program, and information storage medium - Google Patents

Abstract

Provided are an emulation device, an emulation method, a program, and an information storage medium, with which operations with respect to a detection surface can be emulated with a good operational feel. An input data acquisition unit (66) acquires input data correlated with the direction in which an operation stick has been operated. A determination unit (70) determines the relationship between multiple positions in a detection surface and arranged along a direction in accordance with the input data. An emulation process execution unit (74) executes a process to be executed when the multiple determined positions are detected in order on the detection surface.

Description

Emulation apparatus, emulation method, program, and information storage medium

The present invention relates to an emulation apparatus, an emulation method, a program, and an information storage medium.

Game devices are roughly classified into portable devices and stationary devices. Many portable game devices include a touch sensor having a detection surface that sequentially detects the position of an object. In such a game device, operation input by a touch sensor is possible. On the other hand, the operation input to the stationary game device is often performed by the controller. Some such controllers have an operating stick. Among such operation sticks, there are those that can be rotated in an inclined or inclined state, and those that can perform slide operations in the vertical and horizontal directions. The controller provided with the operation stick transmits a signal according to the direction and size in which the operation stick is operated to the game device.

The inventors have developed an emulation device that emulates a game device provided with a touch sensor. Hereinafter, the game device to be emulated is referred to as a target device. Programs executable on the target device can also be executed on the emulation device.

Among the programs that can be executed by the target device, there are some programs that require an operation on the detection surface of the touch sensor. In order to make such a program usable by the emulation device, it is necessary to emulate the operation on the detection surface in some way.

Here, the inventors have made it possible to execute the processing executed when the position of the object is detected on the detection surface by the operation on the operation stick. Then, by associating the direction in which the operation stick is operated with the direction in which the detection surface is traced by the finger or the stylus, the operation feeling of the operation on the operation stick becomes close to the operation feeling of the operation following the detection surface, and a good operation feeling is obtained. Was found to be

By doing as described above, even if the controller does not have a touch sensor, the operation on the detection surface can be emulated with a good sense of operation. Further, even in the case where the controller includes the touch sensor, the operation on the detection surface can be emulated with good feeling of operation by the operation on the operation stick, and the width of the operation is expanded.

This is not only true for the emulation device that emulates the target device. For example, even in the case where the target device includes the operation stick, by performing as described above, the operation on the detection surface of the touch sensor included in the target device can be emulated with good feeling of operation by the operation on the operation stick.

The present invention has been made in view of the above problems, and one of the objects thereof is to provide an emulation apparatus, an emulation method, a program, and an information storage medium capable of emulating an operation on a detection surface with good feeling of operation. .

In order to solve the above problems, an emulation apparatus according to the present invention is an emulation apparatus that emulates an operation on a detection surface that sequentially detects the position of an object, and input data associated with the direction in which the operation stick is operated. A plurality of input data acquisition units for acquiring a plurality of input data acquisition units, a determination unit for determining a relationship between a plurality of positions in the detection plane that are arranged along the direction according to the input data, And a process execution unit that executes a process to be performed when the position is sequentially detected on the detection surface.

The emulation method according to the present invention is an emulation method that emulates an operation on a detection surface that sequentially detects the position of an object, and acquires input data that acquires input data associated with the direction in which the operation stick is operated. A step of determining a relation between a plurality of positions in the detection plane which is arranged along a direction according to the input data, and a plurality of positions arranged according to the relation determined are on the detection plane And a process execution step of executing a process to be executed when sequentially detected.

The program according to the present invention is a program that causes a computer to emulate an operation on a detection surface that sequentially detects the position of an object, and acquires input data associated with the direction in which the operation stick is operated. A procedure of determining a relationship between a plurality of positions in the detection surface that is disposed along a direction according to the input data; a plurality of positions disposed according to the determined relationship are sequentially detected on the detection surface And a step of executing a process to be executed at the same time.

Further, an information storage medium according to the present invention is a computer readable information storage medium storing a program to be executed by a computer emulating an operation on a detection surface which sequentially detects the position of an object, and an operation stick is operated. A procedure for acquiring input data associated with the direction, a procedure for determining a relationship between a plurality of positions in the detection plane that is an arrangement along the direction according to the input data, and A computer-readable information storage medium storing a program that causes the computer to execute a process that is executed when a plurality of positions are sequentially detected on the detection surface.

In the present invention, the relationship between a plurality of positions in the detection plane, which is an arrangement according to the input data, is determined, and the plurality of positions arranged according to the determined relationship are sequentially detected on the detection plane The process to be executed is executed. Thus, according to the present invention, the operation on the detection surface can be emulated with a good sense of operation.

In one aspect of the present invention, the input data acquisition unit acquires input data associated with the direction and size in which the operation stick is operated, and the determination unit determines the size associated with the input data. The relationship between the plurality of positions is determined such that the larger the distance, the longer the interval.

In one aspect of the present invention, the determination unit determines the position in the detection plane, the input data acquisition unit sequentially acquires the input data, and the determination unit acquires the input data. Every time, a position separated along the direction determined based on the input data from the previously determined position is determined, and the processing execution unit corresponds to the position determined multiple times by the determination unit The processing to be executed when sequentially detected according to the acquisition order of the input data to be attached is executed.

In this aspect, the display control unit may further include a display control unit that causes an image to be displayed at a position in the display unit that substantially matches the position in the detection plane of the position determined by the determination unit.

Further, in this aspect, the emulation device emulates an operation on the detection surface capable of multipoint detection, and the input data acquisition unit associates the input data associated with the direction in which each of the plurality of operation sticks is operated. Is sequentially acquired, and the determination unit determines a plurality of positions in the detection plane associated with any of the plurality of operation sticks each time the input data is acquired, and the process execution unit A process may be performed which is performed when a plurality of positions determined a plurality of times by the determination unit are sequentially detected according to the acquisition order of the input data associated with the plurality of positions.

Another emulation apparatus according to the present invention is an emulation apparatus that emulates an input operation to a touch sensor, and includes an execution unit that executes a program, a controller that receives an operation input from an operator, and an operation input that is received. The conversion unit may convert the operation input to the touch sensor, and the execution unit executes the program based on the operation input after conversion by the conversion unit.

Another emulation method according to the present invention is an emulation method for emulating an input operation to a touch sensor, the execution step of executing a program, and an operation input received by a controller that receives an operation input from an operator. And a conversion step of converting into an operation input to a touch sensor, wherein the execution step executes the program based on the operation input after conversion by the conversion unit.

Further, another program according to the present invention is a program to be executed by a computer emulating an input operation to a touch sensor, and a procedure for executing a program to be executed and an operation received by a controller that receives an operation input from an operation element Causing the computer to execute a procedure for converting an input into an operation input to the touch sensor, and executing the program to be executed based on the operation input after conversion by the converter. It features.

Another information storage medium according to the present invention is a computer-readable information storage medium storing a program to be executed by a computer emulating an input operation to a touch sensor, and the procedure for executing the program to be executed. A procedure for converting an operation input received by a controller that receives an operation input from an operator into an operation input for the touch sensor is executed by the computer, and in the procedure for executing, based on the operation input after conversion by the conversion unit A computer readable information storage medium storing a program characterized by executing the program to be executed.

In one aspect of the present invention, the program is a program created on the assumption of an input operation on a touch sensor.

Further, in one aspect of the present invention, the received operation input is associated with at least one of the direction or the size in which the operator is tilted.

Further, according to an aspect of the present invention, in response to the reception of an emulation start instruction for an input operation on a touch sensor, a display unit displays an image indicating a position emulating a position at which the input operation on the touch sensor is performed. And a control unit.

It is a figure showing an example of the whole composition of the information processing system concerning one embodiment of the present invention. It is a figure showing an example of the hardware constitutions of the information processor concerning one embodiment of the present invention. It is a perspective view of an example of a controller concerning one embodiment of the present invention. It is a top view of an example of the controller concerning one embodiment of the present invention. It is a rear view of an example of the controller concerning one embodiment of the present invention. It is a front view of an example of a target device. It is a rear view of an example of a target device. It is a figure showing an example of the hardware constitutions of a target device. It is a figure which shows an example of the relationship between an emulated position and a detection position. It is a figure which shows an example of the relationship between an emulated position and a detection position. It is a figure which shows an example of the relationship between an emulated position and a detection position. It is a figure which shows an example of the relationship between the value of attitude | position data, and the value of an acceleration parameter. It is a figure which shows an example of the rule which determines the value of a velocity parameter, and the coordinate value of an emulate position. It is a figure which shows an example of the screen in which the pointer image was arrange | positioned. It is a figure which shows an example of the screen in which the pointer image was arrange | positioned. It is a figure which shows an example of the screen in which the pointer image was arrange | positioned. It is a figure which shows an example of the screen in which the pointer image was arrange | positioned. It is a figure which shows an example of the screen in which the pointer image was arrange | positioned. It is a figure which shows an example of the screen in which the pointer image was arrange | positioned. It is a figure which shows an example of the transition rule of an operation mode. It is a functional block diagram showing an example of a function realized by an emulation device concerning one embodiment of the present invention. It is a flow figure showing an example of a flow of processing performed with an emulation device concerning one embodiment of the present invention.

Hereinafter, an embodiment of the present invention will be described in detail based on the drawings.

FIG. 1 is a diagram showing an example of the entire configuration of an information processing system 10 according to an embodiment of the present invention. As shown in FIG. 1, an information processing system 10 according to the present embodiment includes an emulation device 12, a controller 14, and a display 16.

The emulation apparatus 12 according to the present embodiment is an information processing apparatus that emulates a portable information processing apparatus (see FIGS. 4A and 4B) described later. For example, as shown in FIG. A communication unit 24, an input / output unit 26, and a card slot 28 are included. The control unit 20 is, for example, a program control device such as a CPU that operates according to a program installed in the emulation apparatus 12. The storage unit 22 is, for example, a storage element such as a ROM or a RAM, a hard disk drive, or the like. The storage unit 22 stores programs executed by the control unit 20 and the like. The communication unit 24 is, for example, a communication interface such as a network board or a wireless LAN module. The input / output unit 26 is an input / output port such as a high-definition multimedia interface (HDMI (registered trademark)) port or a USB port. The card slot 28 is a slot capable of inserting and removing information storage media such as various memory cards. The card slot 28 reads programs and data recorded in an information storage medium such as a memory card inserted into the card slot 28 according to an instruction from the control unit 20, and inserts an information storage medium such as a memory card inserted therein. Write data. Emulation device 12 may have a plurality of card slots 28, and the plurality of card slots 28 may be capable of inserting and removing information storage media conforming to different standards.

The controller 14 according to the present embodiment is an operation input device for performing an operation input to the emulation device 12. FIG. 3A is a perspective view of an example of the controller 14 according to the present embodiment. FIG. 3B is a plan view of the controller 14. FIG. 3C is a rear view of the controller 14.

As shown in these drawings, the controller 14 has grip portions GL and GR which project to the near side (the lower side in the drawing of FIG. 3B) from the left and right of the horizontally long main body portion. The user holds the grips GL and GR with the left and right hands and uses the controller 14.

Four directional keys DK1 to DK4, an operation stick SL, and the like are disposed at positions on the upper left side of the controller 14 where the user can operate the grip GL with his left hand while gripping the grip GL. Four buttons B1 to B4 and an operation stick SR are provided at positions on the upper right side of the controller 14 where the user can operate the grip GR with the right hand while holding the grip GR. Buttons BL1 and BL2 are provided on the left side of the back of the controller 14 at positions where the user can operate the forefinger or middle finger in a state where the user grips the grip portion GL with the left hand. Back buttons BR1 and BR2 are provided at positions on the back right side of the controller 14 where the user grips the grip GR with the right hand and can be operated by the index finger or the middle finger. Further, the controller 14 according to the present embodiment is also provided with operators such as other buttons. The user performs various operation inputs using the controller 14 by pressing the direction keys DK1 to DK4, the buttons B1 to B4, the buttons BL1, BL2, BR1 and BR2 or tilting the operation sticks SL and SR. Can. Then, in the present embodiment, the controller 14 outputs input data associated with the operation input to the emulation device 12.

The operation sticks SL and SR are stick-like operation members erected on the surface of the housing of the controller 14. The operation sticks SL and SR are inclinable from the upright state in all directions by a predetermined angle. As shown in FIG. 3B, the housing longitudinal direction of the controller 14 is the X1 axis direction (the right direction in FIG. 3B is the positive direction), and the housing depth direction orthogonal to the X axis direction is the Y1 axis direction (FIG. 3B) Assuming that the upward direction is the positive direction in 3B), the attitudes (operation states) of the operation sticks SL and SR are 0 to 0 as inclinations of the X1 axis direction and the Y1 axis direction (attitude data (X1, Y1)). A digital value of 255 is input to the emulation device 12. Specifically, the vicinity of X1 = 127 or X1 = 128 indicates that the operation sticks SL and SR are not inclined in the X1 axis direction. Further, X1 = 255 indicates that the operation sticks SL and SR have fallen to the limit in the positive direction of the X1 axis (the right direction in FIG. 3B). Furthermore, X1 = 0 indicates that the operation sticks SL and SR have reached the limit in the negative direction of the X1 axis (left direction in FIG. 3B). The same applies to the Y1 axis direction. Posture data according to the present embodiment is data included as a part of the above-described input data.

Thus, the emulation device 12 can grasp the current tilt state (posture) of the operation sticks SL and SR. The operation sticks SL and SR are also configured as pressure-sensitive buttons, and can be pressed in the axial direction of the sticks.

Further, the controller 14 according to the present embodiment includes sensors such as a gyro sensor that detects an angular velocity and an acceleration sensor that detects an acceleration.

Further, the controller 14 according to the present embodiment is provided with a USB port. The controller 14 can output input data to the emulation device 12 by wire connection via the input / output unit 26 by connecting the emulation device 12 with the USB cable. In addition, the controller 14 according to the present embodiment includes a wireless communication module or the like, and can output input data to the emulation device 12 wirelessly through the communication unit 24. Further, the controller 14 according to the present embodiment can receive power from the emulation device 12 connected by the USB cable.

The display 16 according to the present embodiment is a liquid crystal display, an organic EL display, or the like. In the present embodiment, the emulation device 12 and the display 16 are connected via the input / output unit 26 by a cable such as a high-definition multimedia interface (HDMI (registered trademark)) cable.

4A and 4B show an example of a portable information processing apparatus to be emulated by the emulation apparatus 12 according to the present embodiment. The information processing apparatus shown in FIGS. 4A and 4B is referred to as a target apparatus 30. FIG. 4A is a front view of an example of the target device 30. FIG. FIG. 4B is a rear view of the target device 30. FIG. 5 is a diagram showing an example of the hardware configuration of the target device 30. As shown in FIG. As described above, the emulation device 12 according to the present embodiment emulates the target device 30.

The target device 30 according to the present embodiment has a substantially rectangular flat plate shape as a whole. In the following, the lateral direction (width direction) of the housing is taken as the X2 axis direction, and the longitudinal direction (height direction) as the Y2 axis direction. Further, in the present embodiment, the direction from left to right when viewed from the front of the housing is the X2 axis positive direction, and the direction from bottom to top when viewed from the front of the housing is the Y2 axis positive direction.

In the present embodiment, as shown in FIGS. 4A, 4B, and 5, the target device 30 includes the control unit 40, the storage unit 42, the communication unit 44, the input / output unit 46, the card slot 48, the display unit 50, The touch sensor 52, the operation key 54, and the sensor unit 56 are provided.

The roles of the control unit 40, the storage unit 42, the communication unit 44, the input / output unit 46, and the card slot 48 are the same as those of the control unit 20, the storage unit 22, the communication unit 24, the input / output unit 26, and the card slot 28 in the emulation device 12, respectively. Similar to the role of

The display unit 50 is a liquid crystal display, an organic EL display, or the like.

The touch sensor 52 is a sensor that sequentially detects the contact of an object (for example, a finger or the like) on the detection surface at predetermined time intervals. The target device 30 according to the present embodiment includes two touch sensors 52 (a front surface touch sensor 52a and a rear surface touch sensor 52b). A touch panel 58 in which the display unit 50 and the surface touch sensor 52a are integrated is provided on the front of the housing of the target device 30 according to the present embodiment. The touch sensor 52 according to the present embodiment may be any type of device capable of detecting the position of an object on the detection surface, such as a capacitive type, a pressure-sensitive type, or an optical type. . In the present embodiment, it is assumed that both the front surface touch sensor 52a and the back surface touch sensor 52b are multipoint detection type touch sensors capable of detecting the contact of an object at a plurality of positions (for example, up to eight positions).

In the present embodiment, the length in the vertical direction of the back surface touch sensor 52b is shorter than the length in the vertical direction of the front surface touch sensor 52a. The back surface touch sensor 52b is offset upward with respect to the front surface touch sensor 52a. Further, the position of the upper edge of the front surface touch sensor 52a and the position of the upper edge of the back surface touch sensor 52b are substantially coincident in the vertical direction. Further, the length in the left-right direction is substantially the same between the front surface touch sensor 52a and the rear surface touch sensor 52b. The front surface touch sensor 52 a and the rear surface touch sensor 52 b are located at the center of the target device 30 in the left-right direction.

The operation key 54 is a type of operation unit used for an operation input performed by the user on the target device 30. For example, direction keys DK1 (T) to DK4 (T), buttons B1 (T) to B4 (T), BL1 (T), BR1 (T), and operation stick SL T), SR (T), etc. Direction keys DK1 (T) to DK4 (T) are disposed on the front left side of the housing. The buttons B1 (T) to B4 (T) are disposed on the front right side of the housing. Two operation sticks SL (T) and SR (T) are disposed on the left and right sides of the front of the housing. The button BL1 (T) is disposed on the upper side left side of the housing as viewed from the front of the housing. The button BR1 (T) is disposed on the upper right side of the housing as viewed from the front of the housing. The operation sticks SL (T) and SR (T) are slidable vertically and horizontally.

The sensor unit 56 is a device that detects the attitude of the target device 30. The sensor unit 56 according to the present embodiment includes, for example, a three-axis gyro sensor, a three-axis motion sensor (three-axis acceleration sensor), and an electronic compass.

In this embodiment, for example, a program that can be executed by the target device 30 can be executed by the emulation device 12. The program is hereinafter referred to as a target program. The target program is supplied to the target device 30 via a memory card that can be inserted into the card slot 48 of the target device 30. The target program is also supplied to the emulation device 12 via a memory card that can be inserted into the card slot 28 of the emulation device 12.

The emulation apparatus 12 according to the present embodiment acquires input data indicating an operation input to the controller 14 at a predetermined frame rate (for example, every 1/60 seconds). Then, the emulation apparatus 12 according to the present embodiment executes a target program to execute processing according to the input data or the like at a predetermined frame rate according to acquisition of the input data. For example, generation of data representing a screen corresponding to the input data and output of the data to the display 16 are performed at a predetermined frame rate. In the present embodiment, the display 16 displays a screen representing the data at a resolution of 960 pixels horizontally and 544 pixels vertically.

Further, in the present embodiment, the target program includes a process of determining whether the device being executed is the target device 30 or the emulation device 12. Then, according to the result of the determination, the target program performs an operation input to the controller 14 or an operation input to the touch sensor 52 or the operation key 54 of the target device 30 as a basis of the process to be executed. Decide whether to handle as input.

Further, in the emulation device 12 according to the present embodiment, whether or not the operation on the detection surface of the touch sensor 52 in the target device 30 can be emulated by the emulation device 12 can be set by performing a predetermined operation. It has become. The target program being executed by the emulation device 12 may be based on an operation on the detection surface of the target device 30. That is, the target program may be a program created on the assumption of an input operation on the touch sensor. In such a case, if the operation on the detection surface of the target device 30 can not be emulated in some way, the process can not proceed. In the present embodiment, even if the situation where the processing can not be advanced as described above occurs, the processing can be advanced by setting so that the operation on the detection surface can be emulated by performing the predetermined operation described above. It is possible to

In the following description, it is assumed that the emulation device 12 is set so that the operation on the detection surface of the touch sensor 52 in the target device 30 can be performed by the emulation device 12. When the setting is performed, the emulation device 12 can freely switch between two operation modes, the normal mode in which the operation on the detection surface of the touch sensor 52 can not be emulated and the touch pointer mode in which the operation can be emulated. Hereinafter, the normal mode is referred to as N mode, and the touch pointer mode is referred to as TP mode.

When the operation mode is N mode, the operation on the detection surface of the touch sensor 52 can not be emulated, but the operation on the operation sticks SL (T) and SR (T) can be emulated. On the other hand, when the operation mode is the TP mode, although the operation on the detection surface of the touch sensor 52 can be emulated, the operation on the operation sticks SL (T) and SR (T) can not be emulated.

In the present embodiment, the operation mode at the start of execution of the target program is N mode. When the operation mode is N mode, pressing direction key DK1 to DK4 of controller 14 causes processing to be executed when direction key DK1 (T) to DK4 (T) is pressed on target device 30. Is executed. Further, by pressing buttons B1 to B4, BL1 or BL2 of the controller 14, the buttons B1 (T) to B4 (T), BL1 (T) or BL2 (T) are pressed on the target device 30. The process to be performed when the event occurs is executed. Further, by tilting the operation sticks SL and SR, the process executed when the operation sticks SL (T) and SR (T) are slid in the target device 30 in the direction corresponding to the tilted direction is executed. .

In the present embodiment, when the operation mode is the TP mode, processing executed by the target device 30 when the position of the object on the detection surface of the touch sensor 52 of the target device 30 is detected by the touch sensor 52 is executed. Be done. Hereinafter, the position of the object on the detection surface of the touch sensor 52 of the target device 30 will be referred to as a detection position. In the present embodiment, an operation of setting the position at which the detection position of the detection surface is emulated in the emulation device 12 can be performed. Hereinafter, the position at which the detected position is emulated in the emulation device 12 will be referred to as an emulated position. In the present embodiment, the emulated position is a position that emulates the position where the input operation on the touch sensor 52 is performed.

In the present embodiment, the emulated position and the detected position are associated on a one-to-one basis. Also, the emulated position is associated with the position in the display 16. For example, in the present embodiment, as shown in FIG. 6, the emulated position associated with the detection position of the detection surface of the front surface touch sensor 52a takes the lower left position of the display 16 as the origin and the right direction is the X3 axis positive direction. It is expressed by coordinate values in which the upper direction is the Y3 axis positive direction. Here, the X3 coordinate value of the emulated position takes any integer value from 0 to 959, and the Y3 coordinate value takes any integer value from 0 to 543. These values correspond to the resolution of the display 16 according to the present embodiment.

Then, in the present embodiment, the detection position of the detection surface of the front surface touch sensor 52a is managed by the X2-Y2 coordinate value whose origin is the lower left coordinate value of the front surface touch sensor 52a when viewed from the front of the housing. . The touch sensor 52 according to the present embodiment can specify the detection position in units of 0.5 pixels. Therefore, in the present embodiment, the X2 coordinate value of the detection position takes an integer value of 0 or more and 1918 or less, and the Y2 coordinate value of the detection position takes any integer value of 0 or more and 1086 or less.

In the present embodiment, the relative position of the emulated position in the display 16 and the relative position of the detected position in the surface touch sensor 52a substantially coincide with each other. Specifically, for example, the relationship between the coordinate value (x, y) of the emulated position and the coordinate value (x ', y') of the detected position is x '= 2x and y' = 2y.

Also, when the operation mode is the TP mode, it is possible to switch between a state where the situation where the detection position is detected by the touch sensor 52 is emulated and a state where the situation where the detection position is not detected is emulated. . Hereinafter, a state where the situation where the detection position is detected by the touch sensor 52 is emulated is referred to as a touch state, and a state where the situation where the position of the object is not detected by the touch sensor 52 is emulated is the untouched state I will call it. And in this embodiment, by performing operation which presses down a predetermined | prescribed button, an emulated position will be in a touch state, and by performing release operation, an emulated position will be in an untouched state.

Here, in the present embodiment, it is assumed that the X3-Y3 coordinate value of the emulated position is (x, y) and the emulated position is in the touch state. In this case, the process executed by the target device 30 is executed when the coordinate value (x ', y') of the detection position at which the coordinate value is associated with (x, y) is detected by the surface touch sensor 52a. It becomes. Therefore, for example, when the operation of pressing and releasing the predetermined button described above is performed once with the coordinate value of the emulated position being (x, y), the detection that the coordinate value is (x ', y') When the tap operation is performed on the position, the process performed by the target device 30 is performed. Also, with the coordinate value of the emulated position being (x, y), the coordinate value is (x ', y') when the above-mentioned predetermined button is pressed and released twice in succession. When the double tap operation is performed at a certain detection position, the processing performed by the target device 30 is performed.

Further, in the present embodiment, the emulated position changes based on the acquired posture data (X1, Y1) for each frame. That is, the emulated position can be changed by tilting the operation stick. In the present embodiment, the direction in which the operation stick is inclined is associated with the direction in which the emulated position changes. For example, when the operation stick is tilted in the X1 axis direction, the emulated position changes in the X3 axis direction. When the operation stick is inclined in the Y1 axis direction, the emulated position changes in the Y3 axis direction.

Here, as shown in FIG. 7, it is assumed that the coordinate value of the emulated position in a certain frame is (x1, y1). The coordinate value of the emulated position in the next frame is assumed to be (x2, y2). Further, it is assumed that the coordinate value of the emulated position in the next frame is (x3, y3). Then, during the three frames, the emulated position is assumed to be that the touch state is maintained. Here, the coordinate values of the detection position of the detection surface of the surface touch sensor 52a corresponding to the coordinate values (x1, y1), (x2, y2), (x3, y3) are (x1 ′, y1 ′), ( It is assumed that x2 ', y2') and (x3 ', y3'). In this case, a drag operation or flick operation in which the detection position is detected over three frames in the order of (x1 ', y1'), (x2 ', y2'), and (x3 ', y3') is emulated. In this case, processing performed by the target device 30 is performed when the drag operation or the flick operation is performed.

Further, in the present embodiment, it is assumed that a predetermined button is pressed, the emulation position is changed while the button is pressed, and the button is released. In this case, a drag operation with an emulation position when a predetermined button is pressed as a start point and an emulation position when the button is released as an end point is emulated. As described above, in the present embodiment, the drag operation can be emulated by performing the pressing operation of the predetermined button, the operation of changing the emulation position while the button is held down, and the operation of releasing the predetermined button. Become.

Further, in the present embodiment, two emulated positions can be set. In this case, one emulated position is changed based on the attitude data (X1, Y1) of the operation stick SL input, and the other emulated position is changed based on the attitude data (X1, Y1) of the operation stick SR. Do. Hereinafter, the emulated position changing based on the posture data (X1, Y1) of the operation stick SL is referred to as a first emulation position, and the emulated position changing based on the posture data (X1, Y1) of the operation stick SR is referred to as a second It is called an emulated position.

Further, in the present embodiment, by performing the operation of pressing the button B1 or the button BL2, the first emulated position is in the touch state, and by performing the releasing operation, the first emulated position is in the untouched state. Then, by performing an operation of pressing the button BR2, the second emulated position is in a touch state, and by performing an operation of releasing the button BR2, the second emulated position is in an untouched state. As described above, in the present embodiment, the touch state and the untouch state can be switched independently for each of the first emulated position and the second emulated position.

Here, as shown in FIG. 8, it is assumed that the coordinate value of the first emulated position in a certain frame is (x11, y11) and the coordinate value of the second emulated position is (x12, y12). The coordinate value of the first emulated position in the next frame is (x21, y21), and the coordinate value of the second emulated position is (x22, y22). The coordinate value of the first emulated position in the next frame is (x31, y31), and the coordinate value of the second emulated position is (x32, y32). Then, it is assumed that the touch state is maintained for the first emulated position and the second emulated position during the three frames. Here, the coordinate values of the detection position of the detection surface of the surface touch sensor 52a corresponding to the coordinate values (x11, y11), (x12, y12), (x13, y13) are (x11 ', y11'), ((11) It is assumed that x12 ', y12') and (x13 ', y13'). In addition, the coordinate values of the detection position of the detection surface of the front surface touch sensor 52a corresponding to the coordinate values (x21, y21), (x22, y22), (x23, y23) are (x21 ', y21'), (x22 It is assumed that ', y22') and (x23 ', y23'). In this case, (x11 ', y11') and (x12 ', y12'), (x21 ', y21') and (x22 ', y22'), (x31 ', y31') and (x32 ', y32') The operation in which the detection position is detected in the order of is emulated. That is, an operation in which two detection positions are detected in one frame over three frames is emulated. In this case, when the operation is performed, the process performed by the target device 30 is performed.

If the distance between the two emulated positions gradually approaches, for example, a pinch-in operation or an operation for reducing the displayed image is emulated. FIG. 8 shows, for example, a situation where a pinch-in operation or an operation for reducing the size of a displayed image is emulated. In addition, when the distance between the two emulated positions gradually increases, for example, a pinch out operation or an operation for enlarging and displaying the displayed image is emulated. As described above, for example, an operation of pressing predetermined two buttons, an operation of shortening the length between two emulated positions while the two buttons are pressed, and an operation of releasing the two buttons. By doing this, it is possible to emulate pinch-in operation and the like. Similarly, in the present embodiment, an operation of pressing predetermined two buttons, an operation of increasing the length between two emulated positions while the two buttons are pressed, and the two buttons By performing the release operation, it is possible to emulate a pinch out operation and the like.

As described above, according to this embodiment, various operations on the detection surface can be emulated by the operations on the operation sticks SL and SR. The inventors found that the operation feeling of the operation with respect to the operation sticks SL and SR is similar to the operation feeling of the operation of tracing the detection surface, and a good operation feeling can be obtained. Therefore, according to this embodiment, the operation on the detection surface can be emulated with a good feeling of operation.

Here, the relationship between posture data and the amount of change in emulated position will be further described. The following description applies to both the first emulated position and the second emulated position.

In this embodiment, for the coordinate value (x, y) of the emulated position, a combination (vx, vy) of the value vx associated with the change amount of the value x and the value vy associated with the change amount of the value y The amount of change in the emulated position is managed by the speed parameter to be represented. In the present embodiment, each of the value vx and the value vy is expressed by a value of −1 or more and 1 or less. Further, in the present embodiment, the acceleration parameter represents the combination (ax, ay) of the value ax associated with the change amount of the value vx, and the value ay associated with the change amount of the value vy. Managed In the present embodiment, each of the value ax and the value ay is represented by a value of −1 or more and 1 or less.

And in this embodiment, the following processing is performed about each frame.

First, based on the posture data (X1, Y1) acquired in the frame, the values (ax, ay) of the acceleration parameter are determined according to the relationship shown in FIG. FIG. 9 is a view showing an example of the correspondence between the value of posture data and the value of the acceleration parameter. The acceleration parameter values (ax, ay) are values associated with the acceleration at which the emulated position moves. In the present embodiment, the relationship between the value X1 and the value ax is the same as the relationship between the value Y1 and the value ay. As shown in FIG. 9, when the value of the posture data X1 is any one of 0 and 15 or less, 96 or more and 160 or less, and 241 or more and 255 or less, the value ax is 0. Further, when the value of the posture data Y1 is any one of 0 to 15, 96 to 160, and 241 to 255, the value ay is 0. Hereinafter, the numerical range of 0 to 15 and 96 to 160, and 241 to 255 will be referred to as a dead zone. Further, a numerical range of 16 or more and 95 or less and 161 or more and 240 or less will be referred to as a sensitive zone.

Then, based on the values (ax, ay) of the identified acceleration parameters, the values (vx, vy) representing the velocity parameters are updated in accordance with the rules shown in FIG. Also, based on the values (vx, vy) representing the updated velocity parameter, the coordinate value (x, y) of the emulated position is updated according to the rule shown in FIG.

As shown in FIG. 10, when the sign of the value vx and the sign of the value ax are the same, the value vx is updated to the current value of the value vx plus a value obtained by multiplying the value ax by 1/45. (Vx = vx + 1 / 45ax) ((A1) in FIG. 10). On the other hand, when the sign of the value vx and the sign of the value ax are different, the value vx is updated to a value obtained by multiplying the value ax by 1/45 (vx = 1 / 45ax) ((B1) in FIG. 10). Further, in the present embodiment, when the value ax is 0, the value vx is updated to 0 (vx = 0) ((C1) in FIG. 10).

Then, when the updated value vx is larger than 1, the value vx is set to 1 (vx = 1) ((D1) in FIG. 10), and when the updated value vx is smaller than -1. The value vx is set to −1 (vx = −1) ((E1) in FIG. 10).

Then, the value x is updated to a value obtained by adding the value obtained by multiplying the value vx by 100 times the current value of the value x (x = x + 100 vx) ((F1) in FIG. 10). Here, the value x is set to 0 when it is smaller than 0 (x = 0) ((G1) in FIG. 10), and is set to 959 when it is larger than 959. (X = 959) ((H1) in FIG. 10). In these cases, the value vx is updated to 0 (vx = 0).

The same applies to the case of calculating the value vy and the value y based on the value ay ((A2) to (H2) in FIG. 10). However, the value y is not set to 959 when it is larger than 959, but is set to 543 when it is larger than 543 (y = 543) ((H2 in FIG. 10) )).

As described above, in the present embodiment, the updated emulated position in the frame is determined based on the posture data (X1, Y1).

In the present embodiment, when the direction in which the emulated position is changing corresponds to the direction in which the operation sticks SL and SR are operated, the amount of change in the emulated position per frame is increased (see FIG. 10 (see (A1) and (A2)). Further, in the present embodiment, when the value X1 and the value Y1 of the posture data are within the numerical range of the dead zone, the emulated position does not change (see (C1) and (C2) in FIG. 10).

Further, in the present embodiment, in the sensing zone, the absolute value of the value ax or the value ay of the acceleration parameter becomes larger as the size (for example, the inclination) at which the operation stick is operated is larger (see FIG. 9). Therefore, in any of these cases, the larger the size at which the operation stick is operated, the larger the absolute value of the value vx (see (A1) (A2) (B1) (B2) in FIG. 10). As a result, the larger the size at which the operation stick is operated, the longer the distance between the emulated position in the immediately preceding frame and the emulated position in the frame (see (F1) and (F2) in FIG. 10). .

Further, in the present embodiment, the values vx and vy are adjusted so as not to exceed the range of −1 or more and 1 or less (see (D1), (D2), (E1), and (E2) in FIG. 10).

Further, in the present embodiment, the value x is adjusted so as not to exceed the range of 0 or more and 959 or less, and in this case, the value vx is 0 and the change of the emulated position in the X3 axis direction is suppressed. (See (G1) in FIG. 10). In addition, the value y is adjusted so as not to exceed the range of 0 or more and 543 or less, and in this case, the value vy is 0, and the change of the emulated position in the Y3 axis direction is suppressed (FIG. 10). In (G2)).

The setting of the emulated position of the front surface touch sensor 52a has been described above. However, in the present embodiment, the emulated position of the back surface touch sensor 52b can be set instead of the front surface touch sensor 52a. The detection position of the back surface touch sensor 52b is also managed by the above-mentioned X2-Y2 coordinate value. However, since the back surface touch sensor 52b is offset upward with respect to the front surface touch sensor 52a, the X2 coordinate value of the detection position takes an integer value of 0 or more and 1918 or less, and the Y2 coordinate value is , And any integer between 306 and 1086 inclusive. In this case, as shown in FIG. 6, the relationship between the coordinate value (x, y) of the emulated position and the coordinate value (x ', y') of the detection position of the back surface touch sensor 52b is x '= 2x , Y ′ = 780/543 y + 306.

Further, in the present embodiment, setting of emulated positions on both sides of the front surface touch sensor 52a and the rear surface touch sensor 52b can also be performed. In this case, the position associated with the same detection position when viewed along the direction perpendicular to the X2-Y2 plane is set as the emulated position for the detection surfaces of both the front surface touch sensor 52a and the rear surface touch sensor 52b. Be done. This is suitable, for example, in the case of emulating an operation of pinching and moving the front surface touch sensor 52a and the rear surface touch sensor 52b with a finger. It is assumed that the operation is adopted, for example, in a program that simulates opening an envelope or picking up a character.

In the present embodiment, the back surface touch sensor 52b is offset upward with respect to the front surface touch sensor 52a. Therefore, when the Y3 coordinate value of the emulated position is small (here, for example, smaller than 153), the detection position of the detection surface of the back surface touch sensor 52b when viewed along the direction perpendicular to the X2-Y2 plane. Does not exist. Therefore, in this embodiment, when the Y3 coordinate value of the emulated position determined as described above is smaller than 153, it is corrected to 153 (see (G2) in FIG. 10).

Hereinafter, the TP mode capable of setting the emulated position of the front surface touch sensor 52a will be referred to as a front surface TP mode. Then, a TP mode capable of setting an emulated position of the back surface touch sensor 52b is referred to as a back surface TP mode. The TP mode capable of setting the emulated position for both sides is referred to as a two-sided TP mode.

In the present embodiment, in order to enable visual recognition of the emulating position and the setting situation of the emulating position, when the operation mode is the TP mode, the screen on which the pointer image I is arranged is It is displayed on the display 16 (see FIGS. 11 to 16). In the present embodiment, the pointer image I indicates the emulated position. In the present embodiment, the pointer image I is arranged such that the position of the center of gravity of the circular image included in the pointer image I is the emulated position.

In the present embodiment, the relative position of the emulated position in the display 16 substantially matches the relative position of the detected position in the detection plane. In the present embodiment, the surface touch sensor 52a of the target device 30 and the display unit 50 have substantially the same size and the same shape. Therefore, when the operation mode is the front surface TP mode or the both surface TP mode, when the pointer image I is displayed on the display unit 50, the position of the pointer image I substantially overlaps the detection position.

Further, in the present embodiment, the design of the displayed pointer image I differs depending on which of the front side TP mode, the back side TP mode, and the both side TP mode. Further, in the present embodiment, the design of the displayed pointer image I also differs depending on whether it is in the touch state or the untouched state.

In FIG. 11, when the operation mode is the surface TP mode, the pointer image Ia1 (nt) is disposed at the first emulated position in the untouched state, and the pointer image Ia2 (nt) is disposed at the second emulated position in the untouched state. The placed screen is shown. In FIG. 12, when the operation mode is the surface TP mode, the pointer image Ia1 (t) is disposed at the first emulated position in the touch state, and the pointer image Ia2 (t) is disposed at the second emulated position in the touch state. The placed screen is shown. In FIG. 13, when the operation mode is the back surface TP mode, the pointer image Ib1 (nt) is arranged at the first emulated position in the untouched state, and the pointer image Ib2 (nt) is arranged at the second emulated position in the untouched state. The placed screen is shown. In FIG. 14, when the operation mode is the back surface TP mode, the pointer image Ib1 (t) is disposed at the first emulated position in the touch state, and the pointer image Ib2 (t) is disposed at the second emulated position in the touch state. The placed screen is shown. In FIG. 15, the pointer image Ic1 (nt) is arranged at the first emulated position in the untouched state and the pointer image Ic2 (nt) is arranged at the second emulated position in the untouched state when the operation mode is the double-sided TP mode. The placed screen is shown. In FIG. 16, the pointer image Ic1 (t) is disposed at the first emulated position in the touch state and the pointer image Ic2 (t) is disposed at the second emulated position in the touch state when the operation mode is the two-sided TP mode. The placed screen is shown. These screens are displayed on the display 16.

The pointer image I is displayed on the display 16 in a state of being superimposed on the screen displayed by executing the target program. In FIGS. 11 to 16, the images generated by executing the target program are omitted.

Further, in the present embodiment, as described above, the user can freely switch between the N mode and the TP mode by operating the controller 14. Hereinafter, switching between the N mode and the TP mode will be described with reference to FIG.

FIG. 17 is a diagram showing an example of transition rules of the operation mode. In the present embodiment, the N mode and the TP mode are switched according to the transition rule shown in FIG. In the following description, it is assumed that all emulated positions are untouched.

When at least one of the operation sticks SL and SR is pressed in the axial direction of the stick when the operation mode is the N mode, the operation mode is changed to the TP mode and one emulated position is set. In the present embodiment, when the operation stick SL is pressed when the operation mode is the N mode, the surface TP mode is set. In this case, the pointer image Ia1 is displayed on the display 16. In the present embodiment, when the operation stick SR is pressed when the operation mode is the N mode, the back surface TP mode is set. In this case, the pointer image Ib1 is displayed on the display 16. Further, in the present embodiment, in the case where the operation mode is the N mode, when both of the operation sticks SL and SR are pressed, the duplex TP mode is set. In this case, the pointer image Ic1 is displayed on the display 16.

Set when there is an operation input of operation stick SR (see Fig. 9), in which one emulated position is set, and either posture data value X1 or value Y1 is within the numerical range of the sensing range. The emulated position is increased from one to two. In this case, the pointer image Ia2, Ib2 or Ic2 is displayed on the display 16.

It is assumed that a predetermined time has elapsed with no operation input for any of the operation members in a state where two emulated positions are set. For example, for the operation sticks SL and SR, there is no operation input that is the numerical range of the sensing zone (see FIG. 9) for any of the posture data values X1 and Y1, and there is no operation input for direction keys or buttons. Suppose that has passed. In this case, the emulated positions to be set are reduced from two to one. In this case, for example, the pointer image Ia2, Ib2, or Ic2 is erased from the display 16.

When the operation mode is the TP mode, when the button B4 or the operation stick SL or SR is pressed in the axial direction of the stick, the operation mode is changed to the N mode. In this case, all the pointer images I are erased from the display 16.

Here, as a summary of the contents described above, the function of the emulation device 12 according to the present embodiment and the process executed by the emulation device 12 will be described.

FIG. 18 is a functional block diagram showing an example of functions implemented by the emulation device 12 according to the present embodiment. In the emulation apparatus 12 according to the present embodiment, not all the functions shown in FIG. 18 need to be mounted, and functions other than the functions shown in FIG. 18 may be mounted.

Then, as shown in FIG. 18, the emulation apparatus 12 according to the present embodiment functionally includes, for example, an emulated position data storage unit 60, a speed parameter data storage unit 62, an operation mode data storage unit 64, and input data. The acquisition unit 66, the operation mode setting unit 68, the determination unit 70, the display control unit 72, and the emulation process execution unit 74 are included. The emulated position data storage unit 60, the speed parameter data storage unit 62, and the operation mode data storage unit 64 are mainly implemented with the storage unit 22. The input data acquisition unit 66 is mainly implemented with the communication unit 24 or the input / output unit 26. The other functions are implemented mainly by the control unit 20.

The above functions are implemented by the control unit 20 executing a program installed in the emulation device 12 which is a computer and including a command corresponding to the above functions. This program is supplied to the emulation apparatus 12 via a computer readable information storage medium such as an optical disk, a magnetic disk, a magnetic tape, a magneto-optical disk, a flash memory, or a computer network such as the Internet, for example. .

The emulated position data storage unit 60 stores emulated position data indicating coordinate values of the emulated position. In the present embodiment, the emulated position data storage unit 60 stores first emulated position data indicating coordinate values of the first emulated position and second emulated position data indicating coordinate values of the second emulated position. . In the present embodiment, initial values of the coordinate value of the first emulated position and the coordinate value of the second emulated position are, for example, coordinate values (480, 272) of the center of the display 16.

The velocity parameter data storage unit 62 stores velocity parameter data indicating velocity parameters associated with the amount of change per emulated position per frame. In the present embodiment, the velocity parameter data storage unit 62 indicates, for example, first velocity parameter data indicating the value of the velocity parameter for the first emulated position and a second velocity parameter indicating the value of the velocity parameter for the second emulated position. Store data In the present embodiment, initial values of the first velocity parameter and the second velocity parameter are, for example, (0, 0).

The operation mode data storage unit 64 stores operation mode data indicating the operation mode and the number of emulated positions to be set. When the operation mode is N mode, the value of the operation mode data is "N", for example. When the operation mode is the surface TP mode, the value of the operation mode data is, for example, “surface TP1” when the set emulation position is one, and when the value is two, the operation mode data is The value of is, for example, "surface TP2". When the operation mode is the back surface TP mode, the value of the operation mode data is, for example, “back surface TP1” when the set emulation position is one, and when it is two, the operation mode data is The value of is, for example, "back side TP2". When the operation mode is double-sided TP mode, the value of the operation mode data is, for example, “double-sided TP1” when the set emulation position is one, and when it is two, the operation mode data The value of is, for example, "both sides TP2".

The input data acquisition unit 66 acquires input data associated with an operation input to the controller 14. In the present embodiment, the input data acquisition unit 66 sequentially acquires input data at a predetermined frame rate. In the present embodiment, the input data acquisition unit 66 acquires, for example, input data including posture data associated with at least one of the direction and the size in which the operation stick is operated. More specifically, for example, input data including posture data associated with at least one of the direction and the size in which the operation stick is tilted is acquired. In the present embodiment, the input data acquisition unit 66 acquires, for example, posture data (X1, Y1) of the operation stick SL and posture data (X1, Y1) of the operation stick SR. The input data acquisition unit 66 also acquires data indicating whether or not the direction keys DK1 to DK4, the buttons B1 to B4, BL1, BL2, BR1, BR2 and the like are pressed.

The operation mode setting unit 68 determines the operation mode and the number of emulated positions in the frame based on the input data in accordance with the transition rule shown in FIG. 17 according to the acquisition of the input data. In the present embodiment, the operation mode setting unit 68 holds transition rule data indicating transition rules of the operation mode shown in FIG. Then, based on the transition rule data and the input data acquired by the input data acquisition unit 66, the operation mode setting unit 68 determines the operation mode and the number of emulated positions in the frame. Then, the operation mode setting unit 68 updates the value of the operation mode data stored in the operation mode data storage unit 64.

The determination unit 70 determines the relationship between a plurality of positions in the detection plane, which is an arrangement along the direction according to the input data acquired by the input data acquisition unit 66. In the present embodiment, the determination unit 70 determines the emulated position based on the input data acquired by the input data acquisition unit 66. In the present embodiment, the determination unit 70 plays a role as a conversion unit that converts an operation input received by the controller 14 into an operation input to the touch sensor 52. Further, in the present embodiment, the determination unit 70 emulates, in the frame, a position away from the previously determined emulated position along the direction determined based on the posture data each time input data is acquired. Determined as a rate position. Note that the determination unit 70 may determine a plurality of emulated positions. Then, the determination unit 70 determines the detection position based on the emulated position. Note that the determination unit 70 may determine a plurality of detection positions each time input data is acquired. The determination unit 70 may determine, for example, a position vector of the emulated position in the frame when the emulated position determined last time is set as the start point based on the input data. Specifically, for example, the orientation of the emulated position in the frame with respect to the previously determined emulated position, and the length between the previously determined emulated position and the emulated position in the frame may be determined.

In the present embodiment, the determination unit 70 holds posture / acceleration correspondence data indicating the correspondence between the value of posture data and the value of the acceleration parameter as shown in FIG. Then, the determination unit 70 determines the value of the acceleration parameter based on, for example, posture acceleration correspondence relationship data and the posture data acquired by the input data acquisition unit 66. Hereinafter, the acceleration parameter whose value is determined based on the value of the posture data of the operation stick SL is called a first acceleration parameter, and the acceleration parameter whose value is determined based on the value of the posture data of the operation stick SR is a second acceleration We call it a parameter.

Further, in the present embodiment, the determination unit 70 holds determination rule data indicating a rule for determining the value of the velocity parameter and the coordinate value of the emulated position as shown in FIG. Then, the determination unit 70 determines the value of the velocity parameter and the coordinate value of the emulated position based on, for example, the determination rule data and the value of the determined acceleration parameter. Then, the determination unit 70 determines the value of the velocity parameter indicated by the velocity parameter data stored in the velocity parameter data storage unit 62 and the emulated position indicated by the emulated position data stored in the emulated position data storage unit 60. Update coordinate values.

Further, in the present embodiment, the determination unit 70 holds coordinate correspondence relationship data indicating the correspondence between the coordinate value of the emulated position and the coordinate value of the detection position on the detection surface of the touch sensor 52 as shown in FIG. ing. Then, when there is an emulated position in the touch state, the determination unit 70 determines the detected position associated with the emulated position.

The determination unit 70 also corrects the Y3 coordinate value of the emulated position indicated by the emulated position data, which may occur when the operation mode is the two-sided TP mode (see FIG. 10).

The display control unit 72 causes the display 16 to display the pointer image I in response to the determination of the emulated position. In the present embodiment, the display control unit 72 arranges the pointer image I, which is determined based on whether the operation mode data and the emulated position are in the touch state, at a position specified based on the emulated position data. The displayed screen is displayed on the display 16. In this embodiment, the relative position of the emulated position in the display 16 and the relative position of the detected position in the surface touch sensor 52a substantially coincide with each other. Therefore, the display control unit 72 causes the pointer image I to be displayed at a position in the display 16 that substantially matches the relative position of the detection position in the detection plane. Further, in the present embodiment, the display control unit 72 receives an instruction to start emulating the input operation to the touch sensor 52, for example, a pointer image in response to receiving an instruction to shift the operation mode from N mode to TP mode. Display I on the display 16. In the present embodiment, the instruction corresponds to, for example, at least one of the operation stick SL and the operation stick SR received when the operation mode is the N mode.

In the present embodiment, for example, the emulation process execution unit 74 executes a process that is executed when a plurality of positions arranged according to the relationship determined by the determination unit 70 are sequentially detected on the detection surface. In the present embodiment, the emulation process execution unit 74 executes the process executed by the target device 30 when the touch sensor 52 detects the detection position determined by the determination unit 70. In the present embodiment, the emulation process execution unit 74 is executed by the target device 30 when the detection positions of the arrangement along the direction determined based on the input data acquired by the input data acquisition unit 66 are sequentially detected. Execute the process Further, as described above, the larger the size at which the operation sticks SL and SR associated with the input data are operated, the longer the interval between detection positions detected in order. Further, in the present embodiment, the emulation process execution unit 74 executes the target program based on the operation input to the touch sensor 52 determined by the determination unit 70.

In addition, when both the first emulated position and the second emulated position are in the touch state (see FIGS. 12, 14 and 16), the detected position corresponding to each of them is detected by the touch sensor 52. When detected, processing executed by the target device 30 is executed.

Further, it is assumed that a plurality of detection positions are determined continuously over a plurality of frames, that is, a plurality of times. In this case, the processing performed by the target device 30 is performed when a plurality of detection positions determined for each frame are sequentially detected according to the acquisition order (frame order) of input data associated with the plurality of detection positions. Is executed (see FIG. 8).

When the operation mode is the surface TP mode, the process executed by the target device 30 is executed when the detection position of the detection surface of the surface touch sensor 52a is detected. When the operation mode is the back surface TP mode, the processing executed by the target device 30 is executed when the detection position of the detection surface of the back surface touch sensor 52 b is detected. When the operation mode is the double-sided TP mode, the process executed by the target device 30 is executed when the detection position of the detection surface for both the front surface touch sensor 52a and the rear surface touch sensor 52b is detected.

Here, an example of the flow of processing performed for each frame by the emulation device 12 according to the present embodiment will be described with reference to the flow chart shown in FIG.

First, the input data acquisition unit 66 acquires input data (S101). Then, the operation mode setting unit 68 determines the operation mode and the number of emulated positions based on the input data and the transition rule data (S102). Then, the value of the operation mode data stored in operation mode data storage unit 64 is set such that operation mode setting unit 68 attains a value corresponding to the operation mode and the number of emulated positions determined in the process shown in S102. It updates (S103).

Then, the operation mode setting unit 68 confirms whether the value of the operation mode data is "N" (S104). In the case of "N", that is, when the operation mode is N mode (S104: Y), the target device 30 executes when the emulation process execution unit 74 acquires the input data acquired in the process shown in S101. The processing is executed (S105), and the processing shown in this processing example is ended. In this case, it is possible to emulate operations on the operation sticks SL (T) and SR (T) of the target device 30.

On the other hand, if it is not "N", that is, if the operation mode is the TP mode (S104: N), the determination unit 70 determines an acceleration parameter based on the posture acceleration correspondence data and the posture data acquired in the process shown in S101. The value of is determined (S106). At this time, when the value of the operation mode data is “front surface TP1”, “back surface TP1”, or “both sides TP1”, the value of the first acceleration parameter is determined. Further, when the value of the operation mode data is “front surface TP2”, “back surface TP2”, or “both sides TP2”, the values of the first acceleration parameter and the second acceleration parameter are determined.

Then, based on the determination rule data, the value of the velocity parameter data stored in the velocity parameter data storage unit 62, and the value of the acceleration parameter determined in the process shown in S106, the velocity parameter in the frame is determined. The value of is determined (S107). Then, the determination unit 70 updates the value of the velocity parameter indicated by the velocity parameter data stored in the velocity parameter data storage unit 62 to the value determined in the process shown in S107 (S108). In the processes shown in S107 and S108, when the value of the operation mode data is “front surface TP1”, “back surface TP1”, or “both sides TP1”, the value of the first velocity parameter is determined and updated. Further, when the value of the operation mode data is “front surface TP2”, “back surface TP2”, or “both sides TP2”, determination and update of the values of the first velocity parameter and the second velocity parameter are performed.

Then, based on the emulated position data stored in emulated position data storage unit 60 and the value of the velocity parameter determined in the process shown in S107, decision unit 70 determines the emulated position in the frame. Coordinate values are determined (S109). Then, the determination unit 70 updates the coordinate value of the emulated position indicated by the emulated position data stored in the emulated position data storage unit 60 to the coordinate value determined in the process shown in S109 (S110). At this time, when the value of the operation mode data is “front surface TP1”, “back surface TP1”, or “both sides TP1”, determination and update of coordinate values of the first emulated position are performed. In addition, when the value of the operation mode data is "front side TP2", "back side TP2", or "both sides TP2", the coordinate values of the first emulated position and the second emulated position are determined and updated. . If the operation mode is the double-sided TP mode, the Y3 coordinate value of the emulated position determined in the process shown in S109 is corrected to 153 when it is smaller than 153.

Then, the display control unit 72 causes the display 16 to display a screen in which the pointer image I determined based on the operation mode data is located at the position specified based on the emulated position data (S111). In the process shown in S111, the display control unit 72 outputs, for example, data representing the screen to the display 16. Then, the display 16 displays the screen represented by the data. At this time, when the value of the operation mode data is “front surface TP1”, “back surface TP1”, or “both sides TP1”, one pointer image I is arranged on the screen. Further, when the value of the operation mode data is “front surface TP2”, “back surface TP2”, or “both sides TP2”, two pointer images I are arranged on the screen.

Then, the determination unit 70 determines a detection position associated with the emulated position in the touch state (S112). Then, the emulation process execution unit 74 executes the process executed by the target device 30 when the detected position determined in the process shown in S112 is detected (S113), and ends the process shown in the present process example. .

The present invention is not limited to the above-described embodiment.

For example, the operation sticks SL and SR provided in the controller 14 may not be tiltable sticks, but may be operation members that can slide vertically and horizontally. Then, posture data included in the input data may be associated with the direction and the size of the slide operation.

Further, the present embodiment may be applied to other than the emulation device 12 that emulates the target device 30. For example, in the target device 30, as described above, the operation on the touch sensor 52 may be emulated by the operation on the operation sticks SL (T) and SL (R).

Also, the emulation device 12 may incorporate the display 16. Also, the emulation device 12 may be configured from a plurality of casings. Further, the above-described specific character strings and numerical values, and the specific character strings and numerical values in the drawings are merely examples, and the present invention is not limited to these character strings and numerical values.

Claims (15)

An emulation apparatus that emulates an operation on a detection surface that sequentially detects the position of an object, comprising:
An input data acquisition unit that acquires input data associated with the direction in which the operation stick is operated;
A determination unit configured to determine a relationship between a plurality of positions in the detection plane, which is disposed along a direction according to the input data;
A process execution unit that executes a process to be performed when a plurality of positions arranged according to the determined relationship are sequentially detected on the detection surface;
An emulation apparatus comprising: The input data acquisition unit acquires input data associated with the direction and size in which the operation stick is operated;
The determination unit determines the relationship between the plurality of positions so that the interval becomes longer as the size associated with the input data is larger.
The emulation apparatus according to claim 1, wherein The determination unit determines the position in the detection plane,
The input data acquisition unit sequentially acquires the input data,
The determination unit determines, each time the input data is acquired, a position away from the previously determined position along the direction determined based on the input data.
The process execution unit executes a process that is executed when a position determined a plurality of times by the determination unit is sequentially detected according to an acquisition order of the input data associated with the position.
The emulation apparatus according to claim 1 or 2, wherein And a display control unit configured to display an image at a position in the display unit that substantially matches the position in the detection plane of the position determined by the determination unit.
The emulation apparatus according to claim 3, characterized in that: The emulation apparatus emulates an operation on the detection surface capable of multipoint detection;
The input data acquisition unit sequentially acquires the input data associated with the direction in which each of the plurality of operation sticks is operated;
The determination unit determines a plurality of positions in the detection plane associated with any of the plurality of operation sticks each time the input data is acquired.
The process execution unit executes a process to be performed when a plurality of positions determined a plurality of times by the determination unit are sequentially detected according to an acquisition order of the input data associated with the plurality of positions.
The emulation apparatus according to claim 3 or 4, characterized in that: An emulation apparatus that emulates an input operation to a touch sensor, comprising:
An execution unit that executes a program,
A controller that accepts an operation input from an operator,
A conversion unit that converts an operation input to be received into an operation input to the touch sensor;
The execution unit executes the program based on the operation input converted by the conversion unit.
An emulation apparatus characterized by The program is a program created on the assumption of an input operation to the touch sensor,
7. The emulation apparatus according to claim 6, wherein: The received operation input is associated with at least one of the direction or the size in which the operator is tilted.
The emulation apparatus according to claim 6 or 7, characterized in that: And a display control unit for displaying on the display unit an image indicating a position emulating a position at which the input operation to the touch sensor is performed in response to reception of an emulation start instruction of the input operation to the touch sensor.
The emulation apparatus according to any one of claims 6 to 8, characterized in that: An emulation method for emulating an operation on a detection surface that sequentially detects the position of an object, comprising:
An input data acquisition step of acquiring input data associated with the direction in which the operation stick is operated;
A determination step of determining a relationship between a plurality of positions in the detection plane, which is an arrangement along an orientation according to the input data;
A process execution step of executing a process to be performed when a plurality of positions arranged according to the determined relationship are sequentially detected on the detection surface;
An emulation method characterized by including: A program that is executed by a computer that emulates an operation on a detection surface that sequentially detects the position of an object.
A procedure for acquiring input data associated with the direction in which the operation stick is operated;
A procedure of determining a relationship between a plurality of positions in the detection plane, which is disposed along an orientation according to the input data;
A procedure for executing processing executed when a plurality of positions arranged according to the determined relationship are sequentially detected on the detection surface;
A program that causes the computer to execute the program. A computer-readable information storage medium storing a program that causes a computer to emulate an operation on a detection surface that sequentially detects the position of an object.
A procedure for acquiring input data associated with the direction in which the operation stick is operated;
A procedure of determining a relationship between a plurality of positions in the detection plane, which is disposed along an orientation according to the input data;
A procedure for executing processing executed when a plurality of positions arranged according to the determined relationship are sequentially detected on the detection surface;
A computer readable information storage medium storing a program for causing the computer to execute the program. An emulation method for emulating an input operation to a touch sensor, comprising:
An execution step of executing a program,
And converting the operation input received by the controller receiving the operation input from the operation element into the operation input to the touch sensor,
In the execution step, the program is executed based on the operation input after conversion by the conversion unit.
Emulation method characterized by A program to be executed by a computer emulating an input operation to a touch sensor,
Steps to execute the program to be executed
Causing the computer to execute a procedure of converting an operation input received by a controller receiving an operation input from an operation element into an operation input to the touch sensor;
In the execution procedure, the execution target program is executed based on the operation input after conversion by the conversion unit.
A program characterized by A computer readable information storage medium storing a program to be executed by a computer emulating an input operation to a touch sensor, the computer readable information storage medium comprising:
Steps to execute the program to be executed
Causing the computer to execute a procedure of converting an operation input received by a controller receiving an operation input from an operation element into an operation input to the touch sensor;
In the execution procedure, the execution target program is executed based on the operation input after conversion by the conversion unit.
A computer readable information storage medium storing a program characterized by the above.

Images