CN111565808A - Electronic controller with hand holder, housing and finger sensing - Google Patents

Abstract

A controller for an electronic system includes a controller body having a head and a handle, and a tracking member secured to the controller body. The head includes at least one thumb-operated control, and the handle has a tubular housing partially encased by a shell. The controller includes a hand retainer configured to physically bias a user's palm against the housing. A first plurality of tracking transducers is disposed in the tracking member, the first plurality of tracking sensors being coupled to the electronic system by electromagnetic radiation. An array of proximity sensors is spatially distributed on the housing, the array of proximity sensors being responsive to proximity of a user's finger to the housing.

Description

Electronic controller with hand holder, housing and finger sensing

CROSS-REFERENCE TO RELATED APPLICATIONS

This is a PCT application that claims priority to US Patent Application Serial No. 15/834,425, filed December 7, 2017, entitled "Electronic Controller with a Hand Retainer, Outer Shell, and Finger Sensing", which was filed August 2017 Continuation-in-part of co-pending US Patent Application Serial No. 15/679,521, filed October 17, entitled "Electronic Controller with HandRetainer and Finger Motion Sensing," which is US Patent Application Serial No. 29/580,635, filed October 11, 2016 and claims priority to US Provisional Patent Application 62/520,958, filed June 16, 2017.

Background technique

The video game industry has grown large and important, and has spawned many innovations in software and related hardware. Various handheld video game controllers have been designed, manufactured, and sold for a variety of gaming applications. Some of these innovations have applicability outside the video game industry, such as controllers for industrial machines, defense systems, robots, and more. Virtual reality (VR) systems are applications that have generated great contemporary interest and rapid technological development both within and outside the video game industry. Controllers for VR systems must perform several different functions and satisfy strict (sometimes competing) design constraints, often while optimizing certain desired characteristics (such as ease of use), etc. Accordingly, there is a need in the art for an improved controller design that improves VR systems and/or better facilitates user manipulation.

Description of drawings

Figure 1 depicts a controller according to an exemplary embodiment of the present invention with a hand holder in an open position.

FIG. 2 depicts the controller of FIG. 1 in a user's palm-up hand.

FIG. 3 depicts the controller of FIG. 1 in the closed hand of a user.

FIG. 4 depicts the controller of FIG. 1 in a user's palm-down hand.

5 depicts a pair of controls with hand holders in an open position according to an exemplary embodiment of the present invention.

6A depicts a front view of a right-hand controller according to another exemplary embodiment of the present invention.

Figure 6B depicts a rear view of the right hand controller of Figure 6A.

Figure 7A depicts a window for an infrared light sensor according to an embodiment of the present invention.

Figure 7B depicts a window for an infrared light sensor according to another embodiment of the present invention.

Figure 8 shows a side view of the right hand controller of Figure 6A with the outer shell of the tubular housing partially surrounding the controller handle exploded to reveal the instrumentation on its inner surface.

9A depicts a cross-section of the right-hand controller of FIG. 6A with the outer shell of the tubular housing partially surrounding the controller handle exploded.

Figure 9B depicts the cross-section of Figure 9A, except with the housing installed in its normal operating position.

Detailed ways

1-4 depict a controller 100 for an electronic system according to an exemplary embodiment of the present invention. The controller 100 may be utilized by electronic systems such as VR video game systems, robots, weapons or medical devices. The controller 100 may include a controller body 110 having a handle 112, and a hand holder 120 for holding the controller 100 in a user's hand (eg, the user's left hand). The handle 112 includes a tubular housing, which may optionally be substantially cylindrical. In this context, the substantially cylindrical shape need not have a constant diameter or a perfectly circular cross-section.

1-4, the controller body 110 may include a head (between the handle 112 and the distal end 111), which may optionally include one or more thumb-operated controls 114, 115, 116. For example, if a tilt button or any other button, knob, scroll wheel, joystick, or trackball can be conveniently operated by the user's thumb during normal operation when the controller 100 is held in the user's hand, it can be Treated as a thumb operated control.

The controller 100 preferably includes a tracking member 130 that is secured to the controller body 110 and optionally includes two noses 132 , 134 , each nose extending from two opposite distal ends of the tracking member 130 . a prominent one. In the embodiment of Figures 1-4, the tracking member 130 is preferably, but not necessarily, a tracking arc having an arcuate shape. Tracking member 130 includes a plurality of tracking transducers disposed therein, wherein preferably at least one tracking transducer is disposed in each protruding nose 132 , 134 . Additional tracking transducers may also be provided in the controller body 110 , wherein preferably at least one distal tracking transducer is provided adjacent said distal end 111 .

The aforementioned tracking transducers may be tracking sensors responsive to electromagnetic radiation (eg, infrared light) emitted by the electronic system, or they may alternatively be tracking signals that emit electromagnetic radiation (eg, infrared light) received by the electronic system. mark. For example, the electronic system may be a VR gaming system that broadly broadcasts (ie paints) pulsed infrared light towards the controller 100, wherein the plurality of tracking transducers of the tracking member 130 are capable of receiving the broadcasted pulsed infrared light Light or infrared light sensor shaded by the broadcast pulsed infrared light. The tracking transducers in each nose 132, 134 (eg, 3 sensors in each nose) preferably overhang the user's hand on each distal end of the tracking member 130, and thus can be better exposed (around the user's hand) to receive electromagnetic radiation emitted by the electronic system, or to transmit the electromagnetic radiation to the electronic system at a greater angle without creating an unacceptable amount of shadowing.

Preferably, the tracking member 130 and the controller body 110 are made of a substantially rigid material, such as a rigid plastic, and are securely fastened together so that they do not translate or rotate significantly relative to each other. In this way, tracking the translation and rotation of the group of tracking transducers in space is preferably not complicated by the movement of the tracking transducers relative to each other. For example, as shown in FIGS. 1-4 , the tracking member 130 may be secured to the controller body 110 by being engaged to the controller body 110 at two locations. The hand holder 120 can be attached to the controller 100 (either the controller body 110 or the tracking member 130 ) adjacent to those two positions to bias the user's palm to the handle 112 between the two positions on the outer surface.

In certain embodiments, the tracking member 130 and the controller body 110 may comprise integral, one-piece components with material continuity rather than being assembled together. For example, the tracking member 130 and the controller body 110 may be molded together in a single injection molding process step, resulting in a unitary rigid plastic part that includes both the tracking member 130 and the controller body 110 . Alternatively, the tracking member 130 and the controller body 110 may be manufactured separately initially and then assembled together later. Either way, the tracking member 130 can be considered to be fixed to the controller body 110 .

The hand holder 120 is shown in an open position in FIG. 1 . The hand holder 120 can optionally be biased in the open position by a curved elastic member 122 to facilitate insertion of the user's left hand into the hand holder 120 and the user's left hand when the user grasps the controller and vision is blocked by the VR goggles. between the controller main body 110 . For example, the flexural elastic member 122 may optionally be an elastically bendable flexible metal strip, or may comprise an alternative plastic material such as substantially elastically bendable nylon. For user comfort, the flexural elastic member 122 may optionally be partially or completely within or covered by a cushion or fabric material 124 (eg, a neoprene jacket). Alternatively, a cushion or fabric material 124 may be provided (eg, bonded) to only the side of the curved elastic member 122 that faces the user's hand.

The hand holder 120 is optionally adjustable in length, eg, by including a drawstring 126 tied by a spring-biased chock 128 . The pull cord 126 can optionally have excess length that can be used as a lanyard. The sheath 124 is optionally attachable to the drawstring. In certain embodiments, the flexural elastic members 122 may be preloaded by the tension of the tethered pull cords 126 . In such embodiments, the tension imparted by the flexural elastic member 122 to the hand retainer 120 (to bias it in the open position) causes the hand retainer to automatically open when the pull cord 126 is released. The present disclosure also contemplates alternative conventional means for adjusting the length of the hand retainer 120, such as anti-slip strips, elastic straps (which temporarily stretch when inserted into the hand so that elastic tension is applied to press against the back of the hand), allow for length adjustment hook-and-loop strap attachment, etc.

The hand holder 120 may be disposed between the handle 112 and the tracking member 130 and configured to contact the back of the user's hand. FIG. 2 shows the controller 100 during operation with the user's left hand inserted therein, but not grasping the controller body 110 . In FIG. 2 , the hand retainer 120 is closed and taut on the hand to physically bias the user's palm against the outer surface of the handle 112 . In this way, the hand holder 120, when closed, can hold the controller 100 in the hand even if the hand is not grasping the controller body 110. 3 and 4 depict during operation, when the hand holder 120 is closed, and the hand is gripping the controller body 110 and the thumb is operating one or more of the thumb-operated controls (eg, the track pad 116 ) controller 100.

The handle 112 of the controller body 110 preferably includes an array of proximity sensors that are spatially distributed partially or fully around its outer surface. The proximity sensors in an array are not necessarily equal in size and do not necessarily have equal spacing therebetween, although the array may include a grid. The array of proximity sensors is preferably responsive to the proximity of the user's fingers to the outer surface of handle 112 . For example, the array of proximity sensors may be a plurality of capacitive sensors embedded under the outer surface of handle 112, where the outer surface includes an electrically insulating material. The capacitance between such an array of capacitive sensors and a portion of the user's hand is inversely related to the distance therebetween. Capacitance can be sensed by connecting an RC oscillator circuit to the elements of the capacitive sensor array, and it is noted that the time constant of the circuit (and thus the period and frequency of oscillation) will vary with capacitance. In this manner, the circuitry can detect the release of the user's finger from the outer surface of handle 112 .

When the hand retainer 120 (eg, a hand retaining strap) is tightly closed, it not only serves to prevent the controller 100 from falling out of the hand, but it also prevents excessive translation of the fingers relative to the proximity sensor array of the handle 112 for more reliable finger sensing sports. The electronic system may include algorithms that embody the anatomically possible movements of the fingers to better use the sensing from the proximity sensor array to render the controlled character's hand opening, finger pointing or fingers relative to the controller or relative to each other of other sports. In this manner, movements of the controller 100 and/or fingers by the user may facilitate control of VR gaming systems, defense systems, medical systems, industrial robots or machines, or other devices. In VR system applications (eg, for gaming, training, etc.), the system may render throwing motions based on the movement of the tracking transducers, and may render based on the sensed release of the user's finger from the outer surface of the controller handle The release of the thrown object.

Thus, the function of the hand holder 120 (allowing the user to "let go" of the controller 100 without the controller 100 actually being detached from the hand or being thrown or dropped to the floor) may enable additional functions of the controlled electronic system sex. For example, if the release and recovery of a user's grip on the handle 112 of the controller body 110 is sensed, this release or grip can be incorporated into the game to display (eg, in VR) a throw or grip object. The hand holder 120 may allow this function to be performed repeatedly and safely. For example, the position of the hand holder 120 in the embodiment of FIGS. 1-4 may help the tracking member 130 to protect the back of the user's hand from collisions in the real world, such as when the user responds in a VR environment when moving while the cue is sensed in (such as when actually occluded by VR goggles).

In certain embodiments, the controller 100 may include a rechargeable battery disposed within the controller body 110, and the hand holder 120 (eg, a hand holder strap) may include a conductive charge electrically coupled to the rechargeable battery Wire. The controller 100 preferably also includes a radio frequency (RF) transmitter for communicating with the rest of the electronic system. Such RF transmitters may be powered by a rechargeable battery and may be responsive to thumb operated controls 114 , 115 , 116 , proximity sensors in handle 112 of controller body 110 and/or tracking sensors in tracking member 130 .

As shown in FIG. 5 , in some embodiments, the controller 100 may be the left-hand controller in a pair of controllers that includes a similar right-hand controller 200 . In some embodiments, controllers 100 and 200 may simultaneously (together) track the movement and grip of the user's hands, eg, to enhance the VR experience.

6A depicts a front view of a right-hand controller 600 according to another exemplary embodiment of the present invention. FIG. 6B depicts a rear view of the right-hand controller 600 . The controller 600 has a controller body including a head 610 and a handle 612 . In the embodiment of Figures 6A-6B, the head 610 includes at least one thumb-operated control A, B, 608, and may also include a control (eg, trigger 609) configured to be operated by the index finger. The handle 612 includes a tubular housing that is partially enclosed by a housing 640 .

In the embodiment of FIGS. 6A-6B , the tracking member 630 is secured to the controller body at the head 610 and at the end of the handle 612 . The hand holder 620 is configured to physically bias the user's palm against the housing 640 between the head 610 and the end of the handle 612 . The hand retainer 620 is preferably disposed between the handle 612 and the tracking member 630, and may include a hand retaining strap that is adjustable in length and configured to contact the back of the user's hand. In the embodiment of FIGS. 6A-6B, the hand holder 620 optionally includes a pull cord 628, and is optionally length adjustable by a cord lock 626 (adjacent to the distal end of the handle 612), the cord The lock 626 selectively prevents sliding movement of the pull cord 628 at the location of the cord lock 626 .

In the embodiment of FIGS. 6A-6B , tracking transducers 632 , 633 are disposed on a tracking member 630 , wherein the tracking transducer 633 is disposed on a protruding nose at the opposite distal end of the tracking member 630 . Additional tracking transducers 634 are optionally disposed on the distal region of the head 610 . Tracking transducers 632, 633, and 634 may be tracking sensors responsive to electromagnetic radiation (eg, infrared light) emitted by an electronic system (eg, a virtual reality gaming system), or may be tracking sensors that emit electromagnetic radiation (eg, received by an electronic system) , infrared light) tracking beacons. For example, the electronic system may be a VR gaming system that broadly broadcasts (ie whitewashes) pulsed infrared light toward controller 600, where tracking transducers 632, 633, and 634 are infrared light sensors that can receive the broadcasted pulsed infrared light. The response of such tracking sensors can be communicated back to the electronic system, and the system can interpret the response to effectively track the position and orientation of the controller 600 .

One or more of the tracking transducers 632, 633, 634 may optionally be as shown in the embodiment of FIG. 7A, or alternatively as shown in the embodiment of FIG. shown in the conventional manner. The lower portion of FIG. 7A depicts an exploded perspective view of infrared light sensor 750 electrically connected to flex circuit 751, shown as a rectangle comprising an overlying windowed housing wall 755 of infrared opaque plastic section below. Windowed housing wall 755 includes window 756 . Window 756 preferably comprises infrared transmissive polycarbonate plastic, and may include a bottom side recess for accommodating the thickness of infrared light sensor 750 .

According to the embodiment of Figure 7A, the windowed housing wall (eg, the outer structure of the tracking member 630 or the head 610 of Figure 6A) may be fabricated by a so-called "two-shot" injection molding process, such that the majority of the housing wall is made of infrared Opaque plastic, but with IR transmissive plastic disposed in window 756 above IR light sensor 750.

The upper portion of FIG. 7A depicts a cross-sectional view of the assembled infrared light sensor 750 , flex circuit 751 , and windowed housing wall 755 . Infrared light shown in FIG. 7A as three downward arrows incident on window 756 from above passes through window 756 to be received by infrared light sensor 750 below. Since housing wall 755 comprises infrared opaque plastic, infrared light impinging on it will not pass through, and a portion may be reflected back into the window to be received by infrared light sensor 750 . In this way, although the majority of housing wall 755 comprises infrared opaque plastic, window 756 allows infrared light to affect infrared light sensor 750 so that infrared light sensor 750 only receives infrared light from a preferred range of angles.

Alternatively, one or more of the tracking transducers 632, 633, 634 optionally may be constructed as shown in the embodiment of Figure 7B. The lower portion of FIG. 7B depicts an exploded perspective view of infrared light sensor 750 electrically connected to flex circuit 751, shown below a rectangular portion of an overlying housing wall 758 comprising IR transmissive plastic . Housing wall 758 is coated with infrared opaque film 757 that is patterned to include window 759 (in which infrared opaque film 757 is absent).

The upper portion of FIG. 7B depicts a cross-sectional view of the assembled infrared light sensor 750 , flex circuit 751 , housing wall 758 , and IR opaque film 757 . Infrared light, shown as three downward arrows incident on housing wall 758 from above in Figure 7B, passes through window 759 in infrared opaque film 757 to pass through housing wall 758 therefrom by the underlying infrared light Light sensor 750 receives. Since the housing wall 758 comprises infrared transmissive plastic, infrared light impinging on it can enter it and disappear, perhaps inadvertently and unintentionally even reaching nearby sensors through internal reflections. In this manner, windows 759 in infrared opaque film 757 allow infrared light to primarily affect infrared light sensor 750 .

Figure 8 shows a side view of the right hand controller 600 with the outer shell 640 of the tubular housing partially surrounding the handle 612 exploded to reveal the instrument on its inner surface. In the embodiment of FIG. 8 , the instrument may include an array of proximity sensors 800 spatially distributed on the inner surface of the housing 640 , the array of proximity sensors 800 being responsive to the proximity of the user's finger to the housing 640 . The proximity sensors 800 in an array are not necessarily of equal size, nor are they necessarily regularly or equally spaced from each other. In certain embodiments, the array of proximity sensors 800 may preferably be a plurality of capacitive sensors connected to a flex circuit bonded to the inner surface of the housing 640 . In the embodiment of FIG. 8, the housing 640 includes a first electrical connector portion 805 connectable to a mating second electrical connector portion of the handle 612 (shown in greater detail in FIGS. 9A-9B).

Figures 9A-9B depict cross-sections of the right hand controller 600 of Figure 6A, showing that the handle of the controller may optionally include tubular housings 612a, 612b, the right hand controller 600 consisting of tubular housing portions 612a and Seams 613 where 612b adjoins are longitudinally divided. In Figure 9A, the housing 640 is shown exploded away from the remainder of the handle. FIG. 9B depicts the cross-section of FIG. 9A with the housing 640 installed in its normal operating position. In the embodiment of FIGS. 9A-9B, the first electrical connector portion 805 of the housing 640 is shown mating and connectable with the second electrical connector portion 905 of the controller handle.

In the embodiment of Figures 9A-9B, the outer shell 640 partially wraps the tubular shells 612a, 612b in such a way that it preferably overlaps the longitudinal seam 613 so that the longitudinal seam 613 can be positioned to optimize the manufacturing process, while the Not the desired circumferential location to accommodate proximity sensor array 800 . In certain embodiments, the housing 640 overlaps the circumferential portion C of the handle's tubular housings 612a, 612b, and the circumferential portion C angularly spans at least 100 degrees but not more than the entire circumference of the handle's tubular housings 612a, 612b 170 degrees. In certain embodiments, this circumferential overlap may enable proximity sensor array 800 to sense the proximity of a desired portion of a user's finger or palm (eg, the area of the hand that best indicates a grip).

The tubular housings 612a, 612b of the handle need not have a circular cross-section, and the term "circumferential" is used herein whether or not the tubular housings 612a, 612b of the handle have a circular cross-section. Herein, the term "circumference" refers to the full perimeter of the tubular housings 612a, 612b surrounding the handle, which may be circular if the tubular housings 612a, 612b are hollow cylinders that are exactly circular, but Shaped as a non-circular cylinder or hollow prism, it can also be a closed shape other than circular.

In the embodiment of FIGS. 9A-9B, a printed circuit board (PCB) 920 may be mounted within the tubular housings 612a, 612b of the handle with the second electrical connector portion 905 electrically coupled to the PCB 920. The PCB 920 optionally includes a Force Sensing Resistor (FSR) 922, and the controller may also include a plunger 924 that conveys a compressive force applied through the housing 640 to the exterior of the tubular housings 612a, 612b of the handle inwardly to the FSR 922. In certain embodiments, the FSR 922 in combination with the proximity sensor array 800 may be beneficial for sensing both the onset of a user's grip and the relative strength of such a grip by the user, which may facilitate certain gaming functions.

In certain embodiments, the shell thickness of the housing 640 (measured radially in FIGS. 9A-9B ) is less than one-third the thickness of the shell wall of the tubular shell portion 612a or 612b of the handle. In those embodiments, this difference in thickness may improve the sensitivity of the proximity sensor array 800 relative to alternative embodiments in which the proximity sensor array 800 is disposed on or in the tubular housing 612a, 612b of the handle.

The invention has been described herein with reference to specific exemplary embodiments, but those skilled in the art will recognize that the invention is not limited to these embodiments. It is contemplated that the various features and aspects of the present invention may be used alone or in combination in different environments or applications. For example, features shown with respect to a right-hand controller may also be implemented in a left-hand controller, and vice versa. Accordingly, the description and drawings are to be regarded as illustrative and exemplary and not restrictive. For example, the word "preferably" and the phrase "preferably but not necessarily" are used synonymously herein to consistently include the meaning of "not necessarily" or "optionally." "Comprising," "including," and "having" are intended to be open-ended terms.

Claims (21)

What is claimed is: 1. A controller for an electronic system for operation by a user having a thumb, fingers and a palm in the user's hand, the controller comprising: a controller body having a head and a handle, the head including at least one thumb-operated control, and the handle having a tubular housing partially encased by a housing; a tracking member fixed to the controller body; a hand retainer configured to physically bias the user's palm against the housing; a first plurality of tracking transducers disposed in the tracking member, the first plurality of tracking transducers coupled to the electronic system by electromagnetic radiation; and An array of proximity sensors spatially distributed on the housing, the array of proximity sensors responsive to the proximity of the user's fingers to the housing. 2. The controller of claim 1, wherein the first plurality of tracking transducers comprise a plurality of tracking sensors responsive to electromagnetic radiation emitted by the electronic system. 3. The controller of claim 2, wherein the plurality of tracking sensors are infrared light sensors responsive to pulsed infrared light emitted by the electronic system. 4. The controller of claim 3, wherein each of the infrared light sensors is covered by an infrared transmissive polycarbonate plastic. 5. The controller of claim 1, wherein the first plurality of tracking transducers comprise a plurality of tracking beacons that emit electromagnetic radiation received by the electronic system. 6. The controller of claim 1, wherein the tracking member is a tracking arc having an arcuate shape. 7. The controller of claim 1, wherein the tracking member is secured to the controller body by engaging to the controller body at two locations, and the hand holder is secured to the controller body at the The user's palm is biased against the housing between the two positions. 8. The controller of claim 7, wherein the hand retainer includes a hand retaining strap disposed between the handle and the tracking member. 9. The controller of claim 7, wherein the hand retainer includes a hand retention strap that is adjustable in length and configured to contact the back of the user's hand. 10. The controller of claim 9, wherein the hand retention strap includes an inner flexural elastic member. 11. The controller of claim 1, further comprising a second plurality of tracking transducers disposed in the controller body, the second plurality of tracking transducers comprising a At least one distal tracking transducer disposed at the distal end. 12. The controller of claim 1, wherein the tracking member includes two noses, each nose protruding from a corresponding one of two opposing distal ends of the tracking member, each The nose includes at least one of the first plurality of tracking transducers. 13. The controller of claim 1, wherein the array of proximity sensors is a plurality of capacitive sensors attached to an inner surface of the housing. 14. The controller of claim 13, wherein the plurality of capacitive sensors are disposed on a flexible circuit attached to an inner surface of the housing. 15. The controller of claim 1, wherein the housing angularly spans at least 100 degrees but not more than 170 degrees of the entire circumference of the tubular housing of the handle. 16. The controller of claim 1, wherein the housing includes a first electrical connector portion and the tubular housing of the handle includes a second electrical connector portion, and the first electrical connector The portion and the second electrical connector portion are mating and connectable. 17. The controller of claim 16, further comprising a printed circuit board (PCB) mounted within the tubular housing of the handle, the second electrical connector portion electrically coupled to the PCB. 18. The controller of claim 17, wherein the PCB includes a force sensing resistor (FSR), and the controller further includes a plunger to be applied to the tubular housing of the handle The compressive force on the outside of the body is delivered inward to the FSR. 19. The controller of claim 1, wherein the tubular housing of the handle is longitudinally divided by a seam, and the housing spans the seam. 20. The controller of claim 1, wherein the housing has a shell thickness and the tubular housing has a shell wall thickness, and the shell thickness is less than one third of the shell wall thickness. 21. A controller for an electronic system for operation by a user, the user's hand having a thumb, fingers and a palm, the controller comprising: a controller body having a head and a handle, the head including at least one thumb-operated control; a tracking member fixed to the controller body; a hand retainer configured to physically bias the user's palm against an outer surface of the handle; a first plurality of tracking transducers disposed in the tracking member, the first plurality of tracking transducers coupled to the electronic system by electromagnetic radiation; and An array of proximity sensors spatially distributed on the handle, the array of proximity sensors responsive to the proximity of the user's fingers to the outer surface of the handle.

Images