CN102349038B - System and method for texture engine - Google Patents

Abstract

Disclosed are systems and methods for a texture engine. For example, a disclosed system includes a processor configured to receive a display signal comprising a plurality of pixels, determine a haptic effect comprising a texture, and transmit a haptic signal associated with the haptic effect to an actuator in communication with the processor; and an actuator configured to receive the haptic signal and output the haptic effect.

Description

System and method for texture engine

Cross References to Related Applications

This patent application claims priority to US Provisional Patent Application No. 61/159,482, filed March 12, 2009, entitled "Locating Features Using a Friction Display," which is hereby incorporated by reference in its entirety.

This patent application claims priority to U.S. Provisional Patent Application No. 61/262,041, filed November 17, 2009, entitled "System and Method for Increasing Haptic Bandwidth in an Electronic Device," which is incorporated by reference in its entirety here.

This patent application claims priority to US Provisional Patent Application No. 61/262,038, filed November 17, 2009, entitled "Friction Rotary Device for Haptic Feedback," which is hereby incorporated by reference in its entirety.

This patent application claims priority to U.S. Utility Patent Application No. 12/696,893, filed January 29, 2010, entitled "Systems And Methods For Providing Features In A Friction Display," which is incorporated by reference in its entirety here.

This patent application claims priority to U.S. Utility Patent Application No. 12/696,900, filed January 29, 2010, entitled "Systems And Methods For Friction Displays And Additional Haptic Effects," which is incorporated by reference in its entirety here.

This patent application claims priority to U.S. Utility Model Application No. 12/696,908, filed January 29, 2010, entitled "Systems And Methods For Interfaces Featuring Surface-Based Haptic Effects," the entire contents of which are incorporated by reference merged here.

This patent application claims priority to US Utility Patent Application No. 12/697,010, entitled "Systems And Methods For A Texture Engine," filed January 29, 2010, which is hereby incorporated by reference in its entirety.

This patent application claims priority to U.S. Utility Patent Application No. 12/697,037, entitled "Systems And Methods For Using Textures In Graphical User Interface Widgets," filed January 29, 2010, which is incorporated by reference in its entirety here.

This patent application claims priority to U.S. Utility Patent Application No. 12/697,042, filed January 29, 2010, entitled "Systems And Methods For Using Multiple Actuators To Realize Textures," which is incorporated by reference in its entirety here.

technical field

The present invention relates generally to haptic feedback, and more particularly to systems and methods for texture engines.

Background technique

The use of handheld devices of all types has grown exponentially over the past few years. These devices are used as portable organizers, phones, music players, and gaming systems. Many modern handheld devices now incorporate some type of haptic feedback. As haptic technology improves, devices can incorporate tactile feedback that mimics texture. Therefore, a haptic texture engine is required.

Contents of the invention

Embodiments of the present invention provide systems and methods for texture engines. For example, in one embodiment, a system for a texture engine includes a processor configured to receive a display signal including a plurality of pixels, determine a haptic effect including a texture, and associate a haptic effect with the haptic effect. The signal is communicated to an actuator in communication with the processor configured to receive the haptic signal and output a haptic effect.

The illustrative embodiments are mentioned not to limit or define the invention, but to provide examples to aid in the understanding of the invention. Illustrative examples are discussed in the Detailed Description, which provide further description of the invention. Advantages provided by various embodiments of the present invention can be further understood by examining the specification.

Description of drawings

These and other features, aspects, and advantages of the present invention will be better understood when read the following detailed description with reference to the accompanying drawings, in which:

1 is a block diagram of a system for a texture engine according to one embodiment of the present invention;

Figure 2 is a diagram of a system for a texture engine according to one embodiment of the present invention;

Figure 3a is a diagram of a system for a texture engine according to one embodiment of the present invention;

Figure 3b is an illustration of a system for a texture engine according to one embodiment of the present invention;

FIG. 4 is a flowchart of a method for a texture engine according to an embodiment of the present invention;

Figure 5a is an illustration of one of the textures that can be generated by a texture engine according to one embodiment of the invention;

Figure 5b is another illustration of one of the textures that a texture engine can generate according to one embodiment of the invention;

Figure 5c is another illustration of one of the textures that a texture engine can generate according to one embodiment of the invention;

Figure 5d is another illustration of one of the textures that can be generated by a texture engine according to one embodiment of the invention;

Figure 5e is another illustration of one of the textures that can be generated by a texture engine according to one embodiment of the invention;

Figure 5f is another illustration of one of the textures that can be generated by a texture engine according to an embodiment of the present invention;

Figure 5g is another illustration of one of the textures that a texture engine can generate according to one embodiment of the invention; and

Figure 5h is another illustration of one of the textures that can be generated by a texture engine according to one embodiment of the invention.

detailed description

Embodiments of the present invention provide systems and methods for texture engines.

Illustrative Embodiment of Texturing Engine

An illustrative embodiment of the invention includes a messaging device, such as a mobile telephone. In an illustrative embodiment, the messaging device includes Immersion's TouchSense 3000, TouchSense 4000, or TouchSense 5000 vibrotactile feedback system (formerly known as Immersion's VibeTonz Vibration Haptic Feedback System) for Samsung Touch Phone (SCH-W420). In other embodiments, different messaging devices and haptic feedback systems may be utilized.

The illustrative messaging device includes a display, speakers, network interface, memory, and a processor in communication with each of these elements. The illustrative messaging device also includes a touch-sensitive interface interface and an actuator, both in communication with the processor. The touch-sensitive interface is configured to sense user interaction with the messaging device, and the actuator is configured to output a haptic effect. The illustrative messaging device may further include a manipulandum configured to detect user interaction and transmit an interface signal associated with the user interaction to the processor.

In an illustrative messaging device, a display is configured to display a graphical user interface to a user. A graphical user interface may include virtual objects, such as icons, buttons, or a virtual keyboard. The illustrative messaging device further includes a touch sensitive interface, such as a touch screen, mounted on top of the display. Touch-sensitive interfaces allow users to interact with virtual objects displayed in a graphical user interface. For example, in one embodiment, the graphical user interface may include a virtual keyboard, and in such an embodiment, the touch-sensitive interface allows a user to touch keys on the virtual keyboard to enter alphanumeric characters associated with the keys. This functionality can be used to type messages, or otherwise interact with objects in the graphical user interface.

In an illustrative messaging device, a processor is configured to determine a haptic effect and transmit a haptic signal corresponding to the haptic effect to an actuator configured to output the haptic effect. In an illustrative messaging device, the haptic effect mimics the texture a user feels on the surface of a touch-sensitive interface. The simulated texture can be associated with the user interface shown on the display. For example, the display may show an icon including the shape of a rock. In such an embodiment, the processor may determine a haptic effect configured to mimic the texture of a rock on the surface of the touch-sensitive interface. The processor then transmits the haptic signal to an actuator configured to output the haptic effect. When the actuator receives a haptic signal, it will output a haptic effect such as a vibration at a frequency configured to bring the surface of the touch-sensitive interface closer to the texture of the rock.

In an illustrative embodiment, the processor may implement a haptic map to determine haptic effects. For example, in an illustrative embodiment, a processor may receive a display signal comprising a plurality of pixels, each pixel being associated with a color. For example, in an illustrative embodiment, each pixel in the display signal may be associated with a red, green, or blue color, and it may further be associated with an intensity for each color. In an illustrative embodiment, the processor assigns a haptic value to each color, and further assigns a haptic intensity associated with the intensity of each color. The processor then transmits the haptic signal including the haptic value and the haptic intensity to the actuator configured to output the haptic effect.

In an illustrative embodiment, the processor may determine the haptic effect further based on the external trigger. For example, in an illustrative embodiment, the processor is configured to receive an interface signal from a touch-sensitive interface configured to detect user interaction. Then, in an illustrative embodiment, the processor will determine the haptic effect based at least in part on the interface signal. For example, the processor may modify the haptic value or haptic intensity based at least in part on the interface signal. In an illustrative embodiment, the processor will determine a higher intensity haptic effect if the touch sensitive interface detects a high speed or high pressure user interaction.

An illustrative messaging device can output haptic effects for a variety of purposes. For example, in one embodiment, a haptic effect may serve as an acknowledgment that the processor has received an interface signal associated with the user interaction. For example, a graphical user interface may include buttons, and a touch-sensitive interface may detect user interaction associated with pressing a button and transmit an interface signal to the processor. In response, the processor may determine a haptic effect to confirm receipt of the interface signal. In such embodiments, the haptic effect may cause the user to perceive a texture on the surface of the touch-sensitive interface. In an illustrative embodiment, the processor may further determine the haptic effect for other purposes. For example, an illustrative messaging device may output a texture to alert the user that it is on the border of the display or as an identification of an object such as an icon on the surface of the display.

This illustrative example is given to introduce the reader to the general subject matter discussed herein. The present invention is not limited to this example. The following sections describe various additional non-limiting embodiments and examples of systems and methods for texture engines.

Illustrative system for texture engines

Referring now to the drawings, in which like numerals represent like elements throughout the several views, FIG. 1 is a block diagram of a system for a texture engine in accordance with one embodiment of the present invention. As shown in FIG. 1, system 100 includes a messaging device 102, such as a mobile phone, portable digital assistant (PDA), portable multimedia player, portable computer, portable gaming device, or some other mobile device. In some embodiments, messaging device 102 may include a laptop, tablet, desktop PC, or other similar device. In still other embodiments, the messaging device may include an external monitor for use with a PC or some other device. Messaging device 102 includes processor 110 in communication with network interface 112 , touch-sensitive interface 114 , display 116 , actuator 118 , speaker 120 , and memory 122 .

Processor 110 is configured to execute computer-executable program instructions stored in memory 122 . For example, the processor 110 may execute one or more computer programs for messaging or for generating haptic feedback. Processor 110 may include a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), one or more field programmable gate arrays (FPGA), or a state machine. The processor 110 may further include programmable electronics such as a Programmable Logic Controller (PLC), Programmable Interrupt Controller (PIC), Programmable Logic Device (PLD), Programmable Read Only Memory (PROM), Electrically Programmable Read Only Memory (EPROM or EEPROM), or other similar devices.

Memory 122 includes a computer-readable medium storing instructions that, when executed by processor 110, cause processor 110 to perform a number of steps, such as those described herein. Embodiments of a computer readable medium may include, but are not limited to, electronic, optical, magnetic, or other storage or transmission devices capable of providing computer readable instructions to processor 110 . Other examples of media include, but are not limited to, floppy disks, CD-ROMs, magnetic disks, memory chips, ROM, RAM, ASICs, configured processors, all optical media, all tape or other magnetic media, or from which a computer processor can read any other medium. In addition, various other devices may include computer-readable media, such as routers, private or public networks, or other transmission devices. Processor 110 and the processes described may be one or more instructions and may be distributed throughout one or more structures.

Processor 110 communicates with network interface 112 . Network interface 112 may include one or more methods of mobile communication, such as infrared, radio, Wi-Fi, or cellular network communication. In other variations, network interface 112 includes a wired network interface, such as Ethernet. The messaging device 102 may be configured to exchange messages or virtual message objects with other devices (not shown) over a network, such as a cellular network and/or the Internet. Examples of messages exchanged between devices may include voice messages, text messages, data messages, or other forms of digital messages.

Processor 110 is also in communication with one or more touch-sensitive interfaces 114 . In some embodiments, touch-sensitive interface 114 may include a touch screen or a touchpad. For example, in some embodiments, touch-sensitive interface 114 may include a touch screen mounted on top of a display configured to receive display signals and output images to a user. In other embodiments, touch-sensitive interface 114 may include an optical sensor or another type of sensor. In one embodiment, the touch sensitive interface may include an LED detector. For example, in one embodiment, touch-sensitive interface 114 may include an LED finger detector mounted on the side of display 116 . In some embodiments, the processor communicates with a single touch-sensitive interface 114, and in other embodiments, the processor communicates with multiple touch-sensitive interfaces, eg, a first touch screen and a second touch screen. Touch-sensitive interface 114 is configured to detect user interaction and transmit signals to processor 110 based on the user interaction. In some embodiments, touch-sensitive interface 114 may be configured to detect various aspects of user interaction. For example, touch-sensitive interface 114 may detect the speed and pressure of user interaction and incorporate this information into the interface signal.

In the embodiment shown in FIG. 1 , processor 110 is also in communication with display 116 . Processor 110 may be configured to generate a graphical representation of the user interface to be shown on display 116 and then transmit a display signal including the graphical representation to display 116 . In other embodiments, display 116 is configured to receive a display signal from another device. For example, in some embodiments, display 116 may include an external display, such as a computer monitor. Display 116 is configured to receive a display signal and output an image associated with the display signal. In some embodiments, the display signal may include video graphics array (vga), high-definition multimedia interface (hdmi), advanced video graphics array (svga), video, two-component video (s-video), or known in the art Other types of display signals are known. In some embodiments, display 116 includes a flat screen display, such as a liquid crystal display (LCD) or a plasma screen display. In other embodiments, display 116 includes a cathode ray tube (CRT) or other type of display known in the art. In still other embodiments, display 116 may include touch-sensitive interface 114, for example, display 116 may include a touchscreen LCD. In still other embodiments, the display 116 may comprise a flexible screen or a flexible display. For example, in some embodiments, display 116 may include a tactile substrate mounted beneath its surface. In such embodiments, display 116 is made of a flexible material, and in response to signals received from processor 110 , the haptic substrate flexes, forming bridges, grooves, or other features on the surface of display 116 . In some embodiments, the haptic substrate may include a grid of plasmonic actuators, piezoelectric actuators, electroactive polymers, microelectromechanical systems, shape memory alloys, liquid-filled or gas-filled cells.

In some embodiments, processor 110 receives signals from touch-sensitive interface 114 associated with interactions with a graphical user interface shown on display 116 . For example, in one embodiment, touch-sensitive interface 114 may include a touch screen, and the graphical user interface on display 116 may include a virtual keyboard. In such an embodiment, when a user interacts with a portion of the touchscreen covering one of the keys of the virtual keyboard, the touchscreen sends an interface signal to the processor 110 corresponding to the user interaction. Based on the interface signal, the processor 110 will determine that the user has pressed a key on the virtual keyboard. This functionality allows the user to interact with other icons and virtual objects on the display 116 . For example, in some embodiments, a user can tap the touch screen to move a virtual ball or turn a virtual knob.

As shown in FIG. 1, the processor 110 is also in communication with the actuation system, which includes one or more actuators 118, a suspension system for each actuator, and a suspension system for each actuator. Electrical power and control wiring. In some embodiments, messaging device 102 includes more than one actuation system. Processor 110 is configured to determine a haptic effect and transmit a haptic signal corresponding to the haptic effect to actuator 118 . In some embodiments, the haptic effect includes a vibrating tactile texture felt on the surface of the display 116 , the touch-sensitive interface 114 , or the housing of the messaging device 102 . In some embodiments, determining the haptic effect may include performing a series of calculations. In other embodiments, determining the haptic effect may include accessing a lookup table. In still other embodiments, determining the haptic effect may include a combination of lookup tables and algorithms.

In some embodiments, determining the haptic effect may include haptic mapping. In such embodiments, determining the haptic effect may include mapping the display signal to the actuator. For example, a display signal may include a plurality of pixels, each pixel being associated with a color. In such an embodiment, each pixel may be associated with a red, green, or blue color; each color may further be associated with an intensity, eg, intensities 1-8. In such embodiments, determining the haptic effect may include assigning a haptic effect to each color. In some embodiments, the haptic effect may include the direction and intensity of the manipulation, for example, in one embodiment, the haptic signal may be configured to cause the rotary actuator to rotate clockwise at half power. In some embodiments, the intensity of the operation may be correlated with the intensity of the color. Once the processor 110 determines the haptic effect, it transmits a haptic signal including the haptic effect. In some embodiments, processor 110 may assign haptic effects to only some pixels in the display signal. For example, in such an embodiment, the haptic effect may only be associated with a portion of the display signal.

In some embodiments, processor 110 may utilize haptic mapping to determine haptic effects and then output display signals to display 116 . In other embodiments, processor 110 may use haptic mapping to determine the haptic effect and then not transmit a display signal to display 116 . In such an embodiment, the display 116 may remain dark or off while the actuator 118 outputs the haptic effect. For example, in such an embodiment, processor 110 may receive a display signal from a digital camera associated with messaging device 102 . In some embodiments, to conserve battery power, the user may de-disable the display 116 . In such an embodiment, the processor may utilize the haptic mapping to provide the user with a haptic effect that mimics a texture on the surface of the display. This texture can be used to alert the user when the camera is focused or when some other event occurs. For example, processor 110 may use facial recognition software to determine haptic effects that mimic textures at various locations on display 116 that would be associated with a face if display 116 were activated.

In some embodiments, processor 110 may determine the haptic effect based at least in part on a user interaction or trigger. In such an embodiment, processor 110 receives an interface signal from touch-sensitive interface 114 and determines a haptic effect based at least in part on the interface signal. For example, in some embodiments, processor 110 may determine the haptic effect based on the location of the user interaction detected by touch-sensitive interface 114 . For example, in such an embodiment, processor 110 may determine a haptic effect that mimics the texture of a virtual object touched by a user on display 116 . In other embodiments, processor 110 may determine the strength of the haptic effect based at least in part on the interface signal. For example, if touch-sensitive interface 114 detects a high-pressure user interaction, processor 110 may determine a high-intensity haptic effect. In another embodiment, processor 110 may determine a low-intensity haptic effect if touch-sensitive interface 114 detects a low-pressure user interaction. In still other embodiments, processor 110 may determine the strength of the haptic effect based at least in part on the speed of the user interaction. For example, in one embodiment, processor 110 may determine a low-intensity haptic effect when touch-sensitive interface 114 detects a low-speed user interaction. In still other embodiments, processor 110 may determine that there is no haptic effect unless it receives an interface signal from touch-sensitive interface 114 associated with a user interaction.

Once processor 110 determines the haptic effect, it transmits a haptic signal associated with the haptic effect to actuator 118 . Actuator 118 is configured to receive a haptic signal from processor 110 and generate a haptic effect. The actuator 118 may be, for example, a piezoelectric actuator, an electric motor, an electromagnetic actuator, a voice coil, a shape memory alloy, an electroactive polymer, a solenoid, an eccentric moment of inertia motor (ERM), or a linear resonant actuator. (LRA). In some embodiments, actuator 118 may include multiple actuators, eg, ERM and LRA.

In one embodiment of the invention, the haptic effect generated by actuator 118 is configured to mimic the texture that a user feels on the surface of touch-sensitive interface 114 or display 116 . The texture may be associated with a graphical user interface shown on display 116 . For example, display 116 may show an icon including the shape of a rock. In such an embodiment, processor 110 may determine a haptic effect configured to mimic the texture of a rock on the surface of touch-sensitive interface 114 . Processor 110 then communicates the haptic signal associated with the haptic effect to actuator 118, which outputs the haptic effect. For example, when actuator 118 receives a tactile signal, it may output a vibration at a frequency configured to cause the surface of the touch-sensitive interface to include the texture of rock. In other embodiments, actuator 118 may be configured to output vibrations at frequencies such that the surface of display 116 or touch-sensitive interface 114 includes textures of: water, ice, leather, sand, gravel, snow, skin, fur , or some other surface. In some embodiments, haptic effects may be output onto different parts of messaging device 102, for example, onto its housing. In some embodiments, the actuator 118 may output a multitude of vibrations configured to output multiple textures simultaneously. For example, actuator 118 may output vibrations configured to cause the surface of display 116 to include a texture of sand. In such an embodiment, the actuator 118 may be configured to output additional vibrations configured to cause the user to feel the texture of the rocks in the sand.

Processor 110 may determine the haptic effect for a variety of reasons. For example, in some embodiments, processor 110 may output a haptic effect corresponding to the texture of an object shown on display 116 . In such an embodiment, the display may show multiple objects, and as the user moves his/her finger from object to object, the processor may determine different haptic effects, simulating different textures for each object. In some embodiments, the haptic effect may serve as an acknowledgment that the processor 110 has received a signal associated with the user interaction. For example, in one embodiment, the graphical user interface may include buttons, and touch-sensitive interface 114 may detect user interaction associated with pressing the buttons. When touch-sensitive interface 114 transmits an interface signal associated with a user interaction to processor 110, processor 110 may determine a haptic effect to confirm receipt of the interface signal. In such embodiments, the haptic effect may cause the user to feel a texture on the surface of touch-sensitive interface 114 . For example, the processor may output a haptic effect that mimics the texture of sand to confirm that the processor 110 has received a user input. In other embodiments, the processor may determine different textures, such as those of water, ice, oil, rock, or skin. In some embodiments, the haptic effects may be used for different purposes, such as alerting the user that they are on the border of the display 116 , or providing haptic information to the user about an image on the display 116 . For example, in some embodiments, each icon on display 116 may include a different texture, and as the user moves his/her finger from one icon to another, the processor will determine the texture pattern that mimics each icon. tactile effect. In a further embodiment, when the user's finger moves from contact with the icon to contact with the background of the display, the processor may change the texture, thereby alerting the user that he/she is no longer touching the icon.

As shown in FIG. 1 , the processor 110 is also in communication with a speaker 120 . Speaker 120 is configured to receive audio signals from processor 110 and output them to a user. In some embodiments, the audio signal may be associated with a haptic effect output by actuator 118 or an image output by display 116 . In other embodiments, the audio signal may not correspond to the haptic effect or image.

In some embodiments, processor 110 may further include one or more sensors, such as a GPS sensor, imaging sensor, accelerometer, position sensor, rotational speed sensor, light sensor, camera, microphone, or some other type of sensor . The sensors may be configured to detect changes in acceleration, inclination, inertia or position. For example, messaging device 102 may include an accelerometer configured to measure acceleration of the messaging device. The sensors are configured to transmit sensor signals to the processor 110 .

The sensor signal may include one or more parameters associated with the position, motion, acceleration, or "jerk" (ie, the derivative of acceleration) of the messaging device 102 . For example, in one embodiment, a sensor may generate and transmit a sensor signal comprising a plurality of parameters, each parameter being associated with motion along or about a measured translational or rotational axis. In some embodiments, sensor output processor 110 is programmed to interpret voltages or currents indicative of motion along one or more axes.

In some embodiments, the processor 110 will receive the sensor signal and determine that it should activate the virtual workspace, and interpret the sensed movement of the messaging device 102 in the X, Y, or Z direction as corresponding to the virtual workspace " "inside" virtual movement. The user can then move the device 102 within the virtual workspace to select functions or files by gesturing within the virtual space. For example, functions within the virtual workspace are selected by moving the messaging device 102 in the Z-axis. In some embodiments, a user may use gestures within the virtual workspace to modify haptic effects output by messaging device 102 .

Figure 2 is a diagram of a system for a texture engine according to one embodiment of the present invention. Figure 2 includes a messaging device 200, such as a mobile phone, PDA, portable media player, portable gaming device, or mobile computer. The messaging device 200 is configured to send and receive signals such as voicemails, text messages, and other data messages over a network such as a cellular network or the Internet. The message sending device 200 may include a wireless network interface and/or a wired network interface (not shown in FIG. 2 ). Although device 200 is illustrated in FIG. 2 as a handheld messaging device, other embodiments may include different devices, such as video game systems and/or personal computers.

As shown in FIG. 2 , the message sending device 200 includes a housing 202 and a display 216 . In some embodiments, display 216 may comprise an LCD display. In other embodiments, display 216 may comprise a plasma display, or other types of displays known in the art. Display 216 is configured to receive a display signal and output an image associated with the display signal. In some embodiments, the display signal may include video graphics array (vga), high-definition multimedia interface (hdmi), advanced video graphics array (svga), video, two-component video (s-video), or known in the art Other types of display signals are known. In the embodiment shown in FIG. 2 , display 216 includes textured bulb 204 . Display 216 further includes texture selection icons 206, which include rock, sand, and water textures.

Referring also to FIG. 2 , the messaging device 200 further includes a manipulation mechanism 214 . In the embodiment shown in FIG. 2, the steering mechanism 214 includes a rolling ball and a button. Messaging device 200 also includes touch-sensitive interface 218 . In the embodiment shown in FIG. 2 , touch-sensitive interface 218 includes a touch screen positioned on top of display 216 . In some embodiments, the display 216 and touch screen may comprise a single integrated component, such as a touch screen display.

Manipulation mechanism 214 and touch-sensitive interface 218 are configured to detect user interaction and transmit interface signals corresponding to the user interaction to the processor. In some embodiments, the user interaction is associated with a graphical user interface shown on display 216 . In such an embodiment, the processor receives the interface signal and manipulates the graphical user interface based at least in part on the interface signal. For example, in the embodiment shown in FIG. 2 , a user may select one of texture selection icons 206 using manipulation mechanism 214 or touch-sensitive interface 218 . Once the user has selected a texture for textured bulb 204, its on-screen appearance can be changed to correspond to that texture. For example, if the user selects the sand texture icon, the processor may manipulate the display to give the textured ball 204 the appearance of a sand surface, and further determine what makes the user feel the sand texture when interacting with the textured ball 204. tactile effect. Alternatively, in another embodiment, if the user selects the rock texture icon, the processor may determine a haptic effect that causes the user to feel the rock texture when the user interacts with the textured ball 204 .

The messaging device 200 further includes an actuator (not shown in FIG. 2 ) configured to receive a haptic signal and output a haptic effect. In some embodiments, the haptic effect includes a vibrotactile texture felt by a user of the messaging device 200 . The processor 110 is configured to determine a haptic effect and transmit a haptic signal corresponding to the haptic effect to the actuator. In some embodiments, determining the haptic effect may include a series of calculations to determine the haptic effect. In other embodiments, determining a haptic effect may include accessing a lookup table to determine an appropriate haptic effect. In still other embodiments, determining the haptic effect may include using a combination of lookup tables and algorithms. Once processor 110 determines a haptic effect, it transmits a haptic signal associated with the haptic effect to the actuator. The actuators receive haptic signals from the processor 110 and generate haptic effects. A user may feel the haptic effect via the surface of display 216 or via some other portion of messaging device 200 (eg, via manipulation mechanism 214 or housing 202 ). In some embodiments, as the user moves his/her finger over the surface of the textured bulb 204, the processor may modify the haptic effect to mimic a change in texture.

Description of the system used for the texture engine

Figure 3a is a diagram of a system for a texture engine according to one embodiment of the present invention. Figure 3a includes a messaging device 300, such as a mobile phone, PDA, portable media player, portable gaming device, or mobile computer. The messaging device 300 is configured to send and receive signals including messages, such as voicemails, text messages, and other data messages, over a network, such as a cellular network or the Internet. The messaging device 300 may include a wireless network interface and/or a wired network interface (not shown in Figure 3a). Although device 300 is illustrated in Figure 3a as a handheld messaging device, other embodiments may include different devices, such as video game systems and/or personal computers.

As shown in FIG. 3 a , the messaging device 300 includes a display 316 . Display 316 is configured to receive a display signal and output an image based at least in part on the display signal. The messaging device 300 further includes a processor (not shown in FIG. 3 a ) configured to transmit display signals to the display 316 . Messaging device 300 further includes a touch-sensitive interface 314 mounted on top of a display 316 . Touch sensitive interface 314 is configured to detect user interaction and transmit interface signals corresponding to the user interaction to the processor. Display 316 includes two icons 302 and 304 . When a user interacts with one of icons 302 and 304, touch sensitive interface 314 will detect the user interaction and transmit a corresponding interface signal to the processor. Based on the interface signal, the processor may determine that the user has opened a file linked to one of the icons or performed some other action known in the art.

As shown in Figure 3a, each of the icons 302 and 304 includes a texture. In the illustrated embodiment, icon 302 includes a brick texture and icon 304 includes a rock texture. In other embodiments, a different texture may be used, such as a texture of sand, water, oil, grass, fur, skin, leather, ice, wood, or some other texture known in the art. As the user interacts with the portion of display 316 associated with each icon, as shown by finger 306 in Figure 3a, the processor will determine a haptic effect configured to mimic the texture of that icon. The processor then outputs a signal associated with the haptic effect to an actuator (not shown in Figure 3a) configured to output the haptic effect. For example, in the embodiment shown in FIG. 3a, when the user interacts with the portion of display 316 associated with icon 302, the processor will determine the haptic effect associated with the texture of the brick. This haptic effect may be characterized by a random signal punctuated by high power pulses as the user's finger 306 moves across the mortar. In other embodiments, other haptic effects will be used to mimic different textures that may correspond to the image shown on display 316 .

Figure 3b is a diagram of a system for a texture engine according to one embodiment of the present invention. In the embodiment shown in Figure 3b, determining the haptic effect includes mapping display signals to actuators. The embodiment shown in FIG. 3b includes a magnified portion of display 350 . Display 350 is configured to receive display signals from the processor. The display signal consists of pixels, each associated with a color and an intensity of that color. The display 350 receives the display signal, and outputs an image associated with the display signal. In the embodiment shown in FIG. 3 b , the enlarged portion of display 350 includes six pixels: 351 , 352 , 353 , 354 , 355 and 356 . Each pixel is associated with a color and the intensity of the color on a scale of 1-10. For example, pixel 355 is associated with a green color, and the color intensity is 3 out of 10. Thus, display 350 will output a green color at intensity 3 at the location of pixel 355 .

In the embodiment shown in FIG. 3b, the processor will determine the haptic effect based at least in part on display signals and interface signals received from a touch-sensitive interface mounted on top of display 350 (not shown in FIG. 3b ). . For example, in the embodiment shown in Figure 3b, the processor uses the display signal to associate or "map" a haptic effect to each pixel. For example, in the embodiment shown in Figure 3b, the processor may determine a different frequency haptic effect for each color. The processor may further correlate the intensity of the haptic effect at each pixel with the intensity of the color at each pixel. For example, the processor may determine that a pixel with a color intensity of 8 will also have a haptic intensity of 8. When the processor receives an interface signal associated with a user interaction on top of a pixel of the display, the processor will output a haptic signal associated with the pixel the user is interacting with. The haptic effect is configured to cause the user to feel a texture on the surface of the display.

For example, in the embodiment shown in Figure 3b, the processor may determine that blue pixels are associated with a tap haptic effect, red pixels are associated with a pulse vibration, and green pixels are associated with a click haptic effect. In such an embodiment, when the touch-sensitive interface detects that the user's finger has passed over pixel 351, the processor will determine a tap with an intensity of one. Then, when the user's finger moves over the pixel 352, the processor will determine a pulse vibration with an intensity of 5. And, when the user's finger continues to move on the display 350 to the pixel 353, the processor may determine a click effect with an intensity of 3.

These haptic effects are configured to cause the user to feel a texture on the surface of the display 350 as the user moves his/her finger on the surface of the display 350 . In some embodiments, the processor may be in communication with more than one actuator, and each color may be associated with its own actuator. In other embodiments, different combinations of colors, intensities, and haptic effects may be used to cause the user to perceive texture on the surface of the display.

FIG. 4 is a flowchart of a method for a texture engine, discussed with respect to the device shown in FIG. 1 , according to one embodiment of the present invention. As shown in FIG. 4 , the method 400 begins when the processor 110 receives a display signal including a plurality of pixels 402 . Display signals may include video graphics array (vga), high-definition multimedia interface (hdmi), advanced video graphics array (svga), video, two-component video (s-video), or other types of displays known in the art Signal. The display signal may include a graphical user interface or other image to be displayed by the messaging device to a user via display 116 .

Touch-sensitive interface 114 then transmits the interface signal to processor 110 , which receives interface signal 404 . In some embodiments, touch-sensitive interface 114 may include a touch screen or a touchpad. For example, in some embodiments, touch-sensitive interface 114 may include a touch screen mounted on top of a display configured to receive display signals and output images to a user. In other embodiments, the touch-sensitive interface may include buttons, switches, scroll wheels, scrolling balls, or some other type of physical device interface known in the art. In some embodiments, processor 110 is in communication with a single touch-sensitive interface 114 . In other embodiments, the processor 110 is in communication with a plurality of touch-sensitive interfaces 114, such as a touch screen and a scroll ball. Touch-sensitive interface 114 is configured to detect user interaction and transmit a signal to the processor based at least in part on the user interaction. In some embodiments, touch-sensitive interface 114 may be configured to detect various aspects of user interaction. For example, touch-sensitive interface 114 may detect the speed and pressure of user interaction and incorporate this information into the interface signal.

Next, processor 110 determines a haptic effect including texture 406 . The haptic effect may include a vibration that a user may feel by touching the surface of the sensitive interface or manipulation mechanism. In some embodiments, the vibration may cause the user to feel a texture on the surface of the touch-sensitive interface. For example, leather, snow, sand, ice, skin, or some other surface texture. In some embodiments, determining the haptic effect may include determining a series of calculations of the haptic effect. In other embodiments, determining the haptic effect may include accessing a lookup table to determine the appropriate haptic effect. In still other embodiments, determining the haptic effect may include a combination of lookup tables and algorithms.

In some embodiments, determining the haptic effect may include haptic mapping. In such embodiments, determining the haptic effect may include mapping the display signal to the actuator. For example, a display signal may include a plurality of pixels, each pixel being associated with a color. In such embodiments, determining the haptic effect may include assigning a haptic effect to each color. Then, the processor 110 will output a haptic signal including the haptic effect. In some embodiments, processor 110 may assign haptic effects to only some pixels in the display signal. For example, in such an embodiment, the haptic effect may only be associated with a portion of the display signal.

In some embodiments, processor 110 may determine the haptic effect based at least in part on a user interaction or trigger. In such an embodiment, processor 110 receives an interface signal from touch-sensitive interface 114 and determines a haptic effect based at least in part on the interface signal. For example, in some embodiments, processor 110 may determine different intensities of haptic effects based on interface signals received from touch-sensitive interface 114 . For example, if touch-sensitive interface 114 detects a high-pressure user interaction, processor 110 may determine a high-intensity haptic effect. In another embodiment, processor 110 may determine a low-intensity haptic effect if touch-sensitive interface 114 detects a low-pressure user interaction. In still other embodiments, processor 110 may determine a low-intensity haptic effect when touch-sensitive interface 114 detects a low-speed user interaction. Also, processor 110 may determine a high-intensity haptic effect when touch-sensitive interface 114 detects a high-velocity user interaction. In still other embodiments, processor 110 may determine that there is no haptic effect unless it receives an interface signal from touch-sensitive interface 114 that includes a user interaction.

Finally, processor 110 sends the haptic signal associated with the haptic effect to actuator 118 , which is configured to receive the haptic signal and output haptic effect 408 . Actuator 118 is configured to receive a haptic signal from processor 110 and generate a haptic effect. The actuator 118 may be, for example, a piezoelectric actuator, an electric motor, an electromagnetic actuator, a voice coil, a linear resonant actuator, a shape memory alloy, an electroactive polymer, a solenoid, an eccentric moment of inertia motor (ERM), or a Linear Resonant Actuator (LRA).

Figure 5a is an illustration of one of the textures that a texture engine can generate according to one embodiment of the present invention. The embodiment shown in Figure 5a comprises bricks. The texture of the brick is characterized by having a rough irregular texture from the brick, intervening in a sandy concave feel from the mortar. While the user's fingers are moving, the system for the texture engine can generate a rough irregular texture of bricks by driving an actuator such as an LRA, LPA or FPA with a medium random signal to a high maximum variance. In some embodiments, this variance can be adjusted for different roughnesses. In some embodiments, the transition from brick to mortar may be provided by a high duration pop created by the ERM. Additionally, if the mortar is thick enough, fine texture can be provided by driving the actuator with a lower amplitude signal with a higher variance than the actuator used to drive the texture of the output brick.

Figure 5b is an illustration of one of the textures that a texture engine can generate according to one embodiment of the invention. The embodiment shown in Figure 5b includes rock. The texture of the rock is characterized by a smooth surface that transitions intervene as the user moves from rock to rock. To output the texture of the rock, actuators such as FPAs are used to create low friction patches. Individual rocks can be provided by a non-virtual edge map of the displayed image, and when the touch-sensitive interface detects the user's motion, a high-amplitude haptic signal is output to an actuator, such as an LPA or ERM. For example, output a haptic effect whenever the touch-sensitive interface detects that the user's finger is transitioning from rock to rock.

Figure 5c is an illustration of one of the textures that a texture engine can generate according to one embodiment of the invention. The embodiment shown in Figure 5c includes sand or sandpaper. Sand is characterized by a rough, gritty feel and the sensation of building a pile of grains in front of the user's fingers. To output the rough, gritty texture of the sand, while the user's finger is moving, an actuator such as an LRA, LPA or FPA is driven by a random signal with a high maximum variance. In some embodiments, the processor may adjust the variance of the signal to create varying degrees of roughness. To create the sensation of sand accumulation, actuators such as FPA can be used. In such an embodiment, when the user moves their finger across the touchscreen, the processor will drive the actuator with a signal that starts at a low intensity and gradually increases as the user moves his/her finger in one direction. strengthen.

In another embodiment, the texture shown in Figure 5c may comprise sandpaper. Sandpaper is characterized by having a rough, gritty feel. To create a rough and gritty feel, the processor drives actuators, such as LRA, LPA or FPA, with random signals with high maximum variance. In some embodiments, this signal is only output when the user's finger is moving across the surface of the touch-sensitive interface. In some embodiments, the processor can adjust the variance of the signal to change the level of roughness.

Figure 5d is an illustration of one of the textures that a texture engine can generate according to one embodiment of the present invention. In the embodiment shown in Figure 5c, the texture comprises the texture of grass. Grass is characterized by a periodic light sensation that almost tickles the user's fingers. To create the feel of grass, the processor may drive an actuator, such as an FPA, with a signal configured to create low-friction patches of grass cover through patches. In some embodiments, when the user interface detects user interaction, the processor may provide individual blades of grass by having a non-virtual edge map of the displayed image and outputting a low amplitude signal to an actuator such as an LPA or ERM.

Figure 5e is an illustration of one of the textures that a texture engine can generate according to one embodiment of the present invention. In the embodiment shown in Figure 5e, the texture comprises the texture of a fabric. The fabric is characterized by a light smooth sensation. To create the textured feel of fabric, the processor may drive an actuator such as an LPA or LRA with a low amplitude high frequency signal as the user's finger is moved across the surface of the touch sensitive interface.

Figure 5f is an illustration of one of the textures that can be generated by a texture engine according to one embodiment of the present invention. In the embodiment shown in Figure 5f, the texture comprises a texture of water or molasses. Water is characterized by almost no sensation. However, the disturbing water can splash around and hit the user's fingers. To mimic the texture of water, the processor can drive actuators such as FPAs to reduce friction on the surface of the touch sensor interface. In order to mimic water splashes, the processor may output haptic signals only when the user is touching the screen. To mimic the texture of a more viscous fluid such as molasses or oil, the processor may drive an actuator with a signal configured to increase friction on the user's finger as the user's finger is moved across the surface of the touch-sensitive interface.

Figure 5g is an illustration of one of the textures that can be generated by a texture engine according to one embodiment of the present invention. In the embodiment shown in Figure 5g, the texture comprises the grain of leather. Leather is characterized by an overall smooth feel including the elevations and depressions of the surface of the leather. To create the textured feel of leather, the processor may drive an actuator, such as an FPA, with a signal configured to output a friction-reducing haptic effect when the user's finger is moved across the surface of the touch-sensitive interface. The processor can output cracks and bumps by driving the actuator with very short, low-amplitude haptic signals when the touch-sensitive interface detects that the user's finger is moving.

Figure 5g is an illustration of one of the textures that can be generated by a texture engine according to one embodiment of the present invention. In the embodiment shown in Figure 5e, the texture comprises the grain of wood. Wood can be characterized by an irregular, bumpy texture that intervenes through sharp transitions as the user moves from board to plank. To create an irregular, bumpy texture, the processor can drive an actuator such as an LRA, LPA, or FPA with a non-virtual edge map of the displayed image, and use very short low amplitude signal to drive the actuator. To output a transition from plank to plank, the processor may output a haptic signal configured to cause the actuator to generate a high amplitude short duration pop.

In other embodiments, haptic effects associated with different textures may be output. For example, in one embodiment, the processor may transmit a haptic signal configured to cause the actuator to output a haptic effect configured to cause the user to feel a texture associated with the texture of the ice. The ice is characterized by low friction, and in some embodiments, the ice has a completely smooth texture. In other embodiments, the ice includes a fine low amplitude sandy texture. To create the ice texture, the processor may determine a haptic signal configured to cause the actuator to reduce as much friction as possible when the user moves across the surface of the touch-sensitive interface. In another embodiment, the processor may drive an actuator such as an LPA or LRA with a haptic signal configured to output a low amplitude effect while the user moves their finger. These low magnitude effects may be associated with imperfections or grit on the surface of the ice.

In another embodiment, the processor may drive the actuator with a signal configured to cause the actuator to output a haptic effect that approximates the texture of lizard skin. Lizard skin is characterized by an overall smooth feel mediated by transitions from bump to bump on the skin. To achieve a haptic effect including the texture of lizard skin, the processor may drive the actuator with a haptic signal configured to cause the actuator to create a low-friction patch on the touch-sensitive interface. When the touch-sensitive interface detects that a user's finger is moving across its surface, the processor may provide cracks on the surface of the skin by periodically outputting a high-amplitude tactile signal. These high amplitude signals may be close to cracks in the surface of the skin.

In yet another embodiment, the processor may drive the actuator with a signal configured to cause the actuator to output a haptic effect that approximates the texture of the fur. The fur is characterized by a periodic light sensation that is very soft to the touch. To achieve the haptic effect including the texture of the fur, the processor may drive the actuator with a haptic signal configured to cause the actuator to output a haptic effect configured to reduce friction felt by the user on the surface of the touch-sensitive interface. When the touch-sensitive interface detects the user's motion, the processor may further provide individual hairs that output low-amplitude pulsed tactile signals.

In yet another embodiment, the processor may drive the actuator with a signal configured to cause the actuator to output a haptic effect that approximates the texture of the metal. Metals are characterized by a smooth low friction surface, which in some embodiments includes light grit. To achieve a textured haptic effect including metal, the processor may drive the actuator with a signal configured to reduce friction felt by the user on the surface of the touch-sensitive interface. In some embodiments, the processor may provide individual bumps by outputting a brief high-amplitude tactile signal when the touch-sensitive interface detects that the user is moving across its surface. These brief high-amplitude signals can be close to grit on the surface of the metal.

In still other embodiments, the processor may drive the actuator with a signal configured to cause the actuator to output a haptic effect proximate another sensation (eg, heat). In such an embodiment, when a user touches an element of the display associated with heat, the processor may output a haptic signal configured to cause the actuator to output a high frequency shaking effect.

Advantages of systems and methods for texture engines

There are various advantages of the systems and methods for texture engines. For example, the systems and methods of texture engines add previously unused haptic effects to mobile devices. This new effect provides a new way for the user to receive information from the mobile device without the user having to look at the display of the mobile device. For example, the systems and methods of a texture engine may allow users to assign different textures to different icons, buttons, or other components of their displays. Thus, the user is able to determine which icon they are touching without having to look at the icon. This can increase the usability of the device and can make the device more useful for the visually impaired.

Also, because the system and method for a texture engine provides more information to the user without distracting the user from other tasks, it will reduce user errors. For example, if a user utilizes the systems and methods for a texture engine, the user will be less likely to hit the wrong icon or press the wrong key. This functionality can be used to increase user satisfaction and increase adoption of technologies incorporating systems and methods for texture engines.

overall consideration

The use of "adapted" or "configured to" herein is meant to not preclude open and inclusive language adapted or configured to perform additional tasks or steps. Additionally, the use of "based on" is meant to be open-ended and inclusive, since a process, step, calculation, or other action "based on" one or more recited conditions or values may actually be based on additional conditions beyond those recited or value. Headings, listings and numbers are included here only for easier explanation and are not meant to be limiting.

Embodiments according to aspects of the present subject matter may be implemented in digital electronic circuitry, in computer hardware, firmware, software, or in a combination of the foregoing. In one embodiment, a computer may include one or more processors. The processor includes or has access to computer-readable media, such as random access memory (RAM), coupled to the processor. The processor executes computer-executable program instructions stored in the memory, such as executing one or more computer programs including sensor sampling routines, haptic effect selection routines, and suitable programming for generating signals to generate the selected haptic effects described above .

Such processors may include microprocessors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), and state machines. Such processors may further include programmable electronics such as PLCs, Programmable Interrupt Controllers (PICs), Programmable Logic Devices (PLDs), Programmable Read-Only Memory (PROM), Electrically Programmable Read-Only Memory (EPROM or EEPROM), or other similar devices.

Such a processor may include or be in communication with a medium (e.g., a tangible computer-readable medium) that may store instructions that, when executed by the processor, cause the processor to perform the A step of. Embodiments of computer readable media may include, but are not limited to, all electronic, optical, magnetic, or other storage devices capable of providing computer readable instructions to a processor, such as a processor in a network server. Other examples of media include, but are not limited to, floppy disks, CD-ROMs, magnetic disks, memory chips, ROM, RAM, ASICs, configured processors, all optical media, all tape or other magnetic media, or from which a computer processor can read any other medium. Also, various other devices may include computer readable media, such as routers, private or public networks, or other transmission devices. A processor and described processes may be in the form of, and interspersed by, one or more instructions. A processor may include code for performing one or more of the methods (or portions of a method) described herein.

While the subject matter has been described in detail with respect to specific embodiments thereof, it will be appreciated that alterations, changes and equivalents to such embodiments can readily be produced by those skilled in the art upon gaining the foregoing understanding. Accordingly, it should be understood that this disclosure is presented for purposes of illustration and not limitation, and does not preclude the inclusion of such modifications, changes and/or additions to the subject matter as will be readily apparent to those of ordinary skill in the art of.

Claims (19)

1. for a system for grain engine, including:

Processor, described processor is configured to:

Receive and include the display signal of multiple pixel, wherein, in the plurality of pixel each with Color is associated and each color includes the sense of touch value that is associated；

Determine the haptic effect including texture, wherein it is determined that described haptic effect include determining with The described sense of touch value that one or more pixels in the plurality of pixel are associated；And

Transmit the haptic signal being associated with described haptic effect；

Actuator, described actuator and described processor communication, described actuator is configured to connect Receive described haptic signal and export described haptic effect.

System the most according to claim 1, wherein, described texture is vibrating tactile effect.

System the most according to claim 1, wherein, described texture includes following texture: Sand, Eremiatis argi skin or fragment of brick.

System the most according to claim 1, wherein, described actuator includes one below: Eccentric rotary inertia motor, Linear Resonant Actuator, marmem, electroactive polymerization Thing or piezo-activator.

System the most according to claim 1, wherein, each color includes intensity, and Determine that described haptic effect farther includes: regulate described sense of touch value with corresponding to described intensity.

System the most according to claim 1, farther includes: communicate with described processor Display, described display is configured to receive described display signal and export image.

System the most according to claim 6, wherein, described texture is output to described aobvious Show on the surface of device.

System the most according to claim 6, wherein, described actuator coupled to described aobvious Show device.

System the most according to claim 1, farther includes: housing, described housing quilt It is configured to surround described actuator and described processor.

System the most according to claim 9, wherein, described housing includes mobile device Housing.

11. systems according to claim 9, wherein, described actuator coupled to described Housing.

12. systems according to claim 1, farther include: touch sensitive interface, Touch sensitive interface to be configured to detect user alternately, and be based at least partially on described user Alternately sensor signal is sent to described processor.

13. systems according to claim 12, wherein, described processor is joined further It is set to be based at least partially on described sensor signal to determine described haptic effect.

14. systems according to claim 13, wherein, described touch sensitive interface is joined It is set to detect the speed that described user is mutual, and wherein it is determined that described haptic effect includes: Regulate described haptic effect corresponding with the described speed mutual with described user.

15. systems according to claim 13, wherein, described touch sensitive interface is joined It is set to detect the pressure that described user is mutual, and wherein it is determined that described haptic effect includes: The intensity regulating described haptic effect is corresponding with the described pressure mutual with described user.

16. 1 kinds are used for the method exporting haptic effect, including:

Receive and include the display signal of multiple pixel, wherein, in the plurality of pixel each with Color is associated and each color includes the sense of touch value that is associated；

Determine the haptic effect including texture, wherein it is determined that described haptic effect include determining with The described sense of touch value that one or more pixels in the plurality of pixel are associated；And

The haptic signal being associated with described haptic effect is sent to actuator, described actuator It is configured to receive described haptic signal and export described haptic effect.

17. methods according to claim 16, wherein, each color includes intensity, and And determine that described haptic effect farther includes: regulate described sense of touch value with corresponding to described intensity.

18. methods according to claim 16, farther include: from touching sensitive interface Reception interface signal, and wherein, described haptic effect is based at least partially on described interface letter Number determine.

19. 1 kinds of systems for grain engine, including:

Touching sensitive interface, described touch sensitive interface is configured to detect user and alternately and passes The signal the most corresponding with described user, described touch sensitive interface is sent to be configured to detect institute State the mutual speed of user and pressure；

Processor, described processor communicates with described touch sensitive interface, and described processor is joined It is set to:

Receiving the display signal including multiple pixel, wherein, each pixel includes that be associated touches Feel value；

Determine the haptic effect including texture, wherein it is determined that described haptic effect include determining with The described sense of touch value that one or more pixels in the plurality of pixel are associated；And

Transmit the haptic signal being associated with described haptic effect；

Actuator, described actuator and described processor communication, described actuator is configured to connect Receive described haptic signal and export described haptic effect.