KR20180054897A - User interface object manipulations in a user interface - Google Patents

Abstract

Systems and processes for manipulating graphical user interfaces are disclosed. One process may include receiving user input through a crown for rotating a virtual object. The process includes selecting a surface of the object from among multiple surfaces of the object in response to determining whether crown rotation exceeds a speed threshold.

Description

USER INTERFACE OBJECT MANIPULATION IN A USER INTERFACE < RTI ID = 0.0 >

Cross reference of related application

This application is related to U.S. Provisional Patent Application No. 61 / 873,356, filed September 3, 2013, entitled " CROWN INPUT FOR WEARABLE ELECTRONIC DEVICE " U.S. Provisional Patent Application No. 61 / 873,359, filed September 3, 2013, entitled " USER INTERFACE OBJECT MANIPULATION IN A USER INTERFACE " U.S. Provisional Patent Application No. 61 / 959,851, filed September 3, 2013, entitled " USER INTERFACE FOR MANIPULATING USER INTERFACE OBJECTS " U.S. Provisional Patent Application Serial No. 61 / 952,753, filed September 3, 2013, entitled " USER INTERFACE FOR MANIPULATING USER INTERFACE OBJECTS WITH MAGNETIC PROPERTIES "873,360; And U.S. Patent Application Serial No. 14 / 476,657, filed September 3, 2014, entitled " User Interface for Manipulating User Interface Objects Using Magnetic Properties ". The contents of these applications are hereby expressly incorporated by reference herein in their entirety.

[0001] This application claims the benefit of U.S. Provisional Application, filed September 3, 2014, entitled " Crown Input for Wearable Electronic Device ", by the inventor Nicholas Zambetti et al .; Filed September 3, 2014, entitled " User Interface for Manipulating User Interface Objects ", and U.S. Patent Application Serial Number Nicholas Zambetti et al .; U.S. Patent Application Serial No. 14 / 476,657, filed September 3, 2014, entitled " User interface object manipulation in a user interface "; And U.S. Provisional Patent Application Serial No. 61 / 747,278, filed December 29, 2012, entitled " Device, Method, and Graphical User Interface for Manipulating User Interface Objects Using Visual and / or Haptic Feedback & ≪ / RTI > The contents of these applications are hereby expressly incorporated by reference herein in their entirety.

The present disclosure relates generally to user interfaces, and more specifically, to user interfaces that utilize crown input mechanisms.

Modern personal electronic devices can have a small form factor. Such personal electronic devices include, but are not limited to, tablets and smart phones. The use of such personal electronic devices entails manipulation of user interface objects on the display screen, the display screen also having a small form factor that complements the design of the personal electronic device.

Exemplary manipulations that a user may perform on a personal electronic device include hierarchical navigation, user interface object selection, adjustment of the position, size, and magnification of user interface objects, or other types of user interface manipulation. Exemplary user interface objects include digital images, video, text, icons, maps, control elements such as buttons, and other graphics. The user may perform such operations in image management software, video editing software, word processing software, software execution platforms such as operating system workspaces, web site browsing software, and other environments.

Conventional methods for manipulating user interface objects on a reduced-size touch-sensitive display may be inefficient. Also, existing methods are generally less precise than preferred.

Systems and processes for manipulating graphical user interfaces are disclosed. One process may include receiving user input through a crown to rotate a virtual object. The process includes selecting a surface of the object from among multiple surfaces of the object in response to determining whether crown rotation exceeds a speed threshold.

The present application is best understood with reference to the following description, which is set forth in the accompanying drawings, wherein like parts may be referred to by like numerals.
1 illustrates an exemplary wearable electronic device according to various examples.
Figure 2 shows a block diagram of an exemplary wearable electronic device according to various examples.
Figures 3 to 12 illustrate an exemplary graphical user interface representing the selection of the surface of a two-sided object in response to rotation of the crown.
Figure 13 illustrates an exemplary process for selecting the surface of a two-sided object in response to rotation of the crown.
Figs. 14-23 illustrate an exemplary graphical user interface representing selection of a surface of an object in response to rotation of a crown. Fig.
Figure 24 illustrates an exemplary process for selecting a surface of an object in response to rotation of a crown.
25 illustrates an exemplary multi-view object in a graphical user interface.
26 illustrates an exemplary computing system for manipulating a user interface in response to rotation of a crown in accordance with various examples.

In the following description of the disclosure and examples, reference is made to the accompanying drawings, in which specific examples that may be practiced are shown by way of example in the figures. It will be understood that other examples may be practiced and structural changes may be made without departing from the scope of the disclosure.

Many personal electronic devices have a graphical user interface with options that can be activated in response to user input. Typically, the user can select and activate specific options from among the various options. For example, a user can select an option by using a pointing device to place the mouse cursor over the desired option. The user can activate the option by clicking the button of the pointing device while the option is selected. In another example, a user may select or activate an option displayed on a touch sensitive display (also known as a touch screen) by touching the touch sensitive display at a location where the options are displayed. Considering the inefficiency of existing methods for selecting options on a reduced-size touch-sensitive display, there is a need for methods that allow users to more conveniently and conveniently select the desired option in a graphical user interface environment .

Examples below describe improved techniques for selecting a surface of a user interface object in a graphical user interface using user input. More specifically, these techniques use a physical crown as an input device that allows a user to select a desired option by selecting a surface of the user interface object. As a result, the examples described below allow the user to more efficiently and conveniently select the desired option.

FIG. 1 illustrates an exemplary personal electronic device 100. In the illustrated example, the device 100 is a watch that generally includes a body 102 and a wristband 104 for securing the device 100 to a user ' s body. That is, the device 100 is wearable. The body 102 may be designed to engage the wristbands 104. The device 100 may have a touch sensitive display screen (hereinafter referred to as a touch screen) 106 and a crown 108. The device 100 may also have buttons 110, 112, 114.

Conventionally, in the context of a clock, the term 'crown' refers to the cap on the stem to wind the watch's hand. In the context of personal electronic devices, a crown may be a physical component of an electronic device rather than a virtual crown on a touch sensitive display. The crown 108 may be a mechanical means that can be connected to a sensor for converting the physical movement of the crown into an electrical signal. The crown 108 may rotate in two directions of rotation (e.g., forward and backward). The crown 108 can also be pushed / pushed toward the body of the device 100 or pulled out of the device 100. The crown 108 may be touch sensitive, for example, using capacitive touch technology to detect whether the user is touching the crown. In addition, the crown 108 may further oscillate in one or more directions or translationally along a track along, or at least partially circumferentially around, the edge of the body 102. In some instances, more than one crown 108 may be used. The visual appearance of the crown 108 may dictate the crown of a conventional watch, but this is not necessary. When buttons 110, 112, and 114 are included, they may be physical or touch sensitive buttons, respectively. That is, the buttons may be, for example, physical buttons or capacitive buttons. In addition, the body 102, which may include a bezel, may have predetermined areas serving as buttons on the bezel.

The display 106 may include a display device such as a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, Is disposed on the front, partly or completely rear of the touch sensor panel, which is implemented using single capacitive touch sensing, resistive touch sensing, projection scan touch sensing, and the like. The display 106 allows the user to perform various functions by touching or wandering the touch sensor panel using one or more fingers or other objects.

In some instances, the device 100 may further include one or more pressure sensors (not shown) to detect the force or pressure exerted on the display. Using the force or pressure exerted on the display 106 as an input to the device 100, any desired action may be performed, such as selecting, entering or exiting a menu, displaying additional options / actions, and the like . In some instances, different operations may be performed based on the amount of force or pressure being applied to the display 106. One or more pressure sensors may additionally be used to determine the position at which force is being applied to the display 106.

2 shows a block diagram of some components of the device 100. As shown in FIG. As shown, the crown 108 can be connected to an encoder 204, which monitors the change in the physical state or state of the crown 108 (e.g., the position of the crown) and converts it to an electrical signal (E.g., converting it to an analog or digital signal representation of a change in position or position of the crown 108), and provide the signal to the processor 202. For example, in some instances, the encoder 204 senses the absolute rotational position of the crown 108 (e.g., angles of 0 to 360 degrees) and provides an analog or digital representation of the position to the processor 202 Output. Alternatively, in other instances, the encoder 204 may detect a change in the rotational position of the crown 108 (e.g., a change in rotational angle) during some sampling periods and provide an analog or digital representation of the sensed change to the processor 202, respectively. In these examples, the crown position information may also indicate the direction of rotation of the crown (e.g., the positive value may correspond to one direction and the negative value may correspond to the other direction). In other instances, the encoder 204 may be configured to detect rotation of the crown 108 in any desired manner (e.g., speed, acceleration, etc.) and may provide crown rotation information to the processor 202 . In alternative examples, instead of providing information to the processor 202, this information may be provided to other components of the device 100. Although the examples described herein refer to the use of the rotational position of the crown 108 to control scrolling, scaling, or object position, it will be appreciated that any other physical state of the crown 108 may be used.

In some instances, the physical state of the crown may control the physical properties of the display 106. For example, if crown 108 is in a particular position (e.g., rotated forward), display 106 may be limited in z-axis traversal capability. In other words, the physical state of the crown can indicate the functionality of the physical form of the display 106. In some instances, the temporal nature of the physical state of the crown 108 may be used as an input to the device 100. For example, a rapid change in a physical state can be interpreted differently from a slow change in a physical state.

The processor 202 may further be coupled to receive input signals from the buttons 110, 112, 114 in accordance with touch signals from the touch sensitive display 106. The button may be, for example, a physical button or a capacitive button. In addition, the body 102, which may include a bezel, may have predetermined areas serving as buttons on the bezel. The processor 202 may be configured to interpret these input signals and output appropriate display signals to produce an image by the touch sensitive display 106. Although a single processor 202 is shown, it will be appreciated that any number of processors or other computing devices may be used to perform the general functions discussed above.

Figures 3 to 12 illustrate an exemplary user interface 300 that displays user interface objects 302 on both sides. The object 302 has a first surface 304 and a second surface 306. Each surface of the object 302 is a selectable surface associated with the corresponding data. The data may be, for example, characters, images, application icons, commands, binary ON or OFF options, and the like. The user may select the surface from among the multiple selectable surfaces of the object 302 by rotating the object 302 using the physical crown of the wearable electronic device to align the desired selected surface so that the preferred selected surface is the device 100, To be displayed on the display 106. The display 106 of FIG. The system is designed to switch from one surface to another and not stop between the surfaces. The examples are described with respect to object surfaces (or planes) parallel to the display 106, but the examples can also be modified to be described relative to the object surfaces (or planes) that are instead opposed to the observers of the display 106. This modification may be particularly helpful when the object surface or display 106 is not a planar surface.

The crown 108 of the device 100 is a user-rotatable user interface input. The crown 108 can be rotated in two distinct directions: clockwise and counterclockwise. Figs. 3 to 12 include a rotation direction arrow indicating the direction of crown rotation and, if applicable, a movement direction arrow indicating the rotation direction of the user interface object. The direction of rotation arrows and the direction of movement arrows are not normally part of the displayed user interface, but are provided to aid in the interpretation of the drawings. In this example, the clockwise rotation of the crown 108 is indicated by the rotational direction arrows pointing upwards. Similarly, the counterclockwise rotation of the crown 108 is indicated by the rotational direction arrows pointing downward. The nature of the rotational direction arrows does not indicate the distance, speed, or acceleration at which the crown 108 is rotated by the user. Instead, the rotation direction arrow indicates the direction of rotation of the crown 108 by the user.

In Figure 3, the first surface 304 of the object 302 is aligned and displayed parallel to the display 106 to indicate the selection of the first surface 304. The selected first surface 304 may be activated, for example, via additional user input. In Fig. 4, the device 100 determines a change in the position of the crown 108 in a clockwise direction, as indicated by the rotational direction arrow 308. The device 100 determines the rotational speed and direction based on the change in the position of the determined crown 108. In response to determining a change in the position of the crown 108, the device rotates the object 302, which is indicated by the direction arrow 310 and shown in Fig. The rotation of the object 302 is based on the determined rotational speed and direction. The rotational speed can be expressed in several ways. For example, the rotational speed can be expressed in terms of hertz, rotation per unit time, rotation per frame, revolution per unit time, revolution per frame, change in angle per unit time, and the like. In one example, the object 302 may be associated with mass or may have a calculated rotational inertia.

In Figures 5-7, the device 100 continues to determine a change in the position of the crown 108 in a clockwise direction, as indicated by the rotational direction arrow 308. [ The device 100 determines the rotational speed and direction based on the change in the position of the determined crown 108. In response to determining a change in the position of the crown 108, the device continues to rotate the object 302, which is indicated by the direction arrow 310 and shown in Figures 5 and 6. The rotation of the object 302 is based on the determined rotational speed and direction.

In one example, the rotation angle of the object 302 is based on the determined speed, as measured from the position of the object when it is parallel to the display 106. By visualizing more easily, the object 302 can be considered to have some similar characteristics to an analog tachometer. As the determined speed increases, the rotational angle of the object 302 increases. In this example, when the rotation of the crown 108 is maintained at a constant speed, the object 302 will remain statically in a rotated position that is not parallel to the display 106. When the rotational speed of the crown 108 is increased, the determined speed will increase and the object 302 will rotate by an increment.

In some instances, the object 302 is configured to be perpendicular to the display 106 in response to the determined speed being a speed threshold. If the determined speed exceeds the speed threshold, the object 302 exceeds the total rotation of 90 degrees so that the first surface 304 of the object 302 is no longer displayed, but instead is displayed on the second surface of the object 302 306 are displayed. This transition between the representation of the first surface 304 and the representation of the second surface 306 is shown as a transition between Figures 7 and 8. [ Thus, as the determined speed exceeds the speed threshold, the object 302 is flipped from one side to the other.

In Figures 9-12, the device 100 determines that there is no further change in the location of the crown 108. [ As a result of this determination, the rotation of the object 302 is modified such that the surface of the object 302 is parallel to the display 106. This change can be animated, as shown in Figures 9-12. The device 100 rotates the object 302 so that when the device 100 determines that there is no change in the position of the crown 108 the surface of the object 302, To be the surface to be displayed. When the surface of the object 302 is parallel to the display 106 and no change in the position of the crown 108 is detected, the object 302 is in a steady state. When an object is not translated, rotated, or scaled, the object is in a steady state.

In some instances, when the object 302 is in a steady state, the display surface of the object 302 parallel to the display 106 may be activated using additional inputs. It is determined that the display surface parallel to the display 106 in the normal state is selected before activation. For example, the object 302 may be used as an ON / OFF switch or as a toggle. The first surface 304 is associated with an ON command and the second surface 306 is associated with an OFF command. The user may switch between the ON and OFF states by rotating the crown 108 beyond the speed threshold to cause the object 302 to flip to display the desired surface. It is determined that the desired surface is selected when the desired surface is displayed on the display 106, parallel to the display 106, and no change in the position of the crown 108 is detected.

While the surface is selected, the user may activate the selected surface using one or more of a number of techniques. For example, the user may press the touch sensitive display 106, press the touch sensitive display with a force greater than a predetermined threshold, press the button 112, or simply press the button 112 for a time So that it remains selected for a while. In another example, when the display surface is parallel to the display 106, the operation can be interpreted as the selection of the display surface and the activation of the data associated with the display surface.

Figure 13 illustrates an exemplary process for selecting a surface of a graphical user interface object on both sides in response to rotation of a crown. Process 1300 is performed on a wearable electronic device (e.g., device 100 of FIG. 1) having a physical crown. In some examples, the electronic device also includes a touch sensitive display. The process provides an effective technique for selecting surfaces of two-dimensional, two-dimensional objects.

At block 1302, the device causes the two-sided object to be displayed on the touch sensitive display of the wearable electronic device. In some examples, the object is two-dimensional. In other examples, the object is three-dimensional, but only two surfaces are selectable. The selectable surfaces of the object are each associated with a corresponding data value. The data may be, for example, characters, images, application icons, commands, binary ON or OFF options, and the like.

At block 1304, the device receives the crown location information. The crown position information can be received as a series of pulse signals, real values, integer values, and the like.

At block 1306, the device determines whether a change has occurred in the crown distance value. The crown distance value is based on the angular displacement of the physical crown of the wearable electronic device. The change in crown distance value indicates that the user provides input to the wearable electronic device, for example, by turning the physical crown. If the device determines that a change in crown distance value has not occurred, the system returns to block 1304 to continue receiving crown position information. If the device determines that a change in crown distance value has occurred, the system continues to block 1308, but the system may continue to receive crown position information.

At block 1308, the device determines the direction and crown speed. The crown speed is based on the rotational speed of the physical crown of the wearable electronic device. For example, the determined crown speed can be expressed in terms of hertz, rotation per unit time, rotation per frame, revolution per unit time, revolution per frame, and the like. The determined direction is based on the direction of rotation of the physical crown of the wearable electronic device. For example, the upper direction can be determined based on the clockwise rotation of the physical crown. Likewise, the downward direction can be determined based on the counterclockwise rotation of the physical crown. In other examples, the downward direction can be determined based on the clockwise rotation of the physical crown, and the up direction can be determined based on the counterclockwise rotation of the physical crown.

In block 1310, in response to determining a change in the crown distance value, the device causes an initial rotation of the two-sided object on the display. The amount of rotation is based on the determined crown speed. The direction of rotation is based on the determined direction. The rotation can be animated.

At block 1312, the device determines whether the determined crown speed exceeds the speed threshold. If the device determines that the determined crown speed exceeds the speed threshold, then the device continues to block 1314. [ For example, the speed threshold may be regarded as the escape speed (or escape speed). The escape velocity is the speed at which the sum of the kinetic energy of the object and the potential energy due to gravity is zero. If the device determines that the determined crown speed does not exceed the speed threshold, then the device transitions to block 1316.

In some instances, the minimum angular velocity of the crown rotation required to reach the escape velocity directly corresponds to the instantaneous angular velocity of the crown 108 (Fig. 1), which allows the user interface of the device 100, Is responding when it reaches a sufficient angular velocity. In some embodiments, the minimum angular velocity of the crown rotation required to reach the escape velocity is a calculated velocity that is not necessarily exactly the same, based on the moment (" current ") angular velocity of the crown 108. In these examples, the device 100 may maintain a calculated crown (angular) velocity V every discontinuous moment of time T according to equation 1:

[Formula 1]

V _T = V _(T-1) + ΔV _Crown - ΔV _Drag .

In equation 1, V _T denotes a crown velocity (speed and direction) calculated at time _{(T), V (T-} 1) denotes a previous velocity (speed and direction) at the time (T-1), ΔV _Crown Represents the change in velocity caused by the force applied through the rotation of the crown at time T, and? V _drag represents the change in velocity due to the drag force. The applied force is reflected through the DELTA V _crown and can vary depending on the current rotational speed of the crown. Therefore, the DELTA V _crown may also vary depending on the current angular velocity of the crown. In this way, the device 100 is not only based on instantaneous crown speed, but also provides user interface interaction based on user input as a form of crown movement over a number of time intervals, even when the intervals are finely divided . Typically, if there is no user input in the form of a ΔV _crown , V _T will approach 0 (and become 0) based on the ΔV _drag in accordance with Equation 1, but the user input in the form of crown rotation (ΔV _crown ) Note that V _T may not change the signal if not present.

Normally, the larger the speed of each rotation of the crown, the larger the value of the? V _crown . However, the actual mapping between the speed of each rotation of the _crown and the? V _crown may vary depending on the desired user interface effect. For example, various linear or non-linear mappings between the speed of each rotation of the _crown and the? V _crown may be used.

Further, the? V _drag can take various values. For example, the DELTA V _drag may vary depending on the speed of the crown rotation, so that at a larger speed, an opposite change of the larger speed (DELTA V _drag ) can be generated. In another example, the DELTA V _drag may have a constant value. It will be appreciated that the requirements of the [Delta] V _crown and [Delta] V _dragging described above may be modified to produce desirable user interface effects.

As can be seen in Equation 1, if the? V _crown is larger than the? V _drag , the sustained speed (V _T ) can continue to increase. In addition, V _T may have a non-zero value even when a DELTA V _crown input is not received, which means that user interface objects may continue to change even if the user does not rotate the crown. If this occurs, the objects can stop changing when the user stops rotating the crown and DELTA V _drag components based on the speed at which they are held.

In some instances, if the crown rotates in a direction corresponding to the opposite direction of rotation in which the current user interface is being changed, the V _(T-1) component is reset to a value of 0 so that the user has sufficient force to offset V _T So that the direction of the object can be quickly changed without providing it.

At block 1314, the device causes the object to be inverted past the transition position between the first and second surfaces that were last selected. For example, if the object is flipped past the switch position, it will not return so that the first surface is displayed parallel to the display without receiving further user input. In the example of a double-sided object, the transition position will be when the surface is perpendicular to the display.

When the object reaches a steady state, the display plane parallel to the display can be activated by the designated user input. In the steady state, the display surface parallel to the display is determined to be selected before activation. When an object is not translated, rotated, or scaled, the object is in a steady state. As a result, in the case of a cube shaped object, the first surface of the object may no longer be displayed.

At block 1316, because the escape velocity has not been reached, the device causes the object to return to the initial position of the object when at least partially in block 1302. For example, some of the initial rotation of the object caused in block 2410 may be invalidated. To achieve this, the device animates the rotation of the object in the opposite direction of the initial rotation at block 1310. [

Figs. 14-23 illustrate an exemplary graphical user interface illustrating the selection of the surface of a cube object in response to rotation of the crown. Fig. The object 1402 is a cube having six surfaces. In this example, four of the six surfaces are selectable. These four selectable surfaces include the surface 1404 of the object 1402 facing the viewer of the display 106, the top surface of the object 1402, the bottom surface of the object 1402, and the back surface of the object 1402 do. In this example, the left and right sides of the object 1402 are not selectable. However, in other examples, the left and right sides of the object 1402 may be selectable. Although examples are described with respect to an object surface (or planes) parallel to the display 106, examples may also be altered to be described relative to an object surface (or planes) that is also opposite the observer of the display 106. [ This change can be particularly helpful when the object surface or display 106 is not a planar surface.

Each selectable surface of object 1402 is associated with corresponding data. The data may be, for example, characters, images, application icons, commands, quad-state settings (e.g., Off / Low / Medium / High) The user selects a surface from among the multiple selectable surfaces of the object 1402 by rotating the object 1402 using the physical crown of the wearable electronic device to align the desired selected surface so that a preferred selected surface is displayed on the display 106. [ And is displayed on the display 106. [0064]

The crown 108 of the device 100 is a user rotatable user interface input. The crown 108 can be rotated in two distinct directions: clockwise and counterclockwise. Figs. 14 to 23 include a rotation direction arrow indicating the direction of crown rotation and, if applicable, a movement direction arrow indicating the rotation direction of the user interface object. The direction of rotation arrows and the direction of movement arrows are not normally part of the displayed user interface, but are provided to aid in the interpretation of the drawings. In this example, the clockwise rotation of the crown 108 is indicated by the rotational direction arrows pointing upwards. Similarly, the counterclockwise rotation of the crown 108 is indicated by the rotational direction arrows pointing downward. The nature of the rotational direction arrows does not indicate the distance, speed, or acceleration at which the crown 108 is rotated by the user. Instead, the rotation direction arrow indicates the direction of rotation of the crown 108 by the user.

In Figure 14, the first surface 1404 of the object 1402 is aligned and displayed parallel to the display 106 to indicate the selection of the first surface 1404. In Fig. 15, the device 100 determines a change in the position of the crown 108 in a counterclockwise direction, as indicated by the direction of rotation arrow 1502. The device 100 determines the rotational speed and direction based on the change in the position of the determined crown 108. In response to determining to change the position of the crown 108, the device rotates the object 1402, which is indicated by the direction of movement arrow 1504 and as shown in Fig. The rotation of the object 1402 is based on the determined rotational speed and direction. The rotational speed can be expressed in several ways. For example, the rotational speed can be expressed in hertz, rotation per unit time, rotation per frame, revolution per unit time, revolution per frame, and the like. In one example, the object 1402 may be associated with a mass or may have a calculated rotational inertia.

In Fig. 16, the device 100 continues to change the position of the crown 108 in a counterclockwise direction, as indicated by the rotation direction arrow 1502. The device 100 determines the rotational speed and direction based on the change in the position of the determined crown 108. In response to determining a change in the position of the crown 108, the device continues to rotate the object 1402, which is indicated by the direction arrow 1504 of movement and as shown in Fig. The rotation of the object 1402 is based on the determined rotational speed and direction.

In one example, the angle of rotation of the object 1402 is based on the determined speed. As the determined speed increases, the rotation angle of the object 1402 increases. In this example, when the rotation of the crown 108 is maintained at a constant speed, the object 1402 will remain statically in a rotated position, where the surface of the object 1402 is not parallel to the display 106. [ When the rotational speed of the crown 108 is increased, the determined speed will increase and the object 1402 will rotate by an additional amount.

In some instances, the object 1402 is configured to rotate to have a parallel surface to the display 106 in response to the determined speed being above the speed threshold. If the determined speed exceeds the speed threshold, the object 1402 exceeds the rotation of 45 degrees so that the first surface 1404 of the object 1402 rotates away from the display and is no longer displayed, To be rotated toward the display. This transition between the display of the first surface 1404 and the display of the second surface 1406 is shown as a switch between Figs. 16 and 17. Thus, as the determined speed exceeds the speed threshold, the object 1402 is flipped from one surface to another.

17 and 18, the device 100 determines that there is no change in the position of the crown 108. As a result of this determination, the object 1402 is rotated so that the display surface of the object 1402 is parallel to the display 106. This rotation can be animated, as shown in FIGS. 17 and 18. FIG. The device 100 will rotate the object 1402 so that the display surface of the object 1402 with the smallest angle to the display is parallel to the display 106. [ In other words, the surface of the object that best opposes or is closest to the display 106 is parallel to the display 106. When the surface of the object 1402 is parallel to the display 106 and no change in the position of the crown 108 is detected, the object 1402 is in a steady state. When an object is not translated, rotated, or scaled, the object is in a steady state.

In some instances, it is determined that when the object 1402 is in a steady state, the surface of the object 1402 that is parallel to the display 106 and that is displayed on the display 106 is selected. For example, the object 1402 may be used as a four state selection switch. The first surface 1404 is associated with a LOW setting command and the second surface 1406 is associated with a MEDIUM instruction set. The remaining two selectable surfaces are associated with the HIGH and OFF command settings. The user may switch between the four settings by rotating the crown 108 beyond the speed threshold to cause the object 1402 to flip over to display the desired surface. When the displayed surface is parallel to the display 106 and no change in the position of the crown 108 is detected, it is determined that the desired surface is selected.

While the surface is selected, the user may activate the selected surface using one or more of a number of techniques. For example, the user may press the touch sensitive display 106, press the button 112, or simply allow the surface to remain selected for a predetermined length of time. In another example, when the display surface is parallel to the display 106, the operation can be interpreted as the selection of the display surface and the activation of the data associated with the display surface.

Figs. 20-23 illustrate a second flip of an object 1402 for selecting a third surface 2002 of an object 1402. Fig. In Figures 21 and 22, the device 100 determines a change in the position of the crown 108 in a counterclockwise direction, as indicated by the direction of rotation arrow 1502. The device 100 determines the rotational speed and direction based on the change in the position of the determined crown 108. In response to determining a change in the position of the crown 108, the device rotates the object 1402, which is indicated by the direction of movement arrow 1504 and as shown in Figs. The rotation of the object 1402 is based on the determined rotational speed and direction.

In response to the rotational speed exceeding the threshold, the object 1402 is turned upside down so that the third surface 2002 is parallel to the display 106 and is displayed on the display 106, as shown in Fig. When an object is not translated, rotated, or scaled, the object is in a steady state. When the object 1402 is in a steady state, it is determined that the surface of the object 1402 that is parallel to the display 106 and displayed on the display 106 is selected. In this example, the third surface 2002 is selected.

Figure 24 illustrates an exemplary process for selecting a surface of a multi-faceted graphical user interface object in response to rotation of a crown. Process 2400 is performed on a wearable electronic device (e. G., Device 100 of FIG. 1) having a physical crown. In some examples, the electronic device also includes a touch sensitive display. The process provides an effective technique for selecting the surface of a multi-dimensional, three-dimensional object.

At block 2402, the device causes the multisided object to be displayed on the touch sensitive display of the wearable electronic device. The selectable surfaces of the object are each associated with a corresponding data value. The data may be, for example, letters, images, application icons, commands, and the like.

At block 2404, the device receives the crown location information. The crown position information can be received as a series of pulse signals, real values, integer values, and the like.

At block 2406, the device determines whether a change has occurred in the crown distance value. The crown distance value is based on the angular displacement of the physical crown of the wearable electronic device. The change in crown distance value indicates that the user provides input to the wearable electronic device, for example, by turning the physical crown. If the device determines that a change in crown distance value has not occurred, the system returns to block 2404 to continue receiving crown position information. If the device determines that a change in crown distance value has occurred, the system continues to block 2408, but the system may continue to receive crown position information.

At block 2408, the device determines the direction and crown speed. The crown speed is based on the rotational speed of the physical crown of the wearable electronic device. For example, the determined crown speed can be expressed in terms of hertz, rotation per unit time, rotation per frame, revolution per unit time, revolution per frame, and the like. The determined direction is based on the direction of rotation of the physical crown of the wearable electronic device. For example, the upper direction can be determined based on the clockwise rotation of the physical crown. Likewise, the downward direction can be determined based on the counterclockwise rotation of the physical crown. In other examples, the downward direction can be determined based on the clockwise rotation of the physical crown, and the up direction can be determined based on the counterclockwise rotation of the physical crown.

In block 2410, in response to determining a change in the crown distance value, the device causes an initial rotation of the multisided object on the display. The amount of rotation is based on the determined crown speed. The direction of rotation is based on the determined direction. The rotation can be animated.

At block 2412, the device determines whether the determined crown speed exceeds the speed threshold. If the device determines that the determined crown speed exceeds the speed threshold, the device continues to block 2414. For example, the speed threshold may be regarded as the escape speed (or escape speed). The escape velocity is the speed at which the sum of the kinetic energy of the object and the potential energy due to gravity is zero. If the device determines that the determined speed does not exceed the speed threshold, the device continues to block 2416.

In some instances, the minimum angular velocity of the crown rotation required to reach the escape velocity directly corresponds to the instantaneous angular velocity of the crown 108 (Fig. 1), which allows the user interface of the device 100, Is responding when it reaches a sufficient angular velocity. In some embodiments, the minimum angular velocity of the crown rotation required to reach the escape velocity is a calculated velocity that is not necessarily exactly the same, based on the moment (" current ") angular velocity of the crown 108. In these examples, the device 100 may maintain a calculated crown (angular) velocity V every discontinuous moment of time T according to equation 1:

[Formula 1]

V _T = V _(T-1) + ΔV _Crown - ΔV _Drag .

In equation 1, V _T denotes a crown velocity (speed and direction) calculated at time _{(T), V (T-} 1) denotes a previous velocity (speed and direction) at the time (T-1), ΔV _Crown Represents the change in velocity caused by the force applied through the rotation of the crown at time T, and? V _drag represents the change in velocity due to the drag force. The applied force is reflected through the DELTA V _crown and can vary depending on the current rotational speed of the crown. Therefore, the DELTA V _crown may also vary depending on the current angular velocity of the crown. In this way, the device 100 is not only based on instantaneous crown speed, but also provides user interface interaction based on user input as a form of crown movement over a number of time intervals, even when the intervals are finely divided . Typically, if there is no user input in the form of a ΔV _crown , V _T will approach 0 (and become 0) based on the ΔV _drag in accordance with Equation 1, but the user input in the form of crown rotation (ΔV _crown ) Note that V _T may not change the signal if not present.

Normally, the larger the speed of each rotation of the crown, the larger the value of the? V _crown . However, the actual mapping between the speed of each rotation of the _crown and the? V _crown may vary depending on the desired user interface effect. For example, various linear or non-linear mappings between the speed of each rotation of the _crown and the? V _crown may be used.

Further, the? V _drag can take various values. For example, the DELTA V _drag may vary depending on the speed of the crown rotation, so that at a larger speed, an opposite change of the larger speed (DELTA V _drag ) can be generated. In another example, the DELTA V _drag may have a constant value. It will be appreciated that the requirements of the [Delta] V _crown and [Delta] V _dragging described above may be modified to produce desirable user interface effects.

As can be seen in Equation 1, if the? V _crown is larger than the? V _drag , the sustained speed (V _T ) can continue to increase. In addition, V _T may have a non-zero value even when a DELTA V _crown input is not received, which means that user interface objects may continue to change even if the user does not rotate the crown. If this occurs, the objects can stop changing when the user stops rotating the crown and DELTA V _drag components based on the speed at which they are held.

In some instances, if the crown rotates in a direction corresponding to the opposite direction of rotation in which the current user interface is being changed, the V _(T-1) component is reset to a value of 0 so that the user has sufficient force to offset V _T So that the direction of the object can be quickly changed without providing it.

At block 2414, the device causes the object to flip past the transition position between the first surface that was last selected and the new surface. For example, if the object is flipped past the switch position, it will not return so that the first surface is displayed parallel to the display without receiving further user input.

When the object reaches a steady state, the display plane parallel to the display can be activated through the designated user input. In the steady state, the display surface parallel to the display is determined to be selected before activation. When an object is not translated, rotated, or scaled, the object is in a steady state. As a result, in the case of a cube shaped object, the first surface of the object may no longer be displayed.

At block 2416, because the escape velocity has not been reached, the device causes the object to return to the initial position of the object at least partially when it is in block 2408. For example, some of the initial rotation of the object caused in block 2410 may be invalidated. To achieve this, the device animates the rotation of the object in the opposite direction of the initial rotation at block 2410.

Figure 25 shows a graphical user interface 2500 that represents the selection of the surface 2506 of a multi-faceted object in response to rotation of the crown. The object 2502 is a twelve-sided rotatable object with a shape similar to a wheel. The object 2502 is rotatable along a fixed axis. In this example, all 12 surfaces of object 2502 are selectable. These twelve selectable surfaces include surface 2504, surface 2506, surface 2508, surface 2510, and surface 2512. In Figure 25, surface 2508 is selected because surface 2508 is parallel to display 106 and is displayed on display 106. Selectable surfaces of the object 2505 may be selected according to the processes and techniques described in other examples.

In some instances, the device 100 may provide haptic feedback based on the content displayed on the display 106. When the user interface object is displayed on the display 106, the device may change the appearance of the object based on a change in the crown distance value received at the device 100 based on the rotation of the crown 108. [ If the criterion is met, a haptic output is output from device 100.

In one example, the object is, for example, the rotatable multisurface object described above. When the surface of the polygon object is selected, the criteria is met. In another example, the criterion is met whenever the display surface of the polyhedral object passes a plane parallel to the display.

One or more of the functions related to the user interface may be performed by a system similar or identical to the system 2600 shown in Fig. The system 2600 may include instructions stored on a non-volatile computer-readable storage medium, e.g., memory 2604 or storage device 2602, and executed by the processor 2606. [ The instructions may also be executed by or in connection with an instruction execution system, device, or device, such as a computer-based system, processor-embedded system, or other system capable of fetching instructions and executing instructions from the instruction execution system, device, May be stored in any non-volatile computer readable storage medium. In the context of this specification, " non-volatile computer readable storage medium " may be any non-volatile medium that can contain or store a program to be used by or in connection with an instruction execution system, apparatus, or device. Non-volatile computer-readable storage media include, but are not limited to, electronic, magnetic, optical or semiconductor systems, devices or devices, portable computer diskettes (magnetic), random access memory (RAM), read only memory A flash memory such as a compact flash card, a secure digital card, a USB memory device, a memory stick, or the like, such as a CD-ROM, a CD-R, an EPROM Memory, and the like, but are not limited thereto.

The instructions may also be executed by or in connection with an instruction execution system, device, or device, such as a computer-based system, processor-embedded system, or other system capable of fetching instructions and executing instructions from the instruction execution system, device, And may be delivered in any transmission medium. In the context of this document, " transmission medium " may be any medium capable of communicating, communicating, or transmitting a program for use by or in connection with an instruction execution system, apparatus, or device. Transmission media may include, but are not limited to, electronic, magnetic, optical, electromagnetic or infrared wired or wireless transmission media.

In some instances, the system 2600 may be included within the device 100. In these examples, the processor 2606 may be the same or a different process than the processor 202. Processor 2606 may be configured to receive output from encoder 204, buttons 110,112, 114, and touch sensitive display 106. [ Processor 2606 may process these inputs for those processes described and illustrated, as described above. It will be appreciated that the system is not limited to the components and configurations of FIG. 26 and may include other or additional components in multiple configurations according to various examples.

Although the disclosure and examples have been described fully with reference to the accompanying drawings, it should be noted that various changes and modifications will be apparent to those of ordinary skill in the art. Such changes and modifications are to be understood as included within the scope of the disclosure and examples as defined by the appended claims.

Claims (1)

The apparatus of claim 1,

Images