CN108008902B - Virtual keyboard adjusting method and device and playing method and device - Google Patents
Virtual keyboard adjusting method and device and playing method and device Download PDFInfo
- Publication number
- CN108008902B CN108008902B CN201610971916.0A CN201610971916A CN108008902B CN 108008902 B CN108008902 B CN 108008902B CN 201610971916 A CN201610971916 A CN 201610971916A CN 108008902 B CN108008902 B CN 108008902B
- Authority
- CN
- China
- Prior art keywords
- display area
- pressure value
- virtual keyboard
- touch operation
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Input From Keyboards Or The Like (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention provides a virtual keyboard adjusting method and device and a playing method and device, wherein the virtual keyboard adjusting method comprises the following steps: when touch operation of a user on a virtual keyboard of a mobile terminal is received, acquiring a pressure value of the touch operation; determining a target display area of the virtual keyboard according to the pressure value; the virtual keyboard is displayed in the target display area, so that the display area of the virtual keyboard is dynamically adjusted according to the pressure value of touch operation of a user, the problem that the adjustment of the display area of the virtual keyboard in the prior art can only be carried out before input is executed is solved, the virtual keyboard of the mobile terminal can change in real time along with the input of the user, and the interest of the user in the input process is increased.
Description
Technical Field
The present invention relates to the field of input methods, and in particular, to a method and an apparatus for adjusting a virtual keyboard, a playing method, and a playing apparatus.
Background
Many electronic devices such as portable palmtop computers, personal digital assistants, smart phones and the like which are used at present adopt touch screen input, namely a virtual keyboard is simulated on a touch screen of the electronic device, the virtual keyboard generally comprises a plurality of virtual keys, and a user can trigger the virtual keys of the virtual keyboard to input in a finger mode or a stylus mode and the like.
Generally, the user can adjust the display area of the virtual keyboard through a setting function provided by an input method, for example, the display area of the virtual keyboard is adjusted to be larger or smaller according to the use habit of the user. However, the adjustment of the virtual keyboard can only be set by the user in advance, and cannot be adjusted in real time during the input process of the user, and the method can only adjust the entire display area of the virtual keyboard, and cannot change the display area of the single virtual key.
Disclosure of Invention
In view of the above problems, embodiments of the present invention are proposed to provide an adjusting method of a virtual keyboard, an adjusting apparatus of a virtual keyboard, a playing method and a playing apparatus that overcome or at least partially solve the above problems.
In order to solve the above problem, an embodiment of the present invention discloses a method for adjusting a virtual keyboard, including:
when touch operation of a user on a virtual keyboard of a mobile terminal is received, acquiring a pressure value of the touch operation;
determining a target display area of the virtual keyboard according to the pressure value;
and displaying the virtual keyboard in the target display area.
Optionally, the virtual keyboard includes a plurality of virtual keys, and the step of obtaining, when receiving a touch operation of a user on the virtual keyboard of the mobile terminal, a pressure value of the touch operation includes:
when receiving a touch operation of a user on any virtual key of the mobile terminal, acquiring a pressure value of the current touch operation.
Optionally, the step of determining the target display area of the virtual keyboard according to the pressure value includes:
when the pressure value belongs to a first pressure range, determining that the target display area of the current virtual key is a preset first display area;
and when the pressure value belongs to a second pressure range, determining that the target display area of the current virtual key is a preset second display area.
Optionally, the current virtual key has an initial display area, and the initial display area has a corresponding central point;
the first display area is generated by the following steps:
adjusting the initial display area according to a preset first proportion by taking the central point as a center to obtain a first display area;
the second display area is generated by the following steps:
and adjusting the initial display area according to a preset second proportion by taking the central point as a center to obtain the second display area.
Optionally, the step of presenting the virtual keyboard in the target display area includes:
and displaying the current virtual key in the target display area.
Optionally, the step of determining the target display area of the virtual keyboard according to the pressure value includes:
when the pressure value belongs to a first pressure range, determining that a target display area of the virtual keyboard is a preset third display area;
and when the pressure value belongs to a second pressure range, determining that the target display area of the virtual keyboard is a preset fourth display area.
Optionally, the virtual keyboard has an initial display area with a corresponding display height;
the third display area is generated by the following steps:
adjusting the initial display area according to a preset first distance to obtain a third display area;
the fourth display area is generated by:
and adjusting the initial display area according to a preset second distance to obtain the fourth display area.
In order to solve the above problem, an embodiment of the present invention further discloses a playing method, including:
when touch operation of a user on a virtual keyboard of a mobile terminal is received, acquiring a pressure value of the touch operation;
extracting audio data corresponding to the pressure value;
and playing corresponding sound by adopting the audio data.
Optionally, the virtual keyboard includes a plurality of virtual keys, and the step of obtaining, when receiving a touch operation of a user on the virtual keyboard of the mobile terminal, a pressure value of the touch operation includes:
when receiving a touch operation of a user on any virtual key of the mobile terminal, acquiring a pressure value of the current touch operation.
Optionally, the plurality of virtual keys respectively have different preset audio data, and the step of extracting the audio data corresponding to the pressure value includes:
when the pressure value belongs to a first pressure range, determining a first volume value corresponding to the first pressure range, and generating first audio data according to the first volume value and the preset audio data of the current virtual key;
and when the pressure value belongs to a second pressure range, determining a second volume value corresponding to the second pressure range, and generating second audio data according to the second volume value and the preset audio data of the current virtual key.
In order to solve the above problem, an embodiment of the present invention further discloses an adjusting device for a virtual keyboard, including:
the mobile terminal comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring a pressure value of a touch operation when the touch operation of a user on a virtual keyboard of the mobile terminal is received;
the determining module is used for determining a target display area of the virtual keyboard according to the pressure value;
and the display module is used for displaying the virtual keyboard in the target display area.
Optionally, the virtual keyboard includes a plurality of virtual keys, and the first obtaining module includes:
the first obtaining submodule is used for obtaining a current pressure value of touch operation when touch operation of a user on any virtual key of the mobile terminal is received.
Optionally, the determining module includes:
the first display area determining submodule is used for determining that the target display area of the current virtual key is a preset first display area when the pressure value belongs to a first pressure range;
and the second display area determining submodule is used for determining the target display area of the current virtual key as a preset second display area when the pressure value belongs to a second pressure range.
Optionally, the current virtual key has an initial display area, and the initial display area has a corresponding central point;
the first display area is generated by calling the following sub-modules:
the first generation submodule is used for adjusting the initial display area according to a preset first proportion by taking the central point as a center to obtain the first display area;
the second display area is generated by calling the following sub-modules:
and the second generation submodule is used for adjusting the initial display area according to a preset second proportion by taking the central point as a center to obtain the second display area.
Optionally, the presentation module comprises:
and the display sub-module is used for displaying the current virtual key in the target display area.
Optionally, the determining module includes:
a third display area determination submodule, configured to determine that a target display area of the virtual keyboard is a preset third display area when the pressure value belongs to the first pressure range;
and the fourth display area determining submodule is used for determining the target display area of the virtual keyboard as a preset fourth display area when the pressure value belongs to the second pressure range.
Optionally, the virtual keyboard has an initial display area with a corresponding display height;
the third display area is generated by calling the following sub-modules:
the third generation submodule is used for adjusting the initial display area according to a preset first distance to obtain a third display area;
the fourth display area is generated by calling the following sub-modules:
and the fourth generation submodule is used for adjusting the initial display area according to a preset second distance to obtain the fourth display area.
In order to solve the above problem, an embodiment of the present invention further discloses a playing device, including:
the second acquisition module is used for acquiring the pressure value of the touch operation when the touch operation of a user on a virtual keyboard of the mobile terminal is received;
the extraction module is used for extracting the audio data corresponding to the pressure value;
and the playing module is used for playing corresponding sound by adopting the audio data.
Optionally, the virtual keyboard includes a plurality of virtual keys, and the second obtaining module includes:
and the second obtaining submodule is used for obtaining the current pressure value of the touch operation when the click operation of the user on any virtual key of the mobile terminal is received.
Optionally, the plurality of virtual keys have different preset audio data, respectively, and the extracting module includes:
the first audio data generation submodule is used for determining a first volume value corresponding to a first pressure range when the pressure value belongs to the first pressure range, and generating first audio data according to the first volume value and the preset audio data of the current virtual key;
and the second audio data generation submodule is used for determining a second volume value corresponding to a second pressure range when the pressure value belongs to the second pressure range, and generating second audio data according to the second volume value and the preset audio data of the current virtual key.
In order to solve the above problem, an embodiment of the present invention further discloses an adjusting apparatus for a virtual keyboard, including a memory, and one or more programs, where the one or more programs are stored in the memory, and the one or more programs configured to be executed by the one or more processors include instructions for:
when touch operation of a user on a virtual keyboard of a mobile terminal is received, acquiring a pressure value of the touch operation;
determining a target display area of the virtual keyboard according to the pressure value;
and displaying the virtual keyboard in the target display area.
In order to solve the above problem, an embodiment of the present invention further discloses a playback apparatus, including a memory and one or more programs, where the one or more programs are stored in the memory, and configured to be executed by one or more processors, and the one or more programs include instructions for:
when touch operation of a user on a virtual keyboard of a mobile terminal is received, acquiring a pressure value of the touch operation;
extracting audio data corresponding to the pressure value;
and playing corresponding sound by adopting the audio data.
Compared with the background art, the embodiment of the invention has the following advantages:
according to the embodiment of the invention, when the touch operation of the user on the virtual keyboard of the mobile terminal is received, the pressure value of the touch operation can be obtained, the target display area of the virtual keyboard is determined according to the pressure value, and the virtual keyboard is displayed in the target display area, so that the display area of the virtual keyboard is dynamically adjusted according to the pressure value of the touch operation of the user, the problem that the adjustment of the display area of the virtual keyboard can only be carried out before the input is executed in the prior art is solved, the virtual keyboard of the mobile terminal can change in real time along with the input of the user, and the interest of the user in the input process is increased.
Secondly, according to the obtained pressure value of the touch operation, audio data corresponding to the pressure value can be extracted, corresponding sound is played by adopting the audio data, and due to the fact that specific audio data are preset for each virtual key, when a user continuously presses different virtual keys, continuously played music can be formed, so that the auditory sense of actually knocking a musical instrument or an object can be simulated, the audio-visual sense of the user in the input process is added, and the input pleasure of the user is further increased.
Drawings
FIG. 1 is a flowchart illustrating steps of a method for adjusting a virtual keyboard according to an embodiment of the present invention;
FIGS. 2A-2C are exemplary diagrams of a virtual keyboard according to embodiments of the present invention;
FIG. 3A is a schematic diagram of an initial display area of a virtual key according to the present invention;
3B-3C are schematic diagrams of target display areas of a virtual key of the present invention;
FIG. 4A is a schematic diagram of an initial display area of a virtual keyboard according to the present invention;
FIGS. 4B-4C are schematic diagrams of a target display area of a virtual keyboard according to the present invention;
FIG. 5 is a flow chart of steps of an embodiment of a playback method of the present invention;
FIGS. 6A-6B are block diagrams illustrating an exemplary embodiment of an apparatus for adjusting a virtual keyboard according to the present invention;
FIG. 7 is a block diagram of a playing device according to an embodiment of the present invention;
FIG. 8 is a block diagram illustrating an apparatus for adjusting a virtual keyboard in accordance with an exemplary embodiment;
fig. 9 is a block diagram illustrating a playback apparatus according to an example embodiment.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
Referring to fig. 1, a flowchart illustrating steps of an embodiment of a method for adjusting a virtual keyboard according to the present invention is shown, which may specifically include the following steps:
in a specific implementation, the embodiment of the present invention may be applied to a mobile terminal having a touch screen, for example, a mobile phone, a PDA (Personal Digital Assistant), a laptop computer, a palmtop computer, and the like, wherein the touch screen may include a vector pressure sensing touch screen, a resistive touch screen, a capacitive touch screen, an infrared touch screen, a surface acoustic wave touch screen, and the like, which is not limited in this respect.
These mobile terminals may support operating systems such as Windows, Android (Android), IOS, Windows phone, and may generally run application programs that perform input through a virtual keyboard, for example, input method programs.
The virtual keyboard typically has one or more virtual keys, often multiplexed, mapped with one or more characters, which when activated can be used to input characters that are different for different languages, such as chinese, english, japanese, etc.
In order to make the embodiment of the present invention better understood by those skilled in the art, in the embodiment of the present invention, chinese is explained as an example of a language.
In a specific implementation, the characters of the virtual key mapping may specifically include, but are not limited to, at least one of input numeric characters, english characters, chinese characters (such as pinyin characters, stroke characters, etc.), and symbolic characters.
For example, referring to fig. 2A and 2B, which illustrate an exemplary diagram of a virtual keyboard 200 according to an embodiment of the present invention, the virtual keyboard 200 may be referred to as a squared figure keyboard or a 9-key keyboard, and mainly includes 9 virtual keys.
In this example, as shown in fig. 2A, for the virtual button 201, in the pinyin input mode, clicking the virtual button 201 can input the initial "d", the final "e", and the initial "f", in the number input mode, clicking the virtual button 201 can input the number "3", in the english input mode, clicking the virtual button 201 can input the english "d", "e", and "f"; clicking the virtual key 202 in a pinyin input mode, a numeric input mode and an English input mode to input a comma,; as shown in FIG. 2B, clicking on the virtual key 201 in stroke input mode can input strokes "" or "" down "" as well.
For another example, referring to fig. 2C, which shows an exemplary view of another virtual keyboard of the present invention, the virtual keyboard 210 may be referred to as a full keyboard or a 26-key keyboard, and a typical full keyboard or 26-key keyboard may be a QWERTY keyboard, which mainly includes 26 virtual keys.
In this example, for the virtual key 211, in the pinyin input mode, clicking the virtual key 211 may input a semivowel "w", in the english input mode, clicking the virtual key 211 may input english "w", and in the numeric input mode, clicking the virtual key 211 may input a number "2"; for the virtual key 212, in the pinyin input mode, the initial letter "g" can be input by clicking the virtual key 212, in the english input mode, the english "g" can be input by clicking the virtual key 211, and in the symbol input mode, "%" can be input.
Of course, the virtual keyboard is only used as an example, and when the embodiment of the present invention is implemented, other virtual keyboards may be set according to actual situations. In addition, besides the virtual keyboard, a person skilled in the art may also use other virtual keyboards according to actual needs, and the embodiment of the present invention is not limited thereto.
When a user inputs an input through the virtual keyboard, the user may perform a touch operation on a position of the virtual keyboard in a touch screen of the electronic device or the mobile terminal with a finger or another object (e.g., a stylus pen), for example, the user may click one of the virtual keys to complete the input, or slide on one of the virtual keys to complete the input.
In a preferred embodiment of the present invention, the step of obtaining the pressure value of the touch operation when receiving the touch operation of the user on the virtual keyboard of the mobile terminal may specifically include the following sub-steps:
in sub-step 1011, when a touch operation of a user on any virtual key of the mobile terminal is received, a pressure value of the current touch operation is obtained.
In a specific implementation, after a user completes a touch operation on a certain virtual key in a virtual keyboard of the mobile terminal, the mobile terminal can recognize the touch operation, and can further detect a pressure value of the touch operation through a set of touch technologies integrating capacitive touch and infrared sensing.
For example, one or more infrared transmitters may be disposed below a touch screen of the mobile terminal, and infrared light may be transmitted to a touch screen glass cover at a specific angle.
These angles are selected to provide 100% reflection of reflected light from the top and bottom surfaces of the cover, as well as from the ambient air and fingers.
When the light within the cover is reflected, the emitted infrared light will trigger a receiver that can count the total number of total internal reflections, which will display different output readings depending on whether the reflected light is from the surrounding air or the user's finger, thus enabling the detection of touch pressure.
In addition, of course, a pressure sensor may be attached under the touch screen to detect a pressure value of a touch operation, or detect a pressure value in other manners, which is not limited in the embodiment of the present invention.
in the embodiment of the invention, the target display area of the virtual keyboard can be determined according to the magnitude of the pressure value generated by the touch of the virtual keyboard by the user, so that the adjustment of the virtual keyboard is realized.
As an example of the present invention, the step of determining the target display area of the virtual keyboard according to the pressure value may specifically include the following sub-steps:
substep 1021, when the pressure value belongs to a first pressure range, determining that the target display area of the current virtual key is a preset first display area;
as shown in fig. 3A, it is a schematic diagram of an initial display area of a virtual key according to the present invention, and in fig. 3A, the initial display area of the virtual key 301 is a display area of the key in a default state. It should be noted that the initial display area of the virtual key 301 shown in fig. 3A is rectangular, which is only an example of the embodiment of the present invention, and the initial display area of the virtual key may also be circular, diamond, or other shapes, which is not limited in this embodiment of the present invention.
In the embodiment of the present invention, a user may perform an input by performing a touch operation within the range of the initial display area of the virtual key 301, and when a pressure value of the touch operation performed by the user during the input belongs to a first pressure range, the preset first display area corresponding to the first pressure range may be a target display area of the virtual key 301. The first pressure range may be preset by the system, may be defined by the user, and may be formed by performing adjustment according to feedback of the user on the basis of the preset by the system, which is not limited in the embodiment of the present invention.
In the embodiment of the present invention, the initial display area of the virtual key may have a corresponding center point, for example, taking the rectangular virtual key 301 in fig. 3A as an example, the center point may be an intersection of diagonals of the display area, and for other types of display areas, the center point position may be determined according to the specific shape or type of the display area, for example, for a circular display area, the center point should be located at the center of a circle. Therefore, further, the first display area may be generated by determining a center point of the initial display area as follows:
s11, taking the central point as a center, adjusting the initial display area according to a preset first proportion, and obtaining the first display area;
in a specific implementation, the initial display area of each virtual key may be adjusted according to a certain proportion with a center point of the display area of the virtual key as a center, the adjusted display area is used as a first display area, then the first display area may be preset in the system, and when a pressure value of an input operation performed by a user belongs to a first pressure range, the virtual key may be displayed within the range of the first display area.
It should be noted that the first ratio may be preset by a system, or may be defined by a user, which is not limited in the embodiment of the present invention, and in addition, the first ratio may be less than 100%, or may be greater than 100%, that is, when the initial display area of the virtual key is adjusted according to a ratio less than 100%, the range of the adjusted target display area is smaller than the initial display area of the virtual key; when the initial display area of the virtual key is adjusted according to the proportion of more than 100%, the range of the adjusted target display area is larger than the initial display area of the virtual key.
For convenience of understanding, the embodiment of the present invention is described by taking the first ratio smaller than 100% as an example, and as shown in fig. 3B, it is one of schematic diagrams of the target display area of the virtual key of the present invention, and the virtual key 302 is the target display area obtained by adjusting according to the ratio smaller than 100%.
And a substep 1022, determining the target display area of the current virtual key as a preset second display area when the pressure value belongs to a second pressure range.
In the embodiment of the present invention, when a user performs an input by performing a touch operation within the range of the initial display area of the virtual key 301 in fig. 3A, if a pressure value of the touch operation performed by the user during the input belongs to the second pressure range, the preset second display area corresponding to the second pressure range may be used as the target display area of the virtual key 301. The second pressure range may be preset by the system, may be defined by the user, and may be formed by performing adjustment according to feedback of the user on the basis of the preset by the system, which is not limited in the embodiment of the present invention.
Further, the second display area may be generated by the following method based on the determination of the center point of the initial display area:
s12, taking the central point as a center, adjusting the initial display area according to a preset second proportion, and obtaining a second display area;
in a specific implementation, the initial display area of each virtual key may be adjusted according to a certain proportion with a center point of the display area of the virtual key as a center, the adjusted display area is used as a second display area, then the second display area may be preset in the system, and when a pressure value of an input operation performed by a user belongs to a second pressure range, the virtual key may be displayed within the range of the second display area.
It should be noted that the second ratio may be preset by a system, or may be defined by a user, which is not limited in the embodiment of the present invention, and in addition, the second ratio may be less than 100%, or may be greater than 100%, that is, when the initial display area of the virtual key is adjusted according to a ratio less than 100%, the range of the adjusted target display area is smaller than the initial display area of the virtual key, as shown in fig. 3C, which is a second schematic diagram of the target display area of the virtual key of the present invention, and the virtual key 303 is the target display area obtained after being adjusted according to a ratio less than 100%; when the initial display area of the virtual key is adjusted according to the proportion of more than 100%, the range of the adjusted target display area is larger than the initial display area of the virtual key.
In an embodiment of the invention, the pressure values in the first pressure range may be smaller than the pressure values in the second pressure range.
Therefore, the touch operation performed by the user according to the pressure values in the first pressure range may be referred to as a tap, in which the virtual key is touched with a pressure having a small force for input, and the touch operation performed by the user according to the pressure values in the second pressure range may be referred to as a hard press, in which the virtual key is touched with a pressure having a large force for input.
By comparing the target display areas shown in fig. 3B and fig. 3C, when both the first ratio and the second ratio are less than 100%, when the range of the first target display area obtained by the user performing the touch operation using the pressure value in the first pressure range is larger than the range of the second target display area obtained by the user performing the touch operation using the pressure value in the second pressure range, that is, when the user touches the same virtual key, the range of the target display area obtained by lightly pressing the virtual key is larger than the range of the target display area obtained by heavily pressing the virtual key.
It should be noted that, if the operating system of the mobile terminal provides an API (Application Programming Interface) for detecting the pressing type, the API Interface may be directly called to detect the pressing type, and the target display area may be determined according to the pressing type.
For example, a proxy object and a source view (such as a view for showing an error correction item) of a preview function are registered in the IOS system, and the proxy object accepts the uiview control preview without delete protocol, that is, the Peek (soft press) and Pop (hard press) methods in the protocol can be realized.
As another example of the present invention, the step of determining the target display area of the virtual keyboard according to the pressure value may further include the following sub-steps:
a substep 1023 of determining the target display area of the virtual keyboard as a preset third display area when the pressure value belongs to the first pressure range;
fig. 4A is a schematic diagram of an initial display area of a virtual keyboard according to the present invention, and in fig. 4A, the initial display area of the virtual keyboard 401 is a display area of the keyboard in a default state. It should be noted that the initial display area of the virtual keyboard 401 shown in fig. 4A is rectangular, which is only an example of the embodiment of the present invention, and the initial display area of the virtual keyboard may also be circular, diamond, or other shapes, which is not limited in this embodiment of the present invention.
In the embodiment of the present invention, a user may perform an input by performing a touch operation on a certain virtual key of the virtual keys, and when a pressure value of the touch operation performed by the user during the input belongs to a first pressure range, the preset third display area corresponding to the first pressure range may be used as the target display area of the virtual keyboard 401. The first pressure range may be preset by the system, may be defined by the user, and may be formed by performing adjustment according to feedback of the user on the basis of the preset by the system, which is not limited in the embodiment of the present invention.
In the embodiment of the present invention, the initial display area of the virtual keyboard may have a corresponding display height, for example, taking the rectangular virtual keyboard 401 in fig. 4A as an example, the display height is H1, while for other types of display areas, the display height may be determined according to the specific shape or type of the display area, for example, for a circular display area, the display height may be determined by the diameter of a circle. Therefore, further, the third display area may be generated by the following method based on the determination of the display height of the initial display area:
s21, adjusting the initial display area according to a preset first distance to obtain a third display area;
taking a virtual keyboard with a rectangular initial display area as an example, the initial display area of the virtual keyboard can be adjusted according to a certain distance and direction by fixing two vertexes of the rectangle, the adjusted display area is taken as a third display area, then the third display area can be preset in the system, and when a pressure value for a user to perform an input operation belongs to a first pressure range, the virtual keyboard can be displayed in the range of the third display area.
It should be noted that the first distance may be preset by the system or defined by the user, which is not limited in the embodiment of the present invention. As shown in fig. 4B, which is one of schematic diagrams of a target display area of a virtual keyboard of the present invention, a virtual keyboard 402 is a third display area obtained by reducing a display height of a virtual keyboard 401 by a first distance, and the display height of the virtual keyboard 402 is H2.
And a substep 1024 of determining the target display area of the virtual keyboard to be a preset fourth display area when the pressure value belongs to the second pressure range.
In the embodiment of the present invention, when a user performs an input by performing a touch operation on any virtual key of the virtual keyboard in fig. 4A, if a pressure value of the touch operation performed by the user during the input belongs to the second pressure range, the preset fourth display area corresponding to the second pressure range may be used as the target display area of the virtual keyboard 401. The second pressure range may be preset by the system, may be defined by the user, and may be formed by performing adjustment according to feedback of the user on the basis of the preset by the system, which is not limited in the embodiment of the present invention.
Further, the fourth display area may be generated by the following method based on the determination of the display height of the initial display area:
s22, adjusting the initial display area according to a preset second distance to obtain a fourth display area;
taking the virtual keyboard with the rectangular initial display area as an example, the initial display area of the virtual keyboard can be adjusted according to a certain distance by fixing two vertexes of the rectangle, and the adjusted display area is taken as a fourth display area, and then the fourth display area can be preset in the system, and when a pressure value for a user to perform an input operation belongs to a first pressure range, the virtual keyboard can be displayed in the range of the fourth display area.
It should be noted that the second distance may be preset by the system or defined by the user, which is not limited in the embodiment of the present invention. As shown in fig. 4C, which is a second schematic diagram of the target display area of the virtual keyboard of the present invention, the virtual keyboard 403 is a fourth display area obtained by reducing the display height H1 of the virtual keyboard 401 according to the second distance, and the display height of the virtual keyboard 403 is H3.
In an embodiment of the invention, the pressure values in the first pressure range may be smaller than the pressure values in the second pressure range. Therefore, the touch operation performed by the user according to the pressure values in the first pressure range may be referred to as a tap, in which the virtual key is touched with a pressure having a small force for input, and the touch operation performed by the user according to the pressure values in the second pressure range may be referred to as a hard press, in which the virtual key is touched with a pressure having a large force for input.
By comparing the target display areas shown in fig. 4B and 4C, the display height of the third target display area obtained when the user performs the touch operation using the pressure values in the first pressure range is greater than the display height of the fourth target display area obtained when the user performs the touch operation using the pressure values in the second pressure range, that is, the first distance is smaller than the second distance.
And 103, displaying the virtual keyboard in the target display area.
As an example of the present invention, after determining a target display area corresponding to a pressure value of a touch operation performed by a user on any virtual key of a virtual keyboard, the virtual keyboard may be displayed in the target display area. For example, when the user performs a touch operation using pressure values of the first pressure range, the entire virtual keyboard may be displayed in the third display area, and when the user performs a touch operation using pressure values of the second pressure range, the entire virtual keyboard may be displayed in the fourth display area.
As another example of the present invention, after determining a target display area corresponding to a pressure value of a touch operation performed by a user on a certain virtual key of a virtual keyboard, the current virtual key may be displayed in the target display area. For example, when the user performs a touch operation using pressure values of a first pressure range, the display area of the entire virtual keyboard may be maintained and then the current virtual key may be displayed in the first display area, and when the user performs a touch operation using pressure values of a second pressure range, the current virtual key may be displayed in the second display area.
In the embodiment of the invention, when the touch operation of a user on the virtual keyboard of the mobile terminal is received, the pressure value of the touch operation can be obtained, the target display area of the virtual keyboard is determined according to the pressure value, and the virtual keyboard is displayed in the target display area, so that the display area of the virtual keyboard can be dynamically adjusted according to the pressure value of the touch operation of the user, the problem that the adjustment of the display area of the virtual keyboard can only be carried out before the input is executed in the prior art is solved, the virtual keyboard of the mobile terminal can change in real time along with the input of the user, and the interest of the user in the input process is increased.
Referring to fig. 5, a flowchart illustrating steps of an embodiment of a playing method according to the present invention is shown, which may specifically include the following steps:
in a specific implementation, the embodiment of the present invention may be applied to a mobile terminal having a touch screen, for example, a mobile phone, a PDA (Personal Digital Assistant), a laptop computer, a palmtop computer, and the like, wherein the touch screen may include a vector pressure sensing touch screen, a resistive touch screen, a capacitive touch screen, an infrared touch screen, a surface acoustic wave touch screen, and the like, which is not limited in this respect.
These mobile terminals may support operating systems including Windows, Android, IOS, Windows phone, and the like, and may generally run application programs that perform input through a virtual keyboard, for example, input method programs.
The virtual keyboard typically has one or more virtual keys, often multiplexed, mapped with one or more characters, which when activated can be used to input characters that are different for different languages, such as chinese, english, japanese, etc.
When a user performs input on the virtual keyboard, the user may perform a touch operation on a position of the virtual keyboard in a touch screen of the electronic device or the mobile terminal with a finger or another object (e.g., a stylus pen), for example, the user may perform input by clicking one of the virtual keys or by sliding on one of the virtual keys.
In a preferred embodiment of the present invention, the step of obtaining the pressure value of the touch operation when receiving the touch operation of the user on the virtual keyboard of the mobile terminal may specifically include the following sub-steps:
sub-step 5011, when receiving a click operation of a user on any virtual key of the mobile terminal, acquiring a current touch pressure value.
Since sub-step 5011 is similar to sub-step 1011, they can refer to each other, and this embodiment will not be described again.
in the embodiment of the present invention, specific audio data may be preset for each virtual key, and when a touch operation of a user on a certain virtual key is received, the audio data corresponding to the virtual key may be extracted. For example, for Q, W, E, R four virtual keys on the virtual keyboard, a specific audio data may be preset for each of the four virtual keys, for example, the audio data corresponding to the virtual key Q is set as data 1, the audio data corresponding to the virtual key W is set as data 2, the audio data corresponding to the virtual key E is set as data 3, the audio data corresponding to the virtual key R is set as data 4, and when the user sequentially touches the virtual key Q, W, E, R, data 1, data 2, data 3, and data 4 may be sequentially extracted according to the corresponding touch sequence.
In a preferred embodiment of the present invention, the step of extracting the audio data corresponding to the pressure value may specifically include the following sub-steps:
substep 5021, when the pressure value belongs to a first pressure range, determining a first volume value corresponding to the first pressure range, and generating first audio data according to the first volume value and preset audio data of the current virtual key;
and a substep 5022, determining a second volume value corresponding to a second pressure range when the pressure value belongs to the second pressure range, and generating second audio data according to the second volume value and the preset audio data of the current virtual key.
In specific implementation, a user can perform input by performing touch operation on a certain virtual key, when a pressure value of the touch operation performed by the user during input belongs to a first pressure range, a first volume value corresponding to the first pressure range can be determined, and then first audio data is generated according to the first volume value and preset audio data of the current virtual key; when the pressure value of the touch operation performed by the user during the input belongs to the second pressure range, the second volume value corresponding to the second pressure range may be determined, and then the second audio data may be generated according to the second volume value and the preset audio data of the current virtual key. The first pressure range may be preset by the system, may be defined by the user, and may be formed by performing adjustment according to feedback of the user on the basis of the preset by the system, which is not limited in the embodiment of the present invention.
It should be noted that the first volume value and the second volume value may be volumes in two different ranges, for example, if the volume value ranges from 0 to 100, the first volume value may be set to be a volume value in a range from 0 to 50, the second volume value may be set to be a volume value in a range from 51 to 100, and when it is determined that the current volume value should be the first volume value according to the pressure value of the touch operation of the user, any specific volume value may be randomly selected in a range from 0 to 50 of the first volume value, for example, 30, 35, or 45, and so on, without setting the first volume values of all the virtual keys to be the same specific volume value. Similarly, the second volume value may also be any specific volume value within the second volume value range, which is not limited in the embodiment of the present invention.
In the embodiment of the invention, when the user touches the virtual key, different audio data can be generated according to the audio data preset by the virtual key and the volume value determined according to the pressure value of the touch operation, so that when the user continuously touches different virtual keys, continuous audio data are formed, and corresponding sound is played to the user.
In the embodiment of the invention, when the touch operation of a user on the virtual keyboard of the mobile terminal is received, the pressure value of the touch operation can be acquired, the audio data corresponding to the pressure value can be extracted, and then the audio data is adopted to play the corresponding sound.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Referring to fig. 6A, a block diagram of an embodiment of an adjusting apparatus for a virtual keyboard according to the present invention is shown, and the adjusting apparatus may specifically include the following modules:
the first obtaining module 601 is configured to obtain a pressure value of a touch operation when the touch operation of a user on a virtual keyboard of a mobile terminal is received;
a determining module 602, configured to determine a target display area of the virtual keyboard according to the pressure value;
a displaying module 603, configured to display the virtual keyboard in the target display area.
In this embodiment of the present invention, the virtual keyboard may include a plurality of virtual keys, and the first obtaining module 601 may specifically include the following sub-modules:
the first obtaining submodule 6011 is configured to, when receiving a touch operation of a user on any virtual key of the mobile terminal, obtain a pressure value of a current touch operation.
On the basis of fig. 6A, optionally, referring to fig. 6B, which shows a second structural block diagram of an embodiment of an adjusting apparatus for a virtual keyboard according to the present invention, the determining module 602 may specifically include the following sub-modules:
a first display area determination submodule 6021, configured to determine that a target display area of the current virtual key is a preset first display area when the pressure value belongs to a first pressure range;
the second display area determination submodule 6022 is configured to determine that the target display area of the current virtual key is the preset second display area when the pressure value belongs to the second pressure range.
In the embodiment of the present invention, the current virtual key may have an initial display area, and the initial display area may have a corresponding central point;
the first display area may be generated by invoking the following sub-modules:
a first generation submodule 6023, configured to adjust the initial display area according to a preset first ratio with the central point as a center, and obtain the first display area;
the second display area may be generated by invoking the following sub-modules:
and the second generating submodule 6024 is configured to adjust the initial display area according to a preset second ratio with the central point as a center, and obtain the second display area.
In the embodiment of the present invention, the presenting module 603 may specifically include the following sub-modules:
a displaying sub-module 6031 for displaying the current virtual key in the target display area.
In this embodiment of the present invention, the determining module 602 may further include the following sub-modules:
a third display area determination submodule 6025 configured to determine that the target display area of the virtual keyboard is a preset third display area when the pressure value belongs to the first pressure range;
a fourth display area determination submodule 6026, configured to determine that the target display area of the virtual keyboard is a preset fourth display area when the pressure value belongs to the second pressure range.
In the embodiment of the present invention, the virtual keyboard may have an initial display area, and the initial display area may have a corresponding display height;
the third display area may be generated by invoking the following sub-modules:
a third generating submodule 6027, configured to adjust the initial display area according to a preset first distance, and obtain a third display area;
the fourth display area may be generated by invoking the following sub-modules:
a fourth generating sub-module 6028, configured to adjust the initial display area according to a preset second distance, so as to obtain the fourth display area.
Referring to fig. 7, a block diagram of a playing device according to an embodiment of the present invention is shown, which may specifically include the following modules:
a second obtaining module 701, configured to obtain a pressure value of a touch operation when the touch operation of a user on a virtual keyboard of a mobile terminal is received;
an extracting module 702, configured to extract audio data corresponding to the pressure value;
the playing module 703 is configured to play corresponding sound by using the audio data.
In this embodiment of the present invention, the virtual keyboard may include a plurality of virtual keys, and the second obtaining module 701 may specifically include the following sub-modules:
the second obtaining sub-module 7011 is configured to, when a touch operation of a user on any virtual key of the mobile terminal is received, obtain a pressure value of a current touch operation.
In this embodiment of the present invention, the plurality of virtual keys may have different preset audio data, and the extracting module 702 may specifically include the following sub-modules:
the first audio data generation submodule 7021 is configured to determine a first volume value corresponding to a first pressure range when the pressure value belongs to the first pressure range, and generate first audio data according to the first volume value and preset audio data of a current virtual key;
the second audio data generating sub-module 7022 is configured to, when the pressure value belongs to a second pressure range, determine a second volume value corresponding to the second pressure range, and generate second audio data according to the second volume value and preset audio data of the current virtual key.
For the apparatus embodiment, since it is substantially similar to the method embodiment, the description is relatively simple, and reference may be made to the partial description of the method embodiment for relevant points.
Fig. 8 is a block diagram illustrating an apparatus 800 for adjusting a virtual keyboard according to an exemplary embodiment. For example, the apparatus 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 8, the apparatus 800 may include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communications component 816.
The processing component 802 generally controls overall operation of the device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing element 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the virtual keyboard adjustment method described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.
The memory 804 is configured to store various types of data to support operations at the apparatus 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 800 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the apparatus 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.
The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the device 800. For example, the sensor assembly 814 may detect the open/closed status of the device 800, the relative positioning of components, such as a display and keypad of the device 800, the sensor assembly 814 may also detect a change in the position of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, the orientation or acceleration/deceleration of the device 800, and a change in the temperature of the device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 816 is configured to facilitate communication between the apparatus 800 and other devices in a wired or wireless manner. The device 800 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described virtual keyboard adjustment method.
In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 804 comprising instructions, executable by the processor 820 of the device 800 to perform the virtual keyboard adjustment method described above is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
A non-transitory computer readable storage medium having instructions therein, which when executed by a processor of a mobile terminal, enable the mobile terminal to:
when touch operation of a user on a virtual keyboard of a mobile terminal is received, acquiring a pressure value of the touch operation; determining a target display area of the virtual keyboard according to the pressure value; and displaying the virtual keyboard in the target display area.
Fig. 9 is a block diagram illustrating a playback apparatus 900 according to an example embodiment. For example, the apparatus 900 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 9, apparatus 900 may include one or more of the following components: processing component 902, memory 904, power component 906, multimedia component 908, audio component 910, input/output (I/O) interface 912, sensor component 914, and communication component 916.
The processing component 902 generally controls overall operation of the device 900, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. Processing component 902 may include one or more processors 920 to execute instructions to perform all or a portion of the steps of the playback method described above. Further, processing component 902 can include one or more modules that facilitate interaction between processing component 902 and other components. For example, the processing component 902 can include a multimedia module to facilitate interaction between the multimedia component 908 and the processing component 902.
The memory 904 is configured to store various types of data to support operation at the apparatus 900. Examples of such data include instructions for any application or method operating on device 900, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 904 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power supply component 906 provides power to the various components of the device 900. The power components 906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 900.
The multimedia component 908 comprises a screen providing an output interface between the device 900 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 908 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 900 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 910 is configured to output and/or input audio signals. For example, audio component 910 includes a Microphone (MIC) configured to receive external audio signals when apparatus 900 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 904 or transmitted via the communication component 916. In some embodiments, audio component 910 further includes a speaker for outputting audio signals.
The I/O interface 912 provides an interface between the processing component 902 and a peripheral interface module, which may be a keyboard, click wheel, button, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor component 914 includes one or more sensors for providing status assessment of various aspects of the apparatus 900. For example, sensor assembly 914 may detect an open/closed state of device 900, the relative positioning of components, such as a display and keypad of device 900, the change in position of device 900 or a component of device 900, the presence or absence of user contact with device 900, the orientation or acceleration/deceleration of device 900, and the change in temperature of device 900. The sensor assembly 914 may include a proximity sensor configured to detect the presence of a nearby object in the absence of any physical contact. The sensor assembly 914 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 916 is configured to facilitate communications between the apparatus 900 and other devices in a wired or wireless manner. The apparatus 900 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 916 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 916 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 900 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described playback method.
In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 904 comprising instructions, executable by the processor 920 of the apparatus 900 to perform the above-described playback method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
A non-transitory computer readable storage medium having instructions therein, which when executed by a processor of a mobile terminal, enable the mobile terminal to:
when touch operation of a user on a virtual keyboard of a mobile terminal is received, acquiring a pressure value of the touch operation; extracting audio data corresponding to the pressure value; and playing corresponding sound by adopting the audio data.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The method for adjusting a virtual keyboard, the device for adjusting a virtual keyboard, the playing method and the playing device provided by the present invention are described in detail above, and specific examples are applied in the text to explain the principle and the implementation of the present invention, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (30)
1. A method for adjusting a virtual keyboard, comprising:
when touch operation of a user on a virtual keyboard of a mobile terminal is received, acquiring a pressure value of the touch operation; one or more infrared transmitters and a receiver are deployed below a touch screen of the mobile terminal, and the receiver detects a pressure value of the touch operation according to infrared light reflected by a touch screen glass cover and transmitted to the touch screen glass cover by the infrared transmitters;
determining a target display area of the virtual keyboard according to the pressure value and the initial display area of the virtual keyboard; the target display area is a virtual key or the whole virtual keyboard, and the initial display area of the virtual key is the same as the central point of the target display area;
displaying the virtual keyboard in the target display area;
the method includes the steps that a plurality of virtual keys respectively have different preset audio data, and when touch operation of a user on a virtual keyboard of a mobile terminal is received, after a pressure value of the touch operation is obtained, the method further includes the following steps:
when the pressure value belongs to a first pressure range, determining a first volume value corresponding to the first pressure range, and generating first audio data according to the first volume value and the preset audio data of the current virtual key;
and playing corresponding sound by adopting the audio data.
2. The method according to claim 1, wherein the virtual keyboard comprises a plurality of virtual keys, and the step of obtaining the pressure value of the touch operation when receiving the touch operation of the user on the virtual keyboard of the mobile terminal comprises:
when receiving a touch operation of a user on any virtual key of the mobile terminal, acquiring a pressure value of the current touch operation.
3. The method of claim 2, wherein the step of determining the target display area of the virtual keyboard according to the pressure value comprises:
when the pressure value belongs to a first pressure range, determining that the target display area of the current virtual key is a preset first display area;
and when the pressure value belongs to a second pressure range, determining that the target display area of the current virtual key is a preset second display area.
4. The method of claim 3, wherein the current virtual key has an initial display area, the initial display area having a corresponding center point;
the first display area is generated by the following steps:
adjusting the initial display area according to a preset first proportion by taking the central point as a center to obtain a first display area;
the second display area is generated by the following steps:
and adjusting the initial display area according to a preset second proportion by taking the central point as a center to obtain the second display area.
5. The method of any of claims 2-4, wherein the step of presenting the virtual keyboard in the target display area comprises:
and displaying the current virtual key in the target display area.
6. The method of claim 2, wherein the step of determining the target display area of the virtual keyboard according to the pressure value comprises:
when the pressure value belongs to a first pressure range, determining that a target display area of the virtual keyboard is a preset third display area;
and when the pressure value belongs to a second pressure range, determining that the target display area of the virtual keyboard is a preset fourth display area.
7. The method of claim 6, wherein the virtual keyboard has an initial display area with a corresponding display height;
the third display area is generated by the following steps:
adjusting the initial display area according to a preset first distance to obtain a third display area;
the fourth display area is generated by:
and adjusting the initial display area according to a preset second distance to obtain the fourth display area.
8. A playback method, comprising:
when touch operation of a user on a virtual keyboard of a mobile terminal is received, acquiring a pressure value of the touch operation; one or more infrared transmitters and a receiver are deployed below a touch screen of the mobile terminal, and the receiver detects a pressure value of the touch operation according to infrared light reflected by a touch screen glass cover and transmitted to the touch screen glass cover by the infrared transmitters;
extracting audio data corresponding to the pressure value;
playing corresponding sound by adopting the audio data;
wherein the virtual keys have different preset audio data respectively, and the step of extracting the audio data corresponding to the pressure value comprises:
and when the pressure value belongs to a first pressure range, determining a first volume value corresponding to the first pressure range, and generating first audio data according to the first volume value and the preset audio data of the current virtual key.
9. The method according to claim 8, wherein the virtual keyboard comprises a plurality of virtual keys, and the step of obtaining the pressure value of the touch operation when receiving the touch operation of the user on the virtual keyboard of the mobile terminal comprises:
when receiving a touch operation of a user on any virtual key of the mobile terminal, acquiring a current pressure value of the touch operation.
10. The method of claim 9, wherein the step of extracting audio data corresponding to the pressure value comprises:
and when the pressure value belongs to a second pressure range, determining a second volume value corresponding to the second pressure range, and generating second audio data according to the second volume value and the preset audio data of the current virtual key.
11. An apparatus for adjusting a virtual keyboard, comprising:
the mobile terminal comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring a pressure value of a touch operation when the touch operation of a user on a virtual keyboard of the mobile terminal is received; one or more infrared transmitters and a receiver are arranged below a touch screen of the mobile terminal, and the receiver detects the pressure value of the touch operation according to infrared light reflected by a touch screen glass cover and transmitted to the touch screen glass cover by the infrared transmitters;
the determining module is used for determining a target display area of the virtual keyboard according to the pressure value and the initial display area of the virtual keyboard; the target display area is a virtual key or the whole virtual keyboard, and the initial display area of the virtual key is the same as the central point of the target display area;
the display module is used for displaying the virtual keyboard in the target display area;
the method includes the steps that a plurality of virtual keys respectively have different preset audio data, and when touch operation of a user on a virtual keyboard of the mobile terminal is received, after a pressure value of the touch operation is obtained, the method further includes the following steps: when the pressure value belongs to a first pressure range, determining a first volume value corresponding to the first pressure range, and generating first audio data according to the first volume value and the preset audio data of the current virtual key; and playing corresponding sound by adopting the audio data.
12. The apparatus according to claim 11, wherein the virtual keyboard includes a plurality of virtual keys, and the first obtaining module specifically includes the following sub-modules:
the first obtaining submodule is used for obtaining a current pressure value of touch operation when touch operation of a user on any virtual key of the mobile terminal is received.
13. The apparatus according to claim 12, wherein the determining module specifically includes the following sub-modules:
the first display area determining submodule is used for determining that the target display area of the current virtual key is a preset first display area when the pressure value belongs to a first pressure range;
and the second display area determining submodule is used for determining the target display area of the current virtual key as a preset second display area when the pressure value belongs to a second pressure range.
14. The apparatus of claim 13, wherein the current virtual key has an initial display area, the initial display area having a corresponding center point;
the first display area is generated by calling the following sub-modules:
the first generation submodule is used for adjusting the initial display area according to a preset first proportion by taking the central point as a center to obtain the first display area;
the second display area is generated by calling the following sub-modules:
and the second generation submodule is used for adjusting the initial display area according to a preset second proportion by taking the central point as a center to obtain the second display area.
15. The apparatus according to any of the claims 12-14, wherein the presentation module comprises in particular the following sub-modules:
and the display sub-module is used for displaying the current virtual key in the target display area.
16. The apparatus of claim 12, wherein the determining module further comprises sub-modules for:
a third display area determination submodule, configured to determine that a target display area of the virtual keyboard is a preset third display area when the pressure value belongs to the first pressure range;
and the fourth display area determining submodule is used for determining the target display area of the virtual keyboard as a preset fourth display area when the pressure value belongs to the second pressure range.
17. The device of claim 16, wherein the virtual keyboard has an initial display area with a corresponding display height;
the third display area is generated by calling the following sub-modules:
the third generation submodule is used for adjusting the initial display area according to a preset first distance to obtain a third display area;
the fourth display area is generated by calling the following sub-modules:
and the fourth generation submodule is used for adjusting the initial display area according to a preset second distance to obtain the fourth display area.
18. A playback apparatus, comprising:
the second acquisition module is used for acquiring the pressure value of the touch operation when the touch operation of a user on a virtual keyboard of the mobile terminal is received; one or more infrared transmitters and a receiver are deployed below a touch screen of the mobile terminal, and the receiver detects a pressure value of the touch operation according to infrared light reflected by a touch screen glass cover and transmitted to the touch screen glass cover by the infrared transmitters;
the extraction module is used for extracting the audio data corresponding to the pressure value;
the playing module is used for playing corresponding sound by adopting the audio data;
the virtual keys are respectively provided with different preset audio data, and the extraction module specifically comprises the following sub-modules:
and the first audio data generation submodule is used for determining a first volume value corresponding to a first pressure range when the pressure value belongs to the first pressure range, and generating first audio data according to the first volume value and the preset audio data of the current virtual key.
19. The apparatus according to claim 18, wherein the virtual keyboard comprises a plurality of virtual keys, and the second obtaining module specifically comprises the following sub-modules:
and the second acquisition submodule is used for acquiring the current pressure value of the touch operation when the touch operation of the user on any virtual key of the mobile terminal is received.
20. The apparatus of claim 19, wherein the extraction module comprises the following sub-modules:
and the second audio data generation submodule is used for determining a second volume value corresponding to a second pressure range when the pressure value belongs to the second pressure range, and generating second audio data according to the second volume value and the preset audio data of the current virtual key.
21. An apparatus for adjusting a virtual keyboard, comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory, and wherein the one or more programs are configured to be executed by one or more processors and comprise instructions for:
when touch operation of a user on a virtual keyboard of a mobile terminal is received, acquiring a pressure value of the touch operation; one or more infrared transmitters and a receiver are arranged below the touch screen of the mobile terminal, and the receiver detects the pressure value of the touch operation according to infrared light reflected by the touch screen glass cover and transmitted to the touch screen glass cover by the infrared transmitters;
determining a target display area of the virtual keyboard according to the pressure value and the initial display area of the virtual keyboard; the target display area is a virtual key or the whole virtual keyboard, and the initial display area of the virtual key is the same as the central point of the target display area;
displaying the virtual keyboard in the target display area;
the method includes the steps that a plurality of virtual keys respectively have different preset audio data, and when touch operation of a user on a virtual keyboard of a mobile terminal is received, after a pressure value of the touch operation is obtained, the method further includes the following steps: when the pressure value belongs to a first pressure range, determining a first volume value corresponding to the first pressure range, and generating first audio data according to the first volume value and the preset audio data of the current virtual key; and playing corresponding sound by adopting the audio data.
22. The adjusting apparatus according to claim 21, wherein the virtual keyboard comprises a plurality of virtual keys, and the step of obtaining the pressure value of the touch operation when receiving the touch operation of the user on the virtual keyboard of the mobile terminal comprises:
when receiving a touch operation of a user on any virtual key of the mobile terminal, acquiring a current pressure value of the touch operation.
23. The apparatus of claim 22, wherein the step of determining the target display area of the virtual keyboard according to the pressure value comprises:
when the pressure value belongs to a first pressure range, determining that the target display area of the current virtual key is a preset first display area;
and when the pressure value belongs to a second pressure range, determining that the target display area of the current virtual key is a preset second display area.
24. The device of claim 23, wherein the current virtual key has an initial display area, the initial display area having a corresponding center point;
the first display area is generated by the following steps:
adjusting the initial display area according to a preset first proportion by taking the central point as a center to obtain a first display area;
the second display area is generated by the following steps:
and adjusting the initial display area according to a preset second proportion by taking the central point as a center to obtain the second display area.
25. The apparatus of any one of claims 22-24, wherein the step of presenting the virtual keyboard in the target display area comprises:
and displaying the current virtual key in the target display area.
26. The apparatus of claim 22, wherein the step of determining the target display area of the virtual keyboard according to the pressure value comprises:
when the pressure value belongs to a first pressure range, determining that a target display area of the virtual keyboard is a preset third display area;
and when the pressure value belongs to a second pressure range, determining that the target display area of the virtual keyboard is a preset fourth display area.
27. The apparatus of claim 26, wherein the virtual keyboard has an initial display area with a corresponding display height;
the third display area is generated by the following steps:
adjusting the initial display area according to a preset first distance to obtain a third display area;
the fourth display area is generated by:
and adjusting the initial display area according to a preset second distance to obtain the fourth display area.
28. A playback device comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory, and wherein execution of the one or more programs by one or more processors comprises instructions for:
when touch operation of a user on a virtual keyboard of a mobile terminal is received, acquiring a pressure value of the touch operation; one or more infrared transmitters and a receiver are deployed below a touch screen of the mobile terminal, and the receiver detects a pressure value of the touch operation according to infrared light reflected by a touch screen glass cover and transmitted to the touch screen glass cover by the infrared transmitters;
extracting audio data corresponding to the pressure value;
playing corresponding sound by adopting the audio data;
wherein the virtual keys have different preset audio data respectively, and the step of extracting the audio data corresponding to the pressure value comprises:
and when the pressure value belongs to a first pressure range, determining a first volume value corresponding to the first pressure range, and generating first audio data according to the first volume value and the preset audio data of the current virtual key.
29. The apparatus according to claim 28, wherein the virtual keyboard comprises a plurality of virtual keys, and the step of obtaining, when receiving a touch operation of a user on the virtual keyboard of the mobile terminal, a pressure value of the touch operation comprises:
when receiving a touch operation of a user on any virtual key of the mobile terminal, acquiring a pressure value of the current touch operation.
30. The apparatus of claim 29, wherein the step of extracting audio data corresponding to the pressure value comprises:
and when the pressure value belongs to a second pressure range, determining a second volume value corresponding to the second pressure range, and generating second audio data according to the second volume value and the preset audio data of the current virtual key.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610971916.0A CN108008902B (en) | 2016-10-31 | 2016-10-31 | Virtual keyboard adjusting method and device and playing method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610971916.0A CN108008902B (en) | 2016-10-31 | 2016-10-31 | Virtual keyboard adjusting method and device and playing method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN108008902A CN108008902A (en) | 2018-05-08 |
CN108008902B true CN108008902B (en) | 2022-05-31 |
Family
ID=62048578
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610971916.0A Active CN108008902B (en) | 2016-10-31 | 2016-10-31 | Virtual keyboard adjusting method and device and playing method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108008902B (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112216258A (en) * | 2020-11-04 | 2021-01-12 | 苏州探寻文化科技有限公司 | Interactive system of digital string instrument and digital string instrument |
CN113996052B (en) * | 2021-10-28 | 2025-08-12 | 腾讯科技(深圳)有限公司 | Virtual button adjustment method and device, storage medium and electronic device |
CN119400135B (en) * | 2024-12-31 | 2025-03-18 | 深圳大学 | A method and system for automatically calibrating the sensitivity of a virtual musical instrument keyboard |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101630223A (en) * | 2009-07-25 | 2010-01-20 | 深圳华为通信技术有限公司 | Method and terminal for adjusting interface |
CN103034326A (en) * | 2011-10-05 | 2013-04-10 | 广达电脑股份有限公司 | Method for providing tactile feedback type virtual keyboard and electronic device thereof |
CN103543853A (en) * | 2011-11-30 | 2014-01-29 | 英特尔公司 | Self-adaptive virtual keyboard for handheld device |
CN104216612A (en) * | 2014-08-04 | 2014-12-17 | 联想(北京)有限公司 | Information processing method and electronic equipment |
CN104793863A (en) * | 2015-04-21 | 2015-07-22 | 努比亚技术有限公司 | Display control method and device for terminal screen |
CN104898964A (en) * | 2014-03-05 | 2015-09-09 | 网路家庭国际资讯股份有限公司 | Virtual keyboard system and operation method thereof |
CN105159549A (en) * | 2015-05-29 | 2015-12-16 | 努比亚技术有限公司 | Zoom-in display method of virtual keyboard and mobile terminal |
CN105700808A (en) * | 2016-02-18 | 2016-06-22 | 广东欧珀移动通信有限公司 | Music playing method, device and terminal equipment |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1067505A (en) * | 1991-06-05 | 1992-12-30 | 北京理工大学 | Combined tactile sensor |
US8300023B2 (en) * | 2009-04-10 | 2012-10-30 | Qualcomm Incorporated | Virtual keypad generator with learning capabilities |
CN103809873B (en) * | 2012-11-13 | 2018-02-27 | 联想(北京)有限公司 | A kind of information processing method and input equipment |
CN104917890A (en) * | 2015-05-29 | 2015-09-16 | 努比亚技术有限公司 | Mobile terminal and volume adjusting method |
CN105162966B (en) * | 2015-08-07 | 2019-07-09 | 惠州Tcl移动通信有限公司 | A kind of volume adjusting method and system based on mobile terminal |
CN105183241B (en) * | 2015-08-21 | 2018-10-09 | 惠州Tcl移动通信有限公司 | Based on pressure sensing touch screen, display device and realize pressure sensing method |
CN105511795B (en) * | 2015-12-17 | 2019-06-04 | Oppo广东移动通信有限公司 | A method for operating a user interface and a mobile terminal |
CN105841861B (en) * | 2016-05-04 | 2018-08-17 | 常州信息职业技术学院 | A kind of pressure distribution measurement device and its measurement method based on light total internal reflection |
-
2016
- 2016-10-31 CN CN201610971916.0A patent/CN108008902B/en active Active
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101630223A (en) * | 2009-07-25 | 2010-01-20 | 深圳华为通信技术有限公司 | Method and terminal for adjusting interface |
CN103034326A (en) * | 2011-10-05 | 2013-04-10 | 广达电脑股份有限公司 | Method for providing tactile feedback type virtual keyboard and electronic device thereof |
CN103543853A (en) * | 2011-11-30 | 2014-01-29 | 英特尔公司 | Self-adaptive virtual keyboard for handheld device |
CN104898964A (en) * | 2014-03-05 | 2015-09-09 | 网路家庭国际资讯股份有限公司 | Virtual keyboard system and operation method thereof |
CN104216612A (en) * | 2014-08-04 | 2014-12-17 | 联想(北京)有限公司 | Information processing method and electronic equipment |
CN104793863A (en) * | 2015-04-21 | 2015-07-22 | 努比亚技术有限公司 | Display control method and device for terminal screen |
CN105159549A (en) * | 2015-05-29 | 2015-12-16 | 努比亚技术有限公司 | Zoom-in display method of virtual keyboard and mobile terminal |
CN105700808A (en) * | 2016-02-18 | 2016-06-22 | 广东欧珀移动通信有限公司 | Music playing method, device and terminal equipment |
Also Published As
Publication number | Publication date |
---|---|
CN108008902A (en) | 2018-05-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105446646B (en) | Content input method, device and touch control device based on dummy keyboard | |
EP3260967A1 (en) | Method and apparatus for text selection | |
JP6321296B2 (en) | Text input method, apparatus, program, and recording medium | |
CN107153541A (en) | Browse interaction processing method and device | |
US20100088628A1 (en) | Live preview of open windows | |
US20100315366A1 (en) | Method for recognizing touch input in touch screen based device | |
WO2018027501A1 (en) | Terminal, touch response method, and device | |
CN103885632A (en) | Input method and input device | |
CN106802808A (en) | Suspension button control method and device | |
JP2017525076A (en) | Character identification method, apparatus, program, and recording medium | |
CN108008902B (en) | Virtual keyboard adjusting method and device and playing method and device | |
CN107168566B (en) | Operation mode control method, device and terminal electronic device | |
CN108803892B (en) | Method and device for calling third party application program in input method | |
CN108475157B (en) | Character input method, device and terminal | |
CN112486603A (en) | Interface adaptation method and device for adapting interface | |
CN108021322A (en) | Control the method and touch control terminal that display interface slides | |
CN106020694B (en) | Electronic equipment, and method and device for dynamically adjusting selected area | |
CN112346571A (en) | Equipment control method and device and storage medium | |
CN108021327A (en) | Control the method and touch control terminal that display interface slides | |
CN108062168B (en) | Candidate word screen-on method and device and candidate word screen-on device | |
CN112445363A (en) | Electronic device, control method and device for electronic device, and storage medium | |
CN113741783B (en) | Key identification method and device for identifying keys | |
CN111092971A (en) | Display method and device for displaying | |
CN107168631B (en) | Application program closing method and device and terminal electronic equipment | |
CN108762554A (en) | touch event response method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |