CN110502126B - Input method and electronic equipment - Google Patents

Abstract

The embodiment of the application discloses an input method and electronic equipment. Wherein the method comprises the following steps: receiving first data input by a user in a first input mode; determining a target result according to the first data, wherein the target result is a history selection result of a second data input by a user in a second input mode, syllable sequences corresponding to the first data and the second data are the same, and the target result is different from a universal result corresponding to the syllable sequences; the target result is displayed in a target input interface. The method can integrate the data input by the user in different input modes, so that the output result is more in line with the use habit of the user, and the input efficiency of the user is improved.

Description

Input methods and electronic devices

Technical field

The present application relates to the technical field of electronic equipment, and in particular, to an input method and electronic equipment.

Background technique

Input method application (IMA), also known as input method engine (IME), or input method editor (IME), is software used to implement word input. Currently, the more commonly used input method applications include Huawei input method, Sogou input method, Baidu input method, etc. By installing input method applications in terminals such as mobile phones, users can be assisted to input words in the terminal. A summary of existing input method applications can usually provide users with multiple input methods, including keyboard input, voice input, image scanning input, etc., providing convenience to users.

However, the content that the user has input using a certain input method may not be accurately input when the user inputs using another method, resulting in low user input efficiency. For example, if the user has entered a name "Zhang San" using the keyboard input method, when the user inputs the syllable sequence zhang'san using the voice input method, it may be recognized as "Zhang San" instead of the "Zhang San" expected by the user. . At this time, the user needs to manually change "Zhang" into "Zhang" in the edit box. This process is cumbersome and the user experience is poor.

Contents of the invention

Embodiments of the present application provide an input method and electronic device, which can improve user input efficiency.

In a first aspect, embodiments of the present application provide an input method, including: receiving first data input by a user using a first input method; determining a target result based on the first data, where the target result is the user using a second input method. Input the historical selection result of the second data, the syllable sequence corresponding to the above-mentioned first data and the above-mentioned second data is the same, and the above-mentioned target result is different from the general result corresponding to the above-mentioned syllable sequence; the above-mentioned target result is displayed in the target input interface.

The embodiments of the present application can integrate data input by users using different input methods, so that the user's usage habits are not affected by different input methods. When the user's usage habits are different from those of the public, no matter what input method the user uses, This can make the output results more in line with the user's own usage habits and improve the user's input efficiency.

In a possible implementation, determining the target result based on the first data includes: searching a first language library based on the first data and outputting the first result; the first language library is a language library corresponding to multiple input methods. ; Search the second language library according to the above-mentioned first data and output the second result; wherein the above-mentioned second language library is a language library generated according to the above-mentioned second data; determine the target result according to the above-mentioned first result and the above-mentioned second result.

Embodiments of the present application can integrate data input by users of the electronic device using different input methods, share data in different input methods, enhance the processing capabilities of the electronic device for input data, and make the output results more efficient than existing ones. It conforms to the user's usage habits and improves the user's input efficiency.

In a possible implementation, both the first language library and the second language library include words, syllable sequences corresponding to the words, and word frequencies corresponding to the words; the syllable sequences in the second language library correspond to The word with the highest word frequency is different from the word with the highest word frequency corresponding to the above-mentioned syllable sequence in the above-mentioned first language library.

In the embodiment of the present application, the second language library can record the user's own usage habits, and the user's own usage habits are different from the public's usage habits. Comprehensively consider the user's own usage habits and the usage habits of the public to make the output results more accurate.

In a possible implementation, the syllable sequence corresponding to the word in the second language library is part of the syllable sequence corresponding to the first data.

In a possible implementation, the syllable sequence corresponding to the first data is part of the syllable sequence corresponding to the words in the second language library.

In a possible implementation, the first input method is a voice input method, and the second input method is at least one of a keyboard input method, an image input method, and a handwriting input method.

Embodiments of the present application can share data input by users using keyboard input, image input, and handwriting input to the voice input method, which can improve the accuracy of speech recognition and improve the user's input efficiency.

In another possible implementation, the first input method is a keyboard input method, and the second input method is at least one of a voice input method, an image input method, and a handwriting input method.

Embodiments of the present application can share data input by the voice input method, image input method, and handwriting input method to the voice input method, which can improve the accuracy of keyboard input and improve the user's input efficiency.

In another possible implementation, the second result is empty and the target result is the first result.

Possibly, the second result being empty means that the second result does not exist.

In the embodiment of this application, if the second result does not exist, the output result shall be based on the first result. The first result is a result generated based on the usage habits of multiple users, which is in line with the usage habits of most users.

In another possible implementation, the second result is not empty, and the target result is the second result.

In the embodiment of this application, if the second result exists, the output result shall be based on the second result. The second result is a structure generated based on the usage habits of the electronic device, which is more in line with the usage habits of the user, ensuring the accuracy of the output results, improving the efficiency of user input, and improving the user experience.

In a second aspect, embodiments of the present application provide an electronic device, including: one or more processors, memories, and wireless communication modules; the above-mentioned memory and the above-mentioned wireless communication module are coupled with one or more processors, and the above-mentioned memory is used to Store computer program code. The computer program code includes computer instructions. When the one or more processors execute the computer instructions, the electronic device performs: receiving data input by the user using the first input method; determining a target result based on the first data. , the above-mentioned target result is the historical selection result of the above-mentioned user inputting the second data using the second input method, the above-mentioned first data and the above-mentioned second data correspond to the same syllable sequence, the above-mentioned target result is different from the general result corresponding to the above-mentioned syllable sequence; in The above target results are displayed in the target input interface.

In a possible implementation, when the electronic device performs the above-mentioned determination of the target result based on the above-mentioned first data, it specifically performs: searching the first language library according to the above-mentioned first data, and outputting the first result; the first language library is a variety of input methods The corresponding language library; searches the second language library according to the above-mentioned first data, and outputs the second result; the second language library is a language library generated according to the above-mentioned second data; and determines the target result according to the first result and the above-mentioned second result.

In a possible implementation, both the first language library and the second language library include words, syllable sequences corresponding to the words, and word frequencies corresponding to the words; the syllable sequences in the second language library correspond to The word with the highest word frequency is different from the word with the highest word frequency corresponding to the above-mentioned syllable sequence in the above-mentioned first language library.

In a possible implementation, the syllable sequence corresponding to the word in the second language library is part of the syllable sequence corresponding to the first data.

In a possible implementation, the syllable sequence corresponding to the first data is part of the syllable sequence corresponding to the words in the second language library.

In a possible implementation, the first input method is a voice input method, and the second input method is at least one of a keyboard input method, an image input method, and a handwriting input method.

In another possible implementation, the first input method is a keyboard input method, and the second input method is at least one of a voice input method, an image input method, and a handwriting input method.

In another possible implementation, the second result is empty and the target result is the first result.

In another possible implementation, the second result is not empty, and the target result is the second result.

In a third aspect, embodiments of the present application provide an electronic device, including: an input module, a determination module, and a display module. Among them: the input module is used to receive the first data input by the user using the first input method; the determination module is used to determine the target result based on the above-mentioned first data, and the above-mentioned target result is the historical selection of the above-mentioned user inputting the second data using the second input method. As a result, the syllable sequence corresponding to the above-mentioned first data and the above-mentioned second data are the same, and the above-mentioned target result is different from the general result corresponding to the above-mentioned syllable sequence; the display module is used to display the above-mentioned target result in the target input interface.

In a possible implementation, the above-mentioned determination module includes a first search unit, a second search unit and a determination unit; wherein the first search unit is used to output the first result according to the first data received by the input module; the first language The library is a language library corresponding to multiple input methods; the second search unit is used to output the second result according to the first data received by the input module; the second language library is a language library generated based on the above-mentioned second data; the determination unit is used to output the second result according to the first data received by the input module. The first result and the second result determine the target result.

In a possible implementation, both the first language library and the second language library include words, syllable sequences corresponding to the words, and word frequencies corresponding to the words; the syllable sequences in the second language library correspond to The word with the highest word frequency is different from the word with the highest word frequency corresponding to the above-mentioned syllable sequence in the above-mentioned first language library.

In a possible implementation, the syllable sequence corresponding to the word in the second language library is part of the syllable sequence corresponding to the first data.

In a possible implementation, the syllable sequence corresponding to the first data is part of the syllable sequence corresponding to the words in the second language library.

In a possible implementation, the first input method is a voice input method, and the second input method is at least one of a keyboard input method, an image input method, and a handwriting input method.

In another possible implementation, the first input method is a keyboard input method, and the second input method is at least one of a voice input method, an image input method, and a handwriting input method.

In another possible implementation, the second result is empty and the target result is the first result.

In another possible implementation, the second result is not empty, and the target result is the second result.

In a fourth aspect, embodiments of the present application provide a computer storage medium that includes computer instructions. When the computer instructions are run on an electronic device, the electronic device causes the electronic device to execute the method provided in the first aspect or any implementation of the first aspect. Input method.

In a fifth aspect, embodiments of the present application provide a computer program product, which when the computer program product is run on an electronic device, causes the electronic device to execute the input method provided in the first aspect or any implementation of the first aspect.

It can be understood that the electronic device mentioned above in the second aspect, the electronic device mentioned in the third aspect, the computer storage medium mentioned in the fourth aspect or the computer program product mentioned in the fifth aspect are all used to execute the method provided in the first aspect. Input method. Therefore, the beneficial effects it can achieve can be referred to the beneficial effects in the corresponding methods, and will not be described again here.

Description of the drawings

Figure 1 is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present application;

Figures 2A-2C are schematic diagrams of application scenarios involved in embodiments of the present application;

Figures 3A to 3D are schematic diagrams of the user interface of the keyboard input method provided by the embodiment of the present application;

Figure 4 is a schematic diagram of voice input provided by an embodiment of the present application;

Figure 5 is a schematic diagram of the voice input results provided by the embodiment of the present application;

6A-6G are schematic user interface diagrams of the image scanning input method provided by the embodiment of the present application;

Figure 7 is a schematic structural diagram of an electronic device provided by another embodiment of the present application;

Figure 8 is a schematic flow chart of an input method provided by an embodiment of the present application;

Figure 9 is a schematic flowchart of a specific input method provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be described clearly and in detail below with reference to the accompanying drawings.

Embodiments of the present application provide an input method that can share data between input methods of the input method and improve the recognition accuracy of voice input. That is to say, text input using a keyboard or text input using an image can be recognized when input via voice input again, thereby improving the recognition accuracy of voice input.

The electronic devices involved in the embodiments of this application may be portable mobile terminals, such as mobile phones, tablet computers, netbooks, personal digital assistants (Personal Digital Assistants, PDAs), wearable electronic devices (such as smart bracelets, smart watches, etc.), virtual Real equipment, etc.

The electronic device involved in the embodiment of the present application may include an input method application. The input method application can be a system application or a third-party application. The electronic device may also include one or more applications with input boxes. The application with the input box can be a system application, such as short message, calendar, etc., or a third-party application, such as Facebook, Amazon, map, music player, etc. Users can use an input method application to input words in the input box of an application that has an input box.

Next, exemplary electronic devices provided in the following embodiments of the present application are introduced.

FIG. 1 shows a schematic structural diagram of an electronic device 100 .

The electronic device 100 may include a processor 110, an internal memory 120, a USB interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, and an audio module 170, Speaker 170A, receiver 170B, microphone 170C, headphone interface 170D, sensor module 180, buttons 190, camera 191, display screen 192, etc. The sensor module 180 may include a gyroscope sensor 180A, an acceleration sensor 180B, a distance sensor 180C, a fingerprint sensor 180D, a temperature sensor 180E, a touch sensor 180F, etc.

It can be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100 . In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figures, or some components may be combined, some components may be separated, or some components may be arranged differently. The components illustrated may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (GPU), an image signal processor ( image signal processor (ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processing unit (NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors.

The controller can generate operation control signals based on the instruction operation code and timing signals to complete the control of fetching and executing instructions.

The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in processor 110 is cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 110 . If the processor 110 needs to use the instructions or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.

The charging management module 140 is used to receive charging input from the charger. While the charging management module 140 charges the battery 142, it can also provide power to the electronic device through the power management module 141.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charging management module 140 and supplies power to the processor 110, the internal memory 120, the display screen 192, the camera 191, the wireless communication module 160, and the like.

The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.

The mobile communication module 150 can provide solutions for wireless communication including 2G/3G/4G/5G applied on the electronic device 100 . The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, perform filtering, amplification and other processing on the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves through the antenna 1 for radiation.

The wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (bluetooth, BT), and global navigation satellite system. (global navigation satellite system, GNSS), frequency modulation (FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.

The electronic device 100 implements display functions through a GPU, a display screen 192, an application processor, and the like. The GPU is an image processing microprocessor and is connected to the display screen 192 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 192 is used to display images, videos, etc. Display 192 includes a display panel. The display panel can use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode). (AMOLED), flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diodes (QLED), etc. In this embodiment of the present application, the display screen 192 may be used to display results corresponding to data input by the user using various input methods.

Camera 191 is used to capture still images or video. The object passes through the lens to produce an optical image that is projected onto the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to convert it into a digital image signal. ISP outputs digital image signals to DSP for processing. DSP converts digital image signals into standard RGB, YUV and other format image signals. In this embodiment of the present application, the camera 191 can be used to capture a picture containing text information input by the user using an image scanning input method, so that the electronic device can recognize the text information in the picture and display the text information on the display screen 192 .

NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can continuously learn by itself. Intelligent cognitive applications of the electronic device 100 can be implemented through the NPU, such as image recognition, face recognition, speech recognition, text understanding, etc.

Internal memory 120 may be used to store computer executable program code, which includes instructions. The internal memory 120 may include a program storage area and a data storage area. Among them, the stored program area can store an operating system, at least one application program required for a function (such as a sound playback function, an image playback function, etc.). The storage data area may store data created during use of the electronic device 100 (such as audio data, phone book, etc.). In addition, the internal memory 120 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, a flash memory device, universal flash storage (UFS), and the like. The processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 120 and/or instructions stored in a memory provided in the processor. In the embodiment of the present application, the internal memory 120 can be used to store the first language library and the second language library, so that the electronic device 100 searches the first language library and the second language library respectively according to the data input by the user, obtains the target result, and The target results are displayed through the display screen 192 .

The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playback, recording, etc.

The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. Audio module 170 may also be used to encode and decode audio signals.

Speaker 170A, also called "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music through the speaker 170A, or listen to hands-free calls.

Receiver 170B, also called "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a call or a voice message, the voice can be heard by bringing the receiver 170B close to the human ear.

Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak close to the microphone 170C with the human mouth and input the sound signal to the microphone 170C. In this embodiment of the present application, the microphone 170C can be used to collect audio signals input by the user, so that the electronic device can input the audio signals into the acoustic model.

The headphone interface 170D is used to connect wired headphones.

The gyro sensor 180A may be used to determine the motion posture of the electronic device 100 . In some embodiments, the angular velocity of electronic device 100 about three axes (ie, x, y, and z axes) may be determined by gyro sensor 180A.

The acceleration sensor 180B can detect the acceleration of the electronic device 100 in various directions (generally three axes).

Distance sensor 180C, used to measure distance. Electronic device 100 can measure distance via infrared or laser.

The fingerprint sensor 180D is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to achieve fingerprint unlocking, access to application locks, fingerprint photography, fingerprint answering of incoming calls, etc.

Temperature sensor 180E is used to detect temperature.

Touch sensor 180F, also known as "touch device". The touch sensor 180F can be disposed on the display screen 192, and the touch sensor 180F and the display screen 192 form a touch screen, which is also called a "touch screen". The touch sensor 180F is used to detect a touch operation on or near the touch sensor 180F. The touch sensor can pass the detected touch operation to the application processor to determine the touch event type. Visual output related to the touch operation may be provided through display screen 192 . In other embodiments, the touch sensor 180F may also be disposed on the surface of the electronic device 100 at a location different from that of the display screen 192 . In the embodiment of the present application, the touch sensor 180F can be used to detect data input by the user using keyboard input or handwriting input, so that the electronic device outputs a result corresponding to the data and displays the result on the display screen 192 .

Next, the application scenarios involved in the embodiments of the present application will be introduced with reference to Figures 2A-2C.

FIG. 2A exemplarily shows a schematic diagram of the keyboard input mode interface of the input method.

Figure 2A shows the contact chat interface 30 of WeChat. Among them, WeChat is an instant messaging software. As shown in FIG. 2A , the user interface 30 may include: a status bar 301 , a display area 302 , an input box 303 , and a navigation bar 304 . in:

The status bar 301 may include: an operator indicator (for example, the name of the operator "China Mobile"), one or more signal strength indicators of a wireless fidelity (Wi-Fi) signal, a mobile communication signal (which may also be One or more signal strength indicators, time indicators, and battery status indicators known as cellular signals.

The display area 302 may be used to display historical chat content with the contact (Emmy).

The user can perform a click operation on the input box 303. In response to the click operation, the processor 110 of the electronic device 100 may call the input method application in the electronic device 110 and display the interface 305 of the input method application shown in FIG. 2B on the display screen 192 . This interface is an input interface with 26 alphanumeric keys. The user can input a string in the interface 305 of the input method application. The processor 110 of the electronic device 100 can search for one or more words corresponding to the string according to the string input by the user, and display the words in the interface 305 of the input method application through the display screen 192 . The user can select the word they intend to input from one or more words corresponding to the string.

It can be understood that in FIG. 2B, the interface 305 of the input method application is shown as an input interface with 26-key letter combination keys. The interface of the input method application can also be an input interface with 9-key number combination keys. The user You can also enter strings in this interface.

The navigation bar 304 may include: a return button 3041, a home screen button 3042, an outgoing task history button 3043 and other system navigation keys. The main interface is an interface displayed by the electronic device 100 after any user interface detects a user operation on the main interface button 3042 . When detecting that the user clicks the return button 3041, the electronic device 100 may display the previous user interface of the current user interface. When detecting that the user clicks the home interface button 3042, the electronic device 100 may display the home interface. When detecting that the user clicks the outgoing task history button 3043, the electronic device 100 may display tasks recently opened by the user. The navigation keys can also be named in other ways. For example, 3041 can be called Back Button, 3042 can be called Home button, and 3043 can be called Menu Button. This application does not limit this. Each navigation key in the navigation bar 304 is not limited to a virtual key, and can also be implemented as a physical key.

The interface 305 of the input method application may include an input mode switching control 3051.

The input mode switching control 3051 can be used to switch the input mode. Specifically, the electronic device 100 can detect a touch operation acting on the input mode switching control 3051 (such as a click operation on the input mode switching control 3051), and in response to the operation, the electronic device 100 can perform a touch operation on the input method application interface 305. Icons for other input methods are displayed, such as the icon 3052 for the text scanning input method, the icon 3053 for the voice input method, and the icon 3054 for the handwriting input method shown in FIG. 2C . in:

The text scanning input mode icon 3052 can be used to input words by scanning an image. Specifically, the electronic device 100 can detect a touch operation on the icon 3052 in the image scanning input mode (such as a click operation on the icon 3052 in the text scanning input mode). In response to the operation, the electronic device 100 turns on the camera 191 to scan. Picture, the scanned picture content is sent to the processor 110, the processor 110 recognizes the text or characters (letters, numbers, symbols, etc.) in the picture, and the recognition result is displayed on the interface of the input method application through the display screen 192. 305 in.

The voice input mode icon 3053 is used to input words by voice. Specifically, the electronic device 100 can detect a touch operation on the icon 3053 in the voice input mode (such as a click operation on the icon 3053 in the voice input mode). In response to the operation, the electronic device 100 can turn on the microphone 170C to collect sound. signal, the collected sound signal is sent to the processor 110, the processor 110 recognizes the words or characters (letters, numbers, etc.) corresponding to the sound signal, and the recognition result is displayed on the interface of the input method application through the display screen 192. 305 in.

The handwriting input mode icon 3054 may be used to input words by the user's handwriting. Specifically, the electronic device 100 can detect a contextual operation (such as a click operation on the icon 3054 of the handwriting input mode) that acts on the icon 3054 of the handwriting input mode. In response to the operation, the electronic device 100 can perform the input method application interface on the interface of the input method. A handwriting detection area is displayed in 305, the touch track input by the user in the handwriting detection area is detected, the words input by the user are determined based on the touch track, and the words are displayed in the input method application interface 305 through the display screen 192.

Next, the input methods provided by several embodiments of the present application will be introduced in conjunction with the aforementioned application scenarios.

Embodiment 1: keyboard input-voice input, that is, data input using the keyboard input method is shared with the voice input method.

Next, the input method provided by Embodiment 1 will be introduced in four parts.

Part One: Use keyboard input to input data and output the corresponding results.

As shown in FIG. 3A , the electronic device 100 can detect the click operation of inputting the string zhangsan and one or more letter keys (for example, the one or more letter keys can be zhangsan in sequence) in the interface 305 of the input method application. In response to the click operation, the electronic device 100 can display the input result 401 (zhang'san) in the interface 305 of the input method application, and display the option list 402 and the drop-down control 403 corresponding to the input result. The candidate list 402 may include one or more candidate options 4021.

Among them, the drop-down control 403 can be used to display more waiting options. The electronic device 100 may detect a touch operation (such as a click operation on the drop-down control 403) acting on the drop-down control 403, and in response to the operation, the electronic device 100 may update the interface 305 that displays the input method application shown in FIG. 3B.

As shown in FIG. 3B , the interface 305 of the input method application may include a list of options 402 , a scroll up control 404 , a scroll down control 405 and a return control 406 .

Among them, both the scroll up control 404 and the scroll down control 405 can be used to update the candidate options in the display candidate list 402 . The electronic device 100 may detect a touch operation on the flip-down control 405 (such as a click operation on the flip-down control 405), and in response to the operation, the electronic device 100 may update the candidate options in the display candidate list 402. The same principle applies to the flip-up control 404, which will not be described again here.

Return control 406 may be used to cause electronic device 100 to display user interface 30 shown in Figure 3A.

The above options can be the options corresponding to the complete input result “zhang’san”, or the options corresponding to the first half of the input result “zhang”.

The user can click on the options in the option list 402 of FIG. 3B to select the desired result. For example, the user can click "Zhang" in the list of options 402 to select the word corresponding to the input result "zhang". After selecting the word corresponding to the first half of the input result, the electronic device 100 can display the input method application interface 305 shown in FIG. 3C .

The input method application interface 305 shown in FIG. 3C is similar to the input method application interface 305 shown in FIG. 3B. The difference is that the list of options 402 in the interface 305 of the input method application in Figure 3B displays the options corresponding to the complete input result "zhang'san" or the options corresponding to the first half of the input result "zhang". options. The candidate list 402 in the input method application interface 305 in FIG. 3C displays the candidate options corresponding to the second half of the input result "san".

The user can click an option in the option list 402 of FIG. 3C to select an expected result. For example, the user can click "three" in the list of options 402 to select the word corresponding to the input result "san".

After the electronic device 100 determines the word corresponding to the complete input result “zhang’san”, as shown in FIG. 3D , the corresponding word “zhang’san” can be displayed in the input box 303 .

The keyboard input method involved in the embodiment of the present application may be a pinyin input method, or may be an input method through a keyboard such as the Wubi input method. The interface 305 of the input method application may include an input interface of 26-key letter combination keys, or may include an input interface of 9-key number combination keys, etc.

Next, the process of the electronic device 100 determining the result corresponding to the character string is introduced.

After receiving the string input by the user, the electronic device 100 can combine the string into multiple syllables or syllable sequences, and search for words corresponding to the multiple syllables or syllable sequences.

First, the electronic device 100 can determine multiple syllables or syllable sequences composed of the character string, and determine the possibility of each syllable or syllable sequence respectively. The electronic device 100 may preferentially display words corresponding to the most likely syllables or syllable sequences in the candidate list 402 .

The basis for determining the possibility of each syllable or syllable sequence can be obtained by collecting the usage habits of a large number of users, and further can be adjusted according to the usage habits of users who use the electronic device 100 .

For example, the string entered by the user could be xian. The syllable or syllable sequence corresponding to this string can be xi’an or xian. If multiple users made 1,000 choices, the syllable or syllable sequence corresponding to the string was chosen 600 times as xian, and the syllable sequence corresponding to the string was chosen xi’an 400 times. Then the probability that the syllable or syllable sequence corresponding to the string is xian is 60%, and the probability that the syllable sequence corresponding to the string is xi’an is 40%. The electronic device 100 may determine the syllable or syllable sequence corresponding to the character string selected by the user based on the word finally selected by the user. After the electronic device 100 determines the possibility of various syllables or syllable sequences corresponding to the character string, the electronic device 100 may preferentially display the words corresponding to the most likely syllables or syllable sequences in the waiting list 402 .

Further, if the user using the electronic device 100 makes 10 selections, 6 times the syllable sequence corresponding to the string is xi’an, and 4 times the syllable sequence corresponding to the string is xian. Then the electronic device 100 can be adjusted according to the usage habits of the user using the electronic device 100, and the possibility of determining that the syllable sequence corresponding to the string is xi'an is 60%, and the possibility of the syllable sequence corresponding to the string being xian is 40%. Then the electronic device 100 can prioritize the words corresponding to the syllable sequence xi'an in the waiting list 402.

Instead of preferentially displaying the words corresponding to the most likely syllable or syllable sequence in the candidate list 402 , the candidate list 402 may also prioritize displaying the words corresponding to the syllable or syllable sequence recently selected by the user in the candidate list 402 . For example, the last time the user using the electronic device 100 selected the syllable sequence corresponding to the string xian was xi'an, then the electronic device 100 can display the syllable sequence xi' in priority in the waiting option list 402 when the user inputs the string xian again. The word corresponding to an.

Secondly, the electronic device 100 can determine one or more words corresponding to the syllable, and determine the possibility of each word respectively. The electronic device 100 may preferentially display words with the highest probability in the candidate list 402 .

It can be known that there can be many kinds of words corresponding to syllables or syllable sequences. For example, the words corresponding to the syllable sequence xi'an can be "Xi'an", "West Bank", "Zion", etc., and the words corresponding to the syllable xian can be "Xian", "Xian", "Xian", "Xian" wait.

The electronic device 100 can collect the usage habits of a large number of users to obtain the possibility of various words corresponding to the syllable, and can further adjust the possibility according to the usage habits of the users who use the electronic device 100 .

For example, for the syllable xian, if among 1,000 selections by multiple users, 400 times the word corresponding to the syllable is "Xian", 300 times the word corresponding to the syllable is "Xian", and 200 times The word corresponding to the syllable selected for the first time is "line", and the word corresponding to the syllable selected 100 times is "Xian". Then the possibility of the word corresponding to this syllable being "Xian" is 40%, the possibility of the word corresponding to this syllable being "Xian" is 30%, and the possibility of the word corresponding to this syllable being "Xian" is 20% %, the probability that the word corresponding to this syllable is "fresh" is 10%. After the electronic device 100 determines the possibility of various character strings corresponding to the syllable, the electronic device 100 may preferentially display the word with the highest possibility in the candidate list 402 .

Further, if among the 10 selections made by the user using the electronic device 100, 5 times the word corresponding to the syllable is selected as "Xian", 3 times the word corresponding to the syllable is selected as "Xian", and 1 time Selecting the word corresponding to this syllable is "now", and once selecting the word corresponding to this syllable is "xian". Then the electronic device 100 can be adjusted according to the usage habits of the user using the electronic device 100, and determine that the possibility of the word corresponding to the syllable is "Xian" is 50%, and the possibility of the word corresponding to the syllable is "线" is 30%, the probability that the word corresponding to this syllable is "Xian" is 10%, and the probability that the word corresponding to this syllable is "Xian" is 10%. Then the electronic device 100 can display the word "fresh" first in the waiting list 402 .

Instead of preferentially displaying words with the highest probability in the candidate list 402 , the word corresponding to the syllable recently selected by the user may also be prioritized in the candidate list 402 . For example, if the last time the user using the electronic device 100 selected the word corresponding to the syllable xian was "Xian", the electronic device 100 may display the word "Xian" first in the waiting option list 402 when the user inputs the syllable xian again.

The above-mentioned way of preferentially displaying words in the candidate list 402 may be to display them in the leftmost column or the top row of the candidate list 402 .

Part 2: Generate personalized language library.

Specifically, the electronic device 100 can save the character string input by the user using the keyboard and the word corresponding to the character string finally selected by the user in the personalized language library. The personalized language library may be a certain storage area in the internal memory 120 . The electronic device 100 can determine the syllable or syllable sequence corresponding to the string and the word corresponding to the syllable or syllable sequence according to the personalized language library, and record the number of times the word is selected (ie, word frequency). Therefore, the finally generated personalized language library can conform to the usage habits of the user using the electronic device 100 .

For example, if the user inputs the string zhangsan using the keyboard, and the user finally selects the word corresponding to the string "Zhang San", then the electronic device 100 can determine that the syllable sequence corresponding to the string zhangsan is zhang'san, and the syllable sequence zhang' The corresponding word for san is "Zhang San", not "Zhang San".

Part 3: Enter data using voice input.

After the user clicks the icon 3053 in Figure 2B, the electronic device 100 can display the input method application interface 305 shown in Figure 4, turn on the microphone 170C (the position of the microphone 170C is exemplarily shown in Figure 4), and start collecting sound signals. . At this point, the user can input audio signals.

Specifically, the electronic device 100 can extract audio features of the audio signal input by the user, input the audio features into the acoustic model, and output syllables or syllable sequences. Next, taking the output syllable sequence as zhang’san as an example, the following fourth part will be explained as an example.

Part 4: Search the general language library and personalized language library, and output the final results.

After the electronic device 100 determines that the syllable sequence output by the acoustic model is zhang'san, it searches for the results corresponding to the syllable sequence in the general language library and the personalized language library respectively, and based on the results of searching the general language library and the results of searching the personalized language library The result determines the final result, and the final result is displayed in the input box 303 shown in Figure 5.

Specifically, the universal language library is a preset language library that can be obtained based on data input by a large number of users using multiple input methods. Therefore, the general language library can meet the usage habits of most users. The general language library may be the language library that comes with the input method when the user downloads the input method. The general language library may also be the language library that comes with the electronic device 100 .

Specifically, the general language library may include, but is not limited to, a variety of words, the syllable sequence corresponding to each word, and the word frequency corresponding to the word. In addition, the general language library can also be used to calculate the scores of candidate words in the sentence structure, so that the electronic device 100 preferentially displays the candidate words with the highest scores in the candidate list 402 . Possibly, the same syllable sequence can correspond to a variety of different words, and the corresponding word frequencies of these words can be different.

After determining the syllable or syllable sequence corresponding to the audio signal input by the user, the electronic device 100 can search the general language library to determine the most likely result corresponding to the syllable or syllable sequence. The result with the highest probability of finding a general language library is called the first result.

The electronic device 100 may also search the personalized language library after determining the syllable or syllable sequence corresponding to the audio signal input by the user, and determine the result with the highest probability corresponding to the syllable or syllable sequence. The result with the highest probability of finding a personalized language library is called the second result.

The most likely result in the above-mentioned personalized language library may be the result selected by the user the most, or may be the result selected by the user most recently, which is not limited in the embodiments of the present application.

The results of searching for a general language library and the results of searching for a personalized language library may be in the following situations:

Case 1: The first result and the second result are consistent. At this time, the final output result using voice input is the first result and the second result.

Scenario 2: The first result and the second result are inconsistent. At this time, the final result using voice input is the second result. That is, if the first result and the second result are inconsistent, the second result shall prevail.

Case 3: The first result exists, but the second result does not exist or the second result is empty. At this time, the final result using voice input is the first result.

In addition, the embodiment of the present application does not limit the order in which the general language library and the personalized language library are searched. The time relationship between the general language library search and the personalized language library search can also be performed at the same time.

For example, after the electronic device 100 determines that the syllable sequence corresponding to the audio signal input by the user is zhang'san, it searches for the most likely result corresponding to the syllable in the general language library as "Zhang San", and searches for it in the personalized language library. The most likely result corresponding to this syllable is "Zhang 3". That is, if the first result is "Zhang San" and the second result is "Zhang San", then the final result corresponding to the audio signal input by the user is "Zhang San".

Implementing the embodiments of the present application can share the data input by the user using the keyboard input method to the voice input method. When using voice input, the input result can be determined based on the historical data input by the user using the keyboard input method and the usage habits of the public. Enhance the processing capabilities of electronic devices for input data, improve the accuracy of speech recognition, and improve user input efficiency.

Embodiment 2: Image scanning input-voice input, that is, data input using the image scanning input method is shared with the voice input method.

Next, the input method provided by Embodiment 2 will be introduced in four parts.

Part One: Use image scanning input method to input data and output the corresponding results.

As shown in FIG. 2C , the electronic device 100 can detect a touch operation on the icon 3052 in the image scanning input mode (such as a click operation on the icon 3052 in the text scanning input mode). In response to the operation, the electronic device 100 turns on The camera 191 scans the picture and displays the scanning interface.

For example, as shown in FIG. 6A , the scanning interface 70 may include: a scanning content preview area 701 , a scanning requirement prompt box 702 , a scanning control 703 , a return control 704 and a reference line 705 . in:

Scan content preview area 701 may be used to display images captured by camera 191.

The scan request prompt box 702 can be used to display scan requirements and prompt the user to scan according to the requirements.

Scan control 703 can be used to determine what to scan. The electronic device 100 can detect a touch operation on the scan control 703 (such as a click operation on the scan control 703). In response to the operation, the electronic device 100 can determine that the image captured by the camera 191 at the current moment is the scan content. , extract the area with text in the scanned content. In the subsequent description, the area with text will be simply referred to as the text area.

Return control 704 may be used to cause electronic device 100 to display user interface 30 shown in Figure 2C.

The reference line 705 may be used to prompt the user to make the direction of the text in the scanned image parallel to the reference line 705 so that the electronic device 100 can identify the text in the scanned image.

In response to the touch operation on the scan control 703, the electronic device 100 may also display the user interface 80 shown in FIG. 6B.

For example, as shown in FIG. 6B , the user interface 80 may include: a text area 801A, a text area 801B, a determination control 802 and a return control 803 .

Among them, the text area 801A and the text area 801B are areas containing text extracted by the electronic device 100 from the scanned content. Both text area 801A and text area 801B can be used to determine the text area to be selected. The electronic device 100 can detect a touch operation acting on the text area 801A and/or the text area 801B (such as a click operation on the text area 801A and/or the text area 801B). In response to the operation, the electronic device 100 can specifically The text area 801A or the text area 801B is displayed to prompt the user that the text area 801A and/or the text area 801B is the text area to be selected. The special display method may be, for example, but is not limited to, boldly displaying the border of the text area to be selected. For details, reference may be made to the text area 801B shown in FIG. 6C.

The determination control 802 can be used to determine the target text area. The electronic device 100 can detect a touch operation on the determination control 802 (such as a click operation on the determination control 802), and in response to the operation, the electronic device 100 can determine the text area to be selected as the target text area, and display FIG. 6D User interface 90 is shown.

The return control 803 may be used to cause the electronic device 100 to display the user interface 70 shown in Figure 6B.

As shown in FIG. 6D , the user interface 90 may include: a target text area display box 901 , a scan result display area 902 , a send control 903 , a copy control 904 and a return control 905 . in:

The target text area 901 can be used to display the target text area.

The scan result display area 902 may be used to display the content extracted by the electronic device 100 from the target text area, that is, the scan result.

Send control 903 may be used to cause scan results to be displayed in input box 305 . The electronic device 100 can detect a touch operation (such as a click operation on the sending control 903) acting on the sending control 903. In response to the operation, the electronic device 100 can display the user interface 30 shown in FIG. 6E. The user interface 30 The scan results can be displayed in the input box 303.

Copy control 904 can be used to copy scan results.

Return control 905 may be used to cause electronic device 100 to display user interface 80 shown in Figure 6C.

Part 2: Generate personalized language library.

Specifically, the electronic device 100 can save the text input by the user using the image scanning input method in the personalized language library. In addition, the electronic device 100 can also save the syllables or syllable sequences corresponding to the text input by the user using the image scanning input method in the personalized language library. Therefore, the finally generated personalized language library can conform to the usage habits of the user using the electronic device 100 . The personalized language library may be a certain storage area in the internal memory 120 . The results saved in the personalized language database may include words, the syllable sequence corresponding to the word, and the number of times the word is selected (ie, word frequency), etc. Possibly, the same syllable sequence can correspond to a variety of different words, and the corresponding word frequencies of these words can be different.

For example, the result input by the user using image scanning is "Room 1006, Building B17, Financial Port, East Lake High-tech Zone, Wuhan City, Hubei Province". The results that the electronic device 100 can save in the personalized language library can be exemplified in the following table:

Table 1 List of results in the personalized language library

words syllable sequence word frequency hubei province hu’bei’sheng 8 Wuhan wu’han’shi 10 East Lake High-tech Zone dong’hu’gao’xin’qu 13 financial port jin’rong’gang 6 Building B17 bi’shi’qi’dong 8 Room 1006 yi’ling’ling’liu’shi 9

It is not limited to the words listed in Table 1. In specific implementation, the words stored in the personalized language library can also be other words, which are not limited in the embodiments of the present application.

It can be known that the word frequencies corresponding to each word listed in Table 1 are examples, and are actually recorded based on historical data input by the user. The word frequencies listed above do not limit the embodiments of the present application.

Part 3: Enter data using voice input.

Specifically, the third part in this embodiment is similar to the third part in Embodiment 1.

Assume that the electronic device 100 extracts the audio features of the audio signal input by the user, and after inputting the audio features into the acoustic model, the output syllable sequence is hu'bei'sheng'wu'han'shi'dong'hu'gao'xin 'qu'jin'rong'gang'bi'shi'qi'dong'yi'ling'ling'liu'shi.

The syllable sequence corresponding to the input audio signal is not limited to the syllable sequence corresponding to the input result using the image scanning method. In a specific implementation, the syllable sequence corresponding to the input audio signal may be the syllable sequence corresponding to the result input using the image scanning method. A part of the sequence, for example as shown in Figure 6F, the syllable sequence output according to the audio signal input by the user may be dong'hu'gao'xin'qu.

On the contrary, the syllable sequence corresponding to the input result using the image scanning input method can also be part of the syllable sequence corresponding to the input audio signal. For example, as shown in Figure 6G, the syllable sequence output according to the audio signal input by the user can be wo'yao 'qu'dong'hu'gao'xin'qu.

Part 4: Search the general language library and personalized language library, and output the final results.

Specifically, the fourth part in this embodiment is similar to the fourth part in Embodiment 1, and will not be described again here.

Implementing the embodiments of the present application can share the data input by the user using the image scanning method to the voice input method. When using voice input, the input result can be determined based on the historical data input by the user using the image scanning method and the usage habits of the public. Improve the accuracy of speech recognition and improve user input efficiency.

Embodiment 3: Voice input-keyboard input, that is, data input using the voice input method is shared with the keyboard input method.

Next, the input method provided by Embodiment 3 will be introduced in four parts.

Part One: Use voice input to input data and output the corresponding results.

Specifically, the process of the user inputting data using the voice input method can be referred to Figure 4, which will not be described again here.

Assume that the electronic device 100 extracts the audio features of the audio signal input by the user in the voice input mode, inputs the audio features into the acoustic model, and the output syllable sequence is wu’he’da’dao. The electronic device 100 may display in the input box 303 that the most likely result corresponding to the syllable sequence is "Five Rivers Avenue". If the result does not meet the user's expectations, the user can use keyboard input again in the input box to edit, for example, "river" can be changed to "and". The electronic device 100 may determine that the modified result “五和大道” is a word corresponding to the syllable sequence wu’he’da’dao.

It is not limited to changing some results, such as changing "river" to "和" as mentioned above. In the specific implementation, the user can also use the keyboard input method to edit all the results again in the input box, for example, changing the speech recognition result "五河" Delete all "Avenue" and edit again using keyboard input. The electronic device 100 can confirm that the re-edited result is the word corresponding to the syllable sequence wu’he’da’dao. The embodiments of the present application do not limit this.

Part 2: Generate personalized language library.

The electronic device 100 can save the syllable sequence (such as wu'he'da'dao) corresponding to the audio signal input by the user in the voice input mode and the finally determined word corresponding to the syllable sequence (such as "五和大道") in the personalized language database, and record the number of times the word is selected (i.e. word frequency). The personalized language library may be a certain storage area in the internal memory 120 . Therefore, the finally generated personalized language library can conform to the usage habits of the user using the electronic device 100 .

Part 3: Enter data using keyboard input.

Specifically, the process of the user inputting data using the keyboard input method can be referred to FIG. 3A , which will not be described again here. Next, taking the string input by the user using the keyboard input mode as wuhedadao as an example, the fourth part will be explained exemplarily.

Part 4: Search the general language library and the personalized language library, determine the final result, and display the final result first in the waiting list 402.

Specifically, the process of determining the final result in this embodiment is similar to the fourth part in Embodiment 1, and will not be described again here.

For example, the electronic device 100 may determine that the syllable sequence corresponding to the string wuhedadao is wu’he’da’dao. The electronic device 100 can search the universal language library and determine that the result corresponding to the syllable sequence is "五河道", that is, the first result is "五河道". The electronic device 100 can search the personalized language library and determine that the result corresponding to the syllable sequence is "五和大道", that is, the second result is "五和大道". The electronic device 100 may display the second result "Wuhe Avenue" first in the waiting option list 402, and secondly display the first result "Wuhe Avenue".

Implementing the embodiments of the present application can share the data input by the user using the voice input mode to the keyboard input mode, and prioritize the options that conform to the user's voice input habits in the waiting option list of the keyboard input mode, reducing the user's search for target options in the waiting option list. time to improve user input efficiency.

Not limited to the above-mentioned embodiments, in a specific implementation, the data input by the image scanning input method can also be shared with the keyboard input method, and the data input by the handwriting input method can also be shared with the keyboard input method or the voice input method. Specifically, The implementation process may be similar to the previous three embodiments and will not be described again here.

It is not limited to the user interface shown in Figure 4. In a specific implementation, the user can input audio data through the voice assistant. The embodiment of the present application does not limit the user interface for inputting audio data. Specifically, when audio data is input through the voice assistant, the electronic device 100 may display any user interface, or the electronic device 100 may be in a screen lock state or a screen off state. The electronic device can display the speech recognition results in the interface of the voice assistant. Among them, the voice assistant may be a function of the electronic device 100, and the function usually needs to be awakened through a specific keyword. The keyword may be, for example, but is not limited to, "xiaoyi xiaoyi".

Next, an electronic device provided by another embodiment of the present application is introduced.

As shown in FIG. 7 , the electronic device 100 may include an input module 810 , a general language library 820 , a personalized language library 830 , a determination module 840 and a display module 850 . in:

The input module 810 may be used to receive data input by a user.

Specifically, when the user uses voice input to input data, the input module 810 may be the microphone 170C. When the user inputs data using keyboard input or handwriting input, the input module 810 may be a touch sensor 180F. When the user inputs data using the image scanning input method, the input module 810 may be the camera 191 .

The universal language library 820 may output the first result according to the data received by the input module 810 .

Specifically, the universal language library 820 can be a preset language library, which can be obtained based on data input by a large number of users using multiple input methods. In the embodiment of this application, the general language library may be called the first language library.

Specifically, the general language library may include, but is not limited to, a variety of words, the syllable sequence corresponding to each word, and the word frequency corresponding to the word. In addition, the general language library can also be used to calculate the scores of candidate words in the sentence structure, so that the electronic device 100 preferentially displays the candidate words with the highest scores in the candidate list 402 . Possibly, the same syllable sequence can correspond to a variety of different words, and the corresponding word frequencies of these words can be different.

The personalized language library 830 may output the second result according to the data received by the input module 810. In the embodiment of this application, the personalized language library may be called a second language library.

Specifically, when the user inputs data using the keyboard input method, the personalized language database 830 may record the user's input using other input methods other than the keyboard input method (such as image scanning input method, voice input method, and handwriting input method). data.

When the user inputs data using the voice input method, the personalized language database 830 may record the data input by the user using other input methods besides the voice input method (such as image scanning input method, keyboard input method, and handwriting input method).

The above-mentioned general language library 820 and personalized language library 830 may be a certain storage area in the internal memory 120 .

The determining module 840 may be configured to receive the first result output by the general language library 820 and the second result output by the personalized language library 830, and determine the final result according to the first result and the second result. In the embodiment of this application, the final result may be called the target result.

The display module 850 is used to display the above final result in the target input interface. Specifically, the display module 850 may be the display screen 192. The target input interface may be a user interface of an application having an input box. Applications with input boxes can be system applications, such as text messages, calendars, etc., or third-party applications, such as Facebook, Amazon, maps, music players, etc. The target input interface can also be the interface of the voice assistant.

The electronic device provided by the embodiment of the present application can integrate user data of different input methods, share data in different input methods, and improve user input efficiency.

Next, the input method provided by the embodiment of this application is introduced.

As shown in Figure 8, the input method provided by the embodiment of the present application may include at least the following steps:

S901: Receive the first data input by the user using the first input method.

Specifically, the first input method may be the voice input method or keyboard input method mentioned in the previous embodiment. Among them, the keyboard input method may be Pinyin input method or Wubi input method.

For the process of the user inputting data using the voice input method, reference can be made to the description in the third part of Embodiment 1 or Embodiment 2, which will not be described again here.

The user may refer to the description in FIG. 3A or the description in the third part of Embodiment 3 for the process of inputting data using the keyboard input method, which will not be described again here.

S902: Determine the target result based on the first data. The target result is the historical selection result of the user inputting the second data using the second input method. The syllable sequence corresponding to the first data and the second data is the same, and the target result is the universal corresponding to the syllable sequence. The results are different.

Wherein, the historical selection results are the results selected by the user before using other input methods to input the second data. Universal results are results that are consistent with the usage habits of most users.

For example, if the first input method is a voice input method, the input first data is an audio signal, and the audio features extracted according to the audio signal are input into the acoustic model and the output syllable sequence can be zhang'san, and the second input method is In the keyboard input mode, the second data is the string zhangsan. The historical selection result of the user inputting the second data using the second input mode is "Zhang San", and the general result corresponding to the syllable sequence zhang'san is "Zhang San". It can be seen that the target result determined based on the first data is "Zhang San", not "Zhang San".

That is to say, the target result is not in line with the public's usage habits, but it is related to the data input by the user using other input methods, and is in line with the user's usage habits when using other input methods to input data.

In a specific implementation manner, the above S902 may include the following steps:

S9021: Search the first language library according to the first data input by the user, and output the first result.

Specifically, the first language library may be the general language library mentioned in the previous embodiment. The universal language library can be a preset language library, which can be obtained based on data input by a large number of users using multiple input methods. The general language library may be the language library that comes with the input method when the user downloads the input method. The general language library may also be the language library that comes with the electronic device 100 .

Specifically, the general language library may include, but is not limited to, a variety of words, the syllable sequence corresponding to each word, and the word frequency corresponding to the word. In addition, the general language library can also be used to calculate the scores of candidate words in the sentence structure, so that the electronic device 100 preferentially displays the candidate words with the highest scores in the candidate list 402 . Possibly, the same syllable sequence can correspond to a variety of different words, and the corresponding word frequencies of these words can be different.

S9022: Search the second language library according to the first data input by the user, and output the second result.

Specifically, the second language library may be the personalized language library mentioned in the previous embodiment. The personalized language library can record data input by the user using other input methods other than the first input method.

Possibly, the word with the highest word frequency corresponding to the syllable sequence in the personalized language database is inconsistent with the word with the highest word frequency corresponding to the syllable sequence in the general language database. That is, the personalized language library records the usage habits of the user who uses the electronic device, while the general language library records the usage habits of the public. The user's own usage habits are different from the usage habits of the public.

Possibly, the syllable sequence corresponding to the data input by the user using the first input method may be part of the syllable sequence corresponding to the data recorded in the personalized language library. For example, the syllable sequence corresponding to the data input by the user using the first input method may be gao’xin’qu, and the syllable sequence corresponding to the data recorded in the personalized language library may be dong’hu’gao’xin’qu.

On the contrary, the syllable sequence corresponding to the data recorded in the personalized language library may also be part of the syllable sequence corresponding to the data input by the user using the first input method. For example, the syllable sequence corresponding to the data input by the user using the first input method may be wo'yao'qu'dong'hu'gao'xin'qu, and the syllable sequence corresponding to the data recorded in the personalized language library may be dong' hu'gao'xin'qu.

The input methods included in the electronic device 100 may include but are not limited to: keyboard input method, voice input method, image scanning input method, and handwriting input method.

If the first input method is voice input, the personalized language library can record data input by the user using keyboard input, image scanning input, and handwriting input.

If the first input method is keyboard input, the personalized language library can record data input by the user using image scanning, voice input, and handwriting input.

The second result may or may not exist. When the second result does not exist, it can be regarded that the second result output by the second language library is empty.

The keyboard input method involved in the embodiment of the present application may be a Pinyin input method or a Wubi input method. The interface 305 of the input method application may include an input interface of 26-key letter combination keys, or may include an input interface of 9-key number combination keys.

It can be understood that the embodiment of the present application does not limit the order in which the above-mentioned S9021 and S9022 are implemented.

S9023: Determine the target result based on the first result and the second result.

Possibly, the first result and the second result are consistent. The target result is the first result or the second result.

Possibly, the first result and the second result are inconsistent, and the second result is not empty. The target result is the secondary result.

Possibly, the first result and the second result are inconsistent, and the second result is empty. The target result is the first result.

S903: Display the target result in the target input interface.

Specifically, after the target result is determined, the target result can be displayed in the target input interface.

If the user inputs audio data through an application with an input box, such as WeChat, the electronic device 100 can display the target result in the input box 303 in the WeChat interface. The target input interface is a user interface provided with the input box 303 that receives voice data input by the user. For example, the user interface shown in Figure 5.

If the user inputs audio data through the voice assistant after waking up the voice assistant, the electronic device 100 can display the target result in the interface of the voice assistant. The interface of the voice assistant is the target input interface.

Implementing the embodiments of the present application can integrate data input by users of the electronic device using different input methods, share data in different input methods, enhance the electronic device's ability to process input data, and make the output results better than existing ones. It is more in line with users' usage habits and improves user input efficiency.

In some other embodiments, the data input by the user using the first input method is searched in the first language library, and a first result corresponding to the complete input data is obtained. When searching in the second language library, it is found that the second result exists in a part of the input data, but does not exist in another part of the input data. Then the final result may be the splicing result of the result of another part of the input data in the first language library (that is, the result corresponding to the other part in the first result) and the above-mentioned second result.

For example, the user uses voice input to input an audio signal, and the corresponding syllable sequence obtained based on the audio signal is wo’ming’tian’yao’he’xiao’ming’yi’qi’qu’guang’jie. The first result obtained by searching the above syllable sequence in the first language library is "I want to go shopping with Xiao Ming tomorrow." In the second language library, it is found that the syllable sequence xiao'ming corresponding to a part of the input audio signal has a second result of "小明", and other syllable sequences do not have a second result. Then the final result can be to splice the results in the first result except the syllable sequence xiao’ming with the second result, and the final result obtained is "I want to go shopping with Xiao Ming tomorrow."

It should be noted that the application program that provides the first input method and the application program that provides the second input method may be the same or different. For example, an application that provides a keyboard input method may be an input method, and an application that provides a voice input method may be a voice assistant, etc.

Next, a specific input method provided by the embodiment of the present application is introduced.

As shown in Figure 9, the input method can include the following steps:

S1001: Receive the user operation of inputting the string wuhedadao using the keyboard input method.

Specifically, the user can input the above string in the application interface of the input method.

S1002: Receive a user operation for determining that the result corresponding to the above string is "Wuhe Avenue".

Specifically, the process by which the user determines the result corresponding to the above character string can refer to the process shown in FIG. 3A to FIG. 3D .

In the embodiment of the present application, the keyboard input method is the second input method, the data input by the user using the second input method is the string wuhedadao, and the historical selection result is "Wuhe Avenue".

S1003: Save the above string and the result corresponding to the string to the personalized language library.

S1004: Receive audio signals input using voice input.

Specifically, the user can use a voice assistant to input the above audio signal, the user can also use Google Maps to input the above audio signal, and the user can also use an input method to input the above audio signal. The embodiments of the present application do not limit this.

In the embodiment of the present application, the voice input method is the first input method, and the audio signal input by the user is the first data.

S1005: Determine the syllable sequence corresponding to the above audio signal to be wu’he’da’dao.

Specifically, the electronic device 100 can extract the audio features of the audio signal, and input the audio features into the acoustic model to obtain the syllable sequence corresponding to the audio signal.

S1006: Search the general language library and determine that the first result is "Five Rivers Avenue".

In the embodiment of this application, “Wuhe Avenue” is the general result corresponding to the syllable sequence wu’he’da’dao.

S1007: Search the personalized language library and determine that the second result is "Wuhe Avenue".

In the embodiment of this application, "Wuhe Avenue" is the historical selection result.

S1008: Compare the first result and the second result, and determine that the target result is "Wuhe Avenue".

As can be seen, the target results are different from the universal results and the same as the historical selection results.

S1009: Display the target result "Wuhe Avenue" in the target input interface.

Specifically, if the user uses the voice assistant to input audio signals in S1004, the target input interface is the interface of the voice assistant; if the user uses Google Maps to input the above audio signals in S1004, the target input interface is the interface of Google Maps; if the user In S1004, the input method is used to input the audio signal. The target input interface may be a user interface that receives voice data input by the user, such as the user interface shown in Figure 5.

Specifically, when the first result and the second result are inconsistent, the second result shall take priority, that is, the second result shall be given priority as the target result. Because the second result is the result of searching the personalized language library, and the personalized language library is obtained based on the data input by the user of the electronic device using other input methods. Therefore, the results output by the personalized language library are more in line with the user's usage habits, with higher accuracy and high user input efficiency.

Embodiments of the present application also provide a computer-readable storage medium. The computer-readable storage medium stores instructions, which when run on a computer or processor, cause the computer or processor to execute one of the above methods. or multiple steps. If each component module of the above-mentioned electronic device is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in the computer-readable storage medium.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in or transmitted over a computer-readable storage medium. The computer instructions may be transmitted from one website, computer, server or data center to another website through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) means. , computer, server or data center for transmission. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains one or more available media integrated. The available media may be magnetic media (eg, floppy disk, hard disk, magnetic tape), optical media (eg, DVD), or semiconductor media (eg, solid state disk (SSD)), etc.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments are implemented. This process can be completed by instructing relevant hardware through a computer program. The program can be stored in a computer-readable storage medium. When the program is executed, , may include the processes of the above method embodiments. The aforementioned storage media include: ROM, random access memory (RAM), magnetic disks, optical disks and other media that can store program codes.

Claims (9)

1. An input method, comprising:

receiving first data input by a user in a first input mode;

determining a target result according to the first data, wherein the target result is a history selection result of the user inputting second data in a second input mode, the syllable sequence corresponding to the first data and the syllable sequence corresponding to the second data are the same, and the target result is different from a universal result corresponding to the syllable sequence;

displaying the target result in a target input interface;

the determining a target result according to the first data comprises:

searching a first language library according to the first data, and outputting a first result; the first language library is a universal language library;

Searching a second language library according to the first data, and outputting a second result; the second language library is a language library generated according to the second data;

determining a target result according to the first result and the second result; the second result is not null, and the target result is the second result;

the first language library and the second language library comprise words, syllable sequences corresponding to the words and word frequencies corresponding to the words;

and the word with highest word frequency corresponding to the syllable sequence in the second language library is different from the word with highest word frequency corresponding to the syllable sequence in the first language library.

2. The method of claim 1, wherein syllable sequences corresponding to words in the second language library are part of syllable sequences corresponding to the first data.

3. The method of claim 1, wherein the syllable sequence corresponding to the first data is part of a syllable sequence corresponding to a word in the second language library.

4. The method of any of claims 1-3, wherein the first input mode is a voice input mode and the second input mode is at least one of a keyboard input mode, an image scan input mode, and a handwriting input mode.

5. The method of any of claims 1-3, wherein the first input mode is a keyboard input mode and the second input mode is at least one of a voice input mode, an image input mode, and a handwriting input mode.

6. The method of any one of claims 1-5, wherein the second result is null and the target result is the first result.

7. An electronic device, comprising: one or more processors and memory;

the memory being coupled to the one or more processors, the memory being for storing computer program code comprising computer instructions which, when executed by the one or more processors, the electronic device performs the input method of any of claims 1-6.

8. A computer storage medium comprising computer instructions which, when run on an electronic device, cause the electronic device to perform the input method of any of claims 1-6.

9. A computer program product, characterized in that the computer program product, when run on an electronic device, causes the electronic device to perform the input method according to any of claims 1-6.