WO2026007110A1 - Writing method, interactive tablet and storage medium - Google Patents

Abstract

Provided in the present application are a writing method, an interactive tablet and a storage medium. The method comprises: when it is confirmed that a movement operation is executed by a preset touch object, displaying a writing layer overlaid on an interface; when a text editing box that has obtained an input focus exits or the movement operation points to a certain text editing box, displaying a toolbar at a preset position of the text editing box; after it is confirmed that the movement operation has ended, displaying, in the text editing box, text content corresponding to the movement operation, and closing the writing layer; and upon receiving an operation on a certain text editing control in the toolbar, editing the text content on the basis of an editing method corresponding to the text editing control. In the present application, the text content can be edited by means of the text editing control in the toolbar, so that the text content can be edited without invoking a soft keyboard, and thus the editing process of the text content can be simplified, and then the input efficiency of the text content can be improved.

Description

A writing method, an interactive flat panel, and a storage medium Technical Field

This application relates to the field of terminal technology, and more specifically, to a writing method, an interactive flat panel, and a storage medium.

Background Technology

Currently, interactive whiteboards typically support handwriting input mode. In handwriting input mode, users can quickly input text content into the interactive whiteboard using a stylus, thereby improving the efficiency of text input.

While handwriting input can improve the efficiency of text input, it has certain limitations when editing already entered text. For example, when inserting a space character into the text, handwriting input usually does not support space characters, requiring the use of the on-screen keyboard. Furthermore, when deleting some or all characters from the text, the common practice in handwriting input is to draw an underline on the character to be deleted. This method lacks visual clarity and is not easily mastered by users, often requiring them to use the on-screen keyboard to delete characters. In short, while handwriting input can improve the efficiency of text input, it may require frequent switching between input modes when editing already entered text, resulting in lower overall input efficiency.

Summary of the Invention

This application provides a writing method, an interactive whiteboard, and a storage medium, which improves the efficiency of text content input.

In a first aspect, a writing method is provided, comprising: displaying a first interface, the first interface including at least one text editing box; receiving a first movement operation occurring on the first interface; confirming that the first movement operation is performed by a preset first touch object; overlaying and displaying a first writing layer of a first writing application on the first interface; adding and displaying a first handwriting based on the first movement operation on the first writing layer; when the first movement operation points to a target text editing box in the at least one text editing box, after confirming that the first movement operation has terminated, obtaining text content in a standard font based on the first handwriting; displaying the text content in the target text editing box; displaying a toolbar at a preset position in the target text editing box; and closing the first writing layer; wherein the toolbar includes at least one text editing control; and after displaying the text content in the target text editing box, upon receiving an operation on a target text editing control among the at least one text editing controls, editing the displayed text content according to a first editing method corresponding to the target text editing control; and displaying the edited text content in the target text editing box.

The above technical solution receives a first movement operation occurring on a first interface, confirms that the first movement operation is performed by a preset first touch object, overlays and displays a first writing layer of a first writing application on the first interface, and adds and displays first handwriting based on the first movement operation on the first writing layer. When the first movement operation points to a target text editing box in at least one text editing box, after confirming that the first movement operation has terminated, text content in a standard font is obtained based on the first handwriting, the text content is displayed in the target text editing box, a toolbar is displayed at a preset position in the target text editing box, and the first writing layer is closed. When receiving an operation on a target text editing control in at least one text editing control, the displayed text content is edited according to the first editing method corresponding to the target text editing control, and the edited text content is displayed in the target text editing box. Because this method displays a toolbar at a preset position in the text editing box during the process of inputting text content into the text editing box, the toolbar includes one or more text editing controls. For text content that has already been entered into a text editing box, users can edit the text content using the text editing controls within the text editing box. This eliminates the need to call the soft keyboard and frequently switch input modes, thus simplifying the text editing process and improving text input efficiency.

Secondly, a writing method is provided, comprising: displaying a first interface, the first interface including at least one text editing box; receiving a first movement operation occurring on the first interface; confirming that the first movement operation is performed by a preset first touch object, and overlaying a first writing layer of a first writing application on the first interface; when there is a target text editing box with input focus in the at least one text editing box, displaying a toolbar at a preset position of the target text editing box, and adding and displaying a first writing stroke on the first writing layer based on the first movement operation; wherein the toolbar includes at least one text editing control; after confirming that the first movement operation has terminated, obtaining text content in a standard font based on the first writing stroke; wherein the input focus is triggered by a click operation occurring on the first interface; displaying the text content in the target text editing box and closing the first writing layer; and, after displaying the text content in the target text editing box, upon receiving an operation on a target text editing control among the at least one text editing controls, editing the displayed text content according to a first editing method corresponding to the target text editing control; and displaying the edited text content in the target text editing box.

The above technical solution receives a first movement operation occurring on a first interface, confirms that the first movement operation is performed by a preset first touch object, and overlays and displays a first writing layer of a first writing application on the first interface. When at least one text editing box contains a target text editing box that has received input focus, a toolbar is displayed at a preset position of the target text editing box, and a first writing stroke is added and displayed on the first writing layer based on the first movement operation; after confirming that the first movement operation has terminated, a standard font text is obtained based on the first writing stroke. This method displays text content in a target text editing box and closes the first writing layer. Upon receiving an operation on a target text editing control within at least one text editing control, the displayed text content is edited according to the first editing mode corresponding to the target text editing control, and the edited text content is displayed in the target text editing box. Because this method displays a toolbar at a preset position in the text editing box during the process of inputting text content, and the toolbar includes one or more text editing controls, users can edit the text content in the text editing box using the text editing controls within the text editing box. This eliminates the need to call the soft keyboard and frequently switch input modes, simplifying the text editing process and improving text input efficiency.

Optionally, the step of overlaying and displaying the first writing layer of the first writing application on the first interface includes: overlaying and displaying the first writing layer of a first size on the first interface; wherein the area of the first writing layer of the first size is larger than the area of the target text editing box and smaller than the area of the first interface; obtaining the duration of the first movement operation; and when the duration is greater than a preset duration, displaying the first writing layer of a second size; wherein the second size is larger than the first size.

Optionally, the at least one text editing control includes an input control for inputting a space character and a delete control for deleting characters; the step of editing the displayed text content according to the first editing method corresponding to the target text editing control includes: determining the text editing position from the displayed text content; if the target text editing control is the input control, inputting a space character at the text editing position; or, if the target text editing control is the delete control, deleting characters in the text content that are located before the text editing position.

Optionally, the at least one text editing control includes a switching control for switching input methods, and the method further includes: hiding the toolbar when an operation on the switching control is received; and displaying a soft keyboard after hiding the toolbar, so as to edit the text content in the target text editing box through the soft keyboard.

Optionally, displaying the toolbar at a preset position in the target text editing box includes: hiding the soft keyboard corresponding to the target text editing box; and displaying the toolbar at the preset position after hiding the soft keyboard.

Optionally, obtaining the text content of the standard font based on the first handwriting includes: performing optical character recognition on the first handwriting to obtain at least one candidate text content and the accuracy of each candidate text content; and determining the text content from the at least one candidate text content based on the accuracy of each candidate text content.

Optionally, the method further includes: listening to whether the target text editing box loses input focus; when the target text editing box loses input focus, hiding the toolbar.

Optionally, when the first movement operation points to the target text editing box, the first writing stroke displayed in the first writing layer is a writing stroke of a first color; when the first movement operation does not point to any of the at least one text editing box, the first writing stroke displayed in the first writing layer is a writing stroke of a second color; wherein, the first color is different from the second color.

Optionally, when the target text editing box exists in at least one text editing box, the first writing handwriting displayed in the first writing layer is a first color; when the target text editing box does not exist in at least one text editing box, the first writing handwriting displayed in the first writing layer is a second color; wherein the first color is different from the second color.

Optionally, the method further includes: receiving a second movement operation occurring on the first writing layer, the second movement operation passing through the target text editing box; confirming that the second movement operation was performed by the first touch object, then determining a second editing method corresponding to the second movement operation based on the second movement operation; editing the text content according to the second editing method; and displaying the edited text content in the target text editing box.

Optionally, determining the second editing method corresponding to the second movement operation based on the second movement operation includes: adding and displaying a second handwriting on the first writing layer based on the second movement operation; when it is confirmed that the second movement operation passes through the text content displayed in the target text editing box, and the second handwriting is a first preset handwriting, determining the second editing method as deleting text; when it is confirmed that the second movement operation passes through the text content displayed in the target text editing box, and the second handwriting is a second preset handwriting, determining the second editing method as selecting text; when it is confirmed that the second handwriting is a third preset handwriting, determining the second editing method as splitting or combining text content.

Optionally, when the first movement operation does not point to a text editing box, the method further includes: receiving a third movement operation, the third movement operation overlapping with the first handwriting, and the third movement operation being performed by a preset second touch object; and erasing the first handwriting according to the third movement operation.

Optionally, when the target text editing box does not exist in the at least one text editing box, the method further includes: receiving a third movement operation, the third movement operation overlapping with the first writing, and the third movement operation being performed by a preset second touch object; erasing the first writing according to the third movement operation.

Optionally, erasing the first writing strokes according to the third movement operation includes: identifying a first overlapping area between the third movement operation and the first writing strokes; and erasing the writing strokes in the first overlapping area of the first writing strokes.

Optionally, the method further includes: receiving a fourth movement operation occurring on the first interface; confirming that the fourth movement operation is performed by a preset third touch object; updating the first interface according to the fourth movement operation; and displaying the updated first interface.

Optionally, updating the first interface includes: updating the first interface by sliding; or updating the first interface by turning pages.

Thirdly, a writing device is provided, comprising: a display module for displaying a first interface, the first interface including at least one text editing box; a receiving module for receiving a first movement operation occurring on the first interface; the display module is further configured to confirm that the first movement operation is performed by a preset first touch object, overlay a first writing layer of a first writing application on the first interface, and add and display first handwriting based on the first movement operation on the first writing layer; a obtaining module for obtaining text content in a standard font based on the first handwriting after confirming that the first movement operation has terminated when the first movement operation points to a target text editing box in the at least one text editing box; the display module is further configured to display the text content in the target text editing box, and display a toolbar at a preset position in the target text editing box, and close the first writing layer; wherein the toolbar includes at least one text editing control; an editing module for editing the displayed text content according to a first editing method corresponding to the target text editing control after the text content is displayed in the target text editing box, upon receiving an operation on the target text editing control in the at least one text editing control; the display module is further configured to display the edited text content in the target text editing box.

Fourthly, a writing device is provided, comprising: a display module for displaying a first interface, the first interface including at least one text editing box; a receiving module for receiving a first movement operation occurring on the first interface; the display module is further configured to confirm that the first movement operation is performed by a preset first touch object, and to overlay and display a first writing layer of a first writing application on the first interface; the display module is further configured to, when there is a target text editing box with input focus in the at least one text editing box, display a toolbar at a preset position of the target text editing box, and add and display first handwriting on the first writing layer based on the first movement operation; wherein, the toolbar includes at least one text editing box. This editing control includes a module for obtaining text content in a standard font based on the first handwriting after confirming the termination of the first movement operation; wherein the input focus is triggered by a click operation occurring on the first interface; the display module is further configured to display the text content in the target text editing box and close the first writing layer; the editing module is configured to, after displaying the text content in the target text editing box, edit the displayed text content according to the first editing method corresponding to the target text editing control when receiving an operation on the target text editing control in the at least one text editing control; the display module is further configured to display the edited text content in the target text editing box.

Fifthly, an interactive flat panel is provided, including a memory and a processor. The memory is used to store executable program code; the processor is used to call and run the executable program code from the memory, so that the interactive flat panel executes the writing method in the first aspect or any possible implementation of the first aspect.

In a sixth aspect, a computer-readable storage medium is provided that stores computer program code, which, when run on a computer, causes the computer to perform the writing method in any possible implementation of the first or second aspect described above.

In a seventh aspect, a computer program product is provided, comprising: computer program code, which, when run on a computer, causes the computer to execute the writing method in any possible implementation of the first or second aspect described above.

Attached Figure Description

Figure 1 is a structural schematic diagram of an interactive flat panel provided in an embodiment of this application;

Figure 2 is a schematic diagram of a writing method provided in an embodiment of this application;

Figure 3 is a schematic flowchart of a writing method provided in an embodiment of this application;

Figure 4 is a schematic diagram of a text input scenario provided in an embodiment of this application;

Figure 5 is a schematic diagram of another text input scenario provided by an embodiment of this application;

Figure 6 is a schematic diagram of another text input scenario provided by an embodiment of this application;

Figure 7 is a schematic diagram of another text input scenario provided by an embodiment of this application;

Figure 8 is a schematic diagram of another text input scenario provided by an embodiment of this application;

Figure 9 is a schematic diagram of a text deletion scenario provided in an embodiment of this application;

Figure 10 is a schematic diagram of another text deletion scenario provided by an embodiment of this application;

Figure 11 is a schematic flowchart of another writing method provided in an embodiment of this application;

Figure 12 is a schematic diagram of the architecture of a Windows system provided in an embodiment of this application;

Figure 13 is a schematic diagram of another writing method provided in an embodiment of this application;

Figure 14 is a schematic flowchart of a writing method provided in an embodiment of this application;

Figure 15 is a schematic diagram of another text input scenario provided by an embodiment of this application;

Figure 16 is a schematic diagram of an interface change provided in an embodiment of this application;

Figure 17 is a schematic flowchart of another writing method provided in the embodiments of this application;

Figure 18 is a schematic diagram of the structure of a writing device provided in an embodiment of this application;

Figure 19 is a structural schematic diagram of a writing device provided in an embodiment of this application;

Figure 20 is a schematic diagram of the structure of an interactive flat panel provided in an embodiment of this application.

Detailed Implementation

The technical solutions of this application will now be described clearly and in detail with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, "/" indicates "or," for example, A/B can mean A or B. "And/or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and/or B can represent: A alone, A and B simultaneously, and B alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more. Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Therefore, a feature defined with "first" or "second" may explicitly or implicitly include one or more of that feature.

The writing method described in this application can be applied to interactive flat panels, which are integrated devices that use touch technology to control content displayed on a screen and achieve human-computer interaction. They integrate one or more functions such as a projector, electronic whiteboard, screen, audio system, television, and video conferencing terminal. Of course, interactive flat panels do not limit the surface features of the display surface; for example, an interactive flat panel can be a flat surface, a curved surface, or a combination of multiple flat surfaces.

Figure 1 is a schematic diagram of an interactive flat panel provided in an embodiment of this application. Exemplarily, as shown in Figure 1, the interactive flat panel 100 includes a touch-sensitive display screen 110 and a control motherboard 120. The touch-sensitive display screen 110 is used to detect the position information and type of the touch object; the control motherboard 120 is used to control and coordinate the interactive flat panel 100 and external devices, enabling various independent hardware components in the interactive flat panel 100 to work together as a stable whole. Exemplarily, the touch-sensitive display screen 110 is a display screen with touch functionality; for example, an infrared display screen, a capacitive display screen, a resistive display screen, an electromagnetic display screen, or a pressure-sensitive display screen. On the touch-sensitive display screen 110, users can perform writing operations or other operations by touching the touch-sensitive display screen 110 with their fingers, a stylus, or other touch media (hereinafter collectively referred to as touch objects); correspondingly, the interactive flat panel 100 detects the position information when the finger or stylus performs a touch operation and responds according to the position information to realize touch-based human-computer interaction functions.

In this embodiment, the sensing data that the touch-sensitive display screen 110 can detect includes not only position information, but also the result of judging the type of the touch object by directly detecting touch signals or by detecting specific signals of the touch object through auxiliary sensors. Specifically, for example, different touch object types can be distinguished based on the size of the touch point when the touch object contacts the touch-sensitive display screen 110, based on the distinguishable physical signals (such as sound) generated when the touch object contacts the touch-sensitive display screen 110, or based on the identifying wireless signals generated when the touch object contacts the touch-sensitive display screen 110. In other words, the touch-sensitive display screen 110 can not only send the touch position information to the control motherboard 120, but also send the touch object type to the control motherboard 120.

For example, the control motherboard 120 is equipped with at least one operating system; wherein the operating system includes, but is not limited to, Android, Linux, Windows, and HarmonyOS, and is used to control and coordinate the interactive flat panel 100 and external devices, so that the various independent hardware components in the interactive flat panel 100 can work together as a stable whole. The architectural layer at which the operating system resides is defined as the system layer. Based on the system layer, the interactive flat panel 100 is equipped with applications developed to meet the needs of users in different fields and for different problems, and the corresponding architectural layer is the application layer.

In the specific embodiments described in this solution, the interactive flat panel 100 can install at least one writing application with writing functionality. This writing application can be a built-in application of the operating system or an application downloaded from a third-party device or server. Optionally, in addition to touch-based writing functionality, the writing application may also have other editing functions, such as deletion, table insertion, image insertion, graphic insertion, table drawing, and graphic drawing, etc., which are not specifically limited here.

In related technologies, when inputting text into an interactive whiteboard via handwriting input, inserting a space character into the already entered text is often necessary because handwriting input does not support space character input. Therefore, the soft keyboard must be used to insert the space character. Furthermore, when deleting some or all characters from the entered text, the common practice in handwriting input is to draw an underline on the character to be deleted. This method lacks visual clarity and is not easily mastered by users, leading to frequent reliance on the soft keyboard for deletion. In short, while handwriting input can improve text input efficiency, frequent switching between input modes may be required when editing already entered text, resulting in low overall input efficiency.

In view of this, this application proposes a writing method, an interactive whiteboard, and a storage medium. This method, when a pre-set first touch object is used to perform a touch movement operation on a first interface, can directly generate and display handwriting, achieving the effect of displaying handwriting as soon as it is written. Furthermore, if a text editing box with input focus exists, or if the movement operation points to a text editing box, the handwriting can be directly converted into… The text content, converted to a standard font, is entered into the text editing box. Simultaneously, a toolbar containing one or more text editing controls is displayed at a preset position within the text editing box. When the user needs to edit the text content in the editing box, they can do so using the text editing controls in the toolbar. This eliminates the need to access the soft keyboard and frequently switch input modes, simplifying the text editing process and improving input efficiency. Furthermore, since this method allows writing on any position on the first interface using a preset touch object, directly inputting text or generating handwriting, it eliminates the need to repeatedly open and close the soft keyboard or writing software. This enhances the convenience of writing on the interactive whiteboard, thereby improving writing efficiency and enhancing the user experience.

Figure 2 is a schematic diagram of a writing method according to an embodiment of this application. Exemplarily, Figure 2(a) shows a scenario of writing with a pen, and Figure 2(b) shows a scenario of writing with a finger. Exemplarily, as shown in Figure 2(a), when the main thread detects that the pen is performing a writing operation on the first interface of the interactive tablet, a first writing layer of the first writing application is overlaid on the first interface, and the first writing strokes are received through the first writing layer. The duration of the pen being lifted is continuously detected; if the lifting duration exceeds a preset duration, writing is determined to be complete, and the first writing strokes are collected.

Meanwhile, a separate thread iterates through all open windows from top to bottom to obtain the position of each window. Based on the positions of each window and the landing point (the landing point is the starting position of the writing operation), the target window is determined. Specifically, the window where the landing point is located is detected by iterating through the open windows of the first interface to determine that the open window where the landing point is located is the target window. After determining the target window, based on the landing point and the positions of each edit box in the target window, it is determined whether an edit box (hereinafter referred to as the first edit box) exists at the landing point position of the writing operation. For example, it is possible to iterate through each edit box to determine the position of the first edit box where the landing point is located, and obtain the attribute information of the first edit box. If the attribute information meets the preset conditions of the edit box, the first edit box is determined to be the target text edit box.

Furthermore, when the writing operation is executed at a target text editing box, after confirming the termination of the writing operation, the text content in standard font is obtained based on the first handwriting stroke and displayed in the target text editing box, and the first writing layer is closed. Conversely, when the writing operation is executed at a target text editing box, after confirming the termination of the writing operation, the first handwriting stroke is displayed on the first writing layer for the user to view. It should be noted that the writing pen is a pen designed for use with the interactive whiteboard.

Optionally, the first writing layer can be a transparent writing layer or a semi-transparent writing layer; no specific limitation is made here. Optionally, the preset conditions for the editing box include, but are not limited to: the editing box is an editing box that supports text editing, the editing box is located within the first interface of the interactive whiteboard, the editing box has an input box for entering text, etc.; no specific limitation is made here. Optionally, the landing point position can be represented based on coordinate data; for example, with the upper left corner of the first interface as the origin, the horizontal direction as the x-axis, and the vertical direction as the y-axis, the landing point position of the writing operation is determined based on the coordinate data. The location of the coordinate system can be determined according to the actual situation; no specific limitation is made here. Optionally, the preset duration can be 300ms, 350ms, 380ms, etc.; no specific limitation is made here.

For example, when the pen type successfully matches a preset type, a movement operation of the pen on the first interface of the interactive tablet is detected. It is understood that upon determining that a movement operation of the pen is occurring on the first interface of the interactive tablet, the landing point of the movement operation is determined. It is understood that the movement operation can include, but is not limited to, writing operations, text deletion, text selection, etc., and is not specifically limited here. For example, the main thread detects a finger movement operation on the first interface, updates the first interface based on the movement operation, and displays the updated first interface.

Figure 3 is a schematic flowchart of a writing method provided in an embodiment of this application. As shown in Figure 3, the method includes the following steps:

S301, displaying the first interface.

For example, the interactive flat panel can be a Windows system conference flat panel, an Android tablet, etc. The first interface can be a web page interface or an application input interface, etc., and includes at least one text editing box. The text editing box is used to receive text content input by the user in a standard font, where standard font refers to a font as opposed to handwritten fonts, such as Chinese fonts, English fonts, etc. Optionally, the standard font can also be configured with a specific font format; for example, Chinese fonts can have formats such as SimSun, HeiTi, Microsoft YaHei, etc.

S302, receive the first movement operation that occurs on the first interface.

Optionally, the first movement operation can be any of the following: a writing operation, text selection, or text deletion. For example, when the first movement operation is a writing operation, the writing operation occurring on the first interface is received. It is understood that the example shown is only one possible scenario in practical applications, and the specific implementation can be determined according to actual circumstances; no limitation is made here.

S303, confirm that the first movement operation is performed by a preset first touch object, overlay and display the first writing layer of the first writing application on the first interface, and add and display the first writing strokes on the first writing layer based on the first movement operation.

The first touch object is the tip of a writing pen. Optionally, the first writing application can be an application that comes pre-installed in the operating system of the interactive flat panel, or an application downloaded from a third-party device or server; no specific limitation is made here. Optionally, in this embodiment, the first writing application is an annotation application installed in the interactive flat panel operating system. In one implementation, when detecting whether the first movement operation is performed by a preset touch object, the type of touch object can be determined by detecting a touch signal or by detecting specific information of the touch object through an auxiliary sensor. For example, different touch object types can be distinguished based on the size of the touch point when the touch object contacts the first interface; different touch object types can be distinguished based on the recognizable physical signal generated when the touch object contacts the first interface; and different touch object types can be distinguished based on the touch point size when the touch object contacts the first interface. When a touch object comes into contact with the first interface, a wireless signal with identification capabilities is generated to distinguish different types of touch objects. The method for determining the type of touch object can be determined according to the actual situation and is not specifically limited here. In another implementation, when detecting whether the first movement operation is performed by a preset touch object, it can be determined by receiving the touch object type sent by the touch-sensitive display screen. For example, the embodiments of this application use a high-precision touch-sensitive display screen, which can not only identify the position information of the touch object on the touch-sensitive display screen, but also identify the specific shape of the touch object, thereby distinguishing the specific type of touch object. Therefore, this application redesigns the touch data reception of the first writing application in terms of software architecture or software logic to meet the data acquisition needs under different states.

For example, when the interactive flat panel is powered on, the first writing application starts running in the background. At this time, the first writing layer of the first writing application is not displayed on the interactive flat panel. During the operation of the interactive flat panel, when a touch object is touched on the touch-sensitive display screen, the operating system of the interactive flat panel will receive the touch data. The first writing application will determine in real time whether other writing applications are running. If so, it will not establish a connection with the operating system's driver layer (corresponding to the driver program), and the operating system will handle the data distribution response. That is, the first writing application starts up and runs in the background; if the first interface is not the interface of the writing application, the first writing application establishes a data channel with the driver program; if the first interface is the interface of the writing application, it disconnects the data channel with the driver program; the data channel is used to transmit touch data sent by the touch-sensitive display screen, which includes at least the touch position data detected by the touch-sensitive display screen and the specific type of the touch object. By setting the connection status of the data channel between the first writing application and the driver program according to the type of the first interface, unnecessary display of the first writing layer of the first writing application can be directly avoided when writing is currently supported.

If no other writing application is running, the first writing application establishes a connection with the operating system's driver layer, informing the driver layer of the rules or conditions for judging the touch data to be intercepted (e.g., intercepting touch data from a specific pen). The driver layer judges the received touch data. If it determines that the touch data is generated by a pen (corresponding to a preset first medium type of touch object), it intercepts the touch data and sends it to the first writing application for response. If it determines that the touch data is not generated by a pen, the operating system distributes the touch data in response. Thus, combined with other steps in the embodiments of this application, when a user writes on the interactive tablet with a specific pen, the user can write as soon as they pick up the pen, or directly input or edit text in the text input box, improving the convenience of writing on the interactive tablet, thereby increasing writing efficiency and greatly enhancing the user experience.

As shown in Figure 4, which is a schematic diagram of a text input scenario provided by an embodiment of this application, when it is confirmed that the first movement operation is executed by the pen tip, a first writing layer can be displayed on the first interface. The first writing layer can be a transparent writing layer, a semi-transparent writing layer, or an opaque writing layer. Simultaneously, the movement trajectory of the first movement operation can be obtained, converted into first handwriting, and displayed on the first writing layer.

S304, when the first move operation points to the target text editing box in at least one text editing box, after confirming that the first move operation has terminated, the text content in the standard font is obtained based on the first handwriting.

The target text editing box pointed to by the first movement operation can be a text editing box located at the landing position of the first movement operation. For example, the landing position of the first movement operation and the positions of various text editing boxes included in the first interface can be detected to determine whether a text editing box exists at the landing position of the first movement operation. If a text editing box exists, the text editing box at the landing position is identified as the target text editing box. Simultaneously, after confirming the termination of the first movement operation, the movement trajectory of the first movement operation is collected to obtain a first handwriting, and then text recognition is performed based on the first handwriting to obtain at least one candidate text. From the at least one candidate text, one candidate text is determined to be text content in a standard font.

Optionally, the landing point can be the starting position of the first movement operation on the first interface. For example, the landing point can be represented by coordinate data, with the upper left corner of the first interface as the origin, the horizontal direction as the x-axis, and the vertical direction as the y-axis. The landing point position is, for example, (100, 200), where (100, 200) represents the horizontal coordinate of the landing point position as 100 and the vertical coordinate as 200 on the first interface. In determining whether a text editing box exists at the landing point position, the target window where the landing point position is located can be determined, and the position of at least one text editing box in the target window can be obtained. If the landing point position is within the position range of a certain text editing box in the target window, then it is determined that the first movement operation points to that text editing box, and that text editing box is the target text editing box. As shown in Figure 4, the starting point of the first writing stroke is the landing point of the first movement operation. Since the landing point position is within the position range of the text editing box, the text editing box can be determined to be the target text editing box.

To determine the target window where the landing point is located, all open windows in the first interface can be traversed to obtain their positions. Based on the positions of these windows and the landing point, the target window is then determined. Specifically, the GetTopWindow interface in the User32.dll module of the system architecture layer in the Windows system architecture is used to find the top-level window in the first interface. The GetWindowRect interface in the User32.dll module is used to determine the position (window size) of the top-level window. It is then checked whether the position of the top-level window includes the landing point. If the position of the top-level window includes the landing point, it is determined as the target window. If the position of the top-level window does not include the landing point, the GetWindow interface in the User32.dll module is used to search downwards for reference windows. The GetWindowRect interface in the User32.dll module is used to determine the position of the reference windows, and it is checked whether the position of the reference windows includes the landing point. If the position of the reference windows includes the landing point, it is determined as the target window.

For example, the GetTopWindow interface is used to find the top-level window in the first interface, and the GetWindowRect interface is used to determine the position of the top-level window as (100, 100, 750, 800). This means that the position coordinates of the top-left corner of the top-level window are (100, 100), the position coordinates of the bottom-right corner of the top-level window are (750, 800), and the landing point position is (650, 650). Determining the position of the top-level window includes the landing point position, and thus the top-level window is determined to be the target window. Alternatively, the GetTopWindow interface can be used to locate the top-level window in the first interface, and the GetWindowRect interface can be used to determine the position of the top-level window as (100, 100, 750, 800), indicating that the coordinates of the top-left corner of the top-level window are (100, 100), the coordinates of the bottom-right corner are (750, 800), and the landing point is (850, 850). It is determined that the position of the top-level window does not include the landing point. The GetWindow interface is then used to search for reference windows one by one downwards from the top-level window, and the position of the reference window is determined. It is then checked whether the position of the reference window includes the landing point. If the position of the reference window includes the landing point, the reference window is determined as the target window. It is understood that the method for detecting whether the position of the reference window includes the landing point can refer to the method for detecting whether the position of the top-level window includes the landing point in the aforementioned disclosed embodiments, and will not be repeated here. After determining the target window where the landing point is located, iterate through each text editing box in the target window, determine the position of the text editing box where the landing point is located (hereinafter referred to as the text editing box), and obtain the attribute information of the text editing box; if the attribute information meets the preset conditions of the editing box, then determine that the first movement operation is directed to the text editing box.

Optionally, the preset conditions for the edit box include that the text edit box is an edit box that supports text editing, and that the position of the text edit box is within the first interface. The preset conditions for the edit box can be determined according to the actual situation, and are not specifically limited here. For example, the UIAComWrapper module can be used to traverse each text edit box, obtain the position of each text edit box through the BoudingRectangle interface, and determine the position of the edit box where the landing point is located; the FindAll interface in the UIAComWrapper module can be used to obtain the attribute information of the edit box where the landing point is located. If the attribute information meets the preset conditions for the edit box, the first movement operation is determined to point to the text edit box where the landing point is located. For example, iterate through each text edit box and obtain its position using the BoudingRectangle interface. The position of each text edit box is represented by coordinate data; for example, a text edit box with the position (100, 100, 200, 300) indicates that the top-left corner is at coordinates (100, 100) and the bottom-right corner is at coordinates (200, 300). After determining the position of each text edit box, check the position of the edit box containing the landing point. Obtain the edit box's attribute information using the FindAll interface. If the attribute information meets the preset conditions of the edit box, determine that the first move operation points to that text edit box. Alternatively, iterate through each text edit box and obtain its position using the BoudingRectangle interface. If the landing point is outside the positions of all text edit boxes, it is determined that no target text edit box exists, meaning the first move operation did not point to a text edit box. Alternatively, iterate through each text edit box and obtain its position using the BoudingRectangle interface to determine the position of the text edit box containing the landing point. The FindAll interface is used to obtain the attribute information of the text editing box where the landing point is located. If the attribute information does not meet the preset conditions of the editing box, it is determined that the first move operation did not point to the text editing box.

The above solution iterates through each text editing box, determines the position of the editing box where the landing point is located, and obtains the attribute information of the editing box where the landing point is located. If the attribute information meets the preset conditions of the editing box, it determines that the first movement operation points to the text editing box where the landing point is located. Since the process of determining that the first movement operation points to the text editing box firstly involves iterating through each text editing box and then filtering by the preset conditions of the editing box to determine whether there is a text editing box that meets the conditions at the landing point, it can improve the accuracy of judging whether the first movement operation points to the text editing box, thereby improving the writing accuracy.

For example, after confirming the termination of the first movement operation, optical character recognition (OCR) can be performed on the collected first handwriting to obtain N candidate texts. Then, in response to the selection operation of the N candidate texts, the text content is determined. For example, the N candidate texts include {"each", "every", "every other"}, and if the user selects "each", then "each" is determined as the text content. Optionally, the number of candidate texts can be preset; for example, performing text recognition on the first handwriting yields 5 candidate texts. Alternatively, the number of candidate texts can be determined based on the confidence level corresponding to the recognition result; for example, performing text recognition on the first handwriting yields candidate texts with a confidence level greater than 80%. Alternatively, performing text recognition on the first handwriting, if the confidence levels corresponding to all recognition results are less than 60%, the text with the highest confidence level is determined as the candidate text.

For example, when the first movement operation points to the text editing box, after recognizing the first handwriting to obtain at least one candidate text of a standard font, at least one candidate text can be displayed in a candidate pop-up window. At this time, a selection operation occurring in the candidate pop-up window can be received, and the text content can be determined from the at least one candidate text based on the selection operation. For example, the candidate pop-up window can be displayed at a target location, where the distance between the target location and the target text editing box is less than a preset distance threshold. The preset distance threshold is, for example, 3 cm, 5 cm, etc., and is not specifically limited here. For example, the candidate pop-up window can be positioned below the target text editing box; or, the candidate pop-up window can be positioned to the right of the target text editing box.

Figure 5 is a schematic diagram of another text input scenario provided by an embodiment of this application. As shown in Figure 5, after confirming the termination of the first movement operation, OCR text recognition is performed on the first handwriting to obtain three candidate texts, which are displayed in a candidate pop-up window. The three candidate texts include {“Micro”, “Micy0”, “微软”}. At this time, the user can select one candidate text from the three candidate texts according to their needs and click it (selection operation). After receiving the user's click operation, the clicked candidate text can be determined as the text content. It can be understood that when there are multiple candidate texts, the confidence level of each candidate text obtained by OCR text recognition can be used to determine the text content. The size of the candidate texts is determined by the order of the candidate texts displayed in the candidate pop-up window. As shown in Figure 5, the confidence levels of the candidate texts "Micro", "Micy0", and "微软" are from highest to lowest as "Micro", "Micy0", and "微软", respectively. These can be displayed in the candidate pop-up window in the following order: "Micro", "Micy0", and "微软".

Optionally, the step of obtaining text content in a standard font based on the first handwriting may include: performing optical character recognition on the first handwriting to obtain at least one candidate text content and the accuracy of each candidate text content; and determining the text content from the at least one candidate text content based on the accuracy of each candidate text content.

In one implementation, during the process of acquiring the text content corresponding to the first handwriting, OCR text recognition can first be performed on the first handwriting to obtain one or more texts, and the confidence score (i.e., accuracy) of each text can be obtained. Each text obtained is a candidate text. After obtaining at least one candidate text, based on the accuracy of each candidate text, the candidate text with the highest accuracy can be directly determined as the text content, and the text content is displayed in the target text editing box. As described above, after obtaining at least one candidate text, the text content can be determined directly from at least one candidate text without going through a candidate pop-up window. In the above scheme, during the process of acquiring text content based on the first handwriting, the text content is directly determined from at least one candidate text according to the accuracy of each identified candidate text, which simplifies the text input operation and improves the text input efficiency.

S305, display the text content in the target text editing box, display the toolbar at the preset position of the target text editing box, and close the first writing layer.

The toolbar includes at least one text editing control. The preset position can be below, above, to the left, or to the right of the target text editing box, and the distance between it and the target text editing box is less than a preset distance threshold. The preset distance threshold can be set to 1 cm, 2 cm, etc., and is not specifically limited here. In this embodiment, after obtaining the text content based on the first handwriting, the text content can be displayed in the target text editing box, and the first writing layer can be closed. Simultaneously, the toolbar can be displayed at a preset position in the target text editing box. As shown in Figure 6, Figure 6 is a schematic diagram of another text input scenario provided by this application embodiment. After determining the candidate text "Micro" as the text content, the text content "Micro" can be displayed in the target text editing box, and the first writing layer can be closed. Simultaneously, the toolbar can be displayed at a preset position below the target text editing box. Referring to Figure 5, when determining the text content from at least one candidate text through a candidate pop-up window, after determining the text content from at least one candidate text, the candidate pop-up window and the first writing layer can be closed first, and then the toolbar can be displayed.

As shown in Figure 6, the toolbar may include text editing controls such as an input control for entering space characters and a delete control for deleting characters, as well as other controls such as a close control for closing the toolbar and a toggle control for switching text input modes. It should be understood that the types and number of text editing controls may include, but are not limited to, the examples above.

Optionally, displaying the toolbar at a preset position in the target text editing box includes: hiding the soft keyboard corresponding to the target text editing box; and displaying the toolbar at the preset position after hiding the soft keyboard.

In practical applications, when the first movement operation is directed at the target text editing box, the target text editing box can be set to receive input focus. At this time, the interactive whiteboard first starts and displays the soft keyboard corresponding to the target text editing box, and displays the soft keyboard in a position close to the target text editing box. To avoid the soft keyboard interfering with the user's handwriting input and to avoid the soft keyboard interfering with the normal display of the toolbar, the soft keyboard can be hidden first, and then the toolbar can be displayed in a preset position after the soft keyboard is hidden.

S306, when receiving an operation on a target text editing control in at least one text editing control, the displayed text content is edited according to the first editing method corresponding to the target text editing control.

S307 Displays the edited text content in the target text editing box.

In this embodiment, after displaying the toolbar, if a user's operation on a text editing control (i.e., the target text editing control) in the toolbar is received, the text displayed in the target text editing box can be edited according to the first editing method corresponding to the target text editing control, and then the edited text content is displayed in the target text editing box. As shown in Figure 6, when displaying text content in the target text editing box, an input cursor can be displayed simultaneously. The input cursor is used to indicate the text editing position, and the default text editing position can be located at the end of the text content, so that the input cursor is located at the end of the text content. For example, a user's operation on the text editing control can be a click operation. Each time a user clicks on the delete control, a character before the input cursor in the text content can be deleted to complete one edit of the text content, resulting in the edited text content, which is then displayed in the target text editing box. Similarly, each time a user clicks on the input control, a space character can be inserted at the position of the input cursor, and then the space character is combined with the text content to obtain the edited text content, which is then displayed in the target text editing box.

In one implementation, the user can manually adjust the text editing position. As shown in Figure 7, which is a schematic diagram of another text input scenario provided in this embodiment, after displaying the text content, if the user determines that they need to insert other characters between the characters "c" and "r," or delete one or more characters before the character "r" in the text content, they can use a second touch object—the end of a stylus—to click the position between the characters "c" and "r." At this time, the user's click position can be determined as... The text editing location is where the input cursor is inserted. The above is merely an example; specific methods for determining the text editing location may include, but are not limited to, the examples above.

Optionally, when historical text exists in the text edit box, the historical text and the current text can be concatenated, and the concatenated text can be displayed in the target text edit box. For example, after determining the text content corresponding to the first handwriting, the historical text in the text edit box can be obtained through the Current.Value interface, and then the current text can be concatenated with the historical text to obtain new text content. Then, the historical text can be replaced with the new text content through the SetValue interface, thereby achieving the purpose of displaying the text content in the text edit box.

Optionally, at least one text editing control includes an input control for inputting a space character and a delete control for deleting characters. The steps of editing the displayed text content according to the first editing method corresponding to the target text editing control may include: determining the text editing position from the displayed text content; if the target text editing control is an input control, inputting a space character at the text editing position; or, if the target text editing control is a delete control, deleting the character in the text content preceding the text editing position. As shown in Figures 6 and 7, the toolbar includes an input control and a delete control. After displaying the text content, the user can determine the text editing position as needed using a second touch object, such as the position between the character "c" and the character "r". During the process of determining the text editing position, the user can click the text editing position using a second or third touch object to position the input cursor at the text editing position, indicating the text editing position through the input cursor. When the user needs to delete a character before the input cursor, they can click the delete control. The interactive whiteboard can delete one character before the input cursor each time it receives a click operation to obtain the edited text content. If a user needs to insert a space character at the cursor position, they can click the input control. The interactive whiteboard will insert a space character at the cursor position with each click, resulting in edited text composed of the space character and other characters. It should be understood that the method for determining the text editing position, as well as the types and number of text editing controls, and the specific operation methods of the text editing controls, may include, but are not limited to, the examples above.

In the above solution, the toolbar includes a delete control or an input control for users to input space characters. The delete control and input control can assist the stylus in quickly deleting characters in the text content or adding space characters in the text content, so that users do not need to call the soft keyboard when editing text content, thereby improving text editing efficiency and thus improving text input efficiency.

Optionally, at least one text editing control includes a switching control for switching input modes. The method may further include: hiding the toolbar when an operation on the switching control is received; and displaying a soft keyboard after hiding the toolbar, so that the text content in the target text editing box can be edited via the soft keyboard. As shown in Figure 7, the toolbar includes a switching control. After the toolbar is displayed, if the user needs to switch the text input mode from handwriting input mode to keypad input mode, they can click the switching control. The interactive whiteboard can respond to the user's click operation, close the toolbar, and display the soft keyboard after closing the toolbar. As shown in Figure 8, Figure 8 is a schematic diagram of another text input scenario provided by an embodiment of this application. After the toolbar is closed, the soft keyboard can be displayed at a preset position in the target text editing box, at which time the user can edit the text in the target text editing box via the soft keyboard. The method of editing the text in the target text editing box via the soft keyboard can be set according to requirements, and this embodiment does not limit it.

In the above solution, the toolbar includes a switching control for switching input modes. The switching control can help users quickly switch input methods, which can not only improve the user's text input efficiency, but also make the interactive whiteboard meet the different needs of users, thus improving the user experience of the interactive whiteboard.

Optionally, displaying a first writing layer of the first writing application overlaid on the first interface includes: displaying a first writing layer of a first size overlaid on the first interface; wherein the area of the first writing layer of the first size is larger than the area of the target text editing box and smaller than the area of the first interface; obtaining the duration of the first movement operation; and when the duration is greater than a preset duration, displaying a first writing layer of a second size; wherein the second size is larger than the first size.

In one implementation, upon determining that the first movement operation is performed by the first touch object and that the first movement operation points to the target text editing box, a first writing layer of a first size can be displayed firstly. As shown in Figure 5, the first writing layer shown in Figure 5 is a first writing layer of a first size. The area of the first writing layer of the first size is larger than the area of the target text input box, and can completely cover the target text input box. The interactive tablet can start timing upon receiving the first movement operation, with the timing duration being the duration of the first movement operation. When the timing duration is greater than or equal to a preset duration (e.g., 300 milliseconds), a first writing layer of a second size is displayed, the second size being, for example, the size of the first interface. At this time, the first writing layer covers the entire first interface. The user can then write on the larger first writing layer using the first touch object.

In the above scheme, when the duration of the first movement operation is longer than the preset duration, a larger first writing layer is displayed. This allows the first writing layer to cover a larger area of the first interface, which can prevent accidental touches on other controls in the first interface during the writing process, thus ensuring the smoothness of the writing process.

Optionally, when the first move operation points to the target text editing box, the first writing stroke displayed in the first writing layer is a writing stroke of a first color; when the first move operation does not point to any of the at least one text editing box, the first writing stroke displayed in the first writing layer is a writing stroke of a second color; wherein the first color and the second color are different.

In this embodiment, when the first movement operation points to the target text editing box, the target text editing box can be set to receive input focus, indicating that the user needs to input text content into the target text editing box via the first touch object. At this time, when the first writing stroke is displayed on the first writing layer, the first writing stroke of the first color can be displayed, for example, blue. Conversely, when the first movement operation does not point to any of the at least one text editing box, it can be determined that no text editing box receives input focus, indicating that the user needs to annotate text via the first touch object. At this time, when the first writing stroke is displayed on the first writing layer, the first writing stroke of the second color can be displayed, for example, red.

In the above scheme, when the first movement operation points to the text editing box, the writing handwriting of the first color is displayed, and when the first movement operation does not point to the text editing box, the writing handwriting of the second color is displayed. By displaying the writing handwriting under different operations with different colors, it is easy for users to distinguish the writing handwriting under different operations.

Optionally, the method may further include: receiving a second movement operation occurring on the first writing layer, the second movement operation passing through the target text editing box; confirming that the second movement operation was performed by a first touch object, then determining a second editing method corresponding to the second movement operation based on the second movement operation; editing the text content according to the second editing method; and displaying the edited text content in the target text editing box. The second movement operation can be either text selection or text deletion.

Optionally, the step of determining the second editing method corresponding to the second movement operation may include: adding and displaying a second handwriting on the first writing layer based on the second movement operation; when it is confirmed that the second movement operation passes through the text content displayed in the target text editing box, and the second handwriting is a first preset handwriting, determining the second editing method as deleting text. For example, the second movement operation may be drawing a wavy line on the text content displayed in the text editing box, i.e., the first preset handwriting is a wavy line. When it is confirmed that the second movement operation passes through the text content displayed in the target text editing box, and the second handwriting is a second preset handwriting, determining the second editing method as selecting text; for example, the second movement operation may be drawing a horizontal line on the text content displayed in the text editing box, i.e., the second preset handwriting is a horizontal line.

Once the second handwriting is confirmed to be the third preset handwriting, the editing method corresponding to the second movement operation is determined to be either splitting or combining text content. For example, the second movement operation could be drawing a vertical line between the text content displayed in the text editing box. Drawing a vertical line between split text content can combine text content, and drawing a vertical line between combined text content can split text content; that is, the third preset handwriting is a vertical line. In the above solution, determining the editing method corresponding to the second movement operation through the handwriting of the second movement operation allows for quick identification of the editing method, thereby improving writing efficiency.

For example, when the second editing method is to delete text, the text content is edited according to the second editing method, including: determining the first bounding rectangle of the second handwriting in the target text editing box, and the second bounding rectangle of the text content; determining the intersection area of the first and second bounding rectangles; determining the first text content covered by the intersection area; and deleting the first text content. Specifically, the first bounding rectangle of the second handwriting and the second bounding rectangle of the text content are obtained within the text editing box through the Text Pattern property of the editing box, and the intersection area of the first and second bounding rectangles is determined; then the first text content covered by the intersection area is obtained through the RangeFromPoint interface.

For example, after determining the first text content covered by the intersection area, the first text content is deleted; or, based on the historical text and the first text content within the text edit box, the first sub-text preceding the first text content in the historical text and the second sub-text following the first text content in the historical text are determined; the first sub-text and the second sub-text are concatenated to obtain the updated text; and the updated text is displayed in the text edit box. Specifically, the first text content can be selected using the Select interface, and a deletion message can be simulated to delete the first text content from the historical text. Alternatively, the first sub-text and the second sub-text can be concatenated to obtain the updated text, and the updated text can replace the historical text using the SetValue interface.

In the above solution, when the editing method corresponding to the second movement operation is to delete text, the intersection area of the first bounding rectangle and the second bounding rectangle is determined, and the first text content covered by the intersection area is determined. Then, the first text content in the text content is deleted. Since the first text content is the text content covered by the intersection area, the accuracy of the first text content can be improved, thereby enhancing the user experience.

Figure 9 is a schematic diagram of a text deletion scenario provided by an embodiment of this application. As shown in Figure 9, when the second editing method is to delete text, the first bounding rectangle of the second handwriting and the second bounding rectangle of the text content are obtained in the text editing box. The first text content covered by the intersection area of the first bounding rectangle and the second bounding rectangle is determined to be "的sd". Further, "的sd" can be selected through the Select interface, and a deletion message can be simulated to delete "的sd"; or, the first text content is determined to be "的sd", and based on the first text content "的sd" and the historical text "A的sdokq吃", the first sub-text is determined to be "A" and the second sub-text is "okq吃". The first sub-text and the second sub-text are concatenated to obtain the updated text "Aokq吃", and "Aokq吃" is updated to the text editing box through the SetValue interface.

For example, when the second editing mode is selected text, the text content is edited according to the second editing mode, including: determining the second overlapping area between the second handwriting and the text content; determining the second text content within the second overlapping area based on the second overlapping area; and selecting the second text content within the text content. As shown in Figure 9, the text content is "A的sdokq吃", and the second text content within the second overlapping area between the second handwriting and the text content is determined to be "的sd", then "的sd" is selected. It is understandable that... Selected text can be highlighted or displayed in a different way than other text to improve user convenience.

In the above scheme, when the second editing method is to select text, the second text content in the second overlapping area between the second handwriting and the text content is determined, and the second text content in the text content is selected. Since the second text content is determined by the second overlapping area between the second handwriting and the text content, the accuracy of the second text content can be improved, thereby enhancing the user's convenience.

For example, when the second editing method is to split or combine text content, the text content is edited according to the second editing method, including: determining the target position of the second handwriting in the text editing box; determining the third text content adjacent to the target position in the text editing box based on the target position; and splitting or combining the third text content in the text content. For example, if the text content is "A的sdok q吃", the target position of the second handwriting in the text editing box is determined to be the position between the characters "s" and "d", and the third text content adjacent to the target position in the text editing box is determined to be "A的s s" and "dok q吃". The third text content in the text content is then split to obtain the split text content "A的s dok q吃". Alternatively, if the text content is "A的sdok q吃", the target position of the second handwriting in the text editing box is determined to be the position between the characters "k" and "q". The third text content adjacent to the target position in the text editing box is determined to be "A的sdok" and "q吃". The third text content in the text content is combined to obtain the combined text content "A的sdokq吃".

In the above scheme, when the second editing method is to split or combine text content, the third text content adjacent to the target position in the text editing box is determined, and the third text content in the text content is split or combined. Since the user only needs to perform simple operations in the process of splitting or combining the third text content in the text content, the convenience of the user in writing text is improved.

For example, after editing the text content according to the second editing method, the edited text content is displayed in the text editing box for the user to view. Optionally, when the second editing method is to delete text, editing the text content according to the second editing method includes: identifying target characters in the text content covered by the second handwriting; and deleting the target characters.

In one implementation, during text deletion, the user can perform the deletion operation above the target text editing box. This allows the second handwriting to cover some or all characters in the text content, with the covered characters being the target characters. Figure 10 illustrates another text deletion scenario provided by this application embodiment. Touch events can be monitored through the accessibility service in the interactive whiteboard. After detecting a touch event corresponding to the second movement operation, the touch point can be saved as a stroke point on the second handwriting. Then, the second handwriting is constructed based on these stroke points. The stroke points of the second handwriting include stroke points a, b, c, d, and e as shown in Figure 10. The target characters covered by the second handwriting are "想" (think), "听" (listen), and "歌" (song). After displaying the second handwriting, the target characters "想", "听", and "歌" can be directly deleted to achieve the text content deletion operation.

Optionally, identifying the target character in the text content covered by the second handwriting includes: determining the third bounding rectangle where each character in the text content is located; determining the target bounding rectangle covered by the second handwriting from all the third bounding rectangles; and determining the character within the target bounding rectangle as the target character.

As shown in Figure 10, after receiving the second movement operation and determining that the second editing method is to delete text, the accessibility service object corresponding to the first movement operation can be obtained through the accessibility service. The rectangular border of each character in the text content, i.e., the third circumscribed rectangle, is obtained from the accessibility service object, specifically rect1, rect2, rect3, and rect4 shown in Figure 10. Then, a stroke line can be constructed based on the stroke points a, b, c, d, and e in the second handwriting. The stroke line can be a Bézier curve, and the third circumscribed rectangle (rect2, rect3, and rect4) covered by the Bézier curve is the target circumscribed rectangle covered by the second handwriting. After determining the target circumscribed rectangle, the characters within the target circumscribed rectangle are determined as the target characters, and the characters "想" and "歌" can be deleted from the target circumscribed rectangle. Optionally, during the determination of the target circumscribed rectangle, the intersection point of the Bézier curve and the third circumscribed rectangle can be determined, and the third circumscribed rectangle containing the intersection point and the stroke points on the Bézier curve is determined as the target circumscribed rectangle. As shown in Figure 10, the intersection points of the Bézier curve and the third bounding rectangle include c1, d1 and e1. The third bounding rectangles rect2, rect3 and rect4, where points b, c1, d1 and e1 are located, can be determined as the target bounding rectangle.

The above solution, when the second editing mode is text deletion, determines the third bounding rectangle containing each character in the text content, identifies the target bounding rectangle covered by the second handwriting from all third bounding rectangles, and deletes the characters within the target bounding rectangle. In this way, users can easily create a second handwriting style and quickly delete specific characters from the text content using this style, thus improving text editing efficiency.

Optionally, the first preset handwriting is continuous handwriting, and the number of strokes of the first preset handwriting on the text content is greater than or equal to a preset number. In one implementation, after determining that the second movement operation has terminated, a second handwriting can be added and displayed on the first writing layer based on the second movement operation, and the number of strokes in the second handwriting can be counted. Then, it is determined whether the number of strokes in the second handwriting is 1. If the number of strokes in the second handwriting is equal to 1, it can be determined that the second handwriting is continuous handwriting; if the number of strokes in the second handwriting is greater than 1, it can be determined that the second handwriting is not continuous handwriting.

Simultaneously, the number of strokes in the second handwriting that fall on the text content can be counted to obtain the stroke count. Then, if the second handwriting is a continuous handwriting and the stroke count is greater than or equal to a preset number, the second handwriting can be identified as the first preset handwriting. The traces can then be used to determine that the editing method corresponding to the second movement operation is text deletion. The preset quantity is, for example, 5, but this preset quantity can be set according to actual circumstances; this embodiment does not impose any limitations on it.

For example, when the second editing mode is text selection, a second overlapping area between the second handwriting and the text content is determined; based on the second overlapping area, the second text content within the second overlapping area is determined; and the second text content within the text content is selected. For instance, if the text content is "A的sdokq吃", and the second text content within the second overlapping area between the second handwriting and the text content is determined to be "的sd", then "的sd" is selected. It is understood that the selected text content can be highlighted or displayed in a way different from other text content to improve user viewing convenience.

In the above scheme, when the second editing method is to select text, the second text content in the second overlapping area between the second handwriting and the text content is determined, and the second text content in the text content is selected. Since the second text content is determined by the second overlapping area between the second handwriting and the text content, the accuracy of the second text content can be improved, thereby enhancing the user's convenience.

For example, when the second editing method is to split or combine text content, the target position of the second handwriting in the target text editing box is determined; based on the target position, the third text content adjacent to the target position in the target text editing box is determined; the third text content in the text content is then split or combined. For example, if the text content is "A的sdok q吃", the target position of the second handwriting in the target text editing box is determined to be between the characters "s" and "d", and the third text content adjacent to the target position in the target text editing box is determined to be "A的s" and "dok q吃". The third text content in the text content is then split to obtain the split text content "A的s dok q吃". Alternatively, if the text content is "A的sdok q吃", the target position of the second handwriting in the target text editing box is determined to be between the characters "k" and "q", and the third text content adjacent to the target position in the target text editing box is determined to be "A的sdok" and "q吃". The third text content in the text content is then combined to obtain the combined text content "A的sdokq吃".

In the above scheme, when the second editing method is to split or combine text content, the third text content adjacent to the target position in the target text editing box is determined, and the third text content in the text content is split or combined. Since the user only needs to perform simple operations in the process of splitting or combining the third text content in the text content, the convenience of the user in writing text is improved.

Optionally, the method may further include: when the first movement operation does not point to a text editing box, receiving a third movement operation, the third movement operation overlapping with the first handwriting, and the third movement operation being performed by a preset second touch object; erasing the first handwriting according to the third movement operation. For example, when the first movement operation does not point to any text editing box, the first handwriting can be displayed on the first writing layer to make it more convenient for the user to view the handwriting. Then, a third movement operation can be received, the third movement operation overlapping with the first handwriting, and the third movement operation being performed by a second touch object, allowing the first handwriting to be erased according to the third movement operation. Specifically, a first overlapping area between the third movement operation and the first handwriting is identified, and the handwriting in the first overlapping area of the first handwriting is erased. It should be noted that the third movement operation is an erasing operation of the first handwriting. Furthermore, the second touch object can be the end of a writing pen.

Optionally, the writing in the first handwriting can be completely erased or partially erased, depending on the actual situation, and is not specifically limited here. In the above scheme, if the first movement operation does not point to a text editing box, a third movement operation is received, the first overlapping area between the third movement operation and the first handwriting is confirmed, and the writing in the first overlapping area of the first handwriting is erased. Since the erasure of the writing is determined based on the first overlapping area between the third movement operation and the first handwriting, the accuracy of the writing to be erased can be ensured, thereby improving user convenience.

Optionally, the method may further include receiving a fourth movement operation occurring on the first interface, confirming that the fourth movement operation was performed by a preset third touch object, updating the first interface according to the fourth movement operation, and displaying the updated first interface. Here, the third touch object is the user's finger. The method for confirming whether the fourth movement operation was performed by the preset third touch object can refer to the method in the aforementioned disclosed embodiments, and will not be repeated here. In this embodiment, when the user determines that the first interface needs to be updated, they can perform a fourth movement operation through a third touch object, such as sliding the third touch object on the first interface. Upon receiving the fourth movement operation, the first interface can be updated by sliding or by flipping through pages to update the first interface, and then the updated first interface is displayed.

The above solution provides different update methods, allowing users to choose the appropriate method and improving the user experience.

The above technical solution receives a first movement operation occurring on a first interface, confirms that the first movement operation is performed by a preset first touch object, overlays and displays a first writing layer of a first writing application on the first interface, and adds and displays first handwriting based on the first movement operation on the first writing layer. When the first movement operation points to a target text editing box in at least one text editing box, after confirming the termination of the first movement operation, text content in a standard font is obtained based on the first handwriting, the text content is displayed in the target text editing box, a toolbar is displayed at a preset position in the target text editing box, and the first writing layer is closed. When receiving an operation on a target text editing control in at least one text editing control, the displayed text content is edited according to the first editing method corresponding to the target text editing control, and the edited text content is displayed in the target text editing box. Because this method displays a toolbar at a preset position in the text editing box during the process of inputting text content into the text editing box, the toolbar includes one or more text editing controls. For text editing boxes that have already been input... The text content can be edited by users through the text editing controls within the text editing box, eliminating the need to access the soft keyboard and frequently switch input modes. This simplifies the text editing process and improves input efficiency. Furthermore, the system allows users to write on any location on the first interface using a preset touch object. This solution, through the same writing application, enables direct text input or handwriting generation without relying on repeatedly opening and closing the soft keyboard or writing software. This enhances the convenience and efficiency of writing on the interactive whiteboard, thus improving the user experience.

Figure 11 is a schematic flowchart of another writing method provided in an embodiment of this application. As shown in Figure 11, the method includes:

S1101, Receive a first movement operation that occurs on the first interface, and determine the landing point of the first movement operation on the first interface.

For example, when the first movement operation is a writing operation, the writing operation occurring on the first interface is received, and the landing position of the first movement operation on the first interface is determined. The first landing position can be determined by directly detecting the touch signal or by detecting specific information of the touched object through an auxiliary sensor to determine the type of the touched object and the landing position. For example, the landing position can be represented based on coordinate data; for example, with the upper left corner of the first interface as the origin, the horizontal direction as the x-axis, and the vertical direction as the y-axis, the landing position of the movement operation can be determined based on the coordinate data, such as the landing position being (100, 200). The location of the coordinate system can be determined according to the actual situation and is not specifically limited here.

S1102, display the first writing layer on the first interface and receive the first writing stroke.

S1103, after determining that the first movement operation has ended, the first handwriting is collected.

For example, if it is confirmed that the first movement operation is performed by a preset first touch object, a first writing layer of the first writing application is overlaid on the first interface, and the first handwriting is collected through the first writing layer. It is understood that the user does not write continuously during the writing process; there may be brief pauses. For example, if the input device is a writing pen, the user may lift the pen during writing. Therefore, the lifting time of the writing pen can be used to determine whether the user has finished writing. For example, the lifting time of the writing pen is monitored in real time. If the lifting time is longer than a preset time, it is determined that the user has finished writing, and the first movement operation is terminated. If the lifting time is less than or equal to the preset time, it is determined that the first movement operation has not terminated. For example, if the preset time is 300ms, the lifting time of the writing pen is monitored in real time. If the lifting time is 500ms, the first movement operation is determined to have terminated, and the first handwriting is collected. Optionally, the preset duration can be set to 300ms, 350ms, 380ms, etc., without any specific limitation.

S1104, determine whether the first move operation is directed to the text editing box; if not, execute S1105; if yes, execute S1106.

For example, the target window where the landing point is located can be determined. Based on the landing point location and the position of at least one text editing box in the target window, it can be determined whether the first movement operation is directed to a text editing box. For instance, the target window where the landing point is located can be determined, and the position of at least one text editing box in the target window can be obtained. It can be detected whether the landing point location is located at the position of a text editing box in the target window. If the landing point location is located at the position of a text editing box in the target window, it can be determined that the first movement operation is directed to a text editing box, and the text editing box directed to by the first movement operation is the target text editing box. Optionally, the method for detecting whether the first movement operation is directed to a text editing box can refer to the method in the aforementioned disclosed embodiments, and will not be repeated here.

S1105, Display the first handwriting on the first writing layer.

S1106, Identify the first handwriting to obtain candidate text.

S1107, determine the text content from at least one candidate text.

For example, when the first movement operation is not directed at a text editing box, the first handwriting is displayed on the first writing layer. When the first movement operation is directed at a text editing box, OCR text recognition is performed on the first handwriting to obtain at least one candidate text. For example, the text content can be determined from at least one candidate text through a candidate pop-up window, or the text content can be determined directly from at least one candidate text based on the accuracy of each candidate text.

S1108, display the text content in the target text editing box, display the toolbar at the preset position of the target text editing box, and close the first writing layer.

S1109, when receiving an operation on a target text editing control in at least one text editing control, the displayed text content is edited according to the first editing method corresponding to the target text editing control.

S1110, the edited text content is displayed in the target text editing box. For an understanding of steps 1106 to 1110, please refer to the aforementioned examples; this embodiment will not repeat them here.

Figure 12 is a schematic diagram of the architecture of a Windows system provided in an embodiment of this application.

For example, as shown in Figure 12, the Windows system includes a UI architecture layer, a system architecture layer, etc. The UI architecture layer includes a WPF architecture layer, which includes the UIAComWrapper module; the system architecture layer includes the User32.dll module.

In this embodiment, the GetTopWindow interface of the User32.dll module can be used to find the top-level window opened in the first interface, and the position (window size) of the top-level window can be determined by the GetWindowRect interface of the User32.dll module. It can also be determined whether the landing point is within the position of the top-level window. If the landing point is within the position of the top-level window, the top-level window is determined as the target window; otherwise, the landing point is determined as the target window. The position of the top-level window is determined by searching downwards through the GetWindow interface of the User32.dll module, and then using the GetWindowRect interface of the User32.dll module to determine the window's position. If the landing point is within the window's current position, the current window is identified as the target window. After identifying the target window, the UIAComWrapper module retrieves each text editing box within the target window, and the BoudingRectangle interface obtains the position (size) of each text editing box, determining the position of the first editing box where the landing point is located. The FindAll interface in the UIAComWrapper module retrieves the attribute information of the first editing box. If the attribute information meets the preset conditions of the editing box, the text editing box pointed to by the first move operation is identified as the target text editing box.

Furthermore, when the first movement operation points to the text editing box, after confirming the termination of the first movement operation, the text content in standard font is obtained based on the first handwriting. Specifically, the historical text of the text editing box is obtained through the Current.Value interface, the text content in standard font is concatenated with the historical text to obtain the concatenated text, and then the concatenated text replaces the historical text through the SetValue interface. In addition, a second movement operation can be received. If it is confirmed that the second movement operation is performed by a preset first touch object, then the second editing method corresponding to the second movement operation is determined according to the second movement operation; if the second editing method is to delete text, the text content is edited, and the edited text content is displayed in the text editing box.

Specifically, based on the second movement operation, a second handwriting is added and displayed on the first writing layer. The first bounding rectangle of the second handwriting and the second bounding rectangle of the text content are determined within the text editing box using the Text Pattern property of the editing box. Based on the first and second bounding rectangles, the intersection area of the first and second bounding rectangles is determined. Then, the first text content covered by the intersection area is deleted using the RangeFromPoint interface.

The above technical solution receives a first movement operation occurring on a first interface, confirms that the first movement operation is performed by a preset first touch object, and overlays a first writing layer of a first writing application on the first interface. When at least one text editing box contains a target text editing box that has received input focus, a toolbar is displayed at a preset position of the target text editing box, and a first writing stroke is added and displayed on the first writing layer based on the first movement operation; after confirming that the first movement operation has terminated, text content in standard font is obtained based on the first writing stroke; the text content is displayed in the target text editing box, and the first writing layer is closed. When an operation is received on a target text editing control in at least one text editing control, the displayed text content is edited according to the first editing method corresponding to the target text editing control, and the edited text content is displayed in the target text editing box. Because this method displays a toolbar at a preset position of the text editing box during the process of inputting text content into the text editing box, the toolbar includes one or more text editing controls. For text content that has already been entered into a text editing box, users can edit the text content using the text editing controls within the text editing box. This eliminates the need to call the soft keyboard and frequently switch input modes, thus simplifying the text editing process and improving text input efficiency.

Figure 13 is a schematic diagram of another writing method provided in this application embodiment. Exemplarily, Figure 13(a) shows a scenario where a text editing box receives input focus, Figure 13(b) shows a scenario where a writing pen performs writing, and Figure 13(c) shows a scenario where a finger performs writing. Exemplarily, as shown in Figure 13(a), when the main thread detects a finger click operation on the first interface of the interactive tablet, it determines the landing point of the click operation on the first interface. If the landing point is located within the area of a text editing box, then that text editing box is determined to be the target text editing box receiving input focus. As shown in Figure 13(b), when the main thread detects a writing pen performing a writing operation on the first interface of the interactive tablet, it overlays and displays the first writing layer of the first writing application on the first interface. At this time, if it is determined that there is a target text editing box receiving input focus, a toolbar is displayed at a preset position of the target text editing box. After displaying the first writing layer, the system receives the handwriting and continuously monitors the duration of pen lift-off. If the lift-off duration exceeds a preset duration, the writing operation is confirmed to have terminated, the writing is complete, and the handwriting is collected. Further, after confirming the termination of the writing operation, the system obtains text content in standard font based on the handwriting, displays the text content in the target text editing box, and closes the first writing layer. Subsequently, upon receiving an operation on at least one target text editing control, the system edits the displayed text content according to the first editing method corresponding to the target text editing control, and displays the edited text content in the target text editing box. Furthermore, if it is determined that there is no target text editing box with input focus, the handwriting is displayed on the first writing layer after confirming the termination of the writing operation for the user to view.

Figure 14 is a schematic flowchart of a writing method provided in an embodiment of this application. As shown in Figure 14, the method includes the following steps:

S1401, displaying the first interface.

S1402, Receive the first movement operation that occurs on the first interface.

S1403, confirm that the first movement operation was performed by a preset first touch object, and overlay a first writing layer of the first writing application on the first interface.

Optionally, displaying a first writing layer of the first writing application overlaid on the first interface includes: displaying a first writing layer of a first size overlaid on the first interface; obtaining the duration of the first movement operation; and displaying the first writing layer of a second size when the duration exceeds a preset duration. For an understanding of steps 1401 to 1403, please refer to the embodiment shown in Figure 3; this embodiment will not be elaborated upon here.

S1404, when at least one text editing box contains a target text editing box that has received input focus, a toolbar is displayed at a preset position of the target text editing box, and a first writing stroke is added and displayed on the first writing layer based on the first movement operation.

The toolbar includes at least one text editing control. In this embodiment, after receiving a first movement operation performed by a first touch object, it is first determined whether there is a target text editing box with input focus in at least one text editing box on the first interface. As shown in Figure 13, when a user needs to input text content into a text editing box, they can first perform a click operation on the text editing box to make it gain input focus, and then the user can perform a first movement operation through the first touch object. Correspondingly, after receiving a click operation from the user on a text editing box, the interactive tablet determines that the text editing box has gained input focus. After determining that the text editing box has gained input focus, if a first movement operation is received and it is confirmed that the first movement operation was performed by the first touch object, a first writing layer of the first writing application can be overlaid on the first interface, and it can be determined that there is a target text editing box with input focus. At this time, the toolbar can be displayed at a preset position of the target text editing box, and a first writing stroke can be added and displayed on the first writing layer based on the first movement operation. As shown in Figure 15, Figure 15 is a schematic diagram of another text input scenario provided by an embodiment of this application. After confirming the existence of a target text editing box that has input focus, the first writing stroke can be displayed on the first writing layer, and the toolbar can be displayed at a preset position in the target text editing box.

Optionally, displaying the toolbar at a preset position in the target text editing box includes: hiding the soft keyboard corresponding to the target text editing box; and displaying the toolbar at the preset position after hiding the soft keyboard.

Optionally, the method may further include: monitoring whether the target text editing box loses input focus; and hiding the toolbar when the target text editing box loses input focus. In this embodiment, after determining that a target text editing box has gained input focus, it is possible to monitor whether the target text editing box loses input focus, and hide the toolbar after the target text editing box loses input focus. In the above solution, hiding the corresponding toolbar in a timely manner after the text editing box loses input focus can prevent the toolbar from affecting other controls that have gained input focus.

S1405, after confirming that the first movement operation has ended, obtain the text content in the standard font based on the first handwriting.

Optionally, obtaining text content in a standard font based on the first handwriting includes: performing optical character recognition on the first handwriting to obtain at least one candidate text content and the accuracy of each candidate text content; and determining the text content from the at least one candidate text content based on the accuracy of each candidate text content. The input focus is triggered by a click operation occurring on the first interface.

S1406, Display the text content in the target text editing box and close the first writing layer.

In this embodiment, after displaying the first handwriting and toolbar, it is possible to monitor whether the first movement operation has terminated. After the first movement operation terminates, the first writing layer can be closed, the first handwriting generated by the first movement operation on the first writing layer can be collected, and then the text content can be determined based on the first handwriting, and the text content can be displayed in the target text editing box. The method for displaying the text content in the target text editing box is shown in Figure 7, which will not be described in detail here. As shown in Figure 16, Figure 16 is a schematic diagram of an interface change provided by an embodiment of this application. When a user inputs text content into a text editing box, they can first determine the target text editing box from at least one text editing box included in the first interface, and then use their finger to click the target text editing box in the first interface to make the target text editing box gain input focus. After clicking the target text editing box, the user performs the first movement operation. After receiving the first movement operation, the interactive tablet determines that there is a target text editing box that has gained input focus, overlays the first writing layer on the first interface, and overlays a floating layer on the first writing layer. The floating layer is a transparent layer, and then displays the toolbar on the floating layer. The toolbar is located at a preset position of the target text editing box.

During the execution of the first movement operation, the first writing layer collects the movement trajectory of the first movement operation to obtain the first writing handwriting, which is then displayed on the first writing layer. After the first movement operation ends, the first writing layer is closed, and the text content is obtained based on the first writing handwriting. The text content is then displayed in the target text editing box, and a toolbar is displayed in the floating layer.

S1407, when receiving an operation on a target text editing control in at least one text editing control, the displayed text content is edited according to the first editing method corresponding to the target text editing control.

S1408, Display the edited text content in the target text editing box.

In this embodiment, after the text content is displayed in the target text editing box, the user's operation on the target text editing control in at least one text editing control can be received. The displayed text content is edited according to the first editing method corresponding to the target text editing control, and then the edited text content is displayed in the target text editing box. For a comparison of the understanding of steps 1407 and 1408, please refer to the embodiment shown in Figure 3. This embodiment will not be described in detail here.

Optionally, at least one text editing control includes an input control for inputting a space character and a delete control for deleting a character; editing the displayed text content according to a first editing method corresponding to the target text editing control includes: determining the text editing position from the displayed text content; if the target text editing control is the input control, inputting a space character at the text editing position; or, if the target text editing control is a delete control, deleting characters in the text content preceding the text editing position.

Optionally, at least one text editing control includes a switching control for switching input methods. The method may further include: hiding the toolbar when an operation on the switching control is received; and displaying a soft keyboard after hiding the toolbar, so as to edit the text content in the target text editing box via the soft keyboard. Optionally, when a target text editing box exists in at least one text editing box, the first writing style displayed in the first writing layer is a first color; when no target text editing box exists in at least one text editing box, the first writing style displayed in the first writing layer is a second color; wherein the first color and the second color are different.

In this embodiment, when at least one text editing box contains a target text editing box that has received input focus, it can be determined that the user needs to perform handwriting input via the first touch object. In this case, when the first handwriting is displayed on the first writing layer, the first handwriting in a first color can be displayed, for example, blue. Conversely, when no target text editing box contains a target text editing box that has received input focus, it can be determined that the user needs to annotate text via the first touch object. In this case, when the first handwriting is displayed on the first writing layer, the first handwriting in a second color can be displayed, for example, red.

In the above scheme, when there is a target text editing box that has received input focus, the writing handwriting of the first color is displayed, and when there is no target text editing box that has received input focus, the writing handwriting of the second color is displayed. By displaying the writing handwriting under different operations with different colors, it is easy for users to distinguish the writing handwriting under different operations.

Optionally, the method may further include: receiving a second movement operation occurring on the first writing layer, the second movement operation passing through the target text editing box; confirming that the second movement operation was performed by a first touch object, then determining a second editing method corresponding to the second movement operation based on the second movement operation; editing the text content according to the second editing method; and displaying the edited text content in the target text editing box.

Optionally, based on the second movement operation, determining the second editing method corresponding to the second movement operation includes: adding and displaying a second handwriting stroke on the first writing layer based on the second movement operation; when it is confirmed that the second movement operation passes through the text content displayed in the target text editing box, and the second handwriting stroke is a first preset handwriting stroke, determining the second editing method as deleting text; for example, the second movement operation could be drawing a wavy line on the text content displayed in the text editing box. When it is confirmed that the second movement operation passes through the text content displayed in the target text editing box, and the second handwriting stroke is a second preset handwriting stroke, determining the second editing method as selecting text; for example, the second movement operation could be drawing a horizontal line on the text content displayed in the text editing box. When it is confirmed that the second handwriting stroke is a third preset handwriting stroke, determining the editing method corresponding to the second movement operation as splitting or combining text content; for example, the second movement operation could be drawing a vertical line between the text content displayed in the text editing box, drawing a vertical line between split text content can combine text content, and drawing a vertical line between combined text content can split text content.

Optionally, when at least one text editing box does not contain a target text editing box, the method may further include: receiving a third movement operation, the third movement operation overlapping with the first handwriting, and the third movement operation being performed by a preset second touch object; erasing the first handwriting according to the third movement operation.

In this embodiment, when at least one text editing box does not contain a target text editing box with input focus, a third movement operation can be received. This third movement operation overlaps with the first handwriting and is performed by a preset second touch object. Based on the third movement operation, the first handwriting is then erased. Specifically, the first overlapping area between the third movement operation and the first handwriting can be identified, and the handwriting within this first overlapping area is erased. It should be noted that the third movement operation is an erasure operation of the first handwriting. Furthermore, the second touch object can be the end of a writing pen.

Optionally, the writing in the first handwriting can be completely erased or partially erased, depending on the actual situation, and is not specifically limited here. In the above scheme, if at least one text editing box does not have a target text editing box with input focus, a third movement operation is received. The first overlapping area between the third movement operation and the first handwriting is confirmed, and the writing in the first overlapping area of the first handwriting is erased. Since the erasure of the writing is determined based on the first overlapping area between the third movement operation and the first handwriting, the accuracy of the writing to be erased can be ensured, thereby improving user convenience.

Optionally, the method may further include receiving a fourth movement operation occurring on the first interface, confirming that the fourth movement operation is performed by a preset third touch object, updating the first interface according to the fourth movement operation, and displaying the updated first interface. Optionally, the fourth movement operation may be any one of writing, text selection, or text deletion. Furthermore, updating the first interface may be a swipe update or a page flip. By providing different update methods, users can choose different update methods, thus improving the user experience.

Figure 17 is a schematic flowchart of another writing method provided in an embodiment of this application. As shown in Figure 17, the method includes:

S1701, Receive the first movement operation that occurs on the first interface.

For example, when the first movement operation is a writing operation, the writing operation occurring on the first interface is received, and the landing position of the first movement operation on the first interface is determined.

Optionally, the first landing point location can be determined by directly detecting the touch signal or by detecting specific information of the touched object through an auxiliary sensor to determine the type of the touched object and the landing point location.

For example, the landing point can be represented based on coordinate data; for instance, with the top left corner of the first interface as the origin, the horizontal direction as the x-axis, and the vertical direction as the y-axis, the landing point of the movement operation can be determined based on the coordinate data, such as the landing point being (100, 200). The location of the coordinate system can be determined according to the actual situation, and no specific limitation is made here.

S1702, display the first writing layer on the first interface and receive the first writing stroke.

For example, if it is confirmed that the first movement operation is performed by a preset first touch object, then the first writing layer of the first writing application is superimposed on the first interface, and the movement trajectory of the first movement operation is collected through the first writing layer to obtain the first writing handwriting.

S1703, determine whether there is a target text editing box that has received input focus in at least one text editing box; if yes, then execute S1705; if no, then execute S1704.

S1704, Display the first handwriting on the first writing layer.

S1706, Display the toolbar at the preset position of the target text editing box, and add and display the first writing stroke on the first writing layer.

S1706, Identify the first handwriting to obtain candidate text.

S1707, determine the text content from at least one candidate text.

For example, text content can be determined from at least one candidate text through a candidate pop-up, or text content can be determined directly from at least one candidate text based on the accuracy of each candidate text.

S1708, Display the text content in the target text editing box and close the first writing layer.

S1709, upon receiving an operation on a target text editing control in at least one text editing control, the displayed text content is edited according to the first editing mode corresponding to the target text editing control.

S1710, if a second click operation on the target text editing box is received, a first writing layer is overlaid and displayed on the first interface according to the second click operation. The understanding of steps 1706 to 1710 can be found in the aforementioned examples, and will not be repeated here.

Figure 18 is a structural schematic diagram of a writing device provided in an embodiment of this application. As shown in Figure 18, the writing device 1800 includes: a display module 1801 for displaying a first interface, the first interface including at least one text editing box; a receiving module 1802 for receiving a first movement operation occurring on the first interface; the display module 1801 is further configured to confirm that the first movement operation is performed by a preset first touch object, overlay and display a first writing layer of a first writing application on the first interface, and add and display first writing strokes on the first writing layer based on the first movement operation; and a obtaining module 1803 for, when the first movement operation points to a target text editing box in the at least one text editing box, after confirming that the first movement operation has terminated, based on the... The first handwriting produces text content in a standard font; the display module 1801 is further configured to display the text content in the target text editing box, and to display a toolbar at a preset position in the target text editing box, and to close the first handwriting layer; wherein, the toolbar includes at least one text editing control; the editing module 1804 is configured to, after displaying the text content in the target text editing box, edit the displayed text content according to the first editing method corresponding to the target text editing control when receiving an operation on the target text editing control among the at least one text editing controls; the display module 1801 is further configured to display the edited text content in the target text editing box.

Figure 19 is a schematic diagram of a writing device provided in an embodiment of this application. As shown in Figure 19, the writing device 1900 includes: a display module 1901 for displaying a first interface, the first interface including at least one text editing box; a receiving module 1902 for receiving a first movement operation occurring on the first interface; the display module 1901 is further configured to confirm that the first movement operation is performed by a preset first touch object, and to overlay and display a first writing layer of a first writing application on the first interface; the display module 1901 is further configured to, when there is a target text editing box with input focus in the at least one text editing box, display a toolbar at a preset position of the target text editing box, and add and display first writing strokes on the first writing layer based on the first movement operation; wherein, the toolbar includes at least one text editing box. An editing control; a module 1903, configured to obtain text content in a standard font based on the first handwriting after confirming the termination of the first movement operation; wherein the input focus is triggered by a click operation occurring on the first interface; the display module 1901 is further configured to display the text content in the target text editing box and close the first writing layer; an editing module 1904, configured to, after displaying the text content in the target text editing box, edit the displayed text content according to the first editing method corresponding to the target text editing control when receiving an operation on the target text editing control in at least one text editing control; the display module 1901 is further configured to display the edited text content in the target text editing box.

Figure 20 is a schematic diagram of the structure of an interactive flat panel provided in an embodiment of this application. Exemplarily, as shown in Figure 20, the interactive flat panel 2000 includes a memory 2010 and a processor 2020. The memory 2010 stores executable program code 2030, and the processor 2020 is used to call and execute the executable program code 2030 to perform a writing method. Exemplarily, the memory 2010 can be used to store related programs of the writing method provided in this embodiment; the processor 2020 can call the related programs of the writing method stored in the memory 2010 to execute the writing method of this embodiment. This embodiment can divide the device into functional modules according to the above method example. For example, it can correspond to various functional modules, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware. It should be noted that the module division in this embodiment is illustrative and only represents a logical functional division; in actual implementation, there may be other division methods. It should be understood that the device provided in this embodiment is used to execute the above-described writing method, and therefore can achieve the same effect as the above-described implementation method.

This application also provides a computer-readable storage medium storing computer program code. When the computer program code is executed on a computer, it causes the computer to perform the aforementioned method steps to implement the writing method provided in the above embodiments. The computer-readable storage medium may include, but is not limited to, any type of disk, including floppy disks, optical disks, Digital Video Discs (DVDs), Compact Disc Read-Only Memory (CD-ROMs), and microdrives. The actuator, as well as magneto-optical disks, read-only memory (ROM), random access memory (RAM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), dynamic random access memory (DRAM), video random access memory (VRAM), flash memory devices, magnetic or optical cards, nanosystems (including molecular memory ICs), or any type of media or device suitable for storing instructions and/or data.

This application also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned related steps to implement a writing method provided in the above embodiments.

The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims (19)

A writing method, characterized in that the method includes: Display a first interface, which includes at least one text editing box; Receive a first movement operation occurring on the first interface; Confirm that the first movement operation is performed by a preset first touch object, overlay and display a first writing layer of the first writing application on the first interface, and add and display first writing strokes on the first writing layer based on the first movement operation; When the first movement operation points to the target text editing box in the at least one text editing box, after confirming that the first movement operation has terminated, the text content in standard font is obtained based on the first handwriting. The text content is displayed in the target text editing box, and a toolbar is displayed at a preset position in the target text editing box, while the first writing layer is closed; wherein, the toolbar includes at least one text editing control; Furthermore, after the text content is displayed in the target text editing box, upon receiving an operation on the target text editing control in the at least one text editing control, the displayed text content is edited according to the first editing method corresponding to the target text editing control; and the edited text content is displayed in the target text editing box. A writing method, characterized in that the method includes: Display a first interface, which includes at least one text editing box; Receive a first movement operation occurring on the first interface; Confirming that the first movement operation was performed by a preset first touch object, a first writing layer of the first writing application is overlaid and displayed on the first interface; When a target text editing box with input focus exists in at least one text editing box, a toolbar is displayed at a preset position of the target text editing box, and a first handwriting is added and displayed on the first writing layer based on the first movement operation; wherein, the toolbar includes at least one text editing control; the input focus is triggered by a click operation occurring on the first interface; After confirming that the first movement operation has ended, text content in standard font is obtained based on the first handwriting; the text content is displayed in the target text editing box, and the first writing layer is closed; Furthermore, after the text content is displayed in the target text editing box, upon receiving an operation on the target text editing control in the at least one text editing control, the displayed text content is edited according to the first editing method corresponding to the target text editing control; and the edited text content is displayed in the target text editing box. The method as described in claim 1 or 2, characterized in that, the step of overlaying and displaying the first writing layer of the first writing application on the first interface includes: A first writing layer of a first size is superimposed and displayed on the first interface; wherein the area of the first writing layer of the first size is larger than the area of the target text editing box and smaller than the area of the first interface; Obtain the duration of the first movement operation; when the duration exceeds a preset duration, display the first writing layer of a second size; wherein the second size is larger than the first size. The writing method according to claim 1 or 2 is characterized in that the at least one text editing control includes an input control for inputting space characters and a deletion control for deleting characters; The step of editing the displayed text content according to the first editing method corresponding to the target text editing control includes: determining the text editing position from the displayed text content; if the target text editing control is the input control, entering a space character at the text editing position; or, if the target text editing control is the delete control, deleting the characters in the text content that are located before the text editing position. The writing method according to claim 1 or 2, characterized in that the at least one text editing control includes a switching control for switching input methods, and the method further includes: When an operation on the switching control is received, the toolbar is hidden; after the toolbar is hidden, the soft keyboard is displayed so that the text content in the target text editing box can be edited using the soft keyboard. The writing method according to claim 1 or 2, characterized in that, displaying the toolbar at a preset position in the target text editing box includes: Hide the soft keyboard corresponding to the target text editing box; after hiding the soft keyboard, display the toolbar at the preset position. The writing method according to claim 1 or 2 is characterized in that obtaining the text content of the standard font based on the first handwriting includes: performing optical character recognition on the first handwriting to obtain at least one candidate text content and the accuracy of each candidate text content; and determining the text content from the at least one candidate text content based on the accuracy of each candidate text content. The method as described in claim 2, wherein the method further comprises: monitoring whether the target text editing box loses the input focus; and hiding the toolbar when the target text editing box loses the input focus. The method as described in claim 1, wherein in the step of adding and displaying the first handwriting on the first writing layer based on the first movement operation, when the first movement operation points to the target text editing box, the first handwriting displayed in the first writing layer is a handwriting of a first color; when the first movement operation does not point to any of the at least one text editing box, the first handwriting displayed in the first writing layer is a handwriting of a second color; wherein the first color is different from the second color. The method as described in claim 2, wherein in the step of adding and displaying the first handwriting on the first writing layer based on the first movement operation, when the target text editing box exists in the at least one text editing box, the first handwriting displayed in the first writing layer is a handwriting of a first color; when the target text editing box does not exist in the at least one text editing box, the first handwriting displayed in the first writing layer is a handwriting of a second color; wherein the first color is different from the second color. The method as described in claim 1 or 2, characterized in that the method further comprises: Receive a second movement operation occurring on the first writing layer, the second movement operation passing through the target text editing box; If it is confirmed that the second movement operation was performed by the first touch object, then the second editing method corresponding to the second movement operation is determined based on the second movement operation; Edit the text content according to the second editing method; The edited text content is displayed in the target text editing box. The writing method according to claim 11, characterized in that, determining the second editing mode corresponding to the second movement operation based on the second movement operation includes: Based on the second movement operation, add and display the second writing stroke on the first writing layer; When it is confirmed that the second movement operation passes through the text content displayed in the target text editing box, and the second handwriting is the first preset handwriting, the second editing method is determined to be deleting text; When it is confirmed that the second movement operation passes through the text content displayed in the target text editing box, and the second handwriting is the second preset handwriting, the second editing method is determined to be selected text; Once it is confirmed that the second handwriting is the third preset handwriting, the second editing method is determined to be splitting or combining text content. The writing method according to claim 1, characterized in that, when the first movement operation does not point to a text editing box, the method further includes: Receive a third movement operation, the third movement operation overlapping with the first writing stroke, and the third movement operation being performed by a preset second touch object; The first handwriting is erased according to the third movement operation. The writing method according to claim 2, characterized in that, when the target text editing box does not exist in the at least one text editing box, the method further includes: Receive a third movement operation, the third movement operation overlapping with the first writing stroke, and the third movement operation being performed by a preset second touch object; The first handwriting is erased according to the third movement operation. The writing method according to claim 13 or 14, characterized in that, the step of erasing the first writing stroke according to the third movement operation includes: Confirm the first overlapping area between the third movement operation and the first writing stroke; The erasure is performed on the writing in the first overlapping area of the first writing. The writing method according to claim 1 or 2 is characterized in that the method further includes: receiving a fourth movement operation occurring on the first interface; confirming that the fourth movement operation is performed by a preset third touch object; updating the first interface according to the fourth movement operation; and displaying the updated first interface. The writing method according to claim 16 is characterized in that updating the first interface includes: updating the first interface by sliding; or updating the first interface by turning pages. An interactive flat panel, characterized in that it comprises: Memory, used to store executable program code; A processor is configured to call and run the executable program code from the memory, causing the interactive tablet to perform the writing method as described in any one of claims 1 to 17. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, which, when executed, implements the writing method as described in any one of claims 1 to 17.