CN112463012B - Method for Consistent Display of Handwriting in Paper and Screen Synchronization - Google Patents
Method for Consistent Display of Handwriting in Paper and Screen Synchronization Download PDFInfo
- Publication number
- CN112463012B CN112463012B CN202010802004.7A CN202010802004A CN112463012B CN 112463012 B CN112463012 B CN 112463012B CN 202010802004 A CN202010802004 A CN 202010802004A CN 112463012 B CN112463012 B CN 112463012B
- Authority
- CN
- China
- Prior art keywords
- paper
- display
- virtual
- display window
- area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B11/00—Teaching hand-writing, shorthand, drawing, or painting
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
本发明涉及教学用具技术领域,公开了一种纸屏同步中手写笔迹一致显示的方法,首先初始化,将物理纸张置于手写板之上,连接手写板与显示设备,在虚拟纸张上布置矩形框作为显示参考信息,设置虚拟纸张与物理纸张的比例系数和当前窗口所显示的区域位置;然后,接收手写设备实时采集的笔尖位置信息,将笔尖位置信息与参考矩形位置数据进行比较,依据比较结果不断调整显示区域,跟踪笔尖位置并将当前笔尖所处的相关区域置于显示中心。本发明纸屏同步中手写笔迹一致性显示的方法,实时感知书写过程中笔尖在物理纸张上所处的位置,并将所书写的手写笔迹一致显示在屏幕上,具有笔尖位置实时跟踪、所显示的笔迹不产生形变、随意调整所显示的笔迹大小的优点。
The invention relates to the technical field of teaching appliances, and discloses a method for consistent display of handwriting in paper-screen synchronization. First, initialize, place physical paper on a tablet, connect the tablet and a display device, and arrange a rectangular frame on the virtual paper As the display reference information, set the scale factor of the virtual paper and the physical paper and the area position displayed in the current window; then, receive the pen tip position information collected in real time by the handwriting device, and compare the pen tip position information with the reference rectangle position data, and based on the comparison result Continuously adjusts the display area, tracking the pen tip position and centering the display in the relevant area where the current pen tip is located. The method for displaying handwriting consistency in the synchronization of paper and screen of the present invention senses the position of the pen tip on the physical paper in real time during the writing process, and displays the written handwriting on the screen in a consistent manner. The handwriting does not produce deformation, and the size of the displayed handwriting can be adjusted at will.
Description
技术领域technical field
本发明涉及教学用具技术领域,具体涉及纸屏同步中手写笔迹一致性显示的方法。The invention relates to the technical field of teaching appliances, in particular to a method for consistent display of handwriting and handwriting in paper-screen synchronization.
背景技术Background technique
随着电子信息技术的飞速发展,纸屏同步成为可能。所谓纸屏同步是指用户拿着普通的笔在普通纸张上书写的同时,电子手写设备实时感知用户的手写过程和结果,并同步显示和保存手写笔迹数据。与传统的电子手写设备相比,纸屏同步的优点在于完全符合手眼协调一致的书写习惯,也就是在整个书写过程中,用户视觉反馈是由手中的笔留在纸上的痕迹带来的,而不是像传统手写设备那样,手眼在书写过程中是分离的,视觉反馈是由屏幕产生的。With the rapid development of electronic information technology, paper screen synchronization becomes possible. The so-called paper-screen synchronization means that while the user is holding an ordinary pen and writing on ordinary paper, the electronic handwriting device perceives the user's handwriting process and results in real time, and simultaneously displays and saves the handwriting data. Compared with traditional electronic handwriting devices, the advantage of paper-screen synchronization is that it fully conforms to the writing habit of hand-eye coordination, that is, during the entire writing process, the user's visual feedback is brought by the traces of the pen in the hand left on the paper. Instead of hand-eye separation during writing, as in traditional handwriting devices, visual feedback is generated by the screen.
但是,在纸屏同步中,由于手写设备的书写区域与显示设备在大小规格上的不一致,导致屏幕上显示的笔迹易产生字体变形、不能实时跟踪并显示笔尖附近的书写区域、不能随意调整笔迹大小等问题。这些问题会极大影响用户在书写过程中的感受,阻碍纸屏同步技术的广泛应用。However, in the paper-screen synchronization, due to the inconsistency in the size of the writing area of the handwriting device and the display device, the handwriting displayed on the screen is prone to font deformation, the writing area near the pen tip cannot be tracked and displayed in real time, and the handwriting cannot be adjusted at will. size, etc. These problems will greatly affect the user's feeling in the writing process and hinder the wide application of the paper-screen synchronization technology.
发明内容SUMMARY OF THE INVENTION
本发明的目的就是针对上述技术的不足,提供一种纸屏同步中手写笔迹一致性显示的方法,实时感知书写过程中笔尖在物理纸张上所处的位置,并将所书写的手写笔迹一致性显示在屏幕上,具有笔尖位置实时跟踪、所显示的笔迹不产生形变、能随意调整所显示的笔迹大小的优点。The purpose of the present invention is to address the deficiencies of the above-mentioned technologies, to provide a method for displaying the consistency of handwriting in the synchronization of paper and screen, to sense the position of the pen tip on the physical paper in real time during the writing process, and to display the consistency of the written handwriting. Displayed on the screen, it has the advantages of real-time tracking of the position of the pen tip, no deformation of the displayed handwriting, and the advantages of being able to adjust the size of the displayed handwriting at will.
为实现上述目的,本发明所设计的纸屏同步中手写笔迹一致性显示的方法,包括如下步骤:In order to achieve the above-mentioned purpose, the method for consistent display of handwriting and handwriting in the synchronization of paper and screen designed by the present invention includes the following steps:
A)初始化:A) Initialization:
首先,将物理纸张置于手写板之上,使得物理纸张的四个角与手写板数据采集区域四个角在整个书写过程中保持固定且重合;First, place the physical paper on the tablet, so that the four corners of the physical paper and the four corners of the data collection area of the tablet remain fixed and coincident throughout the writing process;
然后,连接手写板与显示设备,显示设备获取手写板的设备尺寸规格信息,依据设备尺寸规格信息,显示设备创建虚拟纸张,虚拟纸张的长度和宽度大小均保持与书写纸尺寸相同的比例;Then, connect the tablet and the display device, the display device obtains the device size specification information of the tablet, and according to the device size specification information, the display device creates a virtual paper, and the length and width of the virtual paper are kept in the same proportion as the size of the writing paper;
接下来,在虚拟纸张上整齐的布置矩形框作为显示参考信息,记录每个矩形框的中心点在虚拟纸张中的位置信息;矩形的长度和高度值设置依据相关应用中所书写汉字的典型尺寸而定;例如在学龄儿童练字应用中,典型的汉字尺寸不超过1.5cm×1.5cm,那么将矩形框的长度和宽度均设置为1.5cm;Next, neatly arrange rectangular boxes on the virtual paper as display reference information, and record the position information of the center point of each rectangular box in the virtual paper; the length and height of the rectangle are set according to the typical size of the Chinese characters written in the relevant application. For example, in the application of calligraphy practice for school-age children, the typical size of Chinese characters does not exceed 1.5cm×1.5cm, then the length and width of the rectangular frame are set to 1.5cm;
最后,设置虚拟纸张与物理纸张的比例系数R,根据比例系数R设置虚拟纸张的属性参数,设置显示窗口当前所显示的虚拟纸张矩形区域以及显示窗口的中心点和显示窗口的主显示矩形区域;比例系数R的取值范围为R2≤R≤R1,R1为显示区域的长度和高度与虚拟纸张上布置的矩形框长度和高度的比值的较小者,表示显示区域至少能显示一个笔迹,R2的取值与显示区域至多能同时显示的笔迹个数NR相关,NR=(R1/R22);Finally, set the proportional coefficient R of the virtual paper and the physical paper, set the attribute parameters of the virtual paper according to the proportional coefficient R, set the virtual paper rectangular area currently displayed in the display window, the center point of the display window and the main display rectangular area of the display window; The value range of the scale coefficient R is R2≤R≤R1, R1 is the smaller of the ratio of the length and height of the display area to the length and height of the rectangular frame arranged on the virtual paper, indicating that the display area can display at least one handwriting, R2 The value of is related to the number of handwriting NR that can be displayed simultaneously in the display area at most, NR =(R1/R2 2 );
B)手写笔迹同步显示:B) Simultaneous display of handwriting:
当用户在物理纸张上书写的同时,手写板对笔尖运动的轨迹实时采样,并将采样的笔尖位置信息实时传送给显示设备,显示设备首先进行坐标转换,将手写板传过来的物理纸张位置坐标转换成虚拟纸张位置坐标;When the user writes on the physical paper, the tablet samples the trajectory of the pen tip movement in real time, and transmits the sampled pen tip position information to the display device in real time. Converted to virtual paper position coordinates;
然后,显示设备判断该时刻的虚拟纸张位置坐标是否在显示窗口的主显示区域内,如果在主显示区域内,则在显示窗口绘制出当前时刻笔迹的运动轨迹,否则,依据当前采样点的虚拟纸张位置坐标,在所有规则排列的矩形框中,找出中心点离当前虚拟纸张位置坐标距离最近的矩形框,移动显示窗口,使得显示窗口的中心点位置移动到所述距离最近矩形框中心点位置,再在显示窗口绘制出当前时刻笔迹的运动轨迹,结束对当前采样点虚拟纸张位置坐标的绘制后,读取下一采样时刻的笔尖位置信息,重复上述操作,直到书写过程结束;Then, the display device judges whether the position coordinates of the virtual paper at this moment are in the main display area of the display window, and if it is in the main display area, the movement trajectory of the handwriting at the current moment is drawn in the display window, otherwise, according to the virtual paper at the current sampling point Paper position coordinates, in all the rectangular boxes arranged regularly, find the rectangular box whose center point is closest to the current virtual paper position coordinates, and move the display window so that the center point of the display window moves to the center point of the nearest rectangular box. position, and then draw the motion trajectory of the handwriting at the current moment in the display window, after finishing the drawing of the virtual paper position coordinates of the current sampling point, read the pen tip position information at the next sampling moment, and repeat the above operations until the writing process ends;
所述显示窗口是指在显示设备上为同步的显示手写笔迹而开辟的一块显示区域;The display window refers to a display area opened up on the display device for synchronously displaying handwriting;
所述主显示区域是一块中心点与显示窗口中心点重合的矩形显示区域,该矩形显示区域的面积小于显示窗口的面积,设置主显示区域的目的是为了始终避免将笔尖置于显示窗口的边缘;The main display area is a rectangular display area whose center point coincides with the center point of the display window. The area of the rectangular display area is smaller than the area of the display window. The purpose of setting the main display area is to always avoid placing the pen tip on the edge of the display window. ;
所述一致性显示是指显示设备实时跟踪书写过程中笔尖在物理纸张上所处的位置,并将笔尖在物理纸张上当前所处的一块区域置于显示窗口的中心区域,所显示的笔迹大小能自适应显示区域大小,所绘制在虚拟纸张上的手写笔迹的位置和长宽比例与物理纸张上手写笔迹的位置和长宽比例相一致。The consistent display means that the display device tracks the position of the pen tip on the physical paper in real time during the writing process, and places an area where the pen tip is currently located on the physical paper in the center area of the display window. It can adapt to the size of the display area, and the position and aspect ratio of the handwritten handwriting drawn on the virtual paper are consistent with the position and aspect ratio of the handwritten handwriting on the physical paper.
优选地,所述步骤A),包括如下步骤:Preferably, described step A), comprises the steps:
A1)开始:纸屏同步中手写笔迹一致性显示方法的初始化步骤开始;A1) Start: the initialization step of the handwriting consistency display method in the paper-screen synchronization starts;
A2)将物理纸张置于手写板之上,使得物理纸张的四个角与手写板数据采集区域四个角在整个书写过程中保持固定且重合,所述物理纸张包括没有格子的白纸,只有水平或垂直方向的参考线的信纸,还包括用于写字练习的田字格或米字格练字纸;A2) Place the physical paper on the tablet, so that the four corners of the physical paper and the four corners of the data collection area of the tablet remain fixed and coincident throughout the writing process. The physical paper includes white paper without grids, and only Stationery paper with reference lines in the horizontal or vertical direction, and also includes field-shaped or rice-shaped practice paper for writing practice;
A3)连接手写板与显示设备,显示设备获取手写板的设备尺寸规格信息,依据设备尺寸规格信息,显示设备创建虚拟纸张,为了在显示设备上使得显示出来的笔迹不产生形变,虚拟纸张的长度和宽度大小均保持与书写纸尺寸一致的比例;A3) Connect the tablet and the display device, the display device obtains the device size specification information of the tablet, and according to the device size specification information, the display device creates a virtual paper. In order to prevent the displayed handwriting from being deformed on the display device, the length of the virtual paper and width are kept in the same proportion as the size of writing paper;
所述显示设备是指具有显示功能的设备,包括智能手机、平板电脑、笔记本电脑、台式电脑;The display device refers to a device with a display function, including smart phones, tablet computers, notebook computers, and desktop computers;
所述虚拟纸张是指在计算机中虚拟生成的,可以用软件画图工具在虚拟纸张上绘制图案,并可以在显示设备上呈现所绘制内容的虚拟资源;虚拟纸张的属性包括宽度和高度;The virtual paper refers to a virtual resource that is virtually generated in a computer, can use a software drawing tool to draw patterns on the virtual paper, and can present the drawn content on a display device; the properties of the virtual paper include width and height;
设物理纸张的宽度和高度分别为L1和H1,设虚拟纸张的宽度和高度分别为L2和H2,若H1=H2×r1,L1=L2×r2,且r1=r2,则称物理纸张和虚拟纸张的长宽比例是一致的;其中r1,r2为缩放比例系数,0<r1,r2<+∞;Let the width and height of the physical paper be L1 and H1 respectively, and let the width and height of the virtual paper be L2 and H2 respectively, if H1=H2×r1, L1=L2×r2, and r1=r2, then the physical paper and the virtual paper are called The aspect ratio of the paper is the same; r1, r2 are scaling coefficients, 0<r1, r2<+∞;
所述物理纸张的长度和宽度与手写板书写区域的尺寸相关;The length and width of the physical paper are related to the size of the writing area of the tablet;
A4)在虚拟纸张上整齐的布置矩形框作为显示参考信息,记录每个矩形框的中心点在虚拟纸张中的位置信息;A4) neatly arrange rectangular frames on the virtual paper as display reference information, and record the position information of the center point of each rectangular frame in the virtual paper;
所述在虚拟纸张上整齐的布置矩形框是指在虚拟纸张上按从上到下,从左到右的顺序布置矩形框,任意两个被布置的矩形框重合部分的面积小于等于零,每行和每列矩形框之间设置一定的距离,在虚拟纸张的上、下、左、右部留出一定的空白区域,所述矩形框之间留出的距离大小、上、下、左、右部空白区域的大小、矩形框长度和宽度的大小根据具体应用的要求而定;例如在预知书写汉字较小的应用中,矩形框可设置得较小些;特别地,在物理纸张上已预先印刷有田字格、米字格的应用场景中,虚拟纸张上布置的矩形框大小、排列位置、边缘及矩形框行、列间留白等与物理纸张上印刷的田字格或米字格框大小、排列位置、边缘及矩形框行、列间留白保持一致;在物理纸张上已预先印刷有水平或垂直方向参考线的应用场景中,虚拟纸张上布置的矩形框高度不超过两条水平参考线的距离,并使矩形框的底边与水平参考线重合,虚拟纸张上布置的矩形框宽度不超过两条垂直参考线的距离,并使矩形框的左边与垂直参考线重合,在虚拟纸张的上、下、左、右部留出的空白区域大小与物理纸张上印刷的对应留白区域大小保持一致;The neatly arranging rectangular boxes on the virtual paper refers to arranging the rectangular boxes on the virtual paper in the order from top to bottom and from left to right, and the overlapping area of any two arranged rectangular boxes is less than or equal to zero. A certain distance is set between the rectangular boxes in each column, and a certain blank area is left on the upper, lower, left and right parts of the virtual paper. The size of the blank area, the length and width of the rectangular frame are determined according to the requirements of the specific application; for example, in the application where the writing Chinese characters are predicted to be smaller, the rectangular frame can be set smaller; In the application scenario of printing field grids and rice grids, the size, arrangement position, edge, and white space between rectangular frame rows and columns arranged on the virtual paper are different from those printed on the physical paper. The size, arrangement position, edges, and white space between the rows and columns of the rectangular frame shall be consistent; in the application scenario where the horizontal or vertical reference lines are pre-printed on the physical paper, the height of the rectangular frame arranged on the virtual paper shall not exceed two horizontal lines. The distance of the reference line, and make the bottom edge of the rectangular box coincide with the horizontal reference line, the width of the rectangular box arranged on the virtual paper does not exceed the distance between the two vertical reference lines, and make the left side of the rectangular box coincide with the vertical reference line. The size of the blank area left on the upper, lower, left and right parts of the paper is consistent with the size of the corresponding blank area printed on the physical paper;
所述虚拟纸张的属性参数包括虚拟纸张的宽度L2,L2=L1×R;高度H2,H2=H1×R;其中L1和H1分别表示物理纸张的宽度和高度;整齐布置的第i个矩形框的中心点位置信息其中,表示R=1时,第i个矩形框的中心点在虚拟纸张中所处的位置;比例系数R的取值应能保证在相关的应用场景中至少一个汉字笔迹能被完整显示在显示窗口中;The attribute parameters of the virtual paper include the width L2 of the virtual paper, L2=L1×R; the height H2, H2=H1×R; wherein L1 and H1 represent the width and height of the physical paper respectively; the i-th rectangular frame arranged neatly The center point position information of in, Indicates the position of the center point of the i-th rectangular frame in the virtual paper when R=1; the value of the proportional coefficient R should ensure that at least one Chinese handwriting can be completely displayed in the display window in relevant application scenarios ;
经过此步骤后,得到(L1,H1,L2,H2,R,E1,E2,...,Ei,...,En)其中L1和H1表示物理纸张的宽度和高度,L2和H2表示虚拟纸张的宽度和高度,R表示比例系数,L2=L1×R,H2=H1×R,表示第i个矩形框的中心点位置信息,1≤i≤n,n表示虚拟纸张上布置的矩形框个数,其中表示R=1时,第i个矩形框的中心点在虚拟纸张中所处的位置;After this step, we get (L1, H1 ,L2,H2,R,E1, E2 ,...,Ei,..., En ) where L1 and H1 represent the width and height of the physical paper, L2 and H2 represents the width and height of the virtual paper, R represents the scale factor, L2=L1×R, H2=H1×R, Indicates the position information of the center point of the i-th rectangular frame, 1≤i≤n, n denotes the number of rectangular frames arranged on the virtual paper, in Indicates the position of the center point of the i-th rectangular frame in the virtual paper when R=1;
A5)设置虚拟纸张与物理纸张的比例系数R,根据比例系数R设置虚拟纸张的属性参数;设置显示窗口当前所显示的虚拟纸张矩形区域以及显示窗口的中心点和显示窗口的主显示矩形区域;A5) set the proportional coefficient R of virtual paper and physical paper, set the attribute parameter of virtual paper according to proportional coefficient R; Set the virtual paper rectangular area currently displayed in the display window and the center point of the display window and the main display rectangular area of the display window;
比例系数R的取值范围为R2≤R≤R1,R1为显示区域的长度和高度与虚拟纸张上布置的矩形框长度和高度的比值的较小者,表示显示区域至少能显示一个笔迹,R2的取值与显示区域至多能同时显示的笔迹个数NR相关,NR=(R1/R2)2;The value range of the scale coefficient R is R2≤R≤R1, R1 is the smaller of the ratio of the length and height of the display area to the length and height of the rectangular frame arranged on the virtual paper, indicating that the display area can display at least one handwriting, R2 The value of is related to the number of handwriting NR that can be displayed simultaneously in the display area at most, NR =(R1/R2) 2 ;
所述设置显示窗口当前所显示的虚拟纸张矩形区域以及显示窗口的中心点和显示窗口的主显示矩形区域是指,在初始状态下,任选一个矩形框,将显示窗口的中心点置于该矩形框的中心点上, 表示第k个矩形框等比例缩放后的中心点,1≤k≤n;显示窗口的四个顶点由下式求得:The setting of the virtual paper rectangular area currently displayed in the display window, the center point of the display window, and the main display rectangle area of the display window refers to, in the initial state, selecting a rectangular frame, and placing the center point of the display window on the display window. On the center point of the rectangular box, Represents the center point of the k-th rectangular box after proportional scaling, 1≤k≤n; the four vertices of the display window are obtained by the following formula:
显示窗口的主显示矩形区域四个顶点由下式求得:The four vertices of the main display rectangular area of the display window are obtained by the following equations:
其中n表示虚拟纸张上布置的矩形框个数,Width和Height分别表示显示窗口的宽度和高度;0<w<1为比例系数,用于调节主显示区域大小占比显示窗口的比例;Among them, n represents the number of rectangular boxes arranged on the virtual paper, Width and Height represent the width and height of the display window respectively; 0<w<1 is the scale factor, which is used to adjust the proportion of the main display area to the display window;
A6)结束:经过初始化步骤,为在显示设备上一致性显示同步书写在物理纸张上的手写笔迹做好准备。A6) End: After the initialization step, preparations are made for the consistent display of the handwritten handwriting written on the physical paper synchronously on the display device.
优选地,所述步骤B),包括如下步骤:Preferably, described step B), comprises the steps:
B1)开始:纸屏同步中手写笔迹一致性显示方法一致性显示步骤的开始;B1) Start: the start of the consistent display step of the handwriting consistency display method in the paper-screen synchronization;
B2)显示设备接收来自书写过程中手写板采集的一个时序位置数据,手写板采集在书写过程中笔尖在物理纸张区域上所处于的时序位置数据si=(xi,yi);B2) the display device receives a time-series position data collected from the handwriting board during the writing process, and the handwriting board collects the time-series position data s i =( xi , y i ) where the pen tip is located on the physical paper area during the writing process;
B3)显示设备同步一致性显示该时刻时序位置数据:以当前时刻笔尖在物理纸张区域上所处于的时序位置数据si=(xi,yi),当前显示窗口的四个顶点在虚拟纸张的位置坐标{(dx1,dy1),(dx2,dy2),(dx3,dy3),(dx4,dy4)},当前显示窗口的中心点在虚拟纸张的位置坐标(Gx,Gy),当前显示窗口的主显示区域四个顶点在虚拟纸张的位置坐标作为参数,调用同步一致性显示子方法,得到该时刻笔尖在虚拟纸张上的时序位置数据为Ai=(ui,vi);更新后的当前显示窗口的四个顶点在虚拟纸张的位置坐标{(dx1,dy1),(dx2,dy2),(dx3,dy3),(dx4,dy4)},更新后的当前显示窗口的中心点在虚拟纸张的位置坐标(Gx,Gy),更新后的当前显示窗口的主显示区域四个顶点在虚拟纸张的位置坐标{(fx1,fy1),(fx2,fy2),(fx3,fy3),(fx4,fy4)};B3) Display device synchronously and consistently display the time-series position data at this moment: with the time-series position data s i =(x i , y i ) where the pen tip is on the physical paper area at the current moment, the four vertices of the current display window are on the virtual paper The position coordinates of {(dx 1 ,dy 1 ),(dx 2 ,dy 2 ),(dx 3 ,dy 3 ),(dx 4 ,dy 4 )}, the position coordinates of the center point of the current display window on the virtual paper ( Gx, Gy), the position coordinates of the four vertices of the main display area of the current display window on the virtual paper As a parameter, call the synchronization consistency display sub-method, and obtain the time series position data of the pen tip on the virtual paper at this moment as A i =( u i ,vi ); the updated position of the four vertices of the current display window on the virtual paper Coordinates {(dx 1 ,dy 1 ),(dx 2 ,dy 2 ),(dx 3 ,dy 3 ),(dx 4 ,dy 4 )}, the updated position coordinates of the center point of the current display window on the virtual paper (Gx, Gy), the updated position coordinates of the four vertices of the main display area of the current display window on the virtual paper {(fx 1 ,fy 1 ),(fx 2 ,fy 2 ),(fx 3 ,fy 3 ), (fx 4 ,fy 4 )};
B4)判断手写过程是否结束:判断手写板传送到显示设备的笔尖实时位置数据是否结束,若已结束,则跳转至步骤B5),同步显示过程结束;否则,跳转至步骤B2),继续对下一个笔尖位置数据进行同步显示;B4) Judging whether the handwriting process is finished: Judging whether the real-time position data of the pen tip transmitted by the handwriting board to the display device is finished, if it has ended, then jump to step B5), and the synchronous display process ends; otherwise, jump to step B2), continue Simultaneously display the next pen tip position data;
B5)结束:纸屏同步中手写笔迹一致性显示方法一致性显示步骤的结束。B5) End: the end of the consistent display step of the handwriting consistency display method in the paper-screen synchronization.
优选地,所述步骤B3),包括如下步骤:Preferably, described step B3), comprises the steps:
B31)开始:假设该时刻显示设备接收到的笔尖时序位置数据为si=(xi,yi),当前显示窗口的四个顶点在虚拟纸张的位置坐标当前显示窗口的中心点在虚拟纸张的位置坐标(Gx,Gy),当前显示窗口的主显示区域四个顶点在虚拟纸张的位置坐标{(fx1,fy1),(fx2,fy2),(fx3,fy3),(fx4,fy4)};B31) Start: Assuming that the time series position data of the pen tip received by the display device at this moment is s i =(x i , y i ), the position coordinates of the four vertices of the current display window on the virtual paper The position coordinates (Gx, Gy) of the center point of the current display window on the virtual paper, the position coordinates of the four vertices of the main display area of the current display window on the virtual paper {(fx 1 ,fy 1 ),(fx 2 ,fy 2 ) ,(fx 3 ,fy 3 ),(fx 4 ,fy 4 )};
B32)将手写板传来的该采样时刻笔尖所处的手写板位置坐标转化为显示设备中虚拟纸张的位置坐标:ui=xi×R,vi=yi×R,得到笔尖在虚拟纸张坐标Ai=(ui,vi),其中R是在系统初始化阶段设置的虚拟纸张与物理纸张的比例系数;B32) Convert the position coordinates of the pen tip at the sampling moment sent from the tablet into the position coordinates of the virtual paper in the display device: u i =x i ×R, v i =y i ×R, get the pen tip in the virtual Paper coordinates A i =( u i ,vi ), where R is the scaling factor between virtual paper and physical paper set in the system initialization stage;
B33)判断虚拟坐标是否处于显示窗口的主显示区域内:判断Ai=(ui,vi)是否在定义的矩形区域内;若是,则跳转至步骤B36);否则,跳转至步骤B34);B33) Determine whether the virtual coordinates are in the main display area of the display window: determine whether A i =( u i ,vi ) is in the main display area of the display window In the defined rectangular area; if so, jump to step B36); otherwise, jump to step B34);
B34)依据虚拟坐标Ai=(ui,vi),在所有规则排列的矩形框中,找出虚拟坐标Ai=(ui,vi)与矩形框中心点距离最近的矩形框:在所有1≤i≤n中,计算Ai=(ui,vi)与所有矩形框中心点的距离,1≤i≤n,设表示与Ai=(ui,vi)距离最近的中心点,1≤k≤n;B34) According to the virtual coordinates A i =(u i ,v i ), in all the regularly arranged rectangular frames, find out the rectangle frame with the virtual coordinates A i =(u i ,vi ) and the center point of the rectangular frame closest to the center point: In all In 1≤i≤n, calculate A i =( u i ,vi ) and the center points of all rectangles distance, 1≤i≤n, set represents the closest center point to A i =(u i ,vi ) , 1≤k≤n;
B35)移动显示窗口,使得显示窗口的中心点位置与所述距离最近矩形框中心点位置对齐:将显示窗口的中心点移动到第k个矩形框的中心点位置并更新当前显示窗口的四个顶点在虚拟纸张的位置坐标{(dx1,dy1),(dx2,dy2),(dx3,dy3),(dx4,dy4)},当前显示窗口的中心点在虚拟纸张的位置坐标(Gx,Gy),当前显示窗口的主显示区域四个顶点在虚拟纸张的位置坐标{(fx1,fy1),(fx2,fy2),(fx3,fy3),(fx4,fy4)};B35) Move the display window so that the center point of the display window is aligned with the center point of the nearest rectangular frame: move the center point of the display window to the center point of the kth rectangular frame And update the position coordinates of the four vertices of the current display window on the virtual paper {(dx 1 ,dy 1 ),(dx 2 ,dy 2 ),(dx 3 ,dy 3 ),(dx 4 ,dy 4 )}, the current The position coordinates (Gx, Gy) of the center point of the display window on the virtual paper, the position coordinates of the four vertices of the main display area of the current display window on the virtual paper {(fx 1 ,fy 1 ),(fx 2 ,fy 2 ), (fx 3 ,fy 3 ),(fx 4 ,fy 4 )};
具体地,将以第k个矩形框的中心点作为显示窗口的中心点, 表示第k个矩形框等比例缩放后的中心点;显示窗口的四个顶点由下式更新:Specifically, the center point of the kth rectangular frame is used as the center point of the display window, Represents the center point of the k-th rectangular box after the proportional scaling; the four vertices of the display window are updated by the following formulas:
显示窗口的主显示矩形区域四个顶点由下式更新:The four vertices of the main display rectangular area of the display window are updated by:
其中Width和Height分别表示显示窗口的宽度和高度;0<w<1为比例系数,用于调节主显示区域大小占比显示窗口的比例;Among them, Width and Height represent the width and height of the display window respectively; 0<w<1 is the proportional coefficient, which is used to adjust the proportion of the size of the main display area to the display window;
B36)在显示窗口的主显示区域将该时刻笔尖所处的虚拟纸张位置显示出来:调用绘图方法,将从上一个采样时刻到当前采样时刻,笔尖在虚拟纸张上的运动轨迹绘制并显示出来;B36) in the main display area of the display window, the virtual paper position of the pen tip at this moment is displayed: call the drawing method, from the last sampling moment to the current sampling moment, the motion track of the pen tip on the virtual paper is drawn and displayed;
B37)结束:表示显示设备同步一致性显示该采样时刻笔尖时序位置数据步骤的结束;返回该时刻笔尖在虚拟纸张上的时序位置数据为Ai=(ui,vi);当前显示窗口的四个顶点在虚拟纸张的位置坐标{(dx1,dy1),(dx2,dy2),(dx3,dy3),(dx4,dy4)},当前显示窗口的中心点在虚拟纸张的位置坐标(Gx,Gy),当前显示窗口的主显示区域四个顶点在虚拟纸张的位置坐标{(fx1,fy1),(fx2,fy2),(fx3,fy3),(fx4,fy4)}。B37) End: indicate the end of the step of displaying the time-series position data of the pen tip at the sampling moment synchronously and consistently; return the time-series position data of the pen tip on the virtual paper at this moment as A i =( u i ,vi ); The position coordinates of the four vertices on the virtual paper {(dx 1 ,dy 1 ),(dx 2 ,dy 2 ),(dx 3 ,dy 3 ),(dx 4 ,dy 4 )}, the center point of the current display window is at The position coordinates of the virtual paper (Gx, Gy), the position coordinates of the four vertices of the main display area of the current display window on the virtual paper {(fx 1 ,fy 1 ),(fx 2 ,fy 2 ),(fx 3 ,fy 3 ),(fx 4 ,fy 4 )}.
优选地,所述步骤A2)中,将手写板书写区域设计成深度可以容纳若干物理纸张厚度的凹槽,将物理纸张放入凹槽并用夹子固定,所述凹槽的深度方便卡住物理纸张使物理纸张的四个角与书写区域四个角重合且不影响正常书写。Preferably, in the step A2), the writing area of the handwriting board is designed into a groove with a depth that can accommodate a number of physical paper thicknesses, the physical paper is put into the groove and fixed with a clip, and the depth of the groove is convenient for jamming the physical paper Make the four corners of the physical paper coincide with the four corners of the writing area without affecting normal writing.
本发明与现有技术相比,具有以下优点:实时感知书写过程中笔尖在物理纸张上所处的位置,并将所书写的手写笔迹一致性显示在屏幕上,具有笔尖位置实时跟踪、所显示的笔迹不产生形变、随意调整所显示的笔迹大小的优点,对纸屏同步技术的广泛应用具有重要意义,且为后继由计算机自动计算出书写中存在的问题从而帮助学龄儿童提高练字效率打下基础。Compared with the prior art, the present invention has the following advantages: real-time perception of the position of the pen tip on the physical paper during the writing process, and consistent display of the written handwriting on the screen, with real-time tracking of the position of the pen tip, display of The advantages of free handwriting without deformation and free adjustment of the displayed handwriting size are of great significance to the wide application of paper-screen synchronization technology, and will help school-age children to improve the efficiency of handwriting by automatically calculating the problems in writing by the computer. Base.
附图说明Description of drawings
图1为本发明纸屏同步中手写笔迹一致性显示的方法的流程图;Fig. 1 is the flow chart of the method for consistent display of handwriting in paper-screen synchronization of the present invention;
图2为图1中步骤A)初始化的具体流程图;Fig. 2 is the concrete flow chart of step A) initialization among Fig. 1;
图3为图1中步骤B)手写笔迹同步显示的具体流程图;Fig. 3 is step B in Fig. 1) concrete flow chart of handwriting synchronous display;
图4为图3中步骤B3)每一个采样数据同步显示流程图。FIG. 4 is a flowchart showing the synchronous display of each sampled data in step B3) in FIG. 3 .
具体实施方式Detailed ways
下面结合附图和具体实施例对本发明作进一步的详细说明。The present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.
一种纸屏同步中手写笔迹一致性显示的方法,如图1所示,包括如下步骤:A method for consistent display of handwriting in paper-screen synchronization, as shown in Figure 1, includes the following steps:
A)初始化:A) Initialization:
首先,将物理纸张置于手写板之上,使得物理纸张的四个角与手写板数据采集区域四个角在整个书写过程中保持固定且重合;First, place the physical paper on the tablet, so that the four corners of the physical paper and the four corners of the data collection area of the tablet remain fixed and coincident throughout the writing process;
然后,连接手写板与显示设备,显示设备获取手写板的设备尺寸规格信息,依据设备尺寸规格信息,显示设备创建虚拟纸张,虚拟纸张的长度和宽度大小均保持与书写纸尺寸相同的比例;Then, connect the tablet and the display device, the display device obtains the device size specification information of the tablet, and according to the device size specification information, the display device creates a virtual paper, and the length and width of the virtual paper are kept in the same proportion as the size of the writing paper;
接下来,在虚拟纸张上整齐的布置矩形框作为显示参考信息,记录每个矩形框的中心点在虚拟纸张中的位置信息;矩形的长度和高度值设置依据相关应用中所书写汉字的典型尺寸而定;例如在学龄儿童练字应用中,典型的汉字尺寸不超过1.5cm×1.5cm,那么将矩形框的长度和宽度均设置为1.5cm;Next, neatly arrange rectangular boxes on the virtual paper as display reference information, and record the position information of the center point of each rectangular box in the virtual paper; the length and height of the rectangle are set according to the typical size of the Chinese characters written in the relevant application. For example, in the application of calligraphy practice for school-age children, the typical size of Chinese characters does not exceed 1.5cm×1.5cm, then the length and width of the rectangular frame are set to 1.5cm;
最后,设置虚拟纸张与物理纸张的比例系数R,根据比例系数R设置虚拟纸张的属性参数,设置显示窗口当前所显示的虚拟纸张矩形区域以及显示窗口的中心点和显示窗口的主显示矩形区域;Finally, set the proportional coefficient R of the virtual paper and the physical paper, set the attribute parameters of the virtual paper according to the proportional coefficient R, set the virtual paper rectangular area currently displayed in the display window, the center point of the display window and the main display rectangular area of the display window;
比例系数R的取值范围为R2≤R≤R1,R1为显示区域的长度和高度与虚拟纸张上布置的矩形框长度和高度的比值的较小者,表示显示区域至少能显示一个笔迹,R2的取值与显示区域至多能同时显示的笔迹个数NR相关,NR=(R1/R2)2;The value range of the scale coefficient R is R2≤R≤R1, R1 is the smaller of the ratio of the length and height of the display area to the length and height of the rectangular frame arranged on the virtual paper, indicating that the display area can display at least one handwriting, R2 The value of is related to the number of handwriting NR that can be displayed simultaneously in the display area at most, NR =(R1/R2) 2 ;
B)手写笔迹同步显示:B) Simultaneous display of handwriting:
当用户在物理纸张上书写的同时,手写板对笔尖运动的轨迹实时采样,并将采样的笔尖位置信息实时传送给显示设备,显示设备首先进行坐标转换,将手写板传过来的物理纸张位置坐标转换成虚拟纸张位置坐标;When the user writes on the physical paper, the tablet samples the trajectory of the pen tip movement in real time, and transmits the sampled pen tip position information to the display device in real time. Converted to virtual paper position coordinates;
然后,显示设备判断该时刻的虚拟纸张位置坐标是否在显示窗口的主显示区域内,如果在主显示区域内,则在显示窗口绘制出当前时刻笔迹的运动轨迹,否则,依据当前采样点的虚拟纸张位置坐标,在所有规则排列的矩形框中,找出中心点离当前虚拟纸张位置坐标距离最近的矩形框,移动显示窗口,使得显示窗口的中心点位置移动到距离最近矩形框中心点位置,再在显示窗口绘制出当前时刻笔迹的运动轨迹,结束对当前采样点虚拟纸张位置坐标的绘制后,读取下一采样时刻的笔尖位置信息,重复上述操作,直到书写过程结束;Then, the display device judges whether the position coordinates of the virtual paper at this moment are in the main display area of the display window, and if it is in the main display area, the movement trajectory of the handwriting at the current moment is drawn in the display window, otherwise, according to the virtual paper at the current sampling point Paper position coordinates, in all the regularly arranged rectangular boxes, find the rectangular box whose center point is closest to the current virtual paper position coordinates, and move the display window so that the center point of the display window moves to the center point of the nearest rectangular box, Then draw the motion trajectory of the handwriting at the current moment in the display window, after finishing the drawing of the position coordinates of the virtual paper at the current sampling point, read the pen tip position information at the next sampling moment, and repeat the above operations until the writing process ends;
显示窗口是指在显示设备上为同步的显示手写笔迹而开辟的一块显示区域;The display window refers to a display area opened up on the display device for synchronously displaying handwriting;
主显示区域是一块中心点与显示窗口中心点重合的矩形显示区域,该矩形显示区域的面积小于显示窗口的面积,设置主显示区域的目的是为了始终不将笔尖置于显示窗口的边缘;The main display area is a rectangular display area whose center point coincides with the center point of the display window. The area of the rectangular display area is smaller than that of the display window. The purpose of setting the main display area is to never place the pen tip on the edge of the display window;
一致性显示是指显示设备实时跟踪书写过程中笔尖在物理纸张上所处的位置,并将笔尖在物理纸张上当前所处的一块区域置于显示窗口的中心区域,所显示的笔迹大小能自适应显示区域的大小,所绘制在虚拟纸张上的手写笔迹的位置和长宽比例与物理纸张上手写笔迹的位置和长宽比例相一致。Consistent display means that the display device tracks the position of the pen tip on the physical paper in real time during the writing process, and places the area where the pen tip is currently located on the physical paper in the center of the display window. The size of the displayed handwriting can be adjusted automatically. Adapting to the size of the display area, the position and aspect ratio of the handwritten handwriting drawn on the virtual paper are consistent with the position and aspect ratio of the handwritten handwriting on the physical paper.
其中如图2所示,步骤A)初始化,包括如下步骤:Wherein as shown in Figure 2, step A) initialization, including the following steps:
A1)开始:纸屏同步中手写笔迹一致性显示方法的初始化步骤开始;A1) Start: the initialization step of the handwriting consistency display method in the paper-screen synchronization starts;
A2)将物理纸张置于手写板之上,使得物理纸张的四个角与手写板数据采集区域四个角在整个书写过程中保持固定且重合,物理纸张包括没有格子的白纸,只有水平或垂直方向的参考线的信纸,还包括用于写字练习的田字格或米字格练字纸;A2) Place the physical paper on the tablet, so that the four corners of the physical paper and the four corners of the data collection area of the tablet remain fixed and coincident throughout the writing process. The physical paper includes white paper without grids, only horizontal or Stationery with vertical reference lines, including field or rice-shaped practice paper for writing practice;
A3)连接手写板与显示设备,显示设备获取手写板的设备尺寸规格信息,依据设备尺寸规格信息,显示设备创建虚拟纸张,为了在显示设备上使得显示出来的笔迹不产生形变,虚拟纸张的长度和宽度大小均保持与书写纸尺寸一致的比例;A3) Connect the tablet and the display device, the display device obtains the device size specification information of the tablet, and according to the device size specification information, the display device creates a virtual paper. In order to prevent the displayed handwriting from being deformed on the display device, the length of the virtual paper and width are kept in the same proportion as the size of writing paper;
显示设备是指具有显示功能的设备,包括智能手机、平板电脑、笔记本电脑、台式电脑;Display devices refer to devices with display functions, including smartphones, tablet computers, notebook computers, and desktop computers;
虚拟纸张是指在计算机中虚拟生成的,可以用软件画图工具在虚拟纸张上绘制图案,并可以在显示设备上呈现所绘制内容的虚拟资源;虚拟纸张的属性包括宽度和高度;Virtual paper refers to a virtual resource that is virtually generated in a computer, and can be used to draw patterns on virtual paper with software drawing tools, and can present the drawn content on a display device; the properties of virtual paper include width and height;
设物理纸张的宽度和高度分别为L1和H1,设虚拟纸张的宽度和高度分别为L2和H2,若H1=H2×r1,L1=L2×r2,且r1=r2,则称物理纸张和虚拟纸张的长宽比例是一致的;其中r1,r2为缩放比例系数,0<r1,r2<+∞;Let the width and height of the physical paper be L1 and H1 respectively, and let the width and height of the virtual paper be L2 and H2 respectively, if H1=H2×r1, L1=L2×r2, and r1=r2, then the physical paper and the virtual paper are called The aspect ratio of the paper is the same; r1, r2 are scaling coefficients, 0<r1, r2<+∞;
物理纸张的长度和宽度与手写板书写区域的尺寸相关;The length and width of the physical paper are related to the size of the writing area of the tablet;
A4)在虚拟纸张上整齐的布置矩形框作为显示参考信息,记录每个矩形框的中心点在虚拟纸张中的位置信息;A4) neatly arrange rectangular frames on the virtual paper as display reference information, and record the position information of the center point of each rectangular frame in the virtual paper;
在虚拟纸张上整齐的布置矩形框是指在虚拟纸张上按从上到下,从左到右的顺序布置矩形框,任意两个被布置的矩形框重合部分的面积小于等于零,每行和每列矩形框之间设置一定的距离,在虚拟纸张的上、下、左、右部留出一定的空白区域,矩形框之间留出的距离大小、上、下、左、右部空白区域的大小、矩形框长度和宽度的大小根据具体应用的要求而定;例如在预知书写汉字较小的应用中,矩形框可设置得较小些;特别地,在物理纸张上已预先印刷有田字格、米字格的应用场景中,虚拟纸张上布置的矩形框大小、排列位置、边缘及矩形框行、列间留白等与物理纸张上印刷的田字格或米字格框大小、排列位置、边缘及矩形框行、列间留白保持一致;在物理纸张上已预先印刷有水平或垂直方向参考线的应用场景中,虚拟纸张上布置的矩形框高度不超过两条水平参考线的距离,并使矩形框的底边与水平参考线重合,虚拟纸张上布置的矩形框宽度不超过两条垂直参考线的距离,并使矩形框的左边与垂直参考线重合,在虚拟纸张的上、下、左、右部留出的空白区域大小与物理纸张上印刷的对应留白区域大小保持一致;Neatly arranging rectangular boxes on the virtual paper refers to arranging rectangular boxes on the virtual paper in the order from top to bottom and from left to right, and the overlapping area of any two arranged rectangular boxes is less than or equal to zero. Set a certain distance between the rectangular boxes, and leave a certain blank area on the upper, lower, left, and right parts of the virtual paper. The size, length and width of the rectangular frame are determined according to the requirements of the specific application; for example, in the application where the writing of Chinese characters is predicted to be smaller, the rectangular frame can be set smaller; in particular, the physical paper has pre-printed Tianzi grid , In the application scenario of the rice-character grid, the size, arrangement position, edge and rectangular frame row, space between columns, etc. of the rectangular frame arranged on the virtual paper are different from the size and arrangement position of the field-shaped or rice-character grid printed on the physical paper. , the margins and the white space between the rows and columns of the rectangular frame should be consistent; in the application scenario where the horizontal or vertical reference lines are pre-printed on the physical paper, the height of the rectangular frame arranged on the virtual paper should not exceed the distance between the two horizontal reference lines , and make the bottom edge of the rectangular box coincide with the horizontal reference line, the width of the rectangular box arranged on the virtual paper does not exceed the distance between the two vertical reference lines, and make the left side of the rectangular box coincide with the vertical reference line. The size of the blank area left in the lower, left and right parts is consistent with the size of the corresponding blank area printed on the physical paper;
所述虚拟纸张的属性参数包括虚拟纸张的宽度L2,L2=L1×R;高度H2,H2=H1×R;其中L1和H1分别表示物理纸张的宽度和高度;整齐布置的第i个矩形框的中心点位置信息其中,表示R=1时,第i个矩形框的中心点在虚拟纸张中所处的位置;比例系数R的取值应能保证在相关的应用场景中至少一个汉字笔迹能被完整显示在显示窗口中;The attribute parameters of the virtual paper include the width L2 of the virtual paper, L2=L1×R; the height H2, H2=H1×R; wherein L1 and H1 represent the width and height of the physical paper respectively; the i-th rectangular frame arranged neatly The center point position information of in, Indicates the position of the center point of the i-th rectangular frame in the virtual paper when R=1; the value of the proportional coefficient R should ensure that at least one Chinese handwriting can be completely displayed in the display window in relevant application scenarios ;
经过此步骤后,得到(L1,H1,L2,H2,R,E1,E2,...,Ei,...,En)其中L1和H1表示物理纸张的宽度和高度,L2和H2表示虚拟纸张的宽度和高度,R表示比例系数,L2=L1×R,H2=H1×R,表示第i个矩形框的中心点位置信息,1≤i≤n,n表示虚拟纸张上布置的矩形框个数,其中表示R=1时,第i个矩形框的中心点在虚拟纸张中所处的位置;After this step, we get (L1, H1 ,L2,H2,R,E1, E2 ,...,Ei,..., En ) where L1 and H1 represent the width and height of the physical paper, L2 and H2 represents the width and height of the virtual paper, R represents the scale factor, L2=L1×R, H2=H1×R, Indicates the position information of the center point of the i-th rectangular frame, 1≤i≤n, n denotes the number of rectangular frames arranged on the virtual paper, in Indicates the position of the center point of the i-th rectangular frame in the virtual paper when R=1;
A5)设置虚拟纸张与物理纸张的比例系数R,根据比例系数R设置虚拟纸张的属性参数;设置显示窗口当前所显示的虚拟纸张矩形区域以及显示窗口的中心点和显示窗口的主显示矩形区域;A5) set the proportional coefficient R of virtual paper and physical paper, set the attribute parameter of virtual paper according to proportional coefficient R; Set the virtual paper rectangular area currently displayed in the display window and the center point of the display window and the main display rectangular area of the display window;
比例系数R的取值范围为R2≤R≤R1,R1为显示区域的长度和高度与虚拟纸张上布置的矩形框长度和高度的比值的较小者,表示显示区域至少能显示一个笔迹,R2的取值与显示区域至多能同时显示的笔迹个数NR相关,NR=(R1/R2)2;The value range of the scale coefficient R is R2≤R≤R1, R1 is the smaller of the ratio of the length and height of the display area to the length and height of the rectangular frame arranged on the virtual paper, indicating that the display area can display at least one handwriting, R2 The value of is related to the number of handwriting NR that can be displayed simultaneously in the display area at most, NR =(R1/R2) 2 ;
所述设置显示窗口当前所显示的虚拟纸张矩形区域以及显示窗口的中心点和显示窗口的主显示矩形区域是指,在初始状态下,任选一个矩形框,将显示窗口的中心点置于该矩形框的中心点上, 表示第k个矩形框等比例缩放后的中心点,1≤k≤n;显示窗口的四个顶点由下式求得:The setting of the virtual paper rectangular area currently displayed in the display window, the center point of the display window, and the main display rectangle area of the display window refers to, in the initial state, selecting a rectangular frame, and placing the center point of the display window on the display window. On the center point of the rectangular box, Represents the center point of the k-th rectangular box after proportional scaling, 1≤k≤n; the four vertices of the display window are obtained by the following formula:
显示窗口的主显示矩形区域四个顶点由下式求得:The four vertices of the main display rectangular area of the display window are obtained by the following equations:
其中n表示虚拟纸张上布置的矩形框个数,Width和Height分别表示显示窗口的宽度和高度;0<w<1为比例系数,用于调节主显示区域大小占比显示窗口的比例;Among them, n represents the number of rectangular boxes arranged on the virtual paper, Width and Height represent the width and height of the display window respectively; 0<w<1 is the scale factor, which is used to adjust the proportion of the main display area to the display window;
A6)结束:经过初始化步骤,为在显示设备上一致性显示同步书写在物理纸张上的手写笔迹做好准备。A6) End: After the initialization step, preparations are made for the consistent display of the handwritten handwriting written on the physical paper synchronously on the display device.
如图3所示,步骤B)手写笔迹同步显示,包括如下步骤:As shown in Figure 3, step B) synchronous display of handwriting, including the following steps:
B1)开始:纸屏同步中手写笔迹一致性显示方法一致性显示步骤的开始;B1) Start: the start of the consistent display step of the handwriting consistency display method in the paper-screen synchronization;
B2)显示设备接收来自书写过程中手写板采集的一个时序位置数据,手写板采集在书写过程中笔尖在物理纸张区域上所处于的时序位置数据si=(xi,yi);B2) the display device receives a time-series position data collected from the handwriting board during the writing process, and the handwriting board collects the time-series position data s i =( xi , y i ) where the pen tip is located on the physical paper area during the writing process;
B3)显示设备同步一致性显示该时刻时序位置数据:以当前时刻笔尖在物理纸张区域上所处于的时序位置数据si=(xi,yi),当前显示窗口的四个顶点在虚拟纸张的位置坐标{(dx1,dy1),(dx2,dy2),(dx3,dy3),(dx4,dy4)},当前显示窗口的中心点在虚拟纸张的位置坐标(Gx,Gy),当前显示窗口的主显示区域四个顶点在虚拟纸张的位置坐标作为参数,调用同步一致性显示子方法,得到该时刻笔尖在虚拟纸张上的时序位置数据为Ai=(ui,vi);更新后的当前显示窗口的四个顶点在虚拟纸张的位置坐标{(dx1,dy1),(dx2,dy2),(dx3,dy3),(dx4,dy4)},更新后的当前显示窗口的中心点在虚拟纸张的位置坐标(Gx,Gy),更新后的当前显示窗口的主显示区域四个顶点在虚拟纸张的位置坐标{(fx1,fy1),(fx2,fy2),(fx3,fy3),(fx4,fy4)};B3) Display device synchronously and consistently display the time-series position data at this moment: with the time-series position data s i =(x i , y i ) where the pen tip is on the physical paper area at the current moment, the four vertices of the current display window are on the virtual paper The position coordinates of {(dx 1 ,dy 1 ),(dx 2 ,dy 2 ),(dx 3 ,dy 3 ),(dx 4 ,dy 4 )}, the position coordinates of the center point of the current display window on the virtual paper ( Gx, Gy), the position coordinates of the four vertices of the main display area of the current display window on the virtual paper As a parameter, call the synchronization consistency display sub-method, and obtain the time series position data of the pen tip on the virtual paper at this moment as A i =( u i ,vi ); the updated position of the four vertices of the current display window on the virtual paper Coordinates {(dx 1 ,dy 1 ),(dx 2 ,dy 2 ),(dx 3 ,dy 3 ),(dx 4 ,dy 4 )}, the updated position coordinates of the center point of the current display window on the virtual paper (Gx, Gy), the updated position coordinates of the four vertices of the main display area of the current display window on the virtual paper {(fx 1 ,fy 1 ),(fx 2 ,fy 2 ),(fx 3 ,fy 3 ), (fx 4 ,fy 4 )};
B4)判断手写过程是否结束:判断手写板传送到显示设备的笔尖实时位置数据是否结束,若已结束,则跳转至步骤B5),同步显示过程结束;否则,跳转至步骤B2),继续对下一个笔尖位置数据进行同步显示;B4) Judging whether the handwriting process is finished: Judging whether the real-time position data of the pen tip transmitted by the handwriting board to the display device is finished, if it has ended, then jump to step B5), and the synchronous display process ends; otherwise, jump to step B2), continue Simultaneously display the next pen tip position data;
B5)结束:纸屏同步中手写笔迹一致性显示方法一致性显示步骤的结束。B5) End: the end of the consistent display step of the handwriting consistency display method in the paper-screen synchronization.
其中,步骤B3)中显示设备同步一致性显示该时刻时序位置数据,包括如下步骤:Wherein, in step B3), the display device synchronously consistently displays the time sequence position data at this moment, including the following steps:
B31)开始:假设该时刻显示设备接收到的笔尖时序位置数据为si=(xi,yi),当前显示窗口的四个顶点在虚拟纸张的位置坐标当前显示窗口的中心点在虚拟纸张的位置坐标(Gx,Gy),当前显示窗口的主显示区域四个顶点在虚拟纸张的位置坐标{(fx1,fy1),(fx2,fy2),(fx3,fy3),(fx4,fy4)};B31) Start: Assuming that the time series position data of the pen tip received by the display device at this moment is s i =(x i , y i ), the position coordinates of the four vertices of the current display window on the virtual paper The position coordinates (Gx, Gy) of the center point of the current display window on the virtual paper, the position coordinates of the four vertices of the main display area of the current display window on the virtual paper {(fx 1 ,fy 1 ),(fx 2 ,fy 2 ) ,(fx 3 ,fy 3 ),(fx 4 ,fy 4 )};
B32)将手写板传来的该采样时刻笔尖所处的手写板位置坐标转化为显示设备中虚拟纸张的位置坐标:ui=xi×R,vi=yi×R,得到笔尖在虚拟纸张坐标Ai=(ui,vi),其中R是在系统初始化阶段设置的虚拟纸张与物理纸张的比例系数;B32) Convert the position coordinates of the pen tip at the sampling moment sent from the tablet into the position coordinates of the virtual paper in the display device: u i =x i ×R, v i =y i ×R, get the pen tip in the virtual Paper coordinates A i =( u i ,vi ), where R is the scaling factor between virtual paper and physical paper set in the system initialization stage;
B33)判断虚拟坐标是否处于显示窗口的主显示区域内:判断Ai=(ui,vi)是否在定义的矩形区域内;若是,则跳转至步骤B36);否则,跳转至步骤B34);B33) Determine whether the virtual coordinates are in the main display area of the display window: determine whether A i =( u i ,vi ) is in the main display area of the display window In the defined rectangular area; if so, jump to step B36); otherwise, jump to step B34);
B34)依据虚拟坐标Ai=(ui,vi),在所有规则排列的矩形框中,找出虚拟坐标Ai=(ui,vi)与矩形框中心点距离最近的矩形框:在所有1≤i≤n中,计算Ai=(ui,vi)与所有矩形框中心点的距离,1≤i≤n,设表示与Ai=(ui,vi)距离最近的中心点,1≤k≤n;B34) According to the virtual coordinates A i =(u i ,v i ), in all the regularly arranged rectangular frames, find out the rectangle frame with the virtual coordinates A i =(u i ,vi ) and the center point of the rectangular frame closest to the center point: In all In 1≤i≤n, calculate A i =( u i ,vi ) and the center points of all rectangles distance, 1≤i≤n, set represents the closest center point to A i =(u i ,vi ) , 1≤k≤n;
B35)移动显示窗口,使得显示窗口的中心点位置与距离最近矩形框中心点位置对齐:将显示窗口的中心点移动到第k个矩形框的中心点位置并更新当前显示窗口的四个顶点在虚拟纸张的位置坐标当前显示窗口的中心点在虚拟纸张的位置坐标(Gx,Gy),当前显示窗口的主显示区域四个顶点在虚拟纸张的位置坐标{(fx1,fy1),(fx2,fy2),(fx3,fy3),(fx4,fy4)};B35) Move the display window so that the center point of the display window is aligned with the center point of the nearest rectangle: move the center point of the display window to the center point of the kth rectangle And update the position coordinates of the four vertices of the current display window on the virtual paper The position coordinates (Gx, Gy) of the center point of the current display window on the virtual paper, the position coordinates of the four vertices of the main display area of the current display window on the virtual paper {(fx 1 ,fy 1 ),(fx 2 ,fy 2 ) ,(fx 3 ,fy 3 ),(fx 4 ,fy 4 )};
具体地,将以第k个矩形框的中心点作为显示窗口的中心点,表示第k个矩形框等比例缩放后的中心点;显示窗口的四个顶点由下式更新:Specifically, the center point of the kth rectangular frame is used as the center point of the display window, Represents the center point of the k-th rectangular box after the proportional scaling; the four vertices of the display window are updated by the following formulas:
显示窗口的主显示矩形区域四个顶点由下式更新:The four vertices of the main display rectangular area of the display window are updated by:
其中Width和Height分别表示显示窗口的宽度和高度;0<w<1为比例系数,用于调节主显示区域大小占比显示窗口的比例;Among them, Width and Height represent the width and height of the display window respectively; 0<w<1 is the proportional coefficient, which is used to adjust the proportion of the size of the main display area to the display window;
B36)在显示窗口的主显示区域将该时刻笔尖所处的虚拟纸张位置显示出来:调用绘图方法,将从上一个采样时刻到当前采样时刻,笔尖在虚拟纸张上的运动轨迹绘制并显示出来;B36) in the main display area of the display window, the virtual paper position of the pen tip at this moment is displayed: call the drawing method, from the last sampling moment to the current sampling moment, the motion track of the pen tip on the virtual paper is drawn and displayed;
B37)结束:表示显示设备同步一致性显示该采样时刻笔尖时序位置数据步骤的结束;返回该时刻笔尖在虚拟纸张上的时序位置数据为Ai=(ui,vi);当前显示窗口的四个顶点在虚拟纸张的位置坐标当前显示窗口的中心点在虚拟纸张的位置坐标(Gx,Gy),当前显示窗口的主显示区域四个顶点在虚拟纸张的位置坐标{(fx1,fy1),(fx2,fy2),(fx3,fy3),(fx4,fy4)}。B37) End: indicate the end of the step of displaying the time-series position data of the pen tip at the sampling moment synchronously and consistently; return the time-series position data of the pen tip on the virtual paper at this moment as A i =( u i ,vi ); The position coordinates of the four vertices on the virtual paper The position coordinates (Gx, Gy) of the center point of the current display window on the virtual paper, the position coordinates of the four vertices of the main display area of the current display window on the virtual paper {(fx 1 ,fy 1 ),(fx 2 ,fy 2 ) ,(fx 3 ,fy 3 ),(fx 4 ,fy 4 )}.
另外,在初始化的步骤A2)中,将手写板书写区域设计成深度可以容纳若干物理纸张厚度的凹槽,将物理纸张放入凹槽并用夹子固定,凹槽的深度方便卡住物理纸张使物理纸张的四个角与书写区域四个角重合且不影响正常书写。In addition, in the initialization step A2), the writing area of the handwriting board is designed to be a groove with a depth that can accommodate a number of physical paper thicknesses, the physical paper is put into the groove and fixed with a clip, and the depth of the groove is convenient for jamming the physical paper. The four corners of the paper coincide with the four corners of the writing area and do not affect normal writing.
本发明纸屏同步中手写笔迹一致性显示的方法,实时感知书写过程中笔尖在物理纸张上所处的位置,并将所书写的手写笔迹一致性显示在屏幕上,具有笔尖位置实时跟踪、所显示的笔迹不产生形变、随意调整所显示的笔迹大小的优点,对纸屏同步技术的广泛应用具有重要意义,且为后继由计算机自动计算出书写中存在的问题从而帮助学龄儿童提高练字效率打下基础。The method for displaying the consistency of handwriting in the synchronization of paper and screen of the present invention can sense the position of the pen tip on the physical paper in real time during the writing process, and display the consistency of the written handwriting on the screen. The displayed handwriting does not deform, and the displayed handwriting size can be adjusted at will. lay the foundation.
Claims (5)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010802004.7A CN112463012B (en) | 2020-08-11 | 2020-08-11 | Method for Consistent Display of Handwriting in Paper and Screen Synchronization |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010802004.7A CN112463012B (en) | 2020-08-11 | 2020-08-11 | Method for Consistent Display of Handwriting in Paper and Screen Synchronization |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112463012A CN112463012A (en) | 2021-03-09 |
CN112463012B true CN112463012B (en) | 2022-07-12 |
Family
ID=74833296
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010802004.7A Active CN112463012B (en) | 2020-08-11 | 2020-08-11 | Method for Consistent Display of Handwriting in Paper and Screen Synchronization |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112463012B (en) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115145460A (en) * | 2021-03-31 | 2022-10-04 | 华为技术有限公司 | Method, device and storage medium for remote writing display |
CN113253874B (en) * | 2021-06-01 | 2024-04-30 | 北京有竹居网络技术有限公司 | Control method and device of display device, terminal and storage medium |
CN113934394B (en) * | 2021-10-19 | 2024-05-03 | 河北师达教育科技有限公司 | Method, device and terminal equipment for realizing memory display in display screen |
CN115880974A (en) * | 2021-11-17 | 2023-03-31 | 湖北工业大学 | Physical paper rapid calibration device and calibration method for paper screen synchronization |
CN114296565B (en) * | 2021-11-17 | 2024-05-14 | 湖北工业大学 | Method for correcting position information of synchronous pen point of paper screen |
CN114529915B (en) * | 2022-02-10 | 2023-05-05 | 珠海读书郎软件科技有限公司 | Intelligent correction system, electronic equipment and storage medium |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110928459A (en) * | 2019-10-09 | 2020-03-27 | 广州视源电子科技股份有限公司 | Writing operation method, device, equipment and storage medium of intelligent interactive tablet |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2009080773A (en) * | 2007-09-27 | 2009-04-16 | Fuji Xerox Co Ltd | Handwritten information management device, handwritten information management system, and handwritten information management program |
CN103324917A (en) * | 2013-06-24 | 2013-09-25 | 中国科学技术大学 | Handwriting chirography inputting device including finger information |
CN103729074B (en) * | 2013-12-26 | 2016-08-31 | 三星电子(中国)研发中心 | A kind of identify the device of person's handwriting, system and method |
TW201903568A (en) * | 2017-06-02 | 2019-01-16 | 陳文斌 | System, method for displaying handwriting synchronously, and handwriting device |
CN107240330A (en) * | 2017-06-27 | 2017-10-10 | 北京新国人智慧科技股份有限公司 | System that handwriting display method and system, the intelligence of practising handwriting practise handwriting terminal and intelligence is practised handwriting |
-
2020
- 2020-08-11 CN CN202010802004.7A patent/CN112463012B/en active Active
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110928459A (en) * | 2019-10-09 | 2020-03-27 | 广州视源电子科技股份有限公司 | Writing operation method, device, equipment and storage medium of intelligent interactive tablet |
Also Published As
Publication number | Publication date |
---|---|
CN112463012A (en) | 2021-03-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN112463012B (en) | Method for Consistent Display of Handwriting in Paper and Screen Synchronization | |
US8600164B2 (en) | Method and tool for recognizing a hand-drawn table | |
US7168038B2 (en) | System and method for scaling and repositioning drawings | |
US7770129B2 (en) | Viewable document section | |
US20160070688A1 (en) | Displaying annotations of a document by augmenting the document | |
WO2019140987A1 (en) | Table control method, device, apparatus, and storage medium | |
CN107391016B (en) | Handwriting input handwriting calibration method and system | |
US20160070686A1 (en) | Collecting annotations for a document by augmenting the document | |
US20120047432A1 (en) | Aligning Content in an Electronic Document | |
WO2014183677A1 (en) | Method for acquiring and displaying original handwriting information of handwriting input device | |
KR20180048774A (en) | System and method of digital note taking | |
WO2021218445A1 (en) | Handwriting processing method, handwriting processing apparatus, and storage medium | |
CN101339703A (en) | Character calligraph exercising method based on computer | |
US20160070687A1 (en) | Creating an annotation pane for a document by augmenting the document | |
CN109635687A (en) | The Chinese-character text running hand calculated based on timing point set writes automatic Evaluation of Quality method and system | |
US7911452B2 (en) | Pen input method and device for pen computing system | |
CN103345365B (en) | The display packing of continuous handwriting input and the hand input device of employing the method | |
CN201097312Y (en) | A large-screen interactive electronic white board | |
US7970812B2 (en) | Redistribution of space between text segments | |
CN112181231A (en) | Blackboard writing input method, system and device | |
US7190353B2 (en) | Method to implement an adaptive-area partial ink layer for a pen-based computing device | |
CN112686319B (en) | A method for merging power signal model training files | |
CN104123551B (en) | A kind of information processing method, processor and message input device | |
CN102129789A (en) | Double-screen display electronic schoolbag | |
US12360607B2 (en) | Mid-air-gesture editing method, device, display system and medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |