CN101753473B - Method for real-time transmission of an interactive image and system applying the method - Google Patents
Method for real-time transmission of an interactive image and system applying the method Download PDFInfo
- Publication number
- CN101753473B CN101753473B CN2008101839155A CN200810183915A CN101753473B CN 101753473 B CN101753473 B CN 101753473B CN 2008101839155 A CN2008101839155 A CN 2008101839155A CN 200810183915 A CN200810183915 A CN 200810183915A CN 101753473 B CN101753473 B CN 101753473B
- Authority
- CN
- China
- Prior art keywords
- image
- computer
- information
- trace information
- tracing point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 23
- 230000005540 biological transmission Effects 0.000 title claims description 39
- 238000007906 compression Methods 0.000 claims description 17
- 230000006835 compression Effects 0.000 claims description 17
- 239000000284 extract Substances 0.000 claims description 9
- 230000009467 reduction Effects 0.000 claims description 4
- 238000000605 extraction Methods 0.000 claims description 3
- 238000005070 sampling Methods 0.000 claims description 3
- 238000002407 reforming Methods 0.000 claims 3
- 238000004040 coloring Methods 0.000 claims 1
- 239000003550 marker Substances 0.000 description 16
- 230000008859 change Effects 0.000 description 12
- 238000004891 communication Methods 0.000 description 6
- 230000008521 reorganization Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000002688 persistence Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
Images
Landscapes
- Information Transfer Between Computers (AREA)
- Processing Or Creating Images (AREA)
Abstract
Description
技术领域 technical field
本发明涉及一种即时传输一互动图像的方法及应用该方法的系统,尤其涉及一种在有限频宽下,可降低运算量的即时传输一互动图像的方法及应用该方法的系统。 The invention relates to a method for real-time transmission of an interactive image and a system applying the method, in particular to a method for real-time transmission of an interactive image and a system for applying the method, which can reduce the amount of computation under limited bandwidth. the
背景技术 Background technique
随着网络科技的进步,远距沟通已经不再是问题。然而网络传输的最大问题在于线路架设的频宽,换言之,若想要获得清晰的传输画面与良好的传输品质,就必须要有足够的网络频宽。一般而言,网络频宽的提升费用不菲,因此大多数的网络传输,仍依赖良好的封包与压缩技术。 With the advancement of network technology, long-distance communication is no longer a problem. However, the biggest problem in network transmission is the bandwidth of the line. In other words, if you want to obtain clear transmission images and good transmission quality, you must have sufficient network bandwidth. Generally speaking, increasing network bandwidth is expensive, so most network transmissions still rely on good packet and compression technology. the
照片的即时分享是现在远距沟通的一个好处之一,而且现在市面上存在着各式各样的即时信号传输应用(像是MSN、Yahoo messenger等应用软件),因此分享照片的同时,还可针对所分享的照片,彼此提出讨论。然而,如果通信双方想要在所分享的照片进行细部内容的讨论时,其最重要的关键是要先确认通信双方所要要讨论的细部内容为同一部分。为了达成这一目的,通常会以在分享的照片上即时产生一标记图像或涂鸦的方式,然后再将分享的照片传送给对方后,才开始进行讨论。 The instant sharing of photos is one of the benefits of remote communication now, and there are various instant signal transmission applications (such as MSN, Yahoo messenger, etc.) on the market, so while sharing photos, you can also Suggest discussions with each other about shared photos. However, if the two parties in the communication want to discuss the detailed content of the shared photos, the most important key is to first confirm that the detailed content to be discussed by the two parties in the communication is the same part. In order to achieve this purpose, a marked image or graffiti is usually generated on the shared photo in real time, and then the shared photo is transmitted to the other party before the discussion begins. the
请参考图1,其是表示通信双方正在共同讨论的一图像或照片。如图中所示,该照片包含一主图像11,该主图像包括一雪地里的房屋及一小狗。此时,如果其中一方要针对该照片1中的一特定部分,例如照片右侧的小狗进行讨论时,此时最方便的方式便是利用一涂鸦符号12将照片右侧的小狗标示出来。仅当一方将在分享图片或照片上加上一涂鸦符号或标示图像时,还需将整个修改过的照片传送给对方,才能使对方明白其所标示的部分。但是,修改后的照片与修改前的照片相较,其差别仅在于涂鸦或标示图像的出现,而关于主图像的部分则完全没有改变。因此,仅为了图像或照片上的局部改变就重新传送一次图像不仅浪费频宽,而且也少了交谈时的即时通信的感觉。
Please refer to FIG. 1 , which is an image or photo showing that two parties in communication are discussing together. As shown in the figure, the photo contains a main image 11 including a house in the snow and a puppy. At this time, if one of the parties wants to discuss a specific part of the
发明内容 Contents of the invention
为了克服上述缺失,本发明特提出一种可以在有限的频宽下,能够在分享的图像上即时传输标记符号或涂鸦的系统及方法。 In order to overcome the above shortcomings, the present invention proposes a system and method capable of transmitting marker symbols or graffiti on shared images in real time under limited bandwidth. the
本发明的主要目的是在有限频宽之下,提供一种即时传输图像的方法及应用该方法的计算机系统。 The main purpose of the present invention is to provide a method for real-time image transmission and a computer system using the method under limited bandwidth. the
本发明的另一目的是使得即时传输图像时,提供一种可降低处理器运算量的即时传输图像的方法及应用该方法的计算机系统。本发明的方法是应用在低频宽的网络传输,以使两个计算机之间可即时分享该图像,其中该图像包括一主图像与一标记图像,且标记图像是由两个计算机其中任一所产生。本发明的方法包括以下步骤: Another object of the present invention is to provide a method for real-time image transmission and a computer system using the method, which can reduce the computation load of the processor during real-time image transmission. The method of the present invention is applied to low-bandwidth network transmission, so that the image can be shared between two computers in real time, wherein the image includes a main image and a marked image, and the marked image is created by any one of the two computers produce. Method of the present invention comprises the following steps:
A:由该第一计算机向第二计算机传送该主图像,以使该主图像同时呈现在该第一及第二计算机上;以及 A: transmitting the main image from the first computer to the second computer so that the main image is simultaneously presented on the first and second computers; and
B:由该第一计算机及该第二计算机其中之一在该主图像上绘制该标记图像,并将该标记图像即时传输给对方,其中,在该标记图像的即时传输的步骤,该方法还包括: B: draw the marked image on the main image by one of the first computer and the second computer, and transmit the marked image to the other party in real time, wherein, in the step of real-time transmission of the marked image, the method further include:
B1:以一特定频率提取该标记图像的轨迹信息,其中该标记图像实质是由多个轨迹点所构成; B1: Extract the trajectory information of the marked image at a specific frequency, wherein the marked image is essentially composed of multiple trajectory points;
B2:依据任两个相邻轨迹点之间的一差异程度,删减过于相近的轨迹点,以减少所提取的轨迹信息;以及 B2: According to a degree of difference between any two adjacent trajectory points, delete too close trajectory points to reduce the extracted trajectory information; and
B3:压缩删减后的轨迹信息,并通过该低频宽的网络传输给对方; B3: Compress the deleted trajectory information and transmit it to the other party through the low-bandwidth network;
C:接收该压缩删减后的轨迹信息的一方,还将所接收的轨迹信息解压缩,以在该主图像上还原该标记图像。 C: The party receiving the compressed and pruned track information also decompresses the received track information to restore the marked image on the main image. the
在较佳实施例中,该特定频率为每秒15笔轨迹信息。轨迹信息包括一坐标信息、一轨迹形状信息或一颜色信息。标记图像的轨迹信息为提取自一操作系统,例如微软视窗(Windows)操作系统。更进一步而言,利用计算机指标控制装置(例如鼠标)的操作,可使计算机操作系统检测其移动信息,并借此获得坐标信息。 In a preferred embodiment, the specific frequency is 15 traces per second. The trajectory information includes coordinate information, trajectory shape information or color information. The trajectory information of the marked image is extracted from an operating system, such as Microsoft Windows (Windows) operating system. Furthermore, by using the operation of the computer pointer control device (such as a mouse), the computer operating system can detect its movement information, and thereby obtain coordinate information. the
在一实施例中,差异程度实质是依据任两个相邻的轨迹点的坐标信息,以获得该差异程度,借此删减过于相近的轨迹点,进而减少轨迹信息。在本实施例中,可以依据任两相邻轨迹点的坐标信息,以获得一斜率,借此计算出所有相邻轨迹点的斜率,并依据任两相邻的斜率,以获得该差异程度,删 减过于相近的轨迹点,借此减少轨迹信息。 In one embodiment, the degree of difference is essentially based on the coordinate information of any two adjacent track points to obtain the degree of difference, thereby deleting track points that are too close to reduce track information. In this embodiment, a slope can be obtained based on the coordinate information of any two adjacent track points, thereby calculating the slopes of all adjacent track points, and the degree of difference can be obtained based on the slopes of any two adjacent points, Delete track points that are too close to reduce track information. the
在一较佳实施例中,本发明的步骤B3还可包括步骤B31:重新整理删减后的轨迹信息,以使各轨迹点的坐标信息与特性信息转换成多组分类数据,以进一步压缩删减后的轨迹信息。此外,除了起始点之外,任两相邻轨迹点的坐标信息可转换成变化量,借此还可进一步减少所需存储的信息,因此本发明的步骤B3还可包括步骤B32:以前一轨迹点的轨迹信息与后一轨迹点之间的一轨迹信息变化量存储下一轨迹点的轨迹信息,借此压缩删减后的轨迹信息,以降低所需传输的数据量。 In a preferred embodiment, step B3 of the present invention may also include step B31: rearranging the deleted track information, so that the coordinate information and characteristic information of each track point can be converted into multiple sets of classification data, so as to further compress the deleted track information. The subtracted trajectory information. In addition, in addition to the starting point, the coordinate information of any two adjacent track points can be converted into a change amount, thereby further reducing the information to be stored, so step B3 of the present invention can also include step B32: the previous track A trajectory information change amount between the trajectory information of a point and the next trajectory point stores the trajectory information of the next trajectory point, thereby compressing the truncated trajectory information to reduce the amount of data to be transmitted. the
在另一实施例中,本发明提供一种即时传输一标记图像于一分享图像上的方法,该方法包括以下步骤: In another embodiment, the present invention provides a method for instantly transmitting a tagged image on a shared image, the method comprising the following steps:
A:提供分享图像,使其同时显示在一第一计算机及一第二计算机上; A: Provide shared images to be displayed on a first computer and a second computer at the same time;
B:由第一计算机在分享图像上形成一标记图像,并将该标记图像即时传输给第二计算机,其中,在该标记图像的即时传输步骤,该方法还包括: B: The first computer forms a marked image on the shared image, and transmits the marked image to the second computer in real time, wherein, in the instant transmission step of the marked image, the method also includes:
B1以一频率提取所构成该标记图像的每一轨迹点的轨迹信息; B1 extracts the trajectory information of each trajectory point forming the marked image at a frequency;
B2将所提取的轨迹信息进行数据重整与压缩;以及 B2 performs data reorganization and compression on the extracted trajectory information; and
B3将压缩重整后的轨迹信息即时传输给第二计算机; B3 immediately transmits the compressed and reformed trajectory information to the second computer;
C:该第二计算机将所接收的轨迹信息解压缩,以在该主图像上还原该标记图像。 C: The second computer decompresses the received trajectory information to restore the marked image on the main image. the
此外,本发明还提供一种互动图像的即时传输系统,利用本发明的方法可使两计算机之间即时分享一互动图像。本发明的即时传输系统包括一发送端计算机与一接收端计算机,其中该发送端计算机包括一绘图模块及第一图像处理模块。绘图模块可使一标记图像形成在该主图像上。第一图像处理模块提取及压缩构成标记图像的轨迹信息,以将压缩后的轨迹信息通过该低频宽的网络即时传输给接收端计算机。较佳者,第一图像处理模块是以每秒15笔的频率提取该标记图像的轨迹信息。 In addition, the present invention also provides an interactive image real-time transmission system, which can share an interactive image between two computers in real time by using the method of the present invention. The real-time transmission system of the present invention includes a sending computer and a receiving computer, wherein the sending computer includes a drawing module and a first image processing module. The drawing module can cause a marker image to be formed on the main image. The first image processing module extracts and compresses the trajectory information constituting the marked image, so as to transmit the compressed trajectory information to the receiving computer in real time through the low-bandwidth network. Preferably, the first image processing module extracts the track information of the marked image at a frequency of 15 strokes per second. the
接收端计算机包括第二图像处理模块。第二图像处理模块将所接收的轨迹信息解压缩,以在主图像上还原该标记图像。 The receiver computer includes a second image processing module. The second image processing module decompresses the received trajectory information to restore the marked image on the main image. the
在一较佳实施例中,发送端计算机还包括一计算机指标控制装置,且绘图模块是通过该计算机指标控制装置在主图像上形成标记图像。在本实施例中,轨迹信息包含构成该标记图像的各轨迹点的一坐标信息与一特性信息。坐标信息是计算机指标控制装置在计算机操作系统中被检测到的移动信息,也就是利用计算机指标控制装置(例如鼠标)的操作,可使计算机操作系统检测其移动信息,并借此获得坐标信息。特性信息是指该标记图像的颜色、粗细及形状形式其中之一。 In a preferred embodiment, the sending computer further includes a computer index control device, and the drawing module forms a mark image on the main image through the computer index control device. In this embodiment, the trajectory information includes coordinate information and characteristic information of each trajectory point constituting the marker image. The coordinate information is the movement information detected by the computer pointer control device in the computer operating system, that is, the operation of the computer pointer control device (such as a mouse) can make the computer operating system detect its movement information, and thereby obtain the coordinate information. The characteristic information refers to one of the color, thickness and shape of the marked image. the
在另一较佳实施例中,第一图像处理模块还包括一减少取样(downsampling)模块,用以删减过于相近的轨迹点。换言之,本发明可利用减少取样模块进行如上述减少所提取的轨迹信息的步骤。 In another preferred embodiment, the first image processing module further includes a downsampling module for deleting too close track points. In other words, the present invention may utilize the downsampling module to perform the step of reducing the extracted trajectory information as described above. the
此外,该第一图像处理模块还可进一步包含一数据重整模块,用以将各轨迹点的坐标信息与特性信息转换成多组分类数据,以进一步压缩删减后的轨迹信息。 In addition, the first image processing module may further include a data reorganization module, which is used to convert the coordinate information and characteristic information of each trajectory point into multiple sets of classification data, so as to further compress the deleted trajectory information. the
该第一图像处理模块还包含一压缩模块,用以利用前一轨迹点的轨迹信息及该前一轨迹点与后一轨迹点的轨迹信息间的一轨迹信息变化量存储下一轨迹点的轨迹信息,借此以压缩删减后的轨迹信息,以降低所需传输的数据量。 The first image processing module also includes a compression module for storing the track of the next track point by using the track information of the previous track point and a track information change amount between the track information of the previous track point and the track point of the next track point information, thereby compressing the truncated trajectory information to reduce the amount of data to be transmitted. the
第二图像处理模块还包含一图像合成器(image compositor),借此在接收端计算机中,标记图像即显示于主图像上。因此,在发送端计算机与接收端计算机皆会同时显示具有主图像与标记图像的图像,而达到互动图像的即时传输的效果。 The second image processing module also includes an image compositor, whereby the marked image is displayed on the main image in the receiving computer. Therefore, both the computer at the sending end and the computer at the receiving end will display images with the main image and the marked image at the same time, thereby achieving the effect of real-time transmission of interactive images. the
本发明特可以在有限的频宽下,能够在分享的图像上即时传输标记符号或涂鸦。 The invention can transmit marker symbols or graffiti on shared images in real time under limited bandwidth. the
附图说明 Description of drawings
图1显示要分享的照片及其涂鸦。 Figure 1 shows a photo to share and its doodles. the
图2与图3是根据本发明的一实施例,分别显示本发明的互动图像的即时传输系统图及其方框图。 FIG. 2 and FIG. 3 are a system diagram and a block diagram respectively showing the real-time transmission system of the interactive image according to an embodiment of the present invention. the
图4与图5是根据图3的第一图像处理模块与第二图像处理模块,分别显示其方框图。 FIG. 4 and FIG. 5 are block diagrams of the first image processing module and the second image processing module according to FIG. 3 , respectively. the
图6是根据本发明的一实施例,显示即时传输一互动图像的方法流程图。 FIG. 6 is a flowchart showing a method for real-time transmission of an interactive image according to an embodiment of the present invention. the
图7是显示将各点的坐标与特性转换成多组分类数据。 Fig. 7 shows that the coordinates and characteristics of each point are converted into multiple sets of classification data. the
图8是根据本发明的另一实施例,显示即时传输一互动图像的方法流程图。 FIG. 8 is a flowchart showing a method for real-time transmission of an interactive image according to another embodiment of the present invention.
其中,附图标记说明如下: Among them, the reference signs are explained as follows:
1、互动图像 2、即时传输
1.
11、主图像 12、标记图像
11.
21、22、计算机 25、游标 21. 22. Computer 25. Cursor
211、绘图模块 210、220、处理器
211. Drawing
212、222、图像处理模块 2121、减少模块
212, 222,
2122、数据重整模块 2123、压缩模块 2122. Data reorganization module 2123. Compression module
221、图像合成模块 221. Image synthesis module
具体实施方式 Detailed ways
为让本发明的上述和其他目的、特征和优点能更明显易懂,下文特举出本发明的具体实施例,并结合所附附图,作详细说明如下。 In order to make the above and other objects, features and advantages of the present invention more comprehensible, specific embodiments of the present invention are specifically cited below and described in detail in conjunction with the accompanying drawings. the
本发明提供一种互动图像的即时传输系统,其可通过一低频宽的网络(例如频宽为低于100kbps的网络)即时在两台计算机之间分享一互动图像1(例如图1所示的主图像11与标记图像12)。详言之,请先参考图2与图3,本发明的即时传输系统2包括一发送端计算机21与一接收端计算机22,其中该发送端计算机21与该接收端计算机22正在分享一图像。该发送端计算机21包括一绘图模块211及第一图像处理模块212。绘图模块211可使标记图像形成在所分享的图像的一主图像上(例如图1所示的主图像11与标记图像12,以下将所有提到主图像与标记图像都分别记为标号11与12)。第一图像处理模块212用以提取及压缩构成该标记图像12的轨迹信息,以将压缩后的轨迹信息通过低频宽的网络即时传输给接收端计算机22。较佳者,第一图像处理模块212是以每秒15笔的频率提取该标记图像的轨迹信息。标记图像实质是由多个轨迹点所构成。由于人眼睛会有视觉暂留,因此在每秒约15张图像(15 frames/per second)的更新频率下,此时所即时传输的标记图像的轨迹也会有即时绘制的感觉而不会产生不连续的效果,故在较佳实施例中,为该特定频率是以每秒提取15笔的频率提取该标记图像(轨迹点)的轨迹信息,然而此并非是用以限制本发明。
The present invention provides a real-time transmission system of interactive images, which can instantly share an interactive image 1 (such as shown in FIG. main image 11 and marker image 12). Specifically, please refer to FIG. 2 and FIG. 3 . The
本发明的即时传输系统2中,发送端计算机21实质包含一第一处理器210,用以执行一应用程序,以分别执行该绘图模块211及第一图像处理模 块212的前述绘图及图像处理功能。
In the real-
接收端计算机22也包括第二图像处理模块222,该第二图像处理模块222是将所接收的轨迹信息解压缩,以在主图像11上还原形成该发送端计算机上所传输的标记图像12。接收端计算机22实质上也包含一第二处理器220执行一应用程序,以达成该第二图像处理模块的图像解压缩功能。
The receiving
在一较佳实施例中,发送端计算机21还包括一计算机指标控制装置25(例如鼠标、辨识书写板、辨识书写笔或绘图板等类似的输入装置)。绘图模块211是通过该计算机指标控制装置25在主图像上11形成标记图像12。在本实施例中,轨迹信息包含构成该标记图像12的各轨迹点的一坐标信息与一特性信息。坐标信息是计算机指标控制装置25在计算机操作系统(例如Windows操作系统)中被检测到的移动信息,也就是利用计算机指标控制装置25的操作,可使计算机操作系统检测其移动信息,并借此获得坐标信息。特性信息则是指标记图像25的颜色、粗细及形状形态其中之一。
In a preferred embodiment, the
请参考图4,在另一较佳实施例中,第一图像处理模块212还包括一减少取样(down sampling)模块2121,用以删减过于相近的轨迹点。关于此一功能,以下将在方法流程中进一步说明。
Please refer to FIG. 4 , in another preferred embodiment, the first
此外,该第一图像处理模块212还可进一步包含一数据重整模块2122,用以将各轨迹点的坐标信息与特性信息转换成多组分类数据,以进一步重新排列删减后的轨迹信息。关于此一功能,也将在以下方法流程中进一步说明。
In addition, the first
第一图像处理模块212还包含一压缩模块2123。压缩模块2123利用前一轨迹点的轨迹信息及该前一轨迹点与后一轨迹点的轨迹信息间的一轨迹信息变化量存储下一轨迹点的轨迹信息,借此以压缩删减后的轨迹信息,以降低所需传输的数据量。在此一实施例中,关于此一功能,也将在以下方法流程中进一步说明。
The first
如图5所示,第二图像处理模块222还包含一图像合成器(imagecompositor)2221,借此在接收端计算机22中,将标记图像12合成于以分享的主图像11上。因此,在发送端计算机21与接收端计算机22皆可同时显示有主图像11与标记图像12,而达到互动图像的即时传输的目的。
As shown in FIG. 5 , the second
本发明还公开一种即时传输一互动图像的方法,其应用在一低频宽的网络传输,以使一第一计算机及一第二计算机之间即时分享该互动图像。互动 图像也引用图1的标号,也就是互动图像1包括一主图像11与一标记图像12,且该标记图像12是由该第一或第二计算机其中任一所产生。详言之,本发明的即时传输互动图像的方法可利用上述的系统以达成所有机制,例如为了简化说明,在此实施例是以第一计算机作为上述的发送端计算机21,也就是标记图像12是由第一计算机所产生,而第二计算机可以是上述的接收端计算机22,因此以下虽然是以第一及第二计算机称之,但为了简化说明,仍引用相同的标号21与22。请参考图6,本发明的方法包括以下步骤:
The invention also discloses a method for real-time transmission of an interactive image, which is applied to a low-bandwidth network transmission to enable a first computer and a second computer to share the interactive image in real time. The interactive images also refer to the symbols of FIG. 1, that is, the
步骤S1:由第一计算机21向第二计算机22传送主图像11,以使主图像11同时呈现在第一及第二计算机21、22上。例如,第一与第二计算机21、22的第一与第二图像处理模块212、222即可达成此功能。
Step S1: The
步骤S2:由第一计算机21及第二计算机22其中之一在主图像11上绘制该标记图像12,并将该标记图像12即时传输给对方。在此,为了简化说明,第一计算机21即作为发送端计算机,然此并非用以限制本发明,任一计算机皆可作为发送端计算机。在标记图像12的即时传输的步骤,本发明的方法还包括:
Step S2: Draw the
步骤S21:记录标记图像12的轨迹信息,其中该标记图像12实质是由多个轨迹点所构成。进一步而言,标记图像12实质是由连续的多个轨迹点所构成。此一步骤可能实质是由操作系统自动执行;例如,操作系统自动记录游标位置,借此获得标记图像12的轨迹信息。
Step S21: Record the track information of the
步骤S22:以一特定频率提取所记录的轨迹信息。在较佳实施例中,该特定频率是每秒15笔轨迹信息。如上所述,由于人眼睛会有视觉暂留,在每秒15张图像(15 frames/per second)的提取频率下,此时所即时显示的图像几乎不会有不连续的感觉,故在较佳实施例中,为该特定频率是以每秒提取15笔的频率提取该标记图像(轨迹点)的轨迹信息,然而此并非是用以限制本发明。 Step S22: Extract the recorded track information at a specific frequency. In a preferred embodiment, the specific frequency is 15 traces per second. As mentioned above, due to the persistence of vision of the human eye, at the extraction frequency of 15 images per second (15 frames/per second), the images displayed in real time at this time will hardly feel discontinuous. In a preferred embodiment, the specific frequency is to extract the track information of the marked image (track point) at a frequency of 15 strokes per second, but this is not intended to limit the present invention. the
轨迹信息则包括一坐标信息、一轨迹形状信息或一颜色信息。标记图像12的轨迹信息可提取自一操作系统,例如微软视窗(Windows)操作系统。更进一步而言,利用计算机指标控制装置(例如上述的鼠标25)的操作,可使计算机操作系统检测其移动信息(例如游标位置),并借此获得坐标信息。轨迹形状信息则可包括轨迹的粗细。由于操作系统可提供许多关于计算机指 标控制装置的信息,甚至高达每秒80笔的信息,但是如上所述,人眼睛的适应频率在每秒15张图像已足,因此本发明利用特定频率提取,也就是先将所有的轨迹信息删减到每秒15笔。
The track information includes coordinate information, track shape information or color information. The trajectory information of the
除此之外,各轨迹点的粗细或出现的时间等其他特性信息也可由操作系统中有关计算机指标控制装置25(例如鼠标)的信息所获得。例如,依据时间信息,本发明即可判断是由哪一台计算机先开始涂鸦,依据时间顺序,使得最新画的涂鸦显示在最上层。 In addition, other characteristic information such as the thickness of each track point or the time of appearance can also be obtained from the information about the computer index control device 25 (such as a mouse) in the operating system. For example, according to the time information, the present invention can judge which computer started the graffiti first, and according to the time sequence, the latest graffiti is displayed on the top layer. the
接下来是步骤S23:依据任两个相邻轨迹点之间的一差异程度,删减过于相近的轨迹点,以减少所提取的轨迹信息。例如,如上所述,本发明可利用第一图像处理模块212的减少取样(down sampling)模块2121,用以删减过于相近的轨迹点。
Next is step S23: according to a degree of difference between any two adjacent track points, delete track points that are too close to reduce the extracted track information. For example, as mentioned above, the present invention can utilize the
在一实施例中,差异程度实质是依据任两个相邻的轨迹点的坐标信息,以获得该差异程度,借此删减过于相近的轨迹点,进而减少轨迹信息。在本实施例中,由于各形成标记图像12的各轨迹点的坐标信息可由操作系统中获知,因此可以依据任两相邻轨迹点的坐标信息,以获得一斜率,借此计算出所有相邻轨迹点的斜率,并依据任两相邻的斜率,以获得该差异程度,删减过于相近的轨迹点,借此减少轨迹信息。
In one embodiment, the degree of difference is essentially based on the coordinate information of any two adjacent track points to obtain the degree of difference, thereby deleting track points that are too close to reduce track information. In this embodiment, since the coordinate information of each track point forming the
再来是步骤S24:压缩删减后的轨迹信息,并通过该低频宽的网络传输给对方。 Then there is step S24: compressing the truncated track information, and transmitting it to the other party through the low-bandwidth network. the
请参考图6,在一较佳实施例中,为了能有更佳的传输效能,本发明的步骤S24还可包括步骤S241:重新整理删减后的轨迹信息,以使各轨迹点的坐标信息与特性信息转换成多组分类数据,以进一步重新排列删减后的轨迹信息。例如,如上所述本发明可利用第一图像处理模块212的数据重整模块2122,用以将各轨迹点的坐标信息与特性信息转换成多组分类数据,以进一步重新排列删减后的轨迹信息。
Please refer to FIG. 6. In a preferred embodiment, in order to have better transmission efficiency, step S24 of the present invention may also include step S241: reorganize the deleted track information, so that the coordinate information of each track point and feature information into multiple sets of categorical data to further rearrange the pruned trajectory information. For example, as mentioned above, the present invention can use the
为了要详细说明步骤S241,请先参考图7的例子。形成标记图像12的各轨迹点的坐标信息可被定义为X,Y,特性信息可定义为Z。如步骤S71所示,第1轨迹点即标示为(X1,Y1,Z1)。若直接传送该信息,则可能需要传送非常多轨迹点的所有轨迹信息。然而,如步骤S72所示,若是将各轨迹点分类,也就是X分为一类、Y为一类以及Z为一类,则传输轨迹数据时,则 仅需传输三类的轨迹信息,故可降低传输数据量。
To describe step S241 in detail, please refer to the example in FIG. 7 . The coordinate information of each trajectory point forming the
此外,除了轨迹起始点之外,任两相邻轨迹点的坐标信息可转换成变化量,借此还可进一步减少所需存储的信息,因此本发明的步骤S24(如图6所示)进一步包括步骤S242的数据压缩步骤,亦即以前一轨迹点的轨迹信息与后一轨迹点之间的一轨迹信息变化量来存储下一轨迹点的轨迹信息,借此压缩删减后的轨迹信息,以降低所需传输的数据量。例如,第一图像处理模块212还包含一压缩模块2123。压缩模块2123利用前一轨迹点的轨迹信息及该前一轨迹点与后一轨迹点的轨迹信息间的一轨迹信息变化量存储下一轨迹点的轨迹信息,借此以压缩删减后的轨迹信息,以降低所需传输的数据量。
In addition, in addition to the starting point of the track, the coordinate information of any two adjacent track points can be converted into a variation, thereby further reducing the information to be stored, so step S24 (as shown in Figure 6) of the present invention further Including the data compression step of step S242, that is, storing the track information of the next track point by a change amount of track information between the track information of the previous track point and the next track point, thereby compressing the deleted track information, To reduce the amount of data that needs to be transferred. For example, the first
详言之,形成标记图像12的连续多个轨迹点当中的第2轨迹点位置坐标实际上是由第1轨迹点的位置坐标再加上其变化量(从第1点到第2点的变化量),第3轨迹点实际上是由第2轨迹点的位置坐标再加上其变化量(从第2轨迹点到第3轨迹点的变化量)……一直到最后一轨迹点。如此一来,很明显从第2轨迹点之后的坐标信息仅须存储第1点的坐标位置及其后续各点的变化量。因此,可更进一步减少所需传输的数据量。如图7的步骤S73所示,分类之后的轨迹信息仅剩下三类的信息,且各类信息除了起始点之外,仅需记载变化量R、R’。
In detail, the position coordinates of the second track point among the multiple continuous track points forming the
请参考图8,在另一实施例中,本发明提供一种即时传输一标记图像于一分享图像上的方法,该方法包括以下步骤: Please refer to FIG. 8. In another embodiment, the present invention provides a method for instantly transmitting a tagged image on a shared image. The method includes the following steps:
步骤S81:提供分享图像,使其同时显示在一第一计算机及一第二计算机上。 Step S81: Provide shared images to be displayed on a first computer and a second computer at the same time. the
步骤S82:由第一计算机在分享图像上形成一标记图像,并将该标记图像即时传输给第二计算机,其中,在该标记图像的即时传输步骤还包括步骤。 Step S82: forming a marked image on the shared image by the first computer, and transmitting the marked image to the second computer in real time, wherein the step of instantly transmitting the marked image further includes a step. the
步骤S821:以一频率提取所构成该标记图像的每一轨迹点的轨迹信息。 Step S821 : Extract the trajectory information of each trajectory point of the marker image at a frequency. the
步骤S822:将所提取的轨迹信息进行数据重整与压缩。 Step S822: Perform data reorganization and compression on the extracted trajectory information. the
步骤S823:将压缩重整后的轨迹信息即时传输给第二计算机。 Step S823: Immediately transmit the compressed and reformed trajectory information to the second computer. the
应当了解,本发明的第一计算机、第二计算机或发送端计算机与接收端计算机,并不限于是何种型态的计算机,虽然图示为一般传统台式计算机,但实际上本发明当可应用在各种计算机例如笔记本计算机、平板计算机、或 掌上型计算机。 It should be understood that the first computer, the second computer or the sending end computer and the receiving end computer of the present invention are not limited to any type of computer, although the illustration is a general traditional desktop computer, but in fact the present invention should be applicable On various computers such as notebook computers, tablet computers, or palmtop computers. the
综上所述,本发明无论就目的、手段及功效,均显示其不同于公知技术的特征。应注意的是,虽然本发明已以较佳实施例公开如上,然其并非用以限定本发明,任何本领域普通技术人员,在不脱离本发明的精神和范围内,当可作些许的更动与润饰,因此本发明的保护范围当以随附的权利要求界定的保护范围为准。 To sum up, the present invention shows its characteristics different from the known technologies in terms of purpose, means and effect. It should be noted that although the present invention has been disclosed above with preferred embodiments, it is not intended to limit the present invention. Any person skilled in the art may make some changes without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention shall be determined by the protection scope defined by the appended claims.
Claims (19)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2008101839155A CN101753473B (en) | 2008-12-09 | 2008-12-09 | Method for real-time transmission of an interactive image and system applying the method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2008101839155A CN101753473B (en) | 2008-12-09 | 2008-12-09 | Method for real-time transmission of an interactive image and system applying the method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN101753473A CN101753473A (en) | 2010-06-23 |
CN101753473B true CN101753473B (en) | 2012-08-08 |
Family
ID=42479898
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN2008101839155A Expired - Fee Related CN101753473B (en) | 2008-12-09 | 2008-12-09 | Method for real-time transmission of an interactive image and system applying the method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN101753473B (en) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103208127B (en) * | 2012-01-16 | 2016-04-13 | 深圳市腾讯计算机系统有限公司 | A kind of pictorial information disposal system and method |
CN104731829B (en) * | 2013-12-24 | 2019-06-21 | 腾讯科技(深圳)有限公司 | A kind of interactive approach and device of network picture |
CN103941982B (en) * | 2014-05-12 | 2016-08-24 | 腾讯科技(深圳)有限公司 | A kind of method sharing interface processing and terminal |
CN104601446A (en) * | 2014-12-30 | 2015-05-06 | 上海孩子国科教设备有限公司 | Information reminding method and system for interactive communication |
CN105447124B (en) * | 2015-11-17 | 2019-07-19 | 广州酷狗计算机科技有限公司 | Virtual objects sharing method and device |
CN106899890A (en) * | 2016-12-31 | 2017-06-27 | 天脉聚源(北京)科技有限公司 | The interactive method and apparatus of scribble |
CN109710165A (en) * | 2018-12-25 | 2019-05-03 | 维沃移动通信有限公司 | A drawing processing method and mobile terminal |
CN110109594B (en) * | 2019-04-30 | 2021-12-24 | 北京大米科技有限公司 | Drawing data sharing method and device, storage medium and equipment |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0921675A3 (en) * | 1997-12-03 | 2001-04-18 | Kabushiki Kaisha Toshiba | Method of processing image information and method of preventing forgery of certificates or the like |
CN1443339A (en) * | 2000-07-19 | 2003-09-17 | 雅各布·威特曼 | Method and device for mobile capture, processing, storage and transmission of mixed information including text and images |
CN1848934A (en) * | 2005-04-14 | 2006-10-18 | 索尼株式会社 | Image processing system, image pickup apparatus, image pickup method, image reproducing apparatus, and image reproducing method |
-
2008
- 2008-12-09 CN CN2008101839155A patent/CN101753473B/en not_active Expired - Fee Related
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0921675A3 (en) * | 1997-12-03 | 2001-04-18 | Kabushiki Kaisha Toshiba | Method of processing image information and method of preventing forgery of certificates or the like |
CN1443339A (en) * | 2000-07-19 | 2003-09-17 | 雅各布·威特曼 | Method and device for mobile capture, processing, storage and transmission of mixed information including text and images |
CN1848934A (en) * | 2005-04-14 | 2006-10-18 | 索尼株式会社 | Image processing system, image pickup apparatus, image pickup method, image reproducing apparatus, and image reproducing method |
Also Published As
Publication number | Publication date |
---|---|
CN101753473A (en) | 2010-06-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN101753473B (en) | Method for real-time transmission of an interactive image and system applying the method | |
CN102761495B (en) | A kind of instant communicating method based on original handwriting, communication terminal and system | |
KR101167765B1 (en) | Apparatus and method for playing handwriting message using handwriting data | |
CN102830977A (en) | Method, client and system for adding insert type data in recording process during instant messaging | |
US6792143B1 (en) | Recognition of handwriting in mobile station | |
CN111736731A (en) | Handwriting obtaining method and system | |
TW202114398A (en) | Image transmission device, image display system with remote screen capture function, and remote screen capture method | |
WO2017010469A1 (en) | Handwriting device and voice/handwriting communication system | |
CN105069104A (en) | Dynamic cartoon generation method and system | |
JP2016224766A (en) | Remote screen display system, remote screen display method, and remote screen display program | |
CN104217007A (en) | Cartographic information transmission and interaction system and method based on individualized mark | |
KR20110040071A (en) | Apparatus and method for transmitting a handwritten message including time information | |
CN102833188A (en) | Method, client and system for displaying transmission file in instant messaging | |
US20150189120A1 (en) | Method of Combining Image Files and Other Files | |
CN101071353A (en) | Hand-write input processing device | |
CN103020053A (en) | Page sharing system and method | |
CN101877839A (en) | A Personalized Short Message Transmission Method | |
CN109036482A (en) | A kind of intelligent recording pen collecting OCR and speech recognition | |
CN105119954B (en) | File transfer method, device and system | |
CN106888269A (en) | A kind of meeting summary method for tracing based on electronic whiteboard | |
CN105808188A (en) | Method for transmitting online sketch between screens | |
CN113382086B (en) | Document transmission method and device, electronic equipment and computer program product | |
CN104753759A (en) | Method and device for displaying contact person information in instant messaging (IM) system | |
CN206585648U (en) | Electronic device and electronic system capable of generating augmented reality images | |
JP3115034U (en) | Real-time transmission / reception system for video screen and handwritten input data |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20120808 |