[go: up one dir, main page]

CN106982165A - Data compression method and its system - Google Patents

Data compression method and its system Download PDF

Info

Publication number
CN106982165A
CN106982165A CN201610027489.0A CN201610027489A CN106982165A CN 106982165 A CN106982165 A CN 106982165A CN 201610027489 A CN201610027489 A CN 201610027489A CN 106982165 A CN106982165 A CN 106982165A
Authority
CN
China
Prior art keywords
packet
header
data block
compression
packet header
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610027489.0A
Other languages
Chinese (zh)
Inventor
洪涛
郭亚松
许振坪
许宁
林德辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xiamen Yaxon Networks Co Ltd
Original Assignee
Xiamen Yaxon Networks Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xiamen Yaxon Networks Co Ltd filed Critical Xiamen Yaxon Networks Co Ltd
Priority to CN201610027489.0A priority Critical patent/CN106982165A/en
Publication of CN106982165A publication Critical patent/CN106982165A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00Traffic control in data switching networks
    • H04L47/10Flow control; Congestion control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00Traffic control in data switching networks
    • H04L47/10Flow control; Congestion control
    • H04L47/32Flow control; Congestion control by discarding or delaying data units, e.g. packets or frames
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00Traffic control in data switching networks
    • H04L47/10Flow control; Congestion control
    • H04L47/36Flow control; Congestion control by determining packet size, e.g. maximum transfer unit [MTU]
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/50Reducing energy consumption in communication networks in wire-line communication networks, e.g. low power modes or reduced link rate

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Communication Control (AREA)

Abstract

The invention discloses a kind of data compression method and its system, methods described includes:Ergodic data bag, obtains the offset, redundancy word joint number and redundance character of each redundant data block;The packing of the offset of each redundant data block, redundancy word joint number and redundance character is generated into corresponding packet header;Number generation packet header quantity according to the packet header;Obtaining includes the header field of the packet header quantity and packet header;The header field is inserted before packet;Delete the redundant data block in packet.The present invention indicates the attribute of redundant data block by increasing header field, redundant data block is deleted in the packet, the space-consuming of packet can be reduced, it can reduce network load and the data traffic consumed in transmission, improve transmission stability and transmission speed, the probability that reduction packet malfunctions in transmitting procedure.

Description

Data compression method and its system
Technical field
The present invention relates to data processing field, more particularly to a kind of data compression method and its system.
Background technology
During Vehicular satellite locating and monitoring terminal provides the various remote services such as position tracking, vehicle-mounted end It is that data interaction carried out by mobile network according to the communications protocol made an appointment between end and monitoring server , communications protocol species is various, and form differs, but they all can not because following fixed protocol format What is avoided has a problem that --- the protocol data content of encapsulation contains larger redundancy, this redundancy Degree shows as continuous multiple identical bytes.Frequent data item between car-mounted terminal and monitoring server is interacted will Make the harmfulness amplification that this redundancy brings, it not only increases network load, consumption data flow, and The reliability of data transfer can be reduced, particularly in the relatively limited communication environment of this bandwidth ratio of mobile network, This network burden brought by redundant data is more very important.
In the patent document of Application No. 201210572738.6, it is proposed that a kind of network data compression method And system.Methods described includes:Judge whether the corresponding type of network data belongs to pre- by data sending terminal If network traffics type, if so, then realizing that the compression of network data obtains described using network proxy cache The corresponding identification information of network data, and the identification information is transmitted, if it is not, then being deleted using network redundancy Handle the compression to realize network data and obtain the corresponding finger print information of the network data, and transmit the finger Line information;The finger print information and identification information are received by data receiver, and according to the identification information The network data for being once cached in the data receiver is extracted, network redundancy is recovered according to the finger print information and deleted Except the network data of before processing;Converge network data corresponding to the identification information and the corresponding net of finger print information Network data.This method is analyzed and transmitted to data block respectively, if but beacon information or finger print information loss, The data then recovered are incomplete.
The content of the invention
The technical problems to be solved by the invention are:A kind of data compression method and its system are provided, reduce net Network is loaded, and improves the efficiency and reliability of data transfer.
In order to solve the above-mentioned technical problem, the technical solution adopted by the present invention is:A kind of data compression method, Including
Ergodic data bag, obtains the offset, redundancy word joint number and redundance character of each redundant data block;
The packing of the offset of each redundant data block, redundancy word joint number and redundance character is generated into corresponding packet header ;Number generation packet header quantity according to the packet header;Acquisition includes the packet header quantity and packet header The header field of item;
The header field is inserted before packet;
Delete the redundant data block in packet.
The invention further relates to a kind of data compression system, including
First acquisition module, for ergodic data bag, obtains offset, the redundancy word of each redundant data block Joint number and redundance character;
First generation module, for by the offset of each redundant data block, redundancy word joint number and redundance character The corresponding packet header of packing generation;
Second generation module, for the number generation packet header quantity according to the packet header;
Second acquisition module, includes the header field of the packet header quantity and packet header for obtaining;
Module is inserted, for inserting the header field before packet;
Removing module, for deleting the redundant data block in packet.
The beneficial effects of the present invention are:The attribute of redundant data block is indicated by increasing header field, Redundant data block is deleted in packet, the space-consuming of packet can be reduced, can reduce network in transmission bears The data traffic for carrying and being consumed, improves transmission stability and transmission speed, reduction packet is in transmitting procedure The probability of middle error.
Brief description of the drawings
Fig. 1 is a kind of flow chart of data compression method of the invention;
Fig. 2 is the method flow diagram of the embodiment of the present invention one;
Fig. 3 is the redundant data block schematic diagram of the embodiment of the present invention one;
Fig. 4 is the header field encapsulation schematic diagram of the embodiment of the present invention one;
Fig. 5 is a kind of structural representation of data compression system of the invention;
Fig. 6 is the system structure diagram of the embodiment of the present invention two.
Label declaration:
1st, the first acquisition module;2nd, the first generation module;3rd, the second generation module;4th, second mould is obtained Block;5th, module is inserted;6th, removing module;7th, sending module;8th, receiving module;9th, grand master pattern is gone back in parsing Block.
Embodiment
To describe technology contents, the objects and the effects of the present invention in detail, below in conjunction with embodiment simultaneously Accompanying drawing is coordinated to be explained in detail.
The design of most critical of the present invention is:Packet header is added in the packet, to mark redundant data in number According to the position occurred in bag, byte number and character, i.e., with shorter packet header, longer redundant data is replaced, Realize the purpose of redundant data compression.
Referring to Fig. 1, a kind of data compression method, including
Ergodic data bag, obtains the offset, redundancy word joint number and redundance character of each redundant data block;
The packing of the offset of each redundant data block, redundancy word joint number and redundance character is generated into corresponding packet header ;Number generation packet header quantity according to the packet header;Acquisition includes the packet header quantity and packet header The header field of item;
The header field is inserted before packet;
Delete the redundant data block in packet.
It was found from foregoing description, the beneficial effects of the present invention are:Redundant data block is represented by header field Attribute and the foundation as reduction redundant data block, realize the compression of redundant data block, improve transmission steady Qualitative and transmission speed, the probability that reduction packet malfunctions in transmitting procedure.
Further, it is described " header field to be inserted before packet;Delete the redundant digit in packet According to block " also include afterwards:
Transmitting terminal obtains the packet after compression, and is sent to receiving terminal;Packet after the compression includes The header field and the packet delete the data block obtained after redundant data block.
Seen from the above description, the packet into transmission link has deleted redundant data block, reduces network Load and data traffic, and the length of redundant data block is longer, the ratio of compression is bigger, the resource of saving Also it is more.
Further, after described " transmitting terminal obtains the packet after compression, and is sent to receiving terminal " also Including:
Receiving terminal receives the packet after the compression, parses the header field, according to the header field, Redundant data block is reduced into the data block, the packet before compression is obtained.
Seen from the above description, the packet after compression can be reduced to by header field by the data before compression Bag, data are not easy to lose, and transmission reliability is high.
Further, the space-consuming and compression ratio according to packet header determine the packet header and the packet header The byte that quantity takes.
Further, the packet header quantity takes a byte;The packet header takes three bytes, its Described in offset, redundancy word joint number and redundance character respectively take a byte.
Seen from the above description, consider the space-consuming and compression ratio in packet header, by space-consuming compared with Few header field replaces the redundant data block that space-consuming is more, and the occupancy that can greatly reduce packet is empty Between, transmission speed is improved, while can ensure that redundant data block can be reduced completely in resolving, makes number According to not easy to lose.
The invention also provides a kind of data compression system, including
First acquisition module, for ergodic data bag, obtains offset, the redundancy word of each redundant data block Joint number and redundance character;
First generation module, for by the offset of each redundant data block, redundancy word joint number and redundance character The corresponding packet header of packing generation;
Second generation module, for the number generation packet header quantity according to the packet header;
Second acquisition module, includes the header field of the packet header quantity and packet header for obtaining;
Module is inserted, for inserting the header field before packet;
Removing module, for deleting the redundant data block in packet.
Further, in addition to
Sending module, obtains the packet after compression, and be sent to receiving terminal for transmitting terminal;The compression Packet afterwards includes the header field and the packet deletes the data block obtained after redundant data block.
Further, in addition to
Receiving module, the packet after the compression is received for receiving terminal;
Recovery module is parsed, for parsing the header field, according to the header field, redundant digit is reduced According to block into the data block, the packet before compression is obtained.
Further, the space-consuming and compression ratio according to packet header determine the packet header and the packet header The byte that quantity takes.
Further, the packet header quantity takes a byte;The packet header takes three bytes, its Described in offset, redundancy word joint number and redundance character respectively take a byte.
Embodiment one
Fig. 1-4 are refer to, embodiments of the invention one are:A kind of data compression method, can operate with vehicle-mounted end Data interaction between end and monitoring server, is comprised the following steps that:
S1:Whole packet is traveled through, obtains and records the offset I of each redundant data block, redundancy word successively Joint number N and redundance character C;As shown in figure 3, the offset I is the first character section of redundant data block Relative position in the packet, the redundancy word joint number N continuously occurs for redundance character in redundant data block Number, the redundance character C be redundant data block in uniquely exist continuously there are multiple characters;Institute Redundance character hexadecimal representation is stated, scope is 0x00-0xFF, the redundance character C=0x00 shown in Fig. 3.
S2:The packing generation of the offset of each redundant data block, redundancy word joint number and redundance character is corresponding Packet header;Number generation packet header quantity according to the packet header;Acquisition include packet header quantity with The header field in packet header;Occupancy of the byte that the packet header and the packet header quantity take according to packet header Space and compression ratio determine that alternatively, the packet header quantity takes a byte;The packet header is accounted for With three bytes, wherein the offset, redundancy word joint number and redundance character respectively take a byte;Packet header The encapsulation schematic diagram of field is as shown in figure 4, the A in figure represents packet header, and M represents the quantity in packet header.
S3:The header field is inserted before packet.
S4:Delete the redundant data block in packet.
S5:Transmitting terminal obtains the packet after compression, and is sent to receiving terminal;Packet after the compression The data block obtained after redundant data block is deleted including the header field and the packet.
S6:Receiving terminal receives the packet after the compression, parses the header field, during parsing, Packet header quantity, which is specified, needs the redundant data number of blocks of reduction in packet, and what each packet header item was specified Offset, byte number and the character of redundant data block, according to the header field, reduce redundant data item by item Block is into the data block, you can obtain the packet before compression.
Alternatively, the step S3 and S4 can be in no particular order, that is to say, that can first carry out S4 and perform again S3。
Embodiment two
Refer to Fig. 5-6, a kind of data compression system, including the first acquisition module 1, the first generation module 2, Second generation module 3, the second acquisition module 4, insertion module 5 and removing module 6.
First acquisition module 1 is used for ergodic data bag, obtains the offset, superfluous of each redundant data block Remaining byte number and redundance character;
First generation module 2 is used for the offset of each redundant data block, redundancy word joint number and redundancy The corresponding packet header of character packing generation;
Second generation module 3 is used for the number generation packet header quantity according to the packet header;
Second acquisition module 4, which is used to obtain, includes the header field of the packet header quantity and packet header;
The insertion module 5 is used to insert the header field before packet;
The removing module 6 is used to delete the redundant data block in packet.
The data compression system also includes sending module 7, receiving module 8 and parsing recovery module 9.
The sending module 7 is used for transmitting terminal and obtains the packet after compression, and is sent to receiving terminal;It is described Packet after compression includes the header field and the packet deletes the data obtained after redundant data block Block.
The receiving module 8 is used for receiving terminal and receives the packet after the compression;
The parsing recovery module 9 is used to parse the header field, according to the header field, reduces superfluous Remaining data block obtains the packet before compression into the data block.
In summary, the present invention is provided a kind of data compression method and its system, by increasing header field To indicate the attribute of redundant data block, redundant data block is deleted in the packet, can reduce the occupancy of packet Space, can reduce network load and the data traffic consumed in transmission, reduce communication cost, improve and pass Defeated stability and transmission speed, the probability that reduction packet malfunctions in transmitting procedure;And redundant data block Length is longer, and the ratio of compression is bigger;Meanwhile, receiving terminal can be reduced to compression according to header field parsing Preceding initial data, data are not easy to lose, and transmission reliability is high.
Embodiments of the invention are the foregoing is only, are not intended to limit the scope of the invention, every profit The equivalents made with description of the invention and accompanying drawing content, or directly or indirectly it is used in the technology of correlation Field, is included within the scope of the present invention.

Claims (10)

1. a kind of data compression method, it is characterised in that:Including:
Ergodic data bag, obtains the offset, redundancy word joint number and redundance character of each redundant data block;
The packing of the offset of each redundant data block, redundancy word joint number and redundance character is generated into corresponding packet header ;Number generation packet header quantity according to the packet header;Acquisition includes the packet header quantity and packet header The header field of item;
The header field is inserted before packet;
Delete the redundant data block in packet.
2. data compression method according to claim 1, it is characterised in that:It is described " before packet Insert the header field;Delete the redundant data block in packet " also include afterwards:
Transmitting terminal obtains the packet after compression, and is sent to receiving terminal;Packet after the compression includes The header field and the packet delete the data block obtained after redundant data block.
3. data compression method according to claim 2, it is characterised in that:It is described that " transmitting terminal is obtained Packet after compression, and it is sent to receiving terminal " also include afterwards:
Receiving terminal receives the packet after the compression, parses the header field, according to the header field, Redundant data block is reduced into the data block, the packet before compression is obtained.
4. data compression method according to claim 1, it is characterised in that:Occupancy according to packet header is empty Between and compression ratio determine byte that packet header and the packet header quantity take.
5. data compression method according to claim 1, it is characterised in that:The packet header quantity is accounted for With a byte;The packet header takes three bytes, wherein the offset, redundancy word joint number and redundancy Character respectively takes a byte.
6. a kind of data compression system, it is characterised in that:Including
First acquisition module, for ergodic data bag, obtains offset, the redundancy word of each redundant data block Joint number and redundance character;
First generation module, for by the offset of each redundant data block, redundancy word joint number and redundance character The corresponding packet header of packing generation;
Second generation module, for the number generation packet header quantity according to the packet header;
Second acquisition module, includes the header field of the packet header quantity and packet header for obtaining;
Module is inserted, for inserting the header field before packet;
Removing module, for deleting the redundant data block in packet.
7. data compression system according to claim 6, it is characterised in that:Also include
Sending module, obtains the packet after compression, and be sent to receiving terminal for transmitting terminal;The compression Packet afterwards includes the header field and the packet deletes the data block obtained after redundant data block.
8. data compression system according to claim 6, it is characterised in that:Also include
Receiving module, the packet after the compression is received for receiving terminal;
Recovery module is parsed, for parsing the header field, according to the header field, redundant digit is reduced According to block into the data block, the packet before compression is obtained.
9. data compression system according to claim 6, it is characterised in that:Occupancy according to packet header is empty Between and compression ratio determine byte that packet header and the packet header quantity take.
10. data compression system according to claim 6, it is characterised in that:The packet header quantity Take a byte;Packet header takes three bytes, wherein the offset, redundancy word joint number and superfluous Remaining character respectively takes a byte.
CN201610027489.0A 2016-01-15 2016-01-15 Data compression method and its system Pending CN106982165A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610027489.0A CN106982165A (en) 2016-01-15 2016-01-15 Data compression method and its system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610027489.0A CN106982165A (en) 2016-01-15 2016-01-15 Data compression method and its system

Publications (1)

Publication Number Publication Date
CN106982165A true CN106982165A (en) 2017-07-25

Family

ID=59341177

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610027489.0A Pending CN106982165A (en) 2016-01-15 2016-01-15 Data compression method and its system

Country Status (1)

Country Link
CN (1) CN106982165A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109104732A (en) * 2018-06-13 2018-12-28 珠海格力电器股份有限公司 Data sending method and device and intelligent electric appliance
CN112769883A (en) * 2019-11-01 2021-05-07 科美诊断技术股份有限公司 Consumable data uploading method and device
CN112786180A (en) * 2019-11-01 2021-05-11 科美诊断技术股份有限公司 Consumable data uploading method and device
CN115361454A (en) * 2022-10-24 2022-11-18 北京智芯微电子科技有限公司 Message sequence coding, decoding and transmitting method and coding and decoding equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101523732A (en) * 2006-09-01 2009-09-02 帕克比特软件股份有限公司 Method and system for transmitting data files via a data network
CN101667843A (en) * 2009-09-22 2010-03-10 中兴通讯股份有限公司 Methods and devices for compressing and uncompressing data of embedded system
CN102075287A (en) * 2010-11-22 2011-05-25 浪潮(北京)电子信息产业有限公司 Data processing method and device
WO2013032825A2 (en) * 2011-09-01 2013-03-07 Microsoft Corporation Optimization of a partially deduplicated file
CN103020317A (en) * 2013-01-10 2013-04-03 曙光信息产业(北京)有限公司 Device and method for data compression based on data deduplication
CN105027071A (en) * 2013-03-06 2015-11-04 起元科技有限公司 Managing operations on stored data units

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101523732A (en) * 2006-09-01 2009-09-02 帕克比特软件股份有限公司 Method and system for transmitting data files via a data network
CN101667843A (en) * 2009-09-22 2010-03-10 中兴通讯股份有限公司 Methods and devices for compressing and uncompressing data of embedded system
CN102075287A (en) * 2010-11-22 2011-05-25 浪潮(北京)电子信息产业有限公司 Data processing method and device
WO2013032825A2 (en) * 2011-09-01 2013-03-07 Microsoft Corporation Optimization of a partially deduplicated file
CN103020317A (en) * 2013-01-10 2013-04-03 曙光信息产业(北京)有限公司 Device and method for data compression based on data deduplication
CN105027071A (en) * 2013-03-06 2015-11-04 起元科技有限公司 Managing operations on stored data units

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109104732A (en) * 2018-06-13 2018-12-28 珠海格力电器股份有限公司 Data sending method and device and intelligent electric appliance
CN112769883A (en) * 2019-11-01 2021-05-07 科美诊断技术股份有限公司 Consumable data uploading method and device
CN112786180A (en) * 2019-11-01 2021-05-11 科美诊断技术股份有限公司 Consumable data uploading method and device
CN115361454A (en) * 2022-10-24 2022-11-18 北京智芯微电子科技有限公司 Message sequence coding, decoding and transmitting method and coding and decoding equipment
CN115361454B (en) * 2022-10-24 2023-03-24 北京智芯微电子科技有限公司 Message sequence encoding, decoding, transmission method and encoding, decoding equipment

Similar Documents

Publication Publication Date Title
WO2017012510A1 (en) Method and device for transmitting flexible ethernet service flow
CN102480462B (en) Universal protocol adapting method and device
CN101436922B (en) Method for transmitting massive data based on UDP protocol
CN111083161A (en) Data transmission processing method and device and Internet of things equipment
CN101568144B (en) A header compression method suitable for wireless ad hoc networks
CN109818930A (en) Communication text data transmission method based on TCP protocol
EP3651438B1 (en) Data transmission based on application- and protocol-adaptive compression strategies
CN103369593B (en) A kind of method compressing reconciliation compressed ethernet message and network element device
CN106982165A (en) Data compression method and its system
CN102480335B (en) A kind of sending method of business datum and system
CN101237419A (en) Packet header compression method in air-space communication of aviation telecommunication network
CN101146025B (en) Compressed real-time transport protocol message transmission method and system and compression end unit
CN103825869A (en) Compression and decompression method for Ethernet message header, and compression and decompression device thereof
WO2018171641A1 (en) Method and device for transmitting and receiving network management information, transmitting apparatus and receiving apparatus
CN104967498B (en) A kind of satellite network data packet compressing transmission method based on history
CN102571939A (en) Cross-platform communication method and system
CN108880760A (en) A kind of big data quantity reliable communication method based on big-dipper satellite
CN102006295A (en) Data compression method based on asynchronous transfer mode (ATM) carried IP voice
CN112087290B (en) Control word transmission method and device and computer readable storage medium
CN103533001A (en) Communication method and communication system based on HTTP multi-proxy, and intermediate proxy server
CN101834881A (en) Network communication method for embedded system
CN113364790B (en) Data transmission method and device
CN102480463B (en) Network interaction method and network interaction system
CN101247415A (en) Data transmission and synchronization method and wireless terminal
CN101404606B (en) Packet tunnel packaging structure and network tunnel management method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20170725