CN105183545A - Big data information compression method - Google Patents
Big data information compression method Download PDFInfo
- Publication number
- CN105183545A CN105183545A CN201510436680.6A CN201510436680A CN105183545A CN 105183545 A CN105183545 A CN 105183545A CN 201510436680 A CN201510436680 A CN 201510436680A CN 105183545 A CN105183545 A CN 105183545A
- Authority
- CN
- China
- Prior art keywords
- compressed
- memory
- data information
- large data
- big data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007906 compression Methods 0.000 title claims abstract description 19
- 230000006835 compression Effects 0.000 title claims abstract description 16
- 238000000034 method Methods 0.000 title claims abstract description 15
- 238000013144 data compression Methods 0.000 claims description 6
- 230000007547 defect Effects 0.000 abstract description 3
- 238000012544 monitoring process Methods 0.000 abstract 1
- 230000010354 integration Effects 0.000 description 2
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
Landscapes
- Storage Device Security (AREA)
Abstract
The invention discloses a big data information compression method. The method comprises: according to volumes of to-be-compressed big data information, numbering and sorting the to-be-compressed big data information in sequence; according to the numbering and sorting, monitoring to-be-compressed big data information with the volume greater than a preset threshold and performing marking; according to the numbering, sorting and marking, storing to-be-compressed big data information with the volume smaller than or equal to the preset threshold into a first storage device, and storing to-be-compressed big data information with input speed greater than a preset threshold into a second storage device; and setting a selector between the first storage device and the second storage device, so that a user, based on an estimated compression time, quickly calls required to-be-compressed big data information from the first storage device or the second storage device according to the volume of the to-be-compressed big data information, and starts a compression program to perform compression processing. According to the technical scheme, the defects of low reliability, poor security, high information encryption difficulty and the like in the prior art can be overcome to achieve the advantages of high reliability, high security and low information encryption difficulty.
Description
Technical field
The present invention relates to technical field of electronic products, particularly, relate to a kind of large data message compression method.
Background technology
Electronic technology is late nineteenth century, earlier 1900s starts the emerging technology that grows up, and twentieth century development is the rapidest, most widely used general, becomes an important symbol of modern science technical development.
First generation electronic product take electron tube as core.Be born first transistor in the world at the forties end, and it, with features such as small and exquisite, light, power saving, life-span length, should be used by various countries soon, in very large range instead of electron tube.The fifties latter stage, occurred first piece of integrated circuit in the world, it on one piece of silicon, makes electronic product to more miniaturization the electronic component integrations such as many transistors.Integrated circuit develops large scale integrated circuit and VLSI (very large scale integrated circuit) rapidly from small scale integration, thus makes electronic product towards high-effect low consumption, high precision, high stable, intelligentized future development.
Electronic product brings great convenience to the live and work of people, but the security of electronic product lacks and becomes people's live and work information leakage whether most important factor.
Realizing in process of the present invention, inventor finding at least to exist in prior art that reliability is low, poor stability and the defect such as information encryption difficulty is large.
Summary of the invention
The object of the invention is to, for the problems referred to above, propose a kind of large data message compression method, to realize the advantage that reliability is high, security good and information encryption difficulty is little.
For achieving the above object, the technical solution used in the present invention is: a kind of large data message compression method, comprising:
By the capacity of large data message to be compressed, successively sequence is numbered to large data message to be compressed;
Sort by number, the to be compressed large data message that supervision capacity is greater than predetermined threshold value is gone forward side by side row labels;
Sort by number and mark, by capacity less than or equal to the to be compressed large data information memory of predetermined threshold value at first memory, input speed is greater than the to be compressed large data information memory of predetermined threshold value at second memory;
Between first memory and second memory, selector switch is set, for user based on the compression time estimated, capacity according to large data message to be compressed transfers required large data message to be compressed from first memory or second memory rapidly, starts condensing routine and carries out compression process;
This condensing routine carries out the operation compressing process, specifically comprises:
The to be compressed large data message chosen is divided into the first substream of data and the second substream of data,
Sequentially described first substream of data is recorded on the first data compression device,
Sequentially described second substream of data is recorded on the second data compression device.
The large data message compression method of various embodiments of the present invention, owing to comprising: by the capacity of large data message to be compressed, is numbered sequence to large data message to be compressed successively; Sort by number, the to be compressed large data message that supervision capacity is greater than predetermined threshold value is gone forward side by side row labels; Sort by number and mark, by capacity less than or equal to the to be compressed large data information memory of predetermined threshold value at first memory, input speed is greater than the to be compressed large data information memory of predetermined threshold value at second memory; Between first memory and second memory, selector switch is set, user is based on the compression time estimated, capacity according to large data message to be compressed transfers required large data message to be compressed from first memory or second memory rapidly, starts condensing routine and carries out compression process; Thus can overcome that reliability in prior art is low, poor stability and the large defect of information encryption difficulty, to realize the advantage that reliability is high, security good and information encryption difficulty is little.
Other features and advantages of the present invention will be set forth in the following description, and, partly become apparent from instructions, or understand by implementing the present invention.
Below by embodiment, technical scheme of the present invention is described in further detail.
Embodiment
Below the preferred embodiments of the present invention are described, should be appreciated that preferred embodiment described herein is only for instruction and explanation of the present invention, is not intended to limit the present invention.
According to the embodiment of the present invention, provide a kind of large data message compression method, comprising:
By the capacity of large data message to be compressed, successively sequence is numbered to large data message to be compressed;
Sort by number, the to be compressed large data message that supervision capacity is greater than predetermined threshold value is gone forward side by side row labels;
Sort by number and mark, by capacity less than or equal to the to be compressed large data information memory of predetermined threshold value at first memory, input speed is greater than the to be compressed large data information memory of predetermined threshold value at second memory;
Between first memory and second memory, selector switch is set, for user based on the compression time estimated, capacity according to large data message to be compressed transfers required large data message to be compressed from first memory or second memory rapidly, starts condensing routine and carries out compression process;
This condensing routine carries out the operation compressing process, specifically comprises:
The to be compressed large data message chosen is divided into the first substream of data and the second substream of data,
Sequentially described first substream of data is recorded on the first data compression device,
Sequentially described second substream of data is recorded on the second data compression device.
Last it is noted that the foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, although with reference to previous embodiment to invention has been detailed description, for a person skilled in the art, it still can be modified to the technical scheme described in foregoing embodiments, or carries out equivalent replacement to wherein portion of techniques feature.Within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (1)
1. a large data message compression method, is characterized in that, comprising:
By the capacity of large data message to be compressed, successively sequence is numbered to large data message to be compressed;
Sort by number, the to be compressed large data message that supervision capacity is greater than predetermined threshold value is gone forward side by side row labels;
Sort by number and mark, by capacity less than or equal to the to be compressed large data information memory of predetermined threshold value at first memory, input speed is greater than the to be compressed large data information memory of predetermined threshold value at second memory;
Between first memory and second memory, selector switch is set, for user based on the compression time estimated, capacity according to large data message to be compressed transfers required large data message to be compressed from first memory or second memory rapidly, starts condensing routine and carries out compression process;
This condensing routine carries out the operation compressing process, specifically comprises:
The to be compressed large data message chosen is divided into the first substream of data and the second substream of data,
Sequentially described first substream of data is recorded on the first data compression device,
Sequentially described second substream of data is recorded on the second data compression device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510436680.6A CN105183545A (en) | 2015-07-23 | 2015-07-23 | Big data information compression method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510436680.6A CN105183545A (en) | 2015-07-23 | 2015-07-23 | Big data information compression method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105183545A true CN105183545A (en) | 2015-12-23 |
Family
ID=54905641
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510436680.6A Pending CN105183545A (en) | 2015-07-23 | 2015-07-23 | Big data information compression method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105183545A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1828556A (en) * | 2005-03-05 | 2006-09-06 | 腾讯科技（深圳）有限公司 | Method, system and device for data storage |
| CN1922580A (en) * | 2003-12-30 | 2007-02-28 | 桑迪士克股份有限公司 | Non-volatile memory and method with phased programming failure handling |
| US20070150886A1 (en) * | 2005-12-22 | 2007-06-28 | Shapiro Alan J | Apparatus and method for subtractive installation |
| CN101206912A (en) * | 2006-12-22 | 2008-06-25 | 富士通株式会社 | Memory device, memory controller and memory system |
| US20100058007A1 (en) * | 2008-08-26 | 2010-03-04 | Kabushiki Kaisha Toshiba | Information processing apparatus and memory management method |
| CN102970287A (en) * | 2012-11-08 | 2013-03-13 | 广东欧珀移动通信有限公司 | HTTP request data processing method |
-
2015
- 2015-07-23 CN CN201510436680.6A patent/CN105183545A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1922580A (en) * | 2003-12-30 | 2007-02-28 | 桑迪士克股份有限公司 | Non-volatile memory and method with phased programming failure handling |
| CN1828556A (en) * | 2005-03-05 | 2006-09-06 | 腾讯科技（深圳）有限公司 | Method, system and device for data storage |
| US20070150886A1 (en) * | 2005-12-22 | 2007-06-28 | Shapiro Alan J | Apparatus and method for subtractive installation |
| CN101206912A (en) * | 2006-12-22 | 2008-06-25 | 富士通株式会社 | Memory device, memory controller and memory system |
| US20100058007A1 (en) * | 2008-08-26 | 2010-03-04 | Kabushiki Kaisha Toshiba | Information processing apparatus and memory management method |
| CN102970287A (en) * | 2012-11-08 | 2013-03-13 | 广东欧珀移动通信有限公司 | HTTP request data processing method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2019024555A8 (en) | Method and device for encoding polar code | |
| CN102122960A (en) | Multi-character combination lossless data compression method for binary data | |
| CN105161135A (en) | Electronic product test information storage method | |
| CN105183545A (en) | Big data information compression method | |
| CN100414475C (en) | Table look-up circuit | |
| CN102184214B (en) | Data grouping quick search positioning mode | |
| CN105573775A (en) | FPGA configuration file loading method and decoder | |
| CN114253524B (en) | A script-based method for assisting state machine logic code design | |
| CN105049178A (en) | Multi-user information screening method | |
| CN112416820B (en) | A kind of data packet classification storage method and system | |
| CN104407367B (en) | Device and method for improving baseband signal processing capability of satellite navigation terminal receiver | |
| CN110716688A (en) | Big data information compression method | |
| CN105072437A (en) | Video data detecting method based on cloud calculation | |
| CN108449445A (en) | A kind of range type message match circuit and method | |
| CN103955492A (en) | Method for storing data in electrical power system | |
| CN105187734A (en) | Loading method for dynamic image and static image | |
| CN106027369A (en) | Email address characteristic oriented email address matching method | |
| CN102495816A (en) | A fast interrupt hierarchical processing device and method | |
| WO2023082156A1 (en) | Lz77 decoding circuit and operation method thereof | |
| CN103559266B (en) | Multi-mode matching method and device | |
| US20110016168A1 (en) | Method and apparatus for modulo n calculation | |
| CN105072481A (en) | Video data loading and playing method | |
| CN105100806A (en) | Compression and issuing method of super-large scale audio and video data | |
| CN105072356A (en) | Static image synchronizing method | |
| CN103399920A (en) | Key value searching method, key value searching device and chip |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Liu Dong New District of Liuzhou city the Guangxi Zhuang Autonomous Region 545000 double Renlu No. 10 Guantang R & D center 2 Building No. 705 (Liu Zhougao and Secretary of Commerce Co. Ltd. hosted) Applicant after: LIUZHOU YIWANG TECHNOLOGY CO., LTD. Address before: No. 16 Golden Road Liunan District of Liuzhou city in the Guangxi Zhuang Autonomous Region Hui Tan 545000 Applicant before: LIUZHOU YIWANG TECHNOLOGY CO., LTD. |
|
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20151223 |