CN106407231A - A data multi-thread export method and system - Google Patents
A data multi-thread export method and system Download PDFInfo
- Publication number
- CN106407231A CN106407231A CN201510468337.XA CN201510468337A CN106407231A CN 106407231 A CN106407231 A CN 106407231A CN 201510468337 A CN201510468337 A CN 201510468337A CN 106407231 A CN106407231 A CN 106407231A
- Authority
- CN
- China
- Prior art keywords
- data
- thread
- deriving
- sequencing
- group
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides a data multi-thread export method and system. The method comprises the steps of presetting the number M of threads for data export; dividing to-be-exported data into M groups according to the number M of the threads, each group of data being exported by using one thread; packaging data exported by the threads into complete exported data. According to the embodiments, the speed and the efficiency of data export are increased and the data security is improved; at the same time, the operability of data export can be improved and the user experience is greatly improved.
Description
Technical field
The present invention relates to Internet technical field, particularly to a kind of data multi-wire journey deriving method and system.
Background technology
With the development of the Internet, increasing data accumulation gets up.User in one operation is put down
Platform is it may appear that the data of magnanimity needs to process and analyzes.This is accomplished by importing and exporting and backing up of data
Work.Common data derives and carries out in data base's aspect.
Data base (Database) is the warehouse to organize, store and to manage data according to data structure, it
Result from before modern more than 60 year, with the development of information technology and market, particularly twentieth century 90 years
After generation, data management is only no longer to store and management data, and is transformed into the various numbers required for user
Mode according to management.Data base has number of different types, from the form of the simplest various data that are stored with to energy
The large-scale database system enough carrying out mass data storage is all widely used in all fields.
Data in data base is set up by numerous users are shared its information, has had been extricated from concrete journey
The restriction of sequence and restriction.Different users can be used the data in data base by respective usage；Multiple use
Family can simultaneously in shared data bank data resource, that is, different users can access in data base simultaneously
Same data.Data sharing not only meets the requirement to information content for each user, also meets simultaneously
The requirement of each user-to-user information communication.
With the arriving of cloud era, big data (Big data) has also attracted increasing concern.《Write cloud
Platform》Analyst team think, it is big that big data (Big data) is commonly used to describe that a company creates
Amount unstructured data and semi-structured data, these data are when downloading to relevant database and being used for analyzing
Can overspending time and money.Big data analysis is often linked together, because large-scale in real time with cloud computing
Data set analysis need the framework as MapReduce to come to tens of, hundreds of or even thousands of computers
Share out the work.
Big data needs special technology, effectively to process the data in the substantial amounts of tolerance elapsed time.Suitable
For the technology of big data, including MPP (MPP) data base, data mining electrical network, divide
Cloth file system, distributed data base, cloud computing platform, the Internet and extendible storage system.
Big data has been exactly internet development to a kind of presentation or the feature in stage now it is not necessary that mythical
It or the heart revered is kept to it, under the setting off of the technological innovation curtain with cloud computing as representative, these are former
The data that this is difficult to collect and use starts easily to be utilized, constantly bringing forth new ideas by all trades and professions,
Big data progressively can create more value for the mankind.
Data derives and backs up is the basis of disaster tolerance, refers to operational error or the system failure for anti-locking system
Lead to loss of data, and all or part of data acquisition system is copied to other from the hard disk of applied host machine or array
Storage medium process.Traditional data backup mainly carries out cold standby using internal or external magnetic tape controller
Part.But this mode can only prevent the man-made faults such as operational error, and its recovery time is also very long.With
The continuous development of technology, the magnanimity of data increases, and many enterprises begin with network backup.Network is standby
Part is typically realized with reference to corresponding hardware and storage device by professional data storage management software.
Import and export, be a kind of specific command of data base.Here data base refers to the institute of software aspects
There is data related thereto storehouse.Disparate databases are different for the requirement importing and exporting.
For example, the ACCSS data base of Microsoft, is to have in data base to compare importing and exporting of fool.With
Sample, Microsoft's other office software also has identical function, and directly data being imported to newly-built file can
With.The number of the field importing and exporting is unrestricted.Flos Nelumbinis software is then the severe data base of comparison.?
Field must be corresponded when importing and exporting, just can import and export successfully.Include APPROACH,
LOTUS 123 office software, and APPROACH data base only has 108 fields.And in Film Animation
The animation that industry adopts manufactures software, such as FLASH, importing and exporting here, actually dynamic making
Element, stage and the element database drawn, imports to single animation, exports to different scenes and stage.
In prior art, data is imported and exported and would generally be carried out by the way of single thread, according to number
According to sequencing etc., import and export data one by one.However, when data volume is very big, importing and exporting
Efficiency also can substantially reduce, thus affecting Consumer's Experience.Thus, need badly and will a kind of raising data lead
Go out the scheme of efficiency, to improve the speed to data exporting and efficiency.
Content of the invention
The present invention provides a kind of data multi-wire journey deriving method and system, in order to solve big data in prior art
In the case of amount, data derives the problem of inefficiency.
The present invention provides a kind of data multi-wire journey deriving method, including：
The default Thread Count M deriving data；
The pre- data deriving is divided into by M group according to described Thread Count M, every group of data is respectively with a thread
Derive；
The data assembling that each thread is derived becomes complete derivation data.
Methods described also includes：
The described Thread Count M deriving data sets according to actual available Thread Count H.
Methods described also includes：
The pre- data deriving is divided into by N group according to described Thread Count M, described N is less than M.
Methods described also includes：
The data of described pre- derivation is grouped according to sequencing；
By the data of each thread derivation according to described sequencing, it is assembled into complete derivation data.
Methods described also includes：
Described sequencing is the sequencing of data storage or the sequencing of reading.
Methods described also includes：
The plurality of thread derives described data simultaneously.
A kind of data multi-wire journey guiding system, including：
Thread setup unit, for the default Thread Count M deriving data；
Data packet units, for being divided into M group according to described Thread Count M by the pre- data deriving；
Lead-out unit, for deriving every group of data respectively with a thread；
Module unitss, the data assembling for deriving each thread becomes complete derivation data.
Described data packet units are additionally operable to, according to described Thread Count M, the pre- data deriving is divided into N group,
Described N is less than M.
Described data packet units are additionally operable to be grouped the data of described pre- derivation according to sequencing；
The data that each thread is derived by described module unitss, according to described sequencing, is assembled into complete
Derive data.
Described lead-out unit is additionally operable to for multiple threads to derive described data simultaneously.
The embodiment of the present invention passes through the default Thread Count M deriving data；Led in advance according to described Thread Count M
The data going out is divided into M group, and every group of data is derived with a thread respectively；The data that each thread is derived
It is assembled into complete derivation data.The scheme of the embodiment of the present invention, it is possible to increase data derive speed and
Efficiency, and improve Information Security, the operability deriving simultaneously for data also makes moderate progress, greatly
Improve user experience.
Other features and advantages of the present invention will illustrate in the following description, and, partly from explanation
Become apparent in book, or understood by implementing the present invention.The purpose of the present invention and other advantages can
Realized by specifically noted structure in the description write, claims and accompanying drawing and obtain
?.
Below by drawings and Examples, technical scheme is described in further detail.
Brief description
Accompanying drawing is used for providing a further understanding of the present invention, and constitutes a part for description, with this
Bright embodiment is used for explaining the present invention together, is not construed as limiting the invention.In the accompanying drawings：
A kind of data multi-wire journey deriving method principle flow chart that Fig. 1 provides for the embodiment of the present invention 1；
A kind of data multi-wire journey guiding system structural representation that Fig. 2 provides for the embodiment of the present invention 2.
Specific embodiment
Below in conjunction with accompanying drawing, the preferred embodiments of the present invention are illustrated it will be appreciated that described herein
Preferred embodiment is merely to illustrate and explains the present invention, is not intended to limit the present invention.
As shown in figure 1, a kind of data multi-wire journey deriving method principle process providing for the embodiment of the present invention 1
Figure, wherein,
Step 11, presets the Thread Count M deriving data.
The the importing and exporting of data, existing mode is typically with the mode of single thread, and such efficiency comparison is low,
It is not suitable with data exporting operation when big data quantity.Efficiency to be improved, present embodiments provides multi-thread
The data of journey derives mode.With derivation in the same manner, the present embodiment does not repeat the mode that data imports.
Derive the Thread Count used required for data firstly the need of setting.This number minimum can be 1, maximum
Set according to the Thread Count that system can be supported by.Determination data is derived supported passage by this Thread Count
Number, thus, the setting of Thread Count M, it usually needs with reference to multiple parameters, can support including system
Big Thread Count, cost of Thread Count, the size of data and packet that packet can be supported by etc..
Thread, sometimes referred to as Lightweight Process (Lightweight Process, LWP), are program performing stream
Minimum unit.The thread of one standard by Thread Id, current instruction pointer (PC), set of registers and
Storehouse forms.In addition, thread is one of process entity, it is independently dispatched and assigned by system basic
Unit, thread oneself does not have system resource, only has the requisite resource that is in operation a bit, but
It can share, with the other threads belonging to a process together, whole resources that process is had.One thread can be created
Build and cancel another thread, can concurrently execute between the multiple threads in same process.Due to thread it
Between mutual restriction, cause thread to be in operation and present discontinuity.Thread also has ready, obstruction and runs
Three kinds of basic status.Ready state refers to that thread possesses all conditions of operation, can run in logic,
Wait datatron；Running status refers to that thread occupies datatron and is currently running；Blocked state refers to that thread is waiting
Treat an event (as certain semaphore), not can perform in logic.At least one line of each program
Journey, if program only one of which thread, that is, program itself.
Thread is a single sequential control flow process in program.A relatively independent, schedulable in process
Performance element, be that system is independently dispatched and the ultimate unit of assigning CPU refers to the scheduling of active program
Unit.Run multiple threads simultaneously and complete different work, referred to as multithreading in single program.
In multithreading OS, typically include multiple threads in a process, each thread is conduct
Using the ultimate unit of CPU, it is the entity of least cost expense.Thread has with properties.
1) light-duty entity
Entity in thread does not substantially have system resource, simply have a little requisite, can guarantee that solely
The vertical resource run.The entity of thread includes program, data and TCB.Thread is dynamic concept, it dynamic
Step response is described by thread control block TCB (Thread Control Block).TCB includes following information：
(1) thread state.
(2) when thread does not run, the field resources that are saved.
(3) one groups of execution stacks.
(4) local variable depositing each thread hosts area.
(5) main memory in same process and other resource are accessed.
For instruction be performed job sequence program counter, retain local variable, minority state parameter and
One group of depositor of return address etc. and storehouse.
2) the independent ultimate unit dispatched and assign.
In multithreading OS, thread is the ultimate unit of energy independent operating, thus is also independently to dispatch and divide
The ultimate unit of group.Due to thread very " light ", thus the switching of thread is very fast and expense little (same enter
In journey).
3) can concurrently execute.
Between the multiple threads in a process, can concurrently execute, even allow for institute in a process
Thread is had can concurrently to execute；Equally, the thread in different processes also can concurrently execute, and make full use of and send out
Wave the ability of datatron and ancillary equipment concurrent working.
4) share process resource.
Each thread in same process, can share the resource that this process is had, and this shows first
?：All threads all there is identical address space (address space of process) it means that, thread can
To access each virtual address of this address space；Further, it is also possible to access process had open literary composition
Part, intervalometer, signal measuring mechanism etc..Due to the thread shared drive in same process and file, so
Between thread, intercommunication need not call kernel.
When creating a new process, also create a new thread, the thread in process can be same
Create in process and in new thread, create new thread.
Thread can be with fair termination oneself it is also possible to certain thread executes mistake, by other thread force termination.
Terminate threading operation and be mainly responsible for depositor and the stack that release thread occupies.
When thread waits each event cannot run, stop its operation.
When the event blocking thread occurs, blocked thread state is set to ready state, is just suspended to
Thread queue.Process still has and executes related state.For example, so-called process is in " execution " state,
Actually refer to that certain thread in this process is carrying out.The behaviour relevant with process statuss that process is applied
Make, also its thread is worked.For example, when certain process being hung up, all threads in this process are also all
It is suspended, activation is also same.
Process is the ultimate unit of resource allocation.All resources relevant with this process, are all recorded in process
In control block PCB.To represent that this process has these resources or be currently in use them.
In addition, process is also to seize the thread of datatron, it has a complete virtual address space.
When process occurs scheduling, different processes has different virtual address spaces, and in same process not
Share same address space with thread.
Corresponding with process, thread is unrelated with resource allocation, and it belongs to some process, and with process in
Other threads share the resource of process together.
Thread is only made up of relational stack (system stack or user stack) depositor and thread control table TCB.
Depositor can be used to store the local variable in thread, but can not store the correlated variabless of other threads.
Several threads generally can be comprised in a process, the money that they can be had using process
Source.In the operating system being introduced into thread, it is all generally the ultimate unit as Resources allocation using process, and
Using thread as independent operating and the independent ultimate unit dispatched.Because thread is less than process, substantially not
Have system resource, therefore the expense that its scheduling is paid will be much smaller, the more efficient raising system of energy
The degree concurrently executing between interior multiple program, thus significantly improve utilization rate and the handling capacity of system resource.Cause
And the general-purpose operating system released in recent years all introduces thread, to improve the concurrency of system further,
And it is considered as an important indicator of modern operating system.
Thread can be summarized as at following 4 points with the difference of process：
1) address space and other resource (such as opening file)：Separate between process, same process each
Cross-thread is shared.Thread in certain process is invisible in other processes.
2) communicate：Interprocess communication IPC, cross-thread can be with direct read/write process data section (as global variable)
To carry out the auxiliary needing Process Synchronization and mutual exclusion means that communicates, to ensure the concordance of data.
3) dispatch and switch：Thread context switching switches much faster than process context.
4) in multithreading OS, process is not an executable entity.
In the present embodiment, the principle using multithreading carries out data derivation, actually might not a program meaning
Multithreading in justice, carry out data just with number of ways and process derives operation simultaneously.
The pre- data deriving is divided into M group according to Thread Count M, every group of data is respectively with one by step 12
Thread is derived.
Furthermore, it is understood that Thread Count M is actually the highest number that system can carry or can distribute
Amount, and corresponding, and for the pre- data deriving it is clear that being also required to be grouped, the quantity of packet is exactly Thread Count
M.So can ensure that number of threads is consistent with number of data packets.
Obviously, the packet of data here not necessarily defeated M group it is also possible to be divided into N group, N be less than or equal to M
?.That is, number of data packets can be less than Thread Count, so, data equally can be ensured
Efficiency of transmission.
For the packet of data, can be grouped according to sequencing with the pre- data deriving of contribute.Here elder generation
Order afterwards, can be the pre- storage order deriving data or reading order, or can also be going out of storehouse
Stacking order etc..This sequencing primarily to make different threads derive data do not repeat mutually,
And in order to follow-up data is easy to assembly.
After packet, each group of data can in the same size it is also possible to inconsistent.Each group of data can be same
When derive it is also possible to asynchronously derivation.Carry out with specific reference to being actually needed.Every group of data is led with a thread
Go out.In fact, multiple threads can also be derived by same group of data.
Data after packet, in order to easy to assembly, can add identification code or flag bit in every group of data,
To facilitate follow-up assembling.
Step 13, the data assembling that each thread is derived becomes complete derivation data.
Because each thread derives one group of data, can carry out simultaneously.So, the efficiency that data derives can carry
Height, speed can be accelerated.But the data deriving not is complete, each thread derives of data
Point, become complete derivation data after needing assembling.
Assembling data can be according to sequencing when being grouped before, it would however also be possible to employ add when packet
Identification code or flag bit.Data after assembling is complete derivation data, can carry out the operation such as backing up.
The embodiment of the present invention passes through the default Thread Count M deriving data；Led in advance according to described Thread Count M
The data going out is divided into M group, and every group of data is derived with a thread respectively；The data that each thread is derived
It is assembled into complete derivation data.The scheme of the embodiment of the present invention, it is possible to increase data derive speed and
Efficiency, and improve Information Security, the operability deriving simultaneously for data also makes moderate progress, greatly
Improve user experience.
As shown in Fig. 2 a kind of data multi-wire journey guiding system structural representation providing for the embodiment of the present invention 2
Figure, wherein,
Thread setup unit 21, for the default Thread Count M deriving data；
Data packet units 22, for being divided into M group according to described Thread Count M by the pre- data deriving；
Lead-out unit 23, for deriving every group of data respectively with a thread；
Module unitss 24, the data assembling for deriving each thread becomes complete derivation data.
Further, above-mentioned data packet units 22 are additionally operable to the number that will derive in advance according to described Thread Count M
According to being divided into N group, described N is less than M.
Further, above-mentioned data packet units 22 are additionally operable to the data of described pre- derivation according to successively suitable
Sequence is grouped；
The data that each thread is derived by described module unitss 24, according to described sequencing, has been assembled into
Whole derivation data.
Further, above-mentioned lead-out unit 23 is additionally operable to for multiple threads to derive described data simultaneously.
In sum, the embodiment of the present invention passes through the default Thread Count M deriving data；According to described Thread Count
The pre- data deriving is divided into M group by M, and every group of data is derived with a thread respectively；Each thread is led
The data assembling going out becomes complete derivation data.The scheme of the embodiment of the present invention, it is possible to increase data derives
Speed and efficiency, and improve Information Security, the operability deriving simultaneously for data has also changed
Kind, greatly improve user experience.
Those skilled in the art are it should be appreciated that embodiments of the invention can be provided as method, system or meter
Calculation machine program product.Therefore, the present invention can be using complete hardware embodiment, complete software embodiment or knot
Close the form of the embodiment of software and hardware aspect.And, the present invention can adopt and wherein wrap one or more
Computer-usable storage medium containing computer usable program code (including but not limited to disk memory and
Optical memory etc.) the upper computer program implemented form.
The present invention is to produce with reference to method according to embodiments of the present invention, equipment (system) and computer program
The flow chart of product and/or block diagram are describing.It should be understood that can by computer program instructions flowchart and
/ or block diagram in each flow process and/or the flow process in square frame and flow chart and/or block diagram and/
Or the combination of square frame.These computer program instructions can be provided to general purpose computer, special-purpose computer, embed
The processor of formula datatron or other programmable data processing device is to produce a machine so that passing through to calculate
The instruction of the computing device of machine or other programmable data processing device produces for realizing in flow chart one
The device of the function of specifying in individual flow process or multiple flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions may be alternatively stored in and computer or other programmable datas can be guided to process and set
So that being stored in this computer-readable memory in the standby computer-readable memory working in a specific way
Instruction produce and include the manufacture of command device, the realization of this command device is in one flow process or multiple of flow chart
The function of specifying in flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions also can be loaded in computer or other programmable data processing device, makes
Obtain and series of operation steps is executed on computer or other programmable devices to produce computer implemented place
Reason, thus the instruction of execution is provided for realizing in flow chart one on computer or other programmable devices
The step of the function of specifying in flow process or multiple flow process and/or one square frame of block diagram or multiple square frame.
Obviously, those skilled in the art can carry out various changes and modification without deviating from this to the present invention
The spirit and scope of invention.So, if these modifications of the present invention and modification belong to the claims in the present invention
And its within the scope of equivalent technologies, then the present invention is also intended to comprise these changes and modification.
Claims (10)
1. a kind of data multi-wire journey deriving method is it is characterised in that include：
The default Thread Count M deriving data；
The pre- data deriving is divided into by M group according to described Thread Count M, every group of data is respectively with a thread
Derive；
The data assembling that each thread is derived becomes complete derivation data.
2. the method for claim 1 is it is characterised in that methods described also includes：
The described Thread Count M deriving data sets according to actual available Thread Count H.
3. the method for claim 1 is it is characterised in that methods described also includes：
The pre- data deriving is divided into by N group according to described Thread Count M, described N is less than M.
4. the method as described in claim 1 or 3 is it is characterised in that methods described also includes：
The data of described pre- derivation is grouped according to sequencing；
By the data of each thread derivation according to described sequencing, it is assembled into complete derivation data.
5. method as claimed in claim 4 is it is characterised in that methods described also includes：
Described sequencing is the sequencing of data storage or the sequencing of reading.
6. the method for claim 1 is it is characterised in that methods described also includes：
The plurality of thread derives described data simultaneously.
7. a kind of data multi-wire journey guiding system is it is characterised in that include：
Thread setup unit, for the default Thread Count M deriving data；
Data packet units, for being divided into M group according to described Thread Count M by the pre- data deriving；
Lead-out unit, for deriving every group of data respectively with a thread；
Module unitss, the data assembling for deriving each thread becomes complete derivation data.
8. system as claimed in claim 7 is it is characterised in that described data packet units are additionally operable to root
According to described Thread Count M, the pre- data deriving is divided into N group, described N is less than M.
9. system as claimed in claim 7 it is characterised in that described data packet units be additionally operable to by
The data of described pre- derivation is grouped according to sequencing；
The data that each thread is derived by described module unitss, according to described sequencing, is assembled into complete
Derive data.
10. system as claimed in claim 7 it is characterised in that described lead-out unit be additionally operable to will be multiple
Thread derives described data simultaneously.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510468337.XA CN106407231A (en) | 2015-08-03 | 2015-08-03 | A data multi-thread export method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510468337.XA CN106407231A (en) | 2015-08-03 | 2015-08-03 | A data multi-thread export method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106407231A true CN106407231A (en) | 2017-02-15 |
Family
ID=58008128
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510468337.XA Pending CN106407231A (en) | 2015-08-03 | 2015-08-03 | A data multi-thread export method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106407231A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106980538A (en) * | 2017-02-16 | 2017-07-25 | 平安科技（深圳）有限公司 | The method and device of data processing |
| CN107798111A (en) * | 2017-11-01 | 2018-03-13 | 四川长虹电器股份有限公司 | A kind of method that data are in high volume exported in distributed environment |
| CN108737292A (en) * | 2018-04-18 | 2018-11-02 | 千寻位置网络有限公司 | A kind of sending method and system, server of bulk messages |
| CN109542874A (en) * | 2018-11-15 | 2019-03-29 | 用友网络科技股份有限公司 | Deriving method, guiding device, server, terminal and readable storage medium storing program for executing |
| CN109992381A (en) * | 2017-12-30 | 2019-07-09 | 中国移动通信集团四川有限公司 | Process split determination method, device, equipment and medium |
| CN110532311A (en) * | 2019-08-14 | 2019-12-03 | 泰安协同软件有限公司 | A kind of distributed data deriving method and system based on queue |
| CN113177826A (en) * | 2021-05-20 | 2021-07-27 | 青岛海信智慧生活科技股份有限公司 | Method and device for configuring commodities and cells in batch |
| CN114741405A (en) * | 2022-02-17 | 2022-07-12 | 深圳壹账通智能科技有限公司 | Excel data table export method, device, equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7650331B1 (en) * | 2004-06-18 | 2010-01-19 | Google Inc. | System and method for efficient large-scale data processing |
| CN101996067A (en) * | 2009-08-19 | 2011-03-30 | 阿里巴巴集团控股有限公司 | Data export method and device |
| CN103034735A (en) * | 2012-12-26 | 2013-04-10 | 北京讯鸟软件有限公司 | Big data distributed file export method |
| CN103412961A (en) * | 2013-09-04 | 2013-11-27 | 广东全通教育股份有限公司 | Processing method and system for real-time exporting report form of mass data |
| CN103793519A (en) * | 2014-02-14 | 2014-05-14 | 浪潮通信信息系统有限公司 | Automatic tool supporting exportation of mass data |
| CN104715076A (en) * | 2015-04-13 | 2015-06-17 | 东信和平科技股份有限公司 | Multi-threaded data processing method and device |
-
2015
- 2015-08-03 CN CN201510468337.XA patent/CN106407231A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7650331B1 (en) * | 2004-06-18 | 2010-01-19 | Google Inc. | System and method for efficient large-scale data processing |
| CN101996067A (en) * | 2009-08-19 | 2011-03-30 | 阿里巴巴集团控股有限公司 | Data export method and device |
| CN103034735A (en) * | 2012-12-26 | 2013-04-10 | 北京讯鸟软件有限公司 | Big data distributed file export method |
| CN103412961A (en) * | 2013-09-04 | 2013-11-27 | 广东全通教育股份有限公司 | Processing method and system for real-time exporting report form of mass data |
| CN103793519A (en) * | 2014-02-14 | 2014-05-14 | 浪潮通信信息系统有限公司 | Automatic tool supporting exportation of mass data |
| CN104715076A (en) * | 2015-04-13 | 2015-06-17 | 东信和平科技股份有限公司 | Multi-threaded data processing method and device |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106980538A (en) * | 2017-02-16 | 2017-07-25 | 平安科技（深圳）有限公司 | The method and device of data processing |
| WO2018149078A1 (en) * | 2017-02-16 | 2018-08-23 | 平安科技（深圳）有限公司 | Data processing method, apparatus and device, and computer readable storage medium |
| CN107798111A (en) * | 2017-11-01 | 2018-03-13 | 四川长虹电器股份有限公司 | A kind of method that data are in high volume exported in distributed environment |
| CN107798111B (en) * | 2017-11-01 | 2021-04-06 | 四川长虹电器股份有限公司 | Method for exporting data in large batch in distributed environment |
| CN109992381A (en) * | 2017-12-30 | 2019-07-09 | 中国移动通信集团四川有限公司 | Process split determination method, device, equipment and medium |
| CN108737292A (en) * | 2018-04-18 | 2018-11-02 | 千寻位置网络有限公司 | A kind of sending method and system, server of bulk messages |
| CN109542874A (en) * | 2018-11-15 | 2019-03-29 | 用友网络科技股份有限公司 | Deriving method, guiding device, server, terminal and readable storage medium storing program for executing |
| CN110532311A (en) * | 2019-08-14 | 2019-12-03 | 泰安协同软件有限公司 | A kind of distributed data deriving method and system based on queue |
| CN110532311B (en) * | 2019-08-14 | 2023-11-28 | 泰安协同软件有限公司 | Distributed data export method and system based on queues |
| CN113177826A (en) * | 2021-05-20 | 2021-07-27 | 青岛海信智慧生活科技股份有限公司 | Method and device for configuring commodities and cells in batch |
| CN114741405A (en) * | 2022-02-17 | 2022-07-12 | 深圳壹账通智能科技有限公司 | Excel data table export method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106407231A (en) | A data multi-thread export method and system | |
| US9594637B2 (en) | Deploying parallel data integration applications to distributed computing environments | |
| US9619430B2 (en) | Active non-volatile memory post-processing | |
| US8381230B2 (en) | Message passing with queues and channels | |
| US20170180220A1 (en) | Techniques to Generate Workload Performance Fingerprints for Cloud Infrastructure Elements | |
| CN108132838A (en) | Method, device and system for image data processing | |
| CN110321329A (en) | Data processing method and device based on big data | |
| CN105022656B (en) | virtual machine snapshot management method and device | |
| CN108021449A (en) | One kind association journey implementation method, terminal device and storage medium | |
| CN105550040B (en) | CPU resources of virtual machine preservation algorithm based on KVM platform | |
| CN114186693B (en) | A scheduling method, system, device and computer medium for a quantum operating system | |
| CN110209646A (en) | A kind of data platform system calculated based on real-time streaming | |
| CN110471754A (en) | Method for exhibiting data, device, equipment and storage medium in job scheduling | |
| Hu et al. | Improved heuristic job scheduling method to enhance throughput for big data analytics | |
| CN107168795A (en) | Codon deviation factor model method based on CPU GPU isomery combined type parallel computation frames | |
| US20110246582A1 (en) | Message Passing with Queues and Channels | |
| CN107360103A (en) | A kind of Operation ＆ Maintenance System and resource regulating method | |
| CN107528871A (en) | Data analysis in storage system | |
| CN109753357A (en) | The resource and constructing network topology method, equipment, medium of virtual machine management platform | |
| CN102902769A (en) | Database benchmark test system of cloud computing platform and method thereof | |
| CN115794450B (en) | A parallel optimization method, system and medium for microkernel system services | |
| CN103870313A (en) | Virtual machine task scheduling method and system | |
| CN103324577A (en) | Large-scale itemizing file distributing system based on minimum IO access conflict and file itemizing | |
| Tordini et al. | Scientific workflows on clouds with heterogeneous and preemptible instances | |
| CN117271122A (en) | Task processing method, device, equipment and storage medium based on separation of CPU and GPU |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170215 |