[go: up one dir, main page]

CN103699495A - Transmission device and transmission system for splitting data - Google Patents

Transmission device and transmission system for splitting data Download PDF

Info

Publication number
CN103699495A
CN103699495A CN201310741620.6A CN201310741620A CN103699495A CN 103699495 A CN103699495 A CN 103699495A CN 201310741620 A CN201310741620 A CN 201310741620A CN 103699495 A CN103699495 A CN 103699495A
Authority
CN
China
Prior art keywords
cutting
file
data
data file
decentralized
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201310741620.6A
Other languages
Chinese (zh)
Inventor
于凤东
张磊
马一鸣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
LeTV Cloud Computing Co Ltd
Original Assignee
LeTV Information Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by LeTV Information Technology Beijing Co Ltd filed Critical LeTV Information Technology Beijing Co Ltd
Priority to CN201310741620.6A priority Critical patent/CN103699495A/en
Publication of CN103699495A publication Critical patent/CN103699495A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a transmission device and a transmission system for splitting data. By the aid of the transmission device and the transmission system, transmission errors caused when data files are split or are written into disk arrays can be prevented. The transmission device comprises a receiving module, a memory module, a distributed file device and a processing module; the receiving module is used for receiving the data files of a client; the memory module is connected to the receiving module and is used for storing the data files; the distributed file device is used for storing target files; the processing module is connected with the receiving module, the memory module and the distributed file device and generates a plurality of internal queues, each internal queue is used for storing path information of the corresponding data file, the data files are split into a plurality of split sections by the processing module according to the path information of the internal queues, and the split sections are parallelly read by the processing module and are written into the target files in the distributed file device.

Description

The transmitting device of data cutting and system
Technical field
The application relates to the system of data transmission, is specifically related to a kind of transmitting device and system of data cutting.
Background technology
Along with the Fast Growth of network traffics, many services that are not easy in the past to realize also can be completed easily.For example: broadband upload multimedia file (multimedia file).Because the transmission of magnanimity still can affect the load of local side.Therefore at known multimedia local side, also can possess the function of Bandwidth Management (Bandwidth Manager).Local side can see through the modes such as bandwidth distribution or buffer memory and alleviate the data transmission amount of same time.
In addition, described transmission mode more combines a plurality of entity disks, and what make that data can be synchronous writes in described disk.And prior art writes the mode of disk to data, be that the synchronous origin source of data is write in local side.Local side can be kept in these data files.Afterwards, local side by these data files in batches write entity disk.
Realizing of this mode writing is with low cost and quick.If but in the process that data write, make a mistake, data can only write again.Therefore the time that data are transmitted again will be elongated, and can increase the load of the network bandwidth.In addition, same one data file is except will being again written into from client, and will again transmit in local side inside, also can cause the time that data are transmitted again to be elongated, and increases the load of the network bandwidth.
Summary of the invention
The application's technical matters to be solved is to provide a kind of transmitting device of data cutting, avoids data file to make a mistake when writing disk array, causes again transmission data file and extends data storages and transmission time, emphasizer bandwidth load.
In order to address the above problem, the transmitting device that the application has disclosed a kind of data cutting comprises: receiver module, for receiving the data file of client; Memory modules, is connected in described receiver module, and described memory modules is for storing data files; Decentralized file device, for storing file destination; Processing module, be connected in described receiver module, described memory modules and described decentralized file device, described processing module is that the data file that receiver module receives creates corresponding internal queues, and described in each, internal queues is for storing the path information of corresponding data file; Described processing module, also, for being a plurality of cutting fragments according to the path information of internal queues by described data file cutting, walking abreast and reads each cutting fragment and described each cutting fragment is write respectively to the file destination in decentralized file device.
Comprise that further described receiver module sees through internet network or Local Area Network is connected in client.
Comprise that further described processing module is also for generating a plurality of worker threads, the quantity of described worker thread is identical with the quantity of the cutting fragment of corresponding data file; By each worker thread is parallel, reads each cutting fragment and described each cutting fragment is write to the file destination in decentralized file device simultaneously.
Described processing module further monitors whether described internal queues and described data file have unusual fluctuation further.
The kind that comprises further decentralized file device comprises: disk, tape or the network storage equipment.
In order to address the above problem, the application has disclosed a kind of transmission system of data cutting, comprising: client, for uploading data file; Local side, see through internet network or Local Area Network and be connected in client, described local side comprises decentralized file device, described local side is that the described data file receiving creates corresponding internal queues, and the described data file receiving is stored in described internal queues, described local side, after data file cutting is a plurality of cutting fragments, walks abreast and reads described cutting fragment and described cutting fragment is write to the file destination in described decentralized file device simultaneously.
Comprise further at least one heartbeat server, described heartbeat server is connected in described local side, and described local side sends heartbeat requirement to heartbeat server, and described heartbeat server sends response message to described local side.
Comprise further the described heartbeat requirement that is received from described control module in turn of described heartbeat server.
Comprise that further described local side records reference position and the side-play amount of each cutting fragment of described data file.
Compared with prior art, the application can obtain and comprise following technique effect:
1) the application improves the transmitting procedure of data file, if data file is write fashionable making a mistake, the application does not need again from client, to obtain data file.
2), if the application makes a mistake in during transmission data file, the application can see through at least one heartbeat server and transmit messages to backstage personnel, make that backstage personnel can be real-time to learn that what assembly occurs abnormal.
Certainly, arbitrary product of enforcement the application must not necessarily need to reach above-described all technique effects simultaneously.
Accompanying drawing explanation
Accompanying drawing described herein is used to provide further understanding of the present application, forms the application's a part, and the application's schematic description and description is used for explaining the application, does not form the improper restriction to the application.In the accompanying drawings:
Figure 1A is the system architecture schematic diagram of the embodiment of the present application.
Figure 1B is the local side configuration diagram of the embodiment of the present application.
Fig. 2 is the operation workflow schematic diagram of the embodiment of the present application.
Embodiment
To coordinate drawings and Examples to describe the application's embodiment in detail below, by this application's implementation procedure how application technology means solve technical matters and reach technology effect can be fully understood and be implemented according to this.
As used some vocabulary in the middle of instructions and claim, censure specific components.Those skilled in the art should understand, and hardware manufacturer may be called same assembly with different nouns.This specification and claims are not used as distinguishing the mode of assembly with the difference of title, but the difference in function is used as the criterion of distinguishing with assembly.If " comprising " mentioned in the middle of instructions and claim is in the whole text an open language, therefore should be construed to " comprise but be not limited to "." roughly " refer to that in receivable error range, those skilled in the art can solve the technical problem within the scope of certain error, reach described technique effect substantially.In addition, " couple " word and comprise directly any and electric property coupling means indirectly at this.Therefore, if describe a first device in literary composition, be coupled to one second device, represent that described first device can directly be electrically coupled to described the second device, or be indirectly electrically coupled to described the second device by other devices or the means that couple.Instructions subsequent descriptions is for implementing the application's better embodiment, and right described description is to illustrate that the application's rule is object, not in order to limit the application's scope.The application's protection domain is when being as the criterion depending on the claims person of defining.
Transmission system and the device of the application's data cutting, please refer to 1A and 1B figure.The application's transmission system comprises: client 110, see through internet network or Local Area Network is connected in client 110 local sides 120 and many heartbeat servers 130.
Client 110 is for uploading data file.Local side 120 is connected in client 110, described local side 120 comprises decentralized file device, described local side 120 is stored in the described data file receiving in internal queues, described local side 120 is a plurality of cutting fragments by data file cutting, the parallel file destination that reads described cutting fragment and described cutting fragment is write to decentralized file device simultaneously of described local side 120.Described local side is preferably storage server.The kind of described decentralized file device comprises: disk, tape or the network storage equipment.
The application's local side 120 is consisted of following hardware: receiver module 121, memory modules 122, processing module 123 and decentralized file device 124.
Receiver module 121, for receiving the data file of client 110;
Memory modules 122, is connected in described receiver module 121, and described memory modules 122 is for storing data files;
Decentralized file device 124, for storing file destination;
Processing module 123, be connected in described receiver module 121, described memory modules 122 and described decentralized file device 124, the data file that described processing module 123 receives for receiver module 121 creates corresponding internal queues, and described in each, internal queues is for storing the path information of corresponding data file;
Described processing module 123, also, for being a plurality of cutting fragments according to the path information of internal queues by described data file cutting, walking abreast and read each cutting fragment and described each cutting fragment is write respectively to the file destination in decentralized file device 124.
Described processing module 123, also for generating a plurality of worker threads, the quantity of described worker thread is identical with the quantity of the cutting fragment of corresponding data file; By each worker thread is parallel, reads each cutting fragment and described each cutting fragment is write to the file destination in decentralized file device 124 simultaneously.
Described processing module 123, is further used for monitoring whether described internal queues and described data file have unusual fluctuation.
For further explaining the function mode of processing module 123 of the application's local side 120, therefore more for processing module 123, according to different functions, mark off following functional module, please coordinate shown in 1B figure: local directory 210, control module 220, upper transmission module 230, scan module 240, queue monitor module 250 and worker thread 260.
Local directory 210, the data file that temporary client 110 sends;
Control module 220, is connected in local directory 210, and control module 220 is for generation of at least one internal queues, the path information of internal queues storage data file;
Upper transmission module 230, is connected in local directory 210 and control module 220;
Scan module 240, is connected in local directory 210 and control module 220;
Queue monitor module 250, is connected in control module 220, and queue monitor module 250 produces the queue monitor module 250 of respective amount, the cutting quantity of queue monitor module 250 determination data files according to the quantity of internal queues;
Worker thread 260, worker thread 260 under each queue monitor module 250 is connected in, the quantity of worker thread 260 is equal to cutting quantity, worker thread 260 is a plurality of cutting fragments according to cutting quantity data file cutting, and worker thread 260 reads the data of cutting fragment according to the position of cutting fragment.
For can be simply and whole function mode is clearly described, therefore the first heartbeat server 131 and the second heartbeat server 132 be set in this application.But in fact the quantity of heartbeat server 130 can determine according to factors such as the service ability of local side 120, bandwidth or securities.
Control module 220 is connected in scan module 240, upper transmission module 230, queue monitor module 250, the first heartbeat server 131 and the second heartbeat server 132.Each local directory 210 can be deposited data file separately.For example: video file can be stored puts video local directory, and promotional literature is put as in advertisement local directory.Generally speaking, the data file that local directory meeting reception client 110 regularly sends.To some extent whether the file in scan module 240 supervision local directories unusual fluctuation.Described file unusual fluctuation refers to increasing newly, move, revise or deleting of data.File in local directory during unusual fluctuation, is gone up transmission module 230 and the data file of unusual fluctuation will be passed to control module 220 in the path in local side 120 to some extent.
In addition the kind of document of the data file of upper transmission module 230 detecting local directory institutes unusual fluctuation.Described in the broadest sense kind of document may be audio file, movie file or text file etc.Furthermore, audio file may be subdivided into mp3, m4a, AAC or ARM etc. again; Movie file can be subdivided into mov, flv, m4v, mkv or mp4 etc. again.
If while there is not the internal queues of kind of data file in control module 220, upper transmission module 230 can generate new internal queues by drive control modules 220.Thereafter, if there is the data file of one species to be written into, upper transmission module 230 can be put into corresponding internal queues by the data file being newly written into.
Control module 220 can be classified successively and produce each self-corresponding internal queues according to received file path, and different internal queues can assign different queue monitor modules 250 to process.In the 1st figure, be to using the first internal queues, the second internal queues and the 3rd internal queues as signal.The cutting information of the file under each queue monitor module 250 can record.When described cutting information refers to file and is uploaded to local directory, file size is unusual fluctuation thereupon also.Before data file cutting, queue monitor module 250 is first taken out correct element (first element of queue) from first internal queues, then just carries out cutting.And being mode according to first in first out (First In FirstOut, FIFO), the data taking-up mode of internal queues realizes.
Correct element is a character string, such as being " data/ad/ad.log ".Queue monitor module 250 is understood pre-generating object file after taking correct element, and can obtain the size of file destination.According to file size, judgement should be cut into how many cutting fragments to queue monitor module 250.Generally speaking, cutting fragment comprises three information to I haven't seen you for ages: 1. pathname (being aforesaid " data/ad/ad.log " in the application), 2. reference position, 3. end position.
250 pairs of files of queue monitor module carry out isometric cutting.After the cutting that completes file, the fragment of each file cutting is defined as cutting fragment (slice).The stacking quantity of the internal queues under 250 detectings of queue monitor module surpasses upper prescribing a time limit, and queue monitor module 250 can be sent warning message to the first heartbeat server 131 and the second heartbeat server 132.
And the quantity of cutting fragment is to determine according to the performance of local side 120.For example: 1 worker thread can be processed 50,000,000 cutting fragment, the data file of 200,000,000 is distributed to 4 worker threads processing so.In like manner, 500,000,000 data file, can distribute to 10 worker threads and process.
The relevent information recording during for cutting is called cutting information.For example, each cutting length during cutting and the side-play amount in disk (offset) of document location.When scan module 240 finds that the data file in local directory is deleted, scan module 240 can be deleted the corresponding internal queues in control module 220.
Then, different cutting fragments can be assigned each self-corresponding worker thread 260, as the data file that reads local directory.The realization of worker thread 260 can be realized by different program languages.Do not limit in this application the kind of program language, for example, JAVA language or ASP language.In fact, queue monitor module 250 is the data file of local directory to be carried out to the estimation of cutting, in order to obtain each position that should be split of described data file.And in fact carry out file cutting processing to as if by queue monitor module 250, realized.Queue monitor module 250 is understood according to the length of cutting fragment after obtaining cutting fragment, and divides and task the affiliated partial document data of worker thread 260.Worker thread 260 is writing the data file of described part in decentralized file device 124.
Generally speaking, the first heartbeat server 131 or the second heartbeat server 132 surpass one default during after do not receive heartbeat requirement, heartbeat server can be to sending warning message.But when worker thread 260 makes a mistake in the process writing.Worker thread 260 can send warning message to the first heartbeat server 131 and the second heartbeat server 132.Described worker thread 260 also can be notified other worker threads 260 with the time, requires other worker threads 260 to stop the processing that writes to decentralized file device 124, uses the data integrity of avoiding in decentralized file device 124.
At this, function mode of aforementioned each assembly is represented with following step, please coordinate shown in the 2nd figure:
Step S210: detected the unusual fluctuation of the data file of local directory by scan module;
Step S220: if the unusual fluctuation to some extent of the data file of local directory, upper transmission module is obtained the pathname of the data file of unusual fluctuation;
Step S230: produce internal queues, and data file is inserted in internal queues;
Step S240: whether the volume of services of monitoring internal queues is greater than preset pressure threshold values;
Step S250: if volume of services is greater than preset pressure threshold values, sent a warning by heartbeat server;
Step S260: if volume of services is less than preset pressure threshold values, the quantity of the cutting fragment of determination data file;
Step S270: configure a plurality of worker threads, worker thread is obtained data file from internal queues, and worker thread carries out cutting according to the quantity of cutting fragment to data file;
Step S280: read cutting fragment, and monitor cutting fragment whether write decentralized file device correct; And
Step S290: if the cutting sheet core dumped writing, worker thread can send warning requirement to heartbeat server.
Local directory comes from the data file of client 110 except receiving, and the data file in local directory also may be modified, move or the unusual fluctuation such as deletion.Whether the data file that queue monitor module 250 is understood in real-time detecting local directory has.When data file unusual fluctuation, queue monitor module 250 upwards transmission module 230 is sent the message of data file unusual fluctuation.Upper transmission module 230 is obtained after the message of data file unusual fluctuation, and upper transmission module 230 can again be obtained the pathname of data file and pathname is stored in internal queues.For different data files, unique internal queues can be set.
When local directory stores a large amount of data files, the quantity of the internal queues in control module 220 also can be grown up fast.Because too much internal queues can cause excessive stackingly, can make those data files of handling that worker thread 260 cannot be instant.Whether the volume of services that therefore the application can monitor internal queues is over the preset pressure threshold values of setting.When volume of services surpasses preset pressure threshold values, control module 220 can be sent warning requirement to the first heartbeat server 131 or the second heartbeat server 132.
Then, according to the quantity of cutting fragment, produce corresponding worker thread 260.The reference position of each worker thread 260 basis cutting fragment separately and the Partial Fragment that side-play amount obtains data file, and the fragment obtaining is write to the file destination in decentralized file device 124.If while there is not file destination in decentralized file device 124, worker thread 260 can be set up the file destination of corresponding data file.In writing the process of file destination, may make a mistake, so the application is when detecting the content of the cutting fragment writing when wrong, can send warning requirement to the first heartbeat server 131 or the second heartbeat server 132.
Also it should be noted that, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thereby the process, method, commodity or the system that make to comprise a series of key elements not only comprise those key elements, but also comprise other key elements of clearly not listing, or be also included as the intrinsic key element of this process, method, commodity or system.The in the situation that of more restrictions not, the key element being limited by statement " comprising ... ", and be not precluded within process, method, commodity or the system that comprises described key element and also have other identical element.
The application, except the implementation of aforesaid software view, also can see through the processing that described hardware carries out aforesaid data cutting and transmission.Receiver module can receive the data file that client 110 is uploaded.
The embodiment that it will be understood by those skilled in the art that the application can be provided as method, system or computer program.Therefore, the application can adopt complete hardware implementation example, implement software example or in conjunction with the form of the embodiment of software and hardware aspect completely.And the application can adopt the form that wherein includes the upper computer program of implementing of computer-usable storage medium (including but not limited to magnetic disk memory, CD-ROM, optical memory etc.) of computer usable program code one or more.
The embodiment that the foregoing is only the application, is not limited to the application.To those skilled in the art, the application can have various modifications and variations.Any modification of doing within all spirit in the application and principle, be equal to replacement, improvement etc., within all should being included in the application's claim scope.

Claims (9)

1. a transmitting device for data cutting, is characterized in that, comprising:
Receiver module, for receiving the data file of client;
Memory modules, is connected in described receiver module, and described memory modules is for storing data files;
Decentralized file device, for storing file destination; And
Processing module, be connected in described receiver module, described memory modules and described decentralized file device, described processing module is that the data file that receiver module receives creates corresponding internal queues, and described in each, internal queues is for storing the path information of corresponding data file;
Described processing module, also, for being a plurality of cutting fragments according to the path information of internal queues by described data file cutting, walking abreast and reads each cutting fragment and described each cutting fragment is write respectively to the file destination in decentralized file device.
2. the transmitting device of data cutting as claimed in claim 1, is characterized in that, described receiver module sees through internet network or Local Area Network is connected in client.
3. the transmitting device of data cutting as claimed in claim 1, is characterized in that, described processing module, and also for generating a plurality of worker threads, the quantity of described worker thread is identical with the quantity of the cutting fragment of corresponding data file; By each worker thread is parallel, reads each cutting fragment and described each cutting fragment is write to the file destination in decentralized file device simultaneously.
4. the transmitting device of data cutting as claimed in claim 1, is characterized in that, described processing module further monitors whether described internal queues and described data file have unusual fluctuation.
5. the transmitting device of data cutting as claimed in claim 1, is characterized in that, the kind of described decentralized file device comprises: disk, tape or the network storage equipment.
6. a transmission system for data cutting, is characterized in that comprising:
Client, for uploading data file; And
Local side as described in claim 1~5 any one, see through internet network or Local Area Network and be connected in client, described local side comprises decentralized file device, described local side is that the described data file receiving creates corresponding internal queues, and the described data file receiving is stored in described internal queues, described local side, after data file cutting is a plurality of cutting fragments, walks abreast and reads described cutting fragment and described cutting fragment is write to the file destination in described decentralized file device simultaneously.
7. the transmission system of data cutting as claimed in claim 6, is characterized in that, described local side is also for generating a plurality of worker threads, and the quantity of described worker thread is identical with the quantity of the cutting fragment of corresponding data file; By each worker thread is parallel, reads each cutting fragment and described each cutting fragment is write to the file destination in decentralized file device simultaneously.
8. the transmission system of data cutting as claimed in claim 6, is characterized in that, the kind of described decentralized file device comprises: disk, tape or the network storage equipment.
9. the transmission system of data cutting as claimed in claim 6, is characterized in that, described local side is storage server.
CN201310741620.6A 2013-12-27 2013-12-27 Transmission device and transmission system for splitting data Pending CN103699495A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310741620.6A CN103699495A (en) 2013-12-27 2013-12-27 Transmission device and transmission system for splitting data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310741620.6A CN103699495A (en) 2013-12-27 2013-12-27 Transmission device and transmission system for splitting data

Publications (1)

Publication Number Publication Date
CN103699495A true CN103699495A (en) 2014-04-02

Family

ID=50361030

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310741620.6A Pending CN103699495A (en) 2013-12-27 2013-12-27 Transmission device and transmission system for splitting data

Country Status (1)

Country Link
CN (1) CN103699495A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105528371A (en) * 2014-09-30 2016-04-27 北京金山云网络技术有限公司 Method, device, and system for executing writing task
CN108038126A (en) * 2017-11-08 2018-05-15 中国平安人寿保险股份有限公司 Method, apparatus, terminal device and storage medium derived from a kind of data
WO2019062079A1 (en) * 2017-09-28 2019-04-04 平安科技(深圳)有限公司 Tag library-based segmentation method for service objects, electronic device and storage medium
CN110019008A (en) * 2017-11-03 2019-07-16 北京金山安全软件有限公司 Data storage method and device
CN110806942A (en) * 2019-11-08 2020-02-18 广州华多网络科技有限公司 Data processing method and device
CN111475305A (en) * 2020-05-06 2020-07-31 智博云信息科技(广州)有限公司 Big data processing method and system based on cloud platform multithreading
CN112925772A (en) * 2019-12-06 2021-06-08 北京沃东天骏信息技术有限公司 Data dynamic splitting method and device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1434606A (en) * 2002-01-24 2003-08-06 华为技术有限公司 Data segmenting and reloading method in ATM communication system
US8150827B2 (en) * 2006-06-07 2012-04-03 Renew Data Corp. Methods for enhancing efficiency and cost effectiveness of first pass review of documents
CN102790771A (en) * 2012-07-25 2012-11-21 山东中创软件商用中间件股份有限公司 File transmission method and system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1434606A (en) * 2002-01-24 2003-08-06 华为技术有限公司 Data segmenting and reloading method in ATM communication system
US8150827B2 (en) * 2006-06-07 2012-04-03 Renew Data Corp. Methods for enhancing efficiency and cost effectiveness of first pass review of documents
CN102790771A (en) * 2012-07-25 2012-11-21 山东中创软件商用中间件股份有限公司 File transmission method and system

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105528371A (en) * 2014-09-30 2016-04-27 北京金山云网络技术有限公司 Method, device, and system for executing writing task
CN105528371B (en) * 2014-09-30 2019-06-07 北京金山云网络技术有限公司 A kind of method, apparatus and system executing writing task
WO2019062079A1 (en) * 2017-09-28 2019-04-04 平安科技(深圳)有限公司 Tag library-based segmentation method for service objects, electronic device and storage medium
CN110019008A (en) * 2017-11-03 2019-07-16 北京金山安全软件有限公司 Data storage method and device
CN108038126A (en) * 2017-11-08 2018-05-15 中国平安人寿保险股份有限公司 Method, apparatus, terminal device and storage medium derived from a kind of data
CN108038126B (en) * 2017-11-08 2021-03-02 中国平安人寿保险股份有限公司 Data export method, device, terminal equipment and storage medium
CN110806942A (en) * 2019-11-08 2020-02-18 广州华多网络科技有限公司 Data processing method and device
CN110806942B (en) * 2019-11-08 2024-05-07 广州华多网络科技有限公司 Data processing method and device
CN112925772A (en) * 2019-12-06 2021-06-08 北京沃东天骏信息技术有限公司 Data dynamic splitting method and device
CN111475305A (en) * 2020-05-06 2020-07-31 智博云信息科技(广州)有限公司 Big data processing method and system based on cloud platform multithreading
CN111475305B (en) * 2020-05-06 2020-11-17 睿智合创(北京)科技有限公司 Big data processing method and system based on cloud platform multithreading

Similar Documents

Publication Publication Date Title
CN103699495A (en) Transmission device and transmission system for splitting data
CN103701907A (en) Processing method and system for continuing to transmit data in server
US10917260B1 (en) Data management across cloud storage providers
US20090010610A1 (en) System and method of recording media content
US20040215673A1 (en) Storage sub-system and management program
US20190188086A1 (en) Redundancy reduction in blockchains
CN103678699A (en) Method and system for merging data in server
CN109885577A (en) Data processing method, device, terminal and storage medium
US11315605B2 (en) Method, device, and computer program product for storing and providing video
CN103699666A (en) Transmission method and transmission device for splitting data
CN102456049A (en) Data migration method and device and object-oriented distributed file system
CN103701667A (en) Method, device and system for monitoring heartbeat of server
US10082977B2 (en) Storing data in storage area
CN112865927B (en) Message delivery verification method, device, computer equipment and storage medium
CN103685559A (en) Method and system for processing data in server
US11323764B2 (en) Caching recorded content segments on playback
CN103684929A (en) System and method for monitoring server status
US9866619B2 (en) Transmission of hierarchical data files based on content selection
CN112181975B (en) Method and apparatus for creating a database in a data warehouse
US11811894B2 (en) Reduction of data transmissions based on end-user context
US8908485B2 (en) Extended diagnostic overlay control for tape storage devices
AU2020226900B2 (en) Adaptive retrieval of objects from remote storage
US20140181281A1 (en) Connecting network management systems
KR101426382B1 (en) Method for data recovery using pipeline in distributed file system
US11086932B1 (en) Asset-level management of media recording in cloud DVR systems

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C41 Transfer of patent application or patent right or utility model
TA01 Transfer of patent application right

Effective date of registration: 20151229

Address after: Room six, building 19, building 68, No. 100089 South Road, Haidian District, Beijing

Applicant after: LETV CLOUD COMPUTING CO., LTD.

Address before: Room six, building 19, building 68, No. 100089 South Road, Haidian District, Beijing

Applicant before: LeTV Information Technology (Beijing) Co., Ltd.

AD01 Patent right deemed abandoned

Effective date of abandoning: 20200414

AD01 Patent right deemed abandoned