CN101615135B - A kind of method and apparatus of smoothed data process - Google Patents
A kind of method and apparatus of smoothed data process Download PDFInfo
- Publication number
- CN101615135B CN101615135B CN200910089782.XA CN200910089782A CN101615135B CN 101615135 B CN101615135 B CN 101615135B CN 200910089782 A CN200910089782 A CN 200910089782A CN 101615135 B CN101615135 B CN 101615135B
- Authority
- CN
- China
- Prior art keywords
- task
- time
- data processing
- execution time
- processing amount
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Stored Programmes (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a kind of method of smoothed data process, comprising: according to the expection execution time of task, and by the data processing amount of fitting function determination task; According to the execution of determined data processing amount control task.Present invention also offers a kind of device of smoothed data process.The present invention, by the prediction to the data processing amount of task, realizes the control to the task processing time, reduces the undulatory property of tasks carrying, is conducive to the stability and the predictability that improve hicap data processing.
Description
Technical field
The present invention relates to the data processing technique of the communications field, particularly relate to a kind of method and apparatus of smoothed data process.
Background technology
In intelligent net system, often need the backstage configuration task in system, carry out the process of user data, as the deletion etc. of logging off users information.In jumbo system, because user data total amount is very large, the time that these tasks expend is often very many, and the load of system also can be very large.In the intelligent net system of commercialization; due to the use habit of user; the date special in the end of month or red-letter day etc. usually can produce a large amount of disposable data; cause the data volume big rise and fall that the system odd-numbered day processes; processing time fluctuation is violent; the system stability that this and commercial system require and predictability produce contradiction, need to take measures level and smooth this fluctuation.
Summary of the invention
In view of this, fundamental purpose of the present invention is the method and apparatus providing a kind of smoothed data process, with the data processing amount in level and smooth intelligent net system and the fluctuation in processing time.
For achieving the above object, technical scheme of the present invention is achieved in that
The invention provides a kind of method of smoothed data process, the method comprises:
According to the expection execution time of task, and by the data processing amount of fitting function determination task;
The execution of described task is controlled according to determined data processing amount;
The expection execution time of described task was determined according to the execution time of the described task of historical record, or was determined by the expection end time of setting of task and the difference of current time;
The expection execution time of described task, in order to the funtcional relationship of data of description treatment capacity and data processing time, accordingly, is substituted into described fitting function by described fitting function, namely obtains expecting with described the data processing amount that the execution time is corresponding.
The method comprises further: the pressure end time presetting task, and in described tasks carrying process, judge whether task execution time exceeds the described pressure end time; When judging that described task execution time exceeds the pressure end time, force to end task.
The method comprises further: at the end of described tasks carrying, the physical end time of logger task, and revises described fitting function according to the physical end time of record.
Present invention also offers a kind of device of smoothed data process, this device comprises:
Data processing amount determination module, for the expection execution time according to task, and by the data processing amount of fitting function determination task;
Tasks carrying control module, for controlling the execution of described task according to determined data processing amount;
Expection execution time of described task by the execution time of historical record, or is determined by the expection end time of setting of task and the difference of current time;
Described fitting function is in order to the funtcional relationship of data of description treatment capacity and data processing time, accordingly, described data processing amount determination module is further used for, and the expection execution time of described task is substituted into described fitting function, obtains expecting with described the data processing amount that the execution time is corresponding.
This device comprises further: judge module, for judging in described tasks carrying process whether task execution time exceeds the predetermined pressure end time, and when judging to exceed, notifies that described tasks carrying control module forces to end task.
This device comprises further: function correcting module, for at the end of described tasks carrying, the physical end time of logger task, the physical end time according to record is revised described fitting function, and revised fitting function is supplied to data processing amount determination module.
The method and apparatus of a kind of smoothed data process provided by the present invention, the time is utilized to predict data processing amount, suitable data processing amount is calculated according to the expection processing time, the object of smoothing processing data can be played, and the control realized the task processing time, the actual treatment of data is expected the processing time around; Propose fitting function, and according to the actual treatment time to carrying out online correction, achieving the self-adaptation of system, reducing the undulatory property of tasks carrying, be conducive to the stability and the predictability that improve hicap data processing.
Accompanying drawing explanation
Fig. 1 is the method flow diagram of a kind of smoothed data process of the present invention;
Fig. 2 is the composition structural representation of the device of a kind of smoothed data process of the present invention.
Embodiment
Below in conjunction with the drawings and specific embodiments, the technical solution of the present invention is further elaborated.
For realizing level and smooth data processing, core concept of the present invention is: according to the expection execution time of task, and by the data processing amount of fitting function determination task, then according to the execution of determined data processing amount control task, thus realize the control to the processing time of task.Wherein, the expection execution time of task, in order to the funtcional relationship of data of description treatment capacity and data processing time, accordingly, is substituted into fitting function, can obtain and expect the data processing amount that the execution time is corresponding by fitting function.Preferably, at the end of tasks carrying, can physical end time of logger task, and according to the physical end time of record, fitting function is revised, the fitting function of correction is applied to follow-up task process; By such cycling, the dynamic self-adapting to fitting function can be realized, to reach the object of the undulatory property reducing tasks carrying.
In actual applications, the expection execution time of task can be the absolute time that user sets, and is namely determined the expection execution time of the task that obtains by the expection end time of task and the difference of current time; Certainly, the expection execution time of task can also be obtained according to certain specific algorithm, such as: the expection execution time determining this subtask according to the execution time of the task of historical record.
Based on above-mentioned thought, the method for a kind of smoothed data process provided by the present invention, as shown in Figure 1, mainly comprises the following steps:
Step 101, the expection end time of setting task.
The expection end time that the task setting that user performs as required is corresponding.
Step 102, obtains the expection end time of task and the difference of current time, is designated as Δ t.
Are subtracted each other the expection end time of setting and current time and obtain Δ t, Δ t is the expection execution time of task, in order to represent span expeced time of tasks carrying.
Step 103, substitutes into fitting function by the expection execution time Δ t obtained, draws data processing amount.
This fitting function is designated as F (), and Δ t, in order to the funtcional relationship of data of description treatment capacity and data processing time, substitutes in F () and can obtain the data processing amount corresponding with Δ t by F ().Wherein, F () can provide an empirical value in the concrete process implemented, and revises in follow-up operation; And F () is not limited only to function, also can be realized by computation processing methods such as processes.
The data processing amount that fitting function F () calculates by the present invention, as the real data treatment capacity of task, and with the actual execution time of this control task, thus improves stability and the predictability of data processing.
Step 104, according to the execution of the data processing amount control task drawn, and the logger task execution time.
Execute the task according to the data processing amount drawn, and when the real data treatment capacity of task reaches above-mentioned data processing amount, control task executable operations terminates.
Step 105, compares the task execution time of record and the pressure end time of presetting, and judges whether task execution time exceeds and forces the end time, if exceeded, then perform step 106; Otherwise, perform step 107.
Step 106, judges that task execution time exceeds and forces the end time, and force to end task, and forward step 107 to.
The present invention forces the end time by setting, when task execution time exceeds the pressure end time of setting, forces to end task, thus realizes definitely controlled to task execution time.
Step 107, at the end of task, the physical end time of logger task, and the physical end time complexity curve fitting function of foundation task.
The time that the physical end time of task and task start when performing is subtracted each other, obtains the actual execution time of task, and according to the actual execution time of task and the funtcional relationship of data processing amount, fitting function is revised.By using actual execution time to carry out dynamic corrections fitting function, the situation of fitting function tracking in time reality can be made, thus the funtcional relationship of more effective fitting data processing time and data processing amount.The dynamic self-adapting correction of fitting function can adopt but be not limited only to the mode of linear fit.
When follow-up tasks carrying, repeat the operation of above-mentioned steps 101 ~ 107, just will use revised fitting function.This shows, by such cycling, the dynamic self-adapting to fitting function can be realized, thus draw the fitting function more tallied with the actual situation, better to reach the object of the undulatory property reducing tasks carrying.
For realizing the method for above-mentioned smoothed data process, the present invention also provides a kind of device of smoothed data process, and as shown in Figure 2, this device comprises: data processing amount determination module 10 and tasks carrying control module 20.Wherein, data processing amount determination module 10, for the expection execution time according to task, and by the data processing amount of fitting function determination task; This fitting function is in order to the funtcional relationship of data of description treatment capacity and data processing time, and accordingly, the expection execution time of task is substituted into fitting function by data processing amount determination module 10, namely obtains and expects the data processing amount that the execution time is corresponding.Tasks carrying control module 20, connection data treatment capacity determination module 10, for the execution according to the determined data processing amount control task of data processing amount determination module 10.
Preferably, this device comprises judge module 30 sum functions correcting module 40 further on the basis of above-mentioned module.Judge module 30, connect tasks carrying control module 20, for judging in task implementation whether task execution time exceeds the predetermined pressure end time, and when judging to exceed, notice tasks carrying control module 20 forces to end task, definitely controlled with what realize task execution time.Function correcting module 40, connection data treatment capacity determination module 10 and tasks carrying control module 20, for at the end of tasks carrying, the physical end time of logger task, the physical end time according to record is revised fitting function, and revised fitting function is supplied to data processing amount determination module 10, thus realize the dynamic self-adapting to fitting function.The dynamic self-adapting correction of fitting function can adopt but be not limited only to the mode of linear fit.
In sum, method and apparatus of the present invention utilizes the time to predict data processing amount, suitable data processing amount is calculated according to the expection processing time, the object of smoothing processing data can be played, and the control realized the task processing time, the actual treatment of data is expected the processing time around; Propose fitting function, and according to the actual treatment time to carrying out online correction, achieving the self-adaptation of system, reducing the undulatory property of tasks carrying, be conducive to the stability and the predictability that improve hicap data processing.
The above, be only preferred embodiment of the present invention, be not intended to limit protection scope of the present invention.
Claims (6)
1. a method for smoothed data process, is characterized in that, the method comprises:
According to the expection execution time of task, and by the data processing amount of fitting function determination task;
The execution of described task is controlled according to determined data processing amount;
The expection execution time of described task was determined according to the execution time of the described task of historical record, or was determined by the expection end time of setting of task and the difference of current time;
The expection execution time of described task, in order to the funtcional relationship of data of description treatment capacity and data processing time, accordingly, is substituted into described fitting function by described fitting function, namely obtains expecting with described the data processing amount that the execution time is corresponding.
2. the method for smoothed data process according to claim 1, is characterized in that, the method comprises further: the pressure end time presetting task, and in described tasks carrying process, judge whether task execution time exceeds the described pressure end time; When judging that described task execution time exceeds the pressure end time, force to end task.
3. the method for smoothed data process according to claim 1, is characterized in that, the method comprises further: at the end of described tasks carrying, the physical end time of logger task, and revises described fitting function according to the physical end time of record.
4. a device for smoothed data process, is characterized in that, this device comprises:
Data processing amount determination module, for the expection execution time according to task, and by the data processing amount of fitting function determination task;
Tasks carrying control module, for controlling the execution of described task according to determined data processing amount;
Expection execution time of described task by the execution time of historical record, or is determined by the expection end time of setting of task and the difference of current time;
Described fitting function is in order to the funtcional relationship of data of description treatment capacity and data processing time, accordingly, described data processing amount determination module is further used for, and the expection execution time of described task is substituted into described fitting function, obtains expecting with described the data processing amount that the execution time is corresponding.
5. the device of smoothed data process according to claim 4, it is characterized in that, this device comprises further: judge module, for judging in described tasks carrying process whether task execution time exceeds the predetermined pressure end time, and when judging to exceed, notify that described tasks carrying control module forces to end task.
6. the device of smoothed data process according to claim 4, it is characterized in that, this device comprises further: function correcting module, for at the end of described tasks carrying, the physical end time of logger task, the physical end time according to record is revised described fitting function, and revised fitting function is supplied to data processing amount determination module.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910089782.XA CN101615135B (en) | 2009-07-23 | 2009-07-23 | A kind of method and apparatus of smoothed data process |
| PCT/CN2010/073664 WO2011009345A1 (en) | 2009-07-23 | 2010-06-08 | Method and device for smoothing data processing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910089782.XA CN101615135B (en) | 2009-07-23 | 2009-07-23 | A kind of method and apparatus of smoothed data process |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101615135A CN101615135A (en) | 2009-12-30 |
| CN101615135B true CN101615135B (en) | 2015-08-12 |
Family
ID=41494793
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200910089782.XA Active CN101615135B (en) | 2009-07-23 | 2009-07-23 | A kind of method and apparatus of smoothed data process |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN101615135B (en) |
| WO (1) | WO2011009345A1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101615135B (en) * | 2009-07-23 | 2015-08-12 | 中兴通讯股份有限公司 | A kind of method and apparatus of smoothed data process |
| CN113296874B (en) * | 2020-05-29 | 2022-06-21 | 阿里巴巴集团控股有限公司 | Task scheduling method, computing device and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1419231A (en) * | 1996-10-15 | 2003-05-21 | 松下电器产业株式会社 | Image coding method and device |
| CN101459605A (en) * | 2008-12-31 | 2009-06-17 | 成都市华为赛门铁克科技有限公司 | Method and device for flow control |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6928398B1 (en) * | 2000-11-09 | 2005-08-09 | Spss, Inc. | System and method for building a time series model |
| JP4071668B2 (en) * | 2003-04-16 | 2008-04-02 | 富士通株式会社 | Apparatus and method for adjusting system resources |
| CN101615135B (en) * | 2009-07-23 | 2015-08-12 | 中兴通讯股份有限公司 | A kind of method and apparatus of smoothed data process |
-
2009
- 2009-07-23 CN CN200910089782.XA patent/CN101615135B/en active Active
-
2010
- 2010-06-08 WO PCT/CN2010/073664 patent/WO2011009345A1/en active Application Filing
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1419231A (en) * | 1996-10-15 | 2003-05-21 | 松下电器产业株式会社 | Image coding method and device |
| CN101459605A (en) * | 2008-12-31 | 2009-06-17 | 成都市华为赛门铁克科技有限公司 | Method and device for flow control |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101615135A (en) | 2009-12-30 |
| WO2011009345A1 (en) | 2011-01-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101785483B1 (en) | Method for acting as service agent, modem and terminal | |
| CN104269885B (en) | Energy feedback control method and energy feedback system | |
| CN102175269B (en) | Sensor device capable of changing sampling frequency and control method thereof | |
| CN104879888A (en) | Device and method for automatically setting parameters of household appliances | |
| KR20210105882A (en) | Comprehensive control method and system that guarantees voltage stability in the power recovery stage of multi-phase DC system | |
| Liu et al. | Congestion tracking control for uncertain TCP/AQM network based on integral backstepping | |
| CN101615135B (en) | A kind of method and apparatus of smoothed data process | |
| CN104613597A (en) | Control method and control device for efficient energy-saving air conditioning unit and air conditioning unit | |
| JP2009005170A5 (en) | ||
| CN115981159B (en) | Generalized improved active disturbance rejection control method based on model-assisted and Smith-like prediction | |
| CN108006911B (en) | Humidification control method and system, air conditioner, computing equipment and storage medium | |
| CN105786152A (en) | Control method and electronic device | |
| CN116566435A (en) | Intelligent cable monitoring method and system for dynamically waking up acquisition node | |
| CN110925936A (en) | Air conditioner control method and device, computer equipment and storage medium | |
| CN106532782A (en) | Operation optimization method and device of combined heat and power generation unit for improving wind power utilization rate | |
| CN104615349A (en) | Information processing method and electronic device | |
| CN104753081B (en) | A kind of method and apparatus for controlling micro-capacitance sensor power supply | |
| CN110311947B (en) | A method and system for pushing information on the proportion of electricity consumption of new energy | |
| CN109948119B (en) | Main steam regulating valve nonlinear identification method based on Bottom-Up algorithm | |
| CN114173197A (en) | Standby method and standby time control system of network set top box | |
| CN106598198A (en) | Multi-period dynamic power management method | |
| CN113794537A (en) | Sensing network in power Internet of things and self-adaptive dynamic sampling method and device thereof | |
| CN103324998B (en) | For obtaining the sensor deployment method and apparatus of energy information | |
| CN116700000B (en) | Predictive control method for hybrid energy storage system | |
| CN111880847B (en) | Self-adjusting method, device, equipment and storage medium for working state of terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |