WO2023024679A1 - Method and apparatus for predicting server capacity - Google Patents
Method and apparatus for predicting server capacity Download PDFInfo
- Publication number
- WO2023024679A1 WO2023024679A1 PCT/CN2022/100509 CN2022100509W WO2023024679A1 WO 2023024679 A1 WO2023024679 A1 WO 2023024679A1 CN 2022100509 W CN2022100509 W CN 2022100509W WO 2023024679 A1 WO2023024679 A1 WO 2023024679A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- tps
- historical
- period
- predicted
- statistical dimension
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
- G06F9/505—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load
Definitions
- the embodiments of the present invention relate to the technical field of financial technology, and in particular to a method, device, computing device, and computer-readable storage medium for predicting server capacity.
- the server capacity is manually adjusted by manually observing the server load changes or monitoring system alarms (network congestion or crash of the server), which easily leads to misoperation and is less intelligent.
- the embodiments of the present invention provide a method for predicting server capacity, which is used to improve the accuracy of server capacity prediction, so as to flexibly adjust the server capacity.
- An embodiment of the present invention provides a method for predicting server capacity, which is used to improve the accuracy of server capacity prediction, thereby flexibly adjusting the server capacity.
- an embodiment of the present invention provides a method for predicting server capacity, including:
- each statistical dimension predict the predicted transaction volume per second TPS of each statistical dimension in each forecast period, and superimpose the predicted TPS of the same forecast period in each statistical dimension to obtain the superposition forecast of the business system in each forecast period TPS;
- the conversion relationship is the TPS of the business system in each historical period
- the relationship between the superimposed historical TPS and the credible historical TPS is obtained by analyzing the relationship;
- the superimposed historical TPS is obtained by superimposing the historical TPS of the same historical period in each statistical dimension;
- the credible historical TPS is obtained by analyzing the business system in It is obtained by analyzing the TPS of each historical period;
- the server capacity of the service system in each forecast period is determined through the credible predicted TPS of the service system in each forecast period.
- the change rules are different, so by analyzing the historical activity of each historical period in different statistical dimensions in the business system, we can get The regular characteristics of the historical activity of each statistical dimension in each historical period can more accurately predict the predicted TPS of each statistical dimension in each forecast period. Then, by superimposing the predicted TPS of different statistical dimensions, the superimposed predicted TPS of the entire business system can be further determined. The superimposed predicted TPS obtained in this way can more accurately reflect the changing rules of different statistical dimensions in each forecast period.
- the conversion relationship between the two is determined, and the credible predicted TPS is obtained according to the conversion relationship and the superimposed predicted TPS.
- the credible predicted TPS is more accurate. Therefore, the server capacity of the business system in each forecast period can be accurately predicted.
- the historical activity of any statistical dimension in each historical period is obtained by the following methods, including:
- the quotient of the historical TPS of the statistical dimension in each historical period and the number of first accounts in each historical period is determined as the historical activity of the statistical dimension in each historical period.
- determining the regular characteristics conforming to the historical activity of the statistical dimension in each historical period includes:
- a fitting curve corresponding to each preset function conforming to a preset condition is determined as a regular feature.
- determining the regular characteristics conforming to the historical activity of the statistical dimension in each historical period includes:
- the historical activity of the statistical dimension in each historical period is segmented into intervals;
- the floating coefficient of each historical activity in the interval segment is determined as the regular feature of the interval segment; the floating coefficient is determined according to the floating ratio of each historical activity; The floating ratio is the ratio of the difference between the highest value of historical activity and the lowest value of historical activity in the interval segment to the lowest value of historical activity.
- predict the predicted TPS of each statistical dimension in each prediction period through the regular characteristics of each statistical dimension including:
- the product of the forecast activity of each statistical dimension in each forecast period and the second account number in the same forecast period is determined as the predicted TPS of each statistical dimension in each forecast period.
- determining the server capacity of the business system in each forecast period through the trusted predicted TPS of the business system in each forecast period including:
- the server capacity of the service system in each forecast period is determined through the trusted forecast TPS and the stand-alone TPS.
- determining the server capacity of the business system in each prediction period through the trusted predicted TPS and the stand-alone TPS includes:
- the first range of server capacity is determined according to the following formula:
- T max is the trusted predicted TPS
- N is the server capacity
- s is the maximum failure time of a single physical machine
- n is the number of servers deployed on a single physical machine
- B is the transaction loss threshold once ;
- the server capacity is determined within the first range of server capacities.
- determining the server capacity of the business system in each prediction period through the trusted predicted TPS and the stand-alone TPS includes:
- the second range of server capacity is determined according to the following formula:
- the L computer room is the number of computer rooms of the business system, and the T stand-alone is the single-machine TPS;
- the server capacity is determined within the first range of server capacities and the second range of server capacities.
- determining the server capacity of the business system in each prediction period through the trusted predicted TPS and the stand-alone TPS includes:
- the third range of server capacity is determined according to the following formula:
- ⁇ is the highest load rate
- the server capacity is determined within the first range of server capacities and the third range of server capacities.
- the embodiment of the present invention also provides an apparatus for predicting server capacity, including:
- each statistical dimension predict the predicted transaction volume per second TPS of each statistical dimension in each forecast period, and superimpose the predicted TPS of the same forecast period in each statistical dimension to obtain the superposition forecast of the business system in each forecast period TPS;
- the conversion relationship is the TPS of the business system in each historical period
- the relationship between the superimposed historical TPS and the credible historical TPS is obtained by analyzing the relationship;
- the superimposed historical TPS is obtained by superimposing the historical TPS of the same historical period in each statistical dimension;
- the credible historical TPS is obtained by analyzing the business system in It is obtained by analyzing the TPS of each historical period;
- the server capacity of the service system in each forecast period is determined through the credible predicted TPS of the service system in each forecast period.
- the determining unit is specifically configured to:
- the quotient of the historical TPS of the statistical dimension in each historical period and the number of first accounts in each historical period is determined as the historical activity of the statistical dimension in each historical period.
- the determining unit is specifically configured to:
- a fitting curve corresponding to each preset function conforming to a preset condition is determined as a regular feature.
- the determining unit is specifically configured to:
- the historical activity of the statistical dimension in each historical period is segmented into intervals;
- the floating coefficient of each historical activity in the interval segment is determined as the regular feature of the interval segment; the floating coefficient is determined according to the floating ratio of each historical activity; The floating ratio is the ratio of the difference between the highest value of historical activity and the lowest value of historical activity in the interval segment to the lowest value of historical activity.
- the determining unit is specifically configured to:
- the product of the forecast activity of each statistical dimension in each forecast period and the second account number in the same forecast period is determined as the predicted TPS of each statistical dimension in each forecast period.
- the determining unit is specifically configured to:
- the server capacity of the service system in each forecast period is determined through the trusted forecast TPS and the stand-alone TPS.
- the determining unit is specifically configured to:
- the first range of server capacity is determined according to the following formula:
- T max is the trusted predicted TPS
- N is the server capacity
- s is the maximum failure time of a single physical machine
- n is the number of servers deployed on a single physical machine
- B is the transaction loss threshold once ;
- the server capacity is determined within the first range of server capacities.
- the determining unit is specifically configured to:
- the second range of server capacity is determined according to the following formula:
- the L computer room is the number of computer rooms of the business system, and the T stand-alone is the single-machine TPS;
- the server capacity is determined within the first range of server capacities and the second range of server capacities.
- the determining unit is specifically configured to:
- the third range of server capacity is determined according to the following formula:
- ⁇ is the highest load rate
- the server capacity is determined within the first range of server capacities and the third range of server capacities.
- an embodiment of the present invention also provides a computing device, including:
- the processor is configured to call the computer program stored in the memory, and execute the method for predicting server capacity listed in any of the above-mentioned ways according to the obtained program.
- the embodiment of the present invention also provides a computer-readable storage medium, the computer-readable storage medium stores a computer-executable program, and the computer-executable program is used to make the computer execute any of the methods listed above.
- a method for predicting server capacity is used to make the computer execute any of the methods listed above.
- FIG. 1 is a method for predicting server capacity provided by an embodiment of the present invention
- Fig. 2A is a schematic diagram of the historical activity of a possible Taobao account related to withdrawing money provided by an embodiment of the present invention
- Fig. 2B is a schematic diagram of the historical activity of a possible Taobao account related to the withdrawal of funds provided by the embodiment of the present invention
- Fig. 3A is a schematic diagram of the daily consumption day historical activity of a Taobao account in each historical period of withdrawal provided by an embodiment of the present invention
- Fig. 3B is a schematic diagram of the predicted activity of a Taobao account on the daily consumption day of each forecast period for withdrawal provided by an embodiment of the present invention
- FIG. 3C is a schematic diagram of the historical activity of a Taobao account on special holidays in various historical periods of withdrawal provided by an embodiment of the present invention
- Fig. 3D is a schematic diagram of the prediction activity of a Taobao account on special holidays in each prediction time period for withdrawing money provided by an embodiment of the present invention
- FIG. 3E is a schematic diagram of the predicted activity of a Taobao account in each predicted time period for withdrawing money provided by an embodiment of the present invention
- FIG. 4 is a schematic diagram of a possible conversion relationship K provided by an embodiment of the present invention.
- FIG. 5 is a schematic diagram of a trusted predicted TPS for each prediction period provided by an embodiment of the present invention.
- Fig. 6 is a possible schematic diagram of the server capacity of the business system in each month of the next year provided by the embodiment of the present invention.
- Fig. 7 shows a possible computer room environment schematic diagram of the business system
- FIG. 8 is a schematic structural diagram of an apparatus for predicting server capacity provided by an embodiment of the present invention.
- FIG. 9 is a schematic structural diagram of a computer device provided by an embodiment of the present invention.
- Figure 1 exemplarily shows a method for predicting server capacity provided by an embodiment of the present invention, including the following steps:
- Step 101 for any statistical dimension in the business system, analyze the historical activity of the statistical dimension in each historical period, and determine the regular characteristics of the historical activity of the statistical dimension in each historical period.
- Step 102 predict the predicted TPS (Transaction Per Second, transaction volume per second) of each statistical dimension in each forecast period according to the regular characteristics of each statistical dimension, and superimpose the predicted TPS of the same forecast period in each statistical dimension to obtain the business system Overlay predicted TPS at each forecast period.
- TPS Transaction Per Second, transaction volume per second
- Step 103 convert the superimposed predicted TPS of the business system in each forecast period into the credible predicted TPS of the business system in each forecast period according to the conversion relationship; wherein, the conversion relationship is the superimposed historical TPS and predictable TPS of the business system in each historical period It is obtained by analyzing the relationship between trusted and historical TPS; superimposed historical TPS is obtained by superimposing the historical TPS of the same historical period in each statistical dimension; trusted historical TPS is obtained by analyzing the TPS of the business system in each historical period.
- Step 104 determine the server capacity of the business system in each forecast period according to the credible predicted TPS of the business system in each forecast period.
- the method of the embodiment of the present invention can predict the future TPS change trend according to the historical TPS change trend, for example, analyze the TPS change trend of this month and predict the TPS change trend of next month; it can also analyze the TPS change trend of this year , predict the changing trend of TPS next year; you can also analyze the changing trend of TPS in recent years, and predict the changing trend of TPS next year or in the next few years.
- the embodiments of the present invention do not limit this.
- the embodiment of the present invention is introduced by taking the prediction of the TPS change trend of next year according to the TPS change trend of this year as an example.
- step 101 any statistical dimension in the business system is first analyzed to determine the historical activity of the statistical dimension in each historical period.
- the historical activity will change over time.
- the e-commerce platform will carry out commercial promotions every special holiday, leading to a sudden increase in historical activity. This leads to a higher TPS required by the payment system under the same number of valid accounts. Therefore, we need to conduct a detailed analysis of the historical activity of the data throughout the year, and find the rules in sections.
- the historical activity of each day in a year can be analyzed to determine the predicted activity of each day in the next year; the historical activity of each month in a year can also be analyzed to determine the predicted activity in the next year The forecast activity of each month; the historical activity of each quarter of the year can also be analyzed to determine the forecast activity of each quarter in the next year.
- the analysis is made based on the historical activity of each month in a year, and the predicted activity of each month in the next year is obtained as an example, and the introduction is made.
- the statistical dimension may be account type, transaction type, etc., which are not limited in this embodiment of the present invention. If the statistical dimension is account type, it can be found that different account types and users have different usage habits, so the change rules of historical activity are different. For example, for e-commerce platforms, the daily historical activity and holiday historical activity will be different There is a big difference, because during special holidays, e-commerce companies will carry out preferential marketing and promotion, which makes the activity of existing users increase sharply; while other businesses with fixed models such as water and electricity bill payment, the historical activity will basically not change due to holidays And change. If the statistical dimension is the transaction type, the transaction type can be withdrawal, deposit, query, etc. For these different transaction types, the user's usage habits are also different, and correspondingly, the change law of historical activity will also be quite different .
- the embodiment of the present invention aims at any statistical dimension in the business system to determine the historical activity of the statistical dimension in each historical period, for example, for the account
- determine the historical activity of each month of the year, or for the transaction type of withdrawal determine the historical activity of each month of the year, or for the account type of Taobao account , respectively determine the historical activity of each month of this year when the transaction type is withdrawal and deposit.
- TPS Collect the TPS of the whole year in the business system.
- TPS mainly adopts the method of log collection.
- the TPS in the business system is obtained through log analysis.
- the number of valid accounts is collected by the database.
- the number of valid accounts at the end of each day is the effective number of accounts.
- the data can be screened when collecting the annual TPS in the business system.
- a business system may have a sudden increase or decrease in the overall transaction volume throughout the year due to internal system machine failures, system internal production pressure testing, related party failures, etc., thereby affecting historical activity.
- Our model calculation must be carried out when the account is naturally active, otherwise it will affect the overall reliability. This requires removing these glitches. Only after removing these glitches can we get the historical activity under the overall natural activity throughout the year. For example, it can be screened according to server performance indicators.
- server performance indicators such as CPU usage and memory usage
- TPS time when the server performance indicators are abnormal is the time of machine failure
- TPS at the time of failure is eliminated; it can also be determined by Manually enter the failure time, such as the internal production pressure test of the system, related party failure and other unconventional time periods, which can be eliminated by manually entering the time point.
- the historical TPS of Taobao account withdrawals in each month of the year is obtained. For example, there are 31 days in January, 24 hours per day, and 60 minutes, 60s per minute, then for each day, you can get 24*60*60 TPS, determine the highest TPS among these TPS as the highest TPS of the day, and then determine the highest TPS of the month among the 31 highest TPS of the day as Historical TPS in January; similarly, historical TPS in February, March...December. Obtain the number of valid accounts in the current month, for example, the number of valid accounts on the last day, or the highest number of accounts in the current month.
- FIG. 2A shows a schematic diagram of a possible monthly historical activity of a Taobao account related to gold withdrawal.
- the historical TPS related to the deposit of Taobao account in each month of this year is obtained, and combined with the number of first accounts in each month, we can get the Taobao account in this year.
- the specific implementation method of the monthly historical activity related to the deposit is the same as the method of determining the historical activity related to the withdrawal of the Taobao account in each month, and will not be repeated here.
- the historical TPS of the withdrawal of the Meituan account in each month of the year is obtained, and combined with the number of first accounts in each month, the Meituan account can be obtained.
- the specific implementation method of the historical activity related to gold withdrawal in each month of this year is the same as the method of determining the historical activity related to gold withdrawal in each month of the Taobao account, and will not be repeated here.
- the historical TPS of the Meituan account for each month of this year is obtained.
- the specific implementation method of the historical activity related to the deposit in each month of the year is the same as the method of determining the historical activity related to the withdrawal of the Taobao account in each month, and will not be repeated here.
- Figure 2A shows a possible schematic diagram of the monthly historical activity of Taobao account related to gold withdrawal.
- the historical activity data of 12 months is a A group of scattered point data, according to the group of scattered point data, determine the regular characteristics of the historical activity of each historical period in the statistical dimension. Then, according to the regular characteristics, the forecast activity in each forecast period is determined, that is, the forecast activity in the next 12 months is determined by analyzing the historical activity in the 12 months of this year.
- the embodiment of the present invention provides two methods for determining the forecast activity in each forecast period.
- the historical activity of each historical period is fitted through a series of curve models, such as linear models, logarithmic models, power function models, or exponential models.
- Fitting can be performed, for example, by the method of least squares.
- a and b are arbitrary real numbers
- x is the timeline
- y is the historical activity we want to obtain. If we want to obtain this unary linear equation, we must determine the values of the real numbers a and b. Set the actual historical activity value as yi, and the approximate value obtained by using the formula is Yi.
- the straight line obtained by regression is the straight line with the smallest deviation from our actual data as a whole.
- the logarithmic function is defined as follows
- lnx represents the logarithm of the natural number of x, which is nonlinear.
- the values of a and b can be obtained through the linear regression algorithm.
- the power function is defined as follows
- a and b are the constants we need to obtain, and the relationship between x and y is also nonlinear. In order to simplify the calculation, take the logarithm of the natural numbers on both sides of the formula at the same time to get
- the values and calculation formulas of a and b can be obtained according to linear regression.
- a and b are constants, and the relationship between x and y is also nonlinear.
- a * and b are the parameters to be estimated, and x and y * are in a linear relationship, and the result value can be obtained according to the linear regression.
- divide historical activity into different time periods according to time for example, divide 12 months into 4 intervals, and perform curve fitting on each interval through method 1.
- interval segmentation can also be performed according to daily consumption days and special holidays.
- Figure 2B shows a possible change trend of the annual historical activity of Taobao accounts for withdrawals. It can be seen that, in addition to several special events such as Spring Festival, Mid-Autumn Festival, New Year’s Day, 214 Valentine’s Day, and 520 Valentine’s Day, etc. Except for holidays, the data trend of the withdrawal account of this account type is basically the same, that is to say, the historical activity during the daily time period is basically maintained within a stable range; during the holiday time period, the historical activity is basically maintained within a stable range . This requires separating the historical activity of daily consumption days and special holidays for model calculation.
- the above method fully takes into account the user's consumption habits on daily consumption days and special holidays, and through targeted analysis of the user's consumption habits, it is possible to more accurately determine the predicted activity of the next year.
- account type is Taobao + transaction type is deposit
- account type is Meituan + transaction type is withdrawal Gold
- the account type is Meituan +
- the transaction type is the forecast activity of deposit next year.
- the predicted TPS of each statistical dimension in each forecast period is determined according to the second account number of each statistical dimension in each forecast period.
- the number of second accounts is input by business personnel according to the business promotion needs of next year, and the business personnel will input the number of second accounts in each forecast period next year into the model. For example, for Taobao accounts, the number of second accounts in each forecast period is 10,000 and 20,000 . Then, for the four different statistical dimensions determined above, the predicted TPS can be respectively determined in combination with the second account number.
- the obtained predicted activity of each forecast period is multiplied by the second account number (10,000, 20,000, 20,000%) of each corresponding forecast period, You can get the predicted TPS of Taobao account for each forecast period related to withdrawal.
- the obtained predicted activity of each forecast period is multiplied by the corresponding number of second accounts (10,000, 20,000, 20,000%) in each forecast period, You can get the predicted TPS of Taobao account for each forecast period related to the deposit.
- the predicted activity of the Meituan account related to withdrawal is multiplied by the number of second accounts (30,000, 10,000, 20,000%) corresponding to each forecast period, which can be obtained The predicted TPS of each forecast period for the withdrawal of the Meituan account.
- the predicted activity of the Meituan account related to the deposit multiply the obtained predicted activity of each forecast period by the number of second accounts (30,000, 10,000, 20,000%) corresponding to each forecast period to get The forecasted TPS of each forecast period for the deposit of the Meituan account.
- the predicted TPS of the four statistical dimensions in each forecast period has been obtained. Then, the predicted TPS of each statistical dimension in each forecast period is superimposed according to the same forecast period, and the superimposed predicted TPS of the business system in each forecast period can be obtained.
- the capacity of the server can be directly determined by dividing the superimposed predicted TPS by the loadable TPS of a single server, that is, the single-machine TPS.
- the superimposed predicted TPS is too large. Because we distinguish between different statistical dimensions, and in each statistical dimension, the highest TPS of the month is selected as the historical TPS of the statistical dimension, and when the business system is running normally, the highest TPS of the month for these four statistical dimensions It is often not generated at the same time, which will cause the value of the superimposed predicted TPS to be too large.
- the Meituan account may reach a maximum TPS of 5 at 17 o'clock, and the Taobao account may achieve a maximum TPS of 6 at 2 o'clock, but the entire business system reaches a maximum TPS of 10 at 18 o'clock, then simply set the highest TPS of the Meituan account
- the 11 obtained by superimposing TPS and the highest TPS of the Taobao account is relatively large compared to the highest TPS of the business system which is 10. Therefore, we need to further correct the value of the superimposed predicted TPS to obtain a credible predicted TPS.
- the historical TPS of each statistical dimension in each historical period is superimposed to obtain the superimposed historical TPS of each historical period. Then determine the credible historical TPS of the business system (that is, without distinguishing statistical dimensions) in each historical period, and determine the conversion relationship K according to the superimposed historical TPS and credible historical TPS in each historical period.
- the historical TPS1 of the statistical dimension of the withdrawal of Taobao account in each historical period of this year the historical TPS2 of the statistical dimension of deposit of Taobao account in each historical period of this year, and the statistical dimension of withdrawal of Meituan account
- the historical TPS4 of the statistical dimension of Meituan account deposits in each historical period of this year the historical TPS of each historical period of the 4 statistical dimensions are superimposed according to the same historical period, and the superposition is obtained Historical TPS. Then, without distinguishing the statistical dimension, determine the credible historical TPS of the business system in each historical period of this year.
- FIG. 4 shows a schematic diagram of a possible conversion relationship K. As shown in the figure, each historical period will There is a corresponding conversion relationship K between superimposed historical TPS and credible historical TPS, that is, the ordinate in Fig. 4 .
- FIG. 5 shows a schematic diagram of a possible trusted prediction TPS for each prediction period.
- the stand-alone TPS can be determined as follows:
- the stand-alone TPS of the server is determined.
- the server performance index is an important index to measure the stability of the service provided by a business system. Including the server's CPU usage, memory usage, IO usage, and disk usage, etc., the collection time period is the whole year, the time unit is second level, and the collection method is the system daemon process collection method. You can set a certain threshold condition to judge the stand-alone TPS of the server. For example, when the CPU utilization rate reaches 80%, the TPS at the corresponding moment is taken as the TPS that can be carried by a single server, that is, the stand-alone TPS.
- the capacity pressure test of the business system server can also be used to obtain the stand-alone TPS of the server under the condition that the transaction success rate and delay are normal.
- General business systems have a log cold backup function, and the generated log files can be uploaded to the cloud for storage.
- the disk usage rate of the local server is not very high, so the performance of the disk can be optimized through code and business logic. within consideration.
- Figure 6 shows a possible schematic diagram of the server capacity of the business system in each month of the next year.
- the operation and maintenance personnel can obtain the results of the server capacity based on To prepare for procurement, you can also perform one-click dynamic expansion and contraction on a monthly basis, saving resources and operation and maintenance costs on the premise of ensuring that the performance of the system server can carry all business needs.
- the credible forecast TPS can also be compared with the business development demand, and the promotion rhythm can be adjusted in time according to the comparison result. For example, if the credible forecast TPS in January is 40,000, but the company's business development demand for the business system is that the highest TPS in January reaches 50,000, then in order to meet the business development demand, you can increase the promotion efforts by increasing the second The number of accounts is used to improve the trusted prediction TPS. If the credible forecast TPS exceeds the business promotion expectation, the promotion efforts can be reduced and the number of newly added second accounts can be reduced.
- the above solution does not take into account various software and hardware failures that may exist in a business system, so the obtained server capacity is not enough to cope with various environmental changes that may occur in the business system. Therefore it can be further optimized.
- Fig. 7 shows a schematic diagram of a possible computer room environment of the business system, including 3 computer rooms, each of which is equipped with 2 physical machines, and several servers are deployed on each physical machine. It is assumed that a maximum number of servers (n sets) are deployed on each physical machine. Server capacity can be optimized from the following three perspectives.
- a single failure transaction loss threshold (B single time ) is usually set, which is the maximum transaction volume that can be affected by a single physical machine failure.
- T max is the trusted predicted TPS
- N is the server capacity
- s is the maximum failure time of a single physical machine
- n is the number of servers deployed on each physical machine.
- the credible predicted TPS is divided by the server capacity of the business system, and the TPS that each server in the business system should carry can be obtained, and then multiplied by n to obtain the TPS that each single physical machine in the business system should handle TPS, because we believe that generally speaking, after s seconds of failure, the operation and maintenance personnel will find the failed physical machine and repair or replace it, then the transaction volume lost by the single physical machine within s seconds of the failure can be used To represent, then the transaction volume lost by a single physical machine should be less than the transaction loss threshold for a single failure (B single ).
- the business system will be deployed in several different computer rooms to avoid the failure of a single computer room to cause the entire system to be paralyzed. That is to say, if any computer room fails, the remaining machines must be able to support the transaction peak. In this way, the number of machines in a computer room needs to be redundant. The more average the machines deployed in each computer room, the fewer redundant machines, so it is best is the average distribution of all computer rooms, that is
- L computer room is the number of computer rooms of the business system.
- T stand-alone is stand-alone TPS.
- the server will not be fully loaded to provide services, that is, the single machine will not be allowed to carry the amount of T single machine for a long time, which will easily cause transaction timeouts, so it is necessary to set a server that can provide services stably
- the highest load rate ⁇ the maximum load rate of the machine planning on the production of the business system of the present invention is 80%, that is to say, in any failure situation, the load rate of the server will be lower than ⁇ ,
- the server capacity can be determined respectively within the first range, the second range or the third range; the server capacity can also be determined within the first range and the second range, and can also be determined within the first range
- the server capacity is determined within the scope and the third scope, which is not limited in this embodiment of the present invention. The following shows the formula for determining the server capacity according to the first range and the third range:
- the method for predicting server capacity takes into account the different rules of change of user activity in different time periods, and determines the predicted activity of each forecast period by analyzing the change rules of historical activity in different historical periods , so that dynamic expansion and contraction can be performed in the process of providing services by the business system.
- fewer resource pools can be equipped, and on the premise of ensuring the normal and effective operation of the business system, it can reduce Identify resource overprovisioning and waste due to system load.
- the entire business system can be quickly isolated and recovered in the event of daily failures, providing more stable services.
- FIG. 8 exemplarily shows the structure of an apparatus for predicting server capacity provided by an embodiment of the present invention, and the structure can execute a process of predicting server capacity.
- the device specifically includes:
- each statistical dimension predict the predicted transaction volume per second TPS of each statistical dimension in each forecast period, and superimpose the predicted TPS of the same forecast period in each statistical dimension to obtain the superposition forecast of the business system in each forecast period TPS;
- the conversion relationship is the TPS of the business system in each historical period
- the relationship between the superimposed historical TPS and the credible historical TPS is obtained by analyzing the relationship;
- the superimposed historical TPS is obtained by superimposing the historical TPS of the same historical period in each statistical dimension;
- the credible historical TPS is obtained by analyzing the business system in It is obtained by analyzing the TPS of each historical period;
- the server capacity of the service system in each forecast period is determined through the credible predicted TPS of the service system in each forecast period.
- the change rules are different, so by analyzing the historical activity of each historical period in different statistical dimensions in the business system, we can get The regular characteristics of the historical activity of each statistical dimension in each historical period can more accurately predict the predicted TPS of each statistical dimension in each forecast period. Then, by superimposing the predicted TPS of different statistical dimensions, the superimposed predicted TPS of the entire business system can be further determined. The superimposed predicted TPS obtained in this way can more accurately reflect the changing rules of different statistical dimensions in each forecast period.
- a fitting curve corresponding to each preset function conforming to a preset condition is determined as a regular feature.
- the determining unit is specifically configured to:
- the floating coefficient of each historical activity in the interval segment is determined as the regular feature of the interval segment; the floating coefficient is determined according to the floating ratio of each historical activity; The floating ratio is the ratio of the difference between the highest value of historical activity and the lowest value of historical activity in the interval segment to the lowest value of historical activity.
- the product of the forecast activity of each statistical dimension in each forecast period and the second account number in the same forecast period is determined as the predicted TPS of each statistical dimension in each forecast period.
- the determining unit is specifically configured to:
- the server capacity of the service system in each forecast period is determined through the trusted forecast TPS and the stand-alone TPS.
- the first range of server capacity is determined according to the following formula:
- T max is the trusted predicted TPS
- N is the server capacity
- s is the maximum failure time of a single physical machine
- n is the number of servers deployed on a single physical machine
- B is the transaction loss threshold once ;
- the server capacity is determined within the first range of server capacities.
- the determining unit is specifically configured to:
- the second range of server capacity is determined according to the following formula:
- the L computer room is the number of computer rooms of the business system, and the T stand-alone is the single-machine TPS;
- the server capacity is determined within the first range of server capacities and the second range of server capacities.
- the third range of server capacity is determined according to the following formula:
- the server capacity is determined within the first range of server capacities and the third range of server capacities.
- the embodiment of the present application provides a computer device, as shown in FIG. 9 , including at least one processor 901, and a memory 902 connected to at least one processor.
- the processor is not limited in the embodiment of the present application.
- the bus connection between processor 901 and memory 902 in FIG. 9 is taken as an example.
- the bus can be divided into address bus, data bus, control bus and so on.
- the memory 902 stores instructions executable by at least one processor 901, and at least one processor 901 executes the instructions stored in the memory 902 to perform the steps of the above method for predicting server capacity.
- the processor 901 is the control center of the computer equipment, which can use various interfaces and lines to connect various parts of the computer equipment, by running or executing the instructions stored in the memory 902 and calling the data stored in the memory 902, so as to make predictions server capacity.
- the processor 901 may include one or more processing units, and the processor 901 may integrate an application processor and a modem processor.
- the tuner processor mainly handles wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 901 .
- the processor 901 and the memory 902 can be implemented on the same chip, and in some embodiments, they can also be implemented on independent chips.
- Memory 902 is any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.
- the memory 902 in the embodiment of the present application may also be a circuit or any other device capable of implementing a storage function, and is used for storing program instructions and/or data.
- an embodiment of the present invention also provides a computer-readable storage medium, the computer-readable storage medium stores a computer-executable program, and the computer-executable program is used to make the computer execute the prediction server listed in any of the above-mentioned methods capacity method.
- These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions
- the device realizes the function specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Description
相关申请的交叉引用Cross References to Related Applications
本申请要求在2021年08月27日提交中国专利局、申请号为202110992903.2、申请名称为“一种预测服务器容量的方法及装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application submitted to the China Patent Office on August 27, 2021, with the application number 202110992903.2 and the application name "A Method and Device for Predicting Server Capacity", the entire contents of which are incorporated herein by reference. Applying.
本发明实施例涉及金融科技技术领域,尤其涉及一种预测服务器容量的方法、装置、计算设备及计算机可读存储介质。The embodiments of the present invention relate to the technical field of financial technology, and in particular to a method, device, computing device, and computer-readable storage medium for predicting server capacity.
随着计算机技术的发展,越来越多的技术应用在金融领域,传统金融业正在逐步向金融科技(Fintech)转变,但由于金融行业的安全性、实时性要求,也对技术提出的更高的要求。With the development of computer technology, more and more technologies are applied in the financial field, and the traditional financial industry is gradually transforming into Fintech. However, due to the security and real-time requirements of the financial industry, higher requirements are placed on technology. requirements.
随着互联网技术的迅速发展与进步,网民数量剧增,因而,一个系统往往需要部署多个服务器以满足网民的请求交易量。若部署的服务器容量(即服务器数量)过少,则容易出现请求交易量超出服务器的额定负载上限,从而服务器拥挤甚至崩溃的情况;若部署的服务器容量过多,不仅造成计算资源的浪费,同时也增加了企业的不必要的成本。With the rapid development and progress of Internet technology, the number of Internet users has increased dramatically. Therefore, a system often needs to deploy multiple servers to meet the transaction volume requested by Internet users. If the deployed server capacity (that is, the number of servers) is too small, it is easy for the transaction volume of requests to exceed the rated load limit of the server, resulting in server congestion or even collapse; if the deployed server capacity is too large, it will not only cause waste of computing resources, but also Also increased the unnecessary cost of the enterprise.
目前,一般是通过人为的观察服务器的负载变化情况或者是通过监控系统告警(服务器发生网络拥挤或崩溃)之后,手动对服务器容量进行调整,容易导致误操作,智能化程度较低。At present, the server capacity is manually adjusted by manually observing the server load changes or monitoring system alarms (network congestion or crash of the server), which easily leads to misoperation and is less intelligent.
因此,如何提前对服务器的容量进行预测,利用预测的结果指导未来的资源部署,对于信息系统的业务发展至关重要。Therefore, how to predict the capacity of servers in advance and use the predicted results to guide future resource deployment is very important for the business development of information systems.
综上,本发明实施例提供一种预测服务器容量的方法,用以提高对服务器容量预测的准确度,从而灵活地调整服务器容量。To sum up, the embodiments of the present invention provide a method for predicting server capacity, which is used to improve the accuracy of server capacity prediction, so as to flexibly adjust the server capacity.
发明内容Contents of the invention
本发明实施例提供一种预测服务器容量的方法,用以提高对服务器容量预测的准确度,从而灵活地调整服务器容量。An embodiment of the present invention provides a method for predicting server capacity, which is used to improve the accuracy of server capacity prediction, thereby flexibly adjusting the server capacity.
第一方面,本发明实施例提供一种预测服务器容量的方法,包括:In a first aspect, an embodiment of the present invention provides a method for predicting server capacity, including:
针对业务系统中的任一统计维度,对所述统计维度在各历史时段的历史活跃度进行分析,确定符合所述统计维度在各历史时段的历史活跃度的规律特征;For any statistical dimension in the business system, analyze the historical activity of the statistical dimension in each historical period, and determine the regular characteristics of the historical activity of the statistical dimension in each historical period;
通过各统计维度的规律特征,预测各统计维度在各预测时段的预测每秒交易量TPS,将各统计维度中相同预测时段的预测TPS进行叠加,得到所述业务系统在各预测时段的叠加预测TPS;According to the regular characteristics of each statistical dimension, predict the predicted transaction volume per second TPS of each statistical dimension in each forecast period, and superimpose the predicted TPS of the same forecast period in each statistical dimension to obtain the superposition forecast of the business system in each forecast period TPS;
将所述业务系统在各预测时段的叠加预测TPS,按照转换关系转换为所述业务系统在各预测时段的可信预测TPS;其中,所述转换关系为对所述业务系统在各历史时段的叠加历史TPS和可信历史TPS的关系进行分析得到的;所述叠加历史TPS为将各统计维度中相同历史时段的历史TPS进行叠加得到的;所述可信历史TPS为对所述业务系统在各历史时段的TPS进行分析得到的;Convert the superimposed predicted TPS of the business system in each forecast period into the credible predicted TPS of the business system in each forecast period according to the conversion relationship; wherein, the conversion relationship is the TPS of the business system in each historical period The relationship between the superimposed historical TPS and the credible historical TPS is obtained by analyzing the relationship; the superimposed historical TPS is obtained by superimposing the historical TPS of the same historical period in each statistical dimension; the credible historical TPS is obtained by analyzing the business system in It is obtained by analyzing the TPS of each historical period;
通过所述业务系统在各预测时段的可信预测TPS,确定所述业务系统在各预测时段的服务器容量。The server capacity of the service system in each forecast period is determined through the credible predicted TPS of the service system in each forecast period.
由于用户活跃度在不同的历史时期是会发生变化的,且在不同的统计维度中,变化规律不同,因而通过对业务系统中不同的统计维度中各历史时段的历史活跃度分别进行分析,得到各统计维度 在各历史时段的历史活跃度的规律特征,从而能够更准确地预测各统计维度在各预测时段的预测TPS。再通过对不同统计维度的预测TPS进行叠加,从而进一步确定整个业务系统的叠加预测TPS,如此得到的叠加预测TPS能更加准确地反映不同的统计维度在各预测时段的变化规律。为了进一步提高预测的准确性,通过对业务系统在各历史时段的可信历史TPS和叠加历史TPS的分析,确定二者的转换关系,根据转换关系和叠加预测TPS得到可信预测TPS,如此得到的可信预测TPS的准确性更高。从而能准确地对业务系统在各预测时段的服务器容量进行预测。Since user activity will change in different historical periods, and in different statistical dimensions, the change rules are different, so by analyzing the historical activity of each historical period in different statistical dimensions in the business system, we can get The regular characteristics of the historical activity of each statistical dimension in each historical period can more accurately predict the predicted TPS of each statistical dimension in each forecast period. Then, by superimposing the predicted TPS of different statistical dimensions, the superimposed predicted TPS of the entire business system can be further determined. The superimposed predicted TPS obtained in this way can more accurately reflect the changing rules of different statistical dimensions in each forecast period. In order to further improve the accuracy of the forecast, through the analysis of the credible historical TPS and superimposed historical TPS of the business system in each historical period, the conversion relationship between the two is determined, and the credible predicted TPS is obtained according to the conversion relationship and the superimposed predicted TPS. The credible predicted TPS is more accurate. Therefore, the server capacity of the business system in each forecast period can be accurately predicted.
可选地,任一统计维度在各历史时段的历史活跃度通过如下方法得到,包括:Optionally, the historical activity of any statistical dimension in each historical period is obtained by the following methods, including:
将所述统计维度在各历史时段的历史TPS和在各历史时段的第一账户数的商,确定为所述统计维度在各历史时段的历史活跃度。The quotient of the historical TPS of the statistical dimension in each historical period and the number of first accounts in each historical period is determined as the historical activity of the statistical dimension in each historical period.
可选地,确定符合所述统计维度在各历史时段的历史活跃度的规律特征,包括:Optionally, determining the regular characteristics conforming to the historical activity of the statistical dimension in each historical period includes:
对所述统计维度在各历史时段的历史活跃度进行拟合,得到各预设函数对应的拟合曲线;Fitting the historical activity of the statistical dimension in each historical period to obtain a fitting curve corresponding to each preset function;
将各预设函数对应的拟合曲线符合预设条件的拟合曲线,确定为规律特征。可选地,确定符合所述统计维度在各历史时段的历史活跃度的规律特征,包括:A fitting curve corresponding to each preset function conforming to a preset condition is determined as a regular feature. Optionally, determining the regular characteristics conforming to the historical activity of the statistical dimension in each historical period includes:
若确定不存在符合预设条件的拟合曲线,则对所述统计维度在各历史时段的历史活跃度进行区间分段;If it is determined that there is no fitting curve that meets the preset conditions, the historical activity of the statistical dimension in each historical period is segmented into intervals;
针对任一区间分段,将所述区间分段中各历史活跃度的浮动系数确定为所述区间分段的规律特征;所述浮动系数是根据所述各历史活跃度的浮动比例确定的;所述浮动比例为所述区间分段中历史活跃度的最高值与历史活跃度的最低值的差占所述历史活跃度的最低值的比例。For any interval segment, the floating coefficient of each historical activity in the interval segment is determined as the regular feature of the interval segment; the floating coefficient is determined according to the floating ratio of each historical activity; The floating ratio is the ratio of the difference between the highest value of historical activity and the lowest value of historical activity in the interval segment to the lowest value of historical activity.
可选地,通过各统计维度的规律特征,预测各统计维度在各预测时段的预测TPS,包括:Optionally, predict the predicted TPS of each statistical dimension in each prediction period through the regular characteristics of each statistical dimension, including:
通过各统计维度的规律特征,确定各统计维度在各预测时段的预测活跃度;Determine the forecast activity of each statistical dimension in each forecast period through the regular characteristics of each statistical dimension;
将所述各统计维度在各预测时段的预测活跃度与相同预测时段的第二账户数的积,确定为各统计维度在各预测时段的预测TPS。The product of the forecast activity of each statistical dimension in each forecast period and the second account number in the same forecast period is determined as the predicted TPS of each statistical dimension in each forecast period.
可选地,通过所述业务系统在各预测时段的可信预测TPS,确定所述业务系统在各预测时段的服务器容量,包括:Optionally, determining the server capacity of the business system in each forecast period through the trusted predicted TPS of the business system in each forecast period, including:
采集所述业务系统在各历史时段的服务器性能指标,将服务器性能指标符合设定条件时所述服务器承载的TPS确定为所述服务器的单机TPS;Collect the server performance indicators of the business system in each historical period, and determine the TPS carried by the server when the server performance indicators meet the set conditions as the stand-alone TPS of the server;
通过所述可信预测TPS和所述单机TPS确定所述业务系统在各预测时段的服务器容量。The server capacity of the service system in each forecast period is determined through the trusted forecast TPS and the stand-alone TPS.
可选地,通过所述可信预测TPS和所述单机TPS确定所述业务系统在各预测时段的服务器容量,包括:Optionally, determining the server capacity of the business system in each prediction period through the trusted predicted TPS and the stand-alone TPS includes:
根据如下公式确定服务器容量的第一范围:The first range of server capacity is determined according to the following formula:
其中,T max为所述可信预测TPS,N为所述服务器容量,s为单物理机的最大故障时间,n为单物理机上部署的服务器的台数,B 单次为交易损失阈值; Wherein, T max is the trusted predicted TPS, N is the server capacity, s is the maximum failure time of a single physical machine, n is the number of servers deployed on a single physical machine, and B is the transaction loss threshold once ;
在所述服务器容量的第一范围内确定所述服务器容量。The server capacity is determined within the first range of server capacities.
可选地,通过所述可信预测TPS和所述单机TPS确定所述业务系统在各预测时段的服务器容量,包括:Optionally, determining the server capacity of the business system in each prediction period through the trusted predicted TPS and the stand-alone TPS includes:
根据如下公式确定服务器容量的第二范围:The second range of server capacity is determined according to the following formula:
其中,L 机房为所述业务系统的机房数,T 单机为所述单机TPS; Wherein, the L computer room is the number of computer rooms of the business system, and the T stand-alone is the single-machine TPS;
在所述服务器容量的第一范围和所述服务器容量的第二范围内确定所述服务器容量。The server capacity is determined within the first range of server capacities and the second range of server capacities.
可选地,通过所述可信预测TPS和所述单机TPS确定所述业务系统在各预测时段的服务器容量,包括:Optionally, determining the server capacity of the business system in each prediction period through the trusted predicted TPS and the stand-alone TPS includes:
根据如下公式确定服务器容量的第三范围:The third range of server capacity is determined according to the following formula:
其中,∈为所述最高负载率;Wherein, ∈ is the highest load rate;
在所述服务器容量的第一范围和所述服务器容量的第三范围内确定所述服务器容量。The server capacity is determined within the first range of server capacities and the third range of server capacities.
第二方面,本发明实施例还提供一种预测服务器容量的装置,包括:In the second aspect, the embodiment of the present invention also provides an apparatus for predicting server capacity, including:
确定单元,用于:Identify units for:
针对业务系统中的任一统计维度,对所述统计维度在各历史时段的历史活跃度进行分析,确定符合所述统计维度在各历史时段的历史活跃度的规律特征;For any statistical dimension in the business system, analyze the historical activity of the statistical dimension in each historical period, and determine the regular characteristics of the historical activity of the statistical dimension in each historical period;
通过各统计维度的规律特征,预测各统计维度在各预测时段的预测每秒交易量TPS,将各统计维度中相同预测时段的预测TPS进行叠加,得到所述业务系统在各预测时段的叠加预测TPS;According to the regular characteristics of each statistical dimension, predict the predicted transaction volume per second TPS of each statistical dimension in each forecast period, and superimpose the predicted TPS of the same forecast period in each statistical dimension to obtain the superposition forecast of the business system in each forecast period TPS;
将所述业务系统在各预测时段的叠加预测TPS,按照转换关系转换为所述业务系统在各预测时段的可信预测TPS;其中,所述转换关系为对所述业务系统在各历史时段的叠加历史TPS和可信历史TPS的关系进行分析得到的;所述叠加历史TPS为将各统计维度中相同历史时段的历史TPS进行叠加得到的;所述可信历史TPS为对所述业务系统在各历史时段的TPS进行分析得到的;Convert the superimposed predicted TPS of the business system in each forecast period into the credible predicted TPS of the business system in each forecast period according to the conversion relationship; wherein, the conversion relationship is the TPS of the business system in each historical period The relationship between the superimposed historical TPS and the credible historical TPS is obtained by analyzing the relationship; the superimposed historical TPS is obtained by superimposing the historical TPS of the same historical period in each statistical dimension; the credible historical TPS is obtained by analyzing the business system in It is obtained by analyzing the TPS of each historical period;
通过所述业务系统在各预测时段的可信预测TPS,确定所述业务系统在各预测时段的服务器容量。The server capacity of the service system in each forecast period is determined through the credible predicted TPS of the service system in each forecast period.
可选地,所述确定单元具体用于:Optionally, the determining unit is specifically configured to:
将所述统计维度在各历史时段的历史TPS和在各历史时段的第一账户数的商,确定为所述统计维度在各历史时段的历史活跃度。The quotient of the historical TPS of the statistical dimension in each historical period and the number of first accounts in each historical period is determined as the historical activity of the statistical dimension in each historical period.
可选地,所述确定单元具体用于:Optionally, the determining unit is specifically configured to:
对所述统计维度在各历史时段的历史活跃度进行拟合,得到各预设函数对应的拟合曲线;Fitting the historical activity of the statistical dimension in each historical period to obtain a fitting curve corresponding to each preset function;
将各预设函数对应的拟合曲线符合预设条件的拟合曲线,确定为规律特征。A fitting curve corresponding to each preset function conforming to a preset condition is determined as a regular feature.
可选地,所述确定单元具体用于:Optionally, the determining unit is specifically configured to:
若确定不存在符合预设条件的拟合曲线,则对所述统计维度在各历史时段的历史活跃度进行区间分段;If it is determined that there is no fitting curve that meets the preset conditions, the historical activity of the statistical dimension in each historical period is segmented into intervals;
针对任一区间分段,将所述区间分段中各历史活跃度的浮动系数确定为所述区间分段的规律特征;所述浮动系数是根据所述各历史活跃度的浮动比例确定的;所述浮动比例为所述区间分段中历史活跃度的最高值与历史活跃度的最低值的差占所述历史活跃度的最低值的比例。For any interval segment, the floating coefficient of each historical activity in the interval segment is determined as the regular feature of the interval segment; the floating coefficient is determined according to the floating ratio of each historical activity; The floating ratio is the ratio of the difference between the highest value of historical activity and the lowest value of historical activity in the interval segment to the lowest value of historical activity.
可选地,所述确定单元具体用于:Optionally, the determining unit is specifically configured to:
通过各统计维度的规律特征,确定各统计维度在各预测时段的预测活跃度;Determine the forecast activity of each statistical dimension in each forecast period through the regular characteristics of each statistical dimension;
将所述各统计维度在各预测时段的预测活跃度与相同预测时段的第二账户数的积,确定为各统计维度在各预测时段的预测TPS。The product of the forecast activity of each statistical dimension in each forecast period and the second account number in the same forecast period is determined as the predicted TPS of each statistical dimension in each forecast period.
可选地,所述确定单元具体用于:Optionally, the determining unit is specifically configured to:
采集所述业务系统在各历史时段的服务器性能指标,将服务器性能指标符合设定条件时所述服务器承载的TPS确定为所述服务器的单机TPS;Collect the server performance indicators of the business system in each historical period, and determine the TPS carried by the server when the server performance indicators meet the set conditions as the stand-alone TPS of the server;
通过所述可信预测TPS和所述单机TPS确定所述业务系统在各预测时段的服务器容量。The server capacity of the service system in each forecast period is determined through the trusted forecast TPS and the stand-alone TPS.
可选地,所述确定单元具体用于:Optionally, the determining unit is specifically configured to:
根据如下公式确定服务器容量的第一范围:The first range of server capacity is determined according to the following formula:
其中,T max为所述可信预测TPS,N为所述服务器容量,s为单物理机的最大故障时间,n为单物理机上部署的服务器的台数,B 单次为交易损失阈值; Wherein, T max is the trusted predicted TPS, N is the server capacity, s is the maximum failure time of a single physical machine, n is the number of servers deployed on a single physical machine, and B is the transaction loss threshold once ;
在所述服务器容量的第一范围内确定所述服务器容量。The server capacity is determined within the first range of server capacities.
可选地,所述确定单元具体用于:Optionally, the determining unit is specifically configured to:
根据如下公式确定服务器容量的第二范围:The second range of server capacity is determined according to the following formula:
其中,L 机房为所述业务系统的机房数,T 单机为所述单机TPS; Wherein, the L computer room is the number of computer rooms of the business system, and the T stand-alone is the single-machine TPS;
在所述服务器容量的第一范围和所述服务器容量的第二范围内确定所述服务器容量。The server capacity is determined within the first range of server capacities and the second range of server capacities.
可选地,所述确定单元具体用于:Optionally, the determining unit is specifically configured to:
根据如下公式确定服务器容量的第三范围:The third range of server capacity is determined according to the following formula:
其中,∈为所述最高负载率;Wherein, ∈ is the highest load rate;
在所述服务器容量的第一范围和所述服务器容量的第三范围内确定所述服务器容量。The server capacity is determined within the first range of server capacities and the third range of server capacities.
第三方面,本发明实施例还提供一种计算设备,包括:In a third aspect, an embodiment of the present invention also provides a computing device, including:
存储器,用于存储计算机程序;memory for storing computer programs;
处理器,用于调用所述存储器中存储的计算机程序,按照获得的程序执行上述任一方式所列的预测服务器容量的方法。The processor is configured to call the computer program stored in the memory, and execute the method for predicting server capacity listed in any of the above-mentioned ways according to the obtained program.
第四方面,本发明实施例还提供一种计算机可读存储介质,所述计算机可读存储介质存储有计算机可执行程序,所述计算机可执行程序用于使计算机执行上述任一方式所列的预测服务器容量的方法。In the fourth aspect, the embodiment of the present invention also provides a computer-readable storage medium, the computer-readable storage medium stores a computer-executable program, and the computer-executable program is used to make the computer execute any of the methods listed above. A method for predicting server capacity.
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简要介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域的普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention. For Those of ordinary skill in the art can also obtain other drawings based on these drawings without making creative efforts.
图1为本发明实施例提供的一种预测服务器容量的方法;FIG. 1 is a method for predicting server capacity provided by an embodiment of the present invention;
图2A为本发明实施例提供的一种可能的淘宝账户有关出金的各个月的历史活跃度的示意图;Fig. 2A is a schematic diagram of the historical activity of a possible Taobao account related to withdrawing money provided by an embodiment of the present invention;
图2B为本发明实施例提供的一种可能的淘宝账户有关出金的各个月的历史活跃度的示意图;Fig. 2B is a schematic diagram of the historical activity of a possible Taobao account related to the withdrawal of funds provided by the embodiment of the present invention;
图3A为本发明实施例提供的一种淘宝账户关于出金的各个历史时段的日常消费日历史活跃度 的示意图;Fig. 3A is a schematic diagram of the daily consumption day historical activity of a Taobao account in each historical period of withdrawal provided by an embodiment of the present invention;
图3B为本发明实施例提供的一种淘宝账户关于出金的各个预测时段的日常消费日的预测活跃度的示意图;Fig. 3B is a schematic diagram of the predicted activity of a Taobao account on the daily consumption day of each forecast period for withdrawal provided by an embodiment of the present invention;
图3C为本发明实施例提供的一种淘宝账户关于出金的各个历史时段的特殊节假日的历史活跃度的示意图;FIG. 3C is a schematic diagram of the historical activity of a Taobao account on special holidays in various historical periods of withdrawal provided by an embodiment of the present invention;
图3D为本发明实施例提供的一种淘宝账户关于出金的各个预测时段的特殊节假日的预测活跃度的示意图;Fig. 3D is a schematic diagram of the prediction activity of a Taobao account on special holidays in each prediction time period for withdrawing money provided by an embodiment of the present invention;
图3E为本发明实施例提供的一种淘宝账户关于出金的各个预测时段的预测活跃度的示意图;FIG. 3E is a schematic diagram of the predicted activity of a Taobao account in each predicted time period for withdrawing money provided by an embodiment of the present invention;
图4为本发明实施例提供的一种可能的得到的转换关系K的示意图;FIG. 4 is a schematic diagram of a possible conversion relationship K provided by an embodiment of the present invention;
图5为本发明实施例提供的一种各预测时段的可信预测TPS的示意图;FIG. 5 is a schematic diagram of a trusted predicted TPS for each prediction period provided by an embodiment of the present invention;
图6为本发明实施例提供的一种可能的该业务系统在明年每个月的服务器容量示意图;Fig. 6 is a possible schematic diagram of the server capacity of the business system in each month of the next year provided by the embodiment of the present invention;
图7示出了一种可能的该业务系统的机房环境示意图;Fig. 7 shows a possible computer room environment schematic diagram of the business system;
图8为本发明实施例提供的一种预测服务器容量装置的结构示意图;FIG. 8 is a schematic structural diagram of an apparatus for predicting server capacity provided by an embodiment of the present invention;
图9为本发明实施例提供的一种计算机设备的结构示意图。FIG. 9 is a schematic structural diagram of a computer device provided by an embodiment of the present invention.
为使本申请的目的、实施方式和优点更加清楚,下面将结合本申请示例性实施例中的附图,对本申请示例性实施方式进行清楚、完整地描述,显然,所描述的示例性实施例仅是本申请一部分实施例,而不是全部的实施例。In order to make the purpose, implementation and advantages of the application clearer, the following will clearly and completely describe the exemplary embodiments of the application in conjunction with the accompanying drawings in the exemplary embodiments of the application. Obviously, the described exemplary embodiments It is only a part of the embodiments of the present application, but not all the embodiments.
基于本申请描述的示例性实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请所附权利要求保护的范围。此外,虽然本申请中公开内容按照示范性一个或几个实例来介绍,但应理解,可以就这些公开内容的各个方面也可以单独构成一个完整实施方式。Based on the exemplary embodiments described in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts fall within the protection scope of the appended claims of this application. In addition, although the disclosures in this application are introduced as exemplary one or several examples, it should be understood that each aspect of these disclosures can also independently constitute a complete implementation.
需要说明的是,本申请中对于术语的简要说明,仅是为了方便理解接下来描述的实施方式,而不是意图限定本申请的实施方式。除非另有说明,这些术语应当按照其普通和通常的含义理解。It should be noted that the brief description of the terms in this application is only for the convenience of understanding the implementations described below, and is not intended to limit the implementations of this application. These terms are to be understood according to their ordinary and usual meaning unless otherwise stated.
本申请中说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”等是用于区别类似或同类的对象或实体,而不必然意味着限定特定的顺序或先后次序,除非另外注明(Unless otherwise indicated)。应该理解这样使用的用语在适当情况下可以互换,例如能够根据本申请实施例图示或描述中给出那些以外的顺序实施。The terms "first", "second", and "third" in the description and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean limiting specific Sequential or sequential order, unless otherwise indicated (Unless otherwise indicated). It should be understood that the terms used in this way can be interchanged under appropriate circumstances, for example, they can be implemented in a sequence other than those shown in the illustrations or descriptions of the embodiments of the present application.
此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖但不排他的包含,例如,包含了一系列组件的产品或设备不必限于清楚地列出的那些组件,而是可包括没有清楚地列出的或对于这些产品或设备固有的其它组件。Furthermore, the terms "comprising" and "having" and any variations thereof, are intended to cover but not exclusively include, for example, a product or device comprising a series of components need not be limited to those components explicitly listed, but may include other components not expressly listed or inherent in these products or equipment.
图1示例性示出了本发明实施例提供的一种预测服务器容量的方法,包括如下步骤:Figure 1 exemplarily shows a method for predicting server capacity provided by an embodiment of the present invention, including the following steps:
步骤101,针对业务系统中的任一统计维度,对统计维度在各历史时段的历史活跃度进行分析,确定符合统计维度在各历史时段的历史活跃度的规律特征。
步骤102,通过各统计维度的规律特征,预测各统计维度在各预测时段的预测TPS(Transaction Per Second,每秒交易量),将各统计维度中相同预测时段的预测TPS进行叠加,得到业务系统在各预测时段的叠加预测TPS。
步骤103,将业务系统在各预测时段的叠加预测TPS,按照转换关系转换为业务系统在各预测时段的可信预测TPS;其中,转换关系为对业务系统在各历史时段的叠加历史TPS和可信历史TPS 的关系进行分析得到的;叠加历史TPS为将各统计维度中相同历史时段的历史TPS进行叠加得到的;可信历史TPS为对业务系统在各历史时段的TPS进行分析得到的。
步骤104,通过业务系统在各预测时段的可信预测TPS,确定业务系统在各预测时段的服务器容量。
采用本发明实施例的方法可以根据历史的TPS变化趋势预测未来的TPS变化趋势,例如对本月的TPS变化趋势进行分析,预测下个月的TPS变化趋势;也可以对本年的TPS变化趋势进行分析,预测明年的TPS变化趋势;还可以对近几年的TPS变化趋势进行分析,预测明年的或者未来几年的TPS变化趋势。本发明实施例对此不作限制。本发明实施例以根据今年的TPS变化趋势预测明年的TPS变化趋势为例进行介绍。The method of the embodiment of the present invention can predict the future TPS change trend according to the historical TPS change trend, for example, analyze the TPS change trend of this month and predict the TPS change trend of next month; it can also analyze the TPS change trend of this year , predict the changing trend of TPS next year; you can also analyze the changing trend of TPS in recent years, and predict the changing trend of TPS next year or in the next few years. The embodiments of the present invention do not limit this. The embodiment of the present invention is introduced by taking the prediction of the TPS change trend of next year according to the TPS change trend of this year as an example.
在步骤101中,首先对业务系统中的任一统计维度进行分析,确定该统计维度在各历史时段的历史活跃度。In
实际上,历史活跃度是会随着时间发生变化的,比如对于连接电商平台和银行核心系统的支付系统,每到特殊的节假日电商平台都会进行商业促销,导历史活跃度发生突增,这就导致在相同的有效账户数条件下,支付系统所需要承载的TPS更高,所以我们需要对一整年的数据进行历史活跃度的细化分析,分段找到其中的规律。In fact, the historical activity will change over time. For example, for the payment system connecting the e-commerce platform and the bank’s core system, the e-commerce platform will carry out commercial promotions every special holiday, leading to a sudden increase in historical activity. This leads to a higher TPS required by the payment system under the same number of valid accounts. Therefore, we need to conduct a detailed analysis of the historical activity of the data throughout the year, and find the rules in sections.
可选地,可以对一年中每一天的历史活跃度进行分析,确定在明年中每一天的预测活跃度;也可以对在一年中每一个月的历史活跃度进行分析,确定在明年中每一个月的预测活跃度;也可以对在一年中每一个季度的历史活跃度进行分析,确定在明年中每一个季度的预测活跃度。本领域技术人员可以根据需要作出各种选择,在此不做限制。本发明实施例以根据一年中的每一个月的历史活跃度进行分析,获取明年每一个月的预测活跃度为例,进行介绍。Optionally, the historical activity of each day in a year can be analyzed to determine the predicted activity of each day in the next year; the historical activity of each month in a year can also be analyzed to determine the predicted activity in the next year The forecast activity of each month; the historical activity of each quarter of the year can also be analyzed to determine the forecast activity of each quarter in the next year. Those skilled in the art can make various choices according to needs, which are not limited here. In the embodiment of the present invention, the analysis is made based on the historical activity of each month in a year, and the predicted activity of each month in the next year is obtained as an example, and the introduction is made.
同时,由于业务系统的统计维度会有很多种,不同的统计维度中,各历史时段的历史活跃度的变化规律是不同的。统计维度可以为账户类型、交易类型等,本发明实施例对此不作限制。若统计维度为账户类型,可以发现,不同的账户类型,用户的使用习惯不同,则历史活跃度的变化规律不同,例如对于电商平台而言,日常的历史活跃度与节假日的历史活跃度会有很大的差别,因为特殊的节假日期间电商会进行优惠营销推广,使得存量用户的活跃度急剧增长;而另外的像是水电缴费等模式固定的业务,历史活跃度基本不会因为节假日的变化而变化。若统计维度为交易类型,交易类型可以为出金、入金、查询等等,对于这些不同的交易类型,用户的使用习惯也不同,相应的,历史活跃度的变化规律也会有较大的差别。At the same time, since there are many statistical dimensions of the business system, in different statistical dimensions, the change rules of historical activity in each historical period are different. The statistical dimension may be account type, transaction type, etc., which are not limited in this embodiment of the present invention. If the statistical dimension is account type, it can be found that different account types and users have different usage habits, so the change rules of historical activity are different. For example, for e-commerce platforms, the daily historical activity and holiday historical activity will be different There is a big difference, because during special holidays, e-commerce companies will carry out preferential marketing and promotion, which makes the activity of existing users increase sharply; while other businesses with fixed models such as water and electricity bill payment, the historical activity will basically not change due to holidays And change. If the statistical dimension is the transaction type, the transaction type can be withdrawal, deposit, query, etc. For these different transaction types, the user's usage habits are also different, and correspondingly, the change law of historical activity will also be quite different .
为了能够兼顾不同的统计维度中,各历史时段的历史活跃度的变化规律,本发明实施例针对业务系统中的任一统计维度,确定该统计维度在各历史时段的历史活跃度,例如针对账户类型为淘宝账户时,确定在今年一年的每个月的历史活跃度,或者针对交易类型为出金时,确定在今年一年的每个月的历史活跃度,或者针对账户类型为淘宝账户,分别确定在交易类型为出金和入金时的今年一年的每个月的历史活跃度。以上仅为示例,本发明实施例对此不作限制。In order to be able to take into account the changing rules of the historical activity of each historical period in different statistical dimensions, the embodiment of the present invention aims at any statistical dimension in the business system to determine the historical activity of the statistical dimension in each historical period, for example, for the account When the type is a Taobao account, determine the historical activity of each month of the year, or for the transaction type of withdrawal, determine the historical activity of each month of the year, or for the account type of Taobao account , respectively determine the historical activity of each month of this year when the transaction type is withdrawal and deposit. The foregoing is only an example, and this embodiment of the present invention does not limit it.
采集业务系统中全年的TPS,TPS主要采用日志采集的方法,通过日志分析得出该业务系统中的TPS,有效账户数采用数据库采集的方法,以每日日终有效账户数量为当日的有效账户数。Collect the TPS of the whole year in the business system. TPS mainly adopts the method of log collection. The TPS in the business system is obtained through log analysis. The number of valid accounts is collected by the database. The number of valid accounts at the end of each day is the effective number of accounts.
可选地,采集业务系统中全年的TPS时可以对数据进行筛选。一个业务系统全年当中可能会因为内部系统机器故障、系统内部生产压测、关联方故障等原因,导致整体交易量突增或者突降,从而影响历史活跃度。我们的模型计算必须是在账户自然活跃的情况下进行,否则会影响整体的可靠性,这就需要剔除这些毛刺点,剔除之后才能得到全年整体的自然活跃情况下的历史活跃度。例如可以根据服务器性能指标进行筛选,通过对服务器性能指标如CPU使用率、内存使用率等的监 控,确定服务器性能指标异常的时刻为机器故障时刻,那么将故障时刻的TPS进行剔除;还可以由人工录入故障时刻,例如系统内部生产压测、关联方故障等非常规时间段可以由人工录入时间点进行剔除。Optionally, the data can be screened when collecting the annual TPS in the business system. A business system may have a sudden increase or decrease in the overall transaction volume throughout the year due to internal system machine failures, system internal production pressure testing, related party failures, etc., thereby affecting historical activity. Our model calculation must be carried out when the account is naturally active, otherwise it will affect the overall reliability. This requires removing these glitches. Only after removing these glitches can we get the historical activity under the overall natural activity throughout the year. For example, it can be screened according to server performance indicators. By monitoring server performance indicators such as CPU usage and memory usage, it is determined that the time when the server performance indicators are abnormal is the time of machine failure, and then the TPS at the time of failure is eliminated; it can also be determined by Manually enter the failure time, such as the internal production pressure test of the system, related party failure and other unconventional time periods, which can be eliminated by manually entering the time point.
针对账户类型为淘宝账户,交易类型为出金的统计维度,获取淘宝账户今年一年中各月的有关出金的历史TPS,例如,1月份有31天,每天有24个小时,每小时有60分钟,每分钟有60s,则对于每一天,可以得到24*60*60个TPS,在这些TPS中确定一个最高TPS作为当日最高TPS,再在31个当日最高TPS中确定一个当月最高TPS作为1月份的历史TPS;同理,可得2月份、3月份……12月份的历史TPS。获取当月的有效账户数,例如可以为最后一天的有效账户数,也可以为当月的最高账户数。将当月的有效账户数作为第一账户数。根据每个月的历史TPS和每个月的第一账户数,确定淘宝账户在今年一年中各月的有关出金的历史活跃度,具体为,每个月的历史TPS除以每个月的第一账户数,得到各月的历史活跃度。图2A示出了一种可能的淘宝账户有关出金的各个月的历史活跃度的示意图。For the statistical dimension where the account type is Taobao account and the transaction type is gold withdrawal, the historical TPS of Taobao account withdrawals in each month of the year is obtained. For example, there are 31 days in January, 24 hours per day, and 60 minutes, 60s per minute, then for each day, you can get 24*60*60 TPS, determine the highest TPS among these TPS as the highest TPS of the day, and then determine the highest TPS of the month among the 31 highest TPS of the day as Historical TPS in January; similarly, historical TPS in February, March...December. Obtain the number of valid accounts in the current month, for example, the number of valid accounts on the last day, or the highest number of accounts in the current month. The number of valid accounts in the current month is taken as the first number of accounts. According to the historical TPS of each month and the number of the first account of each month, determine the historical activity of the Taobao account in each month of the year, specifically, the historical TPS of each month divided by each month The number of the first account of , get the historical activity of each month. FIG. 2A shows a schematic diagram of a possible monthly historical activity of a Taobao account related to gold withdrawal.
针对账户类型为淘宝账户,交易类型为入金的统计维度,获取淘宝账户今年一年中各月的有关入金的历史TPS,结合各月的第一账户数,可以得到淘宝账户在今年一年中各月的有关入金的历史活跃度,具体的实施方式同淘宝账户的各月的有关出金的历史活跃度的确定方式,在此不做赘述。For the statistical dimension that the account type is Taobao account and the transaction type is gold deposit, the historical TPS related to the deposit of Taobao account in each month of this year is obtained, and combined with the number of first accounts in each month, we can get the Taobao account in this year. The specific implementation method of the monthly historical activity related to the deposit is the same as the method of determining the historical activity related to the withdrawal of the Taobao account in each month, and will not be repeated here.
针对账户类型为美团账户,交易类型为出金的统计维度,获取美团账户今年一年中各月的有关出金的历史TPS,结合各月的第一账户数,可以得到美团账户在今年一年中各月的有关出金的历史活跃度,具体的实施方式同淘宝账户的各月的有关出金的历史活跃度的确定方式,在此不做赘述。For the statistical dimension that the account type is a Meituan account and the transaction type is withdrawal, the historical TPS of the withdrawal of the Meituan account in each month of the year is obtained, and combined with the number of first accounts in each month, the Meituan account can be obtained. The specific implementation method of the historical activity related to gold withdrawal in each month of this year is the same as the method of determining the historical activity related to gold withdrawal in each month of the Taobao account, and will not be repeated here.
针对账户类型为美团账户,交易类型为入金的统计维度,获取美团账户今年一年中各月的有关入金的历史TPS,结合各月的第一账户数,可以得到美团账户在今年一年中各月的有关入金的历史活跃度,具体的实施方式同淘宝账户的各月的有关出金的历史活跃度的确定方式,在此不做赘述。For the statistical dimension that the account type is a Meituan account and the transaction type is a deposit, the historical TPS of the Meituan account for each month of this year is obtained. The specific implementation method of the historical activity related to the deposit in each month of the year is the same as the method of determining the historical activity related to the withdrawal of the Taobao account in each month, and will not be repeated here.
至此,得到了业务系统中,4个统计维度在各历史时段的历史活跃度。每个统计维度在各历史时段的历史活跃度的变化趋势是不同的,因此需要分别进行分析。So far, the historical activity of the four statistical dimensions in each historical period in the business system has been obtained. The change trend of the historical activity of each statistical dimension in each historical period is different, so it needs to be analyzed separately.
针对账户类型为淘宝账户,交易类型为出金的统计维度,图2A示出了一种可能的淘宝账户有关出金的各个月的历史活跃度的示意图,12个月的历史活跃度数据是一组散点数据,根据该组散点数据,确定该统计维度中,各历史时段的历史活跃度的规律特征。然后根据规律特征,确定各预测时段的预测活跃度,即,实现了通过对今年12个月的历史活跃度进行分析,确定了明年12个月的预测活跃度。For the statistical dimension where the account type is Taobao account and the transaction type is gold withdrawal, Figure 2A shows a possible schematic diagram of the monthly historical activity of Taobao account related to gold withdrawal. The historical activity data of 12 months is a A group of scattered point data, according to the group of scattered point data, determine the regular characteristics of the historical activity of each historical period in the statistical dimension. Then, according to the regular characteristics, the forecast activity in each forecast period is determined, that is, the forecast activity in the next 12 months is determined by analyzing the historical activity in the 12 months of this year.
具体地,本发明实施例提供两种确定各预测时段的预测活跃度的方法。Specifically, the embodiment of the present invention provides two methods for determining the forecast activity in each forecast period.
方式一method one
通过一系列的曲线模型来对各历史时段的历史活跃度进行拟合,例如可以为线性模型、对数模型、幂函数模型或指数模型等曲线模型。The historical activity of each historical period is fitted through a series of curve models, such as linear models, logarithmic models, power function models, or exponential models.
(1)通过线性模型进行拟合(1) Fitting by linear model
例如可以通过最小二乘法的方式进行拟合。Fitting can be performed, for example, by the method of least squares.
线性方程的公式为:The formula for the linear equation is:
y=a+bx (1)y=a+bx (1)
在这个公式中,a、b都是任意实数,x为时间线,y为我们想要得到的历史活跃度,想要求得这个一元一次方程,就必须确定实数a、b的值。将实际的历史活跃度值设定为yi,利用公式得到的近似值为Yi,我们希望得到的公式计算出来的历史活跃度和实际的历史活跃度之间的差值越小越好,也就是说我们求直线回归方程式的过程其实就是求离差yi-Yi最小值的过程,但是离差的值求 出来有正有负,直接相加会抵消导致无法反应数据的真实贴近度,所以这个离差不能直接用相减的值再求和得到,如下公式2:In this formula, a and b are arbitrary real numbers, x is the timeline, and y is the historical activity we want to obtain. If we want to obtain this unary linear equation, we must determine the values of the real numbers a and b. Set the actual historical activity value as yi, and the approximate value obtained by using the formula is Yi. We hope that the smaller the difference between the historical activity calculated by the formula and the actual historical activity, the better, that is to say Our process of finding the linear regression equation is actually the process of finding the minimum value of the dispersion yi-Yi, but the value of the dispersion can be positive or negative, and direct addition will cancel out the true closeness of the data, so this dispersion It cannot be directly obtained by summing the subtracted values, as shown in the following formula 2:
而是应该得到离差的平方和最小为优化依据,如下公式3:Instead, the minimum sum of squares of the dispersion should be the basis for optimization, as shown in Formula 3 below:
把公式1带入公式3中得公式4:Put formula 1 into formula 3 to get formula 4:
当离差的平方和Q 2达到最小时,回归得到的直线就是离我们实际数据整体偏移度最小的直线。 When the sum of squared deviations Q 2 reaches the minimum, the straight line obtained by regression is the straight line with the smallest deviation from our actual data as a whole.
接下来需要设定x的平均值为 公式5: Next, we need to set the mean value of x as Formula 5:
y的平均值为 公式6: The average value of y is Formula 6:
根据公式4得公式7:According to formula 4, formula 7 is obtained:
接下来对上面的公式进行分解简化Next, decompose and simplify the above formula
① ①
求解过程:Solving process:
② ②
求解过程:Solving process:
所以根据①②两个公式可以简化公式7Therefore, according to the two
至此可以得到最后两项 与a、b无关,属于常数项,想要让R 2最小,那么就必须让前面与a、b相关的多项式尽量小,最好是等于0,即 So far we can get the last two It has nothing to do with a and b and is a constant term. If you want to minimize R 2 , you must make the previous polynomials related to a and b as small as possible, preferably equal to 0, that is
③ ③
④ ④
由③得 from ③
由④得 From ④
由此则可以根据已知的所有散点(x i,y i)的值得出线性方程式a、b的值,从而得出线性回归方程式y=a+bx。 Therefore, the values of the linear equations a and b can be obtained according to the known values of all scattered points ( xi , y i ), so as to obtain the linear regression equation y=a+bx.
(2)对数模型(2) Logarithmic model
对数函数定义如下The logarithmic function is defined as follows
y=a+blnxy=a+blnx
其中lnx表示对x取自然数的对数,是非线性的。为了简化计算,我们可以对对数这种非线性的模型进行线性化处理Among them, lnx represents the logarithm of the natural number of x, which is nonlinear. In order to simplify the calculation, we can linearize the nonlinear model of the logarithm
令x *=lnx Let x * = lnx
那么对于变量y和x *,即y和lnx已经转换为线性的关系,其中a、b为需要求得的系数。 Then for the variables y and x * , that is, y and lnx have been transformed into a linear relationship, where a and b are the coefficients to be obtained.
转化为线性关系后,则可以通过线性回归的算法求得a、b的值。After converting into a linear relationship, the values of a and b can be obtained through the linear regression algorithm.
(3)幂函数模型(3) Power function model
幂函数的定义如下The power function is defined as follows
y=ax b y=ax b
同样的其中a、b为我们需要求得的常数,x和y的关系也是非线性的,为了简化计算,对公式两边同时取自然数对数得Similarly, a and b are the constants we need to obtain, and the relationship between x and y is also nonlinear. In order to simplify the calculation, take the logarithm of the natural numbers on both sides of the formula at the same time to get
lny=lna+blnxlny=lna+blnx
令y *=lny,a *=lna,x *=lnx Let y * =lny, a * =lna, x * =lnx
公式可转换为y *=a *+bx *,其中a *、b为待估参数,x *、y *程线性关系,可根据线性回归得 出a、b的值和计算公式。 The formula can be converted into y * = a * + bx * , where a * and b are parameters to be estimated, and x * and y * are linearly related. The values and calculation formulas of a and b can be obtained according to linear regression.
(4)指数函数模型(4) Exponential function model
指数函数定义如下The exponential function is defined as follows
y=ae bx y=ae bx
其中a、b两个为常数,x、y的关系也是非线性的,对公式两边取自然数对数得Among them, a and b are constants, and the relationship between x and y is also nonlinear. Take the logarithm of the natural numbers on both sides of the formula to get
lny=lna+bxlny=lna+bx
令y *=lny,a *=lna,则 Let y * =lny, a * =lna, then
y *=a *+bx y * = a * + bx
其中a *、b为待估参数,x、y *程线性关系,可根据线性回归得出结果值。 Among them, a * and b are the parameters to be estimated, and x and y * are in a linear relationship, and the result value can be obtained according to the linear regression.
通过上述一系列的曲线模型来对各历史时段的历史活跃度进行拟合,不同的曲线模型得到不同的a、b结果值,这里需要进一步分析得到的结果来判定我们得到的曲线是否趋近于给出的散点数据,y i为第i个散点数据的实际值,Y i为根据得到的公式计算出第i个值, 为所有实际散点y i的平均值。那么, The historical activity of each historical period is fitted through the above series of curve models. Different curve models get different a and b result values. Here we need to further analyze the results to determine whether the curve we get is close to For the given scatter data, y i is the actual value of the i scatter data, and Y i is the i value calculated according to the obtained formula, is the average value of all actual scatter points y i . So,
总平方和 total sum of squares
解释平方和 explain sum of squares
判定系数 coefficient of determination
当判定系数R 2=1时,成为完美拟合,表示由公式计算得到的数据与我们实际给到的散点数据完全重合,但这个很难实现,因为自然界的事物都存在一定的误差,当判定系数R 2→1时,则表示我们计算模型得到的公式越准确。所以根据以上的几种曲线模型得出模型公式后,可以计算出每种模型的R 2值,R 2的值越趋近于1,则越是我们想要得到的拟合曲线。符合设定条件的拟合曲线即为明年淘宝账户有关出金的各个月的预测活跃度。 When the determination coefficient R 2 =1, it becomes a perfect fit, which means that the data calculated by the formula completely coincides with the scatter data we actually give, but this is difficult to achieve, because there are certain errors in things in nature, when When the coefficient of determination R 2 →1, it means that the formula obtained by our calculation model is more accurate. Therefore, after obtaining the model formula based on the above several curve models, the R 2 value of each model can be calculated. The closer the R 2 value is to 1, the more fitting curve we want to obtain. The fitting curve that meets the set conditions is the predicted activity of the Taobao account for each month related to the withdrawal of funds in the next year.
通过上述方法得到的明年各个月的预测活跃度和今年各个月的历史活跃度并不会是完全相同,而是根据历史活跃度的变化趋势得到的,能够更加科学地反映预测活跃度地变化规律。The predicted activity of each month of next year and the historical activity of each month of this year obtained through the above method will not be exactly the same, but are obtained according to the change trend of historical activity, which can more scientifically reflect the change law of predicted activity .
方式二way two
在实践中,大部分的历史活跃度的变化趋势可能不会是如方式一中所说的标准的拟合曲线,也就是说我们计算的出来的R
2值跟1的差距都很远,那么可以对该统计维度在各历史时段的历史活跃度进行区间分段,分别进行分析。
In practice, most of the historical activity trends may not be the standard fitting curve as mentioned in
例如,将历史活跃度按照时间划分为不同的时间段,例如将12个月划分为4个区间,每个区间通过方式一进行曲线拟合。For example, divide historical activity into different time periods according to time, for example, divide 12 months into 4 intervals, and perform curve fitting on each interval through
例如,还可以按照日常消费日和特殊节假日进行区间分段。图2B示出了一种可能的针对淘宝账户关于出金的全年历史活跃度的变化趋势,可以看出,除了春节、中秋节、元旦节、214情人节、520情人节等几个特殊的节假日之外,该账户类型的出金账户数据趋势基本一致,也就是说日常时间段内历史活跃度基本保持在一个稳定的区间内;节假日时间段内历史活跃度基本保持在一个稳定的区间内。这就需要把日常消费日、特殊节假日的历史活跃度分开来进行模型计算。For example, interval segmentation can also be performed according to daily consumption days and special holidays. Figure 2B shows a possible change trend of the annual historical activity of Taobao accounts for withdrawals. It can be seen that, in addition to several special events such as Spring Festival, Mid-Autumn Festival, New Year’s Day, 214 Valentine’s Day, and 520 Valentine’s Day, etc. Except for holidays, the data trend of the withdrawal account of this account type is basically the same, that is to say, the historical activity during the daily time period is basically maintained within a stable range; during the holiday time period, the historical activity is basically maintained within a stable range . This requires separating the historical activity of daily consumption days and special holidays for model calculation.
将图2B中的日常消费日及对应的历史活跃度提取出来,得到图3A,可以看出,针对淘宝账户,有关出金的历史活跃度在0.5835-0.7886之间浮动,则确定浮动比例=(最高历史活跃度-最低历史活跃度)/最低历史活跃度,那么在本例中,浮动比例为35.15%。然后根据浮动比例确定浮动系数作为预测模式,将浮动系数a1确定为(浮动范围+1),在本例中,浮动系数为1.3515。Extract the daily consumption days and the corresponding historical activity in Figure 2B, and get Figure 3A. It can be seen that for Taobao accounts, the historical activity related to withdrawals fluctuates between 0.5835-0.7886, and the floating ratio is determined =( Highest historical activity - lowest historical activity)/lowest historical activity, then in this example, the floating ratio is 35.15%. Then determine the floating coefficient according to the floating ratio as the prediction mode, and determine the floating coefficient a1 as (floating range+1), in this example, the floating coefficient is 1.3515.
然后将图3A中的今年的历史活跃度乘以浮动系数a1,可得淘宝账户的、有关出金的日常消费 日的明年的预测活跃度,如图3B。Then multiply the historical activity of this year in Figure 3A by the floating coefficient a1 to get the predicted activity of the Taobao account and the daily consumption day related to withdrawal next year, as shown in Figure 3B.
将图2B中的特殊节假日及对应的历史活跃度提取出来,得到图3C,可以看出,针对淘宝账户,有关出金的历史活跃度在0.9-3.48之间浮动,则通过相同的方式确定浮动系数b1=2.87。Extract the special holidays and the corresponding historical activity in Figure 2B, and get Figure 3C. It can be seen that for Taobao accounts, the historical activity related to withdrawals fluctuates between 0.9-3.48, and the fluctuation is determined in the same way. Coefficient b1=2.87.
然后将图3C中的今年各个月的历史活跃度乘以浮动系数b1,可得淘宝账户的、有关出金的特殊节假日的明年的预测活跃度,如图3D。Then multiply the historical activity of each month of this year in Figure 3C by the floating coefficient b1 to get the predicted activity of the Taobao account and the special holidays related to cash withdrawal next year, as shown in Figure 3D.
将图3B和图3D进行合并,可得淘宝账户的、有关出金的明年的预测活跃度,如图3E。Combining Figure 3B and Figure 3D, we can get the predicted activity of Taobao account related to withdrawal in the next year, as shown in Figure 3E.
通过上述方法充分考虑到了在日常消费日和特殊节假日时用户的消费习惯,通过对用户的消费习惯进行针对性地分析,可以更加准确地确定明年的预测活跃度。The above method fully takes into account the user's consumption habits on daily consumption days and special holidays, and through targeted analysis of the user's consumption habits, it is possible to more accurately determine the predicted activity of the next year.
以上为本发明实施例给出的两种确定预测活跃度的方法,根据上述方法,可以分别确定其他统计维度,如账户类型为淘宝+交易类型为入金、账户类型为美团+交易类型为出金、账户类型为美团+交易类型为入金的明年的预测活跃度。The above are the two methods for determining the forecast activity given by the embodiment of the present invention. According to the above methods, other statistical dimensions can be determined respectively, such as account type is Taobao + transaction type is deposit, account type is Meituan + transaction type is withdrawal Gold, the account type is Meituan + the transaction type is the forecast activity of deposit next year.
在确定了各个统计维度的明年的预测活跃度后,再根据各统计维度在各预测时段的第二账户数,确定各统计维度在各预测时段的预测TPS。After determining the forecast activity of each statistical dimension for next year, the predicted TPS of each statistical dimension in each forecast period is determined according to the second account number of each statistical dimension in each forecast period.
第二账户数为业务人员根据明年的业务推广需求输入的,业务人员将明年各预测时段的第二账户数输入模型,例如对于淘宝账户,各预测时段的第二账户数为1万、2万、2万……,对于美团账户,各预测时段的第二账户数为3万、1万、2万……。那么,针对前面确定的4种不同的统计维度,可结合第二账户数分别确定预测TPS。The number of second accounts is input by business personnel according to the business promotion needs of next year, and the business personnel will input the number of second accounts in each forecast period next year into the model. For example, for Taobao accounts, the number of second accounts in each forecast period is 10,000 and 20,000 . Then, for the four different statistical dimensions determined above, the predicted TPS can be respectively determined in combination with the second account number.
例如,对于淘宝账户的有关出金的预测活跃度,将得到的各预测时段的预测活跃度分别与对应的各预测时段的第二账户数(1万、2万、2万…)相乘,可得淘宝账户的有关出金的各预测时段的预测TPS。同理,对于淘宝账户的有关入金的预测活跃度,将得到的各预测时段的预测活跃度分别与对应的各预测时段的第二账户数(1万、2万、2万…)相乘,可得淘宝账户的有关入金的各预测时段的预测TPS。对于美团账户的有关出金的预测活跃度,将得到的各预测时段的预测活跃度分别与对应的各预测时段的第二账户数(3万、1万、2万…)相乘,可得美团账户的有关出金的各预测时段的预测TPS。对于美团账户的有关入金的预测活跃度,将得到的各预测时段的预测活跃度分别与对应的各预测时段的第二账户数(3万、1万、2万…)相乘,可得美团账户的有关入金的各预测时段的预测TPS。For example, for the predicted activity of the Taobao account related to gold withdrawal, the obtained predicted activity of each forecast period is multiplied by the second account number (10,000, 20,000, 20,000...) of each corresponding forecast period, You can get the predicted TPS of Taobao account for each forecast period related to withdrawal. Similarly, for the predicted activity of Taobao account related to the deposit, the obtained predicted activity of each forecast period is multiplied by the corresponding number of second accounts (10,000, 20,000, 20,000...) in each forecast period, You can get the predicted TPS of Taobao account for each forecast period related to the deposit. For the predicted activity of the Meituan account related to withdrawal, the predicted activity of each forecast period obtained is multiplied by the number of second accounts (30,000, 10,000, 20,000...) corresponding to each forecast period, which can be obtained The predicted TPS of each forecast period for the withdrawal of the Meituan account. For the predicted activity of the Meituan account related to the deposit, multiply the obtained predicted activity of each forecast period by the number of second accounts (30,000, 10,000, 20,000...) corresponding to each forecast period to get The forecasted TPS of each forecast period for the deposit of the Meituan account.
至此,得到了4个统计维度在各预测时段的预测TPS。然后将各个统计维度在各预测时段的预测TPS按照相同的预测时段进行叠加,可得该业务系统在各个预测时段的叠加预测TPS。通过该叠加预测TPS除以单服务器的可承载TPS即单机TPS可以直接确定服务器的容量。So far, the predicted TPS of the four statistical dimensions in each forecast period has been obtained. Then, the predicted TPS of each statistical dimension in each forecast period is superimposed according to the same forecast period, and the superimposed predicted TPS of the business system in each forecast period can be obtained. The capacity of the server can be directly determined by dividing the superimposed predicted TPS by the loadable TPS of a single server, that is, the single-machine TPS.
但是,回溯该叠加预测TPS的确定过程,我们可以发现,该叠加预测TPS是偏大的。因为我们区分了不同的统计维度,而在每个统计维度中,都选取了当月的最高TPS作为该统计维度的历史TPS,而在该业务系统正常运行时,这4个统计维度的当月最高TPS往往不是同时产生的,这就会导致叠加预测TPS的值偏大。例如,美团账户可能是17点达到的最高TPS为5,淘宝账户在2点得到最高TPS为6,但是整个业务系统是在18点达到最高TPS为10,那么简单地将美团账户的最高TPS与淘宝账户的最高TPS进行叠加得到的11,相对于业务系统的最高TPS为10而言,是偏大的。因此我们需要进一步对叠加预测TPS的值进行修正,得到可信预测TPS。However, looking back at the determination process of the superimposition predicted TPS, we can find that the superimposed predicted TPS is too large. Because we distinguish between different statistical dimensions, and in each statistical dimension, the highest TPS of the month is selected as the historical TPS of the statistical dimension, and when the business system is running normally, the highest TPS of the month for these four statistical dimensions It is often not generated at the same time, which will cause the value of the superimposed predicted TPS to be too large. For example, the Meituan account may reach a maximum TPS of 5 at 17 o'clock, and the Taobao account may achieve a maximum TPS of 6 at 2 o'clock, but the entire business system reaches a maximum TPS of 10 at 18 o'clock, then simply set the highest TPS of the Meituan account The 11 obtained by superimposing TPS and the highest TPS of the Taobao account is relatively large compared to the highest TPS of the business system which is 10. Therefore, we need to further correct the value of the superimposed predicted TPS to obtain a credible predicted TPS.
我们知道,叠加预测TPS和可信预测TPS之间一定存在某种转换关系,该转换关系可以通过对历史数据进行分析得到。We know that there must be a conversion relationship between the superimposed forecast TPS and the credible forecast TPS, and this conversion relationship can be obtained by analyzing historical data.
具体为,首先将各统计维度在各历史时段的历史TPS进行叠加,得到各历史时段的叠加历史TPS。然后确定该业务系统(即不区分统计维度)在各历史时段的可信历史TPS,根据各历史时段 的叠加历史TPS和可信历史TPS确定转换关系K。Specifically, firstly, the historical TPS of each statistical dimension in each historical period is superimposed to obtain the superimposed historical TPS of each historical period. Then determine the credible historical TPS of the business system (that is, without distinguishing statistical dimensions) in each historical period, and determine the conversion relationship K according to the superimposed historical TPS and credible historical TPS in each historical period.
举个例子,首先确定淘宝账户有关出金的统计维度在今年的各历史时段的历史TPS1,淘宝账户有关入金的统计维度在今年的各历史时段的历史TPS2,美团账户有关出金的统计维度在今年的各历史时段的历史TPS3,美团账户有关入金的统计维度在今年的各历史时段的历史TPS4,将4个统计维度的各历史时段的历史TPS按照相同的历史时段进行叠加,得到叠加历史TPS。然后不区分统计维度,确定该业务系统在今年的各历史时段的可信历史TPS。针对每一个历史时段,用可信历史TPS除以叠加历史TPS,可得转换关系K,图4示出了一种可能的得到的转换关系K的示意图,如图所示,每一个历史时段都会有一个相应的叠加历史TPS和可信历史TPS的转换关系K,即图4中的纵坐标。For example, first determine the historical TPS1 of the statistical dimension of the withdrawal of Taobao account in each historical period of this year, the historical TPS2 of the statistical dimension of deposit of Taobao account in each historical period of this year, and the statistical dimension of withdrawal of Meituan account In the historical TPS3 of each historical period of this year, the historical TPS4 of the statistical dimension of Meituan account deposits in each historical period of this year, the historical TPS of each historical period of the 4 statistical dimensions are superimposed according to the same historical period, and the superposition is obtained Historical TPS. Then, without distinguishing the statistical dimension, determine the credible historical TPS of the business system in each historical period of this year. For each historical period, divide the trusted historical TPS by the superimposed historical TPS to obtain the conversion relationship K. Figure 4 shows a schematic diagram of a possible conversion relationship K. As shown in the figure, each historical period will There is a corresponding conversion relationship K between superimposed historical TPS and credible historical TPS, that is, the ordinate in Fig. 4 .
我们认为针对历史数据进行分析得到的转换关系依然可以适用于针对未来的数据进行分析得到的结果,即,叠加预测TPS和可信预测TPS之间依然满足这个转换关系。We believe that the conversion relationship obtained from the analysis of historical data can still be applied to the results obtained from the analysis of future data, that is, the conversion relationship between the superimposed predicted TPS and the credible predicted TPS is still satisfied.
可知,K越大,则得到的可信预测TPS的值越大,为了保证在预测时段部署的服务器的数量足够多不至于系统崩溃,因此在上述多个转换关系中,确定一个最大值为最终的转换关系,如图4中的0.9976。It can be seen that the larger K is, the larger the value of the trusted predicted TPS will be. In order to ensure that the number of servers deployed during the prediction period is large enough to prevent the system from crashing, in the above-mentioned multiple conversion relationships, a maximum value is determined as the final The conversion relationship, such as 0.9976 in Figure 4.
那么将在前文中得到叠加预测TPS乘以转换关系K,可得该业务系统在各预测时段的可信预测TPS。例如可以得到该业务系统明年每个月的可信预测TPS,或明年每一天的可信预测TPS。图5示出了一种可能的各预测时段的可信预测TPS的示意图。Then, the superimposed forecasted TPS multiplied by the conversion relationship K can be obtained in the above, and the credible forecasted TPS of the business system in each forecast period can be obtained. For example, the credible predicted TPS of the business system every month in the next year, or the credible predicted TPS of every day in the next year can be obtained. FIG. 5 shows a schematic diagram of a possible trusted prediction TPS for each prediction period.
将各预测时段的可信预测TPS除以单机TPS,即可确定该业务系统在各预测时段的服务器容量。Divide the trusted predicted TPS of each forecast period by the stand-alone TPS to determine the server capacity of the business system in each forecast period.
具体的,单机TPS可以通过如下方式确定:Specifically, the stand-alone TPS can be determined as follows:
方式一method one
根据业务系统在各历史时段采集的服务器性能指标,确定服务器的单机TPS,服务器性能指标是衡量一个业务系统提供服务稳定性的重要指标。包括服务器的CPU使用率、内存使用率、IO使用率和磁盘使用率等等,采集的时间段为全年,时间单位为秒级,采集方法为系统守护进程采集的方式。可以设置一定的阈值条件用于判断服务器的单机TPS。例如当CPU使用率达到了80%时,将对应时刻的TPS作为单个服务器的可承载的TPS,即单机TPS。According to the server performance index collected by the business system in each historical period, the stand-alone TPS of the server is determined. The server performance index is an important index to measure the stability of the service provided by a business system. Including the server's CPU usage, memory usage, IO usage, and disk usage, etc., the collection time period is the whole year, the time unit is second level, and the collection method is the system daemon process collection method. You can set a certain threshold condition to judge the stand-alone TPS of the server. For example, when the CPU utilization rate reaches 80%, the TPS at the corresponding moment is taken as the TPS that can be carried by a single server, that is, the stand-alone TPS.
方式二way two
借助压测系统对业务系统服务器进行容量压测,同样可以得出在交易成功率、时延都正常的情况下,服务器的单机TPS。With the help of the pressure test system, the capacity pressure test of the business system server can also be used to obtain the stand-alone TPS of the server under the condition that the transaction success rate and delay are normal.
一般的业务系统都有日志冷备功能,产生的日志文件都可以上传到云端保存,本地服务器磁盘使用率都不是很高,所以磁盘这一项性能是可以通过代码和业务逻辑优化的,不需要考虑在内。General business systems have a log cold backup function, and the generated log files can be uploaded to the cloud for storage. The disk usage rate of the local server is not very high, so the performance of the disk can be optimized through code and business logic. within consideration.
至此,得到了该业务系统在各预测时段的服务器容量,图6示出了一种可能的该业务系统在明年每个月的服务器容量的示意图,运维人员可以根据得出的服务器容量的结果进行采购准备,还可以以月份为单位进行一键动态扩缩容,在保证系统服务器性能可以承载所有业务需求的前提下,节省资源和运维成本。So far, the server capacity of the business system in each forecast period has been obtained. Figure 6 shows a possible schematic diagram of the server capacity of the business system in each month of the next year. The operation and maintenance personnel can obtain the results of the server capacity based on To prepare for procurement, you can also perform one-click dynamic expansion and contraction on a monthly basis, saving resources and operation and maintenance costs on the premise of ensuring that the performance of the system server can carry all business needs.
可选地,在得到各预测时段的可信预测TPS后,还可将该可信预测TPS与业务发展需求进行比较,并根据比较结果及时调整推广节奏。例如,若1月份的可信预测TPS为40000,但是公司对该业务系统的业务发展需求为1月份的最高TPS达到50000,则为了达到该业务发展需求,可以加大推广力度,通过增加第二账户数来提高可信预测TPS。如果可信预测TPS超出业务推广预期,则可以减小推广力度,减小新增的第二账户数。Optionally, after obtaining the credible forecast TPS of each forecast period, the credible forecast TPS can also be compared with the business development demand, and the promotion rhythm can be adjusted in time according to the comparison result. For example, if the credible forecast TPS in January is 40,000, but the company's business development demand for the business system is that the highest TPS in January reaches 50,000, then in order to meet the business development demand, you can increase the promotion efforts by increasing the second The number of accounts is used to improve the trusted prediction TPS. If the credible forecast TPS exceeds the business promotion expectation, the promotion efforts can be reduced and the number of newly added second accounts can be reduced.
但是,上述方案并没有考虑到一个业务系统可能存在的各种软硬件故障,因此得到的服务器容量不足以应对业务系统可能出现的各种环境变化。因此可以进一步优化。However, the above solution does not take into account various software and hardware failures that may exist in a business system, so the obtained server capacity is not enough to cope with various environmental changes that may occur in the business system. Therefore it can be further optimized.
图7示出了一种可能的该业务系统的机房环境示意图,包括3个机房,每个机房中设置了2台物理机,每台物理机上均会部署若干台服务器。假设,每台物理机上均部署了最多的服务器(n台)。可以从如下3种角度对服务器容量进行优化。Fig. 7 shows a schematic diagram of a possible computer room environment of the business system, including 3 computer rooms, each of which is equipped with 2 physical machines, and several servers are deployed on each physical machine. It is assumed that a maximum number of servers (n sets) are deployed on each physical machine. Server capacity can be optimized from the following three perspectives.
(1)考虑单物理机单次故障交易损失阈值(1) Consider the transaction loss threshold for a single failure of a single physical machine
一般情况下物理机都存在一定的故障率,衡量一个业务系统服务是否达标,通常会设定一个单次故障交易损失阈值(B 单次),也就是单物理机的故障能影响的最多交易量。 Generally, physical machines have a certain failure rate. To measure whether a business system service is up to standard, a single failure transaction loss threshold (B single time ) is usually set, which is the maximum transaction volume that can be affected by a single physical machine failure. .
其中,T max为可信预测TPS,N为服务器容量,s为单物理机最大故障时间,n为每台物理机上部署的服务器的台数。那么在上式中,可信预测TPS除以该业务系统的服务器容量,可得该业务系统中每台服务器应该承载的TPS,再乘以n可得该业务系统中每台单物理机应该处理的TPS,因为我们认为一般来说在故障s秒后,运维人员即会发现该故障的物理机并进行维修或更换,那么在这故障的s秒里该单物理机损失的交易量即可用 来表示,那么单物理机损失的交易量应该小于单次故障交易损失阈值(B 单次)。 Among them, T max is the trusted predicted TPS, N is the server capacity, s is the maximum failure time of a single physical machine, and n is the number of servers deployed on each physical machine. Then in the above formula, the credible predicted TPS is divided by the server capacity of the business system, and the TPS that each server in the business system should carry can be obtained, and then multiplied by n to obtain the TPS that each single physical machine in the business system should handle TPS, because we believe that generally speaking, after s seconds of failure, the operation and maintenance personnel will find the failed physical machine and repair or replace it, then the transaction volume lost by the single physical machine within s seconds of the failure can be used To represent, then the transaction volume lost by a single physical machine should be less than the transaction loss threshold for a single failure (B single ).
对上述公式进行变形,即得到服务器容量的第一范围:Transform the above formula to obtain the first range of server capacity:
(2)考虑单机房故障容灾(2) Consider single room failure disaster recovery
考虑到容灾的情况,业务系统会部署在几个不同的机房,以避免单机房故障导致整个系统瘫痪。也就是说,任意一个机房故障,剩余的机器都要能够支撑交易高峰,这样就需要冗余一个机房的机器数,每个机房部署的机器越平均,冗余的机器数越少,故此最好是所有机房平均分配,即Considering the situation of disaster recovery, the business system will be deployed in several different computer rooms to avoid the failure of a single computer room to cause the entire system to be paralyzed. That is to say, if any computer room fails, the remaining machines must be able to support the transaction peak. In this way, the number of machines in a computer room needs to be redundant. The more average the machines deployed in each computer room, the fewer redundant machines, so it is best is the average distribution of all computer rooms, that is
其中,L 机房为该业务系统的机房数,当一个机房发生故障时,剩余的服务器容量即 也应能够满足该业务系统的可信预测TPS的需求,即 其中,T 单机为单机TPS。 Among them, L computer room is the number of computer rooms of the business system. When a computer room fails, the remaining server capacity is It should also be able to meet the needs of the trusted predictive TPS of the business system, namely Among them, T stand-alone is stand-alone TPS.
对上述公式进行变形,即得到服务器容量的第二范围:Transform the above formula to obtain the second range of server capacity:
(3)考虑服务器性能稳定性(3) Consider server performance stability
考虑到服务器性能的稳定性,不会让服务器满负荷来提供服务,也就是不会让单机长时间承载T 单机的量,这样很容易引起交易超时,所以需要设定一个服务器能稳定提供服务的最高负载率∈,目前本发明的业务系统生产上的机器规划的最高负载率为80%,那么也就是说在任何故障情况下,服务器的负载率都要低于∈, Considering the stability of server performance, the server will not be fully loaded to provide services, that is, the single machine will not be allowed to carry the amount of T single machine for a long time, which will easily cause transaction timeouts, so it is necessary to set a server that can provide services stably The highest load rate ∈, the maximum load rate of the machine planning on the production of the business system of the present invention is 80%, that is to say, in any failure situation, the load rate of the server will be lower than ∈,
对上述公式进行变形,即得到服务器容量的第三范围:Transform the above formula to obtain the third range of server capacity:
可选地,在实际使用中,可以在第一范围内、第二范围内或第三范围内分别确定服务器容量;还可以在第一范围和第二范围内确定服务器容量,还可在第一范围和第三范围内确定服务器容量,本发明实施例对此不做限制。下面示出了根据第一范围和第三范围确定服务器容量的公式:Optionally, in actual use, the server capacity can be determined respectively within the first range, the second range or the third range; the server capacity can also be determined within the first range and the second range, and can also be determined within the first range The server capacity is determined within the scope and the third scope, which is not limited in this embodiment of the present invention. The following shows the formula for determining the server capacity according to the first range and the third range:
那么在得到各预测时段的可信预测TPS(T max)后,将T max带入上述关系式,可得到一个应该在本业务系统中部署的服务器容量的范围,根据该范围可以确定优化后的服务器容量。 Then, after obtaining the credible predicted TPS(T max ) of each forecast period, bring T max into the above relational expression, a range of server capacity that should be deployed in this business system can be obtained, and the optimized TPS can be determined according to this range. server capacity.
本发明实施例提供的预测服务器容量的方法,由于考虑到了用户活跃度在不同时段的不同的变化规律,通过对不同历史时段的历史活跃度的变化规律进行分析确定了各个预测时段的预测活跃度,从而可以在业务系统提供服务的过程中进行动态扩缩容,在保证业务系统最优容量的基础下,配备较少的资源池,在保证业务系统正常有效运行的前提下,可以减少因为不确定系统负载引起的资源过度配备和浪费。The method for predicting server capacity provided by the embodiment of the present invention takes into account the different rules of change of user activity in different time periods, and determines the predicted activity of each forecast period by analyzing the change rules of historical activity in different historical periods , so that dynamic expansion and contraction can be performed in the process of providing services by the business system. On the basis of ensuring the optimal capacity of the business system, fewer resource pools can be equipped, and on the premise of ensuring the normal and effective operation of the business system, it can reduce Identify resource overprovisioning and waste due to system load.
由于对不同的统计维度进行划分,根据不同的统计维度对用户的交易习惯进行分析,对不同的统计维度确定了不同的规律,进一步通过转换关系进行修正,得出的可信预测TPS值会更加准确,更贴近真实的用户行为。Due to the division of different statistical dimensions, the user's trading habits are analyzed according to different statistical dimensions, and different laws are determined for different statistical dimensions, and further corrections are made through the conversion relationship, and the credible predicted TPS value obtained will be more accurate. Accurate and closer to real user behavior.
将单物理机故障、单机房故障、单服务器最高负载率等各种异常情况考虑进去,使得整个业务系统在出现日常故障时能迅速隔离恢复,提供更稳定的服务。Taking into account various abnormal conditions such as single physical machine failure, single computer room failure, and the highest load rate of a single server, the entire business system can be quickly isolated and recovered in the event of daily failures, providing more stable services.
基于相同的技术构思,图8示例性的示出了本发明实施例提供的一种预测服务器容量的装置的结构,该结构可以执行预测服务器容量的流程。Based on the same technical concept, FIG. 8 exemplarily shows the structure of an apparatus for predicting server capacity provided by an embodiment of the present invention, and the structure can execute a process of predicting server capacity.
如图8所示,该装置具体包括:As shown in Figure 8, the device specifically includes:
确定单元801,用于:A determining
针对业务系统中的任一统计维度,对所述统计维度在各历史时段的历史活跃度进行分析,确定符合所述统计维度在各历史时段的历史活跃度的规律特征;For any statistical dimension in the business system, analyze the historical activity of the statistical dimension in each historical period, and determine the regular characteristics of the historical activity of the statistical dimension in each historical period;
通过各统计维度的规律特征,预测各统计维度在各预测时段的预测每秒交易量TPS,将各统计维度中相同预测时段的预测TPS进行叠加,得到所述业务系统在各预测时段的叠加预测TPS;According to the regular characteristics of each statistical dimension, predict the predicted transaction volume per second TPS of each statistical dimension in each forecast period, and superimpose the predicted TPS of the same forecast period in each statistical dimension to obtain the superposition forecast of the business system in each forecast period TPS;
将所述业务系统在各预测时段的叠加预测TPS,按照转换关系转换为所述业务系统在各预测时段的可信预测TPS;其中,所述转换关系为对所述业务系统在各历史时段的叠加历史TPS和可信历史TPS的关系进行分析得到的;所述叠加历史TPS为将各统计维度中相同历史时段的历史TPS进行叠加得到的;所述可信历史TPS为对所述业务系统在各历史时段的TPS进行分析得到的;Convert the superimposed predicted TPS of the business system in each forecast period into the credible predicted TPS of the business system in each forecast period according to the conversion relationship; wherein, the conversion relationship is the TPS of the business system in each historical period The relationship between the superimposed historical TPS and the credible historical TPS is obtained by analyzing the relationship; the superimposed historical TPS is obtained by superimposing the historical TPS of the same historical period in each statistical dimension; the credible historical TPS is obtained by analyzing the business system in It is obtained by analyzing the TPS of each historical period;
通过所述业务系统在各预测时段的可信预测TPS,确定所述业务系统在各预测时段的服务器容量。The server capacity of the service system in each forecast period is determined through the credible predicted TPS of the service system in each forecast period.
由于用户活跃度在不同的历史时期是会发生变化的,且在不同的统计维度中,变化规律不同,因而通过对业务系统中不同的统计维度中各历史时段的历史活跃度分别进行分析,得到各统计维度 在各历史时段的历史活跃度的规律特征,从而能够更准确地预测各统计维度在各预测时段的预测TPS。再通过对不同统计维度的预测TPS进行叠加,从而进一步确定整个业务系统的叠加预测TPS,如此得到的叠加预测TPS能更加准确地反映不同的统计维度在各预测时段的变化规律。为了进一步提高预测的准确性,通过对业务系统在各历史时段的可信历史TPS和叠加历史TPS的分析,确定二者的转换关系,根据转换关系和叠加预测TPS得到可信预测TPS,如此得到的可信预测TPS的准确性更高。从而能准确地对业务系统在各预测时段的服务器容量进行预测。Since user activity will change in different historical periods, and in different statistical dimensions, the change rules are different, so by analyzing the historical activity of each historical period in different statistical dimensions in the business system, we can get The regular characteristics of the historical activity of each statistical dimension in each historical period can more accurately predict the predicted TPS of each statistical dimension in each forecast period. Then, by superimposing the predicted TPS of different statistical dimensions, the superimposed predicted TPS of the entire business system can be further determined. The superimposed predicted TPS obtained in this way can more accurately reflect the changing rules of different statistical dimensions in each forecast period. In order to further improve the accuracy of the forecast, through the analysis of the credible historical TPS and superimposed historical TPS of the business system in each historical period, the conversion relationship between the two is determined, and the credible predicted TPS is obtained according to the conversion relationship and the superimposed predicted TPS. The credible predicted TPS is more accurate. Therefore, the server capacity of the business system in each forecast period can be accurately predicted.
可选地,所述确定单元具体用于:Optionally, the determining unit is specifically configured to:
将所述统计维度在各历史时段的历史TPS和在各历史时段的第一账户数的商,确定为所述统计维度在各历史时段的历史活跃度。The quotient of the historical TPS of the statistical dimension in each historical period and the number of first accounts in each historical period is determined as the historical activity of the statistical dimension in each historical period.
可选地,所述确定单元具体用于:Optionally, the determining unit is specifically configured to:
对所述统计维度在各历史时段的历史活跃度进行拟合,得到各预设函数对应的拟合曲线;Fitting the historical activity of the statistical dimension in each historical period to obtain a fitting curve corresponding to each preset function;
将各预设函数对应的拟合曲线符合预设条件的拟合曲线,确定为规律特征。A fitting curve corresponding to each preset function conforming to a preset condition is determined as a regular feature.
可选地,所述确定单元具体用于:Optionally, the determining unit is specifically configured to:
若确定不存在符合预设条件的拟合曲线,则对所述统计维度在各历史时段的历史活跃度进行区间分段;If it is determined that there is no fitting curve that meets the preset conditions, the historical activity of the statistical dimension in each historical period is segmented into intervals;
针对任一区间分段,将所述区间分段中各历史活跃度的浮动系数确定为所述区间分段的规律特征;所述浮动系数是根据所述各历史活跃度的浮动比例确定的;所述浮动比例为所述区间分段中历史活跃度的最高值与历史活跃度的最低值的差占所述历史活跃度的最低值的比例。For any interval segment, the floating coefficient of each historical activity in the interval segment is determined as the regular feature of the interval segment; the floating coefficient is determined according to the floating ratio of each historical activity; The floating ratio is the ratio of the difference between the highest value of historical activity and the lowest value of historical activity in the interval segment to the lowest value of historical activity.
可选地,所述确定单元具体用于:Optionally, the determining unit is specifically configured to:
通过各统计维度的规律特征,确定各统计维度在各预测时段的预测活跃度;Determine the forecast activity of each statistical dimension in each forecast period through the regular characteristics of each statistical dimension;
将所述各统计维度在各预测时段的预测活跃度与相同预测时段的第二账户数的积,确定为各统计维度在各预测时段的预测TPS。The product of the forecast activity of each statistical dimension in each forecast period and the second account number in the same forecast period is determined as the predicted TPS of each statistical dimension in each forecast period.
可选地,所述确定单元具体用于:Optionally, the determining unit is specifically configured to:
采集所述业务系统在各历史时段的服务器性能指标,将服务器性能指标符合设定条件时所述服务器承载的TPS确定为所述服务器的单机TPS;Collect the server performance indicators of the business system in each historical period, and determine the TPS carried by the server when the server performance indicators meet the set conditions as the stand-alone TPS of the server;
通过所述可信预测TPS和所述单机TPS确定所述业务系统在各预测时段的服务器容量。The server capacity of the service system in each forecast period is determined through the trusted forecast TPS and the stand-alone TPS.
可选地,所述确定单元具体用于:Optionally, the determining unit is specifically configured to:
根据如下公式确定服务器容量的第一范围:The first range of server capacity is determined according to the following formula:
其中,T max为所述可信预测TPS,N为所述服务器容量,s为单物理机的最大故障时间,n为单物理机上部署的服务器的台数,B 单次为交易损失阈值; Wherein, T max is the trusted predicted TPS, N is the server capacity, s is the maximum failure time of a single physical machine, n is the number of servers deployed on a single physical machine, and B is the transaction loss threshold once ;
在所述服务器容量的第一范围内确定所述服务器容量。The server capacity is determined within the first range of server capacities.
可选地,所述确定单元具体用于:Optionally, the determining unit is specifically configured to:
根据如下公式确定服务器容量的第二范围:The second range of server capacity is determined according to the following formula:
其中,L 机房为所述业务系统的机房数,T 单机为所述单机TPS; Wherein, the L computer room is the number of computer rooms of the business system, and the T stand-alone is the single-machine TPS;
在所述服务器容量的第一范围和所述服务器容量的第二范围内确定所述服务器容量。The server capacity is determined within the first range of server capacities and the second range of server capacities.
可选地,所述确定单元具体用于:Optionally, the determining unit is specifically configured to:
根据如下公式确定服务器容量的第三范围:The third range of server capacity is determined according to the following formula:
其中,∈为所述最高负载率;Wherein, ∈ is the highest load rate;
在所述服务器容量的第一范围和所述服务器容量的第三范围内确定所述服务器容量。The server capacity is determined within the first range of server capacities and the third range of server capacities.
基于相同的技术构思,本申请实施例提供了一种计算机设备,如图9所示,包括至少一个处理器901,以及与至少一个处理器连接的存储器902,本申请实施例中不限定处理器901与存储器902之间的具体连接介质,图9中处理器901和存储器902之间通过总线连接为例。总线可以分为地址总线、数据总线、控制总线等。Based on the same technical concept, the embodiment of the present application provides a computer device, as shown in FIG. 9 , including at least one
在本申请实施例中,存储器902存储有可被至少一个处理器901执行的指令,至少一个处理器901通过执行存储器902存储的指令,可以执行上述预测服务器容量的方法的步骤。In this embodiment of the present application, the
其中,处理器901是计算机设备的控制中心,可以利用各种接口和线路连接计算机设备的各个部分,通过运行或执行存储在存储器902内的指令以及调用存储在存储器902内的数据,从而进行预测服务器容量。可选的,处理器901可包括一个或多个处理单元,处理器901可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器901中。在一些实施例中,处理器901和存储器902可以在同一芯片上实现,在一些实施例中,它们也可以在独立的芯片上分别实现。Among them, the
处理器901可以是通用处理器,例如中央处理器(CPU)、数字信号处理器、专用集成电路(Application Specific Integrated Circuit,ASIC)、现场可编程门阵列或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件,可以实现或者执行本申请实施例中公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者任何常规的处理器等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件处理器执行完成,或者用处理器中的硬件及软件模块组合执行完成。The
存储器902作为一种非易失性计算机可读存储介质,可用于存储非易失性软件程序、非易失性计算机可执行程序以及模块。存储器902可以包括至少一种类型的存储介质,例如可以包括闪存、硬盘、多媒体卡、卡型存储器、随机访问存储器(Random Access Memory,RAM)、静态随机访问存储器(Static Random Access Memory,SRAM)、可编程只读存储器(Programmable Read Only Memory,PROM)、只读存储器(Read Only Memory,ROM)、带电可擦除可编程只读存储器(Electrically Erasable Programmable Read-Only Memory,EEPROM)、磁性存储器、磁盘、光盘等等。存储器902是能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其他介质,但不限于此。本申请实施例中的存储器902还可以是电路或者其它任意能够实现存储功能的装置,用于存储程序指令和/或数据。The
基于相同的技术构思,本发明实施例还提供一种计算机可读存储介质,计算机可读存储介质存储有计算机可执行程序,计算机可执行程序用于使计算机执行上述任一方式所列的预测服务器容量的方法。Based on the same technical concept, an embodiment of the present invention also provides a computer-readable storage medium, the computer-readable storage medium stores a computer-executable program, and the computer-executable program is used to make the computer execute the prediction server listed in any of the above-mentioned methods capacity method.
本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
本申请是参照根据本申请的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to the present application. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a An apparatus for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions The device realizes the function specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded onto a computer or other programmable data processing device, causing a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby The instructions provide steps for implementing the functions specified in the flow chart or blocks of the flowchart and/or the block or blocks of the block diagrams.
显然,本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的精神和范围。这样,倘若本申请的这些修改和变型属于本申请权利要求及其等同技术的范围之内,则本申请也意图包含这些改动和变型在内。Obviously, those skilled in the art can make various changes and modifications to the application without departing from the spirit and scope of the application. In this way, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application is also intended to include these modifications and variations.
Claims (12)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110992903.2 | 2021-08-27 | ||
CN202110992903.2A CN113703974B (en) | 2021-08-27 | 2021-08-27 | Method and device for predicting server capacity |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023024679A1 true WO2023024679A1 (en) | 2023-03-02 |
Family
ID=78655669
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/100509 WO2023024679A1 (en) | 2021-08-27 | 2022-06-22 | Method and apparatus for predicting server capacity |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN113703974B (en) |
WO (1) | WO2023024679A1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113703974B (en) * | 2021-08-27 | 2024-06-25 | 深圳前海微众银行股份有限公司 | Method and device for predicting server capacity |
CN115860257A (en) * | 2022-12-23 | 2023-03-28 | 赛尔网络有限公司 | Data prediction method, device, equipment and medium based on active address of education network |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7222082B1 (en) * | 2000-06-28 | 2007-05-22 | Kronos Technology Systems Limited Partnership | Business volume and workforce requirements forecaster |
CN103490956A (en) * | 2013-09-22 | 2014-01-01 | 杭州华为数字技术有限公司 | Self-adaptive energy-saving control method, device and system based on traffic predication |
CN104778622A (en) * | 2015-04-29 | 2015-07-15 | 清华大学 | Method and system for predicting TPS transaction event threshold value |
CN112269811A (en) * | 2020-10-13 | 2021-01-26 | 北京同创永益科技发展有限公司 | IT capacity prediction method and system based on traffic |
CN113703974A (en) * | 2021-08-27 | 2021-11-26 | 深圳前海微众银行股份有限公司 | Method and device for predicting server capacity |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104123592B (en) * | 2014-07-15 | 2017-10-24 | 清华大学 | Bank's backstage TPS transaction events trend forecasting method and system |
CN104820871B (en) * | 2015-04-30 | 2018-02-09 | 清华大学 | TPS trading volumes predict the method for visualizing and system with threshold range prediction |
CN106549772B (en) * | 2015-09-16 | 2019-11-19 | 华为技术有限公司 | Resource forecasting method, system and capacity management device |
CN107093096B (en) * | 2016-12-15 | 2022-03-25 | 口碑(上海)信息技术有限公司 | Traffic prediction method and device |
CN108874748A (en) * | 2018-06-01 | 2018-11-23 | 交通运输部路网监测与应急处置中心 | A kind of ETC operation indicator prediction technique |
CN109002925A (en) * | 2018-07-26 | 2018-12-14 | 北京京东金融科技控股有限公司 | Traffic prediction method and apparatus |
CN109359758A (en) * | 2018-08-03 | 2019-02-19 | 阿里巴巴集团控股有限公司 | Dealing amount of foreign exchange prediction technique and device |
CN109446041B (en) * | 2018-09-25 | 2022-10-28 | 平安普惠企业管理有限公司 | Server pressure early warning method and system and terminal equipment |
CN109766244A (en) * | 2019-01-04 | 2019-05-17 | 中国银行股份有限公司 | A kind of distributed system CPU method for detecting abnormality, device and storage medium |
CN112633542A (en) * | 2019-09-24 | 2021-04-09 | 顺丰科技有限公司 | System performance index prediction method, device, server and storage medium |
CN112583610B (en) * | 2019-09-27 | 2023-04-11 | 顺丰科技有限公司 | System state prediction method, system state prediction device, server and storage medium |
CN111045907B (en) * | 2019-12-12 | 2020-10-09 | 苏州博纳讯动软件有限公司 | System capacity prediction method based on traffic |
CN111475772B (en) * | 2020-03-27 | 2023-12-15 | 微梦创科网络科技(中国)有限公司 | Capacity assessment method and device |
-
2021
- 2021-08-27 CN CN202110992903.2A patent/CN113703974B/en active Active
-
2022
- 2022-06-22 WO PCT/CN2022/100509 patent/WO2023024679A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7222082B1 (en) * | 2000-06-28 | 2007-05-22 | Kronos Technology Systems Limited Partnership | Business volume and workforce requirements forecaster |
CN103490956A (en) * | 2013-09-22 | 2014-01-01 | 杭州华为数字技术有限公司 | Self-adaptive energy-saving control method, device and system based on traffic predication |
CN104778622A (en) * | 2015-04-29 | 2015-07-15 | 清华大学 | Method and system for predicting TPS transaction event threshold value |
CN112269811A (en) * | 2020-10-13 | 2021-01-26 | 北京同创永益科技发展有限公司 | IT capacity prediction method and system based on traffic |
CN113703974A (en) * | 2021-08-27 | 2021-11-26 | 深圳前海微众银行股份有限公司 | Method and device for predicting server capacity |
Also Published As
Publication number | Publication date |
---|---|
CN113703974A (en) | 2021-11-26 |
CN113703974B (en) | 2024-06-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN114143326B (en) | Load adjustment method, management node, and storage medium | |
US9176789B2 (en) | Capacity control | |
WO2023024679A1 (en) | Method and apparatus for predicting server capacity | |
CN104811344A (en) | Network dynamic service monitoring method and apparatus | |
CN108923996B (en) | A capacity analysis method and device | |
US8396789B1 (en) | Credit-approval decision models | |
CN118152124B (en) | Data processing method and system based on cloud computing | |
CN111260505B (en) | Big data analysis method, device and computer equipment based on power Internet of things | |
US20140379303A1 (en) | Identifying utility resource diversion | |
CN110618867A (en) | Method and device for predicting resource usage amount | |
CN111509700A (en) | A method and device for power grid operation management based on electricity price prediction | |
CN116362865A (en) | Risk early warning decision-making method, device, equipment and medium based on historical lending multi-head data | |
CN116185797A (en) | Method, device and storage medium for predicting server resource saturation | |
CN115018601A (en) | Data processing method, device and equipment | |
CN119887385A (en) | Asset management system, method, computing device, storage medium, and program product | |
CN119668813A (en) | A method, device, equipment, medium and product for processing batch interruption tasks | |
CN117787572B (en) | Abnormal electricity user identification method, device, storage medium and electronic device | |
CN119225980A (en) | Thread pool dynamic adjustment method and device based on configuration center | |
CN116820767A (en) | Cloud resource management method and device, electronic equipment and storage medium | |
CN106470242B (en) | A fast quantitative grading method for large-scale heterogeneous cluster nodes in cloud data centers | |
CN113014412A (en) | Method and system for predicting delay time of downtime fault service | |
CN120583090B (en) | A method and system for eliminating data redundancy of distributed industrial storage equipment | |
CN108182486A (en) | Spatial Load Forecasting method and device | |
CN119596855A (en) | Intelligent management and control platform and management and control method for information system integration technology service | |
CN120631275A (en) | Real estate data distributed storage management system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22860026 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 070624) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 22860026 Country of ref document: EP Kind code of ref document: A1 |