CN106817252B - Internet data processing method and processing device - Google Patents
Internet data processing method and processing device Download PDFInfo
- Publication number
- CN106817252B CN106817252B CN201611267589.7A CN201611267589A CN106817252B CN 106817252 B CN106817252 B CN 106817252B CN 201611267589 A CN201611267589 A CN 201611267589A CN 106817252 B CN106817252 B CN 106817252B
- Authority
- CN
- China
- Prior art keywords
- distribution curve
- data distribution
- data
- user
- point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 title claims abstract description 36
- 238000003672 processing method Methods 0.000 title claims abstract description 11
- 238000000034 method Methods 0.000 claims abstract description 38
- 238000012544 monitoring process Methods 0.000 claims abstract description 25
- 230000006870 function Effects 0.000 claims description 22
- 230000005856 abnormality Effects 0.000 claims description 12
- 238000004458 analytical method Methods 0.000 claims description 11
- 101100206195 Arabidopsis thaliana TCP2 gene Proteins 0.000 claims description 8
- 101000666730 Homo sapiens T-complex protein 1 subunit alpha Proteins 0.000 claims description 8
- 101100536570 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) CCT2 gene Proteins 0.000 claims description 8
- 102100038410 T-complex protein 1 subunit alpha Human genes 0.000 claims description 8
- 230000004044 response Effects 0.000 claims description 5
- 238000004422 calculation algorithm Methods 0.000 abstract description 7
- 230000008447 perception Effects 0.000 description 19
- 238000004891 communication Methods 0.000 description 17
- 230000002159 abnormal effect Effects 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000008859 change Effects 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 238000007405 data analysis Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000010187 selection method Methods 0.000 description 3
- 238000004590 computer program Methods 0.000 description 2
- 238000007418 data mining Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000011664 signaling Effects 0.000 description 2
- 241001025261 Neoraja caerulea Species 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000003012 network analysis Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0681—Configuration of triggering conditions
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Telephonic Communication Services (AREA)
- Information Transfer Between Computers (AREA)
Abstract
本公开提供了上网数据处理方法及装置。该方法包括:对采集到的用户上网数据进行拟合,以得到数据分布曲线,其中用户上网数据包括用户上网的性能指标;以及通过对数据分布曲线进行分析来获得阈值点,在该阈值点时适合于发出异常感知监测报警。根据本发明实施例的上网数据处理方法及装置解决了现有技术中的告警阈值点选择算法复杂且准确率不高的问题,提高了告警阈值点选择的准确性,并且降低了复杂度。
The disclosure provides a method and device for processing online data. The method includes: fitting the collected user online data to obtain a data distribution curve, wherein the user online data includes performance indicators of the user online; and obtaining a threshold point by analyzing the data distribution curve, at the threshold point Suitable for anomaly awareness monitoring alarms. The online data processing method and device according to the embodiments of the present invention solve the problem of complex alarm threshold point selection algorithm and low accuracy in the prior art, improve the accuracy of alarm threshold point selection, and reduce complexity.
Description
技术领域technical field
本公开涉及通讯领域,具体而言,涉及上网数据处理方法及装置。The present disclosure relates to the field of communication, and in particular, relates to a method and device for processing online data.
背景技术Background technique
随着4G用户碎片化上网习惯的养成,端到端体验成为影响用户感知的关键因素。一方面,传统的基于网络、网元的指标监测已不能满“随时随地”上网体验的保障需求;另一方面,4G流量急剧增加,每天手机终端产生的移动信令数据量也在迅速上升,急需通过大数据分析,开展对每用户每业务的全天候感知监测,避免传统网管小区、网元级指标统计湮没了感知质差的用户。As 4G users develop fragmented online habits, end-to-end experience has become a key factor affecting user perception. On the one hand, the traditional indicator monitoring based on the network and network elements can no longer meet the guarantee requirements of "anytime, anywhere" Internet experience; on the other hand, 4G traffic has increased sharply, and the amount of mobile signaling data generated by mobile terminals every day is also rising rapidly. There is an urgent need to carry out all-weather perceptual monitoring of each user and each service through big data analysis, so as to avoid traditional network management cells and network element-level indicator statistics obliterating users with poor perception quality.
而用户级感知指标监测阈值的设置一直是困扰网络监控、网络分析人员的难题,特别是全量4G用户级端到端关键性能指标的监测。一是全量用户基数大,远远超过小区、网元的数量级;二是端到端上网流程环节多,从附着、承载建立、跟踪区更新、域名解析、TCP连接建立至HTTP业务环节多,涉及的关键性能指标多。急需通过大数据的分析挖掘技术,在海量繁杂的数据中有效地发掘和设置感知质差阈值,既能及时发现感知异常问题,又能避免大量的无效告警产生。针对于这些现象,最早的移动数据运维人员提出过通过经验的阈值选取方法与多次计算阈值模型的方法,但这些方法都有着明显的缺点。The setting of monitoring thresholds for user-level perception indicators has always been a difficult problem for network monitoring and network analysts, especially the monitoring of full 4G user-level end-to-end key performance indicators. First, the total user base is large, far exceeding the order of magnitude of cells and network elements; second, there are many links in the end-to-end Internet access process, from attachment, bearer establishment, tracking area update, domain name resolution, TCP connection establishment to HTTP business links, involving There are many key performance indicators. There is an urgent need to use big data analysis and mining technology to effectively discover and set the threshold of poor perception quality in massive and complex data, which can not only detect abnormal perception problems in time, but also avoid a large number of invalid alarms. In response to these phenomena, the earliest mobile data operation and maintenance personnel proposed the threshold selection method through experience and the method of calculating the threshold model multiple times, but these methods have obvious shortcomings.
传统的阈值点取值方法是通过经验的阈值选取方法,但这种方法要求选取者有很高的业务理解水平,而且针对于不同的告警情况都要有很深的了解,这是很难以做到的,往往会导致大量的告警信息被遗漏或者将非阈值点也划入告警的范围。之后一些网络分析、监控工程师意识到了这类的问题,并提出了改进的方法,如7点差值法,这种方法依靠经验选取7个点,以各点之间的距离差得到整条曲线上差值最大的点,将这个点做为阈值点,这样的方法首先取点是仅凭经验的模糊规则,并且在大数据告警模型时需要对所有的阈值点进行多次计算,增加系统的空间复杂度和时间复杂度,算法因为多点重复计算,其计算量高达39.9万次。The traditional threshold value selection method is based on empirical threshold selection method, but this method requires the selector to have a high level of business understanding, and must have a deep understanding of different alarm situations, which is difficult to do However, a large amount of alarm information is often missed or non-threshold points are also included in the alarm range. Later, some network analysis and monitoring engineers realized this kind of problem, and proposed improved methods, such as the 7-point difference method. This method relies on experience to select 7 points, and the entire curve is obtained by the distance difference between the points. The point with the largest difference is taken as the threshold point. This method first selects points based on fuzzy rules based on experience, and in the big data alarm model, it is necessary to perform multiple calculations on all threshold points, increasing the system’s Space complexity and time complexity, because the algorithm is repeatedly calculated at multiple points, its calculation amount is as high as 399,000 times.
发明内容Contents of the invention
本公开的实施例提供了上网数据处理方法及装置,以至少解决现有技术中的告警阈值点选择算法复杂准确率不高的问题。Embodiments of the present disclosure provide a method and device for processing online data, so as to at least solve the problem that the alarm threshold point selection algorithm in the prior art is complex and has low accuracy.
根据本公开的一方面,提供了一种上网数据处理方法,包括:对采集到的用户上网数据进行拟合,以得到数据分布曲线,其中用户上网数据包括用户上网的性能指标;以及通过对数据分布曲线进行分析来获得阈值点,在该阈值点时适合于发出异常感知监测报警。According to one aspect of the present disclosure, a method for processing online data is provided, including: fitting the collected user online data to obtain a data distribution curve, wherein the user online data includes user online performance indicators; The distribution curve is analyzed to obtain a threshold point at which anomaly-aware monitoring alarms are suitable.
根据本公开的另一方面,提供了一种上网数据处理装置,包括:拟合模块,用于对采集到的用户上网数据进行拟合以得到数据分布曲线,其中用户上网数据包括用户上网的性能指标;以及分析模块,用于通过对数据分布曲线进行分析来获得阈值点,在该阈值点时适合于发出异常感知监测报警。According to another aspect of the present disclosure, there is provided an online data processing device, including: a fitting module, used to fit the collected user online data to obtain a data distribution curve, wherein the user online data includes the user online performance An index; and an analysis module, configured to obtain a threshold point by analyzing the data distribution curve, and at the threshold point, it is suitable to issue an abnormality perception monitoring alarm.
根据本公开的另一方面,提供了一种上网数据处理装置,包括:处理器和存储器。该存储器存储供处理器执行的指令。该处理器当执行这些指令时被配置为:对采集到的用户上网数据进行拟合,以得到数据分布曲线,其中用户上网数据包括用户上网的性能指标;以及通过对数据分布曲线进行分析来获得阈值点,在该阈值点时适合于发出异常感知监测报警。According to another aspect of the present disclosure, an apparatus for processing data online is provided, including: a processor and a memory. The memory stores instructions for execution by the processor. When the processor executes these instructions, it is configured to: fit the collected user online data to obtain a data distribution curve, wherein the user online data includes user online performance indicators; and analyze the data distribution curve to obtain A threshold point is suitable for issuing an abnormality perception monitoring alarm at the threshold point.
本公开的实施例解决了现有技术中的告警阈值点选择算法复杂且准确率不高的问题,提高了告警阈值点选择的准确性,并且降低了复杂度。The embodiments of the present disclosure solve the problem that the alarm threshold point selection algorithm in the prior art is complicated and the accuracy rate is not high, improves the accuracy of the alarm threshold point selection, and reduces the complexity.
附图说明Description of drawings
此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:The accompanying drawings described here are used to provide a further understanding of the present invention and constitute a part of the application. The schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations to the present invention. In the attached picture:
图1是根据本发明实施例的一种上网数据处理方法的流程图;Fig. 1 is a flow chart of a method for processing online data according to an embodiment of the present invention;
图2是根据本发明可选实施例的4G用户级关键性能指标(TCP握手成功率)的曲线示意图;Fig. 2 is a schematic diagram of curves of 4G user-level key performance indicators (TCP handshake success rate) according to an optional embodiment of the present invention;
图3是根据本发明实施例的阈值点生成的示例的示意图;3 is a schematic diagram of an example of threshold point generation according to an embodiment of the present invention;
图4是根据本发明实施例的上网数据处理装置的结构框图;以及Fig. 4 is a structural block diagram of an Internet data processing device according to an embodiment of the present invention; and
图5是根据本发明实施例的数据处理设备的结构示意图。Fig. 5 is a schematic structural diagram of a data processing device according to an embodiment of the present invention.
具体实施方式Detailed ways
为了使本技术领域的人员更好地理解本发明方案,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分的实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本发明保护的范围。In order to enable those skilled in the art to better understand the solutions of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only It is an embodiment of a part of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.
需要说明的是,本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的本发明的实施例能够以除了在这里图示或描述的那些以外的顺序实施。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或模块的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或模块,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或模块。It should be noted that the terms "first" and "second" in the description and claims of the present invention and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the invention described herein can be practiced in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" and "having", as well as any variations thereof, are intended to cover a non-exclusive inclusion, for example, a process, method, system, product or device comprising a series of steps or modules is not necessarily limited to the expressly listed Instead, other steps or modules not explicitly listed or inherent to the process, method, product or apparatus may be included.
本公开的实施例提供了一种上网数据处理方法。图1是根据本发明实施例的上网数据处理方法100的流程图,如图1所示,方法100包括如下步骤:The embodiment of the present disclosure provides a method for processing online data. Fig. 1 is a flowchart of a method 100 for processing online data according to an embodiment of the present invention. As shown in Fig. 1, the method 100 includes the following steps:
在步骤S102中,对采集到的用户上网数据进行拟合,以得到数据分布曲线。用户上网数据例如可以包括用户上网的性能指标。In step S102, fitting is performed on the collected user access data to obtain a data distribution curve. The user surfing data may include, for example, performance indicators of the user surfing the Internet.
在步骤S104中,通过对数据分布曲线进行分析来获得阈值点。在该阈值点时适合于发出异常感知监测报警。也就是说,在该阈值点时发出异常感知监测报警,能够包含大多数的异常信息,又能够最大程度地减少无效的异常告警。In step S104, the threshold point is obtained by analyzing the data distribution curve. At this threshold point, it is suitable to issue an abnormality perception monitoring alarm. That is to say, when the threshold point is issued, an abnormality perception monitoring alarm can contain most of the abnormal information, and can minimize invalid abnormal alarms.
在一些实施例中,例如,可以利用自定义的三阶函数来对用户上网数据进行拟合,以得到数据分布曲线。可替代地,在其他实施例中,根据实际需要,可以利用二阶函数或更高阶的函数来对用户上网数据进行拟合。In some embodiments, for example, a user-defined third-order function may be used to fit the user surfing data to obtain a data distribution curve. Alternatively, in other embodiments, according to actual needs, a second-order function or a higher-order function may be used to fit the user surfing data.
在一些实施例中,例如,可以通过以下方式来对数据分布曲线进行分析:获取数据分布曲线曲率最大处前后的两部分曲线的切线;根据这两条切线来预测数据分布曲线的曲率的变化;以及将预测的结果与数据分布曲线的交点确定为阈值点。In some embodiments, for example, the data distribution curve can be analyzed in the following manner: obtain the tangents of the two parts of the curve before and after the maximum curvature of the data distribution curve; predict the change of the curvature of the data distribution curve according to these two tangents; And determine the intersection point of the predicted result and the data distribution curve as the threshold point.
如本领域普通技术人员所理解的,曲线的曲率是针对曲线上某个点的切线方向角对弧长的转动率,其表明曲线偏离直线的程度。曲率在数学上时表明曲线在某一点的弯曲程度的数值。曲率越大,表示曲线的弯曲程度越大。As understood by those of ordinary skill in the art, the curvature of a curve is the rate of rotation of the tangent direction angle to the arc length for a point on the curve, which indicates the degree to which the curve deviates from a straight line. Curvature in mathematics is a numerical value that indicates how curved a curve is at a certain point. The greater the curvature, the more curved the curve.
在一些实施例中,通过对数据分布曲线进行分析来获得阈值点的步骤可以进一步包括:将数据分布曲线曲率最大处前后的两部分曲线各自的切线与所述数据分布曲线的切点相连接,以获得连接线;确定从这两条切线的交点到上述连接线的垂线;以及将该垂线与数据分布曲线的交点确定为阈值点。In some embodiments, the step of obtaining the threshold point by analyzing the data distribution curve may further include: connecting the respective tangent lines of the two parts of the curve before and after the maximum curvature of the data distribution curve to the tangent point of the data distribution curve, obtaining a connecting line; determining a perpendicular from the intersection of the two tangents to the above connecting line; and determining the intersection of the perpendicular and the data distribution curve as a threshold point.
通过上述步骤利用自定义的三阶函数进行拟合得到数据分布曲线,然后,获取数据分布曲线曲率最大处前后的两部分曲线的切线,根据这两条切线来预测数据分布曲线的曲率的变化;将预测的结果与该数据分布曲线的的交点确定为阈值点。通过根据本公开实施例的上网数据处理方法100解决了现有技术中的告警阈值点选择算法复杂且准确率不高的问题,提高了告警阈值点选择的准确性,并且降低了复杂度。Through the above steps, use a custom third-order function to fit the data distribution curve, and then obtain the tangents of the two parts of the curve before and after the maximum curvature of the data distribution curve, and predict the curvature change of the data distribution curve according to these two tangents; The intersection point of the predicted result and the data distribution curve is determined as the threshold point. The online data processing method 100 according to the embodiment of the present disclosure solves the problem of complex alarm threshold point selection algorithm and low accuracy in the prior art, improves the accuracy of alarm threshold point selection, and reduces complexity.
预测数据分布曲线的曲率变化的方式有很多种。作为一种可选的实施方式,曲率的变化用于预测阈值点的位置。通过根据本公开实施例的上网数据处理方法100可以根据阈值点左右两侧的样本点轨迹规律来预测阈值点的位置。There are many ways to predict changes in the curvature of a data distribution curve. As an optional implementation manner, the change of the curvature is used to predict the position of the threshold point. The location of the threshold point can be predicted according to the trajectory law of the sample points on the left and right sides of the threshold point through the online data processing method 100 according to the embodiment of the present disclosure.
下面结合一个可选的示例来对根据本公开实施例的上网数据处理方法100进行详细说明。The method 100 for processing online data according to an embodiment of the present disclosure will be described in detail below in conjunction with an optional example.
针对海量用户级信令大数据分析,生成4G用户各端到端指标的动态实时分布,使数据点均在离此数据分布曲线的上方或下方不远处,既能反应数据的总体分布,又不至于出现局部的较大波动,能反映被逼近函数的特性,使求得的逼近函数与已知数据点从总体上来说其偏差值最小。如上所述,可以通过曲线拟合的方式对采集到的用户上网数据进行拟合。For the analysis of massive user-level signaling big data, the dynamic real-time distribution of end-to-end indicators of 4G users is generated, so that the data points are not far above or below the data distribution curve, which can not only reflect the overall distribution of data, but also There will not be large local fluctuations, and it can reflect the characteristics of the approximated function, so that the deviation between the approximate function obtained and the known data points is generally the smallest. As mentioned above, the collected user surfing data can be fitted by means of curve fitting.
为更好的与数据点分布吻合,采用细分颗粒度的插值。在一些实施例中,考虑到系统实现复杂度,采用三阶函数来对采集到的用户上网数据进行拟合。In order to better match the distribution of data points, interpolation with subdivided granularity is used. In some embodiments, considering the complexity of system implementation, a third-order function is used to fit the collected user surfing data.
例如,假设给定n+1个数据点,则共有n个细分区间,其中n为自然数。则三阶函数可表示为Si(x)=ai+bi(x-xi)+ci(x-xi)2+di(x-xi)3,i=0,1,…,n-1,其中ai,bi,ci,di代表未知系数。For example, assuming that n+1 data points are given, there are n subdivision intervals in total, where n is a natural number. Then the third-order function can be expressed as S i (x)=a i +b i (xx i )+ ci (xx i ) 2 +d i (xx i ) 3 , i=0,1,…,n-1 , where a i , b i , ci , d i represent unknown coefficients.
对曲线Si(x)=ai+bi(x-xi)+ci(x-xi)2+di(x-xi)3分别求一阶导数和二阶导数得出:For the curve S i (x)=a i +b i (xx i )+ ci (xx i ) 2 +d i (xx i ) 3 , calculate the first order derivative and the second order derivative respectively:
Si'(x)=bi+2ci(x-xi)+3di(x-xi)2 (1)S i '(x)=b i +2c i (xx i )+3d i (xx i ) 2 (1)
Si”(x)=2ci+6di(x-xi)S i ”(x)=2c i +6d i (xx i )
将步长hi=xi+1-xi带入样条曲线(所谓样条曲线是指给定一组控制点而得到一条曲线,曲线的大致形状由这些点予以控制)的条件,由Si(xi)=yi,Si'(xi+1)=Si+1'(xi+1),Si”(xi+1)=Si+1”(xi+1),可以得出:Bring the step size h i = xi+1 - xi into the condition of the spline curve (the so-called spline curve refers to a curve obtained by giving a set of control points, and the general shape of the curve is controlled by these points), by S i (x i )=y i , S i '(x i+1 )=S i+1 '(x i+1 ), S i ”(x i+1 )=S i+1 ”(x i +1 ), which yields:
ai=yi a i =y i
ai+hibi+hi 2ci+hi 3di=yi+1 (2)a i +h i b i +h i 2 c i +h i 3 d i =y i +1 (2)
bi+2hici+3hi 2di-bi+1=0b i +2h i c i +3h i 2 d i -b i+1 =0
2ci+6hidi-2ci+1=02c i +6h i d i -2c i+1 =0
设定mi=Si”(xi)=2ci,代入上述公式可得出样条曲线的系数,即Set m i =S i ”( xi )=2c i , substituting the above formula to get the coefficient of the spline curve, namely
ai=yi a i =y i
其中i=0,1,…,n-1。从而可以得到拟合而成的数据分布曲线。where i=0,1,...,n-1. Thus, the fitted data distribution curve can be obtained.
在一个可选的实施方式中,用户上网的性能指标可以包括但不限于如下参数中的一项或多项,例如:TCP1/2步握手成功率、TCP1/2步握手时延、TCP2/3步握手成功率、TCP2/3步握手时延、HTTP访问响应时延、HTTP访问会话时延、HTTP下载速率。In an optional implementation, the user's performance index for surfing the Internet may include but not limited to one or more of the following parameters, for example: TCP1/2 step handshake success rate, TCP1/2 step handshake delay, TCP2/3 Step handshake success rate, TCP2/3 step handshake delay, HTTP access response delay, HTTP access session delay, HTTP download rate.
图2是根据本公开实施例的利用三阶函数拟合出的4G用户级关键性能指标的曲线200的示例。例如,曲线200可以表示TCP握手成功率。FIG. 2 is an example of a curve 200 of a 4G user-level KPI fitted by a third-order function according to an embodiment of the present disclosure. For example, curve 200 may represent a TCP handshake success rate.
通过对曲线200的观察可以看出,拟合数据曲线呈现如下特征:曲线轨迹先是近似为平滑的直线,在阈值点附近的曲率非常大,越过阈值点后又变得近似为平滑的直线。It can be seen from the observation of the curve 200 that the fitted data curve presents the following characteristics: the curve trajectory is approximately a smooth straight line at first, with a very large curvature near the threshold point, and becomes approximately a smooth straight line after crossing the threshold point.
下面通过示例的方式、结合图3来说明如何通过对数据分布曲线进行分析来获得阈值点。图3是根据本发明实施例的阈值点生成的示例的示意图。The following illustrates how to obtain the threshold point by analyzing the data distribution curve by way of example and with reference to FIG. 3 . Fig. 3 is a schematic diagram of an example of threshold point generation according to an embodiment of the present invention.
为便于描述,假设数据分布曲线为F(x,y)=0,数据分布曲线曲率最大处前后的两部分曲线的切线分别为y1=k1x+b1和y2=k2x+b2,其中k1,b1,k2,b2为未知参数。For the convenience of description, assume that the data distribution curve is F(x,y)=0, and the tangents of the two parts of the curve before and after the maximum curvature of the data distribution curve are y 1 =k 1 x+b 1 and y 2 =k 2 x+ b 2 , where k 1 , b 1 , k 2 , and b 2 are unknown parameters.
将切线方程代入数据分布曲线并且按照x的幂次展开,得到F(x,kx+b)=f1(k)xm+f2(k,b)xm+…。Substituting the tangent equation into the data distribution curve and expanding according to the power of x, F(x,kx+b)=f 1 (k)x m +f 2 (k,b)x m + . . . is obtained.
接下来,求解以下方程组即可得出k1,b1,k2,b2的值:Next, the values of k 1 , b 1 , k 2 , and b 2 can be obtained by solving the following system of equations:
从而得到:and thus get:
求解方程组(5)即可得到切线y1=k1x+b1和y2=k2x+b2的交点,在图3中表示为A点。Solving equation group (5) can obtain the intersection point of tangent line y 1 =k 1 x+b 1 and y 2 =k 2 x+b 2 , which is represented as point A in FIG. 3 .
通过下式可以分别找出切线y1=k1x+b1和y2=k2x+b2与数据分布曲线为F(x,y)=0最为相近的点,也即切点。The points closest to the tangent lines y 1 =k 1 x+b 1 and y 2 =k 2 x+b 2 and the data distribution curve F(x,y)=0, that is, the tangent points, can be found through the following formula.
假设所得到的切点分别为M(x,y),N(x,y)。则通过切点M、N可以得出两点的连接线MN的函数为f3(x,y)。从切线y1=k1x+b1和y2=k2x+b2的交点A向连接线f3(x,y)作垂线P。垂线P与数据分布曲线为F(x,y)=0相交于点B(x,y)。则点B即为适合于发出异常感知监测报警的阈值点。Assume that the obtained tangent points are M(x,y) and N(x,y) respectively. Then, the function of the connecting line MN between two points can be obtained through the tangent points M and N as f 3 (x, y). A perpendicular line P is drawn from the intersection point A of the tangent lines y 1 =k 1 x+b 1 and y 2 =k 2 x+b 2 to the connecting line f 3 (x,y). The vertical line P intersects the data distribution curve at point B(x,y) at F(x,y)=0. Then point B is the threshold point suitable for sending out abnormal perception monitoring alarm.
根据本公开实施例的上网数据处理方法100通过以上计算和分析解决了现有技术中的告警阈值点选择算法复杂且准确率不高的问题,提高了告警阈值点选择的准确性,并且降低了复杂度。The online data processing method 100 according to the embodiment of the present disclosure solves the problem that the alarm threshold point selection algorithm in the prior art is complicated and the accuracy rate is not high through the above calculation and analysis, improves the accuracy of the alarm threshold point selection, and reduces the the complexity.
以上示出的是根据本公开的实施例的上网数据处理方法的示例流程图。应当指出的是,虽然这里提供的方法被示出和描述为一系列动作或事件,但是本公开不受所示出的这些动作或事件的排序的限制。例如,除所示出和/或描述的顺序之外,一些动作可以以其它的顺序发生和/或与其它动作或事件同时发生。另外,该方法还可以包括未在图中示出的其它动作,而且并非全部示出的动作都是需要的。What is shown above is an example flowchart of a method for processing surfing data according to an embodiment of the present disclosure. It should be noted that while the methodologies provided herein are shown and described as a series of acts or events, the disclosure is not limited by the ordering of these acts or events shown. For example, some acts may occur in orders other than those shown and/or described and/or concurrently with other acts or events. In addition, the method may also include other actions not shown in the figure, and not all the actions shown are required.
根据本公开实施例的上网数据处理方法100通过采用CT通信领域与IT信息领域结合的方法,较传统单纯CT通信领域经验方案相比,具有可靠性高、通用性好、复杂度低的优势。The online data processing method 100 according to the embodiment of the present disclosure adopts the method of combining the CT communication field and the IT information field, and has the advantages of high reliability, good versatility, and low complexity compared with the traditional simple CT communication field experience scheme.
在本公开的实施例中,还提供了一种上网数据处理装置。图4是根据本公开实施例的上网数据处理装置400的结构框图。如图4所示,上网数据处理装置400例如可以包括拟合模块42和分析模块44。在一些实施例中,根据需要,上网数据处理装置400还可以包括其他模块。各个模块之间可以通信地连接,以协调运作。In an embodiment of the present disclosure, an apparatus for processing data online is also provided. Fig. 4 is a structural block diagram of a data processing device 400 according to an embodiment of the present disclosure. As shown in FIG. 4 , the online data processing device 400 may include, for example, a fitting module 42 and an analysis module 44 . In some embodiments, the device 400 for processing data online may further include other modules as required. The various modules can be communicatively connected to coordinate operations.
在一些实施例中,拟合模块42可以用于对采集到的用户上网数据进行拟合以得到数据分布曲线。作为示例,用户上网数据可以包括用户上网的性能指标。例如,用户上网的性能指标可以包括但不限于如下参数中的一项或多项,例如:TCP1/2步握手成功率、TCP1/2步握手时延、TCP2/3步握手成功率、TCP2/3步握手时延、HTTP访问响应时延、HTTP访问会话时延、HTTP下载速率。In some embodiments, the fitting module 42 may be used to fit the collected user surfing data to obtain a data distribution curve. As an example, the user surfing data may include user surfing performance indicators. For example, the performance indicators of users surfing the Internet may include but not limited to one or more of the following parameters, for example: TCP1/2-step handshake success rate, TCP1/2-step handshake delay, TCP2/3-step handshake success rate, TCP2/ 3-step handshake delay, HTTP access response delay, HTTP access session delay, HTTP download rate.
在一些实施例中,分析模块44用于通过对数据分布曲线进行分析来获得阈值点。在该阈值点时适合于发出异常感知监测报警。也就是说,在该阈值点时发出异常感知监测报警,能够包含大多数的异常信息,又能够最大程度地减少无效的异常告警。In some embodiments, the analysis module 44 is used to obtain the threshold point by analyzing the data distribution curve. At this threshold point, it is suitable to issue an abnormality perception monitoring alarm. That is to say, when the threshold point is issued, an abnormality perception monitoring alarm can contain most of the abnormal information, and can minimize invalid abnormal alarms.
在一些实施例中,考虑到系统实现复杂度,拟合模块42可以被配置为利用三阶函数(例如,如上所述的三阶函数Si(x)=ai+bi(x-xi)+ci(x-xi)2+di(x-xi)3)来对用户上网数据进行拟合。可替代地,在其他实施例中,根据实际需要,拟合模块42可以利用二阶函数或更高阶的函数来对用户上网数据进行拟合。In some embodiments, considering the complexity of system implementation, the fitting module 42 may be configured to use a third-order function (for example, the above-mentioned third-order function S i (x)=a i + bi (xx i ) +c i (xx i ) 2 +d i (xx i ) 3 ) to fit the user surfing data. Alternatively, in other embodiments, according to actual needs, the fitting module 42 may use a second-order function or a higher-order function to fit the user surfing data.
在一些实施例中,分析模块44可以包括获取子模块441、预测子模块442、以及阈值确定子模块443。In some embodiments, the analysis module 44 may include an acquisition submodule 441 , a prediction submodule 442 , and a threshold determination submodule 443 .
在示例中,获取子模块441用于获取数据分布曲线(例如,如上所述的数据分布曲线方程为F(x,y)=0)曲率最大处前后的两部分曲线的切线(例如,如上所述的切线y1=k1x+b1和y2=k2x+b2)。In an example, the acquiring sub-module 441 is used to acquire the tangents of the data distribution curve (for example, the above-mentioned data distribution curve equation is F(x, y)=0) before and after the maximum curvature (for example, as mentioned above tangents y 1 =k 1 x+b 1 and y 2 =k 2 x+b 2 ).
在示例中,预测子模块442用于根据切线(例如,如上所述的切线y1=k1x+b1和y2=k2x+b2)来预测所述数据分布曲线(例如,如上所述的数据分布曲线方程为F(x,y)=0)的曲率的变化。 In an example, the prediction sub - module 442 is used to predict the data distribution curve ( eg, The data distribution curve equation described above is the change in curvature of F(x,y)=0).
在示例中,阈值确定子模块443用于将预测的结果与数据分布曲线(例如,如上所述的数据分布曲线方程为F(x,y)=0)的交点(例如,图3中的B点)确定为适合于发出异常感知监测报警的阈值点。In an example, the threshold determination sub-module 443 is used to calculate the intersection point (for example, B in FIG. point) is determined as the threshold point suitable for sending out abnormal perception monitoring alarms.
在另外的实施例中,分析模块44还可以包括连接子模块444、垂线确定子模块445、以及其他需要的子模块。各个子模块之间可以通信地连接,以协调运作。In another embodiment, the analysis module 44 may further include a connection submodule 444, a vertical line determination submodule 445, and other required submodules. The various sub-modules can be communicatively connected to coordinate operations.
例如,连接子模块444用于将所述数据分布曲线(例如,如上所述的数据分布曲线方程为F(x,y)=0)曲率最大处前后的两部分曲线各自的切线(例如,如上所述的切线y1=k1x+b1和y2=k2x+b2)与该数据分布曲线的切点(例如,如上所述的M点和N点)相连接,以获得连接线(例如,如上所述的连接线f3(x,y))。For example, the connection sub-module 444 is used to connect the respective tangents of the two parts of the curve before and after the maximum curvature of the data distribution curve (for example, the above-mentioned data distribution curve equation is F(x, y)=0) (for example, as above The tangent lines y 1 =k 1 x+b 1 and y 2 =k 2 x+b 2 ) are connected to the tangent points of the data distribution curve (for example, the M point and the N point as mentioned above), to obtain A connecting line (eg, connecting line f 3 (x,y) as described above).
在示例中,垂线确定子模块445用于确定从切线(例如,如上所述的切线y1=k1x+b1和y2=k2x+b2)的交点(例如,图3中的A点)到上述连接线(例如,如上所述的连接线f3(x,y))的垂线(例如,如上所述的垂线P)。In an example, the perpendicular line determination sub-module 445 is used to determine intersection points from tangents (eg, tangents y 1 =k 1 x+b 1 and y 2 =k 2 x+b 2 as described above) (eg, FIG. 3 Point A in ) to the above-mentioned connecting line (eg, connecting line f 3 (x, y) as described above) perpendicular (eg, perpendicular line P as described above).
在示例中,阈值确定子模块443可以被配置为将上述垂线(例如,垂线P)与数据分布曲线(例如,数据分布曲线方程为F(x,y)=0)的交点(例如,图3中的B点)确定为适合于发出异常感知监测报警的阈值点。In an example, the threshold determination sub-module 443 may be configured to calculate the intersection point (for example, Point B in Fig. 3) is determined as a threshold point suitable for issuing an abnormality perception monitoring alarm.
以上示出的是根据本公开的上网数据处理装置的示例。应当指出的是,虽然这里提供的上网数据处理装置被示出和描述为包括多个模块,但是根据所实现的功能的要求,根据本公开的探测模块可以包括更多或更少的模块。What has been shown above is an example of the surfing data processing device according to the present disclosure. It should be noted that although the Internet access data processing device provided here is shown and described as including multiple modules, the detection module according to the present disclosure may include more or fewer modules according to the requirements of the realized functions.
图5示出了数据处理设备500的结构示意图。本申请的实施例中的上网数据处理装置400可以由设备500来实现。如图5所示,设备500可以包括以下组件中的一项或多项:处理器520、存储器530、电源组件540、输入/输出(I/O)接口560、通信接口580,这些组件例如可以通过总线510以可通信的方式连接。FIG. 5 shows a schematic structural diagram of a data processing device 500 . The apparatus 400 for processing data online in the embodiment of the present application may be implemented by a device 500 . As shown in FIG. 5 , device 500 may include one or more of the following components: processor 520, memory 530, power supply component 540, input/output (I/O) interface 560, communication interface 580, and these components may, for example, Communicatively connected via bus 510 .
处理器520在整体上控制设备500的操作,例如与数据通信和计算处理等相关联的操作。处理器520可以包括一个或多个处理核心,并能够执行指令以实现本申请中所述方法的全部或部分步骤。处理器520可以包括具有处理功能的各种装置,包括但不限于通用处理器、专用处理器、微处理器、微控制器、图形处理器(GPU)、数字信号处理器(DSP)、专用集成电路(ASIC)、可编程逻辑器件(PLD)、现场可编程逻辑门阵列(FPGA)等。处理器520可以包括缓存525或可以与缓存525通信,以提高数据的访问速度。The processor 520 controls operations of the device 500 as a whole, such as operations associated with data communication and computational processing, and the like. The processor 520 may include one or more processing cores, and is capable of executing instructions to implement all or part of the steps of the methods described in this application. Processor 520 may include various devices with processing capabilities, including but not limited to general purpose processors, special purpose processors, microprocessors, microcontrollers, graphics processing units (GPUs), digital signal processors (DSPs), application specific integrated circuit (ASIC), programmable logic device (PLD), field programmable logic gate array (FPGA), etc. The processor 520 may include or be in communication with a cache 525 to increase data access speed.
存储器530被配置为存储各种类型的指令和/或数据以支持设备500的操作。数据的示例包括用于在设备500上操作的任何应用程序或方法的指令、数据等。存储器530可以由任何类型的易失性或非易失性存储设备或者它们的组合实现。存储器530可以包括半导体存储器,例如随机存储器(RAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、只读存储器(ROM)、可编程只读存储器(PROM)、可擦除可编程只读存储器(EPROM)、电可擦除可编程只读存储器(EEPROM)、快闪存储器等。存储器530也可以包括例如使用纸介质、磁介质和/或光介质的任何存储器,如纸带、硬盘、磁带、软盘、磁光盘(MO)、CD、DVD、Blue-ray等。The memory 530 is configured to store various types of instructions and/or data to support the operation of the device 500 . Examples of data include instructions, data, etc. for any application or method operating on device 500 . Memory 530 may be implemented by any type or combination of volatile or non-volatile storage devices. Memory 530 may include semiconductor memory such as random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), read only memory (ROM), programmable read only memory (PROM), erasable In addition to programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, etc. Memory 530 may also include, for example, any memory using paper, magnetic, and/or optical media, such as paper tape, hard disk, magnetic tape, floppy disk, magneto-optical disk (MO), CD, DVD, Blue-ray, and the like.
电源组件540为设备500的各种组件提供电力。电源组件540可以包括内部电池和/或外部电源接口,并可以包括电源管理系统以及其他与为设备500生成、管理和分配电力相关联的组件。The power supply component 540 provides power to various components of the device 500 . Power component 540 may include an internal battery and/or an external power interface, and may include a power management system and other components associated with generating, managing, and distributing power for device 500 .
I/O接口560提供了使用户能够与设备500进行交互的接口。I/O接口560例如可以包括基于PS/2、RS-232、USB、FireWire、Lightening、VGA、HDMI、DisplayPort等技术的接口,使用户能够通过键盘、鼠标器、触摸板、触摸屏、操纵杆、按钮、麦克风、扬声器、显示器、摄像头、投影端口等周边装置与设备500进行交互。I/O interface 560 provides an interface that enables a user to interact with device 500 . The I/O interface 560 may include, for example, interfaces based on technologies such as PS/2, RS-232, USB, FireWire, Lightening, VGA, HDMI, DisplayPort, etc. Peripheral devices such as a microphone, a speaker, a display, a camera, and a projection port interact with the device 500 .
通信接口580被配置来使设备500能够与其他设备以有线或无线方式进行通信。设备500可以通过通信接口580接入基于一种或多种通信标准的无线网络,例如WiFi、2G、3G、4G通信网络。在一种示例性实施例中,通信接口580还可以经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。示例性的通信接口580可以包括基于近场通信(NFC)技术、射频识别(RFID)技术、红外数据协会(IrDA)技术、超宽带(UWB)技术、蓝牙(BT)技术等通信方式的接口。The communication interface 580 is configured to enable the device 500 to communicate with other devices in a wired or wireless manner. The device 500 can access wireless networks based on one or more communication standards through the communication interface 580, such as WiFi, 2G, 3G, and 4G communication networks. In an exemplary embodiment, the communication interface 580 may also receive a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. Exemplary communication interfaces 580 may include interfaces based on communication methods such as Near Field Communication (NFC) technology, Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wide Band (UWB) technology, Bluetooth (BT) technology and the like.
在一些实施例中,上网数据处理装置100和上网数据处理装置400的各个步骤或模块可以被实现为硬件、软件、固件或者它们的组合。当以硬件方式实现时,其可以例如是电子电路、专用集成电路(ASIC)、现场可编程门阵列(FPGA)、适当的固件、插件、功能卡等等。当以软件方式实现时,本发明的元素是被用于实现所需功能的程序或者代码段。程序或者代码段可以存储在机器可读介质中,或者通过载波中携带的数据信号在传输介质或者通信链路上传送。In some embodiments, each step or module of the online data processing device 100 and the online data processing device 400 may be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it may be, for example, an electronic circuit, an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), suitable firmware, a plug-in, a function card, or the like. When implemented in software, the elements of the present invention are programs or code segments used to realize desired functions. Programs or code segments can be stored in machine-readable media, or transmitted over transmission media or communication links by data signals carried in carrier waves.
本公开的实施例还提供了一种存储介质。该存储介质可以包括但不限于:闪存盘、只读存储器(Read-Only Memory,ROM)、随机存取器Embodiments of the present disclosure also provide a storage medium. The storage medium may include but not limited to: flash disk, read-only memory (Read-Only Memory, ROM), random access device
(Random Access Memory,RAM)、磁盘或光盘。随着技术的发展出现的其他存储介质也可以实现本公开的实施例。(Random Access Memory, RAM), disk or CD. Embodiments of the present disclosure may also be implemented by other storage media appearing with the development of technology.
本实施例中的存储介质保存有计算机程序或软件程序,该计算机程序或软件程序当被运行时可操作来执行如下步骤:对采集到的用户上网数据进行拟合,以得到数据分布曲线,其中用户上网数据例如可以包括用户上网的性能指标;以及通过对数据分布曲线进行分析来获得阈值点。在该阈值点时适合于发出异常感知监测报警。也就是说,在该阈值点时发出异常感知监测报警,能够包含大多数的异常信息,又能够最大程度地减少无效的异常告警。The storage medium in this embodiment stores a computer program or a software program, and when the computer program or software program is run, it is operable to perform the following steps: fitting the collected user online data to obtain a data distribution curve, wherein The user surfing data may include, for example, user surfing performance indicators; and the threshold point is obtained by analyzing the data distribution curve. At this threshold point, it is suitable to issue an abnormality perception monitoring alarm. That is to say, when the threshold point is issued, an abnormality perception monitoring alarm can contain most of the abnormal information, and can minimize invalid abnormal alarms.
为了更好地说明根据本公开实施例的上网数据处理方法100和上网数据处理装置400的优点,下面结合表1说明上网数据处理方法100和上网数据处理装置400在实际应用中所取得的有益效果。In order to better illustrate the advantages of the online data processing method 100 and the online data processing device 400 according to the embodiments of the present disclosure, the beneficial effects obtained by the online data processing method 100 and the online data processing device 400 in practical applications will be described below in conjunction with Table 1 .
现网实际应用中,采用上网数据处理方法100和上网数据处理装置400,通过对一周内数据的数据挖掘,得到15分钟粒度用户感知指标检测的预警阈值,表1示出了早忙时和晚忙时2个时段内的阈值浮动差距。可见,采用上网数据处理方法100和上网数据处理装置400所取得阈值点,取得了良好的技术效果,基本符合预期。In the actual application of the current network, the online data processing method 100 and the online data processing device 400 are used to obtain the early warning threshold for 15-minute granularity user perception index detection through data mining of the data within a week. Threshold floating gap within 2 time periods during busy hours. It can be seen that the threshold point obtained by using the online data processing method 100 and the online data processing device 400 has achieved good technical results and basically meets expectations.
表1Table 1
具体地,根据本发明上网数据处理方法和装置的一个或多个实施例能够取得如下技术效果中的一个或多个:Specifically, one or more of the following technical effects can be achieved according to one or more embodiments of the method and device for processing online data in the present invention:
(1)可靠性高(1) High reliability
采用CT通信领域与IT信息领域结合的方法,通过曲线拟合后将拟合曲线进行几何分析,判断曲线变化趋势,找到曲线运动趋势与真实情况差值最大的点,判断为阈值点,这种方法完全通过数学分析完成动态阈值点的监测,不依赖人工经验的判断,相较于其他单纯通过CT通信领域的方案更加有说服力,可信度更高。Using the method of combining the CT communication field and the IT information field, through the curve fitting, the fitting curve is geometrically analyzed, the trend of the curve is judged, and the point with the largest difference between the movement trend of the curve and the real situation is found, which is judged as the threshold point. The method completes the monitoring of the dynamic threshold point completely through mathematical analysis, does not rely on the judgment of human experience, and is more convincing and reliable than other solutions that only use CT communication.
(2)通用性好(2) Good versatility
通过曲线拟合方法将4G用户上网8个关键性能指标进行分析,既可有效挖掘感知质差的4G用户,也可以泛化到其他复杂问题监测和定界上。其数据分析函数会根据不同的性能指标的数值不同而变化,也不需要对函数曲线中的点进行特殊标记,其中某几个点进行单独分析,在现网实际案例中有很好的应用性。The curve fitting method is used to analyze 8 key performance indicators of 4G users online, which can not only effectively mine 4G users with poor perception quality, but also generalize to other complex problem monitoring and demarcation. Its data analysis function will change according to the value of different performance indicators, and there is no need to mark the points in the function curve. Some of the points are analyzed separately, which has good applicability in the actual case of the live network .
(3)复杂度小(3) Small complexity
以往的感知监测阈值点选取方案如7点差值法,是通过对几个候选点进行多次计算,反复迭代才能得到最终结果,这样会大大增加系统的空间复杂度和时间复杂度。而本发明只需进行一次曲线拟合,将所有的点变成了一条曲线,将问题定界问题转换成问题定界曲线的几何判断,算法复杂度较小,易于实现。In the past, the threshold point selection scheme for perception monitoring, such as the 7-point difference method, obtained the final result by performing multiple calculations on several candidate points and repeated iterations, which would greatly increase the space complexity and time complexity of the system. However, the present invention only needs to perform curve fitting once, turns all the points into a curve, and converts the problem of delimiting the problem into the geometric judgment of the delimiting curve of the problem. The complexity of the algorithm is small, and it is easy to implement.
在本发明的上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其他实施例的相关描述。In the above-mentioned embodiments of the present invention, the descriptions of each embodiment have their own emphases, and for parts not described in detail in a certain embodiment, reference may be made to relevant descriptions of other embodiments.
另外,在本发明各个实施例中的各功能模块可以集成在一个处理模块中,也可以是各个模块单独物理存在,也可以两个或两个以上模块集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。In addition, each functional module in each embodiment of the present invention may be integrated into one processing module, each module may exist separately physically, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules.
以上所述仅是本发明的可选实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明原理的前提下,还可以做出若干改进和润饰,这些改进和润饰也应视为本发明的保护范围。The foregoing are only optional implementations of the present invention. It should be pointed out that for those of ordinary skill in the art, some improvements and modifications can also be made without departing from the principle of the present invention. These improvements and modifications It should also be regarded as the protection scope of the present invention.
Claims (9)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611267589.7A CN106817252B (en) | 2016-12-31 | 2016-12-31 | Internet data processing method and processing device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611267589.7A CN106817252B (en) | 2016-12-31 | 2016-12-31 | Internet data processing method and processing device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106817252A CN106817252A (en) | 2017-06-09 |
| CN106817252B true CN106817252B (en) | 2019-11-05 |
Family
ID=59110636
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611267589.7A Active CN106817252B (en) | 2016-12-31 | 2016-12-31 | Internet data processing method and processing device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106817252B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020010567A1 (en) * | 2018-07-12 | 2020-01-16 | 深圳齐心集团股份有限公司 | Information security management method based on big data |
| CN111104559A (en) * | 2018-10-29 | 2020-05-05 | 百度在线网络技术(北京)有限公司 | Method and device for dividing distribution form of user data |
| CN112085631B (en) * | 2020-09-04 | 2021-11-12 | 上海松鼠课堂人工智能科技有限公司 | Intelligent analysis method for student memory curve |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101997729A (en) * | 2009-08-12 | 2011-03-30 | 华为技术有限公司 | Network control method and device |
| CN103986626A (en) * | 2014-05-30 | 2014-08-13 | 电子科技大学 | Simulation method and device for path feature characterization based on end-to-end measured data statistics |
| CN104767656A (en) * | 2015-04-10 | 2015-07-08 | 中国电力科学研究院 | Network flow characteristic analysis method based on fractional order Fourier transformation |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9092371B2 (en) * | 2010-09-02 | 2015-07-28 | The Aerospace Corporation | Signal parameter estimator |
-
2016
- 2016-12-31 CN CN201611267589.7A patent/CN106817252B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101997729A (en) * | 2009-08-12 | 2011-03-30 | 华为技术有限公司 | Network control method and device |
| CN103986626A (en) * | 2014-05-30 | 2014-08-13 | 电子科技大学 | Simulation method and device for path feature characterization based on end-to-end measured data statistics |
| CN104767656A (en) * | 2015-04-10 | 2015-07-08 | 中国电力科学研究院 | Network flow characteristic analysis method based on fractional order Fourier transformation |
Non-Patent Citations (1)
| Title |
|---|
| "电信数据中用户行为特征测量与分析";宋竹 等;《电子科技大学学报》;20151130;第44卷(第6期);第934-939页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106817252A (en) | 2017-06-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106598988B (en) | A data processing method and device | |
| JP7520142B2 (en) | Method for identifying sigma-line patterns and electronic device | |
| US9495099B2 (en) | Space-time-node engine signal structure | |
| US9785719B2 (en) | Generating synthetic data | |
| CN106817252B (en) | Internet data processing method and processing device | |
| MX2012005697A (en) | Improved progress bar. | |
| CN104994539A (en) | Wireless sensor network traffic abnormality detection method based on ARIMA model | |
| CN110737006B (en) | Track denoising processing method and device and electronic equipment | |
| CN107852771A (en) | Network anomaly detection based on adaptive-filtering | |
| CN112150490B (en) | Image detection method, device, electronic equipment and computer readable medium | |
| CN111443163A (en) | Interpolation method and device for ozone missing data and interpolation equipment | |
| KR102866817B1 (en) | Method and system for estimating real estates prices | |
| WO2024146197A1 (en) | Network risk assessment method and system | |
| AU2014235873A1 (en) | Geospatial smoothing in web applications | |
| CN115685936A (en) | Production control method of polycrystalline silicon reduction furnace and related equipment | |
| US10444219B2 (en) | Predictive modeling to estimate data values between sampling events | |
| CN109903079A (en) | Information processing method, equipment and storage medium | |
| CN108694245B (en) | Multi-dimensional data display method and device, readable storage medium and electronic equipment | |
| CN119255363A (en) | Base station location determination method, device, computer equipment and readable storage medium | |
| US10368037B2 (en) | Public safety camera monitoring system and method | |
| CN112486683B (en) | Processor control method, control device, and computer-readable storage medium | |
| CN111208501B (en) | Multi-target aggregation method, device, equipment and storage medium based on radar detection | |
| CN112020866B (en) | Communication data demonstration interface generation method and communication data demonstration method thereof | |
| CN116456074A (en) | Camera module analysis force detection method and device, electronic equipment and storage medium | |
| CN113688350A (en) | Method, device, storage medium and terminal for predicting traffic flow based on Fourier function |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |