[go: up one dir, main page]

CN102595467B - Data acquisition method and data acquisition device - Google Patents

Data acquisition method and data acquisition device Download PDF

Info

Publication number
CN102595467B
CN102595467B CN201110005181.3A CN201110005181A CN102595467B CN 102595467 B CN102595467 B CN 102595467B CN 201110005181 A CN201110005181 A CN 201110005181A CN 102595467 B CN102595467 B CN 102595467B
Authority
CN
China
Prior art keywords
data
data packet
packet
address
data acquisition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201110005181.3A
Other languages
Chinese (zh)
Other versions
CN102595467A (en
Inventor
尹伟
王科
杨光华
金凌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN201110005181.3A priority Critical patent/CN102595467B/en
Publication of CN102595467A publication Critical patent/CN102595467A/en
Application granted granted Critical
Publication of CN102595467B publication Critical patent/CN102595467B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

本发明提供了一种数据采集方法和设备,该方法包括:数据采集设备接收到数据包后,对该数据包逐层进行过滤,并在过滤出分组数据协议PDP激活信令数据包后,解析得到其中携带的分配给用户设备的IP地址;所述数据采集设备根据所述IP地址,对后续接收到的数据包进行过滤,并在过滤出所述IP地址对应的用户面数据包后,将其保存或上报。采用本发明,可提高数据采集效率以及采集的可控性。

The present invention provides a data collection method and device, the method comprising: after the data collection device receives the data packet, it filters the data packet layer by layer, and after filtering out the packet data protocol PDP activation signaling data packet, parses Obtaining the IP address carried in it and assigned to the user equipment; the data acquisition device filters subsequent received data packets according to the IP address, and after filtering out the user plane data packets corresponding to the IP address, the It is saved or reported. By adopting the invention, the efficiency of data collection and the controllability of data collection can be improved.

Description

A kind of collecting method and equipment
Technical field
The present invention relates to wireless communication field, relate in particular to a kind of collecting method and equipment.
Background technology
Along with the extensive commercialization of the third generation (3G) mobile communication, mobile whole network data traffic carrying capacity rapid growth.Because business is not seriously mated with the speedup of network carrying ability, network carrying ability is difficult to meet the explosive growth of data service, and user is experienced and causes bad impact.How in ensureing networking, promote data service quality, to meet user growing to data service diversity and high reliability demand, becomes the problem that operator need to solve.
Tradition is with KPI (Key Performance Indicators, critical sales index) centered by network quality evaluation system be difficult to accurately reflect client perception, need to change to the business realizing end to end management taking client perception as guiding from traditional management centered by KPI based on network element.
In order to set up the effectively end-to-end QoS evaluation system based on user awareness, need to gather the data of user the each port of network (being mainly IuB, IuPS, Gn and Gi mouth), by the depth analysis of these data being found to the very crux that affects quality of service.
Existing collecting device lays particular emphasis on the collection to signaling plane data more, the mode of entirely adopting full prison for the general employing of data of port transmission.The data that collect are kept on hard disk, until off-line is resolved after gathering.If desired gather signaling plane and the user face data of designated user, after gathering, need first signaling plane data to be resolved, the information filtering associated with user face data obtaining by parsing goes out the user face data of designated user.The application that needs packet filtering for some, existing collecting device also can adopt IP-based hardware filtering, and the IP filter condition of specifying by configuration is rejected unwanted data.In the whole process of image data, need to there is people in all other monitoring in real time of instrument.
Inventor realizing in process of the present invention, finds that existing end-to-end data acquisition technology at least exists following defect:
Existing collecting device filters image data by configuration of IP address in gatherer process, and filter effect is poor, and the specific aim gathering is poor, and follow-up needs are further resolved to obtain desired data, and therefore collecting efficiency is low.This just causes may having comprised too many unwanted data in the data of actual preservation.Taking the larger Gn of flow and Gi mouth as example, gather the useful data that may only comprise 2M size in 5G data.
Summary of the invention
The embodiment of the present invention provides a kind of collecting method and equipment, in order to solve the problem that available data acquisition technique collecting efficiency is low, specific aim is poor.
The collecting method that the embodiment of the present invention provides, is applied to teleservice data acquisition, comprises the following steps:
Data acquisition equipment receives after packet, this packet is successively filtered, and filtering out after PDP activation signaling data bag, resolve the IP address of distributing to subscriber equipment of wherein being carried;
Described data acquisition equipment, according to described IP address, filters the follow-up packet receiving, and is filtering out after user face data bag corresponding to described IP address, by its preservation or report.
The data acquisition equipment that the embodiment of the present invention provides, is applied to teleservice data acquisition, and this equipment comprises: data acquisition filtering module, Data Analysis relating module and transfer of data are preserved module, wherein:
Data acquisition filtering module, for receiving after packet, successively filters this packet; And, resolve the IP address obtaining according to described data resolution module, the follow-up packet receiving is filtered;
Data Analysis relating module, activates after signaling data bag for filter out PDP at described data acquisition filtering module, resolves the IP address of distributing to subscriber equipment of wherein being carried;
Transfer of data is preserved module, for filtering out at described data acquisition filtering module after user face data bag corresponding to described IP address, by its preservation or report.
In the above embodiment of the present invention, gathering and filtering out after PDP activation signaling data bag, the IP address of what parsing was wherein carried distribute to subscriber equipment, then according to this IP address, the follow-up packet receiving is being filtered, and filtering out after user face data bag corresponding to described IP address, by its preservation or report, thereby realized, specific user's user face data is gathered, compared with available data acquisition technique, on the one hand, the specific aim gathering is stronger, thereby improve data acquisition efficiency, on the other hand, make up the deficiency for user face data collection aspect in available data acquisition technique.
Brief description of the drawings
Fig. 1 is network topological diagram relevant to the end-to-end data acquisition of business in the embodiment of the present invention;
The data acquisition flow schematic diagram that Fig. 2 provides for the embodiment of the present invention;
Fig. 3 is the signaling plane flow chart of data processing schematic diagram in flow process shown in Fig. 2;
Fig. 4 is the application layer data coupling schematic flow sheet that adopts KMP algorithm to realize shown in Fig. 3 in flow process;
Fig. 5 is the schematic flow sheet of the user face data processing in flow process shown in Fig. 2;
Fig. 6 is the signaling plane data schematic diagram associated with user face data in the embodiment of the present invention;
The data acquisition equipment structural representation that Fig. 7 provides for the embodiment of the present invention.
Embodiment
For solving in existing data acquisition, the problem that collecting efficiency is low, the embodiment of the present invention provides a kind of method and apparatus of data acquisition, data acquisition equipment in this technical scheme, can carry out Data Analysis and filtration for the feature of the end-to-end data acquisition of business, can carry out Long-distance Control by server, utilize the Internet real-time report test data, realize the end-to-end test of carrying out quality of service whenever and wherever possible.
The data that the embodiment of the present invention only gathers signaling plane when analyzing KPI are in the past different, in order to reflect user's true perception, can in gathering signaling plane data, gather the data of user's face, and the data of specific user's signaling plane and user's face can be associated, as the foundation of subsequent analysis.
Below in conjunction with the accompanying drawing in embodiments of the invention, the technical scheme in embodiments of the invention is clearly and completely described.
As shown in Figure 1, be network topological diagram relevant to the end-to-end data acquisition of business in the embodiment of the present invention.Wherein, data acquisition equipment can the each network element of Real-time Collection in the data of each port, as the data of the each equipment in access network equipment, equipment of the core network and business platform.Data acquisition equipment can also communicate with end-to-end analysis platform, sends to this platform to carry out subsequent analysis processing the data that collect.Data acquisition equipment can also with Long-distance Control server communication, accept the control of Long-distance Control server, as, carry out the relevant configuration of data acquisition according to the control of Long-distance Control server, data acquisition is carried out or is stopped in the instruction of receiving remote Control Server, and can further keep clock synchronous with Long-distance Control server.Between data acquisition equipment and Long-distance Control server, can communicate by letter by interconnected network mode.Wherein, Long-distance Control server can be stand-alone network elements, also can be integrated in a network element with end-to-end analysis platform.
Based on above-mentioned network topology structure, Fig. 2 shows a kind of data acquisition flow schematic diagram that the embodiment of the present invention provides.Before starting to carry out data acquisition, data acquisition equipment carries out relevant parameter configuration, these parameters can comprise the information such as the business that will gather, agreement, signaling, test plan, data transfer mode, and data acquisition equipment can be set carry out condition and the rule of data filtering.This configuration operation can carry out according to the control of Long-distance Control server, also can carry out in data acquisition equipment this locality.
In addition, in measure of the quality of service, the time is important index end to end, and user's perception and time are closely related.In order accurately to locate the network element device in existing network, quality of service being impacted, each data acquisition equipment of the embodiment of the present invention also can be synchronizeed with Long-distance Control server, and wherein, Long-distance Control server keeps synchronizeing with GPS, like this, each data acquisition equipment can keep synchronizeing with GPS.
As shown in Figure 2, this data acquisition flow can comprise:
Step 201, data acquisition equipment receives after packet, this packet is successively filtered, and filtering out after PDP (packet data protocol) activation signaling data bag, resolve the IP address of distributing to subscriber equipment of wherein being carried.
Wherein, when packet is successively filtered, can, according to protocol layer order, start upwards to carry out step by step keyword filtration by bottom.Concrete, can filter according to the data link layer MAC address of packet, obtain, after the packet of coupling, filtering according to the network layer IP address of packet; Obtain, after the packet of coupling, filtering according to the transport layer port address of packet; Obtain, after the packet of coupling, filtering according to the application layer content of packet.
In the time that packet is filtered, agreement and the port address of the IP source address of the mac source address of data link layer and destination address, network layer and destination address, transport layer, these filter conditions are fixed substantially in the position of packet, in the time mating, hand over easily and find.But the data of application layer have its particularity, as more in equipment manufacturer in existing network, its consultation adopting is had any different, and in actual agreements, also there are many options, under different condition, the size of application data information is also different, this just causes application data to be difficult to fast and accurately judge the position of occurrence in data message, and causes carrying out data message filtration.For addressing this problem, the embodiment of the present invention, in the time filtering according to the application layer content of packet, adopts the character string matching method based on KMP algorithm to realize.When filtration, only need carry out once rapid scanning from left to right to application layer data, to judge that whether data should abandon, and have improved matching efficiency.
Step 202, data acquisition equipment, according to activating from PDP the IP address that signaling data bag parses, filters the follow-up packet receiving.
In data acquisition, conventionally only can filter out the signaling plane data of designated user communicating number.When this is because carries out business in PS (packet switching) territory, user terminal need to carry out authentication by server, and completes PDP activation, sets up data transmission link, at this moment user terminal just can obtain the dynamic IP addressing that MS distributes, and communicates with this and network side.Only have the data that just can filter out user's face by this IP address.This step parses IP address by activating signaling data bag from PDP, and according to this IP address, the user face data of relative users is filtered, thereby has reached the associated of signaling plane data and user face data.Fig. 6 shows the incidence relation schematic diagram of signaling plane data and user face data.
Step 203, data acquisition equipment is filtering out after user face data bag corresponding to this IP address, by its preservation or report.
In this step, data acquisition equipment can adopt following processing mode to the packet collecting:
Mode one: often obtain a desired data bag, add timestamp in this packet, upload server (as end-to-end analysis platform) when framing is also by network implementation again;
Mode two: by packet in accordance with regulations form remain on this locality, after this service ending, automatically upload onto the server (as end-to-end analysis platform);
Mode three: by packet in accordance with regulations form remain on this locality, send after data transfer instruction until server (as end-to-end analysis platform), be uploaded to this server.
Signaling plane flow chart of data processing shown in Fig. 2 in flow process can as shown in Figure 3, comprise:
As shown in Figure 3, be the signaling plane flow chart of data processing schematic diagram in flow process shown in Fig. 2, the method comprises:
Step 301, data acquisition equipment gathers port data.Data acquisition equipment, according to the concrete configuration of acquisition parameter, can gather the data of the ports such as IuB, IuPS, Gn or Gi.
Step 302, data acquisition equipment judges whether the data that receive are signaling plane data, if so, perform step 303; Otherwise packet discard.
Data acquisition equipment can judge whether the data that receive are signaling plane data by analysis protocol keyword.Concrete, data acquisition equipment can obtain signaling plane data by successively filtering keyword.Mac source address in data link layer to Frame and destination address mate with corresponding keyword (as source MAC and target MAC (Media Access Control) address), filter out and contain the Frame that does not need MAC Address; IP source address in network layer to packet and destination address mate with corresponding keyword (source IP address and object IP address), filter out hash bag; In transport layer, each agreement and port are mated with corresponding keyword, filter out hash bag; In application layer, application data is used depth detection, filters out hash bag, and what finally obtain is exactly to carry out end-to-end QoS to analyze required data.
Step 303, data acquisition equipment adopts KMP algorithm application data to mate.
Although the position of the application layer data of various applied business in packet and the length of application layer data section are not quite similar, and can determine the scope that application layer data may exist in packet by methods such as statistics.In this step, data acquisition equipment can extract the data segment of this setting range from packet, and start to scan this data segment from this data segment left side, if the data in current scanning area and keyword match are determined the packet of this packet for gathering; Otherwise slip scan region proceed keyword match to the right; By that analogy, until determine the packet of packet for gathering, or until this data segment scanned.Wherein, described keyword can be IMSI (International MobileSubscriber Identifier, international mobile subscriber identifier), call out the cell ID (cell ID) occurring or call out the parameter such as LAC ID (Location Area Code, Location Area Code) occurring.
Step 304, data acquisition equipment judges whether data mate, if coupling performs step 305; Otherwise packet discard.
Step 305, data acquisition equipment determines whether that PDP activates signaling, if so, performs step 306; Otherwise, perform step 307.
Step 306, resolves and obtains user's face IP address, and perform step 307.
Step 307, preserves signaling plane data.
The application layer data coupling flow process that employing KMP algorithm shown in Fig. 2 in flow process is realized can as shown in Figure 4, comprise:
Step 401, data acquisition equipment takes out the data segment that needs coupling from packet.
By finding out protocal analysis, although the position of application data in packet is unfixed, but its residing scope is confirmable, in the time scanning, can not need from first to last to scan one time, the scope that only need may occur according to application data is carried out scan matching, can add like this fast scan speed, improves matching efficiency.
Step 402, data acquisition equipment is scan-data segment information from left to right.
Concrete, the process of scanning is exactly that the one section of character string and the keyword strings that take out in data message compare.Wherein, keyword strings is generally the parameters such as IMSI, the cell ID that calls out generation or the LAC ID (Location Area Code, Location Area Code) that calls out generation.
Step 403, data acquisition equipment judges whether the character string scanning mates with keyword strings, if so, shows that this packet is desired data bag, and continues next packet to mate; Otherwise execution step 404.
Step 404, data acquisition equipment judges whether by data segment been scanned; If so, show that this packet is that hash bag should abandon, execution step 406; Otherwise, execution step 405.
Step 405, according to " part coupling " result having obtained, a slip scan region segment distance far away as far as possible, then proceeds to step 402 forward, and the data in scanning area are mated.
Step 406, abandons this packet.
User face data handling process shown in Fig. 2 in flow process can as shown in Figure 5, comprise:
Step 501, data acquisition equipment gathers port data.Data acquisition equipment, according to the concrete configuration of acquisition parameter, can gather the data of the ports such as IuB, IuPS, Gn or Gi.
Step 502, data acquisition equipment judges whether the data that gather are user face data, if so, perform step 503; Otherwise, abandon this packet.
In this step, data acquisition equipment can judge whether the data that collect are user face datas by analysis protocol keyword.
Whether step 503, can obtain user face data IP address, if so, performs step 504; Otherwise, return to step 501, continue to gather other data.
Step 504, data acquisition equipment judges whether to meet IP address filtering condition, if so, performs step 505; Otherwise, abandon this packet.
Step 505, data acquisition equipment is preserved this user face data.
In sum, in the embodiment of the present invention, data acquisition equipment is by the data message (comprise and gather signaling plane data and user face data) of port, successively image data information, use the character string matching method based on KMP algorithm to filter for the data acquisition of application layer, signaling plane data are resolved and carried out associated with filter user face data with user face data, to the desired data finally obtaining, compared with available data acquisition technique, can carry out more targetedly data acquisition, and then improve data acquisition efficiency.In addition, data acquisition equipment can also be controlled by distant place Control Server, has improved the controllability of data acquisition.
Based on identical technical conceive, the embodiment of the present invention also provides a kind of data acquisition equipment that can be applicable to above-mentioned flow process.
Referring to Fig. 7, be the data acquisition equipment structural representation that the embodiment of the present invention provides, this data acquisition equipment can comprise: data acquisition filtering module 701, Data Analysis relating module 702 and transfer of data are preserved module 703, wherein:
Data acquisition filtering module 701, for receiving after packet, successively filters this packet; And, resolve according to Data Analysis relating module 702 the IP address obtaining, the follow-up packet receiving is filtered;
Data Analysis relating module 703, activates after signaling data bag for filter out PDP at data acquisition filtering module 701, resolves the IP address of distributing to subscriber equipment of wherein being carried;
Transfer of data is preserved module 703, for filtering out at data acquisition filtering module 701 after user face data bag corresponding to described IP address, by its preservation or report.
In above-mentioned data acquisition equipment, data acquisition filtering module 701 can filter according to the data link layer MAC address of packet; Obtain, after the packet of coupling, filtering according to the network layer IP address of packet; Obtain, after the packet of coupling, filtering according to the transport layer port address of packet; Obtain, after the packet of coupling, filtering according to the application layer content of packet.
In above-mentioned data acquisition equipment, data acquisition filtering module 701 can extract the data segment of setting range from packet, and start scanning from this data segment left side, if the data in current scanning area and keyword match are determined the packet of described packet for gathering; Otherwise slip scan region is scanned and is carried out keyword match to the right; By that analogy, until determine the packet of described packet for gathering, or until this data segment scanned.
Above-mentioned data acquisition equipment also can comprise configuration with control module 704, for accept Long-distance Control server send for controlling the control command of data acquisition, or/and, Packet Filtering rule.
Above-mentioned data acquisition equipment also can comprise clock synchronization module 705, and for carrying out clock synchronous with the Long-distance Control server of data acquisition equipment, wherein, described Long-distance Control server and GPS keep clock synchronous.
In above-mentioned data acquisition equipment, data acquisition filtering module 701 can be realized by hardware mode, further to improve data acquisition efficiency.
It should be noted that, the embodiment of the present invention, in the filtration to packet and parse operation, can be realized by hardware.
Also it should be noted that, the embodiment of the present invention is not limited to and adopts the mode of server and data acquisition equipment to complete end-to-end data acquisition, also can adopt equipment and the mode of other application the technical program.
Through the above description of the embodiments, those skilled in the art can be well understood to the mode that the present invention can add essential general hardware platform by software and realize, and can certainly pass through hardware, but in a lot of situation, the former is better execution mode.Based on such understanding, the part that technical scheme of the present invention contributes to prior art in essence in other words can embody with the form of software product, this computer software product is stored in a storage medium, comprise that some instructions (can be personal computers in order to make a computer equipment, server, or the network equipment etc.) carry out the method described in each embodiment of the present invention.
It will be appreciated by those skilled in the art that accompanying drawing is the schematic diagram of a preferred embodiment, the module in accompanying drawing or flow process might not be that enforcement the present invention is necessary.
It will be appreciated by those skilled in the art that the module in the device in embodiment can be distributed in the device of embodiment according to embodiment description, also can carry out respective change and be arranged in the one or more devices that are different from the present embodiment.The module of above-described embodiment can be merged into a module, also can further split into multiple submodules.
The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.
Disclosed is above only several specific embodiment of the present invention, and still, the present invention is not limited thereto, and the changes that any person skilled in the art can think of all should fall into protection scope of the present invention.

Claims (7)

1.一种数据采集方法,其特征在于,包括以下步骤:1. A data acquisition method, characterized in that, comprises the following steps: 数据采集设备接收到数据包后,对该数据包逐层进行过滤,并在过滤出分组数据协议PDP激活信令数据包后,解析得到其中携带的分配给用户设备的IP地址;After the data acquisition device receives the data packet, it filters the data packet layer by layer, and after filtering out the packet data protocol PDP activation signaling data packet, it analyzes and obtains the IP address assigned to the user equipment carried in it; 所述数据采集设备根据所述IP地址,对后续接收到的数据包进行过滤,并在过滤出所述IP地址对应的用户面数据包后,将其保存或上报;The data acquisition device filters subsequent received data packets according to the IP address, and saves or reports the user plane data packets corresponding to the IP address after filtering out; 所述对数据包逐层进行过滤,包括:根据数据包的数据链路层MAC地址进行过滤;得到匹配的数据包后,根据数据包的网络层IP地址进行过滤;得到匹配的数据包后,根据数据包的传输层端口地址进行过滤;得到匹配的数据包后,根据数据包的应用层内容进行过滤;The described data packet is filtered layer by layer, including: filtering according to the data link layer MAC address of the data packet; after obtaining the matched data packet, filtering according to the network layer IP address of the data packet; after obtaining the matching data packet, Filter according to the transport layer port address of the data packet; after getting the matched data packet, filter according to the application layer content of the data packet; 所述根据数据包的应用层内容进行过滤,包括:The filtering according to the application layer content of the data packet includes: 从数据包中提取出设定范围的数据段,并从该数据段左侧开始扫描,若当前扫描区域内的数据与关键字匹配,则确定所述数据包为所要采集的数据包;否则向右滑动扫描区域进行扫描并进行关键字匹配;以此类推,直到确定出所述数据包为所要采集的数据包,或者直到该数据段扫描完成。Extract the data segment of the set range from the data packet, and start scanning from the left side of the data segment, if the data in the current scanning area matches the keyword, then determine that the data packet is the data packet to be collected; Slide the scanning area to the right to scan and perform keyword matching; and so on until it is determined that the data packet is the data packet to be collected, or until the scanning of the data segment is completed. 2.如权利要求1所述的方法,其特征在于,所述关键字为国际移动用户标识符IMSI、呼叫发生的小区标识或呼叫发生的位置区码。2. The method according to claim 1, wherein the keyword is an International Mobile Subscriber Identifier (IMSI), a cell identity where the call occurs, or a location area code where the call occurs. 3.如权利要求1或2任一项所述的方法,其特征在于,所述采集设备根据该采集设备的远程控制服务器的控制,执行所述数据采集过程。3. The method according to any one of claims 1 or 2, wherein the collection device executes the data collection process under the control of a remote control server of the collection device. 4.如权利要求1或2任一项所述的方法,其特征在于,还包括:所述采集设备与该采集设备的远程控制服务器进行时钟同步,其中,所述远程控制服务器与全球位置测定系统GPS保持时钟同步。4. The method according to any one of claims 1 or 2, further comprising: performing clock synchronization between the collection device and the remote control server of the collection device, wherein the remote control server and the global position measurement The system GPS keeps the clocks synchronized. 5.一种数据采集设备,其特征在于,包括:数据采集过滤模块、数据解析关联模块和数据传输保存模块,其中:5. A data acquisition device, characterized in that it comprises: a data acquisition filtering module, a data analysis association module and a data transmission preservation module, wherein: 数据采集过滤模块,用于在接收到数据包后,对该数据包逐层进行过滤;以及,根据所述数据解析关联模块解析得到的IP地址,对后续接收到的数据包进行过滤;The data collection and filtering module is used to filter the data packet layer by layer after receiving the data packet; and, according to the IP address analyzed by the data analysis association module, filter the subsequent received data packets; 数据解析关联模块,用于在所述数据采集过滤模块过滤出PDP激活信令数据包后,解析得到其中携带的分配给用户设备的IP地址;A data parsing and association module, configured to analyze and obtain the IP address carried in it and assigned to the user equipment after the PDP activation signaling packet is filtered out by the data collection and filtering module; 数据传输保存模块,用于在所述数据采集过滤模块过滤出所述IP地址对应的用户面数据包后,将其保存或上报;A data transmission and storage module, configured to store or report the user plane data packet corresponding to the IP address after the data collection and filtering module filters it out; 其中,所述数据采集过滤模块具体用于:根据数据包的数据链路层MAC地址进行过滤;得到匹配的数据包后,根据数据包的网络层IP地址进行过滤;得到匹配的数据包后,根据数据包的传输层端口地址进行过滤;得到匹配的数据包后,根据数据包的应用层内容进行过滤;Wherein, the data collection filtering module is specifically used for: filtering according to the data link layer MAC address of the data packet; after obtaining the matched data packet, filtering according to the network layer IP address of the data packet; after obtaining the matching data packet, Filter according to the transport layer port address of the data packet; after getting the matched data packet, filter according to the application layer content of the data packet; 所述数据采集过滤模块在根据数据包的应用层内容进行过滤时:从数据包中提取出设定范围的数据段,并从该数据段左侧开始扫描,若当前扫描区域内的数据与关键字匹配,则确定所述数据包为所要采集的数据包;否则向右滑动扫描区域进行扫描并进行关键字匹配;以此类推,直到确定出所述数据包为所要采集的数据包,或者直到该数据段扫描完成。When the data collection and filtering module filters according to the application layer content of the data packet: extract the data segment of the set range from the data packet, and start scanning from the left side of the data segment, if the data in the current scanning area is not the same as the key word match, then determine that the data packet is the data packet to be collected; otherwise, slide the scanning area to the right to scan and perform keyword matching; and so on until it is determined that the data packet is the data packet to be collected, or until The data segment is scanned. 6.如权利要求5所述的数据采集设备,其特征在于,还包括:6. The data acquisition device as claimed in claim 5, further comprising: 配置与控制模块,用于接受远程控制服务器发送的用于控制数据采集过程的控制指令,或/和,数据包过滤规则。The configuration and control module is configured to accept control instructions sent by the remote control server for controlling the data collection process, or/and data packet filtering rules. 7.如权利要求5所述的数据采集设备,其特征在于,还包括:7. The data acquisition device according to claim 5, further comprising: 时钟同步模块,用于与所述数据采集设备的远程控制服务器进行时钟同步,其中,所述远程控制服务器与GPS保持时钟同步。A clock synchronization module, configured to perform clock synchronization with the remote control server of the data acquisition device, wherein the remote control server maintains clock synchronization with GPS.
CN201110005181.3A 2011-01-04 2011-01-04 Data acquisition method and data acquisition device Expired - Fee Related CN102595467B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110005181.3A CN102595467B (en) 2011-01-04 2011-01-04 Data acquisition method and data acquisition device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110005181.3A CN102595467B (en) 2011-01-04 2011-01-04 Data acquisition method and data acquisition device

Publications (2)

Publication Number Publication Date
CN102595467A CN102595467A (en) 2012-07-18
CN102595467B true CN102595467B (en) 2014-09-10

Family

ID=46483569

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110005181.3A Expired - Fee Related CN102595467B (en) 2011-01-04 2011-01-04 Data acquisition method and data acquisition device

Country Status (1)

Country Link
CN (1) CN102595467B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102880168B (en) * 2012-09-21 2014-12-24 青岛海信日立空调系统有限公司 Method and device for testing line controller
CN104022920B (en) * 2014-06-26 2017-11-21 重庆重邮汇测通信技术有限公司 A kind of LTE network flux recognition system and method
CN106535210B (en) * 2016-11-28 2020-03-20 宜通世纪科技股份有限公司 Cell service coverage map drawing method and system based on mobile communication signaling acquisition
CN110868436B (en) * 2018-08-28 2021-03-23 清华大学 IoT data collection method and device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1480857A (en) * 2003-06-05 2004-03-10 中国科学院计算技术研究所 Dual Optical Port Smart Gigabit Ethernet Card
CN1625086A (en) * 2003-12-03 2005-06-08 华为技术有限公司 Voice quality test method and system
CN1855853A (en) * 2005-04-25 2006-11-01 华为技术有限公司 Command monitoring method and system
CN101561825A (en) * 2009-06-02 2009-10-21 北京迈朗世讯科技有限公司 Media technology platform system, data acquisition system and network content supplying method
CN101674200A (en) * 2009-10-19 2010-03-17 中兴通讯股份有限公司 Generation method of SGSN topological graph and device thereof

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FI108601B (en) * 1999-01-05 2002-02-15 Nokia Corp Dissemination of QoS mapping information in a packet radio network
US8364850B2 (en) * 2006-07-20 2013-01-29 Qualcomm Incorporated Utility service in multi-processor environment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1480857A (en) * 2003-06-05 2004-03-10 中国科学院计算技术研究所 Dual Optical Port Smart Gigabit Ethernet Card
CN1625086A (en) * 2003-12-03 2005-06-08 华为技术有限公司 Voice quality test method and system
CN1855853A (en) * 2005-04-25 2006-11-01 华为技术有限公司 Command monitoring method and system
CN101561825A (en) * 2009-06-02 2009-10-21 北京迈朗世讯科技有限公司 Media technology platform system, data acquisition system and network content supplying method
CN101674200A (en) * 2009-10-19 2010-03-17 中兴通讯股份有限公司 Generation method of SGSN topological graph and device thereof

Also Published As

Publication number Publication date
CN102595467A (en) 2012-07-18

Similar Documents

Publication Publication Date Title
USRE49126E1 (en) Real-time adaptive processing of network data packets for analysis
CN111683097B (en) A cloud network traffic monitoring system based on two-level architecture
CN112714045B (en) Rapid protocol identification method based on device fingerprint and port
EP2787758B1 (en) Method, device and system for monitoring internet access service quality of mobile terminal
CN109167798B (en) Household Internet of things device DDoS detection method based on machine learning
CN107888605B (en) A method and system for traffic security analysis of Internet of Things cloud platform
CN107154940A (en) A kind of Internet of Things vulnerability scanning system and scan method
CN103188104A (en) Method and device for analyzing user behaviors
CN102857917B (en) Method for identifying internet access of mobile phone through personal computer (PC) based on signaling analysis
CN102571479A (en) Method, device and system for measuring time delay
CN110048962A (en) A kind of method of net flow assorted, system and equipment
CN102595467B (en) Data acquisition method and data acquisition device
CN110536324B (en) A method and system for collecting and processing WiFi signal data
CN101764748B (en) Method for identifying application program, device and system thereof
CN113726809B (en) IoT device identification method based on traffic data
CN115766471B (en) Network service quality analysis method based on multicast flow
CN108206788A (en) The business recognition method and relevant device of a kind of flow
CN108512816B (en) A method and device for detecting traffic hijacking
CN103052094A (en) Method for acquiring service set identifier of wireless mobile terminal
CN109673011B (en) Mobile terminal identity information correlation analysis method and device
CN110545213A (en) Computer network data flow monitoring system and method
CN101483557A (en) Log statistic, storing method and system used for deep packet detection apparatus
CN102053970A (en) Database auditing method and system
TW201620320A (en) Mobile Internet quality analysis system and method
CN117082522A (en) Dynamic IP access method, device and equipment for Internet of things equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20140910