CN108959514A - A kind of data processing method and device - Google Patents
A kind of data processing method and device Download PDFInfo
- Publication number
- CN108959514A CN108959514A CN201810685887.0A CN201810685887A CN108959514A CN 108959514 A CN108959514 A CN 108959514A CN 201810685887 A CN201810685887 A CN 201810685887A CN 108959514 A CN108959514 A CN 108959514A
- Authority
- CN
- China
- Prior art keywords
- message
- query
- index
- object message
- data processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 12
- 238000012545 processing Methods 0.000 claims abstract description 49
- 238000000034 method Methods 0.000 claims abstract description 18
- 238000012795 verification Methods 0.000 claims abstract description 16
- 238000001914 filtration Methods 0.000 claims abstract description 9
- 238000013507 mapping Methods 0.000 claims description 11
- 238000013481 data capture Methods 0.000 claims description 4
- 238000013500 data storage Methods 0.000 claims description 4
- 210000000352 storage cell Anatomy 0.000 claims description 4
- 238000005516 engineering process Methods 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 9
- 238000003860 storage Methods 0.000 description 7
- 230000002123 temporal effect Effects 0.000 description 5
- 230000002093 peripheral effect Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000004590 computer program Methods 0.000 description 2
- 235000013399 edible fruits Nutrition 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000003754 machining Methods 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
A kind of data processing method provided in an embodiment of the present invention and device, belong to banking business data processing technology field.This method includes obtaining query message；Judge whether query message meets the first preset rules；If so, judging whether the preset field in query message meets default verification condition；If so, carrying out data cleansing by all indexs that the second preset rules are included to query message, first object message is generated；Judge whether the sum for the index that first object message is included is greater than preset value；If it is not, obtaining map information corresponding to each index in first object message；By will be filtered with the querying condition of all indexs in the unmatched first object message of map information, the second object message is generated；Construct empty returned packet, returned packet includes result information corresponding to all indexs for filtering out；Query result is obtained based on the querying condition that the second object message carries；Query result is inserted into returned packet, realizes mass data inquiry.
Description
Technical field
The present invention relates to banking business data processing technology fields, in particular to a kind of data processing method and dress
It sets.
Background technique
Currently, banking employee is in data such as AUM, customer manager's sales volume, the site sales volumes for checking client,
First the business datum batch machining that each operation system generates is calculated, then for different checking, mode develops online friendship respectively
Easily.Since similar achievement data is many and diverse, statistics granularity multiplicity, and the customers faced are different, inevitably result in and need needle
Different transaction is developed to different achievement datas, such processing mode brings a large amount of workload, so that can not be extra large in real time
Measure the inquiry of data.Therefore, the technical problem that above-mentioned technical problem is current urgent need to resolve how is solved.
Summary of the invention
A kind of data processing method provided by the invention and device, it is intended to improve the above problem.
A kind of data processing method provided by the invention, comprising: obtain query message；Judge whether the query message is full
The first preset rules of foot；If so, judging whether the preset field in the query message meets default verification condition；If so, logical
It crosses all indexs that the second preset rules are included to the query message and carries out data cleansing, generate first object message；Sentence
Whether the total of index that the first object message is included that break is greater than preset value；If it is not, obtaining the first object message
In map information corresponding to each index；By by with the institute in the unmatched first object message of the map information
There is the querying condition of index to be filtered, generates the second object message；Empty returned packet is constructed, the returned packet included
Result information corresponding to all indexs filtered；Inquiry knot is obtained based on querying condition entrained by second object message
Fruit；The query result is inserted into the returned packet.
Optionally, described to judge whether the query message meets the first preset rules, comprising: to judge the inquiry report
Whether the message field (MFLD) of text meets the first preset rules.
Optionally, it is clear to carry out data for all indexs for being included to the query message by the second preset rules
It washes, generates first object message, including；Obtaining the query message each of is included the letter of mark corresponding to the index
Breath；By being that empty index is filtered by the identification information, first object message is generated.
Optionally, the map information includes address mapping information and time map information, it is described by will with it is described
The querying condition of all indexs in the unmatched first object message of map information is filtered, and generates the second target report
Text, comprising: the index in the first object message is judged based on the address mapping information and the time map information
Whether query time and inquiry address are empty；If so, being index corresponding to sky by the query time and the inquiry address
It is filtered, generates the second object message.
Optionally, described that query result is obtained based on querying condition entrained by second object message, comprising: root
Constructs database inquiry instruction is distinguished according to the querying condition corresponding to each index in second object message；It obtains every
The corresponding query result of a data base querying instruction.
Optionally, after whether the preset field judged in the query message meets default verification condition, also
It include: to store data corresponding to the preset field into caching.
A kind of data processing equipment provided by the invention, comprising: data capture unit, for obtaining query message；First
Data processing unit, for judging whether the query message meets the first preset rules；Second data processing unit, if for
It is to judge whether the preset field in the query message meets default verification condition；Third data processing unit, if for
It is to carry out data cleansing by all indexs that the second preset rules are included, generate first object report to the query message
Text；4th data processing unit, for judging whether the total of index that the first object message is included is greater than preset value；
5th data processing unit, for if it is not, obtaining map information corresponding to each index in the first object message；6th
Data processing unit, for by will be looked into all indexs in the unmatched first object message of the map information
Inquiry condition is filtered, and generates the second object message；Message structural unit, for constructing empty returned packet, the return report
Text includes result information corresponding to all indexs for filtering out；Result queries unit, for being based on second object message
Entrained querying condition obtains query result；Data return unit, for the query result to be inserted the returned packet.
Optionally, first data processing unit is specifically used for: judging whether the message field (MFLD) of the query message is full
The first preset rules of foot.
Optionally, the third data processing unit is specifically used for: it each of is included described for obtaining the query message
Identification information corresponding to index；By being that empty index is filtered by the identification information, first object message is generated.
Optionally, after second data processing unit, further includes: data storage cell is used for the predetermined word
Data corresponding to section are stored into caching.
A kind of data processing method and device that aforementioned present invention provides, by first obtaining query message；Judge again described
Whether query message meets the first preset rules；When the query message meets the first preset rules, then judge the inquiry
Whether the preset field in message meets default verification condition；When preset field meets default verification condition, then pass through second
All indexs that preset rules are included to the query message carry out data cleansing, generate first object message；Then judge
Whether the sum for the index that the first object message is included is greater than preset value；When sum is not more than preset value, then again
Obtain map information corresponding to each index in the first object message；Then again by will be with the map information not
The querying condition for all indexs in the first object message matched is filtered, and generates the second object message；Then structure again
Make empty returned packet, the returned packet includes result information corresponding to all indexs for filtering out；Then it is based on institute again
It states querying condition entrained by the second object message and obtains query result；The query result is finally inserted the return to report
Text, to improve the efficiency of data query and the accuracy of query result while realizing the real-time query of mass data.
To enable the above objects, features and advantages of the present invention to be clearer and more comprehensible, preferred embodiment is cited below particularly, and cooperate
Appended attached drawing, is described in detail below.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be to needed in the embodiment attached
Figure is briefly described, it should be understood that the following drawings illustrates only certain embodiments of the present invention, therefore is not construed as pair
The restriction of range for those of ordinary skill in the art without creative efforts, can also be according to this
A little attached drawings obtain other relevant attached drawings.
Fig. 1 is the structural block diagram of a kind of electronic equipment provided in an embodiment of the present invention；
Fig. 2 is the flow chart for the data processing method that first embodiment of the invention provides；
Fig. 3 is the functional block diagram for the data processing equipment that second embodiment of the invention provides.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without creative efforts, shall fall within the protection scope of the present invention.Therefore,
The model of claimed invention is not intended to limit to the detailed description of the embodiment of the present invention provided in the accompanying drawings below
It encloses, but is merely representative of selected embodiment of the invention.Based on the embodiments of the present invention, those of ordinary skill in the art are not having
Every other embodiment obtained under the premise of creative work is made, shall fall within the protection scope of the present invention.
As shown in Figure 1, being the structural block diagram of a kind of electronic equipment provided in an embodiment of the present invention.The electronic equipment 300
Including data processing equipment 400, memory 302, storage control 303, processor 304 and Peripheral Interface 305.
The memory 302, storage control 303, processor 304 and each element of Peripheral Interface 305 are direct between each other
Or be electrically connected indirectly, to realize the transmission or interaction of data.For example, these elements can pass through one or more between each other
Communication bus or signal wire, which are realized, to be electrically connected.The data processing equipment 400 includes at least one can be with software or firmware
(firmware) form is stored in the memory 302 or is solidificated in the operating system of the electronic equipment 300
Software function module in (operating system, OS).The processor 304 is used to execute to store in memory 302
Executable module, such as software function module or computer program that the data processing equipment 400 includes.
Wherein, memory 302 may be, but not limited to, random access memory (Random Access Memory,
RAM), read-only memory (Read Only Memory, ROM), programmable read only memory (Programmable Read-
Only Memory, PROM), erasable read-only memory (Erasable Programmable Read-Only Memory,
EPROM), electricallyerasable ROM (EEROM) (Electric Erasable Programmable Read-Only Memory,
EEPROM) etc..Wherein, memory 302 is for storing program, and the processor 304 is after receiving and executing instruction, described in execution
Program.
Processor 304 may be a kind of IC chip, the processing capacity with signal.Above-mentioned processor 304 can
To be general processor, including central processing unit (Central ProcessingUnit, abbreviation CPU), network processing unit
(Network Processor, abbreviation NP) etc.；Can also be digital signal processor (DSP), specific integrated circuit (ASIC),
Ready-made programmable gate array (FPGA) either other programmable logic device, discrete gate or transistor logic, discrete hard
Part component.It may be implemented or execute disclosed each method, step and the logic diagram in the embodiment of the present invention.General processor
It can be microprocessor or the processor be also possible to any conventional processor etc..
Various input/output devices are couple processor 304 and memory 302 by the Peripheral Interface 305.Some
In embodiment, Peripheral Interface 305, processor 304 and storage control 303 can be realized in one single chip.Other one
In a little examples, they can be realized by independent chip respectively.
Referring to Fig. 2, being the flow chart for the data processing method that first embodiment of the invention provides.It below will be to Fig. 2 institute
The detailed process shown is described in detail.
Step S101 obtains query message.
Wherein, the query message includes multiple indexs, and each index is corresponding with an identification information, the mark letter
Breath includes temporal information and attaching information.Wherein, the temporal information is time type information, such as year, month, day.
Wherein, divide the principle of table that index distribution is stored in different database tables according to point library.
Step S102, judges whether the query message meets the first preset rules.
As an implementation, judge whether the message field (MFLD) of the query message meets the first preset rules, such as work as
When in the message field (MFLD) of the query message including critical field or identification field, then it is judged to meeting the first default rule
Then, conversely, being then unsatisfactory for.As critical field either identification field can be heading, type of message, message version, message
Length or message entity etc., here, being not especially limited.
Wherein, when the query message is unsatisfactory for the first preset rules, then determine the query message for exception, thus
Terminate inquiry.
Step S103, if so, judging whether the preset field in the query message meets default verification condition.
When the query message meets the first preset rules, judge whether the preset field in the query message meets
Default verification condition, the setting of the preset condition can be configured according to actual needs, for example, in the query message
Preset field corresponding to most 1 or 2 when, then be judged to meeting default verification condition, conversely, being then unsatisfactory for.
As an implementation, data corresponding to the preset field can be stored in the buffer in real time, with solution
The automatic caching for the hot spot data that certainly banking system high frequency uses, automatic synchronization problem.
Step S104, if so, carrying out data by all indexs that the second preset rules are included to the query message
Cleaning generates first object message.
Wherein, second preset rules, which refer to, judges that query message each of is included mark corresponding to the index
Whether information is sky, that is, washing identification information is empty index, and retaining identification information is not empty index.
The data cleansing refers to the querying condition repetition or nothing in all indexs for being included to the query message
The data of effect are filtered processing.
As an implementation, when the preset field in the query message meets default verification condition, institute is obtained
Stating query message each of is included identification information corresponding to the index；By by the identification information be empty index into
Row filtering, generates first object message.
Wherein, the identification information includes temporal information and attaching information, i.e., when temporal information and attaching information are empty,
It is that index corresponding to sky is filtered by temporal information and attaching information, so that the index not filtered is generated first object
Message.
In the present embodiment, after can be by the way that the index not filtered is re-started encapsulation, first object message be generated,
The index for not having filtering in the query message directly can also be generated into first object message.Here, being not especially limited.
Step S105, judges whether the sum for the index that the first object message is included is greater than preset value.
In the present embodiment, the preset value can be 5, is also possible to the random natural number greater than 5, can also be and be less than
5 integer.Preferably, the preset value is 5.
As an implementation, judge whether the sum for the index that the first object message is included is greater than 5.
It as another embodiment, can be by judging the inquiry sum of index that the first object message is included
Whether 360 are greater than, wherein the inquiry sum meets:M be inquire total n be index sum, C be refer to
Target attaching information number, Ti are the Query Dates number of i-th of index.
Step S106, if it is not, obtaining map information corresponding to each index in the first object message.
When the sum for the index that the first object message is included is not more than preset value, the first object report is obtained
Map information corresponding to each index in text, as by obtaining the letter of mapping corresponding to pre-stored each index in caching
Breath, the map information includes address mapping information and time map information.
Wherein, the address mapping information is used to obtain the storage location of index, can such as be known by address mapping information
Road index is stored in which of which table column, and the time map information is for reflecting that the time existing for some index is remembered
Record.
As an implementation, the map information can be stored in the buffer, is made with solving banking system high frequency
The automatic caching for the hot spot data used, automatic synchronization problem.
Step S107, by will be looked into all indexs in the unmatched first object message of the map information
Inquiry condition is filtered, and generates the second object message.
Wherein, matching refers to the time inquired required for the querying condition or address is identical as the map information or phase
Deng.
As an implementation, first mesh is judged based on the address mapping information and the time map information
Whether the query time of the index in mark message and inquiry address are empty；If so, by the query time and the inquiry address
It is filtered for index corresponding to sky, generates the second object message.Specifically, by the address mapping information and described first
The inquiry address of index in object message is matched, when including the inquiry address in the address mapping information, i.e.,
When being not empty, then it is judged to matching, conversely, then mismatching.Similarly, by the time map information and the first object message
In the query time of index matched, when including the query time in the time map information, i.e., when being not empty,
Then it is judged to matching, conversely, then mismatching.
Step S108, constructs empty returned packet, and the returned packet includes knot corresponding to all indexs for filtering out
Fruit information.
Wherein, all indexs filtered out refer to that the index that the querying condition is included subtracts second target
The index that message is included.
In the present embodiment, returned packet is written by result information corresponding to the index that will filter out, can made
User can check why these indexs do not inquire as a result, such as when receiving returned packet by the returned packet
It is because index is not present or the time is not present, or still attaching information is not present without the reasons such as being worth.To make
User can fast explicit why do not inquire.With saved user processing do not inquire data when
Between.
Step S109 obtains query result based on querying condition entrained by second object message.
As an implementation, the querying condition according to corresponding to each index in second object message point
Other constructs database inquiry instruction；Obtain the corresponding query result of each data base querying instruction.Such as, according to each finger
The table in the either storing data library of inquiry address in the corresponding querying condition of mark is inquired to distinguish constructs database
Instruction, such as constructing SQL query statement.By re-establishing data base querying instruction, with quick obtaining query result.
The query result is inserted the returned packet by step S110.
Wherein, it after the query result is inserted the returned packet, is sent after the returned packet being encrypted
To target side.It is trapped to avoid returned packet after either losing and is seen by other users.
As a kind of implement scene, when staff carries out mass data real-time query, the number that provides through the invention
According to processing method, whether there are repetition querying condition or invalid inquiry in the query message that staff can be made no matter to send
Condition etc. can be carried out directly inquiring, and by multiple data cleansing, effectively reduce the inquiry data of query message
Amount, and then acquisition data query result is accelerated, so that staff can fast implement dependency number in operation interface
According to chart show speed, and then bring better user experience.
Referring to Fig. 3, being the functional block diagram for the data processing equipment that second embodiment of the invention provides.The number
It include data capture unit 410, the first data processing unit 420, the second data processing unit 430, third according to processing unit 400
Data processing unit 440, the 4th data processing unit 450, the 5th data processing unit 460, the 6th data processing unit 470,
Message structural unit 480, result queries unit 490 and data return unit 491.
Data capture unit 410, for obtaining query message.
First data processing unit 420, for judging whether the query message meets the first preset rules.
Wherein, first data processing unit 420 is specifically used for: judging whether the message field (MFLD) of the query message is full
The first preset rules of foot.
Second data processing unit 430, for if so, the preset field for judging in the query message whether meet it is default
Verification condition.
As an implementation, after second data processing unit 430, further includes: data storage cell.
The data storage cell is for storing data corresponding to the preset field into caching.
Third data processing unit 440, for if so, the institute for being included to the query message by the second preset rules
There is index to carry out data cleansing, generates first object message.
Wherein, the third data processing unit 440 is specifically used for: it each of is included described for obtaining the query message
Identification information corresponding to index；By being that empty index is filtered by the identification information, first object message is generated.
Whether the 4th data processing unit 450, the sum for judging index that the first object message is included are big
In preset value.
5th data processing unit 460, for being reflected corresponding to each index if it is not, obtaining in the first object message
Penetrate information.
6th data processing unit 470, will be with the unmatched first object message of the map information for passing through
In the querying conditions of all indexs be filtered, generate the second object message.
Message structural unit 480, for constructing empty returned packet, the returned packet includes all indexs filtered out
Corresponding result information.
Result queries unit 490, for obtaining query result based on querying condition entrained by second object message.
As an implementation, result queries unit 490 is used for according to index each in second object message institute
The corresponding querying condition distinguishes constructs database inquiry instruction；It obtains and is looked into corresponding to each data base querying instruction
Ask result.
Data return unit 491, for the query result to be inserted the returned packet.
In conclusion a kind of data processing method provided by the invention and device, by first obtaining query message；Judge again
Whether the query message meets the first preset rules；When the query message meets the first preset rules, then judge described
Whether the preset field in query message meets default verification condition；When preset field meets default verification condition, then pass through
All indexs that second preset rules are included to the query message carry out data cleansing, generate first object message；Then
Judge whether the sum for the index that the first object message is included is greater than preset value；When sum is not more than preset value, connect
Obtain map information corresponding to each index in the first object message again；Then passing through again will be with the map information
The querying condition of all indexs in the unmatched first object message is filtered, and generates the second object message；Then
Reconstruct empty returned packet, the returned packet includes result information corresponding to all indexs for filtering out；Then base again
The querying condition entrained by second object message obtains query result；The query result is finally inserted into the return
Message, thus while realizing the real-time query of mass data, improve data query efficiency and query result it is accurate
Property.
In several embodiments provided herein, it should be understood that disclosed device and method can also pass through
Other modes are realized.The apparatus embodiments described above are merely exemplary, for example, flow chart and block diagram in attached drawing
Show the device of multiple embodiments according to the present invention, the architectural framework in the cards of method and computer program product,
Function and operation.In this regard, each box in flowchart or block diagram can represent the one of a module, section or code
Part, a part of the module, section or code, which includes that one or more is for implementing the specified logical function, to be held
Row instruction.It should also be noted that function marked in the box can also be to be different from some implementations as replacement
The sequence marked in attached drawing occurs.For example, two continuous boxes can actually be basically executed in parallel, they are sometimes
It can execute in the opposite order, this depends on the function involved.It is also noted that every in block diagram and or flow chart
The combination of box in a box and block diagram and or flow chart can use the dedicated base for executing defined function or movement
It realizes, or can realize using a combination of dedicated hardware and computer instructions in the system of hardware.
In addition, each functional module in each embodiment of the present invention can integrate one independent portion of formation together
Point, it is also possible to modules individualism, an independent part can also be integrated to form with two or more modules.
It, can be with if the function is realized and when sold or used as an independent product in the form of software function module
It is stored in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially in other words
The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a
People's computer, server or network equipment etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention.
And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), arbitrary access
The various media that can store program code such as memory (RAM, Random Access Memory), magnetic or disk.It needs
It is noted that herein, relational terms such as first and second and the like are used merely to an entity or operation
It is distinguished with another entity or operation, without necessarily requiring or implying between these entities or operation, there are any this
Actual relationship or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to nonexcludability
It include so that the process, method, article or equipment for including a series of elements not only includes those elements, but also to wrap
Include other elements that are not explicitly listed, or further include for this process, method, article or equipment intrinsic want
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including described want
There is also other identical elements in the process, method, article or equipment of element.
The foregoing is only a preferred embodiment of the present invention, is not intended to restrict the invention, for the skill of this field
For art personnel, the invention may be variously modified and varied.All within the spirits and principles of the present invention, made any to repair
Change, equivalent replacement, improvement etc., should all be included in the protection scope of the present invention.It should also be noted that similar label and letter exist
Similar terms are indicated in following attached drawing, therefore, once being defined in a certain Xiang Yi attached drawing, are then not required in subsequent attached drawing
It is further defined and explained.
Claims (10)
1. a kind of data processing method characterized by comprising
Obtain query message；
Judge whether the query message meets the first preset rules；
If so, judging whether the preset field in the query message meets default verification condition；
If so, carrying out data cleansing by all indexs that the second preset rules are included to the query message, first is generated
Object message；
Judge whether the sum for the index that the first object message is included is greater than preset value；
If it is not, obtaining map information corresponding to each index in the first object message；
By will be carried out with the querying condition of all indexs in the unmatched first object message of the map information
Filter generates the second object message；
Construct empty returned packet, the returned packet includes result information corresponding to all indexs for filtering out；
Query result is obtained based on querying condition entrained by second object message；
The query result is inserted into the returned packet.
2. the method according to claim 1, wherein described judges whether the query message meets first in advance
If regular, comprising:
Judge whether the message field (MFLD) of the query message meets the first preset rules.
3. the method according to claim 1, wherein described passes through the second preset rules to the query message
All indexs for being included carry out data cleansing, generate first object message, including；
Obtaining the query message each of is included identification information corresponding to the index；
By being that empty index is filtered by the identification information, first object message is generated.
4. the method according to claim 1, wherein the map information includes reflecting address mapping information and time
Penetrate information, it is described by by the inquiry item with all indexs in the unmatched first object message of the map information
Part is filtered, and generates the second object message, comprising:
The inquiry of the index in the first object message is judged based on the address mapping information and the time map information
Whether time and inquiry address are empty；
If so, the query time is filtered with the inquiry address for index corresponding to sky, the second target report is generated
Text.
5. the method according to claim 1, wherein described based on being looked into entrained by second object message
Inquiry condition obtains query result, comprising:
The querying condition according to corresponding to each index in second object message distinguishes constructs database inquiry instruction；
Obtain the corresponding query result of each data base querying instruction.
6. the method according to claim 1, wherein the preset field in the query message that judges is
After the no default verification condition of satisfaction, further includes:
Data corresponding to the preset field are stored into caching.
7. a kind of data processing equipment characterized by comprising
Data capture unit, for obtaining query message；
First data processing unit, for judging whether the query message meets the first preset rules；
Second data processing unit, for if so, judging whether the preset field in the query message meets default verification item
Part；
Third data processing unit, for if so, all indexs for being included to the query message by the second preset rules
Data cleansing is carried out, first object message is generated；
4th data processing unit, for judging it is default whether the sum of index that the first object message is included is greater than
Value；
5th data processing unit, for if it is not, obtaining map information corresponding to each index in the first object message；
6th data processing unit, for by by with it is all in the unmatched first object message of the map information
The querying condition of index is filtered, and generates the second object message；
Message structural unit, for constructing empty returned packet, the returned packet includes corresponding to all indexs for filtering out
Result information；
Result queries unit, for obtaining query result based on querying condition entrained by second object message；
Data return unit, for the query result to be inserted the returned packet.
8. device according to claim 7, which is characterized in that first data processing unit is specifically used for:
Judge whether the message field (MFLD) of the query message meets the first preset rules.
9. device according to claim 7, which is characterized in that the third data processing unit is specifically used for:
Obtaining the query message each of is included identification information corresponding to the index；
By being that empty index is filtered by the identification information, first object message is generated.
10. device according to claim 7, which is characterized in that after second data processing unit, further includes:
Data storage cell, for storing data corresponding to the preset field into caching.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810685887.0A CN108959514B (en) | 2018-06-27 | 2018-06-27 | Data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810685887.0A CN108959514B (en) | 2018-06-27 | 2018-06-27 | Data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108959514A true CN108959514A (en) | 2018-12-07 |
| CN108959514B CN108959514B (en) | 2021-02-26 |
Family
ID=64487448
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810685887.0A Active CN108959514B (en) | 2018-06-27 | 2018-06-27 | Data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108959514B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110619083A (en) * | 2019-08-19 | 2019-12-27 | 深圳市鹏海运电子数据交换有限公司 | Data filtering method and device |
| CN111881356A (en) * | 2020-07-30 | 2020-11-03 | 北京奇艺世纪科技有限公司 | Content recommendation method, device, electronic device and storage medium |
| CN113434564A (en) * | 2020-03-23 | 2021-09-24 | 北京国双科技有限公司 | Mysql metadata access method, device, equipment and medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101639855A (en) * | 2009-09-02 | 2010-02-03 | 华为技术有限公司 | Report inquiry method and device thereof |
| US20100306214A1 (en) * | 2009-05-28 | 2010-12-02 | Microsoft Corporation | Identifying modifiers in web queries over structured data |
| CN102098221A (en) * | 2011-01-28 | 2011-06-15 | 华为技术有限公司 | Message query method and device |
| CN101414914B (en) * | 2008-11-26 | 2012-01-25 | 北京星网锐捷网络技术有限公司 | Method and apparatus for filtrating data content, finite state automata and conformation apparatus |
| US9280597B2 (en) * | 2009-12-01 | 2016-03-08 | Apple Inc. | System and method for customizing search results from user's perspective |
| CN106469175A (en) * | 2015-08-20 | 2017-03-01 | 互联网域名系统北京市工程研究中心有限公司 | Data processing method and device |
| CN106713061A (en) * | 2015-11-17 | 2017-05-24 | 阿里巴巴集团控股有限公司 | Method, system and device for monitoring attack message |
-
2018
- 2018-06-27 CN CN201810685887.0A patent/CN108959514B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101414914B (en) * | 2008-11-26 | 2012-01-25 | 北京星网锐捷网络技术有限公司 | Method and apparatus for filtrating data content, finite state automata and conformation apparatus |
| US20100306214A1 (en) * | 2009-05-28 | 2010-12-02 | Microsoft Corporation | Identifying modifiers in web queries over structured data |
| CN101639855A (en) * | 2009-09-02 | 2010-02-03 | 华为技术有限公司 | Report inquiry method and device thereof |
| US9280597B2 (en) * | 2009-12-01 | 2016-03-08 | Apple Inc. | System and method for customizing search results from user's perspective |
| CN102098221A (en) * | 2011-01-28 | 2011-06-15 | 华为技术有限公司 | Message query method and device |
| CN106469175A (en) * | 2015-08-20 | 2017-03-01 | 互联网域名系统北京市工程研究中心有限公司 | Data processing method and device |
| CN106713061A (en) * | 2015-11-17 | 2017-05-24 | 阿里巴巴集团控股有限公司 | Method, system and device for monitoring attack message |
Non-Patent Citations (5)
| Title |
|---|
| CHU HUANG ET AL: "Towards Trusted Services: Result Verification Schemes for MapReduce", 《2012 12TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID 2012)》 * |
| GUORONG XIAO: "Research on Data Processing of Bank Credit System", 《2012 INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS AND NETWORK TECHNOLOGIES》 * |
| 史英杰 等: "云数据管理系统中查询技术研究综述", 《计算机学报》 * |
| 肖培根: "基于Spark平台的电压指标管理系统的设计与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 陈娜: "基于指标数据关联性的报表生成系统设计及实现", 《信息技术应用》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110619083A (en) * | 2019-08-19 | 2019-12-27 | 深圳市鹏海运电子数据交换有限公司 | Data filtering method and device |
| CN110619083B (en) * | 2019-08-19 | 2022-04-19 | 深圳市鹏海运电子数据交换有限公司 | Data filtering method and device |
| CN113434564A (en) * | 2020-03-23 | 2021-09-24 | 北京国双科技有限公司 | Mysql metadata access method, device, equipment and medium |
| CN111881356A (en) * | 2020-07-30 | 2020-11-03 | 北京奇艺世纪科技有限公司 | Content recommendation method, device, electronic device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108959514B (en) | 2021-02-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112000747B (en) | Data multidimensional analysis method, device and system | |
| CN102236851B (en) | The method and system that the multidimensional credit system composing power based on user calculates in real time | |
| CN102467726A (en) | Data processing method and device based on online trading platform | |
| WO2016041373A1 (en) | Data query method and device | |
| US20180329963A1 (en) | Embedded Analytics and Transactional Data Processing | |
| US10579589B2 (en) | Data filtering | |
| CN106933906B (en) | Data multi-dimensional query method and device | |
| CN111046237A (en) | User behavior data processing method and device, electronic equipment and readable medium | |
| CN108959514A (en) | A kind of data processing method and device | |
| CN112288402A (en) | Data processing method, apparatus, equipment, and storage medium | |
| CN111754340B (en) | Guarantee network risk investigation system based on graph database | |
| CN109447689A (en) | Consumer's risk portrait generation method, device, equipment and readable storage medium storing program for executing | |
| CN115617794A (en) | Data analysis method, data analysis apparatus, and computer-readable storage medium | |
| CN113139835B (en) | Data processing method, device, nonvolatile storage medium and processor | |
| Suresh et al. | Extracting of patterns using mining methods over damped window | |
| CN108537654B (en) | Rendering method and device of customer relationship network graph, terminal equipment and medium | |
| CN109857501B (en) | APP page display method and device, storage medium and server | |
| KR101888010B1 (en) | System and method for providing of statistical trends service of real-estate | |
| CN119109679A (en) | Threat path tracing method, device, equipment and medium | |
| CN114116799B (en) | Method, device, terminal and storage medium for identifying abnormal transaction loop | |
| CN109360032A (en) | Client's appraisal procedure, device, equipment and storage medium | |
| CN114257528B (en) | Method, device, electronic device and storage medium for selecting Internet of Things devices | |
| CN109670853A (en) | Determination method, apparatus, equipment and the readable storage medium storing program for executing of user characteristic data | |
| CN104636433B (en) | Power information system data management system and method based on unified dimensional modeling | |
| CN118735639A (en) | Grid-based extended information generation method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |