[go: up one dir, main page]

CN109271390B - A neural network-based index data structure and its data retrieval method - Google Patents

A neural network-based index data structure and its data retrieval method Download PDF

Info

Publication number
CN109271390B
CN109271390B CN201811152887.0A CN201811152887A CN109271390B CN 109271390 B CN109271390 B CN 109271390B CN 201811152887 A CN201811152887 A CN 201811152887A CN 109271390 B CN109271390 B CN 109271390B
Authority
CN
China
Prior art keywords
data
index
neural network
data structure
bitmap
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811152887.0A
Other languages
Chinese (zh)
Other versions
CN109271390A (en
Inventor
闫柳
李卓
刘开华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianjin University
Original Assignee
Tianjin University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianjin University filed Critical Tianjin University
Priority to CN201811152887.0A priority Critical patent/CN109271390B/en
Publication of CN109271390A publication Critical patent/CN109271390A/en
Application granted granted Critical
Publication of CN109271390B publication Critical patent/CN109271390B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/084Backpropagation, e.g. using gradient descent

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本发明公开了一种基于神经网络的索引数据结构,包括数据映射单元和动态索引单元;数据映射单元是基于神经网络模型的数据映射单元,采集命名数据网络中的名称数据作为样本,计算其累积分布函数值作为标签,训练得到神经网络模型,用于把名称数据映射到改进型位图bitmap数据结构中的相应位置;动态索引单元是基于改进型位图bitmap数据结构的动态索引单元,将传统位图平均分成若干桶,并将桶内每个槽的大小扩展,得到可动态标号的改进型位图bitmap数据结构,用于存储名称数据所对应的地址偏移量。本发明针对命名数据网转发平面特点,可以在保证检索速度和误判概率的条件下,提升存储效率,实现快速数据插入及检索操作。

Figure 201811152887

The invention discloses an index data structure based on a neural network, including a data mapping unit and a dynamic indexing unit; the data mapping unit is a data mapping unit based on a neural network model, collects name data in a named data network as a sample, and calculates the cumulative The distribution function value is used as a label, and the neural network model is obtained by training, which is used to map the name data to the corresponding position in the improved bitmap data structure; the dynamic index unit is a dynamic index unit based on the improved bitmap data structure. The bitmap is evenly divided into several buckets, and the size of each slot in the bucket is expanded to obtain an improved bitmap data structure that can be dynamically labeled, which is used to store the address offset corresponding to the name data. Aiming at the characteristics of the forwarding plane of the named data network, the invention can improve the storage efficiency and realize the fast data insertion and retrieval operations under the condition of ensuring the retrieval speed and the probability of misjudgment.

Figure 201811152887

Description

Index data structure based on neural network and data retrieval method thereof
Technical Field
The invention belongs to the field of high-performance router index Data structure design, and particularly aims at the problems of efficient storage and quick retrieval of index contents in a Named Data Networking (Named Data Networking) forwarding plane.
Background
The continuous emergence of innovative applications, technologies and computing modes such as ultra-high definition videos, artificial intelligence and cloud computing accelerates the role transition of the internet from a communication channel to a data processing platform. The defects of the existing IP internet system structure based on the equipment address in the aspects of information sharing, mobility, safety, expandability and the like become a great difficult problem for hindering the development of the internet. Therefore, a new future internet architecture, named data network, was proposed in 2010 and has gained wide attention from both national and foreign academic circles.
Named data networks use a fully data content oriented communication mode with data names instead of IP addresses. The method has the advantages that the buffer memory is arranged in the routing node, so that the data content sharing in the real sense is realized, the network load is greatly reduced, and the network data transmission rate is effectively improved. It is therefore considered one of the most promising developments in the field of future internet architectures.
However, named data networks also face a series of challenges to be solved, especially for efficient storage and fast retrieval of indexed content in the forwarding plane. The index data structure is the key for improving the performance of the forwarding plane, but the current main research results have advantages and disadvantages. For example, data structure lookup based on a dictionary tree is slow; data structures based on bloom filters cannot directly index data; whereas hash table based data structures require a very large memory space. Therefore, the current research results cannot meet the requirements of the named data network forwarding plane on the retrieval speed and the storage space at the same time, and a new research idea needs to be provided urgently to design an index data structure with excellent comprehensive performance and a data retrieval algorithm thereof so as to solve the problem.
Disclosure of Invention
In order to solve the problems, the invention provides an index data structure based on a neural network and a data retrieval method thereof. Aiming at the characteristics of a forwarding plane of a named data network, the invention can improve the storage efficiency and realize rapid data insertion and retrieval operation under the condition of ensuring the retrieval speed and the misjudgment probability.
In order to solve the technical problem, the invention provides an index data structure based on a neural network, which comprises a data mapping unit and a dynamic index unit; the data mapping unit is a data mapping unit based on a neural network model, name data in a named data network are collected as samples, cumulative distribution function values of the name data are calculated to serve as labels, a back propagation neural network is trained according to the samples and the labels, and the neural network model is obtained and used for mapping the name data to be retrieved to corresponding positions in an improved bitmap data structure; the dynamic index unit is based on the dynamic index unit of the improved bitmap data structure, the traditional bitmap data structure is averagely divided into a plurality of barrels, the size of each groove in each barrel is expanded, and the improved bitmap data structure with dynamic labels is obtained and is marked as D-bitmap and used for storing the address offset corresponding to the name data to be retrieved.
The invention also provides a data retrieval method of the index data structure based on the neural network, which mainly comprises the steps of inserting data into the index data structure and carrying out data retrieval on the index data structure after the data is inserted; the method comprises the following specific steps:
step one, inserting name data in the index data structure, wherein each time one name data is inserted, the method comprises the following steps:
step 1-1: inputting name data: inputting name data to be inserted into the index data structure;
step 1-2: calculating the neural network of the data mapping unit: inputting the name data after fixed length processing into the neural network model for operation to obtain a real numerical value ranging from 0 to 1;
step 1-3: position mapping calculation of the data mapping unit: multiplying the calculation result of the neural network by the total number of the grooves of the D-bitmap to obtain the position of the name data mapped on the D-bitmap, namely the groove sequence number of the D-bitmap;
step 1-4: and calculating the bucket sequence number of the dynamic index unit: dividing the number of the grooves of each barrel by the number of the grooves of each barrel, and rounding downwards to obtain the barrel number of the position;
step 1-5: maximum index lookup of dynamic index units: traversing all the grooves in the barrel according to the barrel serial numbers obtained in the step 1-4, and searching the existing maximum label;
step 1-6: in-slot index entry for dynamic index unit: judging whether the existing maximum label found in the steps 1-5 reaches the maximum value, if not, recording the label of the existing maximum label plus one in the position groove, otherwise, taking the earliest deleted label from the deletion queue as the label in the position groove;
step 1-7: applying for a storage unit for the named data: applying a storage unit for the name data in a data storage space according to the base address corresponding to the barrel serial number in the dynamic index unit and the address offset represented by the in-slot label;
step 1-8: the name data insertion operation is finished;
step two, retrieving one name data in an index data structure, comprising the following steps:
step 2-1: inputting name data: inputting name data to be inserted into the index data structure;
step 2-2: calculating the neural network of the data mapping unit: inputting the name data after fixed length processing into the neural network model for operation to obtain a real numerical value ranging from 0 to 1;
step 2-3: position mapping calculation of the data mapping unit: multiplying the calculation result of the neural network by the total number of the grooves of the D-bitmap to obtain the position of the name data mapped on the D-bitmap, namely the groove sequence number of the D-bitmap;
step 2-4: judging the existence of data of the dynamic index unit: judging whether the label at the position is 0 or not, if not, the name data exists in the index data structure, and continuing to execute the step 2-5 to finish the retrieval; otherwise, the name data does not exist in the index data structure, namely, the name data indicates that no retrieval result exists, and the step 2-7 is executed;
step 2-5: and calculating the bucket sequence number of the dynamic index unit: dividing the number of the grooves of each barrel by the number of the grooves of each barrel, and rounding downwards to obtain the barrel number of the position;
step 2-6: and outputting a retrieval result: outputting the barrel serial number and the in-slot label of the position, namely the base address of the data storage unit and the address offset of the name data relative to the base address in the data storage space;
step 2-7: the name data retrieval operation ends.
Compared with the prior art, the invention has the beneficial effects that:
the indexing data structure based on the neural network and the data retrieval method thereof are deployed and realized on a computer configured as Intel Xeon E5-1650 v23.50GHz and DDR 324 GB SDRAM. The name data for training can be collected through a forwarding plane of a named data network in an actual environment, and in a laboratory environment, one hundred million pieces of name data with similar formats are constructed by using common English words and top-level domain names, and a neural network model capable of realizing uniform mapping is obtained through training. In the performance test, considering that the data volume processed by a named data network forwarding plane is in the million level, one million pieces of name data with the same distribution rule are used for testing the performance of the index data structure and the data retrieval method thereof. Experimental results show that the storage consumption of the method is far less than that of the Hash index, the retrieval speed is equivalent to that of the Hash index, and the communication requirement that the misjudgment rate of the current Internet is lower than 1% can be met. Therefore, the index data structure based on the neural network and the data retrieval method thereof, which are designed by the invention, can improve the storage efficiency under the condition of ensuring the retrieval speed and the misjudgment probability, and have good performance.
Drawings
FIG. 1 is a schematic diagram of an indexing data structure based on a neural network according to the present invention;
FIG. 2 is a diagram illustrating the specific steps of the data mapping unit in the neural network-based index data structure according to the present invention;
FIG. 3 is a block diagram of a data insertion operation in the data retrieval method of the present invention;
FIG. 4 is a block diagram of a data retrieval method according to the present invention.
Detailed Description
The technical solutions of the present invention are further described in detail with reference to the accompanying drawings and specific embodiments, which are only illustrative of the present invention and are not intended to limit the present invention.
As shown in fig. 1, the present invention provides an index data structure based on a neural network, which includes a data mapping unit and a dynamic index unit; the concrete description is as follows:
the data mapping unit is a data mapping unit based on a Neural Network model, name data in a named data Network are collected as samples, cumulative distribution function values of the name data are calculated as labels, a Back Propagation Neural Network (BPNN) is trained according to the samples and the labels, and the Neural Network model is obtained and used for mapping the name data to be retrieved to corresponding positions in an improved bitmap data structure. The collection of the name data in the named data network is realized in a forwarding plane in the actual deployment of the named data network, and a sufficient amount of sample data is obtained by recording all the name data processed by the forwarding plane within a certain time. The reason why the cumulative distribution function value thereof is calculated as a label is that the distribution of values of data subjected to the transformation of the cumulative distribution function, which is subjected to arbitrary distribution, is subjected to uniform distribution between 0 and 1. Therefore, the collected name data is used as a sample, and the cumulative distribution function value is calculated to be used as a label, so that the uniform mapping of the data can be realized, and the utilization efficiency of the storage unit is optimized.
The specific steps of the data mapping unit are shown in fig. 2. In the training stage, the name data serving as a sample and the cumulative distribution function value serving as a label jointly form a training data set, the training data set is used for training the back propagation neural network BPNN, the cumulative distribution function of the training data set is fitted, the relevant parameters such as the weight and the offset of the hidden layer and the output layer are obtained, and a neural network model capable of achieving uniform mapping is formed. And in the actual prediction stage after training, inputting a name data, and multiplying the value obtained by the operation of the neural network model by the mapping size to obtain the mapping position of the name data.
The dynamic index unit is based on the dynamic index unit of the improved bitmap data structure, the traditional bitmap data structure is averagely divided into a plurality of barrels, the size of each groove in each barrel is expanded, and the improved bitmap data structure with dynamic labels is obtained and is marked as D-bitmap and used for storing the address offset corresponding to the name data to be retrieved. The specific method for improving the traditional bitmap data structure is that the bitmap with the size of m slots is averagely divided into n buckets, each bucket contains m/n slots and corresponds to a data storage space with a fixed base address. The size of each slot is expanded from the original 1 bit to j bits for recording the address offset. The improved D-bitmap dynamically marks the labels in the data insertion process, and the label in each slot represents the sequence of the name data entering the bucket, namely the address offset of the name data in the storage space. And applying for a storage unit for the name data according to the base address corresponding to the bucket and the address offset represented by the mark in the slot, thereby realizing the dynamic address allocation of the data storage unit.
The data retrieval method aiming at the index data structure based on the neural network comprises the steps of inserting data into the index data structure and carrying out data retrieval on the index data structure after the data is inserted; the method comprises the following specific steps:
step one, inserting name data in the index data structure, and as shown in fig. 3, each time inserting a name data, including the following steps:
step 1-1: inputting name data: inputting name data to be inserted into the index data structure;
step 1-2: calculating the neural network of the data mapping unit: inputting the name data after fixed length processing into the neural network model for operation to obtain a real numerical value ranging from 0 to 1;
step 1-3: position mapping calculation of the data mapping unit: multiplying the calculation result of the neural network by the total number of the grooves of the D-bitmap to obtain the position of the name data mapped on the D-bitmap, namely the groove sequence number of the D-bitmap;
step 1-4: and calculating the bucket sequence number of the dynamic index unit: dividing the number of the grooves of each barrel by the number of the grooves of each barrel, and rounding downwards to obtain the barrel number of the position;
step 1-5: maximum index lookup of dynamic index units: traversing all the grooves in the barrel according to the barrel serial numbers obtained in the step 1-4, and searching the existing maximum label;
step 1-6: in-slot index entry for dynamic index unit: judging whether the existing maximum label found in the steps 1-5 reaches the maximum value, if not, recording the label of the existing maximum label plus one in the position groove, otherwise, taking the earliest deleted label from the deletion queue as the label in the position groove;
step 1-7: applying for a storage unit for the named data: applying a storage unit for the name data in a data storage space according to the base address corresponding to the barrel serial number in the dynamic index unit and the address offset represented by the in-slot label;
step 1-8: the name data insertion operation is finished;
in the present invention, an example of name data insertion into an index data structure is shown in fig. 1. In the index data structure, a data mapping unit is a trained neural network model, and a dynamic index unit is an improved bitmap data structure D-bitmap. The number of the slots is set to be 32, and each 16 slots are divided into one bucket, so that the D-bitmap is divided into 2 buckets in total, and the D-bitmap corresponds to 2 data storage spaces with fixed base addresses. Currently the index data structure has two name data inserted. And when the third name data/ndn/name/3 rd is inserted, performing neural network calculation and position mapping calculation in the data mapping unit to obtain the mapping position of the name data in the D-bitmap as the 6 th slot. And entering a dynamic index unit, and calculating the barrel serial number of the position to be 1. The current maximum label in the 1 st bucket is searched, the search result is 1, and the maximum value is not reached yet, so that the label of the current maximum label plus one is marked in the 6 th slot and is 2, that is, the address offset of the name data in the data storage unit relative to the 1 st base address.
Step two, retrieving a name data in the index data structure, as shown in fig. 4, including the following steps:
step 2-1: inputting name data: inputting name data to be inserted into the index data structure;
step 2-2: calculating the neural network of the data mapping unit: inputting the name data after fixed length processing into the neural network model for operation to obtain a real numerical value ranging from 0 to 1;
step 2-3: position mapping calculation of the data mapping unit: multiplying the calculation result of the neural network by the total number of the grooves of the D-bitmap to obtain the position of the name data mapped on the D-bitmap, namely the groove sequence number of the D-bitmap;
step 2-4: judging the existence of data of the dynamic index unit: judging whether the label at the position is 0 or not, if not, the name data exists in the index data structure, and continuing to execute the step 2-5 to finish the retrieval; otherwise, the name data does not exist in the index data structure, namely, the name data indicates that no retrieval result exists, and the step 2-7 is executed;
step 2-5: and calculating the bucket sequence number of the dynamic index unit: dividing the number of the grooves of each barrel by the number of the grooves of each barrel, and rounding downwards to obtain the barrel number of the position;
step 2-6: and outputting a retrieval result: outputting the barrel serial number and the in-slot label of the position, namely the base address of the data storage unit and the address offset of the name data relative to the base address in the data storage space;
step 2-7: the name data retrieval operation ends.
Example (b): the indexing data structure based on the neural network and the data retrieval method thereof are deployed and realized on a computer configured as Intel Xeon E5-1650 v23.50GHz and DDR 324 GB SDRAM. The name data for training can be collected through a forwarding plane of a named data network in an actual environment, and in a laboratory environment, one hundred million pieces of name data with similar formats are constructed by using common English words and top-level domain names, and a neural network model capable of realizing uniform mapping is obtained through training. In the performance test, considering that the data volume processed by a named data network forwarding plane is in the million level, one million pieces of name data with the same distribution rule are used for testing the performance of the index data structure and the data retrieval method thereof. Experimental results show that the storage consumption of the method is far less than that of the Hash index, the retrieval speed is equivalent to that of the Hash index, and the communication requirement that the misjudgment rate of the current Internet is lower than 1% can be met. Therefore, the index data structure based on the neural network and the data retrieval method thereof, which are designed by the invention, can improve the storage efficiency under the condition of ensuring the retrieval speed and the misjudgment probability, and have good performance.
While the present invention has been described with reference to the accompanying drawings, the present invention is not limited to the above-described embodiments, which are illustrative only and not restrictive, and various modifications which do not depart from the spirit of the present invention and which are intended to be covered by the claims of the present invention may be made by those skilled in the art.

Claims (1)

1. A data retrieval method based on the index data structure of the neural network, the index data structure adopted includes data mapping unit and dynamic index unit; the data mapping unit is a data mapping unit based on a neural network model, name data in a named data network are collected as samples, cumulative distribution function values of the name data are calculated to serve as labels, a back propagation neural network is trained according to the samples and the labels, and the neural network model is obtained and used for mapping the name data to be retrieved to corresponding positions in an improved bitmap data structure; the dynamic index unit is based on the dynamic index unit of the improved bitmap data structure, averagely divides the traditional bitmap data structure into a plurality of barrels, expands the size of each groove in each barrel to obtain the improved bitmap data structure with dynamic labels, and records the improved bitmap data structure as D-bitmap for storing the address offset corresponding to the name data to be retrieved;
the data retrieval method is characterized by comprising the steps of inserting data into an index data structure, and retrieving the data of the index data structure after the data are inserted; the method comprises the following specific steps:
step one, inserting name data in the index data structure, wherein each time one name data is inserted, the method comprises the following steps:
step 1-1: inputting name data: inputting name data to be inserted into the index data structure;
step 1-2: calculating the neural network of the data mapping unit: inputting the name data after fixed length processing into the neural network model for operation to obtain a real numerical value ranging from 0 to 1;
step 1-3: position mapping calculation of the data mapping unit: multiplying the calculation result of the neural network by the total number of the grooves of the D-bitmap to obtain the position of the name data mapped on the D-bitmap, namely the groove sequence number of the D-bitmap;
step 1-4: and calculating the bucket sequence number of the dynamic index unit: dividing the number of the grooves of each barrel by the number of the grooves of each barrel, and rounding downwards to obtain the barrel number of the position;
step 1-5: maximum index lookup of dynamic index units: traversing all the grooves in the barrel according to the barrel serial numbers obtained in the step 1-4, and searching the existing maximum label;
step 1-6: in-slot index entry for dynamic index unit: judging whether the existing maximum label found in the steps 1-5 reaches the maximum value, if not, recording the label of the existing maximum label plus one in the position groove, otherwise, taking the earliest deleted label from the deletion queue as the label in the position groove;
step 1-7: applying for a storage unit for the named data: applying a storage unit for the name data in a data storage space according to the base address corresponding to the barrel serial number in the dynamic index unit and the address offset represented by the in-slot label;
step 1-8: the name data insertion operation is finished;
step two, retrieving one name data in an index data structure, comprising the following steps:
step 2-1: inputting name data: inputting name data to be inserted into the index data structure;
step 2-2: calculating the neural network of the data mapping unit: inputting the name data after fixed length processing into the neural network model for operation to obtain a real numerical value ranging from 0 to 1;
step 2-3: position mapping calculation of the data mapping unit: multiplying the calculation result of the neural network by the total number of the grooves of the D-bitmap to obtain the position of the name data mapped on the D-bitmap, namely the groove sequence number of the D-bitmap;
step 2-4: judging the existence of data of the dynamic index unit: judging whether the label at the position is 0 or not, if not, the name data exists in the index data structure, and continuing to execute the step 2-5 to finish the retrieval; otherwise, the name data does not exist in the index data structure, namely, the name data indicates that no retrieval result exists, and the step 2-7 is executed;
step 2-5: and calculating the bucket sequence number of the dynamic index unit: dividing the number of the grooves of each barrel by the number of the grooves of each barrel, and rounding downwards to obtain the barrel number of the position;
step 2-6: and outputting a retrieval result: outputting the barrel serial number and the in-slot label of the position, namely the base address of the data storage unit and the address offset of the name data relative to the base address in the data storage space;
step 2-7: the name data retrieval operation ends.
CN201811152887.0A 2018-09-30 2018-09-30 A neural network-based index data structure and its data retrieval method Active CN109271390B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811152887.0A CN109271390B (en) 2018-09-30 2018-09-30 A neural network-based index data structure and its data retrieval method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811152887.0A CN109271390B (en) 2018-09-30 2018-09-30 A neural network-based index data structure and its data retrieval method

Publications (2)

Publication Number Publication Date
CN109271390A CN109271390A (en) 2019-01-25
CN109271390B true CN109271390B (en) 2022-03-01

Family

ID=65196197

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811152887.0A Active CN109271390B (en) 2018-09-30 2018-09-30 A neural network-based index data structure and its data retrieval method

Country Status (1)

Country Link
CN (1) CN109271390B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110138661A (en) * 2019-04-02 2019-08-16 天津大学 Name data network content storage pool neural network based
CN110196938B (en) * 2019-04-02 2022-03-01 天津大学 A Neural Network-Based Method for Data Insertion in Content Storage Pool of Named Data Network
CN110109616B (en) * 2019-04-02 2022-03-01 天津大学 Named data network content storage pool data deletion method based on neural network
CN110096458B (en) * 2019-04-02 2022-03-01 天津大学 Named data network content storage pool data retrieval method based on neural network
CN110474844B (en) * 2019-06-28 2021-06-08 天津大学 Training method and chip for learning index data structure of high-performance intelligent router
CN110851658B (en) * 2019-10-12 2023-05-05 天津大学 Tree index data structure, content storage pool, router and tree index method
CN113220683A (en) * 2021-05-08 2021-08-06 天津大学 Content router PIT structure supporting flooding attack detection and data retrieval method thereof

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8296398B2 (en) * 2008-04-29 2012-10-23 Overland Storage, Inc. Peer-to-peer redundant file server system and methods
CN104536958B (en) * 2014-09-26 2018-03-16 杭州华为数字技术有限公司 A kind of composite index method and device
US10095720B2 (en) * 2016-02-05 2018-10-09 Amadeus S.A.S. Database table index
CN105975587B (en) * 2016-05-05 2019-05-10 诸葛晴凤 A kind of high performance memory database index organization and access method
CN107832343B (en) * 2017-10-13 2020-02-21 天津大学 A method for fast data retrieval based on bitmap-based MBF data index structure

Also Published As

Publication number Publication date
CN109271390A (en) 2019-01-25

Similar Documents

Publication Publication Date Title
CN109271390B (en) A neural network-based index data structure and its data retrieval method
US9269411B2 (en) Organizing data in a hybrid memory for search operations
CN104199827B (en) High-dimensional indexing method for large-scale multimedia data based on locality-sensitive hashing
US9235651B2 (en) Data retrieval apparatus, data storage method and data retrieval method
US20120143877A1 (en) Method and Apparatus for High Performance, Updatable, and Deterministic Hash Table for Network Equipment
CN107357843B (en) Massive network data search method based on data flow structure
CN111382327A (en) Character string matching device and method
CN110460529A (en) Content router FIB storage structure and its data processing method
CN104618361A (en) Network stream data reordering method
CN104780101B (en) Content center network Forwarding plane fib table structure and its search method
CN116795788B (en) Deep learning data set storage and retrieval method and system
CN106599091A (en) Storage and indexing method of RDF graph structures stored based on key values
CN113254720A (en) Hash sorting construction method in storage based on novel memory
CN105912696A (en) DNS (Domain Name System) index creating method and query method based on logarithm merging
CN109086815B (en) Floating point discretization method in decision tree model based on FPGA
CN110096458B (en) Named data network content storage pool data retrieval method based on neural network
CN110138661A (en) Name data network content storage pool neural network based
CN108614879A (en) Small documents processing method and device
CN104301227B (en) High-speed low-power-consumption IP route table lookup method based on TCAM
CN110109616B (en) Named data network content storage pool data deletion method based on neural network
CN111541617B (en) A data flow table processing method and device for high-speed large-scale concurrent data flow
CN110851658A (en) Tree index data structure, content storage pool, router and tree index method
CN117097505A (en) Hash linked list-based flow processing rule maintenance method and device and electronic equipment
CN116170026A (en) Data compression and fuzzy search method suitable for field of data generation of Internet of things-like equipment
CN116628025A (en) An Efficient Graph Flow Measurement Method Based on Adjacency Matrix

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP02 Change in the address of a patent holder
CP02 Change in the address of a patent holder

Address after: 300452 Binhai Industrial Research Institute Campus of Tianjin University, No. 48 Jialingjiang Road, Binhai New Area, Tianjin

Patentee after: Tianjin University

Address before: 300072 Tianjin City, Nankai District Wei Jin Road No. 92

Patentee before: Tianjin University