CN115658716A - OLAP analysis database-oriented materialized view timing refreshing method, equipment and medium - Google Patents
OLAP analysis database-oriented materialized view timing refreshing method, equipment and medium Download PDFInfo
- Publication number
- CN115658716A CN115658716A CN202211671204.9A CN202211671204A CN115658716A CN 115658716 A CN115658716 A CN 115658716A CN 202211671204 A CN202211671204 A CN 202211671204A CN 115658716 A CN115658716 A CN 115658716A
- Authority
- CN
- China
- Prior art keywords
- refreshing
- materialized view
- refreshed
- refresh
- timing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 56
- 238000004458 analytical method Methods 0.000 title claims abstract description 28
- 238000012544 monitoring process Methods 0.000 claims abstract description 8
- 230000006870 function Effects 0.000 claims description 17
- 230000008569 process Effects 0.000 claims description 9
- 238000004364 calculation method Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000002776 aggregation Effects 0.000 description 2
- 238000004220 aggregation Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000011056 performance test Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application discloses a materialized view timing refreshing method, equipment and medium for an OLAP analysis database, which are used for solving the technical problem that the existing materialized view refreshing scheme is poor in timeliness. The method comprises the following steps: when the database is started, creating a refresh thread pool; detecting a materialized view to be refreshed corresponding to the database, and adding the materialized view to be refreshed into the refreshing thread pool; based on the timing refreshing field, monitoring the refreshing time corresponding to the materialized view to be refreshed through the refreshing thread pool; and when the current time reaches the refreshing time corresponding to the materialized view to be refreshed, calling a refreshing function through the refreshing thread pool to finish the timing refreshing of the materialized view to be refreshed.
Description
Technical Field
The application relates to the technical field of IT database research and development, in particular to a materialized view timing refreshing method, equipment and medium for an OLAP analysis database.
Background
In an OLAP scenario, various aggregation results or association results are frequently and repeatedly queried, and this operation is relatively large in consumption of memory and io when performing table association or aggregation operations, and secondly, obtaining query results is relatively slow.
In order to solve the above problem, a materialized view of the OLAP analysis database is generally refreshed. Although the OLAP analysis engine trino has the function of materialized view and can realize data updating, the OLAP analysis engine trino only supports manual trigger refreshing, calculation is started after manual trigger, the materialized view can be updated only after calculation is completed, and finally the data of the materialized view is consistent with the base table. Due to the fact that calculation is needed, the data updating speed of the method is low when the base table is operated, the method can not meet the service requirements of some service scenes with high real-time requirements completely, the effect of quasi real-time data refreshing can not be achieved, and the timeliness of the materialized view updating is poor.
Disclosure of Invention
The embodiment of the application provides a materialized view timing refreshing method, equipment and medium for an OLAP analysis database, and aims to solve the technical problem that an existing materialized view refreshing scheme is poor in timeliness.
In a first aspect, an embodiment of the present application provides a materialized view timing refresh method for an OLAP analysis database, where the method includes: when the database is started, creating a refresh thread pool; detecting a materialized view to be refreshed corresponding to the database, and adding the materialized view to be refreshed into the refreshing thread pool; based on a timing refreshing field, monitoring refreshing time corresponding to the materialized view to be refreshed through the refreshing thread pool; and when the current time reaches the refreshing time corresponding to the materialized view to be refreshed, calling a refreshing function through the refreshing thread pool to finish the timing refreshing of the materialized view to be refreshed.
In one or more embodiments of the present specification, after the creating a refresh thread pool, the method further comprises: adding the timed refresh field in a system, metadata, matched _ view _ properties system table corresponding to the database; wherein the timed refresh field at least comprises a timed refresh time interval refresh _ interval and a timed refresh start time refresh _ time.
In one or more embodiments of the present specification, after adding the refresh field, the method further comprises: and adding the timed refresh time interval refresh _ interval and the timed refresh start time refresh _ time as two refresh attributes to a storage table system.
In one or more embodiments of the present description, adding the to-be-refreshed materialized view to the refresh thread pool specifically includes: determining the number of the views to be refreshed; configuring the number of sub threads in the refreshing thread pool according to the number of the materialized views to be refreshed, so that the sub threads correspond to the materialized views to be refreshed one to one; and adding the to-be-refreshed materialized view into the corresponding sub thread in a polling manner.
In one or more embodiments of the present specification, before monitoring, by the refresh thread pool, a refresh time corresponding to the materialized view to be refreshed, the method further includes: acquiring the timing refresh starting time and the timing refresh time interval in a storage table corresponding to the materialized view to be refreshed; timing the current time through the timing refreshing time interval by taking the timing refreshing starting time as a reference so as to determine that the current time reaches the refreshing time corresponding to the materialized view to be refreshed; and after the materialized view to be refreshed is refreshed, updating the current time to the timing refreshing starting time.
In one or more embodiments of the present description, before calling a refresh function through the refresh thread pool, the method further comprises: determining that the materialized view to be refreshed is refreshed by manual triggering; and updating the trigger time corresponding to the manual trigger refreshing to the timing refreshing starting time.
In one or more embodiments of the present description, after completing the timed refresh of the to-be-refreshed materialized view, the method further comprises: querying the materialized view to be refreshed; and if the materialized view to be refreshed is refreshing, starting to inquire after the materialized view to be refreshed is refreshed.
In one or more embodiments of the present specification, after querying the to-be-refreshed materialized view, the method further comprises: determining that the materialized view to be refreshed is not in the refreshing process; refreshing the materialized view to be refreshed; and after the refreshing is finished, starting the query, and updating the time of finishing the refreshing of the materialized view to be refreshed to the timing refreshing starting time.
In a second aspect, an embodiment of the present application further provides an apparatus for refreshing materialized views of an OLAP analysis database at regular time, where the apparatus includes: a processor; and a memory having stored thereon executable instructions that, when executed, cause the processor to perform a method of OLAP analytics database-oriented materialized view timing refresh as described above.
In a third aspect, embodiments of the present application further provide a non-volatile computer storage medium having stored thereon computer-executable instructions configured to perform a materialized view timing refresh method for an OLAP analysis database as described above.
The materialized view timing refreshing method, equipment and medium for the OLAP analysis database have the following beneficial effects: by constructing sub-threads corresponding to the materialized view to be refreshed in the thread pool, monitoring the refreshing time corresponding to the materialized view to be refreshed based on the timing refreshing field written in the database system table, and calling the refreshing function to refresh the materialized view to be refreshed when the current time reaches the refreshing time, the timing refreshing of the materialized view is realized, the updating time efficiency of the materialized view is improved, meanwhile, the optimal balance between the granularity of the updating time of the materialized view and the consumption of computing resources is obtained, the flexibility is greatly expanded, a highly complex updating strategy can be supported, and a more complex service scene can be met. In addition, the timing refreshing field is stored in a storage table of the database, so that the timing refreshing of the materialized view in the database can be continuously performed after the service is restarted.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the present application, and other drawings can be obtained by those skilled in the art without creative efforts. In the drawings:
fig. 1 is a flowchart of a materialized view timing refresh method for an OLAP analysis database according to an embodiment of the present application;
FIG. 2 is a diagram of a materialized view query process in an application scenario according to an embodiment of the present application;
fig. 3 is a structural diagram of a materialized view timing refresh device oriented to an OLAP analysis database according to an embodiment of the present application.
Detailed Description
In order to make those skilled in the art better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without making any inventive step based on the embodiments of the present disclosure, shall fall within the scope of protection of the present application.
When a standard tpcds-10T data volume performance test is carried out, a large number of sub-queries appear in an SQL script, for the sub-queries which appear repeatedly, the characteristic that a materialized view has the advantage of being used for many times after calculation is utilized, the materialized view can be completely replaced by the materialized view, the occurrence of table returning can be reduced, and therefore the query performance is greatly improved; and as the business data is updated in real time, the materialized view of the OLAP analysis engine trino only supports manual refreshing, once updated, if new data comes in the base table, the materialized view cannot be updated along with the new data, and is updated only after manual triggering, so that the timeliness is not high, and in some occasions with higher timeliness requirements (such as requiring minute-level updating), a materialized view updating mode with higher timeliness needs to be provided.
The materialized view timing refreshing mode of configuring the refreshing time interval and the refreshing times in the application becomes an ideal solution to the above problems. In this way, a reasonable time interval can be set according to the granularity (timeliness) of data update on business, the timeliness requirement can be set to be update according to the level of minutes, the timeliness requirement is low, and the update can be set to be update according to hours or days, so that the balance between the update time of the materialized view and the consumption of computing resources can be achieved while the timeliness of the materialized view refresh is guaranteed.
The technical solutions proposed in the embodiments of the present application are described in detail below with reference to the accompanying drawings.
Fig. 1 is a flowchart of a materialized view timing refresh method for an OLAP analysis database according to an embodiment of the present application. As shown in fig. 1, the materialized view timing refresh method in the embodiment of the present application at least includes the following steps:
The materialized view timing refreshing method in the embodiment of the application is performed on an OLAP analysis database, so that the database in the embodiment of the application refers to the OLAP analysis database without special description. The refresh thread pool refers to a set including a plurality of sub-threads for refreshing the materialized view at regular time, the refresh thread pool has a number including the sub-threads, and the number is related to the number of the materialized view in the database, and the creation process of the refresh thread pool can be realized by the existing technology or method, which is not described herein in detail in the embodiment of the present application.
And 102, detecting the materialized view to be refreshed of the database, and adding the materialized view to be refreshed into a refreshing thread pool.
After the refresh thread pool is created, detecting the materialized views to be refreshed corresponding to the database, namely determining the materialized views which need to be refreshed in the database at the moment, and then adding the materialized views to be refreshed into the refresh thread pool.
In one or more possible implementation manners of the embodiment of the application, the number of sub-threads in the refresh thread pool may be configured by creating a configuration file when the refresh thread pool is created, and using the configuration file to configure the number of sub-threads in the refresh thread pool, specifically, the number of sub-threads in the refresh thread pool is configured to be the number of materialized views to be refreshed according to the detected number of materialized views to be refreshed by the configuration file, and then the materialized views to be refreshed are added to each sub-thread in a polling manner, so that the materialized views to be refreshed correspond to the sub-threads one to one.
And 103, monitoring the refreshing time corresponding to the materialized view to be refreshed through the refreshing thread pool based on the timed refreshing field.
In one or more possible implementation manners of the embodiment of the present application, to implement the timed refresh of the materialized view, it is required to specify a time corresponding to each refresh of the materialized view, where the time may be characterized by a timed refresh start time and a timed refresh time interval, and therefore, the timed refresh start time and the timed refresh time interval are recorded as a timed refresh field, and the timed refresh field is added to a system table of the database. Specifically, the timed refresh time interval is represented by a field refresh _ interval, the timed refresh start time is represented by a field refresh _ time, and the timed refresh start time is constructed as a timed refresh field by the two fields and added to the system table.
After the timed refresh field is determined, the refresh time of the to-be-refreshed materialized view can be monitored through the sub-thread in the refresh thread pool, wherein the refresh time refers to the start time of the next refresh of the to-be-refreshed materialized view, and the record of the timed refresh start time refers to the start time of the last refresh of the to-be-refreshed materialized view, so that the to-be-refreshed materialized view can be regularly refreshed through the interval between the timed refresh start time and the timed refresh time.
Further, the current time is obtained, and then it is monitored whether the current time reaches the refresh time, it should be noted that the refresh time may be determined by adding the timed refresh start time and the timed refresh time interval. In addition, whether the current time reaches the refreshing time or not is monitored, the current time can be timed through the timed refreshing time interval by taking the timed refreshing starting time as a reference, and when the timed residual time interval is ended, the current time reaches the refreshing time of the materialized view to be refreshed. In this process, the remaining time interval plus the interval between the current time and the timing refresh start time is the timing refresh time interval.
And step 104, when the current time reaches the refreshing time corresponding to the materialized view to be refreshed, calling a refreshing function through the refreshing thread pool, and refreshing the materialized view to be refreshed.
When the current time reaches the refreshing time corresponding to the materialized view to be refreshed, the sub-thread in the refreshing thread pool corresponding to the materialized view to be refreshed calls the refreshing function, and the materialized view to be refreshed is refreshed through the called refreshing function, so that the timing refreshing of the materialized view is realized. It should be noted that the refresh function in the embodiment of the present application may be implemented by using a refresh function in an existing database, that is, when the refresh function is called, a function with a similar refresh function existing in the existing database may be called without redesigning and writing a new function, so that details of the embodiment of the present application are not described herein.
And finishing one timing refreshing of the materialized view in the database.
For a more clear and detailed explanation of the solution of the present application, based on the method of fig. 1, some specific embodiments and embodiments of the method are also provided in the present specification, and the following description is continued.
In an example of the application, after the refreshing of the to-be-refreshed materialized view is completed, the time for completing the refreshing is updated to be the timing refreshing starting time, so that the to-be-refreshed materialized view can be refreshed again at a timing refreshing time interval. The time for starting the refresh is updated to the time for starting the timed refresh, so that the time for refreshing the materialized views is not considered in the time interval for the timed refresh because the refresh times corresponding to different materialized views are different and the refresh times of all the materialized views cannot be quantized within a fixed time period.
Further, if the service is stopped due to the burst state in the database service process, after the re-service is resumed, the time period for stopping the service is directly determined, and then the time period is compared with the timing refresh time interval, for example, if the stop time period is greater than or equal to the timing refresh time interval, the materialized view is directly refreshed.
In one or more possible implementation manners of the embodiment of the present application, when the timed refresh field is created, a timed refresh start time and a timed refresh time interval are specified, and the timed refresh start time and the timed refresh time interval need to be stored, so as to ensure that the materialized view can be refreshed by continuously using the timed refresh field after the service is restarted. Specifically, in a storage table system, metadata, materialized _ view corresponding to a materialized view of a database, a timed refresh start time refresh _ time and a timed refresh time interval refresh _ interval are added as two refresh attributes.
In one or more possible implementation manners of the embodiment of the present application, if a user performs a manual trigger refresh in a timing refresh time interval, logic of the timing refresh is disturbed, and therefore, in this embodiment of the present application, if there is a materialized view that is manually triggered to be refreshed, updating a timing refresh start time in a storage table is a time that is manually triggered, or updating the timing refresh start time is a time that is completed by this time of the manual trigger refresh.
In one or more possible implementation manners of the embodiment of the application, the full-scale refreshing of the materialized view is slow, when the dml operation is performed on the table associated with the materialized view, data in the table changes, but the materialized view cannot sense the data, so that the result of the materialized view query may not be the latest data, and therefore the materialized view also needs to be refreshed during the materialized view query.
Specifically, currently, in the OLAP analysis engine trino, when a materialized view is queried, a relevant judgment is made, if the materialized view is a latest table, the content of the materialized view is directly queried, and if the data of the table is found to be updated, the materialized view is treated as a normal view. Therefore, in the embodiment of the present application, an improvement is made to query the materialized view, and specifically, the query logic refers to fig. 2.
Fig. 2 is a diagram of a materialized view query process in an application scenario provided by the embodiment of the present application. As shown in fig. 2, in the embodiment of the application, when a materialized view is queried, if a table corresponding to the materialized view is new, the materialized view does not need to be refreshed, and the content of the materialized view is directly queried.
Further, after the materialized view is refreshed, the time for refreshing the materialized view needs to be updated to the timing refreshing starting time, so that the materialized view can be refreshed regularly and timely in the following process.
In the embodiment of the application, the timed refresh has the advantage that after the refresh is completed, the data of the table is synchronized to the materialized view, so that the queried data is not old data any more, and the latest data can be queried. Meanwhile, the materialized view is updated according to the timeliness of the business, the problem that the time consumption for updating the data is too long when the existing OLAP analysis database carries out complex business logic calculation on mass data is solved, the updating timeliness of the materialized view is improved, or the optimal balance between the granularity of the updating time of the materialized view and the consumption of computing resources is obtained, the flexibility is greatly expanded, a highly complex updating strategy is supported, and more complex business scenes can be met.
The foregoing is an embodiment of a method in the embodiment of the present application, and based on the same inventive concept, the embodiment of the present application further provides an apparatus for regularly refreshing materialized views oriented to an OLAP analysis database, where the structure of the apparatus is shown in fig. 3.
Fig. 3 is a structural diagram of a materialized view timing refresh device oriented to an OLAP analysis database according to an embodiment of the present application. As shown in fig. 3, the apparatus includes: a processor, and a memory having stored thereon executable instructions that, when executed, cause the processor to perform a materialized view timed refresh method for OLAP analysis-oriented databases as described above.
In one or more possible implementations of the embodiments of the present application, the processor is configured to create a refresh thread pool when the database is started; detecting a materialized view to be refreshed corresponding to the database, and adding the materialized view to be refreshed into the refreshing thread pool; based on the timing refreshing field, monitoring the refreshing time corresponding to the materialized view to be refreshed through the refreshing thread pool; and when the current time reaches the refreshing time corresponding to the materialized view to be refreshed, calling a refreshing function through the refreshing thread pool to finish the timing refreshing of the materialized view to be refreshed.
In addition, embodiments of the present application also provide a non-volatile computer storage medium having stored thereon computer-executable instructions configured to perform a materialized view timing refresh method for an OLAP analysis database as described above.
In one or more possible implementations of embodiments of the present application, the computer-executable instructions are configured to, upon startup of the database, create a refresh thread pool; detecting a materialized view to be refreshed corresponding to the database, and adding the materialized view to be refreshed into the refreshing thread pool; based on the timing refreshing field, monitoring the refreshing time corresponding to the materialized view to be refreshed through the refreshing thread pool; and when the current time reaches the refreshing time corresponding to the materialized view to be refreshed, calling a refreshing function through the refreshing thread pool to finish the timing refreshing of the materialized view to be refreshed.
The embodiments in the present application are described in a progressive manner, and the same and similar parts among the embodiments can be referred to each other, and each embodiment focuses on differences from other embodiments. In particular, as for the device and non-volatile computer storage medium embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference may be made to the partial description of the method embodiments for relevant points.
The foregoing description of specific embodiments of the present application has been presented. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art to which the embodiments of the present application pertain. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the embodiments of the present application should be included in the scope of the claims of the present application.
Claims (10)
1. The OLAP analysis database-oriented materialized view timing refreshing method is characterized by comprising the following steps:
when the database is started, creating a refresh thread pool;
detecting a materialized view to be refreshed corresponding to the database, and adding the materialized view to be refreshed into the refreshing thread pool;
based on the timing refreshing field, monitoring the refreshing time corresponding to the materialized view to be refreshed through the refreshing thread pool;
and when the current time reaches the refreshing time corresponding to the materialized view to be refreshed, calling a refreshing function through the refreshing thread pool to finish the timing refreshing of the materialized view to be refreshed.
2. The OLAP analytics database-oriented materialized view timed refresh method of claim 1, wherein after the creating a refresh thread pool, the method further comprises:
adding the timed refresh field in a system, metadata, matched _ view _ properties system table corresponding to the database;
wherein the timed refresh field includes at least a timed refresh time interval refresh _ interval and a timed refresh start time refresh _ time.
3. The OLAP analytics database-oriented materialized view timed refresh method of claim 2, wherein after adding the refresh field, the method further comprises:
and adding the timed refresh time interval refresh _ interval and the timed refresh start time refresh _ time as two refresh attributes to a storage table system.
4. The OLAP analysis database-oriented materialized view timing refreshing method according to claim 1, wherein adding the materialized view to be refreshed to the refreshing thread pool specifically comprises:
determining the number of the materialized views to be refreshed;
configuring the number of sub threads in the refreshing thread pool according to the number of the materialized views to be refreshed, so that the sub threads correspond to the materialized views to be refreshed one to one;
and adding the materialized view to be refreshed into the corresponding sub-thread in a polling manner.
5. The OLAP analysis database-oriented materialized view timing refreshing method according to claim 3, wherein before the refreshing thread pool monitors the refreshing time corresponding to the materialized view to be refreshed, the method further comprises:
acquiring the timing refresh starting time and the timing refresh time interval in a storage table corresponding to the materialized view to be refreshed;
timing the current time through the timing refreshing time interval by taking the timing refreshing starting time as a reference so as to determine that the current time reaches the refreshing time corresponding to the materialized view to be refreshed;
and after the materialized view to be refreshed is refreshed, updating the current time to the timing refreshing starting time.
6. The OLAP analysis database oriented materialized view timed refresh method of claim 3, wherein before calling a refresh function through the refresh thread pool, the method further comprises:
determining that the materialized view to be refreshed is refreshed by manual triggering;
and updating the trigger time corresponding to the manual trigger refreshing to the timing refreshing starting time.
7. The OLAP analytics database-oriented materialized view timed refresh method according to claim 1, wherein after the timed refresh of the materialized view to be refreshed is completed, the method further comprises:
querying the materialized view to be refreshed;
and if the materialized view to be refreshed is refreshing, starting to inquire after the materialized view to be refreshed is refreshed.
8. The OLAP analytics database-oriented materialized view timed refresh method of claim 7, wherein after querying the materialized view to be refreshed, the method further comprises:
determining that the materialized view to be refreshed is not in the refreshing process;
refreshing the materialized view to be refreshed;
and after the refreshing is finished, starting the query, and updating the time of finishing the refreshing of the materialized view to be refreshed to the timing refreshing starting time.
9. OLAP analysis database-oriented materialized view timing refreshing device, characterized in that the device comprises:
a processor;
and a memory having stored thereon executable instructions that, when executed, cause the processor to perform the OLAP analytics database-oriented materialized view timing refresh method of any one of claims 1-8.
10. A non-transitory computer storage medium having stored thereon computer-executable instructions configured to perform the OLAP analytics database-oriented materialized view timing refresh method of any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211671204.9A CN115658716A (en) | 2022-12-26 | 2022-12-26 | OLAP analysis database-oriented materialized view timing refreshing method, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211671204.9A CN115658716A (en) | 2022-12-26 | 2022-12-26 | OLAP analysis database-oriented materialized view timing refreshing method, equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115658716A true CN115658716A (en) | 2023-01-31 |
Family
ID=85022784
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211671204.9A Pending CN115658716A (en) | 2022-12-26 | 2022-12-26 | OLAP analysis database-oriented materialized view timing refreshing method, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115658716A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040122828A1 (en) * | 2002-12-23 | 2004-06-24 | Sidle Richard S. | Independent deferred incremental refresh of materialized views |
| US20070033160A1 (en) * | 2005-08-04 | 2007-02-08 | International Business Machines Corporation | Apparatus and method for autonomic refresh of a materialized query table in a computer database |
| CN101477524A (en) * | 2008-12-11 | 2009-07-08 | 金蝶软件（中国）有限公司 | System performance optimization method and system based on materialized view |
| CN107291806A (en) * | 2017-05-16 | 2017-10-24 | 浙江工业大学 | A kind of Data View copy alternative manner in Web visible environments |
| CN114860408A (en) * | 2022-05-17 | 2022-08-05 | 中国银行股份有限公司 | Thread pool resource management method and device |
-
2022
- 2022-12-26 CN CN202211671204.9A patent/CN115658716A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040122828A1 (en) * | 2002-12-23 | 2004-06-24 | Sidle Richard S. | Independent deferred incremental refresh of materialized views |
| US20070033160A1 (en) * | 2005-08-04 | 2007-02-08 | International Business Machines Corporation | Apparatus and method for autonomic refresh of a materialized query table in a computer database |
| CN101477524A (en) * | 2008-12-11 | 2009-07-08 | 金蝶软件（中国）有限公司 | System performance optimization method and system based on materialized view |
| CN107291806A (en) * | 2017-05-16 | 2017-10-24 | 浙江工业大学 | A kind of Data View copy alternative manner in Web visible environments |
| CN114860408A (en) * | 2022-05-17 | 2022-08-05 | 中国银行股份有限公司 | Thread pool resource management method and device |
Non-Patent Citations (5)
| Title |
|---|
| 张银玲，武彤: "常用OLAP查询优化方法性能分析" * |
| 朱燕燕: "基于Hive的离线数据处理方法与实现" * |
| 温立辉;: "Java语言定时调度任务之实现" * |
| 王继周,李成名,付俊娥: "Java多线程技术在WebGIS空间数据传输中的应用" * |
| 闵昭浩;: "Oracle物化视图增量刷新的应用研究" * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110309161B (en) | Data synchronization method and device and server | |
| US11334544B2 (en) | Method, apparatus, device and medium for storing and querying data | |
| US9778991B2 (en) | Exporting and importing database tables in a multi-user database environment | |
| CN112286941A (en) | Big data synchronization method and device based on Binlog + HBase + Hive | |
| WO2021184761A1 (en) | Data access method and apparatus, and data storage method and device | |
| CN102932424B (en) | Method and system for synchronizing data caching of distributed parallel file system | |
| CN107423404B (en) | Flow instance data synchronous processing method and device | |
| CN112269802B (en) | Method and system for optimizing based on Clickhouse frequent censoring | |
| WO2021169496A1 (en) | Data reading method, apparatus, and device, and storage medium | |
| CN113704267A (en) | Data query method, system, equipment and storage medium based on elastic search | |
| CN114428820A (en) | Method, system and data synchronization device for real-time synchronization of distributed data | |
| CN113918535A (en) | Data reading method, device, equipment and storage medium | |
| CN114238399A (en) | Cache flushing system, method, apparatus, computer device and storage medium | |
| CN104317944A (en) | Formula-based concurrency control method by timestamp dynamic adjustment | |
| CN105353988A (en) | Metadata reading and writing method and device | |
| US10838931B1 (en) | Use of stream-oriented log data structure for full-text search oriented inverted index metadata | |
| CN110874358A (en) | Method and device for storing and retrieving multi-attribute columns, and electronic equipment | |
| CN109344164B (en) | Data storage method and device | |
| CN115658716A (en) | OLAP analysis database-oriented materialized view timing refreshing method, equipment and medium | |
| CN111143329B (en) | Data processing method and device | |
| CN114090609B (en) | Data synchronization method and terminal | |
| CN111026810B (en) | Data synchronization method, device and storage medium | |
| CN111478933A (en) | Application cluster data preloading method, device, storage medium, equipment and system | |
| CN114328738A (en) | Data processing method and device, electronic equipment and readable storage medium | |
| CN114816247A (en) | Logic data acquisition method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20230131 |