[go: up one dir, main page]

SG11201708917SA - Data processing method and system - Google Patents

Data processing method and system

Info

Publication number
SG11201708917SA
SG11201708917SA SG11201708917SA SG11201708917SA SG11201708917SA SG 11201708917S A SG11201708917S A SG 11201708917SA SG 11201708917S A SG11201708917S A SG 11201708917SA SG 11201708917S A SG11201708917S A SG 11201708917SA SG 11201708917S A SG11201708917S A SG 11201708917SA
Authority
SG
Singapore
Prior art keywords
data processing
processing method
data
processing
Prior art date
Application number
SG11201708917SA
Inventor
Min Han
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Publication of SG11201708917SA publication Critical patent/SG11201708917SA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2228—Indexing structures
    • G06F16/2272—Management thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2219—Large Object storage; Management thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2453—Query optimisation
    • G06F16/24534—Query rewriting; Transformation
    • G06F16/24539—Query rewriting; Transformation using cached or materialised query results
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F7/00—Methods or arrangements for processing data by operating upon the order or content of the data handled
    • G06F7/06—Arrangements for sorting, selecting, merging, or comparing data on individual record carriers
    • G06F7/08—Sorting, i.e. grouping record carriers in numerical or other ordered sequence according to the classification of at least some of the information they carry
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Telephonic Communication Services (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
SG11201708917SA 2015-05-04 2016-04-21 Data processing method and system SG11201708917SA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510222356.4A CN106202092B (en) 2015-05-04 2015-05-04 Data processing method and system
PCT/CN2016/079812 WO2016177279A1 (en) 2015-05-04 2016-04-21 Data processing method and system

Publications (1)

Publication Number Publication Date
SG11201708917SA true SG11201708917SA (en) 2017-11-29

Family

ID=57218083

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11201708917SA SG11201708917SA (en) 2015-05-04 2016-04-21 Data processing method and system

Country Status (9)

Country Link
US (2) US10592491B2 (en)
EP (1) EP3293641B1 (en)
JP (1) JP6779231B2 (en)
KR (1) KR102134952B1 (en)
CN (1) CN106202092B (en)
ES (1) ES2808948T3 (en)
PL (1) PL3293641T3 (en)
SG (1) SG11201708917SA (en)
WO (1) WO2016177279A1 (en)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106202092B (en) 2015-05-04 2020-03-06 阿里巴巴集团控股有限公司 Data processing method and system
US11550632B2 (en) * 2015-12-24 2023-01-10 Intel Corporation Facilitating efficient communication and data processing across clusters of computing machines in heterogeneous computing environment
CN111597187B (en) * 2017-08-30 2023-09-01 第四范式（北京）技术有限公司 Distributed system for performing machine learning and method thereof
US11044091B1 (en) * 2018-03-15 2021-06-22 Secure Channels Inc. System and method for securely transmitting non-pki encrypted messages
CN110347513B (en) * 2019-07-15 2022-05-20 中国工商银行股份有限公司 Hot data batch scheduling method and device
US11804955B1 (en) 2019-09-13 2023-10-31 Chol, Inc. Method and system for modulated waveform encryption
US20220374158A1 (en) * 2019-12-20 2022-11-24 Intel Corporation Managing runtime apparatus for tiered object memory placement
CN112307051B (en) * 2020-10-10 2024-11-29 蔚来汽车科技(安徽)有限公司 Data query method, device, medium and data processing system
CN114443176B (en) * 2020-10-30 2025-03-14 武汉斗鱼鱼乐网络科技有限公司 A method for setting hotkeys for third-party software and related equipment
CN112650752A (en) * 2020-12-22 2021-04-13 深圳壹账通智能科技有限公司 Method, device and equipment for determining hot key and storage medium
CN116432903B (en) * 2023-04-01 2024-06-11 国网新疆电力有限公司电力科学研究院 A communication simulation data management system
CN116661961A (en) * 2023-05-10 2023-08-29 深圳前海环融联易信息科技服务有限公司 Big data scheduling method, device, computer equipment and storage medium
CN116346827B (en) * 2023-05-30 2023-08-11 中国地质大学（北京） Real-time grouping method and system for inclined data flow

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7756919B1 (en) * 2004-06-18 2010-07-13 Google Inc. Large-scale data processing in a distributed and parallel processing enviornment
US8726290B2 (en) * 2008-06-12 2014-05-13 Yahoo! Inc. System and/or method for balancing allocation of data among reduce processes by reallocation
CN101645067A (en) 2008-08-05 2010-02-10 北京大学 Method for predicting hot forum in forum collection
JP5229731B2 (en) * 2008-10-07 2013-07-03 インターナショナル・ビジネス・マシーンズ・コーポレーション Cache mechanism based on update frequency
US8370493B2 (en) * 2008-12-12 2013-02-05 Amazon Technologies, Inc. Saving program execution state
EP2325762A1 (en) * 2009-10-27 2011-05-25 Exalead Method and system for processing information of a stream of information
CN102141995B (en) * 2010-01-29 2013-06-12 国际商业机器公司 System and method for simplifying transmission in parallel computing system
CN102236581B (en) * 2010-04-30 2013-08-14 国际商业机器公司 Mapping reduction method and system thereof for data center
CN102314336B (en) * 2010-07-05 2016-04-13 深圳市腾讯计算机系统有限公司 A kind of data processing method and system
CN102456031B (en) * 2010-10-26 2016-08-31 腾讯科技（深圳）有限公司 A kind of Map Reduce system and the method processing data stream
JP5552449B2 (en) * 2011-01-31 2014-07-16 日本電信電話株式会社 Data analysis and machine learning processing apparatus, method and program
US20120304186A1 (en) * 2011-05-26 2012-11-29 International Business Machines Corporation Scheduling Mapreduce Jobs in the Presence of Priority Classes
JP5637071B2 (en) * 2011-05-27 2014-12-10 富士通株式会社 Processing program, processing method, and processing apparatus
CN103019614B (en) 2011-09-23 2015-11-25 阿里巴巴集团控股有限公司 Distributed memory system management devices and method
WO2012149776A1 (en) * 2011-09-28 2012-11-08 华为技术有限公司 Method and apparatus for storing data
EP2765510A4 (en) * 2011-10-06 2016-07-06 Fujitsu Ltd DATA PROCESSING METHOD, DISTRIBUTED PROCESSING SYSTEM, AND PROGRAM
TWI461929B (en) 2011-12-09 2014-11-21 Promise Tecnnology Inc Cloud data storage system
JP5919825B2 (en) * 2012-01-05 2016-05-18 富士通株式会社 Data processing method, distributed processing system, and program
US9367601B2 (en) * 2012-03-26 2016-06-14 Duke University Cost-based optimization of configuration parameters and cluster sizing for hadoop
WO2013153620A1 (en) * 2012-04-10 2013-10-17 株式会社日立製作所 Data processing system and data processing method
TWI610166B (en) 2012-06-04 2018-01-01 飛康國際網路科技股份有限公司 Automated disaster recovery and data migration system and method
JP5935889B2 (en) * 2012-08-02 2016-06-15 富士通株式会社 Data processing method, information processing apparatus, and program
US20150363467A1 (en) 2013-01-31 2015-12-17 Hewlett-Packard Development Company, L.P. Performing an index operation in a mapreduce environment
CN104077297B (en) * 2013-03-27 2017-05-17 日电（中国）有限公司 Query method and query device based on body
CN104142950A (en) 2013-05-10 2014-11-12 中国人民大学 Microblog User Classification Method Based on Keyword Extraction and Gini Coefficient
US9424274B2 (en) * 2013-06-03 2016-08-23 Zettaset, Inc. Management of intermediate data spills during the shuffle phase of a map-reduce job
IN2013MU02918A (en) * 2013-09-10 2015-07-03 Tata Consultancy Services Ltd
CN103838844B (en) * 2014-03-03 2018-01-19 珠海市君天电子科技有限公司 A kind of key-value pair data storage, transmission method and device
CN103995882B (en) 2014-05-28 2017-07-07 南京大学 Probability Mining Frequent Itemsets based on MapReduce
CN104331464A (en) * 2014-10-31 2015-02-04 许继电气股份有限公司 MapReduce-based monitoring data priority pre-fetching processing method
CN104536830A (en) 2015-01-09 2015-04-22 哈尔滨工程大学 KNN text classification method based on MapReduce
CN106202092B (en) 2015-05-04 2020-03-06 阿里巴巴集团控股有限公司 Data processing method and system
CN107193500A (en) 2017-05-26 2017-09-22 郑州云海信息技术有限公司 A kind of distributed file system Bedding storage method and system

Also Published As

Publication number Publication date
EP3293641B1 (en) 2020-06-17
KR102134952B1 (en) 2020-07-17
PL3293641T3 (en) 2021-02-08
US20180046658A1 (en) 2018-02-15
US10872070B2 (en) 2020-12-22
KR20180002758A (en) 2018-01-08
EP3293641A4 (en) 2018-10-17
CN106202092B (en) 2020-03-06
US10592491B2 (en) 2020-03-17
JP2018515844A (en) 2018-06-14
WO2016177279A1 (en) 2016-11-10
CN106202092A (en) 2016-12-07
EP3293641A1 (en) 2018-03-14
JP6779231B2 (en) 2020-11-04
US20200192882A1 (en) 2020-06-18
ES2808948T3 (en) 2021-03-02

Similar Documents

Publication Publication Date Title
ZA201800870B (en) Data processing method and device
IL255644B (en) Data processing apparatus and method
GB201712642D0 (en) Order processing method and system
EP3353671A4 (en) Distributed data processing method and system
GB201613109D0 (en) Computer implemented method and system
PL3376389T3 (en) Data processing method and device
SG11201801335SA (en) Information processing method and device
SG11201709271SA (en) Interaction data processing method and apparatus
SG11201703410YA (en) Data processing method, apparatus, and system
SG11201702373YA (en) System and method for information processing
EP3367250A4 (en) Information processing system and information processing method
SG11201710646TA (en) Information processing apparatus, information processing system, information processing method and program
SG11201708917SA (en) Data processing method and system
SG11201710329TA (en) Substrate processing system and substrate processing method
GB2539966B (en) Data processing method and apparatus
EP3276618A4 (en) Information processing system and information processing method
SG11201710887RA (en) Information processing apparatus and information processing method
EP3367249A4 (en) Information processing system and information processing method
GB201520023D0 (en) Method and system for processing image data
GB201513455D0 (en) Image processing system and method
GB201519510D0 (en) Method and system for handling data
SG11201710051QA (en) Information Processing Apparatus And Information Processing Method
EP3276484A4 (en) Information processing system and information processing method
GB201708340D0 (en) Data processing system and method
SG11201709848SA (en) Transaction processing method and system