[go: up one dir, main page]

ATE534948T1 - Adaptive datei-readahead-technik für mehrere leseströme - Google Patents

Adaptive datei-readahead-technik für mehrere leseströme

Info

Publication number
ATE534948T1
ATE534948T1 AT04812166T AT04812166T ATE534948T1 AT E534948 T1 ATE534948 T1 AT E534948T1 AT 04812166 T AT04812166 T AT 04812166T AT 04812166 T AT04812166 T AT 04812166T AT E534948 T1 ATE534948 T1 AT E534948T1
Authority
AT
Austria
Prior art keywords
read
streams
readahead
operating system
read streams
Prior art date
Application number
AT04812166T
Other languages
English (en)
Inventor
Robert Fair
Original Assignee
Network Appliance Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Network Appliance Inc filed Critical Network Appliance Inc
Application granted granted Critical
Publication of ATE534948T1 publication Critical patent/ATE534948T1/de

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0862—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches with prefetch
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0806—Multiuser, multiprocessor or multiprocessing cache systems
    • G06F12/084—Multiuser, multiprocessor or multiprocessing cache systems with a shared cache
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0866—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches for peripheral storage systems, e.g. disk cache
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/60—Details of cache memory
    • G06F2212/6026—Prefetching based on access pattern detection, e.g. stride based prefetch
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99941—Database schema or data structure
    • Y10S707/99944—Object-oriented database structure
    • Y10S707/99945—Object-oriented database structure processing

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
AT04812166T 2003-11-25 2004-11-24 Adaptive datei-readahead-technik für mehrere leseströme ATE534948T1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/721,596 US7333993B2 (en) 2003-11-25 2003-11-25 Adaptive file readahead technique for multiple read streams
PCT/US2004/039591 WO2005052800A2 (en) 2003-11-25 2004-11-24 Adaptive file readahead technique for multiple read streams

Publications (1)

Publication Number Publication Date
ATE534948T1 true ATE534948T1 (de) 2011-12-15

Family

ID=34591830

Family Applications (1)

Application Number Title Priority Date Filing Date
AT04812166T ATE534948T1 (de) 2003-11-25 2004-11-24 Adaptive datei-readahead-technik für mehrere leseströme

Country Status (5)

Country Link
US (2) US7333993B2 (de)
EP (1) EP1687724B1 (de)
JP (1) JP4510028B2 (de)
AT (1) ATE534948T1 (de)
WO (1) WO2005052800A2 (de)

Families Citing this family (66)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4319984B2 (ja) * 2002-09-02 2009-08-26 セッテック インコーポレイテッド 記録媒体複製用の複製装置、その方法、及びそのコンピュータプログラム
US7809693B2 (en) * 2003-02-10 2010-10-05 Netapp, Inc. System and method for restoring data on demand for instant volume restoration
US7333993B2 (en) * 2003-11-25 2008-02-19 Network Appliance, Inc. Adaptive file readahead technique for multiple read streams
US8244903B2 (en) * 2003-12-22 2012-08-14 Emc Corporation Data streaming and backup systems having multiple concurrent read threads for improved small file performance
US7818475B2 (en) * 2004-04-30 2010-10-19 Emc Corporation Storage switch mirrored write sequence count management
US7496586B1 (en) * 2004-05-26 2009-02-24 Sun Microsystems, Inc. Method and apparatus for compressing data in a file system
US7386674B1 (en) * 2005-04-25 2008-06-10 Netapp, Inc. Method and apparatus to provide a unified readahead scheme for multiple sources
WO2006116183A1 (en) * 2005-04-25 2006-11-02 Network Appliance, Inc. Architecture for supporting sparse volumes
ATE512412T1 (de) * 2005-04-25 2011-06-15 Network Appliance Inc System und verfahren zum zwischenspeichern von netzwerkdateisystemen
US20070022314A1 (en) * 2005-07-22 2007-01-25 Pranoop Erasani Architecture and method for configuring a simplified cluster over a network with fencing and quorum
DE102005057085A1 (de) * 2005-11-30 2007-05-31 Itxperts Gmbh Übertragung digitaler Filme vom Verleih in die Kinos insbesondere zur LIVE-Aufführung ohne Zwischenspeicherung
US8165221B2 (en) 2006-04-28 2012-04-24 Netapp, Inc. System and method for sampling based elimination of duplicate data
US7613714B2 (en) * 2006-05-02 2009-11-03 Netscout Systems, Inc. Systems and methods for analyzing a stream of data records relating to electronic data processing performance
US9432433B2 (en) 2006-06-09 2016-08-30 Qualcomm Incorporated Enhanced block-request streaming system using signaling or block creation
US7536428B2 (en) * 2006-06-23 2009-05-19 Microsoft Corporation Concurrent read and write access to a linked list where write process updates the linked list by swapping updated version of the linked list with internal list
US8412682B2 (en) * 2006-06-29 2013-04-02 Netapp, Inc. System and method for retrieving and using block fingerprints for data deduplication
US7921077B2 (en) * 2006-06-29 2011-04-05 Netapp, Inc. System and method for managing data deduplication of storage systems utilizing persistent consistency point images
US7747584B1 (en) 2006-08-22 2010-06-29 Netapp, Inc. System and method for enabling de-duplication in a storage system architecture
US8112675B2 (en) * 2006-09-28 2012-02-07 Nvidia Corporation Filesystem directory debug log
US7546307B2 (en) * 2006-09-28 2009-06-09 Nvidia Corporation Virtual block storage to filesystem translator
US9940345B2 (en) * 2007-01-10 2018-04-10 Norton Garfinkle Software method for data storage and retrieval
US7853750B2 (en) * 2007-01-30 2010-12-14 Netapp, Inc. Method and an apparatus to store data patterns
US8762345B2 (en) 2007-05-31 2014-06-24 Netapp, Inc. System and method for accelerating anchor point detection
US8793226B1 (en) 2007-08-28 2014-07-29 Netapp, Inc. System and method for estimating duplicate data
US20090252147A1 (en) * 2008-04-03 2009-10-08 Inventec Corporation Storage server implemented by internet small computer systems interface in linux system
US8250043B2 (en) * 2008-08-19 2012-08-21 Netapp, Inc. System and method for compression of partially ordered data sets
US8392312B2 (en) * 2008-09-24 2013-03-05 Netapp, Inc. Adaptive scheduling of storage operations based on utilization of a multiple client and server resources in a distributed network storage system
US8572036B2 (en) * 2008-12-18 2013-10-29 Datalight, Incorporated Method and apparatus for fault-tolerant memory management
US8736590B2 (en) * 2009-03-27 2014-05-27 Qualcomm Mems Technologies, Inc. Low voltage driver scheme for interferometric modulators
US9917874B2 (en) 2009-09-22 2018-03-13 Qualcomm Incorporated Enhanced block-request streaming using block partitioning or request controls for improved client-side handling
US8984231B2 (en) * 2009-12-22 2015-03-17 Intel Corporation Methods and apparatus to perform adaptive pre-fetch operations in managed runtime environments
JP5354606B2 (ja) * 2010-02-10 2013-11-27 日本電信電話株式会社 データ蓄積装置及び方法及びプログラム及びデータ検索装置及び方法及びプログラム
US8732406B1 (en) * 2011-03-15 2014-05-20 Netapp, Inc. Mechanism for determining read-ahead length in a storage system
US9817761B2 (en) * 2012-01-06 2017-11-14 Sandisk Technologies Llc Methods, systems, and computer readable media for optimization of host sequential reads or writes based on volume of data transfer
US8966185B2 (en) * 2012-06-14 2015-02-24 International Business Machines Corporation Cache memory prefetching
KR101978256B1 (ko) 2012-09-27 2019-05-14 삼성전자주식회사 모바일 기기의 데이터 독출 방법 및 이를 이용하는 모바일 기기
KR20140042458A (ko) * 2012-09-28 2014-04-07 삼성전자주식회사 스토리지 시스템의 파일 관리 장치, 파일 관리 방법
JP6195098B2 (ja) 2013-06-21 2017-09-13 華為技術有限公司Ｈｕａｗｅｉ Ｔｅｃｈｎｏｌｏｇｉｅｓ Ｃｏ．，Ｌｔｄ． ファイル読み取り方法、記憶装置、および読み取りシステム
US9223791B2 (en) 2013-07-02 2015-12-29 Red Hat, Inc. System and method for reading file blocks
US11416444B2 (en) * 2014-03-18 2022-08-16 Netapp, Inc. Object-based storage replication and recovery
US9940332B1 (en) * 2014-06-27 2018-04-10 EMC IP Holding Company LLC Storage pool-backed file system expansion
US20160196089A1 (en) * 2015-01-07 2016-07-07 Netapp, Inc. System and method for adaptive data transfers with limited resources
US11782601B2 (en) * 2015-01-20 2023-10-10 Ultrata, Llc Object memory instruction set
US9971506B2 (en) * 2015-01-20 2018-05-15 Ultrata, Llc Distributed index for fault tolerant object memory fabric
US9971542B2 (en) 2015-06-09 2018-05-15 Ultrata, Llc Infinite memory fabric streams and APIs
US10698628B2 (en) 2015-06-09 2020-06-30 Ultrata, Llc Infinite memory fabric hardware implementation with memory
US9886210B2 (en) 2015-06-09 2018-02-06 Ultrata, Llc Infinite memory fabric hardware implementation with router
CN105183366B (zh) * 2015-07-08 2018-04-17 北京师范大学 基于预读缓写的数据分析处理方法及系统
JP6707824B2 (ja) * 2015-09-07 2020-06-10 日本電気株式会社 情報端末、情報処理システムおよびデータ読み込み方法、並びにコンピュータ・プログラム
US10241676B2 (en) 2015-12-08 2019-03-26 Ultrata, Llc Memory fabric software implementation
US10235063B2 (en) 2015-12-08 2019-03-19 Ultrata, Llc Memory fabric operations and coherency using fault tolerant objects
CN115061971A (zh) 2015-12-08 2022-09-16 乌尔特拉塔有限责任公司 使用容错对象的存储器结构操作和一致性
CN108885604B (zh) 2015-12-08 2022-04-12 乌尔特拉塔有限责任公司 存储器结构软件实现方案
CN109154881B (zh) * 2016-03-25 2023-01-03 Netapp股份有限公司 基于对象的存储复制和恢复
EP3519993A1 (de) * 2016-09-29 2019-08-07 Veritas Technologies LLC Verfolgung des zugriffsmusters von inodes und des vorausladens von inodes
US10303401B2 (en) * 2017-01-26 2019-05-28 International Business Machines Corporation Data caching for block storage systems
CN110874345B (zh) * 2018-08-29 2023-04-11 阿里巴巴集团控股有限公司 分布式存储系统中的数据处理方法、装置和系统
US10846226B2 (en) * 2019-01-28 2020-11-24 Western Digital Technologies, Inc. System and method for prediction of random read commands in virtualized multi-queue memory systems
CN111694504B (zh) * 2019-03-15 2023-03-31 杭州宏杉科技股份有限公司 一种处理读请求的方法及装置
US11533384B2 (en) * 2020-03-20 2022-12-20 International Business Machines Corporation Predictive provisioning of cloud-stored files
CN111625503B (zh) * 2020-05-29 2022-11-04 苏州浪潮智能科技有限公司 一种分布式文件系统文件局部随机预读的方法和设备
CN112162956B (zh) * 2020-09-11 2025-02-14 北京浪潮数据技术有限公司 一种跳读预读方法、装置、设备及存储介质
DE102022122836A1 (de) * 2022-09-08 2024-03-14 Carl Zeiss Microscopy Gmbh Verfahren und System zum Übersetzen eines Datenstroms
US12380030B2 (en) 2022-10-20 2025-08-05 Samsung Electronics Co., Ltd. Persistent storage with dual interface
CN118605792A (zh) * 2023-03-06 2024-09-06 戴尔产品有限公司 用于检测顺序流的方法、电子设备以及计算机程序产品
CN120752214A (zh) 2023-04-14 2025-10-03 普拉克生化公司 制备乳酸盐水溶液的方法

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4489378A (en) 1981-06-05 1984-12-18 International Business Machines Corporation Automatic adjustment of the quantity of prefetch data in a disk cache operation
US5146578A (en) 1989-05-01 1992-09-08 Zenith Data Systems Corporation Method of varying the amount of data prefetched to a cache memory in dependence on the history of data requests
US5371870A (en) 1992-04-24 1994-12-06 Digital Equipment Corporation Stream buffer memory having a multiple-entry address history buffer for detecting sequential reads to initiate prefetching
US6026452A (en) 1997-02-26 2000-02-15 Pitts; William Michael Network distributed site cache RAM claimed as up/down stream request/reply channel for storing anticipated data and meta data
US5381539A (en) 1992-06-04 1995-01-10 Emc Corporation System and method for dynamically controlling cache management
DE69431186T2 (de) 1993-06-03 2003-05-08 Network Appliance, Inc. Verfahren und Dateisystem zur Zuordnung von Datei-Blöcken zu Speicherplatz in einem RAID-Plattensystem
US5963962A (en) 1995-05-31 1999-10-05 Network Appliance, Inc. Write anywhere file-system layout
DE69435146D1 (de) 1993-06-03 2008-11-13 Network Appliance Inc Verfahren und Vorrichtung zum Beschreiben beliebiger Bereiche eines Dateisystems
US5913028A (en) 1995-10-06 1999-06-15 Xpoint Technologies, Inc. Client/server data traffic delivery system and method
US5987477A (en) * 1997-07-11 1999-11-16 International Business Machines Corporation Parallel file system and method for parallel write sharing
US6738790B1 (en) * 1997-10-31 2004-05-18 Oracle International Corporation Approach for accessing large objects
US6219693B1 (en) * 1997-11-04 2001-04-17 Adaptec, Inc. File array storage architecture having file system distributed across a data processing platform
US6216208B1 (en) 1997-12-29 2001-04-10 Intel Corporation Prefetch queue responsive to read request sequences
US6484239B1 (en) 1997-12-29 2002-11-19 Intel Corporation Prefetch queue
JP3522527B2 (ja) * 1998-03-27 2004-04-26 富士通株式会社 入出力制御装置および入出力制御方法
JP2003233976A (ja) * 1998-09-30 2003-08-22 Toshiba Corp データ再生装置及びデータ再生制御方法
US6260115B1 (en) 1999-05-13 2001-07-10 Storage Technology Corporation Sequential detection and prestaging methods for a disk storage subsystem
US6567894B1 (en) 1999-12-08 2003-05-20 International Business Machines Corporation Method and apparatus to prefetch sequential pages in a multi-stream environment
US20020049841A1 (en) * 2000-03-03 2002-04-25 Johnson Scott C Systems and methods for providing differentiated service in information management environments
US6523093B1 (en) 2000-09-29 2003-02-18 Intel Corporation Prefetch buffer allocation and filtering system
AU2002214659A1 (en) * 2000-10-26 2002-05-06 James C. Flood Jr. Method and system for managing distributed content and related metadata
WO2002087235A1 (en) * 2001-04-19 2002-10-31 Vividon, Inc. System for applying metric to multimedia files over network
EP1563389A4 (de) * 2001-08-01 2008-06-25 Actona Technologies Ltd Virtuelles datenteilungsnetzwerk
US7333993B2 (en) 2003-11-25 2008-02-19 Network Appliance, Inc. Adaptive file readahead technique for multiple read streams
US7631148B2 (en) 2004-01-08 2009-12-08 Netapp, Inc. Adaptive file readahead based on multiple factors

Also Published As

Publication number Publication date
EP1687724A2 (de) 2006-08-09
WO2005052800A2 (en) 2005-06-09
WO2005052800A3 (en) 2005-10-20
US9152565B2 (en) 2015-10-06
US20050114289A1 (en) 2005-05-26
JP4510028B2 (ja) 2010-07-21
US20080133872A1 (en) 2008-06-05
US7333993B2 (en) 2008-02-19
EP1687724B1 (de) 2011-11-23
JP2007519088A (ja) 2007-07-12

Similar Documents

Publication Publication Date Title
ATE534948T1 (de) Adaptive datei-readahead-technik für mehrere leseströme
Saupe et al. Climatic shifts drove major contractions in avian latitudinal distributions throughout the Cenozoic
WO2006022739A3 (en) Method and system for processing grammar-based legality expressions
NO20063490L (no) System og fremgangsmate for forbedring av en sokrangering ved bruk av artikkelinformasjon
GB2446072A (en) Methods and systems for generating query and result-based relevance indexes
WO2010014851A3 (en) Systems and methods for power aware data storage
WO2008079510A3 (en) High-throughput extract-transform-load (etl) of program events for subsequent analysis
EA200900001A3 (ru) Способ и устройство для управления компьютерной файловой системой с использованием деревьев файловой системы
WO2005071551A3 (en) Adaptive file readahead based on multiple factors
BR112014007679A2 (pt) sistemas e métodos para a implementação de fluxo de trabalho médico
CY1111421T1 (el) Ακυρωση αποθηκευσης, καθαρισμος καταχωρησεων των θεσεων προσκαιρης αποθηκευσης
NL1026172A1 (nl) On line biedingsysteem.
WO2007114938A3 (en) System and method for rendering of financial data
WO2007019311A3 (en) Systems for and methods of finding relevant documents by analyzing tags
WO2008113647A3 (en) Shared disk clones
DK1927913T3 (da) Realtids-proceshistorie-server
WO2004111852A3 (en) Managing a relationship between one target volume and one source volume
IN2015DN01332A (de)
WO2009089345A3 (en) Review managment system for audition portfolios
WO2007038149A3 (en) A system and method for aggregating item delivery information
GB2430058A (en) A system and method for retrieving information and a system and method for storing information
WO2006094160A3 (en) System and method for backing up open files of a source control management repository
WO2008144528A3 (en) Recording, tracking, and reporting content usage, and for payment determination
DE50115844D1 (de) Automatisierungsanlage
TW200729004A (en) System and method for searching multimedia content in content network