Bachkaniwala et al., 2024 - Google Patents
Lotus: Characterization of Machine Learning Preprocessing Pipelines via Framework and Hardware ProfilingBachkaniwala et al., 2024
View PDF- Document ID
- 9558341816544901137
- Author
- Bachkaniwala R
- Lanka H
- Rong K
- Gavrilovska A
- Publication year
- Publication venue
- 2024 IEEE International Symposium on Workload Characterization (IISWC)
External Links
Snippet
Preprocessing input data is a crucial step in machine learning pipelines, involving tasks such as loading, decoding, and applying transformations. Prior works have identified preprocessing as a performance bottleneck for ML training jobs and introduced …
- 238000007781 pre-processing 0 title abstract description 148
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/362—Software debugging
- G06F11/3636—Software debugging by tracing the execution of the program
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
- G06F11/3414—Workload generation, e.g. scripts, playback
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3476—Data logging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3495—Performance evaluation by tracing or monitoring for systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for programme control, e.g. control unit
- G06F9/06—Arrangements for programme control, e.g. control unit using stored programme, i.e. using internal store of processing equipment to receive and retain programme
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5061—Partitioning or combining of resources
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for programme control, e.g. control unit
- G06F9/06—Arrangements for programme control, e.g. control unit using stored programme, i.e. using internal store of processing equipment to receive and retain programme
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for programme control, e.g. control unit
- G06F9/06—Arrangements for programme control, e.g. control unit using stored programme, i.e. using internal store of processing equipment to receive and retain programme
- G06F9/44—Arrangements for executing specific programmes
- G06F9/455—Emulation; Software simulation, i.e. virtualisation or emulation of application or operating system execution engines
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/86—Event-based monitoring
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/875—Monitoring of systems including the internet
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/865—Monitoring of software
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Blake et al. | Evolution of thread-level parallelism in desktop applications | |
| Koh et al. | An analysis of performance interference effects in virtual environments | |
| US7941789B2 (en) | Common performance trace mechanism | |
| US12373329B2 (en) | Deterministic replay of a multi-threaded trace on a multi-threaded processor | |
| CN104750603B (en) | A kind of multi-core DSP software simulator and its physical layer software test method | |
| US9740595B2 (en) | Method and apparatus for producing a benchmark application for performance testing | |
| US12450062B2 (en) | Deterministic replay of a multi-threaded trace on a multi-threaded processor | |
| US12106112B2 (en) | Methods and apparatus to generate graphics processing unit long instruction traces | |
| US10867362B2 (en) | Methods and apparatus to improve operation of a graphics processing unit | |
| US20150070367A1 (en) | Shader Program Profiler | |
| Nilakantan et al. | Synchrotrace: synchronization-aware architecture-agnostic traces for light-weight multicore simulation | |
| Buch et al. | Ai tax in mobile socs: End-to-end performance analysis of machine learning in smartphones | |
| Manotas et al. | Investigating the impacts of web servers on web application energy usage | |
| US10949330B2 (en) | Binary instrumentation to trace graphics processor code | |
| Bachkaniwala et al. | Lotus: Characterization of Machine Learning Preprocessing Pipelines via Framework and Hardware Profiling | |
| Rosales et al. | Remora: a resource monitoring tool for everyone | |
| Kariofillis et al. | Workload Characterization of Commercial Mobile Benchmark Suites | |
| Schmitt et al. | Emulating the power consumption behavior of server workloads using cpu performance counters | |
| Meredith et al. | On exploiting resource diversity in the public cloud for modeling application performance | |
| Martin et al. | Automatic benchmark profiling through advanced trace analysis | |
| Al-Manasia et al. | An overview of chip multi-processors simulators technology | |
| Busse et al. | Simulation-based tracing and profiling for system software development | |
| Ezolt | Optimizing Linux Performance: A Hands-on Guide to Linux Performance Tools | |
| Carata et al. | Resourceful: fine-grained resource accounting for explaining service variability | |
| Zins | Traçage et profilage d'applications d'apprentissage automatique de type flot de données utilisant un processeur graphique |