[go: up one dir, main page]

MY176486A - Automated test environment deployment with metric recommender for performance testing on iaas cloud - Google Patents

Automated test environment deployment with metric recommender for performance testing on iaas cloud

Info

Publication number
MY176486A
MY176486A MYPI2012005289A MYPI2012005289A MY176486A MY 176486 A MY176486 A MY 176486A MY PI2012005289 A MYPI2012005289 A MY PI2012005289A MY PI2012005289 A MYPI2012005289 A MY PI2012005289A MY 176486 A MY176486 A MY 176486A
Authority
MY
Malaysia
Prior art keywords
metric
test
performance
recommender
agent module
Prior art date
Application number
MYPI2012005289A
Inventor
Zakaria Alli Mohamad
Ikhwan Ismail Bukhary
Original Assignee
Mimos Berhad
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mimos Berhad filed Critical Mimos Berhad
Priority to MYPI2012005289A priority Critical patent/MY176486A/en
Priority to PCT/MY2013/000218 priority patent/WO2014088398A1/en
Publication of MY176486A publication Critical patent/MY176486A/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Prevention of errors by analysis, debugging or testing of software
    • G06F11/3698—Environments for analysis, debugging or testing of software
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • G06F11/3414—Workload generation, e.g. scripts, playback
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3466—Performance evaluation by tracing or monitoring
    • G06F11/3476—Data logging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Prevention of errors by analysis, debugging or testing of software
    • G06F11/3668—Testing of software
    • G06F11/3672—Test management
    • G06F11/3684—Test management for test design, e.g. generating new test cases
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/815—Virtual

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

Automated test environment deployment for performance testing on laaS Cloud is provided by utilizing metric recommender. The system and method of the present invention comprising a user interface (104) for setting up test performance; a Metric Agent Module (106, 206) for introducing list of suitable metrics to be captured according to performance goals; an Interface Agent Module (212) for interfacing with API (Application Programming Interface) of Performance Test Tool and Cloud Controller; a Deployment Agent Module (108, 208) for provisioning test environment based on test scripts; a Reporting Agent Module (110, 210) for collecting and aggregating test result from Data Store (220) and displaying in portal; a Metric Store (102, 202) for storing list of metrics; a Metric Logger (216) for monitoring and collecting required metrics during test execution; a Data Store (118, 220) for storing test results from Performance Test Tool (114, 218) and Metric Logger (216). The present invention utilizes a metric recommender wherein the performance test metric is automated using physical resources of virtual machine in which the complexity of setting up test environment will be overcome by providing cloud computing to set up test virtual environment. Metrics are aggregated using metric agents to achieve performance goals by iteration to validate and verify all quantitative and qualitative attributes as reliability, stability or resource utilization of the applications. The most Illustrative drawing is FIG. 2.0.
MYPI2012005289A 2012-12-06 2012-12-06 Automated test environment deployment with metric recommender for performance testing on iaas cloud MY176486A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
MYPI2012005289A MY176486A (en) 2012-12-06 2012-12-06 Automated test environment deployment with metric recommender for performance testing on iaas cloud
PCT/MY2013/000218 WO2014088398A1 (en) 2012-12-06 2013-11-29 Automated test environment deployment with metric recommender for performance testing on iaas cloud

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
MYPI2012005289A MY176486A (en) 2012-12-06 2012-12-06 Automated test environment deployment with metric recommender for performance testing on iaas cloud

Publications (1)

Publication Number Publication Date
MY176486A true MY176486A (en) 2020-08-12

Family

ID=50073398

Family Applications (1)

Application Number Title Priority Date Filing Date
MYPI2012005289A MY176486A (en) 2012-12-06 2012-12-06 Automated test environment deployment with metric recommender for performance testing on iaas cloud

Country Status (2)

Country Link
MY (1) MY176486A (en)
WO (1) WO2014088398A1 (en)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9274782B2 (en) 2013-12-20 2016-03-01 International Business Machines Corporation Automated computer application update analysis
WO2016018333A1 (en) * 2014-07-31 2016-02-04 Hewlett-Packard Development Company, L.P. Determining application change success ratings
US9619371B2 (en) 2015-04-16 2017-04-11 International Business Machines Corporation Customized application performance testing of upgraded software
US10031831B2 (en) 2015-04-23 2018-07-24 International Business Machines Corporation Detecting causes of performance regression to adjust data systems
US9886367B2 (en) 2015-04-29 2018-02-06 International Business Machines Corporation Unified processing test structure
WO2017142393A1 (en) * 2016-02-17 2017-08-24 Mimos Berhad System for managing user experience test in controlled test environment and method thereof
JP2019509681A (en) * 2016-02-26 2019-04-04 ノキア ソリューションズ アンド ネットワークス オサケユキチュア Cloud verification and test automation
CN105843725B (en) * 2016-03-17 2018-10-23 广州杰赛科技股份有限公司 A kind of monitoring method and device of IaaS platforms
CN107291611A (en) * 2016-04-11 2017-10-24 中兴通讯股份有限公司 Call the test system and method for third-party testing instrument
US11650797B2 (en) 2020-04-17 2023-05-16 Jpmorgan Chase Bank, N.A. Cloud portability code scanning tool
US11102081B1 (en) * 2020-09-28 2021-08-24 Accenture Global Solutions Limited Quantitative network testing framework for 5G and subsequent generation networks
CN112395176A (en) * 2020-11-16 2021-02-23 公安部第三研究所 Method, device, system, equipment, processor and storage medium for testing distributed cloud storage performance
CN112699041B (en) * 2021-01-04 2024-03-26 中车青岛四方车辆研究所有限公司 Automatic deployment method, system and equipment for embedded software
US11762962B2 (en) * 2021-06-29 2023-09-19 Capital One Services, Llc Onboarding of monitoring tools
CN117055905A (en) * 2023-10-12 2023-11-14 北京谷器数据科技有限公司 A method for rapid localized deployment of SaaS platforms
CN118764421B (en) * 2024-06-28 2025-09-16 中电云计算技术有限公司 SaaS user scene simulation test method, device and system
CN118550841B (en) * 2024-07-30 2024-10-15 深圳市遨游通讯设备有限公司 A method and system for realizing cross-layer communication of intercom module based on Hongmeng system
US12367125B1 (en) 2024-09-18 2025-07-22 Parry Labs, Llc Apparatus and method for evaluating software performance

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6975965B2 (en) * 2004-01-12 2005-12-13 International Business Machines Corporation System and method for heuristically optimizing a large set of automated test sets

Also Published As

Publication number Publication date
WO2014088398A1 (en) 2014-06-12

Similar Documents

Publication Publication Date Title
MY176486A (en) Automated test environment deployment with metric recommender for performance testing on iaas cloud
Liang et al. Caiipa: Automated large-scale mobile app testing through contextual fuzzing
US10372600B2 (en) Systems and methods for automated web performance testing for cloud apps in use-case scenarios
Zhao et al. Modeling and simulation of cloud computing: A review
US10140204B2 (en) Automated dynamic test case generation
CN104182333B (en) A kind of performance test methods and equipment
WO2014150306A8 (en) System and method for coordinating field user testing results for a mobile application across various mobile devices
EP3474144A3 (en) Method and system for self-optimizing, path-based object allocation tracking
JP2016512631A5 (en)
US9239773B1 (en) Method and system for debugging a program that includes declarative code and procedural code
JP6363152B2 (en) Apparatus, method, computer program, and storage medium for data flow analysis
WO2015023930A3 (en) Automatically capturing user interactions and evaluating user interfaces in software programs using field testing
FI20115104A0 (en) SYSTEM AND METHOD FOR MODEL-BASED TESTING
IN2013CH00165A (en)
WO2014031454A3 (en) Transaction-level health monitoring of online services
CN104268076A (en) A test method for automatically testing memory bandwidth applicable to various processor platforms
Canfora et al. A case study of automating user experience-oriented performance testing on smartphones
US20170024305A1 (en) Client application profiling
CN103605609A (en) An automated testing framework for cloud computing
CN103729293A (en) GUI testing method based on UML activity diagrams
MY167175A (en) A system and method for emulating multiple independent wireless client devices in the cloud
Shekhar et al. Understanding performance interference benchmarking and application profiling techniques for cloud-hosted latency-sensitive applications
US20140215269A1 (en) Test infrastructure simulation
Skretting et al. Baseline for performance prediction of android applications
Horváth et al. Code coverage measurement framework for Android devices