Test plan for "Mirror changes from Web IDE to CI runner"

Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.

• Close this issue

Test Plan

Introduction

This test plan is for https://gitlab.com/gitlab-org/gitlab-ee/issues/5276 and extends https://gitlab.com/gitlab-org/gitlab-ee/issues/7658. The feature allows a user to open a web terminal from the Web IDE and execute commands against the code as it exists in the Web IDE (i.e., the current state of the code, not the latest commit).

Implementation details are still under discussion.

Scope

• EE-only (Ultimate)
• The terminal will include the current state of the code in the Web IDE.
• Starting/stopping the web terminal and basic functionality is covered as part of https://gitlab.com/gitlab-org/gitlab-ee/issues/7658. This test plan focuses on mirroring changes during an active session. But it should include what happens when a session is interrupted.

ACC Matrix

	Secure	Responsive	Intuitive	Reliable
Web IDE

For more information see the Google Testing Blog article about the 10 minute test plan and this wiki page from an open-source tool that implements the ACC model.

Capabilities

Web IDE is:

• Reliable

  • Code changes made in the Web IDE are available in the web terminal without undue delay.

• Intuitive

  • It's clear when code changes made in the IDE will be available in the web terminal. E.g., if the user has to save their changes first, the UI should make that clear.
  • It's clear what's happening if there is a delay in syncing data from the Web IDE to the web terminal. I.e., there is some kind of indication that data is out of sync and is being updated.

Test Plan

End-to-end tests:

• Add and configure a runner, push code to a project, and then
  • start the web terminal and cat the changed file
  • make a change to a project via the Web IDE and cat the changed file

Test Coverage sheet