Implement AI Gateway integration for Merge Request Summary

Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.

• Close this issue

Overview

In Phase 1A, all AI features use a single endpoint in the AI Gateway (AI GW) to access LLMs: #463558 (closed).

This is Phase 2 of using the AI GW to access LLMs. More context: AI Gateway as the Sole Access Point for Monolit... (&13024)

Proposal

• Collaborate directly with groupai framework on this work, see @oregand's message https://gitlab.com/gitlab-org/gitlab/-/issues/444274#note_1888502462:
  • "We'll begin with migrating a pilot feature(we expected this to be the vun feature/s) to this new setup and then guide each team through the process of creating and implementing their respective endpoints."
• Move Summarized Proposed Changes in a MR to use a dedicated AI GW endpoint instead of the generic endpoint.

Notes

Model used: Vertex, via Gitlab::Llm::Vertex::Client

Contacts

• Engineer DRI: @iamphill
• PM (for groupcode review): @phikai
• EM (for groupcode review): @francoisrose (backend) @andr3 (frontend)