Crate adk_browser Copy item path

§adk-browser

Browser automation tools for ADK agents using WebDriver (via thirtyfour).

§Overview

This crate provides browser automation capabilities as ADK tools, allowing LLM agents to interact with web pages. Tools are designed to work with any LlmAgent and inherit all ADK benefits (callbacks, session management, etc.).

§Quick Start

use adk_browser::{BrowserSession, BrowserConfig, BrowserToolset};
use adk_agent::LlmAgentBuilder;
use std::sync::Arc;

async fn example() -> anyhow::Result<()> {
    // Create browser session
    let config = BrowserConfig::new()
        .headless(true)
        .viewport(1920, 1080);

    let browser = Arc::new(BrowserSession::new(config));
    browser.start().await?;

    // Create toolset
    let toolset = BrowserToolset::new(browser.clone());

    // Add tools to agent (example - requires model)
    // let agent = LlmAgentBuilder::new("browser_agent")
    //     .model(model)
    //     .instruction("You are a web automation assistant.")
    //     .tools(toolset.all_tools())
    //     .build()?;

    // Clean up
    browser.stop().await?;
    Ok(())
}

§Available Tools

§Navigation

• browser_navigate - Navigate to a URL
• browser_back - Go back in history
• browser_forward - Go forward in history
• browser_refresh - Refresh the page

§Interaction

• browser_click - Click on an element
• browser_double_click - Double-click an element
• browser_type - Type text into an input
• browser_clear - Clear an input field
• browser_select - Select from a dropdown

§Extraction

• browser_extract_text - Get text from elements
• browser_extract_attribute - Get attribute values
• browser_extract_links - Get all links on page
• browser_page_info - Get current URL and title
• browser_page_source - Get HTML source

§Screenshots

• browser_screenshot - Capture page or element screenshot

§Waiting

• browser_wait_for_element - Wait for element to appear
• browser_wait - Wait for a duration
• browser_wait_for_page_load - Wait for page to load
• browser_wait_for_text - Wait for text to appear

§JavaScript

• browser_evaluate_js - Execute JavaScript code
• browser_scroll - Scroll the page
• browser_hover - Hover over an element
• browser_handle_alert - Handle JavaScript alerts

§Cookies

• browser_get_cookies - Get all cookies
• browser_get_cookie - Get a specific cookie
• browser_add_cookie - Add a cookie
• browser_delete_cookie - Delete a cookie
• browser_delete_all_cookies - Delete all cookies

§Windows/Tabs

• browser_list_windows - List all windows/tabs
• browser_new_tab - Open a new tab
• browser_new_window - Open a new window
• browser_switch_window - Switch to a window
• browser_close_window - Close current window
• browser_maximize_window - Maximize window
• browser_minimize_window - Minimize window
• browser_set_window_size - Set window size

§Frames

• browser_switch_to_frame - Switch to an iframe
• browser_switch_to_parent_frame - Exit current iframe
• browser_switch_to_default_content - Exit all iframes

§Advanced Actions

• browser_drag_and_drop - Drag and drop elements
• browser_right_click - Right-click (context menu)
• browser_focus - Focus on an element
• browser_element_state - Check element state
• browser_press_key - Press keyboard keys
• browser_file_upload - Upload files
• browser_print_to_pdf - Print page to PDF

§Requirements

A WebDriver server (like ChromeDriver, geckodriver, or Selenium) must be running and accessible. By default, tools connect to http://localhost:4444.

§Starting ChromeDriver

# Install ChromeDriver (macOS)
brew install chromedriver

# Start ChromeDriver
chromedriver --port=4444

§Using Docker

docker run -d -p 4444:4444 selenium/standalone-chrome

§Architecture

Tools are implemented using the ADK Tool trait, allowing them to:

• Work with any LLM model (Gemini, OpenAI, Anthropic)
• Use callbacks for monitoring and control
• Access session state and artifacts
• Compose with other tools and agents

┌─────────────────────────────────────────────────┐
│                   LlmAgent                       │
│  (with callbacks, session, artifacts, memory)   │
└─────────────────────────────────────────────────┘
                       │
                       ▼
┌─────────────────────────────────────────────────┐
│               BrowserToolset                     │
│  NavigateTool, ClickTool, TypeTool, ...         │
└─────────────────────────────────────────────────┘
                       │
                       ▼
┌─────────────────────────────────────────────────┐
│              BrowserSession                      │
│         (wraps thirtyfour WebDriver)            │
└─────────────────────────────────────────────────┘
                       │
                       ▼
             WebDriver Server
          (ChromeDriver, etc.)