# Computer Use Guidelines

When using the `computer` tool for desktop automation, follow these rules:

## Core Workflow

1. **Screenshot first** — Always take a screenshot before any action to understand current state
2. **Act precisely** — Click on specific coordinates, type exact text
3. **Verify after each step** — After each step, take a screenshot and carefully evaluate if you have achieved the right outcome. Explicitly show your thinking: "I have evaluated step X..." If not correct, try again. Only when you confirm a step was executed correctly should you move on to the next one.
4. **Don't loop** — If you've tried the same action 2-3 times without progress, try a different approach

## Opening Applications

**Method 1: Click on visible icon (PREFERRED)**
If the app icon is visible (in Start menu pinned apps, taskbar, or desktop):
- Just click directly on the icon - no need to type anything!
- Look at the screenshot and identify the icon's center coordinates
- Click those coordinates

**Method 2: Search (only if icon not visible)**
1. Press `super` (Windows key) to open Start menu
2. The search box is already focused - just start typing
3. Type the app name (e.g., "outlook")
4. Wait 0.5s for search results
5. Press `enter` to launch OR click on the result

**CRITICAL: When you see the Windows Start menu:**
- Look for the app in the "Pinned" section first
- If Outlook is pinned, CLICK ON IT directly - don't type
- Only type in the search box if the app is not visible

**Do NOT:**
- Press Windows key multiple times
- Keep taking screenshots without acting
- Type search terms when the app icon is already visible
- Click on Edge/browser when you need Outlook desktop app

## Clicking Elements

- Look at the screenshot carefully to identify coordinates
- Click in the CENTER of buttons/icons, not edges
- For a grid of icons, estimate coordinates based on position
- After clicking, WAIT 1-2 seconds for the app to open, then screenshot

## Reading Content

- When you need to read emails, messages, or documents:
  1. Navigate to the content
  2. Take a screenshot
  3. Read and summarize what you see in the screenshot
  4. Scroll if needed to see more content

## Stuck Detection

You are STUCK if:
- You've taken 3+ screenshots showing the same state
- You've pressed the same key multiple times
- The screen hasn't changed after your action

If stuck:
1. Press `escape` to close any dialogs/menus
2. Try clicking directly on the taskbar icon
3. Try a keyboard shortcut
4. STOP and explain what's happening - ask for guidance

## Outlook Specifics

- Outlook desktop app shows inbox by default
- Click on email subject lines to open emails
- The reading pane shows email content on the right
- Use scroll to see more emails

## Keyboard Shortcuts

Some UI elements (like dropdowns and scrollbars) can be tricky to manipulate using mouse movements. Prefer keyboard shortcuts when available:
- **Tab/Shift+Tab** — Navigate between UI elements
- **Enter** — Activate focused element
- **Escape** — Close dialogs/menus
- **Ctrl+C/V/X** — Copy/paste/cut
- **Alt+Tab** — Switch windows

## Modifier Keys with Click/Scroll

You can hold modifier keys while clicking or scrolling by using the `text` parameter:
- `text: "shift"` — Shift+click for range selection
- `text: "ctrl"` — Ctrl+click for multi-select (Windows)
- `text: "super"` — Cmd/Win+click
