2024-11-10: We added a new difficulty mode for Windows Agent Arena! You can try the new harder difficulty mode by changing the default diff_lvl="normal" to diff_lvl="hard" in src/win …

To address these challenges, we introduce the WindowsAgentArena (WAA): a reproducible, general environment focusing exclusively on the Windows operating system (OS) where …

In this work, we introduce WindowsAgentArena —a benchmark suite which builds upon the OSWorld framework with the goal of advancing the rigorous development and testing of multi …

Windows Agent Arena is a benchmarking environment to evaluate agent performance on Windows, comes with 150+ agent tasks, and allows parallelized evaluation in Azure. What is a …

Follow the official WindowsAgentArena README to complete the initial setup. Key aspects to understand: The chain starts the Proxmox VM, initializes Docker containers, and begins agent …

2024-11-10: We added a new difficulty mode for Windows Agent Arena! You can try the new harder difficulty mode by changing the default diff_lvl="normal" to diff_lvl="hard" in src/win …

Jan 20, 2025 · Windows Agent Arena is your go-to platform for seamless management of Windows agents, ensuring performance, security, and efficiency.

Jan 14, 2023 · With the setup complete, you now have the tools to conduct meaningful AI agent testing on the Windows operating system. This powerful platform streamlines research and …

Windows Agent Arena (WAA) is a benchmark suite designed to evaluate the performance of AI agents in executing real-world tasks on Windows operating systems. It consists of 154 tasks …

WAA utilizes Docker to create a consistent Windows 11 VM environment. Agents interact with the OS through a Python server within the VM, executing commands and receiving screen state …