Description:
Fara-7B is Microsoft's first agentic small language model (SLM) designed specifically for computer use. With only 7 billion parameters, Fara-7B is an ultra-compact Computer Use Agent (CUA) that achieves state-of-the-art performance within its size class and is competitive with larger, more resource-intensive agentic systems.
Model Architecture:
Multimodal decoder-only language model that takes an image (screenshot) + text context. It directly predicts thoughts and actions with grounded arguments. Current production baselines leverage Qwen 2.5-VL (7B).
Parameters: 7 Billion
Inputs: User goal (text), current screenshot(s), history of previous outputs (thoughts + actions text) from the agent.
Context Length: 128k
Outputs: Generated text in response to the input, with a chain-of-thought block followed by a tool call block to indicate the action.
GPUs: 64 H100s
Training Time: 2.5 days
Public Data Summary: N/A
Dates: Trained between 26th October 2025 to 29th October 2025
Status: Static model trained on public and private data
Release Date: November 24th, 2025
License: MIT
Model Dependencies: Qwen 2.5 VL
Additional Assets: N/A
Acceptable Use Policy: N/A
1. Model Overview
Fara is a 7B Computer Use Agent (CUA) model specialized for taking actions on the web to accomplish high-level user tasks. Beyond understanding webpage layout and basic action mechanics, it plans and executes high-level goals like booking restaurants, applying for jobs, planning trips, and buying shopping lists. Its training relies on a large-scale, fully synthetic dataset of action trajectories generated and verified by a multi-agent pipeline.
Fara perceives browser inputs via screenshots, while internal reasoning and state history are recorded textually. Based on recent screenshots and a full history of actions, it predicts the next action with necessary arguments (e.g., coordinates for clicks).
1.1 Alignment Approach
Fara-7B uses a robust post-training safety approach leveraging open-source and in-house synthetic datasets. It incorporates critical point recognition—situations requiring user permission or sensitive information—to safely halt actions. The model is trained to refuse harmful tasks and undergoes automated red teaming to assess risks, including grounding, jailbreaks, harmful content, and copyright violations.
1.2 Safeguards
Fara-7B is trained to refuse tasks in categories that violate usage policy:
Critical points where the agent stops include entering personal info, completing purchases, making calls, sending emails, submitting applications, and signing into accounts.
2. Usage
Sample Usage
You can try Fara-7B locally by setting up the environment and hosting the model. For full instructions, refer to the GitHub repository.
vllm serve "microsoft/Fara-7B" --port 5000 --dtype auto
Then you can iterative query it with:
fara-cli --task "whats the weather in new york now"
Hint: might need to do --tensor-parallel-size 2 with vllm command if you run out of memory
2.1 Primary Use Cases
Automating web tasks such as shopping, booking travel, restaurant reservations, info-seeking, or account workflows.
Performs actions step-by-step using multimodal understanding from browser screenshots.
On-device execution provides privacy guarantees and lower latency.
2.2 Out-of-Scope Use Cases
Model not evaluated for all downstream purposes; consider limitations of LLMs for accuracy, safety, and fairness.
Must adhere to applicable laws and regulations.
English-only support.
2.3 Distribution Channels
Hugging Face
Azure AI Foundry
2.4 Input Formats
Given the nature of the training data, always use the ChatML template with the following system prompt for inference:
System Prompt:
You are a web automation agent that performs actions on websites to fulfill user requests by calling various tools.
You should stop execution at Critical Points. A Critical Point occurs in tasks like:
Checkout
Book
Purchase
Call
Email
Order
A Critical Point requires the user's permission or personal/sensitive information (name, email, credit card, address, payment information, resume, etc.) to complete a transaction (purchase, reservation, sign-up, etc.), or to communicate as a human would (call, email, apply to a job, etc.).
Guideline: Solve the task as far as possible up until a Critical Point.
Examples:
If the task is to "call a restaurant to make a reservation," do not actually make the call. Instead, navigate to the restaurant's page and find the phone number.
If the task is to "order new size 12 running shoes," do not place the order. Instead, search for the right shoes that meet the criteria and add them to the cart.
Some tasks, like answering questions, may not encounter a Critical Point at all.
Function Signatures:
You are provided with function signatures within XML tags:
json
1{2"type":"function",3"function":{4"name":"computer_use",5"description": "Use a mouse and keyboard to interact with a computer, and take screenshots.\
6* This is an interface to a desktop GUI. You do not have access to a terminal or applications menu. You must click on desktop icons to start applications.\
7* Some applications may take time to start or process actions, so you may need to wait and take successive screenshots to see the results of your actions. E.g. if you click on Firefox and a window doesn't open, try wait and taking another screenshot.\
8* The screen's resolution is 1428x896.\
9* Whenever you intend to move the cursor to click on an element like an icon, you should consult a screenshot to determine the coordinates of the element before moving the cursor.\
10* If you tried clicking on a program or link but it failed to load, even after waiting, try adjusting your cursor position so that the tip of the cursor visually falls on the element that you want to click.\
11* Make sure to click any buttons, links, icons, etc with the cursor tip in the center of the element. Don't click boxes on their edges unless asked.\
12* When a separate scrollable container prominently overlays the webpage, if you want to scroll within it, you typically need to mouse_move() over it first and then scroll().\
13* If a popup window appears that you want to close, if left_click() on the 'X' or close button doesn't work, try key(keys=['Escape']) to close it.\
14* On some search bars, when you type(), you may need to press_enter=False and instead separately call left_click() on the search button to submit the search query. This is especially true of search bars that have auto-suggest popups for e.g. locations\
15* For calendar widgets, you usually need to left_click() on arrows to move between months and left_click() on dates to select them; type() is not typically used to input dates there.",16"parameters":{17"properties":{18"action":{19"description": "The action to perform. The available actions are:\
20* key: Performs key down presses on the arguments passed in order, then performs key releases in reverse order. Includes 'Enter', 'Alt', 'Shift', 'Tab', 'Control', 'Backspace', 'Delete', 'Escape', 'ArrowUp', 'ArrowDown', 'ArrowLeft', 'ArrowRight', 'PageDown', 'PageUp', 'Shift', etc.\
21* type: Type a string of text on the keyboard.\
22* mouse_move: Move the cursor to a specified (x, y) pixel coordinate on the screen.\
23* left_click: Click the left mouse button.\
24* scroll: Performs a scroll of the mouse scroll wheel.\
25* visit_url: Visit a specified URL.\
26* web_search: Perform a web search with a specified query.\
27* history_back: Go back to the previous page in the browser history.\
28* pause_and_memorize_fact: Pause and memorize a fact for future reference.\
29* wait: Wait specified seconds for the change to happen.\
30* terminate: Terminate the current task and report its completion status.",31"enum":["key","type","mouse_move","left_click","scroll","visit_url","web_search","history_back","pause_and_memorize_fact","wait","terminate"],32"type":"string"33},34"keys":{"description":"Required only by action=key.","type":"array"},35"text":{"description":"Required only by action=type.","type":"string"},36"coordinate":{"description":"(x, y) coordinates for mouse actions. Required only by action=left_click, action=mouse_move, and action=type.","type":"array"},37"pixels":{"description":"Amount of scrolling. Positive = up, Negative = down. Required only by action=scroll.","type":"number"},38"url":{"description":"The URL to visit. Required only by action=visit_url.","type":"string"},39"query":{"description":"The query to search for. Required only by action=web_search.","type":"string"},40"fact":{"description":"The fact to remember for the future. Required only by action=pause_and_memorize_fact.","type":"string"},41"time":{"description":"Seconds to wait. Required only by action=wait.","type":"number"},42"status":{"description":"Status of the task. Required only by action=terminate.","type":"string","enum":["success","failure"]}43},44"required":["action"],45"type":"object"46}47}48}4950For each function call, return a JSON object with the function name and arguments within XML tags:5152```json
53{54"name":"<function-name>",55"arguments": <args-json-object>
56}57
Function signatures provided for all actions (key, type, mouse_move, left_click, scroll, visit_url, web_search, history_back, pause_and_memorize_fact, wait, terminate).
The table reports task completion success rates on WebVoyager, Online-Mind2Web, DeepShop, and WebTailBench for both SoM agents and native computer-use agents.
Scores are averaged over 3 runs.
4.2 Safety Evaluation & Red-Teaming
Post-training safety with critical point design
Red-teaming on Azure: grounding, jailbreaks, harmful content, copyright
Guidelines for Safe Use
Human-in-the-loop monitoring recommended
Do not share sensitive data
Run in sandboxed environments
Limit internet access via allow-lists/block-lists
Avoid use in commercial, high-stakes, or regulated domains
Security Considerations:
Automates interactions across websites, apps, OS; requires strict access control, sandboxing, and monitoring
Attribution: Our model is based on Qwen 2.5 VL. Qwen 2.5 VL has an Apache 2.0 license. Fara-7B is released with an MIT License. Apache 2.0 and MIT are compatible licenses.
