Skip to content

Conversation

@dharam1291
Copy link

@dharam1291 dharam1291 commented Apr 8, 2025

Description

Added REST API support using FastAPI to enable browser automation via API calls. This allows integration with an external UI, as I prefer not to use the built-in Streamlit interface.

Quickstart

  • Computer Use Demo
  • Customer Support Agent
  • Financial Data Analyst
  • N/A

Type of Change

  • Bug fix
  • New feature
  • Documentation update
  • Code refactoring
  • Other (please describe):

Testing

  • Added/updated unit tests
  • Tested manually
  • Verified in development environment

Screenshots

Additional Notes

Tested using curl request:
curl -s -X POST http://localhost:8888/chat
-H "Content-Type: application/json"
-d '{"user_message":
"Open https://en.wikipedia.org/wiki/Ada_Lovelace and tell me the first sentence of the article."
}' | jq
{
"session_id": "91a0232a2e71472ca539b10f74c28603",
"assistant_message": "I'll help you access the Wikipedia page about Ada Lovelace and read the first sentence. Let me do this step by step:\n\n1. First, let me take a screenshot to see the current state of the desktop\n2. Then open Firefox and navigate to the page\n3. Take another screenshot to read the contentNow I'll click on Firefox and navigate to the Wikipedia page:Now I'll click on the address bar and enter the Wikipedia URL:The first sentence of the Ada Lovelace Wikipedia article reads:\n\n"Augusta Ada King, Countess of Lovelace (née Byron; 10 December 1815 – 27 November 1852), also known as Ada Lovelace, was an English mathematician and writer chiefly known for her work on Charles Babbage's proposed mechanical general-purpose computer, the Analytical Engine.""
}

@dharam1291
Copy link
Author

Below are the screenshots
Screenshot 2025-04-08 at 3 57 15 PM
Screenshot 2025-04-08 at 3 59 40 PM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant