AutoTask
AI brain that knows everything you're doing on your laptop, and auto completes your routine tasks.
Overview
AutoTask analyzes your daily computer activity and offers to automate repetitive tasks using AI agents.
Are there tasks that you know you need to do but dread having to do them? Applying for jobs, shopping for groceries, paying your bills, travel arrangements, booking appointments, organizing your digital photos, etc.
What if AI could take over some of those tasks, and do them on your behalf? That's where AutoTask comes in - it watches what you're doing throughout the day, sees which tasks you're repeatedly doing, and comes up with a plan for automating those tasks.
Interface
Technical Implementation
AutoTask is comprised of 3 key components:
Screenpipe
For capturing screen activity and OCRing it. We've built a custom pipe called tasks-auto-complete that captures the OCR output from Screenpipe, passes it to OpenAI which then returns suggestions on how to automate the activity.
Electron App
The Electron app listens for tasks suggested by the tasks-auto-complete pipe and displays them in the dashboard. It's the "glue code" that takes the tasks from the pipe and passes them along to browser use for execution.
Browser Use
For using AI to execute tasks in the browser. Browser use has a whole library of tasks that it can automate including grocery shopping!
Future Improvements
- Extend beyond browser tasks using macOS use
- Add settings screen for storing commonly used information
- Utilize Screenpipe's microphone capabilities
- Implement detailed plan viewing
- Leverage SQLite database for trend analysis