Roadmap
Omnibot Product Roadmap
Last updated: 2026-07-07
This document is the current product-status source of truth. Historical implementation plans in docs/superpowers/plans/ remain useful for design intent and task history, but their unchecked boxes may not reflect the current codebase.
For a reader-friendly overview of the current product, see Product Overview.
Product Direction
Omnibot focuses on letting AI agents read, inspect, debug, and operate the user’s real Chromium browser: real tabs, real login state, real extension environment, and explicit tab targeting through a local daemon plus CLI.
Near-term product priorities:
- Keep the local real-browser workflow stable and explicit.
- Make common browser automation tasks possible without raw JavaScript.
- Provide clear fallback tiers when semantic or ref-based operations fail.
- Preserve agent-friendly stdout while keeping diagnostics on stderr.
- Package skills and docs so agents can reliably discover the correct workflow.
Status Legend
- Done: implemented in CLI/action/daemon surface and covered by unit or E2E contracts.
- Partial: command surface exists, but production behavior has known limits or only a foundational path is implemented.
- Experimental: available for targeted testing, not yet a default production workflow.
- Planned: not implemented or only represented by design notes.
Done
Runtime And Distribution
- Local daemon and CLI v2 runtime:
omnibot doctor,status,start,stop,run, daemon auto-start, and local ports18764/18765. - Browser extension transport: WebSocket primary path, HTTP long-poll fallback, tab/session tracking, extension reconnect behavior, and tab update broadcasting.
- npm packaging: platform packages, CLI package, packaged skills path/install commands, and version checks.
- License lifecycle: license status, local persisted activation state, usage count, and extension status push/refresh.
- Explicit tab targeting: page-state commands require
--tab-id; no implicit default target for browser state changes.
Reading And Page Understanding
read: clean rendered page reading with--screens, URL temporary-tab mode, tab-targeted mode, and JSON/text output.snapshot: accessibility tree snapshot,@eNrefs, interactive filtering, compact/depth/url options, selector scoping, rich text editor controls, popup/modal controls, and combobox option probing.get: title, URL, text, HTML, value, attribute, count, box, and style reads.is: visible, enabled, and checked state checks.find: semantic locators for role, text, label, placeholder, alt, title, testid, and nth, with subactions such as click, fill, type, hover, focus, check, uncheck, and text.
User-Like Browser Operations
- Ref/selector operations:
click,dblclick,fill,type,press,hover,focus,select,check,uncheck,scroll,scrollintoview, and element-leveldrag. - Upload: CDP
DOM.setFileInputFiles, DOM nodeId fallback, and JSDataTransferfallback are implemented and unit-covered. - Navigation and tab lifecycle:
navigate,open,goto,close,tab list/new/close,window new,frame,back,forward,reload, andpushstate. - Wait and batch: selector/text/URL/load/function/fixed-time waits, hidden/visible state, and JSON/file batch commands.
Debugging And Evidence
- Screenshots: normal/full/annotated screenshots, PNG/JPEG options, base64/file output paths.
- Console: logs, errors command path, and clear.
- Dialogs: JavaScript dialog logs, clear, accept/dismiss, and prompt text handling.
- Network: extension-backed capture start/stop/clear/logs/summary.
- Raw CDP:
cdp <method> <params-json>for last-resort inspection.
Fallback And Advanced Operation Surfaces
- CUA coordinate mouse:
mouse click,mouse move,mouse scroll, andmouse dragcommand surface backed by CDP input events. - DomCUA:
dom visible,dom click,dom dblclick, anddom scrollfor visible DOM node-id fallback workflows. - Clipboard:
clipboard readandclipboard writethrough page context. - Viewport:
viewport getandviewport setvia page state/CDP emulation. - Assets:
assets listandassets export; export writes asset metadata into a zip when an output path is provided. - Browser/session metadata:
browser list/current/claim/release,session name/list. - Site-skill exploration:
explore run/list/show/promotefoundation for generated site skills and operation memory.
Partial Or Experimental
Human Verification
verify inspectdetects and extracts metadata for NetEase Yidun captcha widgets.- It does not solve captchas, does not provide a production-grade bypass workflow, and requires visual cross-checking for state and coordinate mapping.
Mouse Drag Realism
mouse drag --fastis the stable linear path.- The default realistic drag trajectory is available but experimental; timing, jitter, and success rates still need production validation.
Console And Network Capture Completeness
- Console and network command surfaces exist and have extension-backed capture paths.
console errorscurrently shares the console log collection path; callers should verify level filtering in output.- Network and dialog capture require a current browser extension; older extensions return explicit upgrade/reload errors.
Record, Replay, And Trace
record start/stop,replay, andtrace start/stopare exposed and have basic payload/file shapes.- Automatic capture of every CLI action into
recorded_actions/trace_eventsis not yet wired as a complete product workflow. - Replay supports a limited action set and should be treated as a foundation, not stable browser-flow automation.
Visibility Modes
visibility statusandvisibility setmodel visible, background, dedicated-profile, and headless modes.visibility launchcurrently returnsstatus: plannedfor dedicated/headless launch; it does not yet spawn or attach a separate browser profile.
Assets Export
assets list/exportcollect resource metadata from the page.- Full offline page mirroring, binary asset download, and HAR-quality archive export are not implemented.
Planned Or Not Implemented
Automation Parity Gaps
- Full Playwright-compatible locator/action parity beyond the current semantic locator subset.
- Complete DomCUA node lifecycle with stable IDs across DOM mutations and frames.
- Full CUA policy layer, confirmation workflow, and action safety policy.
- Robust cross-origin iframe introspection beyond current best-effort behavior.
Browser Capability Gaps
- Dedicated automation browser launch and attach flow for
visibility launch. - Headless Chromium mode with extension compatibility guarantees.
- Download management, PDF export, full page archive, and full HAR export.
- Persistent cookie/storage/state vault and auth profile management.
- Full clipboard/filesystem workflows beyond current text clipboard and file upload support.
Debugging And Observability Gaps
- Trace viewer/dashboard.
- Record/replay as a durable no-code macro workflow.
- Profiler, Web Vitals, React/Vue component introspection, and performance timelines.
- Streaming event feed for long-running operations.
Product And Platform Gaps
- Remote multi-user daemon as a supported product mode.
- Cloud browser providers, Lightpanda, iOS/Appium, and mobile automation.
- Team dashboard, policy administration, billing/payment integration, and hosted account management.
- AI-assisted captcha solving. Current scope is inspection only.
Suggested Next Milestones
M1: Stabilize Current Local Browser Surface
- Keep
snapshot+click/fill/type/waitas the primary happy path. - Expand E2E coverage for real browser workflows, especially popup controls, rich text editors, upload, network/dialog capture, and explicit tab targeting.
- Make command reference and skills match the actual CLI command surface on every release.
M2: Finish Recording And Trace Workflow
- Wire action dispatch to append record and trace events consistently.
- Define a stable replay schema and support more actions.
- Add trace export validation and a minimal human-readable trace report.
M3: Dedicated Profile And Visibility Launch
- Implement actual browser launch for dedicated-profile mode.
- Document login-state limitations and extension loading requirements.
- Decide whether headless mode remains experimental or becomes a supported non-user-browser mode.
M4: Observability And Archive Depth
- Improve console/network filtering and retention.
- Add richer asset export and HAR-style summaries.
- Evaluate whether trace viewer/dashboard belongs in CLI-only form or a separate UI.
M5: Platform Expansion
- Revisit remote daemon, hosted/team workflows, policy controls, and cloud browser providers only after local real-browser automation remains stable across release gates.