HKU's CLI-Anything Turns Any Software into AI-Friendly Tools with One Command

HKU Team Revolutionizes AI-Software Integration

Imagine telling an AI to edit a photo in GIMP or render a 3D model in Blender without worrying about the interface crashing. That future just got closer thanks to CLI-Anything, a groundbreaking open-source project from the University of Hong Kong's Data Intelligence Lab.

The Problem with Current Approaches

For developers working with AI agents, integrating professional software has been a persistent headache. Traditional UI automation solutions are notoriously fragile - one minor update can break everything. Meanwhile, writing custom integration scripts consumes valuable time that could be spent on actual innovation.

"We kept hearing the same frustrations from developers," explains the HKU team behind the project. "They wanted to leverage powerful tools like Blender or LibreOffice through AI, but the existing methods were either unreliable or required too much manual work."

How CLI-Anything Works Its Magic

The solution is surprisingly elegant. CLI-Anything automatically analyzes software source code and generates:

• Structured command-line interfaces that AI can understand and chain together
• JSON output support for easy parsing by machine learning models
• Self-documenting commands with standard --help functionality
• Interactive REPL mode for testing and debugging
• Rock-solid reliability backed by over 1,500 tests

What makes this different from traditional automation? Instead of simulating mouse clicks and keyboard inputs (the approach used by most RPA tools), CLI-Anything taps directly into the software's core functionality. This means no more worrying about window positions changing or buttons moving in an update.

Growing List of Supported Applications

The team has already adapted 13 major software packages including:

• Creative tools: GIMP, Blender, Inkscape, Audacity
• Productivity apps: LibreOffice, Draw.io, Mermaid
• Video software: OBS Studio, Kdenlive, Shotcut
• AI utilities: ComfyUI for image generation

The roadmap includes expanding into CAD design tools, digital audio workstations (DAWs), and scientific computing applications. Community contributions for additional software integrations are actively encouraged.

Easy Setup for Developers

The installation process couldn't be simpler:

/plugin marketplace add HKUDS/CLI-Anything
/plugin install cli-anything
/cli-anything 

The tool works seamlessly with popular agent frameworks like OpenClaw and OpenCode while running entirely locally - no cloud dependencies or complicated configurations required.

Why This Matters for AI Development

The enthusiastic response from developers (over 17,000 GitHub stars already) speaks volumes. CLI-Anything isn't just another utility - it's foundational infrastructure for the emerging world where AI agents routinely interact with professional software. Early adopters are already automating complex workflows like batch image processing in GIMP or generating 3D model renders through simple text commands to their AI assistants.

The project represents a significant step toward what many see as inevitable: a future where we increasingly delegate software operation to intelligent agents rather than wrestling with interfaces ourselves. Project Address: https://github.com/HKUDS/CLI-Anything