Skip to content
Aether Docs

Automation

Cleo’s automation system executes multi-step EHR workflows from natural language commands. Tell Cleo what you want to accomplish, and it handles the navigation, clicking, and form filling.

How It Works

Section titled “How It Works”

When you give a command like “Prescribe Lisinopril 10mg daily”, Cleo:

  1. Plans - Breaks your request into actionable steps
  2. Explores - Finds the right UI elements to interact with
  3. Executes - Performs actions (clicks, typing, form filling)
  4. Verifies - Confirms each action succeeded before proceeding

Example Commands

Section titled “Example Commands”
Section titled “Navigation”
"Open John Smith's chart"
"Navigate to the medications tab"
"Go to the patient's problem list"
"Open the lab results section"

Prescriptions & Orders

Section titled “Prescriptions & Orders”
"Prescribe Metformin 500mg twice daily"
"Order a CBC with differential"
"Add a new allergy for penicillin"
"Refill the patient's Lisinopril"

Data Entry

Section titled “Data Entry”
"Schedule a follow-up appointment for 2 weeks"
"Update the patient's phone number to 555-1234"
"Add diabetes type 2 to the problem list"

Data Extraction

Section titled “Data Extraction”
"What medications is this patient taking?"
"List all active problems"
"Show me the latest vital signs"

Tips for Best Results

Section titled “Tips for Best Results”

Be Specific

Section titled “Be Specific”
"Prescribe Lisinopril 10mg oral tablet, take 1 tablet by mouth daily"

Include Key Details

Section titled “Include Key Details”

For medications, include:

  • Drug name and strength
  • Route (oral, topical, etc.)
  • Frequency
  • Duration (if applicable)

For orders, include:

  • Specific test name
  • Priority (routine, stat)
  • Special instructions

One Task at a Time

Section titled “One Task at a Time”
  1. “Open patient John Smith’s chart”
  2. Wait for completion
  3. “Navigate to medications”
  4. Wait for completion
  5. “Prescribe Atorvastatin 20mg daily”

Provide Location Hints

Section titled “Provide Location Hints”

If you know where something is located:

"Click the 'Add Medication' button in the toolbar"
"Use the search box to find the patient"
"Select the 'Active' tab"

Form Filling

Section titled “Form Filling”

Cleo handles complex forms intelligently:

  1. Detects Forms - Recognizes when clicking opens a form or dialog
  2. Plans All Fields - Maps all required form fields at once
  3. Fills Sequentially - Completes fields in logical order
  4. Handles Dropdowns - Waits for dynamic content to load

Example: Prescribing Medication

Section titled “Example: Prescribing Medication”

Command: "Prescribe Amoxicillin 500mg three times daily for 10 days"

Cleo will:

  1. Click ”+ Add Medication” to open the prescription form
  2. Search for “Amoxicillin 500mg Capsule”
  3. Select the medication from results
  4. Set dose to “500mg”
  5. Select frequency “Three times daily”
  6. Set duration to “10 days”
  7. Click “Submit” or “Sign”

Troubleshooting

Section titled “Troubleshooting”

Possible causes:

  • Element is in a different section/tab
  • Element hasn’t loaded yet
  • Element requires scrolling

Solutions:

  • Navigate to the correct section first
  • Wait a moment and retry
  • Add a hint like “in the medications section”

Exploration Strategies

Section titled “Exploration Strategies”

When Cleo can’t find an element directly, it uses exploration strategies:

StrategyWhat It Does
Direct matchLooks for exact text/label matches
Check tabsExplores visible tabs
Check toolbarScans toolbar buttons
Check navigationLooks in navigation menus
Check menusOpens menus to find options
Expand sectionsOpens collapsed sections
Scroll viewportScrolls to find off-screen elements

Strategies are tried in order until Cleo finds what it needs.

Next Steps

Section titled “Next Steps”