SYSTEMS & AUTOMATION
Jarvis Jr — Multimodal Desktop Assistant
Local Python desktop assistant runtime with validated tool execution, voice routing, and recovery journaling.
Problem:
General desktop assistant wrappers lack path validation boundaries, local tool verification, and offline math calculation.
Approach:
Built an intent router and tool dispatcher with canonical filesystem path boundary validation, SymPy symbolic math solving, and wake-word voice handling.
Result:
Runs locally offline across Fedora Linux and Windows with local GPU and VRAM monitoring; validated across 360+ automated test cases covering semantic intent routing, path boundary validation, and transactional recovery journaling (tests/).
Python · Pydantic · SymPy · openWakeWord · OpenCV · PyAutoGUI
+ Architecture Pipeline Deep Dive
01
Semantic Intent Classification (core/router.py)
Routes incoming spoken and text inputs into application commands, calculations, or local queries without sending voice data to cloud providers.
02
Security & Boundary Validation (security/permission_engine.py)
Enforces canonical path resolution, symlink boundary checks, and permission gating prior to file read/write or application launch commands.
03
Action Journaling & Retry (recovery/engine.py)
Maintains transactional execution logs, rolling back transient state changes and retrying failed commands up to configurable limits.