/01
Conversational Agent Evaluation
Prof. Zhou Yu's lab · Columbia
Research on how to evaluate production conversational LLM agents: what goes wrong in real dialogues, which failures matter most, and how to close the loop without new live traffic.
Working across turn-level analysis, ranking of failure patterns, and user simulation on real customer-service conversations.
Details stay under wraps until publication.
LLM EvalNLPUser SimulationResearch
/02
Nightwatch · Multi-Agent Personal AI
24/7 agent infrastructure on macOS
Long-lived multi-agent daemon: PID locking, signal handling, launchd batch jobs, structured incident logs, shell-level command interception.
5-layer memory (SQLite FTS5 + ChromaDB): sub-100ms recall at 100K+ entries with daily GC and graceful degradation.
3-layer rate limiting + circuit breakers keep misbehaving agents inside API quota.
Multi-AgentSQLite FTS5ChromaDBReliability
/03
RCRI · Climbing Route ID & Beta Solver
Real-time CV on the edge
Three-stage YOLOv8 pipeline (hold detection, 5-class type, volumes): mAP50 0.825 on hold detection.
Exported to ONNX, quantized to TensorRT FP16 on Jetson Nano: 12 FPS single-stage, 5 FPS full pipeline at 5W.
A* beta solver with scale-invariant reach recommends optimal move sequences via a Flask MJPEG WebUI.
YOLOv8TensorRTJetsonA* Search
/04
Helm · LLM-Orchestrated Quant System
Agent as decision orchestrator
LLM agent orchestrates macro analysis, multi-factor scoring, RL portfolio optimization, and news, behind a schema + risk + anomaly validation layer.
Multi-model routing picks vendor and model size per task: under $15/month for weekly rebalancing over a 100-stock universe.
Every decision recorded as a structured audit log for offline post-mortems and prompt/policy refinement.
LLM RoutingRLMulti-factorAudit Trail
/05
Distributed Lock Service, TLA+-Verified
Formal methods meet systems
Lease-based distributed lock with fault-tolerant renewal across crash and message-loss failure models.
TLA+ spec model-checked with fault injection: mutual exclusion, lease validity, and monotonicity invariants proven.
Property-tested the Python implementation with Crosshair, surfacing race conditions in lease handoff.
TLA+Distributed SystemsProperty Testing
/06
Pinyin Communication Badge for ASD Children
Assistive AI on a Raspberry Pi
Real-time multimodal pipeline: Pinyin parsing, error correction, ranking, and speech/image feedback under <1s end-to-end latency.
Trie retrieval + probabilistic correction + LLM fallback rerank reach >95% accuracy on noisy input.
Async LLM calls with non-blocking UI and fallbacks on resource-constrained hardware.
Edge AIMultimodalRaspberry PiAccessibility
/07
Desk Companions · 3D Desktop Pets for macOS
Native Swift shell + three.js, image to rigged 3D
Anime characters living on the desktop: image to 3D mesh (Hunyuan3D), auto-rigged, walk cycles and spell animations rendered with three.js + three-vrm inside a transparent, always-on-top WKWebView.
They actually do things: calendar reminders via EventKit, a drag-and-drop "magic shelf" for files, clipboard capture, screen snipping, and face-based photo sorting from the right-click menu.
Five characters shipped as standalone .app bundles with a one-script build; 2D sprite-sheet and 3D variants share the same Swift host.
Swift / AppKitthree.jsHunyuan3DRigging
/08
Atlas of Wonders · Interactive Travel Map
Hand-built d3-geo atlas, one self-contained HTML file
My U.S. trips as a magical interactive map: per-trip diaries, hand-drawn route animation, and venue markers reconstructed by running OCR over my own photos.
Build pipeline turns raw GPS, photos, and notes into a single static page; a public build strips every personal photo so the shareable version carries zero private data.
Zero frameworks at runtime, works offline, renders on a phone.
d3-geoVision OCRData PipelineVanilla JS