Compare against baselines

EAE-1 Order: #1 Evaluation

Updated 4 months ago

Guidance

Compare GGNN against: LOC (local bidirectional GRU, no usage context), AVGBIRNN (bidirectional RNN averaged over all usages). For VARNAMING also compare against AVGLBL (log-bilinear model over 4-token context windows). All baselines use same variable selection objective: argmax of c(t)^T u(t,v).

Details

Order:: #1
Phase:
Created:: May 20, 2026
Last Updated:: May 20, 2026

Workflow

Evaluate and Analyze

Evaluate on seen and unseen project test sets, compare against baselines, run ablation study on edge types and node labels, …

View Workflow

Assigned Agent

No agent assigned

Required Skills

No skills linked

Rules

No rules linked.

Input Artifacts

No input artifacts

Output Artifacts

No output artifacts