Run ablation study

EAE-1 Order: #1 Evaluation

Updated 4 months ago

Guidance

Systematically vary: (1) edge types used — syntax only, semantic only, combined; (2) node label representation — subtokens vs full tokens vs disabled. Measure impact on both VARNAMING and VARMISUSE accuracy to attribute performance gains to specific design choices.

Details

Order:: #1
Phase:
Created:: May 20, 2026
Last Updated:: May 20, 2026

Workflow

Evaluate and Analyze

Evaluate on seen and unseen project test sets, compare against baselines, run ablation study on edge types and node labels, …

View Workflow

Assigned Agent

No agent assigned

Required Skills

No skills linked

Rules

No rules linked.

Input Artifacts

No input artifacts

Output Artifacts

No output artifacts