My marathon was run in weather that was 38 F at the start, 40's at the finish. A singlet, shorts, hat and "magic mittens" (the $1.99 type) worked fine.
My "rule of thumb" is that if I am not chilly (somewhat uncomfortable) at the start, then I am overdressed.