State rep scolds Milford leaders for housing vote