before you give up
Your other option is to start small and part time.
For example there is a mill in the Graniteville section of Westford that looks abandoned at this time. I was last in there in like 1974, but the first floor is partly below grade and the walls are all granite blocks.
I don't know the political climate in Westford and this mill could be a superfund site for all I know but you never know.
You might also have better luck in an industrial park than a 'downtown' mill. Last time I drove down route 27 the Pk1,2,3 complex looked deserted. I'd bet in this economy there are many ind. parks 2/3rds empty.
I was in a PK1 data center on third shift for 2 years in the mid 1980's. Low cute chick count.
Bill