GR3AS3M0NK3Y

So, I have a 1982 Subaru GL that I am currently doing a restore on. One of the things I want to change, and trust me there is a long list, is exhaust. My plan is to keep the cat in place but rebuild cat back removing the muffler. I was curious if this is a decent idea and if so, what diameter pipe would I experience the best gain with?