Look into 94-96 Impala's, Buick Roadmaster's, Cadillac DeVille's, Caprices, Olds Cutlass Classic's. The non-Cadillac's ride like them and they're reasonably priced and easily upgradable.
The Lexus IS300 has power potential and is also a comfortable car to drive.
90's model Altima's and Maxima's are so-so fast, but are decent dailies.
Non-turbo Lancer's and Impreza's aren't too expensive, and obviously have plenty of start-out potential.
If you're into tuners, look into Integra's and V-Tec Prelude's.
You're going to spend a premium on Benz and Beemer parts on all corners. My frienf owned a 318Ti and pulled the radio, which led to shutting the whole car down. His mom bought a head light for her CL and it cost around $300. They may look nice, but when the miles climb and the car gets old you need major funds to repair them.
*EDIT I saw your post about not wanting to mod, but I still stand by the cars I posted.