I am considering the same question and asked some of my driving instructors at the last HPDE I attended. They all say the S4 is a great car but you're not as connected to the road as you are in the 335.
Disclaimer: I haven't test-driven an S4 so I can't give an opinion and oh yeah they are all BMW drivers so perhaps not unbiased...