I was on the fence before picking up my car but, now that I have it, I think it looks good with the badge. Maybe I'll de-badge later on, but I'm happy with the way it is
And to answer the OPs question, I haven't noticed 328i owners de-badging more often then 335i owners. I hardly ever see de-badged Bimmers, in general.