There are also differences with the number of systems you have to manage.
On a Baron you have a fuel powered heater that can burn if you forget to properly feed it with enough air. You also have boots deicing that you need to use at a specific time in order for it to work.
You also have much more power, so this brings both advantages (you can easily climb n-1) but also disadvantages (you can more easily exceed vne)..
This kind of dangers make the baron a bit more worrying that a diamond aircraft.