Also, I don't feel relaxed enough that if a real emergency hits, I'd be able to handle it perfectly.
Perhaps you should set aside some time during your flying time to practise some emergency procedures - for example, tomorrow I will be flying and have scheduled for myself an emergency landing from 2000' agl onto the runway without power (if the airfield isn't too busy).
What I also find helpful is repeating your emergency action list to yourself whilst (e.g.) in the car - it makes your passenger safety briefing seem more competent if you go through the procedures without any "ummm.... and then I'll.... ahhh..... oh yes, I remember, next is: stop the engine by pulling the mixture".
Repeating the check lists (and moving your hand to the area where the action will take place) will help you memorise the actions, should you have to cope with a true emergency....
For me, I found it very rewarding to do some flying with other non-instructor pilots as well as solo trips.
Can only agree with this - firstly because you can each observe the other and discuss the flight / peculiarities afterwards but also because you get to spend more time in the air for less cost