I can tell you from experience: as non EU citizen you can only live and work in the country your EU spouse is residing, in this case Germany. With your german resident permit you can VISIT other EU countries for a maximum of 3 months. If, say, your EU spouse tomorrow was to move to spain, in order for you to reside there you would have to apply for a new residence permit in spain and your spouse would have to demonstrate that she resides there officially and that she has a job there and enough funds for the both of you.
As you can see hardly a non restricted right is it?
Anyways, this is all academic because as we all know there are no jobs in Germany or Europe for that matter. ME will be a much more likely bet.