I'm white player and I draw a desert card.

I place my three settlements there:

Now I use my special ability to move any settlement to a desert field:

I choose the settlement on the right:

Now my question is: Can I place this settlement on a different desert terrain OR do I have to place it on the same place where I took it from?
I haven't built on (or next to) any other desert fields yet. So the only adjacent desert field would be that one.