There is no way to get the gems back once you have put them in your Treasure Hall, so you cannot use them for any purpose. However, you will keep their rating forever, and no one can take their rating away from you.