I ended up adding some PVA glue to the paint for the gems. This was to help it stick and add a shiny gloss to them.