For three and a half minutes you should get enough gems from the board. Rearrange them to build a series of three or more identical gems and then you can pick them up and fill the scale on the right side.