Combine the water and sugar in a small pot. Bring to a simmer over medium heat, then stir in the rosemary sprigs. Remove from heat, cover and let the syrup steep for 15 minutes. Discard the sprigs, and transfer the syrup to a small jar. The syrup will last for about a month in the fridge.