Babies spend so much time teething, so it's best for those special little teeth to use other frozen sugar-free options.  Sometimes they like frozen bagels to gum on, or any of those teether rings that can be put in the freezer. Another idea is a frozen wet washcloth.  If the icepop idea appeals to you, you could even freeze plain water and offer that.  Be cautiousl about presenting it on a stick, which can be hazardous - it would be better to make it more of a squeeze pop, perhaps using the bottom quarter of a sandwich-size zip lock bag. Healthier, and much less sticky, too!