Yogurt is a cultured dairy product that is supposed to taste sour or tart. A sour taste in yogurt is different from the sour taste in milk when it begins to go off. There are other indicators that will let you know if your yogurt has gone bad or whether it is still good to eat.