Currently, Stack Exchange doesn't allow flagging of comments you've upvoted.
For most flag reasons (for example, spam), you shouldn't upvote them in the first place, but it's reasonable for an upvoted comment to be obsolete, which is one of the flag reasons.
I'd rather not use the "Flag question" option, because that may get the wrong comment deleted.