Gervais is right; "antogonize" is of course a verb, the infinitive form.
In the above example, the function of the infinitival clause "to antagonize (me)" is that of adjunct of purpose - it gives the purpose of his altering words. Some people use the term adverbial instead of adjunct, so I just wondered if that's what you meant.