Is it correct to say 'I have neither a telescope or binoculars' or should it be 'I don't have either a telescope or binoculars'

The pairs are "either/or" and "neither/nor:

'I have neither a telescope nor binoculars'

In your second example simply say 'I don't have a telescope or binoculars.'