1. I was being annoyed by his conduct.

2. I was annoyed by his conduct.

3. I was annoyed at his conduct.

4. I had been annoyed on his conduct.