They certainly seem to be hostile towards me, the dogs and the wife(...er...should that be the wife, the dogs, and me.) We had a nest in an olive tree last year and they were hell to dislodge. 1 can of useless wasp killer spray, 1 litre of benzina, 1 close look, and finally 1 stone firmly wedged into the entrance with a hammer sorted them out.
That said, they allegedly fertilize fig trees, and we have very few figs this year. Maybe running around screaming every evening is just the price you have to pay for a decent homegrown fig nowadays...
