That's a very good question. I take portrait photos of people everyday, however I usually have a brief; I've spoken to the person in advance; and I know how they want look and the way they want to use their photos.
With street photography you're photographing a stranger
and often without interacting with them. And as long as you're in a public place, it's quite legal to do this.
Although I'll be honest, it did initially seem strange
photographing strangers without their permission.
But I was quickly hooked and could
divide people into three distinct categories.