Am I being stalked without knowing?

If what you are saying isn't some kind of troll, I would contact the police. I've never experienced anything even remotely similar to this in almost 20 years of living in Japan.