What you describe may be a dream with symbolic relevance in your life or it may be a confusional arousal... or a bit of both. If the setting of your dream was the bedroom or the darkness, it is more likely to have been a confusional arousal. Here's a link to a page on this website that will tell you more about confusional arousals and how to make them stop:
dreamdoctor.com/sleep-disorder/walking-t...8ed64ba7f78bbbec0416
If it was not a confusional arousal, the man in your dream is probably symbolic of someone you know in waking life. Based on your dream, he would be someone you may believe to be a bit "out there"... who is lovingly trying to coax you to be open in a way that makes you not only uncomfortable, but scared. Feelings in dreams are never disguised, so how you feel IN your dream is how you feel about its subject in your waking life. Knowing that, you are in a much better position to make good decisions in your waking life... like not being enticed to do something that feels wrong.
Hope that helps.