You should have exchanged numbers. Anyways give him a call at work to say hi, and ask him if he would like to join you for lunch..
Well I tried you guys. I had the conversation and he said he only likes having sex with me. So I tearfully ended things. I guess I did read the vibes completely wrong. *tears*. I told him to have a nice life and that I hope everything works out for him..