I like a very shy man is 65 and I am 53. He has very low self esteem and he feels he not worthy.

There is no way of telling what this man is feeling, but from what you have mentioned, he seems like the type of person who does not like getting compliments for whatever reason. Sometimes, it can be because they don't want to have to feel indebted to a person who is nice, or sometimes, it might be because they just don't know how to properly react. I wouldn't take it personally, but you should be able to accept his reaction. I would say that he's just nervous, but that doesn't mean that you can't still try. There have been several scenarios I can think of when the man initially fled the woman, usually because he was shy. If it is really bothering you, the healthiest thing to do would be to talk to him and communicate. When you do this though, it might be easier if you reassure him that everything will be okay and that you will not judge him for how he reacts. In fact, I would go out of my way to make sure that he's comfortable talking to you honestly first. This might mean offering to look down so that he doesn't feel obligated to make eye contact, or even turning around so that he isn't faced with too much pressure.