I am working as Sr. SEO and in my office there is a dispute over robots.txt and meta robot can anyone tell me which one is better and why?