You should be able to unless by law they are unable to care for them properly , such as them having legal issues or medical issues that may prevent them to otherwise.
The Grandparents would probably enjoy spending time with them, as long as they are capable of caring for them then it is fine and of course the kids are alright going too, if they have a tantrum its likely they will be a nuisance to their Grandparents.