Can I refuse to travel to America with work? As I don't agree with the current polical climate?

You can, but you probably don't have any legal recourse if your employer decides to fire you for it. I don't blame you for feeling that way, but I doubt many organizations or companies would be that amenable to the idea.