Why are butterflies scared of humans but caterpillars will walk on your hands like its nothing?

i would say that catterpillares are scared of you heaps, but they cant get away as fast, while butterflies can fly really fast, so i guess carterpillers are just too helpless and slow to get away.