Can you grow a baby chicken with grocery store eggs?

No, those are unfertilized eggs in the store.

Chickens lay eggs every day usually. They are unfertilized eggs. They need a rooster for that and there are none on egg farms.

When there is a rooster to mate with the chicken, that's when fertilization happens and the eggs they lay will have baby chicks.