Can I use shredded paper from my office for bottom of my guinia pig cage?

That should work just fine. Just remember that it is thinner than the packaged hay they sell for rodent cages, so you'll need to make sure you remember to use a lot at a time:)