Pajama bottoms might just be the most comfortable. However, it takes serious fashion skills to pull off wearing them in public -- without looking like you just rolled out of bed.
If your pajama pants are saggy, some type of tennis shoes looks better with them.