You can get an external caddy for SATA drives that is hot swappable (no need to turn your machine off), for IDE (PATA) you might want to.
It sits on your desk and you "drop" the drives into it, turn it on and it shows up on your PC as a new drive.
Price for that is around the £40 for one that isn't going to fail after a few weeks.
If you want to do everything then an external housing for a 3.5" drive will comfortably take your normal 3.5" drives, laptop drives will connect to it (SATA ones, you'd need an extra adapter for laptop IDE) but they will be loose inside so don't move it around.
Price for something like that is around the £20 mark.