Digital audio files: formats, structures, time stamps, etc.

I have to confess that my knowledge of digital audio formats and the structure of various files is, at best, spotty. I'm going to have to swap files with people adding tracks to some base tracks I am recording, and I'd like to, uhh, actually know what I am doing. Can someone direct me to a reliable book, website, etc. where I can learn the details.