Can someone tell if you have viewed their source code or have downloaded their website? If so, is there a way around this?

Not really. I would imagine it'd look the same in any log as viewing the code is what's already been downloaded to see the pages (like switching from visual to code view in an html editor).