When you delete a file normally, the data stays on the disk — the filesystem just marks the space as available. The data can be recovered with the right tools. If you need to make sure it is really gone, you can overwrite it securely.
shred -vzf -n 5 /dev/sdb
The -v flag shows progress, -z adds a f[……]