A program (binary, or executable) is a file on disk somewhere, in a recognized format. Common formats include ELF on Linux, ...

But now with platforms like the Raspberry Pi becoming very common, Linux shell scripts can be a big part of a system–even the whole system, in some cases.