However from the books and tutorials that I've been using I haven't come across a strategy or rule of thumb for when I should be using pointers and references and when I should not.

US government agencies speak out about memory-unsafe languages C/C++ are a “risk to national security,” the economy, public health and safety Developers working with critical infrastructure ...