Pay off small purchases on your credit card quickly It can seem daunting at first to start building credit with no credit history, but it can be done with a few simple steps.