If this is what matters most for you, then your choice is probably TensorFlow. A network written in PyTorch is a Dynamic Computational Graph (DCG). It allows you to do any crazy thing you want to do.