Do you use the octave key for every note above the (middle) D (on saxophone)?
Yes. For middle D and everything above it, you use the octave key.
The octave key helps all those notes play more easily. It has to do with the positioning of the holes on the horn connected to the octave key and the acoustics of how the saxophone works.