Initiate the movement by retracting your shoulder blades (pinning your shoulder blades back), the muscles in the upper back should be the main focus and not just the pulling of the arm
Pull the band till your elbow is as far back as it can get and your shoulder blades are fully retracted