E Brake killing engine even with clutch held

Is it just me or should the engine keep rpm if holding the clutch while using e brake?

Ive been messing around with drifting and have noticed this, is it supposed to be like that?
Have i missed a setting somewhere?