It is relevant to develop an adequate control algorithm for quadrotors that guarantees a good compromise robustness/ performance. This compromise should be ensured with or without external disturbances. In this paper, we investigate and apply a revisited formulation of a reference model-based control strategy by introducing a boosting mechanism. This mechanism uses an Extended State-based Observer (ESO) to estimate the uncertainties and variety of disturbances. The estimation is continually updated and rejected from the main control loop. The reinforcement principle is inspired from the popular Active Disturbance Rejection Control (ADRC) technique in order to enhance the robustness ability of a nonlinear reference model-based control strategy (i.e. Interconnection and Damping Assignment-Passivity Based Control (IDA-PBC)). The obtained controller is augmented by an additional input, which is derived via sliding modes framework to handle the estimation errors and ensure asymptotic stability. This combination leads to promising results by improving the nominal control technique. The primary results are shown through numerical simulations and are confirmed, experimentally, with several scenarios.