Delay in headset removal causes adverse effects in userspace such as delay (loss) in audio/video routing. Delay was introduced to reject spurious switch events. These events are already rejected based on the headset status. CRs-Fixed: 321721 Change-Id: I34346a83cc673d7a7856ea1f43f858a5e040265d Signed-off-by: Anirudh Ghayal <aghayal@codeaurora.org>