Annamalai Swami: Stop identifying with it. If you can convince yourself "This "little self" is not me", it will just disappear.
Question: But how to do this?
Annamalai Swami: The "little self" is something which only appears to be real. If you understand that it has no real existence it will disappear, leaving behind it the experience of the real and only Self. Understand that it has no real existence and it will stop troubling you.
Consciousness is universal. There is no limitation or "little self" in it. It is only when we identify with and limit ourselves to the body and the mind that this false self is born. If, through enquiry, you go to the Source of this "little self", you find that it dissolves into nothingness.