Sort:  

No.
Only your invested SP goes towards the witness vote. The person that delegated to you will keep the right to vote for witness of their choice.