ASoC: tegra: fix avp module remove

ASoC: tegra: fix avp module remove

- avp module remove should not try to release client
  if avp pcm open was never called and client was
  never allocated

- avp module remove should deregister offload ops

Bug 200043253

Change-Id: I11a6d65afab4d88aa5669553809e99fd69cfd000
Signed-off-by: Shreshtha SAHU <ssahu@nvidia.com>
Reviewed-on: http://git-master/r/554153
Reviewed-by: Sumit Bhattacharya <sumitb@nvidia.com>
Reviewed-by: Zheng Liu <zhliu@nvidia.com>
Reviewed-by: Winnie Hsu <whsu@nvidia.com>
(cherry picked from commit 999d45effe06a69f28d87c8517b94a109cffbb45)
Reviewed-on: http://git-master/r/554528
Reviewed-by: Automatic_Commit_Validation_User
Reviewed-by: Bharat Nihalani <bnihalani@nvidia.com>