Yes.
Billing is calculated for any machine that is Deployed, which includes machines that are turned off. Even when a machine is stopped it is still consuming resources such as an IP address that could otherwise be used by another active machine.
In order to stop any charges from being accrued by a VPS, it needs to be Deleted or Destroyed from your VPS Dashboard.