You got it in one! You basically pay per SMS to whatever network provider you use.
If you're planning on sending larger volumes of SMS over a fixed period, it may be worth checking out which local operators offer cheap text bundles to keep the cost down.
If you're in the US you'll also pay to receive SMS (for some crazy reason).