Do I own the code?

A one-time build is deployed on your server and the code is handed to you. You own the version that was built.

What that does not include is future development. Anything built after handover is a new piece of work, unless you are on the subscription instead.