GIT? SVN? WAMP? XAMP? MERCURIAL? BITNAMI?
There are so many options that I am getting a bit cunfused.
I just want to work without publishing and a need of an internet connection, and when all is ready, just release it
It's difficult to tell what is being asked here. This question is ambiguous, vague, incomplete, overly broad, or rhetorical and cannot be reasonably answered in its current form. For help clarifying this question so that it can be reopened, see the FAQ.
You can use the XAMP server, I am also using the same for the last 5 years. And also you can consider to use Microsoft Web Matrix as the editor because it provides wordpress syntax highlighting, suggestions etc.