For standalone application on your place i would better use:
WPF - as application platform, i could say Windows.Forms, but personaly i'm like WPF functionality(when you can change everything in your window, and make really cute interface with almost no time), you can get into WPF here ->
http://msdn.microsoft.com/en-us/library/ms742119.aspx and here ->
http://channel9.msdn.com/Wiki/WPF/LearningWPF/ (actualy any "WPF Starter Guide" google\bing search will give you nice tutorials.
For data storing you can use eather MS Access database or XML file (you can write nice coverage on this with creating own file format like zip it and encrypt it)
Since data stored is private i would suggest also read up on avaliable on market C# obfuscators. So you can protect you code from decompilation. (but its still a matter of time)
For updates for your application you can use ClickOnce technology.
Also some nice links on WPF:
http://channel9.msdn.com/wiki/WPF/homepage/