Well, after reading and testing a few plugins, I have had all the necessary plugins which I think I need for on-page optimization.
1. I have installed a All-In-One SEO plugin, that allows me to enter keyword and title.
2. I have tagging plugin (UTW, Ultimate Tagging Warrior) installed and it allows me to insert tags easily while I write my post.
3. I have a Google Site Generator installed, that generates Google sitemap for me comfortably.
4. I have created Feedburner for my blog and I have also inserted some RSS reader icons on my page.
5. I have also changed my Wordpress Permalink to be more search engine friendly.
Pretty much, I am done for on-page optimization. Next, I will need to explore some off-page optimization.
1. I have learned about trackback and pingback. It is important to start interacting with other blog community.
2. I have also posted some comments on some related blog.
Next, I will continue to explore more options about backlinks and hopefully, I will be able to share more update with you later… 
Cheers,
KP
