By default, I configured CentOS at minimal installation, I was having problem to locate vimrc file for VIM Editor, and just found out there is a yum package called yum-enhanced which will give you more features in VIM Editor.
Install vim-enhanced via yum install
# yum install vim-enhanced
After installation, you will see default vimrc file at /etc/vimrc and more example rc files can be found at /usr/share/vim/vim70/
Now… I can have my visual mode working!