Find or create entry on HK_CLASSES_ROOT/Folder/shell/${context_menu_name}/command, change the default value to 'gvim %1' without quotes.
The ${context_menu_name} (suggest using 'Open Vim Here') is the text shown on the context menu when right click on a folder or directory.