You should be fine as long as input lag is low. Not all TVs have game modes, and not all game modes are created equal. Best to research the specific TV model in advance.
Going from 120Hz and above to 60Hz always bugs me out (especially with the mouse cursor movement), but one's eyes/brain...