ESC without controller

Yes, under certain conditions (e.g. safety precautions) a switch on the board is sufficient. Someone here To watercool ESC or not? - #13 by _marty is considering a similar solution.