An urgent search for a missing fisherman has been abandoned after his boat was found unmanned and drifting aimlessly.