It depends on the jack. A standard RJ11 wall phone jack doesn’t have enough terminals for an ethernet connection, so you’ll have to replace it with an RJ45 ethernet jack.