The order follows similar efforts by the White House to dismantle the U.S. Agency for International Development.
Elon Musk has promised transparency as President Donald Trump's leader in making the federal government more efficient.