There are plenty of synonyms for the phrase "reduce the cost of administration," each with a slightly different meaning. Some examples include "cut down on administrative expenses," "streamline the cost of management," "minimize administrative costs," "trim the budget for operations," "simplify administrative overheads," "reduce the operational expense," "lower the expenditures of administration," and "curtail the administrative outlay." Depending on the context and the audience, any of these phrases could be more appropriate or effective than others. Regardless of the choice, the goal is to convey the idea of reducing the amount of money spent on managing an organization, without sacrificing quality or productivity.