Adding Terms to a Government Contract without Saying So

Imagine an incredulous Contractor asking, “Show me in the Contract where it says I’m supposed to do X?”  The Government Contracting Officer smugly answers, “even though the Contract doesn’t say so, you must do it anyway.”  Is that even possible, when, how?