Fianna Fáil Minister asked about the Greens' "disproportionate influence"