Ordering Northern Ireland secretary Hilary Benn to set up a public inquiry into the murder of GAA official Sean Brown was legally and constitutionally wrong, the Court of Appeal has heard.