A person aggrieved by a final decision of the highest administrative appellate authority in a contested case may take any further appeal as allowed by the Administrative Procedure Act. If a further appeal is taken under this section: any criminal prosecution of the person for carrying on without a license an activity for which the person must be licensed under this subtitle shall be stayed pending the appeal; any injunction against the person for carrying on without a license an activity for which the person must be licensed under this subtitle shall be stayed pending the appeal; and the court has discretion as to the care, custody, or control of any child whose care, custody, or control is the responsibility of the person.