Mr Swann was speaking after the resignation of First Minister Paul Givan who quit in protest at the NI Protocol.
Mr Givan’s resignation means the Stormont Executive cannot meet.
The Executive was due to discuss removing remaining Covid restrictions this Thursday, February 10
However, Mr Swann said he was not “prepared to allow a failure of politics to get in the way of lifting now unnecessary restrictions”.
“I am now seeking that legal guidance on how I myself can replace the bulk of the remaining restrictions, if not all of them, with clear guidance and advice,” he told a press conference on Monday.
“When we had an Executive, ministers always said we wouldn’t retain restrictions for a day longer than necessary, so that same logic should still apply.
“While we must move forward carefully, we can’t stay locked in emergency restrictions forever.
“We need to start getting normal back.”
Last month, Executive ministers announced a relaxation of Covid-19 restrictions that were introduced in December due to the Omicron variant.