The stories have been driven by Breitbart News, where Bannon was executive chairman before joining Trump's presidential campaign as chief executive in August.
Scaramucci said he didn't know and hasn't directly asked Bannon about his views.
"I wouldn't have recommended that statement", Scaramucci told ABC's "This Week" with George Stephanopoulos.
Fired former White House communications director Anthony Scaramucci criticized President Donald Trump on Sunday for not clearly condemning the display of violence from white nationalists at a Saturday rally in Charlottesville, Virginia, that left at least three dead and 35 more injured.
"He has to move away from that sort of "Bannon-bart" nonsense", Scaramucci said, apparently combining Bannon's name with Breitbart, the website that Bannon ran before joining Trump's campaign a year ago.
Scaramucci said he spoke with the president "this week" and that the two "had a very candid conversation".
Scaramucci, who held the position as Trump's top spokesman for 11 days, gave ABC his first interview since he was sacked at the end of July by Gen. John Kelly, the new White House chief of staff.
Amid growing bipartisan criticism of his initial response, White House advisers appearing Sunday on talk shows strove to defend the president. He then said, "I would prefer to let the president make the decisions the president needs to make".
"I'm here to serve the country", he told Ryan Lizza, a reporter for The New Yorker.
In the call, Scaramucci went after Bannon, using vulgar language to describe the chief strategist.
Scaramucci also talked about that now-infamous bonkers phone call, saying, "I made a mistake". I paid the consequences of that mistake. He's got to move more into the mainstream.
Scaramucci reiterated that he felt the interview with Lizza was "off the record" and it was a "very deceitful thing" that Lizza did.
He added that it's not serving the President's interests to still have that wing around.
Scaramucci said during the interview that he accepts that what he did was wrong, but emphasized that people need to move on and focus on the president's agenda.