As if replacing David Letterman as the host of the "Late Show" is any small feat, Stephen Colbert recently let it be known he wanted no part of trying to succeed Jon Stewart at the helm of "The Daily Show."

According to Deadline, while recently speaking before a panel at the Tribeca Film Festival, Colbert flatly answered "Star Wars " filmmaker George Lucas' query of if he feels he would have been the absolute best candidate to replace Stewart with the response, "I don't want to be the guy who takes over for Jon Stewart."

Colbert later added, "I've worked with him, and my memories of him is that he's the keenest, most intelligent, most beautifully deconstructive mind -- the clearest thinker I ever worked for. I would never get underneath his shadow."

The soon-to-be 51-year-old Colbert is formally scheduled to take over for Letterman next fall. Meanwhile, Comedy Central network executives have installed 31-year-old, South African-born comedian Trevor Noah as Stewart's replacement.

But Deadline reports before he could so much as perform his first skit, Noah recently found himself at the center of controversy over a series of controversial jokes he long ago made and posted online.

In announcing that they would be standing by their man, Comedy Central officials added, "Like many comedians, Trevor Noah pushes boundaries; he is provocative and spares no one, himself included. To judge him or his comedy based on a handful of jokes is unfair."

Over the years, Noah's "Born a Crime" stand-up act has become legendary. In the performance, he concentrates on such hot-button issues as Apartheid, racial identity and racism.

The 52-year-old Stewart served as host of "The Daily Show" for 15 seasons before abruptly announcing earlier this year he was stepping down.