Kanye West made a surprise appearance during "Late Night with Jimmy Fallon" where he performed a song from his album Yeezus and insulted Kim Kardashian's former lover, singer Ray J.

"@kanyewest surprises Late Night and performs "Bound 2" with @theroots and kills it," Jimmy Fallon said via Twitter on Monday night.

The performance marked both the first time West performed "Bound 2" and West's first time performing on "Late Night with Jimmy Fallon."

During the performance, R&B singer Charlie Wilson sang first, crooning "I know you're tired of loving, of loving," over a piano melody. Next, band the Roots started jamming alongside a children's chorus of six voices.

West, 36, remixed some of the track's lyrics, inserting a quick jab at Ray J, who gained fame with a sex tape he made with Kim Kardashian, West's current girlfriend and mother of his daughter, North West.

"Brandy's little sister lame, man, he know it now," West rapped during the performance. "When a real brother hold you down you supposed to drown."

West's words may have been a response to Ray J's latest song, "I Hit It First," which also features Bobby Brackins. In the song, Ray J, 32, sings about a popular woman that everyone knows he was intimate with first.

"I had her head gong north and her ass going south/ But now baby chose to go west," Ray J sings in the song.

In the music video, the word "west" is accompanied by a shot of a road sign for Chicago, West's hometown.  The video also features a Kardashian look-a-like, whom Ray J records on a camcorder in a fashion similar to the way the two's leaked sex tape was shot.

"And if you were to come back to me girl/We'll make another movie/I put her on, I put her on, I put that girl on," Ray J continues in the song.

According to Ray J, however, the song was not meant to "create a war" with West and Kardashian, 32.

"It's just a record," Ray J said in an interview with New York radio station Hot 97.1. "It's not about that. It's about the concept, you know what I'm saying ... I think people are digging into it way too deep."