Elmo looks inside some awesome goody bags before challenging guest John Mulaney to a nail-biting tricycle race and duetting with Lil Nas X. Ernie leads a baaa-ckstage tour right in the middle of the show, and Cookie Monster gets a special visitor.

The Count helps Elmo keep an eye on the clock in preparation for jammie time. Elmo welcomes Olivia Wilde for a game of "Teddy Bear Dress Up." Musical guest Sara Bareilles brings out two of her besties -- plus an extra special Sesame Street friend -- to help her perform her very own version of "Twinkle Twinkle Little Star."

Before bedtime, Elmo takes on the extra special role of talk show host! And for his very first episode, Elmo welcomes guests Jimmy Fallon and Kasey Musgraves, who sings a Sesame Street classic.

The Jonas Brothers drop by Elmo's show to compete in a Silly Freeze Dance contest and share a song about brushing those pearly whites. Abby Cadabby's magical fix causes havoc in the control room for Bert and Ernie.

Batman is in the house to play a game of Beach Ball Ballyhoo with Elmo. In search of the perfect bedtime story, Elmo welcomes acapella group Pentatonix, who performs a mashup of lullabies. Rosita looks for three sheep so she can tell her favorite sleepy time tale.

Trainer Nature Nick brings some animal friends on-set to help teach Elmo about nocturnal creatures. Jordin Sparks sings one of her favorite childhood songs and shares the thing she loves most about nighttime. Correspondent Grover takes to Sesame Street to investigate whether or not the sun should be in bed. Correspondent Grover takes to Sesame Street to investigate whether or not it's night.

Elmo faces off in a nursery rhyme rap battle with Miles Brown, and the Joyous String Ensemble drop by, in their PJs, to play a medley of familiar tunes. Cookie Monster babysits his little niece, who runs loose around the studio before her bedtime.

Elmo and Cookie Monster talk weird dreams before Blake Lively returns to Sesame Street for a game of "Cookie Monster Says." Dan + Shay perform their own rendition of "I Don't Want to Live on the Moon." Oscar the Grouch prepares to finally get his chance in the spotlight for "Trash Talk."

Elmo finds out what animal John Oliver would be, and the two compete in the world's slowest and most dramatic race. Sofia Carson joins the slow-mo fun with a lovely lullaby, and Kwame Alexander recites an impromptu poem about - who else - Elmo!

Elmo does some hard-hitting journalism to learn about Hoda Kotb's morning routine before challenging her to a game of "Hot Potato." Ben Platt treats Cookie to a song about his very favorite thing. Grover offers his expertise on how to pack Elmo's backpack for school.

Elmo brings in "monster makeover specialist" Jonathan Van Ness to unleash the gorgeous monster inside Sesame Streeter Alan, before Elmo and Cookie unveil hair and makeup transformations of their own. Mykal-Michelle Harris gives hosting a whirl and faces off with Elmo in a "No Laugh Challenge," and H.E.R. performs a song about her beautiful, versatile hair.

When Grover gets lost on his way to guest-star on the show, Andy Cohen steps up to the plate and pretends to be Grover. As a talk show host himself, Andy knows the need to keep the show going no matter what and through his Grover impressions, Andy fools everyone into thinking he is, in fact, Grover ! Finally, Andy reveals his true identity while Grover still searches for a way onto the talk show set. Josh Groban performs I love Trash with Oscar the Grouch.

Elmo isn't shy about an important part of his bedtime routine -- potty time; after he challenges Jason Sudeikis to a round of the "Silly Dance Game," Ciara stops by to share an inspiring musical message; Grover shakes things up as he plays usher.

‘Tis the season for all seasons as Drew Barrymore swings by to dress up a snowman, and Keedron Bryant joins Elmo and his new friend Skyler to sing a song about summer. Then, it’s time for a “spot the difference” picture challenge!

“Old MacDonald Had a Farm” and on that farm are celebrity friends Seth Meyers, who challenges Elmo’s new friend Felice to an obstacle course, and Kelly Rowland, who performs her rendition of the classic song!

It’s a pet party when actor and animal lover Brady Noon stops by for a paw-some game against Elmo’s new friend Jayla that tests their ability to leash a dog. Next, Wanmor “raises the ruff” with a song about how to properly care for pets.

Rise and shine! While Ernie helps Bert with a morning do-over, Elmo and his new friend Ziva are joined by comedian and TV show host Amber Ruffin for a teeth-cleaning challenge. Then, Bebe Rexha sings about morning routines!

While Felix and Baby Bear plan a pretend trip to outer space, author and talk show host Jenna Bush Hager squares off against Elmo’s new friend Nilah in a suitcase-packing challenge, and Sophie Fatu sings about traveling.

Actor Ames McNamara joins in on the fun in this bathtime-themed episode! Broadway star Leslie Odom Jr. performs the iconic bath time classic, “Rubber Duckie!”

Sisters Dani and Dannah Lane team up with Elmo’s new friend Lucia to sort mail before the brothers of AJR sing “Heroes in Your Neighborhood.” Then, Cookie enlists his friends for help thanking community workers!

While Ernie preps Bert for a big football game, actor and tennis lover Rohan Chand suits up for a thrilling timed challenge. Later, country music star Kane Brown steps up to the plate for a song about the topic of the day: sports!

Elmo forgets his signature tie just in time to teach the audience about… getting dressed! Then, Busy Philipps packs on the winter clothes in a timed challenge against Elmo’s new friend Christian.

Comedian Aidy Bryant and singing duo Hello Sunday stop by for some babysitting-themed fun as Cookie Monster does his best to keep an eye on his niece.

“C”is for cook-ing as actor Mackenzie Hancsicsak joins Elmo’s new friend Destin in a Cookie Monster-themed pancake challenge. Later, Juanes sings about navigating the kitchen.

The studio is abuzz for bug day as actor Sway Bhatia drops by to learn and play games all about insects. Then, it’s buggy boogie time with singer Tori Kelly!