The England international was on the scoresheet in midweek as Arsenal secured a 2-0 victory over Bayer Leverkusen to book their place in the UEFA Champions League quarter-finals.
That result extended the Gunners' unbeaten run to 14 matches in all competitions, reinforcing confidence within the squad ahead of the Wembley showdown.
Rice has insisted Arsenal are "looking forward" to the occasion and believes his side are capable of beating any opponent at present.
His comments reflect a dressing room buoyed by strong form and the prospect of competing on multiple fronts, with talk of a potential quadruple still alive internally.
Sunday's final marks Arsenal's first major showpiece appearance since their 2020 FA Cup triumph under Mikel Arteta, offering a chance to end a five-year wait for silverware. It also represents their earliest opportunity to secure a trophy this season.
"Definitely, it could be the start of something," said Rice. "It is the first trophy that is up for grabs.
"If you win that, the momentum after that, that takes you forward, is massive.
"The lads are already talking about it in there, we're excited - we're ready.
"At the minute, every game of football we go into, we believe we can win so we'll be ready and looking forward to it."
A moment of individual brilliance from Eberechi Eze set Arsenal on their way to a commanding victory over Bayer Leverkusen, as they booked a place in the Champions League quarter-finals with a composed 2-0 win at the Emirates Stadium.
Mikel Arteta said Eberechi Eze showed exactly why he was signed after his first-half strike helped Arsenal beat Bayer Leverkusen 2-0 and reach the Champions League quarter-finals with a 3-1 aggregate win.
Bayer Leverkusen head coach Kasper Hjulmand said his side can take pride in their Champions League campaign despite a 3-1 aggregate defeat to Arsenal in the round of 16.
Alvaro Arbeloa hailed his Real Madrid side's discipline and resilience after they once again knocked Manchester City out of the Champions League at the Etihad Stadium.
