Kohli and Sharma announced their surprise retirement from red-ball cricket in May. This gave selectors ample time to consider replacements for the England tour, which gets underway in Leeds on Friday.
Speaking in a Delhi Capitals press conference, Rahul revealed that the stalwart pair - who had an incredible 190 Tests between them - will leave a huge vacuum, especially in the changeroom.
"Virat and Rohit have been the pillars of Indian cricket for the last decade or so, and not having them around will be a huge miss," said Rahul.
"In my whole career so far, I have never walked into a team where there is no Virat or Rohit. The 50-odd Test matches that I have played, either Virat or Rohit or both of them have been there. To walk into that dressing room feels a bit strange.
"But of course, you have to respect their decision. They have given absolutely everything for the country and they will remain legends of Indian cricket. But it's time for the rest of us to step up."
Shubman Gill will lead the Indian troops in the wake of captain Sharma's retirement.
Five clubs, including Chelsea, have set their sights on Liverpool's midfielder Harvey Elliott, who appears poised to leave Anfield this summer following a standout performance at the UEFA European Under-21 Championship.
Ben Duckett scored 149 to lead England to a five-wicket victory in the first Test against India at Headingley as the hosts chased down a 371-run target in the final session on the fifth day.
KL Rahul and Rishabh Pant piled on the runs for India at Leeds, leaving England 350 runs to chase on the final day of the opening Test.
India's new captain Shubman Gill led from the front with an unbeaten 127, guiding his side to a commanding 359-3 on an action-packed opening day of the first Test against England at Headingley.
