WordPress doesn’t have a [rss] shortcode, that’s a feature of wordpress.com, not self hosted WordPress sites.
I expect there are plenty of free plugins you can install that will give you this functionality. Search the internet for “wordpress rss plugin” and similar.