I was curious about the term. No, they are mostly not rare at all, but are materials that can be difficult to extract.
Perplexity says: While rare earths are relatively abundant, they are difficult to extract because they are often mixed with other minerals and require complex, costly processes to separate them at usable purity levels. This makes economically exploitable deposits sparse, even though the elements themselves are widespread.