I wouldn't say that.
A phrase only needs to be considered for global caching if it's used outside of a template (thus, via the code). However, only think about globally caching a phrase if it is commonly used. For example, we cache all the date-related elements as they're basically used on every page. We never cache any infrequently used phrases (like error messages).