Considering that caching search results can lead to inaccurate search results, have you considered removing it? Elastic search is so fast I can't image anyone would notice a 1/10th of a second difference.
The caching isn't part of XFES but the core. At this time, there aren't necessarily plans to change this -- this is the first I've heard of any sort of problem from this.
