[stable28] perf: Avoid updating the folder size if we know the size difference

[stable28] perf: Avoid updating the folder size if we know the size difference #6369