Reloading the index causes a memory leak

[arikh1907]

Using FaissSearcher I am trying to reload the index after updating the directory. The Searcher is updated with the new data, however the memory of the previous load is not released. After several iterations the process memory is exhausted. Is there a way to avoid this while updating the index?

The code is:

    if is_first_load:
        self._dense_searcher = FaissSearcher(self._dense_index_dir, self._encoder)
   else:
        self._dense_searcher.index, self._dense_searcher.docids = self._dense_searcher.load_index(self._dense_index_dir)
        self._dense_searcher.dimension = self._dense_searcher.index.d
        self._dense_searcher.num_docs = self._dense_searcher.index.ntotal