Home > Publications > Updating the partial singular value decomposition in latent semantic indexing

Updating the partial singular value decomposition in latent semantic indexing

Abstract:

Latent semantic indexing (LSI) is a method of information retrieval that relies heavily on the partial singular value decomposition (PSVD) of the term-document matrix representation of a dataset. Calculating the PSVD of large term-document matrices is computationally expensive; hence in the case where terms or documents are merely added to an existing dataset, it is extremely beneficial to update the previously calculated PSVD to reflect the changes. It is shown how updating can be used in LSI to significantly reduce the computational cost of finding the PSVD without significantly impacting performance. Moreover, it is shown how the computational cost can be reduced further, again without impacting performance, through a combination of updating and folding-in.

Authors: Jane E. Tougas, Raymond J. Spiteri

Download: CSDA-06T0909e