blob: a952f15cc895aa05d3836fe14a7b5b3bd874eae9 (
plain) (
blame)
1
2
3
4
5
6
7
8
9
|
This module takes a list of documents (in English) and
builds a simple in-memory search engine using a vector
space model. Documents are stored as PDL objects, and
after the initial indexing phase, the search should be
very fast. This implementation applies a rudimentary
stop list to filter out very common words, and uses a
cosine measure to calculate document similarity.
All documents above a user-configurable similarity
threshold are returned.
|
