Evaluation
Problem: Differences of opinion, or outright cheating, can affect satisfaction with a configuration.
Strategy: Capture individual preferences over documents, services,.. with decision theory
- Use utility theory to represent preferences
- Evaluate documents, collections, services
- Act on evaluation (order how presented, avoid...)
Status: Two prototype search engines (restricted domains)
User prefers small sixth grade documents.
Preferences over non-textual attributes improve evaluation