Choice 2: Face Attributes#
In this project, you will develop a content-based image retrieval system with PyTorch. You will focus on the case where the query is a list of facial attributes (male, blond, smiling, …), and the goal is to retrieve images of people that match these attributes. You will build a multimodal retrieval system that can learn a similarity metric between images and attributes, and then use this metric to retrieve images that match the query.
Difficulty |
Suggested Tutorials |
|---|---|
Moderate |
Requirements: This project can be completed on a standard laptop without a dedicated GPU. However, having access to a GPU will allow you to choose a larger pre-trained model (e.g., ResNet-50) and fine-tune it for potentially better performance.
Grading
The project will be graded based on the following criteria. Points for each activity are awarded based on quality and completeness (partial credit possible).
Activity |
Points (max) |
|---|---|
Build a baseline image retrieval system |
9 |
Properly evaluate its performance (precision, recall) |
3 |
Transfer learning (fine-tuning) |
3 |
Deployment (model made usable) |
2 |
Presentation (clarity & demo) |
3 |
Total |
0-20 |