-
Notifications
You must be signed in to change notification settings - Fork 1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature] Support Flickr30k Retrieval dataset #1625
Conversation
Codecov ReportPatch coverage:
Additional details and impacted files@@ Coverage Diff @@
## dev #1625 +/- ##
==========================================
- Coverage 68.16% 65.50% -2.67%
==========================================
Files 295 328 +33
Lines 23372 25561 +2189
Branches 3713 4075 +362
==========================================
+ Hits 15932 16744 +812
- Misses 6880 8207 +1327
- Partials 560 610 +50
Flags with carried forward coverage won't be shown. Click here to find out more.
☔ View full report in Codecov by Sentry. |
@DATASETS.register_module() | ||
class Flickr30kCaption(BaseDataset): | ||
"""Flickr30k Caption dataset. To generate coco-style GT annotation for | ||
evaluation, refer to refer |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
evaluation, refer to refer | |
evaluation, please refer to |
Modification
Support
Flickr30k
dataset.A example config for BLIP zero-shot retrieval is provided. It matches the result provided in the paper.
A example config for BLIP zero-shot captioning is provided. Its result is reasonable.
Example command:
Local Path
Images and annotations at:
/mnt/petrelfs/share_data/liuyuan/data/mm/flickr30k
Ground truth annotations for evaluation at:
/mnt/petrelfs/share_data/wangyiqin/flickr30k