-
Notifications
You must be signed in to change notification settings - Fork 33
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
How to evaluate DeepGlobe graph with APLS metric? #13
Comments
Hi @tansor, thanks for the query. I used the simple skeletonization of roads and convert to line-string formats. You can refer Spacenet-Road Challenge 2 winners source code. Evaluate the APLS metrics by APLS Visualizer tool with source code available at link, which is released as part of challenge. |
Hi @anilbatra2185 , thanks for your answer. I'm still confused about how to obtain the DeepGlobe gt graph. Because the test method only allows gt graph to be networkx pkl or geoJson.
|
Hi @tansor, I used the same steps of skeletonization and conversion to line-strings using the DeepGlobe segmentation GT mask. And now it will act as GT graph for deepglobe and you might need to do small changes in APLS visualizer to compare deepglobe GT and predicted graph. STEPS for DG
Let me know, if you see any issues/concerns. |
Thank you for your patience! |
I also wonder how you evaluate DeepGlobe dataset with APLS metric. I tried to do that via code provided by "https://github.com/CosmiQ/apls", but I failed to use it on DeepGlobe dataset. Please give me some details.. I read above talks, but I still didn't understand. |
Hi, @hjlim0314. |
@tansor Thank you for your tip! It will be very helpful |
Hi @hjlim0314, @tansor I just made some modifications for DeepGlobe APLS metric measurement. Please use if needed, https://github.com/antran89/road_visualizer |
Thank you for your code. It works on my deepglobe data set very well. |
Hi, thank you for your response.
I wonder how to evaluate the inferred graph using APLS metric?
What data structure do you use to evaluate, and what's the key attribution that the data structure must have?
The reason why I ask so is that, according to https://github.com/CosmiQ/apls, the evaluation metric seems to be connected with lon/lat coordinate or utm coordinate.
Source codes may help more! Thx!
The text was updated successfully, but these errors were encountered: