Geospatial Layer Picking Accuracy

Compare Model Layers vs Ground Truth

Query deepseek-chat-v3-0324
Query 1
Number of litter bins within Sambro, Halifax
 ✔ Correct
Selected:
  • gis_user.litter_bins
  • gis_user.community_boundaries
Ground Truth:
  • gis_user.litter_bins
  • gis_user.community_boundaries
Query 2
Number of litter bin and boat facilities within Sambro, Halifax
 ✘ Incorrect
Selected:
  • None
Ground Truth:
  • gis_user.litter_bins
  • gis_user.community_boundaries
  • gis_user.boat_facilities
Missing: gis_user.litter_bins, gis_user.boat_facilities, gis_user.community_boundaries
Query 3
World's most populous city
 ✔ Correct
Selected:
  • gis_user.worldcities
Ground Truth:
  • gis_user.worldcities
Query 4
Total number of communities in Halifax Regional Municipality
 ✔ Correct
Selected:
  • gis_user.community_boundaries
Ground Truth:
  • gis_user.community_boundaries
Query 5
Number of boat facilities in Halifax
 ✘ Incorrect
Selected:
  • None
Ground Truth:
  • gis_user.boat_facilities
Missing: gis_user.boat_facilities
Query 6
All the available datasets in Halifax
 ✘ Incorrect
Selected:
  • None
Ground Truth:
  • gis_user.litter_bins
  • gis_user.community_boundaries
  • gis_user.boat_facilities
Missing: gis_user.litter_bins, gis_user.boat_facilities, gis_user.community_boundaries
Query 7
All the available datasets
 ✘ Incorrect
Selected:
  • None
Ground Truth:
  • gis_user.litter_bins
  • gis_user.worldcities
  • gis_user.boat_facilities
Missing: gis_user.litter_bins, gis_user.worldcities, gis_user.boat_facilities

Query Legend

  • Query 1 Number of litter bins within Sambro, Halifax
  • Query 2 Number of litter bin and boat facilities within Sambro, Halifax
  • Query 3 World's most populous city
  • Query 4 Total number of communities in Halifax Regional Municipality
  • Query 5 Number of boat facilities in Halifax
  • Query 6 All the available datasets in Halifax
  • Query 7 All the available datasets