Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OSDF director startup creates warnings for missing project during GeoIP resolution #1717

Open
jhiemstrawisc opened this issue Nov 6, 2024 · 0 comments
Assignees
Labels
bug Something isn't working director Issue relating to the director component
Milestone

Comments

@jhiemstrawisc
Copy link
Member

The current approach to recording GeoIP resolution metrics has the issue that it creates a lot of scary noise on startup for OSDF Directors. Consider the logs I get when I run things locally:

INFO[2024-11-06T14:16:28Z] Generating/advertising server ads from OSG topology service... 
INFO[2024-11-06T14:16:28Z] The following servers are currently configured in downtime: map[string]director.filterType{"CARDIFF_UK_OSDF_CACHE":"topologyFiltered", "CHTC_STASHCACHE_CACHE":"topologyFiltered", "FZU_STASH":"topologyFiltered", "MGHPCC_NRP_OSDF_ORIGIN":"topologyFiltered", "PDX-Coeus-CE1":"topologyFiltered", "SDSC_NRP_OSDF_ORIGIN":"topologyFiltered", "SDSC_NRP_OSDF_XENON_ORIGIN":"topologyFiltered"} 
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] GeoIP resolution of the address 128.105.69.247 resulted in a suspiciously large accuracy radius of 1000 km. This will be treated as GeoIP resolution failure and result in random server sorting. Setting lat/long to null. 
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] GeoIP resolution of the address 128.105.69.4 resulted in a suspiciously large accuracy radius of 1000 km. This will be treated as GeoIP resolution failure and result in random server sorting. Setting lat/long to null. 
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] GeoIP resolution of the address 128.105.68.67 resulted in a suspiciously large accuracy radius of 1000 km. This will be treated as GeoIP resolution failure and result in random server sorting. Setting lat/long to null. 
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] GeoIP resolution of the address 200.136.80.55 resulted in a suspiciously large accuracy radius of 1000 km. This will be treated as GeoIP resolution failure and result in random server sorting. Setting lat/long to null. 
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
WARNING[2024-11-06T14:16:28Z] Failed to get project from context           
DEBUG[2024-11-06T14:16:28Z] The director will redirect to caches by default 

I believe each of these warnings come from the process of performing GeoIP resolution against servers registered in Topology.

We should clean up this process to reflect that none of these should be considered warnings, and it doesn't make sense to think of "projects" in this context.

@jhiemstrawisc jhiemstrawisc changed the title Erroneous warnings on OSDF director startup from missing project during GeoIP resolution OSDF director startup creates warnings for missing project during GeoIP resolution Nov 6, 2024
@jhiemstrawisc jhiemstrawisc added this to the v7.12.0 milestone Nov 6, 2024
@jhiemstrawisc jhiemstrawisc added bug Something isn't working director Issue relating to the director component labels Nov 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working director Issue relating to the director component
Projects
None yet
Development

No branches or pull requests

2 participants