Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Survey list on geoserver with all surveys (including embargoed) and full coordinates (for SQ+ and website) #1286

Open
LizziOh opened this issue Jun 15, 2023 · 7 comments

Comments

@LizziOh
Copy link
Collaborator

LizziOh commented Jun 15, 2023

There is a need for a survey list available on the geoserver which contains all surveys (including embargoed surveys from WA). This can be used by TPAC for cataloguing PQs, and Squidle+ for referencing the the TPAC API and also ingesting metadata for images (eg. depth, date).
For these sources the fields necessary are:
survey_id, location, site_code, site_name, latitude, longitude, depth, survey_date, hour, direction, pq_zip_url

Latitude and Longitude can be in full resolution (not truncated to 2 decimal points).

@bpasquer
Copy link
Contributor

From NRMN meeting email from Lizzi (17 Aug 2023):
List of fields requested by Ari:
HasPQs
Location
SurveyDate
SurveyID
SurveyDate
SurveyID
SiteCode
Depth
Altitude (can't remember where this comes from... probably just null since it doesn't seem to exist)

@bpasquer
Copy link
Contributor

harvester changes are in prod.
Waiting for Ari and Ming to provide feedback before layer is promoted to prod

@bpasquer
Copy link
Contributor

bpasquer commented May 1, 2024

Documenting for reference:
Feedback from Ming to request the addition of a field "direction".

Direction was added but further progress on endpoint publication was hindered by harvester issue which incidentally impacted the public endpoints harvest and refresh in Geoserver-123/portal ( #1352)

he issue with the Harvester has been resolved (aodn/harvesters#1032) enabling successful harvesting of data from the public endpoint into the harvest DB and subsequent publication on the portal.

Changes to the ep_tpac published on Geoserver-rc need to be communicated to Ming

@bpasquer
Copy link
Contributor

bpasquer commented Oct 9, 2024

ep_TPAC layer deployed to Prod.
Haven't received feedback from either Ari or Ming.
Closing

@bpasquer bpasquer closed this as completed Oct 9, 2024
@LizziOh LizziOh reopened this Oct 15, 2024
@LizziOh
Copy link
Collaborator Author

LizziOh commented Oct 15, 2024

The geoserver endpoint available at
https://geoserver-123.aodn.org.au/
only has the first 50 when the csv is downloaded, unless the max_features is altered in the download url. Can this default be changed, or can the instructions be documented somehwere for downstream users?

Also (more importantly) the has_pqs_catalogued field is incorrect. all the entries say 'false'.

@utas-raymondng @bpasquer @atcooper1

@bpasquer
Copy link
Contributor

To download the full list of features in the ep_tpac layer (or any geoserver layer), you need to remove maxFeatures=50 and add outputFormat=csv.
maxFeatures is set to 50 as a default across all our Geoserver layers for performance purposes.
I will look at why has_pqs_catalogued values are all set to 'false' tomorrow.

@LizziOh
Copy link
Collaborator Author

LizziOh commented Oct 15, 2024

Thank you, that would be great. There is some momentum today from Ari to look into utilizing this endpoint so it would be good to make sure its correct.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants