Skip to content

Commit

Permalink
Merge pull request #333 from HDFGroup/lkurz-robots-frontmatter
Browse files Browse the repository at this point in the history
Update robots.txt frontmatter
  • Loading branch information
loricooperhdf authored Oct 25, 2024
2 parents 101c9b1 + 14a5d25 commit 70c1834
Showing 1 changed file with 7 additions and 3 deletions.
10 changes: 7 additions & 3 deletions robots.txt
Original file line number Diff line number Diff line change
@@ -1,4 +1,10 @@
robots.txt generated by www.seoptimer.com
---
layout: none
---
User-agent: *
Sitemap: {{ site.url }}/sitemap.xml
Sitemap: {{ site.url }}/doxygen-content-sitemap.xml

User-agent: *
Disallow:
Disallow: /cgi-bin/
Expand All @@ -9,5 +15,3 @@ Disallow: /ftp/newsletters/
Disallow: /ftp/HDF5/documentation/
Disallow: /ftp/HDF5/examples/
Disallow: /ftp/HDF5/projects/
Sitemap: https://support.hdfgroup.org/sitemap.xml
Sitemap: https://support.hdfgroup.org/doxygen-content-sitemap.xml

0 comments on commit 70c1834

Please sign in to comment.