Skip to content

Maintenance: Add sitemap.xml to documentation website #766

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
1 task done
hjgraca opened this issue Feb 14, 2025 · 1 comment · Fixed by #767
Closed
1 task done

Maintenance: Add sitemap.xml to documentation website #766

hjgraca opened this issue Feb 14, 2025 · 1 comment · Fixed by #767
Assignees
Labels
internal Maintenance changes

Comments

@hjgraca
Copy link
Contributor

hjgraca commented Feb 14, 2025

Summary

  • Add sitemap.xml to the documentation website
    Improve discoverability and ranking
  • Investigate llm.txt
    Token limitations makes it hard to use LLMs to parse and provide usable information for large documentation sites. Though technically possible to process documentation directly from HTML, the presence of non-essential content (navigation elements, CSS, JavaScript, metadata and tracking scripts) add to the context window in lieu of actual content. Filtering out this ‘noise’ is resource-intensive and slows down the LLM’s performance.

Why is this needed?

  • sitemap.xml
    Traditional sitemaps (sitemap.xml) help search engines find website pages and optimizes SEO to rank higher in search results.
  • LLM.txt link and link
    llms.txt is designed specifically for LLMs, providing a structured, semantic summary of website content. While sitemaps aid discovery and SEO improves ranking, llms.txt enables AI to understand content. In an AI-driven future where LLMs power search and other applications, this semantic understanding becomes essential for accurate, relevant AI responses. Sitemaps and SEO still remain relevant for traditional search, but llms.txt is better positioned for an AI-centric future by prioritizing semantic understanding for LLMs.

Which area does this relate to?

No response

Solution

No response

Acknowledgment

@hjgraca hjgraca added internal Maintenance changes triage Pending triage from maintainers labels Feb 14, 2025
@hjgraca hjgraca removed the triage Pending triage from maintainers label Feb 14, 2025
@hjgraca
Copy link
Contributor Author

hjgraca commented Feb 14, 2025

Also added sitemap for API Docs https://docs.powertools.aws.dev/lambda/dotnet/api/sitemap.xml

@hjgraca hjgraca changed the title Maintenance: Add sitemap.xml Maintenance: Add sitemap.xml to documentation website Feb 14, 2025
@hjgraca hjgraca moved this to 🏗 In progress in Powertools for AWS Lambda (.NET) Feb 17, 2025
@dreamorosi dreamorosi linked a pull request Feb 24, 2025 that will close this issue
7 tasks
@hjgraca hjgraca moved this from 🏗 In progress to ✅ Done in Powertools for AWS Lambda (.NET) Feb 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
internal Maintenance changes
Projects
Status: ✅ Done
Development

Successfully merging a pull request may close this issue.

1 participant