[docs-noob-tester] 📚 Documentation Noob Test Report - 2026-10-14

[github-actions[bot]]

Summary

• Date: 2026-10-14
• Pages: /gh-aw/, /gh-aw/setup/quick-start/, /gh-aw/setup/cli/ (all HTTP 200)
• Impression: Quick Start is well structured with a time estimate and prerequisites. A true beginner would still hit jargon and a long CLI page.

Critical Issues Found

• None blocking. All 3 pages loaded.

Confusing Areas

• Prerequisites list four AI providers without saying which is easiest or whether it costs money.
• gh auth login --scopes repo,workflow is given without explaining scopes.
• "Lock file", "engine" and "compile" appear before being defined.
• Windows users are told to use WSL with no link or setup hint.
• The CLI page is very long (11 sections); "Day-one commands" is good but is followed by lots of advanced content.
• The relationship between githubnext/agentics (source of the sample workflow) and github/gh-aw isn't explained.

What Worked Well

• 10-minute estimate and embedded video.
• Copy-paste prerequisite checks (gh --version, gh auth status).
• One-command add-wizard flow.
• CLI page opens with "Day-one commands".

Recommendations

1. Quick win: recommend a beginner engine and note cost.
2. Quick win: add a glossary (frontmatter, lock file, engine, compile) linked at first use.
3. Quick win: show expected output after each step.
4. Longer term: add a TOC/collapse advanced CLI content, and a cheat sheet.
5. Longer term: add Windows/WSL setup links.

Screenshots

📎 home.png — https://github.com/github/gh-aw/blob/assets/Documentation-Noob-Tester/e55b29fe81ce7feddda00da9494bbd732188b2e6b6fdb625379987b9f1000e63.png?raw=true
📎 quick.png — https://github.com/github/gh-aw/blob/assets/Documentation-Noob-Tester/76028f30eb2b4cf8d4c706285331f1d4335249a247898758c0577333791c185a.png?raw=true
📎 cli.png — https://github.com/github/gh-aw/blob/assets/Documentation-Noob-Tester/d41e1120a88402f104c3e740008bcb2dba100660b1ccdef8833a4d61d2adc45c.png?raw=true

Note: findings on Quick Start and CLI content come from page source text; I did not review screenshots visually, so layout observations are limited.

Generated by 📝 Documentation Noob Tester · copilot · auto · 16.6 AIC · ⌖ 0.677 AIC · ⊞ 10.7K · ◷

• expires on Oct 14, 2026, 7:54 PM UTC-08:00

[github-actions[bot]]

This discussion was automatically closed because it expired on 2026-10-15T03:54:48.875Z.

Closed by Workflow