My Knowledgebase Ninjas podcast episode -- "Metrics don't work"
Episode details
You can view the episode details on Doc360 podcast site:
You can also listen through the embedded player here:
Topics discussed
The podcast covers the following topics:
- How I got into tech comm — my “reality check moment” working two jobs
- About the group I work in at Amazon (which includes just two technical writers)
- What docs-as-code entails — Markdown, Git, CI/CD, static site generators (SSGs), etc.
- Trends about authoring/publishing tools, including SSG usage, JAMstack, Markdown as a common format across tools
- Disadvantages of the docs-as-code approach: UX skillset requirements, lack of built-in search, internal development time, localization, content re-use, PDF generation, custom scripting and tool lock-in
- Advantages of the docs-as-code approach: simplicity, scalability, flexibility to customize, integration of web frameworks (e.g., Bootstrap), modern-looking websites
- Why metrics often fall short in the value-from-ticket-deflection argument — budgets come from different, non-related areas of business, doc knowledge is internalized and used to close tickets without acknowledging docs, tickets are often never created because users find doc first and get their answers, deals might be made or rejected based on docs without any kind of acknowledgement, onboarding times for internal engineers aren’t tracked, etc.
- Why measuring documentation usage is problematic — high-impact customers versus low-impact customers, the challenge of interpreting metrics, why time on page, bounce rate, and click rates are problematic, paying attention to trending pages
- Whether technical writers create value for internal groups — knowledge creation as an intangible benefit, creating information that becomes the lifeblood of the company
- Whether tech comm teams should be involved high-level product design or just write docs, different specializations tech writers sometimes play, CX knowledge requirements to influence design
- Who I learned from the most in my career - Mark Baker, Every Page Is Page One
- Docs I’ve been using lately — Descript, Cave of Programming
- Advice for my 20-year-old self — turning around the question and letting my 40-year-old self learn from my 20-year-old self to be more open to risk and change
Here’s one takeaway from the metrics discussion:
I think I took more of a devil’s advocate approach regarding metrics during this podcast because other podcast guests seemed to be more enthusiastic about embracing metrics (for example, listen to the episode with Gavin Austin, which I enjoyed). I should have probably acknowledged that metrics are needed to influence decision makers. Also, I should have more advice about which metrics to use for docs. Unfortunately, I don’t have good advice for metrics. Everything I have ever tried hasn’t really worked.
Resources mentioned during the podcast
- Value arguments for docs and tech comm (Part II): Reviewing past research
- Value arguments for docs and tech comm (Part III): Determining value through usage
- Measuring the value of technical writing, by Bob Watson
- Value arguments for docs and tech comm (Part IV): Enabling information flow
- “Value from perceptions from others” (Saul Carliner reference), by Saul Carliner
- “Value from knowledge creation” (Mike Hughes reference), by Michael Hughes
- Every Page Is Page One, by Mark Baker
- Descript help center
- Cave of Programming
- Docs-as-code tools
- Limits to the idea of treating docs as code
Subscribe to Knowledgebase Ninjas Podcast
You can subscribe to the Knowledgebase Ninjas podcast by clicking the Subscribe button on the embedded player above. Alternatively, search for the podcast in your favorite player or subscribe to their RSS feed.
