Simple Docs Extractor

Below you will find the table of contents and links to all generated documentation files.

---

Folders

• config/
  • advanced-config.md
  • basic-example.md
  • builder-example.md
• flow/
  • flow.md
• github-actions/
  • automate-publishing.md
• plugins/
  • CreatingCustomPlugins.md
  • usage.md
  • built-in-plugins/
    • CallbackExtractorPlugin.md
    • CopyContentsPlugin.md
    • RegexExtractorPlugin.md
    • TagExtractorPlugin.md
• simple-docs-scraper/
  • builder/
    • Builder.ts.md
    • TargetBuilder.ts.md
    • TemplateBuilder.ts.md
  • config/
    • ConfigHelper.ts.md
  • consts/
    • defaults.ts.md
  • content/
    • ContentInjection.ts.md
    • TemplateContentExtractionContentMerger.ts.md
  • formatters/
    • AddDoubleLinesFormatter.ts.md
    • RecommendedFormatters.ts.md
    • RemoveMultiLineCommentAsterisks.ts.md
  • generators/
    • DocFileGenerator.ts.md
    • IndexContenGenerator.ts.md
    • IndexFileGenerator.ts.md
  • plugins/
    • CallbackExtractorPlugin.ts.md
    • CopyContentsPlugin.ts.md
    • DocumentContentExtractor.ts.md
    • RegexExtractorPlugin.ts.md
    • TagExtractorPlugin.ts.md
  • processors/
    • DocumentationCodeFileProcessor.ts.md
    • MarkdownIndexProcessor.ts.md
  • scanning/
    • DirectoryMarkdownScanner.ts.md
    • FileScanner.ts.md
  • services/
    • LocalesService.ts.md
    • SimpleDocExtractor.ts.md
  • utils/
    • ExcerptExtractor.ts.md
    • ExtensionReplacer.ts.md
    • createMarkdownLink.ts.md
    • escapeRegexString.ts.md
    • listIndenterPrefix.ts.md
• templates/
  • documentation-template.md
  • index-template.md
  • locales.md

---

About

A lightweight TypeScript library for extracting documentation from source files and organizing them into a structured output directory.

Having trouble getting started? Send me an email or create an issue.

Why this approach?

I built this library so I could write documentation directly in my source code, and have it automatically pulled out and organized for me.

This way, I can focus on coding while the library takes care of collecting and structuring the docs.

With GitHub Actions, the documentation is published to GitHub Pages automatically, so everything stays up to date with no extra effort.

Documentation

View the documentation on GitHub Pages.

Features

• Easy Documentation Writing - Write docs directly in your code using simple tags like <docs> and <method>
• Beautiful Output - Automatically creates clean, organized documentation files with your own custom templates
• Smart Organization - Keeps your docs organized by automatically creating index pages and preserving your folder structure
• Works with Any Code - Extract documentation from JavaScript, TypeScript, and other files using flexible patterns
• Clean Content - Automatically removes messy comment formatting and makes your docs look professional
• Simple Setup - Easy-to-use builder pattern that lets you configure everything in just a few lines
• TypeScript Ready - Built with TypeScript for better development experience and fewer errors
• Multiple Projects - Handle different parts of your codebase with separate documentation setups

Proof is in the pudding

• The entirity of this project’s documentation is powered by this library.
• (Apart from some pages that are manually written )

Examples

Basic Configuration with Minimal Configuration

const service = SimpleDocExtractor
  .create(process.cwd())
  .target((target) => {
    target.cwd(path.join(process.cwd(), 'src'))
    target.outDir(path.join(process.cwd(), "docs"))
    target.patterns("**/*")
    target.createIndexFiles()
  })
  .addRecommendedFormatters()
  .buildService();

await service.start();

Simple Doc Configuration Example

This is the same example as used in our publish-docs.ts script.

• Extracts content from from the top of the classes.
• Extracts content from from the top of the methods.
• It also copies the README.md file to the root index file.
• It only targets js/ts files.

import path from "path";
import { SimpleDocExtractor } from "@/simple-docs-scraper/index.js";
import { TagExtractorPlugin } from "@/simple-docs-scraper/extractors/TagExtractorPlugin.js";
import { CopyContentsPlugin } from "@/simple-docs-scraper/extractors/CopyContentsPlugin.js";

export const DEFAULT_CONFIG = SimpleDocExtractor
  .create(process.cwd())
    // Define our global templates (This can also be done on a target level)
    .indexTemplate((template) => {
      template.useFile(path.join(process.cwd(), "src/templates/index.template.md"));
      template.useMarkdownLinks();
    })
    .documentationTemplate((template) => {
      template.useFile(path.join(process.cwd(), "src/templates/documentation.template.md"));
    })
  // Define our target(s) to extract documentation from
  .target((target) => {
    target.cwd(path.join(process.cwd(), 'src')) // The directory to search for files to extract documentation from
    target.outDir(path.join(process.cwd(), "docs")) // The directory to output the generated documentation to
    target.patterns("**/*.{js,ts}") // The patterns to match files to extract documentation from
    target.ignores(["**/tests/**", "**/scripts/**"]) // The patterns to ignore when searching for files to extract documentation from
    target.createIndexFiles() // Whether to create an index.md file for this target
    target.plugins([ // The plugins to use when extracting documentation
      new TagExtractorPlugin({
        tag: "docs",
        searchAndReplace: "%content%",
      }),
      new TagExtractorPlugin({
        tag: "method",
        searchAndReplace: "%methods%",
        attributeFormat: "### **{value}**",
      })
    ])
    // Define the template to use for the root index file
    target.rootIndexTemplate((template) => {
      template.useFile(path.join(process.cwd(), "src/templates/root-index.template.md")); // The template to use for the root index file
      template.useMarkdownLinks(); // Whether to use markdown links in the root index file
      template.plugins( // The plugins to use when generating the root index file
        new CopyContentsPlugin({
          fileToCopy: path.join(process.cwd(), "README.md"),
          searchAndReplace: "%readme%",
        }),
      )
    })
  })
  .addRecommendedFormatters() // Add the recommended formatters to the configuration
  .buildConfig(); // Build the configuration

new SimpleDocExtractor(config).start()
    .then(result => {
        console.log('Success count: ', result.successCount);
        console.log('Total count: ', result.totalCount);
        console.log('Missing documentation files: ', result.missingDocumentationFiles);
        console.log('Logs:');
        result.logs.forEach(log => {
            console.log(log);
        });
    });

---

This file is auto generated. Do not edit manually.