Skip to content

data.md

Latest commit

 

History

History
116 lines (96 loc) · 5.41 KB

data.md

File metadata and controls

116 lines (96 loc) · 5.41 KB
Raw

Using the data

Everything behind the website is published as one JSON file that anyone can use in their own tools, bots, newsletters or dashboards:

https://tanbirramim.github.io/open-source-radar/data/issues.json

It is refreshed twice a day. The same data, without the website extras, is committed at data/issues.json. Please cache it rather than downloading it on every request, and link back to this project when you publish something built on it.

Shape

{
  "generated_at": "2026-09-13T01:43:41+00:00",   // when the data was collected (UTC)
  "topic_titles": { "web": "Web development" },  // website file only: topic slug to title
  "repositories": {
    "owner/repo": {
      "url": "https://github.com/owner/repo",
      "description": "What the project is",
      "stars": 12345,
      "forks": 678,
      "language": "Rust",                        // primary language
      "license": "MIT",                          // SPDX id, or null
      "pushed": "2026-09-12",                    // last push date
      "topics": ["cli", "terminal"],             // GitHub topics
      "buckets": ["devtools"],                   // Open Source Radar topic slugs (see scripts/config.toml)
      "contributing": "CONTRIBUTING.md",          // detected contributing guide path, or null
      "open_count": 4,                           // listed issues in this project
      "policy": {
        "ai": "none",                            // none | policy | disclose | restricted (detected, may be wrong)
        "ai_file": null,                         // file the AI rule was found in
        "cla": false,                            // CLA mentioned in contribution files
        "dco": false                             // DCO / Signed-off-by mentioned
      }
    }
  },
  "issues": [
    {
      "repo": "owner/repo",
      "number": 42,
      "title": "Crash when the config file is empty",
      "url": "https://github.com/owner/repo/issues/42",
      "labels": ["bug", "good first issue"],
      "level": "beginner",                       // beginner | help-wanted
      "created": "2026-08-01",
      "updated": "2026-09-10",
      "comments": 2,
      "maintainer_replied": true,                 // latest fetched comment is from an owner, member or collaborator
      "closed_pr": false                         // a pull request for it was closed without merging
    }
  ]
}

issues[].maintainer_replied is true when a fetched comment has GitHub's authorAssociation of OWNER, MEMBER or COLLABORATOR; otherwise it is false. The query currently fetches only the latest comment on each issue (comments(last: 1)), so a maintainer reply followed by someone else's comment can be missed. A false value does not mean a maintainer has never replied, and a true value does not guarantee a future response. Older datasets can omit the field. The site shows a Maintainer replied hint only when the value is true.

repositories[repo].contributing is the first detected, nonempty contributing guide in the configured lookup order: CONTRIBUTING.md, .github/CONTRIBUTING.md, docs/CONTRIBUTING.md, then CONTRIBUTING.rst. It is null if no guide was detected; older datasets can omit the field. The site links to the detected path on GitHub and offers a Has a contributing guide filter. The policy-file cache may be stale, and detecting a guide does not guarantee that its advice is current or helpful.

Example: five newest beginner issues in Go

curl -s https://tanbirramim.github.io/open-source-radar/data/issues.json \
  | jq -r '.repositories as $r | [.issues[] | select(.level == "beginner" and $r[.repo].language == "Go")]
           | sort_by(.created) | reverse | .[:5][] | "\(.title)\n  \(.url)"'

A snapshot of this data is also published as a dataset on Hugging Face: TanbirRamim/open-source-radar, with an issues table and a repositories table.

Feeds

Every language and topic has an RSS feed of beginner issues, so you can follow new ones in any feed reader.

  • Feed index: https://tanbirramim.github.io/open-source-radar/feeds/
  • One language: https://tanbirramim.github.io/open-source-radar/feeds/<slug>.xml, for example python.xml. The slugs are in language_slugs in issues.json (cpp, csharp, go, ...).
  • One topic: https://tanbirramim.github.io/open-source-radar/feeds/topics/<slug>.xml, for example ai-ml.xml. The slugs are in topic_feed_slugs.

Python example

Standard library only. It downloads issues.json, looks up each issue's repository language and prints the five newest beginner issues for one language.

import json
import urllib.request

DATA_URL = "https://tanbirramim.github.io/open-source-radar/data/issues.json"
LANGUAGE = "Python"

with urllib.request.urlopen(DATA_URL, timeout=30) as response:
    data = json.load(response)

repos = data["repositories"]
matches = [
    issue
    for issue in data["issues"]
    if issue["level"] == "beginner" and repos.get(issue["repo"], {}).get("language") == LANGUAGE
]
matches.sort(key=lambda issue: issue["created"], reverse=True)

print(f"{len(matches)} beginner {LANGUAGE} issues")
for issue in matches[:5]:
    print(f"{issue['repo']}#{issue['number']}: {issue['title']}")
    print(f"  {issue['url']}")