Skip to content

Create readme crawler #5675

@Jabolol

Description

@Jabolol
  • fetch repos from oso graphql API
  • use rest factory to grab root level readme.md files (via resource relatiosnhip)
  • config to provide minTrustRank maxTrustRank

Query;

SELECT DISTINCT url FROM int_ddp_repo_discovery_v0
WHERE trust_rank BETWEEN 1 and 100

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Status

Backlog

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions