Skip to content

Adding shuf - a way to get a random sample from a large dataset #567

Closed

Description

@MarkSFrancis

What is shuf?

shuf is a tool to get a random sample in a random order, from a data source of an unknown size. It's used in data analytics, often as a way to get a small random sample from a data lake or warehouse, or from a large CSV file. It was originally written for coreutils as a CLI tool, and you can find the source for that here.

I have reverse-engineered it to JS as an algorithm here- would you be interested if I created a PR for it, to add it to this repo?

Activity

  1. stale commented on Mar 19, 2021

    @stale

    This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

  2. added
    wontfixWill not be fixed or is a feature
    on Mar 19, 2021
  3. raklaptudirm commented on May 13, 2021

    @raklaptudirm
    Member

    @MarkSFrancis I would suggest you submit a pr. The mods will check the algorithm then. Cheers!

  4. removed
    wontfixWill not be fixed or is a feature
    on May 13, 2021
  5. raklaptudirm commented on May 14, 2021

    @raklaptudirm
    Member

    @MarkSFrancis Sorry for the ping but I was wondering if you could close the issue since it has been solved.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions