togethercomputer/RedPajama-Data-V2 · Datasets at Hugging Face
huggingface.co
togethercomputer/RedPajama-Data-V2 · Datasets at Hugging Face
DataTrove
DataTrove is a library to process, filter and deduplicate text data at a very large scale. It provides a set of prebuilt commonly used processing blocks with a framework to easily add custom functionality.
DataTrove processing pipelines are platform-agnostic, running out of the box locally or on a slurm cluster. Its (relatively) low memory... See more
DataTrove is a library to process, filter and deduplicate text data at a very large scale. It provides a set of prebuilt commonly used processing blocks with a framework to easily add custom functionality.
DataTrove processing pipelines are platform-agnostic, running out of the box locally or on a slurm cluster. Its (relatively) low memory... See more
huggingface • GitHub - huggingface/datatrove: Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
This dataset is an attempt to replicate the results of Microsoft's Orca
Our dataset consists of:
~1 million of FLANv2 augmented with GPT-4 completions (flan1m-alpaca-uncensored.jsonl)
~3.5 million of FLANv2 augmented with GPT-3.5 completions (flan5m-alpaca-uncensored.jsonl)
We followed the submix and system prompt distribution outlined in the Orca pape... See more
Our dataset consists of:
~1 million of FLANv2 augmented with GPT-4 completions (flan1m-alpaca-uncensored.jsonl)
~3.5 million of FLANv2 augmented with GPT-3.5 completions (flan5m-alpaca-uncensored.jsonl)
We followed the submix and system prompt distribution outlined in the Orca pape... See more
ehartford/dolphin · Datasets at Hugging Face
What is Pandalyst
Pandalyst is a general large language model specifically trained to process and analyze data using the pandas library.
How is Pandalyst
Pandalyst has strong generalization capabilities for data tables in different fields and different data analysis needs.
Why is Pandalyst
Pandalyst is open source and free to use, and its small paramete... See more
Pandalyst is a general large language model specifically trained to process and analyze data using the pandas library.
How is Pandalyst
Pandalyst has strong generalization capabilities for data tables in different fields and different data analysis needs.
Why is Pandalyst
Pandalyst is open source and free to use, and its small paramete... See more