glaiveai/glaive-coder-7b · Hugging Face

DeepSeek Coder comprises a series of code language models trained from scratch on both 87% code and 13% natural language in English and Chinese, with each model pre-trained on 2T tokens. We provide various sizes of the code model, ranging from 1B to 33B versions. Each model is pre-trained on repo-level code corpus by employing a window size of 16K ... See more

Trying to get a better understanding of how prompts work in relation to fine-tunes, and trying to see if any of them are actually reliable enough to be used in a "production" type environment.

My end goals are basically

• A reliable AI assistant that I know is safe, secure and private. Any information about myself, my household or my proprietary ideas

... See more

Some techniques I have seen in the wild

Create a semi-strict programming language like promptlang - https://github.com/ruvnet/promptlang

this style was popular back in the early days of gpt-3.5 when it landed, for some reason, it fell out of fashion

Write a super long persona mapping prompt with a well defined action space

Best example of this is the V... See more

Zephyr is a series of language models that are trained to act as helpful assistants. Zephyr-7B-α is the first model in the series, and is a fine-tuned version of mistralai/Mistral-7B-v0.1 that was trained on on a mix of publicly available, synthetic datasets using Direct Preference Optimization (DPO). We found that removing the in-built alignment o... See more

Meet Cody We’re building the only AI coding assistant that knows your entire codebase Cody answers technical questions and writes code directly in your IDE, using your code graph for context and accuracy.

Fine-Tuning for LLM Research by AI Hero

This repo contains the code that will be run inside the container. Alternatively, this code can also be run natively. The container is built and pushed to the repo using Github actions (see below). You can launch the fine tuning job using the examples in the https://github.com/ai-hero/llm-research-examples pr... See more

Welcome to prompttools created by Hegel AI! This repo offers a set of open-source, self-hostable tools for experimenting with, testing, and evaluating LLMs, vector databases, and prompts. The core idea is to enable developers to evaluate using familiar interfaces like code, notebooks, and a local playground.

In just a few lines of codes, you can t

... See more