GitHub - deepseek-ai/DeepSeek-Coder: DeepSeek Coder: Let the Code Write Itself

DeepSeek Coder comprises a series of code language models trained from scratch on both 87% code and 13% natural language in English and Chinese, with each model pre-trained on 2T tokens. We provide various sizes of the code model, ranging from 1B to 33B versions. Each model is pre-trained on repo-level code corpus by employing a window size of 16K ... See more

Replit AI is now free for all users . Over the past year, we’ve witnessed the transformative power of building software collaboratively with the power of AI. We believe AI will be part of every software developer’s toolkit and we’re excited to provide Replit AI for free to our 25+ million developer community.

To accompany AI for all, we’re releasin... See more

Our training data is pretty much from the same place as everybody else’s — which is pretty much the internet. Pretty much every big AI model just pulls off all the data it can, all the text it can, all the images it can. Scientifically speaking, we’re at an early point in the space, where everyone grabs everything they can, they dump it in a huge f... See more

Many of these projects are saving time by training on small, highly curated datasets. This suggests there is some flexibility in data scaling laws. The existence of such datasets follows from the line of thinking in Data Doesn't Do What You Think, and they are rapidly becoming the standard way to do training outside Google

一款适合需要处理大量非结构化AI数据的工具：datachain，支持多模态API调用和本地AI推理并行处理 可以用它结合大模型一起使用，来完成复杂的数据分析任务，比如做，数据处理和清洗、LLM分析和验证、图像分割等 支持图片、视频、文本、PDF、JSON、CSV、parquet等智能统一管理，自动保存处理记录和版本 可以直接从各种云存储，比如谷歌云、亚马逊云或者本地读取数据，无需手动复制 支持智能搜索和分析，支持超大数据集处理、并行处理 github：https://t.co/bJ9rKKuMBY... See more

Text embeddings are a critical piece of many pipelines, from search, to RAG, to vector databases and more. Most embedding models are BERT/Transformer-based and typically have short context lengths (e.g., 512). That’s only about two pages of text, but documents can be very long – books, legal cases, TV screenplays, code repositories, etc can be tens... See more