Nicolay Gerold
@nicolaygerold
Nicolay Gerold
What is Pingora
Pingora is a Rust framework to build fast, reliable and programmable networked systems.
Pingora is battle tested as it has been serving more than 40 million Internet requests per second for more than a few years.
Pingora is a Rust framework to build fast, reliable and programmable networked systems.
Pingora is battle tested as it has been serving more than 40 million Internet requests per second for more than a few years.
GitHub - cloudflare/pingora: A library for building fast, reliable and evolvable network services.
Backend-Tools and Rust
📦 Service Deployment - Ray Serve (https://lnkd.in/eAV-Y6RN)
🧰 Data Transformation - Ray Data (https://lnkd.in/e7wYmenc)
🔌 LLM Integration - AIConfig (https://lnkd.in/esvH5NQa)
🗄 Vector Database - Weaviate (https://weaviate.io/)
📚 Supervised LLM Fine-Tuning - HuggingFace TLR (https://lnkd.in/e8_QYF-P)
📈 LLM Observability - Weights & Biases Traces (https... See more
🧰 Data Transformation - Ray Data (https://lnkd.in/e7wYmenc)
🔌 LLM Integration - AIConfig (https://lnkd.in/esvH5NQa)
🗄 Vector Database - Weaviate (https://weaviate.io/)
📚 Supervised LLM Fine-Tuning - HuggingFace TLR (https://lnkd.in/e8_QYF-P)
📈 LLM Observability - Weights & Biases Traces (https... See more
Paul Venuto • feed updates
Open-Source Pre-Processing Tools for Unstructured Data
The unstructured library provides open-source components for ingesting and pre-processing images and text documents, such as PDFs, HTML, Word docs, and many more. The use cases of unstructured revolve around streamlining and optimizing the data processing workflow for LLMs. unstructured modular... See more
The unstructured library provides open-source components for ingesting and pre-processing images and text documents, such as PDFs, HTML, Word docs, and many more. The use cases of unstructured revolve around streamlining and optimizing the data processing workflow for LLMs. unstructured modular... See more
Unstructured-IO • GitHub - Unstructured-IO/unstructured: Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.
End to end ML Project
Project setup:
Model training:
Run: python main.py
Model... See more
Project setup:
- Open this in VSCode
- Install Dev Containers
- Do Cmd + Shift + P -> Dev Containers: Rebuild Container Without Cache
- Activate the conda virtual environment: source activate endtoend
- Inside Dev Container, run mlflow and prefect local servers: nohup bash ./start_backend.sh
Model training:
Run: python main.py
Model... See more
arghhjayy • GitHub - arghhjayy/EndToEndML: End to end ML pipeline written with open source tools exclusively
In order to don’t just stop the liking but also craving you have to find ways to module these glucose monitoring cells. One option is dishavituation by avoiding high sugar foods.
Andrew Huberman • Dr. Charles Zuker: The Biology of Taste Perception & Sugar Craving
Intuition : Prompt tokens add very little latency to completion calls. Time to generate completion tokens is much longer, as tokens are generated one at a time. Longer generation lengths will accumulate latency due to generation required for each token.
OpenAI Platform
Indexify - Extraction and Retrieval from Videos, PDF and Audio for Interactive AI Applications
Indexify is an open-source engine for buidling fast data pipelines for unstructured data(video, audio, images and documents) using re-usable extractors for embedding,... See more
LLM applications backed by Indexify will never answer outdated information.
Indexify is an open-source engine for buidling fast data pipelines for unstructured data(video, audio, images and documents) using re-usable extractors for embedding,... See more
tensorlakeai • GitHub - tensorlakeai/indexify: A scalable realtime and continuous indexing engine for Unstructured Data to build Generative AI Applications
The value of data is the value of what you can do with it. Therefore, the more you’re allowed to do — the more usage rights the seller grants you — the more you should be willing to pay! This is a pricing effect that’s completely independent of quality, quantity, dataset internals, or table stakes status.
Common usage rights include:
Common usage rights include:
- Scope of use
How to Price a Data Asset
Scientific Research
At Your Fingertips
Epsilon uses AI to answer research questions with academic literature
At Your Fingertips
Epsilon uses AI to answer research questions with academic literature