Posted inArtificial Intelligence Python PyTorch Web Dev
Offload LLM using Facebook FairScale
What is Fairscale FairScale is an open-source library from Facebook. It help researchers and engineers…
Posted inArtificial Intelligence Python PyTorch
DeepSpeed API ZeRO Offload
The biggest problem in Deep learning and training large language models (LLMs) is the limit…
Posted inArtificial Intelligence Python PyTorch
Offload LLM custom back propagation
What is Model Offloading? Model offloading, as described in the DeepSpeed ZeRO's paper, refers to…
Posted inArtificial Intelligence
Wandb get started
Weights & Biases (W&B) is an MLOps platform, equipped with tools to help you visualize…
Posted inArtificial Intelligence PyTorch
How to generate prompts with 4x less GPU memory
What is 32-bit full precision training and 16-bit half precision training? This picture pretty much…
Posted inArtificial Intelligence Python PyTorch
NanoGPT – My takes
NanoGPT is develop by Andrew Karpathy, a Lead engineer from Tesla. The simplest, fastest repository…
Posted inArtificial Intelligence Matplotlib
Top 5 features on MatPlotlib for Deep Learning
Matplotlib is an incredibly powerful tool for visualization that no data engineer should overlook. Before…
Posted inArtificial Intelligence Python
Tensorboard summary writer 101
Tensorboard is a very convenient way to record a neural network's weights and parameters while…
Posted inArtificial Intelligence
Nvidia CUDA setup on Ubuntu 22.04 for GPU training
AMD vs Nvidia GPU Pytorch and TensorFlow both support AMD and Nvidia, but Nvidia CUDA…
Posted inArtificial Intelligence
Long term memory for LLM chatbot app
The limit of LLM There is an input size limit for all LLMs. GPT-4 has…