Posted inArtificial Intelligence Python PyTorch Web Dev
Offload LLM using Facebook FairScale
What is Fairscale FairScale is an open-source library from Facebook. It help researchers and engineers…
Posted inArtificial Intelligence Python PyTorch
DeepSpeed API ZeRO Offload
The biggest problem in Deep learning and training large language models (LLMs) is the limit…
Posted inArtificial Intelligence Python PyTorch
Offload LLM custom back propagation
What is Model Offloading? Model offloading, as described in the DeepSpeed ZeRO's paper, refers to…
Posted inArtificial Intelligence
Wandb get started
Weights & Biases (W&B) is an MLOps platform, equipped with tools to help you visualize…
Posted inArtificial Intelligence PyTorch
How to generate prompts with 4x less GPU memory
What is 32-bit full precision training and 16-bit half precision training? This picture pretty much…
Posted inArtificial Intelligence Python PyTorch
NanoGPT – My takes
NanoGPT is develop by Andrew Karpathy, a Lead engineer from Tesla. The simplest, fastest repository…
Visual Studio Code debug settings
Include environment { // Use IntelliSense to learn about possible attributes. // Hover to view…
Posted inArtificial Intelligence Matplotlib
Top 5 features on MatPlotlib for Deep Learning
Matplotlib is an incredibly powerful tool for visualization that no data engineer should overlook. Before…
Posted inPython
Useful Anaconda commands
Create environment If you're juggling multiple projects like I am, keeping your packages and dependencies…
Posted inArtificial Intelligence Python
Tensorboard summary writer 101
Tensorboard is a very convenient way to record a neural network's weights and parameters while…