Posted inWork
My work as a control engineer
I worked for Trimble for a few years. My team is in charge of the…
Posted inWork
My work at Caterpillar
I worked for Caterpillar for a few years. My team in charge of a part…
Posted inArtificial Intelligence Python PyTorch Web Dev
Offload LLM using Facebook FairScale
What is Fairscale FairScale is an open-source library from Facebook. It help researchers and engineers…
Posted inArtificial Intelligence Python PyTorch
DeepSpeed API ZeRO Offload
The biggest problem in Deep learning and training large language models (LLMs) is the limit…
Posted inArtificial Intelligence Python PyTorch
Offload LLM custom back propagation
What is Model Offloading? Model offloading, as described in the DeepSpeed ZeRO's paper, refers to…
Posted inArtificial Intelligence
Wandb get started
Weights & Biases (W&B) is an MLOps platform, equipped with tools to help you visualize…
Posted inArtificial Intelligence PyTorch
How to generate prompts with 4x less GPU memory
What is 32-bit full precision training and 16-bit half precision training? This picture pretty much…
Posted inArtificial Intelligence Python PyTorch
NanoGPT – My takes
NanoGPT is develop by Andrew Karpathy, a Lead engineer from Tesla. The simplest, fastest repository…
Visual Studio Code debug settings
Include environment { // Use IntelliSense to learn about possible attributes. // Hover to view…
Posted inArtificial Intelligence Matplotlib
Top 5 features on MatPlotlib for Deep Learning
Matplotlib is an incredibly powerful tool for visualization that no data engineer should overlook. Before…