ml logs
Hi I'm Jason Quach. I'm an AI/ML Engineer. This log is just for some things I work on and study outside of my job to share and document.Consider these nothing more than crackpot ramblings and a whirlwind of thought doodles.
Batch vs. Layer Normalization Just a comparison between the two normalization methods. After implementing several transformer models from scratch that utilize Layer Normalization; I figured I might as well review it's inception and purpose in more detail as a first post.
Published: Sept 15, 2025
Last Edited: Sept 18, 2025