Glycosylation is a common and widespread post-translational modification that affects a large majority of proteins. Of these, a small minority, about 20, are specifically modified by the addition of heparan sulfate, a linear polysaccharide from the glycosaminoglycan family. The resulting molecules, heparan sulfate proteoglycans, nevertheless play a fundamental role in most biological functions by interacting with a myriad of proteins. This large functional repertoire stems from the ubiquitous presence of these molecules within the tissue and a tremendous structural variety of the heparan sulfate chains, generated through both biosynthesis and post synthesis mechanisms. The present review focusses on how proteoglycans are “gagosylated” and acquire structural complexity through the concerted action of Golgi-localized biosynthesis enzymes and extracellular modifying enzymes. It examines, in particular, the possibility that these enzymes form complexes of different modes of organization, leading to the synthesis of various oligosaccharide sequences.