It depends. If you're only working inside one drawing file, and you're creating all the content inside the drawing, then there's probably no need for xrefs. But if you're creating multiple drawings that all need to share the same base information, then xrefs are kind of important. Also, if you're receiving files from outside sources, like an architect, then you should xref the architects files into your drawing.