The endosomal network maintains cellular homeostasis by sorting, recycling and degrading endocytosed cargoes. Retromer organizes the endosomal sorting pathway in conjunction with various sorting nexin (SNX) proteins. The SNX27-retromer complex has recently been identified as a major endosomal hub that regulates endosome-to-plasma membrane recycling by preventing lysosomal entry of cargoes. Here, we show that SNX27 directly interacts with FAM21, which also binds retromer, within the Wiskott-Aldrich syndrome protein and SCAR homologue (WASH) complex. This interaction is required for the precise localization of SNX27 at an endosomal subdomain as well as for recycling of SNX27-retromer cargoes. Furthermore, FAM21 prevents cargo transport to the Golgi apparatus by controlling levels of phosphatidylinositol 4-phosphate, which facilitates cargo dissociation at the Golgi. Together, our results demonstrate that the SNX27-retromer-WASH complex directs cargoes to the plasma membrane by blocking their transport to lysosomes and the Golgi.