Phosphatase and actin regulator 4 (Phactr4) is a newly discovered protein that inhibits protein phosphatase 1 and shows actin-binding activity. We previously found that Phactr4 is expressed in the neurogenic niche in adult mice, although its precise subcellular localization and possible function in neural stem cells (NSCs) is not yet understood. Here, we show that Phactr4 formed punctiform clusters in the cytosol of subventricular zone-derived adult NSCs and their progeny in vitro. These Phactr4 signals were not associated with F-actin fibers but were closely associated with intermediate filaments such as nestin and glial fibrillary acidic protein (GFAP) fibers. Direct binding of Phactr4 with nestin and GFAP filaments was demonstrated using Duolink protein interaction analyses and immunoprecipitation assays. Interestingly, when nestin fibers were de-polymerized during the mitosis or by the phosphatase inhibitor, Phactr4 appeared to be dissociated from nestin, suggesting that their protein interaction is regulated by the protein phosphorylation. These results suggest that Phactr4 forms functional associations with intermediate filament networks in adult NSCs.