Caveolin-1 (Cav-1) expression deficiency and autophagy in tumor stromal fibroblasts (hereafter fibroblasts) are involved in tumor proliferation and progression, particularly in breast and prostate cancer. The aim of this study was to detect the expression of fibroblastic Cav-1 and LC3B, markers of autophagy, in gastric cancer (GC) and to analyze their clinical significances. Furthermore, because Epstein-Barr virus (EBV)-associated GC (EBVaGC) is a unique subtype of GC; we compared the differential expression of fibroblastic Cav-1 and LC3B in EBVaGC and non-EBVaGC. Quantum dots (QDs)-based immunofluorescence histochemistry was used to examine the expression of fibroblastic Cav-1 and LC3B in 118 cases of GC with adequate stroma. QDs-based double immunofluorescence labeling was performed to detect the coexpression of Cav-1 and LC3B proteins. EBV-encoded small RNA was detected by QDs-based fluorescence in situ hybridization to identify EBVaGC. Multivariate analysis indicated that low fibroblastic Cav-1 level was an independent prognosticator (p = 0.029) that predicted poorer survival of GC patients. Positive fibroblastic LC3B was correlated with lower invasion (p = 0.032) and was positively associated with Cav-1 expression (r = 0.432, p < 0.001). EBV infection did not affect fibroblastic Cav-1 and LC3B expression. In conclusion, positive fibroblastic LC3B correlates with lower invasion, and low expression of fibroblastic Cav-1 is a novel predictor of poor GC prognosis.