We investigate the non-Markovian dynamics of two-state systems in structured reservoirs. We establish a connection between two theoretical quantum approaches, the pseudomodes [ B. M. Garraway Phys. Rev. A 55 2290 (1997)] and the recently developed non-Markovian quantum jump method [ J. Piilo et al. Phys. Rev. Lett. 100 180402 (2008)]. This connection provides a clear physical picture of how the structured reservoir affects the system dynamics, suggesting the role of the pseudomodes as effective description of environmental memory.