Welfare recipients in Germany are allowed to take up supplementary jobs while receiving welfare. The possibility of having a supplementary job was introduced to reduce welfare dependency and facilitate successful labor market integration. In the present study, we use the German Panel Study "Labour Market and Social Security" (PASS) for the years 2006-2014 to analyze the impact of supplementary jobs on the chances of welfare exit. Dynamic multinomial logit models controlling for unobserved heterogeneity and the problem of initial conditions reveal that (part- and full-time) employed males are more likely to exit welfare receipt into employment than their non-employed counterparts. This effect is not driven by household composition changes or earnings increases of household members. For women, however, we find only stepping stone effects for full-time supplementary jobs during welfare receipt. Women having a supplementary part-time job have an even lower probability of leaving welfare into full-time employment.