Youth Unemployment and Active Labor Market Policies in Europe

Since the economic crisis in 2008, European youth unemployment rates have been persistently high at around 20% on average. The majority of European countries spends significant resources each year on active labor market programs (ALMP) with the aim of improving the integration prospects of struggling youths. Among the most common programs used are training courses, job search assistance and monitoring, subsidized employment, and public work programs. For policy makers, it is of upmost importance to know which of these programs work and which are able to achieve the intended goals – may it be the integration into the first labor market or further education. Based on a detailed assessment of the particularities of the youth labor market situation, we discuss the pros and cons of different ALMP types. We then provide a comprehensive survey of the recent evidence on the effectiveness of these ALMP for youth in Europe, highlighting factors that seem to promote or impede their effectiveness in practice. Overall, the findings with respect to employment outcomes are only partly promising. While job search assistance (with and without monitoring) results in overwhelmingly positive effects, we find more mixed effects for training and wage subsidies, whereas the effects for public work programs are clearly negative. The evidence on the impact of ALMP on furthering education participation as well as employment quality is scarce, requiring additional research and allowing only limited conclusions so far.


Introduction
Young individuals entering the labor market are generally considered to be an at-risk population. They face a higher risk of unemployment than older workers, are more likely to switch between states of joblessness, training and working, and are more likely to enter temporary or precarious types of employment (see, e.g., Quintini, Martin, and Martin, 2007).
One reason for the lower labor market attachment of youth is their initially low labor market experience. During the school-to-work transition period labor market entrants tend to learn about their abilities and preferences by "job-shopping" (Topel and Ward, 1992), resulting in higher rates of turn-over and more frequent periods of non-employment. At the same time, firms commonly face higher costs of investment and lower costs of termination when employing young workers, making the youth labor market situation more sensitive to demand-side fluctuations which was recently demonstrated in the aftermath of the financial crisis 2007/2008 (Verick, 2011;Bell and Blanchflower, 2010;Choudhry, Marelli, and Signorelli, 2012). Between 2008 and 2009 youth unemployment rates increased by about five percentage points to a 20% average, until 2013 they further climbed to 24%; during the same time period adult unemployment rate changed from 6% to 10%. 1 High and persistent levels of youth unemployment give rise to concern, as the negative consequences of extended spells of unemployment early in the career are well documented.
One the one hand, joblessness is directly associated with psychological distress and financial hardship for the affected youth (Goldsmith, Veum, and Darity, 1997). On the other hand, early unemployment spells may have negative effects on later-life outcomes such as lower wages (Arulampalam, 2001;Skans, 2004;Gregg and Tominey, 2005;Kahn, 2010), lower labor market attachment (Gregg, 2001), lower well-being (Daly and Delaney, 2013), and a higher propensity to engage in criminal activities (Fougère, Kramarz, and Pouget, 2009;Bell, Bindler, and Machin, 2014). The immediate monetary costs of youth unemployment include direct costs for unemployment benefits and social assistance, as well as indirect costs of foregone tax payments and social security contributions. Calculations by Eurofund (2011) suggest that the immediate public costs accruing from youth neither in education nor in employment (NEET) in the EU-26 amounted to 120 billion Euros (1% of GDP) in 2008, and 153 billion Euros (1.2% of GDP) in 2011, not accounting for discounted future costs and foregone payments due to the lowered labor market attachment in the long-run. In light of demographic change and increasing old-age dependency ratios, the burden of these costs are expected to further increase. Raising employment levels is seen as the most effective strategy with which countries can prepare for population ageing (European Commission, 2008) making the youth unemployment problem all the more urgent.
1 To smooth the school-to-work transition process, to prevent extended spells of unemployment or the complete withdrawal from the labor market, and to promote entry into stable employment relationships, policy makers in many countries resort to active labor market programs (ALMP). Prominent initiatives include the "New Deal for Young People (NDYP)" in the UK, "Jugend mit Perspektive (JUMP)" in Germany and the "Youth Unemployment Program (YUP)" in Denmark. More recently, the "Youth Guarantee (YG)" adopted by the European Union in 2013 called all member states to set up ALMP programs to ensure that unemployed youth were offered high quality employment or education opportunities within four months of entering unemployment (European Commission, 2014). The types of programs most commonly used can be divided into four categories, i.e., labor market training, job search assistance and monitoring, wage subsidies and public sector work programs. Given the relatively high rates of youth unemployment it is not 2 surprising that large shares of the active youth population participate in ALMP as can be seen in Figure 1. The average youth unemployment rate in the presented countries was at 23% in 2012 and on average 9% of the active youth participated in ALMP. Unfortunately, however, the quantitative importance attributed to the use of ALMP to fighting youth unemployment stands in stark contrast to the low level of knowledge we have regarding their effectiveness. Grubb (1999) provides a descriptive summary of the early evidence (up to 2000) on the effectiveness of specific ALMP for disadvantaged youth in the US. He concludes that training and education measures are largely unsuccessful, but points to promising combinations of training with a close labor market link and additional support schemes.
Reproducing the negative findings on training programs for OECD countries, Martin and Grubb (2001) suggest that wage subsidies are among the most promising programs for youths. Heckman, LaLonde, and Smith (1999) study the evidence of ALMP in the US and Europe reaching the conclusion that none of the program types substantially benefit unemployed youth. A meta-analysis of European ALMP evaluation studies up to the year 2000 is provided by Kluve, Schmidt, van Ours, and Vandenbussche (2002) who find that youth tend to benefit less from ALMP participation than adults. Similar results emerge in the more recent and comprehensive meta-analyses by Kluve (2010) and Card, Kluve, and Weber (2010) showing that programs targeted at youths, and in particular those involving training, are less effective in increasing employment levels than programs targeted at the general population of unemployed.
The particularity of the youth labor market situation and the results from the metaanalyses suggest that assessments of the effectiveness of ALMP for adults are most likely not valid for youth. So far, no consensus exists on the effectiveness of the different ALMP programs for this age group. With this study we aim to fill this gap. Aggregating the evidence of a substantial number of recent studies assessing the effectiveness of ALMP for youth, we provide a comprehensive re-assessment of the question which policies work for whom and under which conditions. Unlike the recent meta-analyses we thereby pay special attention to the specificity of the youth labor market situation, highlighting the particularities that might promote or mitigate the effects of ALMP programs for young individuals. In line with the previous literature we focus on the micro-evidence of the effectiveness of ALMP, distinguishing between the four types of programs that are most commonly employed to promote a direct labor market entry: labor market training, job search assistance and monitoring, wage subsidies and public sector work programs. Besides focusing on the effect of ALMP on employment take-up, we also examine the evidence available on education participation, and the findings on the quality of the accepted employment whenever available. The paper is organized as follows. Section 2 gives a quick overview of the labor market situation of youth in Europe and discusses the role of ALMP. Section 3 presents the collected evidence on the effects of the different policies, before Section 4 concludes.  (1) shows that there exists substantial variation across countries in the unemployment rates 2 for youth below 25 years, ranging from 8% in Germany to over 40% in Italy, Spain and Greece. Similarly, the share of youth in long-term unemployment in column (3) ranges from 5% to 7% in Finland and Sweden to over 50% in Italy, Greece and the Slovak Republic. As these cross-country differences are linked to differences in economic performance or the institutional set-up, youth-specific labor market patterns are highlighted when relating youth labor market outcomes to those of more senior workers. In particular, this reveals that the youth labor market situation across countries shares several common features. The youth/adult unemployment ratio in column (2) shows that youth are, on average, two to three times more likely to be unemployed than adult workers -with the largest differences observed in Sweden, the UK, and Italy. At the same time, the probability of becoming long-term unemployed is commonly substantially lower for youths than for adults. The relative shares of long-term unemployed between youth and adults depicted in column (4) show that youth long-term unemployment risk is, on average, only two thirds the value of adult long-term unemployment.
Part of the differences in the youth-adult (long-term) unemployment risk can be explained by the higher job mobility and the higher likelihood to enter inactivity among youth. As depicted in columns (5) and (6) of Table 1, the inactivity rate 3 among youth ranges between below 30% (Netherlands, Switzerland and Iceland) and 70% (Greece, Hungary, Luxemburg and Italy). On average, they are hence about four times more likely to be inactive than adults. While part of this higher inactivity is driven by entry into formal education -note, that countries with an extensive apprenticeship-based secondary education system in which youth are counted as working, such as Germany, Austria, Denmark and Switzerland, exhibit a much lower inactivity rate -youth are generally also less attached to the labor market, and hence more likely to withdraw from labor force. An indicator capturing the size of this risk group are the share of youth neither in education nor in employment (NEET). Column (7) shows that about one third of countries exhibit NEET shares above 20% among the age group of 20 to 24-year-olds; with the Southern European countries (Italy, Portugal, Spain and Greece), some Eastern European countries (Poland, Slovak Republic and Hungary) and Ireland being affected most heavily.
The labor market transition of youth is generally highly correlated with the levels of educational attainment (Quintini, Martin, and Martin, 2007). Averaged European unemployment rates from 2013 suggest that youth who have obtained at most a schooling degree at the lower secondary level are 1.7-times more likely to be unemployed than youth who have at most obtained an upper secondary degree, and about two times more likely to be unemployed than youth with a tertiary education degree. In the Southern European countries that were hit particularly hard during the economic crisis -Greece, Italy, Portugal and Spain -the unemployment rates of lower secondary and upper secondary school grad-uates only differ by a factor of 1.1 in favor of the higher educated. In the other European countries, the respective unemployment rates differed by a factor of 1.8 (Eurostat, 2013). 4 Differences in economic conditions, education and labor market policies may result in systematic cross-country differences in the chances of youth to enter the labor market. As outlined above, youth from countries that were hit hardest by the economic crisis (Southern European countries, Ireland) and that are hence plagued with structurally low labor demand, are more likely to be (long-term) unemployed, more likely to enter inactivity, and to experience lower returns to education. Several studies underline the close relation between labor market institutions, e.g., hiring policies, minimum wages, and youth unemployment levels (Jimeno and Rodríguez-Palenzuela, 2003;Addison and Teixeira, 2003;Bertola, Blau, and Kahn, 2007). The close link between the schooling system and labor market entry of youth is documented most intensely. On the one hand, the general schooling system may affect the tendency of youth to leave school early, i.e, to finishing their education with a degree at the lower secondary or lower level, with the consequence of experiencing more difficulties entering the labor market. On the other hand, the structure of post-mandatory, professional education options affects the youth labor market transition. In countries with established vocational education tracks or an extensive apprenticeship system, youth participating in vocational education tend to experience a faster entry into the labor market than youth entering the labor market after participating in mostly general education (Ryan, 2001;Hanushek, Woessmann, and Zhang, 2011;Neuman and Ziderman, 1999;Winkelmann, 1996;Riphahn and Zibrowius, 2015). 5 The reason for this faster entry due to vocational education is seen in an improved short-run alignment of the supply and demand for skills.
In particular, skill or qualification mismatch is likely to reduce the quality and stability of initially accepted jobs (Wolbers, 2003), with potentially long-lasting negative effects of later-life labor market outcomes (Liu, Salvanes, and Sørensen, 2012). At the same time, the increasing phenomenon of over-education (Quintini, 2011) may result in decreased chances of low-skilled workers finding employment due to crowding-out (Borghans, de Grip, and Network, 2000;Dolado, Felgueroso, and Jimeno, 2000). According to Quintini (2011), the Netherlands, Greece, Spain, Sweden, Luxembourg and Portugal are amongst the countries with highest levels of over-qualification. 4 The country-average is based on Belgium, Czech Republic, Denmark, Germany, Estonia, Ireland, Greece, Spain, France, Italy, Luxemburg, Hungary, Netherlands, Austria, Poland, Portugal, Slovenia, Finland, Sweden and UK.
5 European countries with the most developed vocational education and apprenticeship systems are, e.g., Germany, Austria, Switzerland, Denmark and partially also the Netherlands. See Eichhorst, Rodríguez-Planas, Schmidl, and Zimmermann (2015) for a more detailed definition and assessment of the role of vocational education in industrialized countries.

The Role of Active Labor Market Policies
The primary objective of active labor market programs for youth is to integrate unemployed youth into the labor market, stabilize their career entry, and/or to promote the take-up of vocational training as an intermediate step to labor market entry. Column (8) in Table 1 shows that countries exhibit substantial differences with respect to participation in ALMP. While in Slovenia, Estonia and the Netherlands the share of youth in ALMP is below 10% of the unemployed youth population, it exceeds 100% in Austria, Germany and Hungary (meaning that individuals participate in more than one program on average).
Column (9) relates the share of unemployed youth participating in ALMP in to the share of unemployed adults participating in ALMP. An indicator larger than 1 shows that youth are over-represented in ALMP compared to adults (e.g. in Austria, France and Germany) while an indicator below 1 indicates that they are under-represented (e.g. in Denmark, Estonia and Finland).
The previous Section points to three areas of intervention depending on the source of the labor market problem: the stimulation of labor demand, the avoidance of long-term unemployment, and the elimination of educational mismatch. In case educational mismatch is at the root of the unemployment problem, ALMP training programs serve to align the skill-level of the unemployed youth to that of labor demand. As youth are more prone to engage in further formal education, it is sensible to distinguish short-and long-term training measures. While short-run programs tend to be of remedial nature, aiming to overcome minor and specific skill deficits, long-run training programs aim to overcome more structural skill deficits such as gaps in general education. As the latter types of programs stand in direct competition to formal education, their benefits need to be evaluated relative to regular schooling or training options and are thus likely to be less strong than programs for adults who would otherwise not engage in any education. Also, depending on the types of professional education options available, ALMP training may not be similarly valued as formal education by employers and participation in them may entail negative stigmatization effects. A smaller part of training ALMP are preparatory training programs that promote the take-up of regular formal education, such as the continuation of general schooling, or participation in apprenticeship-based vocational education.
Since the returns to upgrading skills may be low if the overall demand for youth labor is low -as outlined above -a second issue to be addressed by ALMP programs is the stimulation of youth labor demand. There are several reasons why the demand for youth labor may be low. First, youth are commonly the ones most affected by economic downturn, as firms may be less willing or able to let go of workers with longer tenure. Second, even under normal economic conditions, employers may prefer hiring more experienced workers, in particular, if previous work credentials or colleague referrals allow employers to discriminate 7 better between low and high ability workers (compare Montgomery, 1991, for a theoretical analysis of employee referrals). Third, in the presence of job-specific human capital, firms may be less willing to hire youth and invest in costly training if there is a high probability that youth leave the firm without redeeming this initial investment (see, for an extensive summary of firm's training involvement Wolter and Ryan, 2011). Hence, if low work-or job-specific experience are barriers to initial labor market entry, the provision of financial incentives for employers to hire and train young people may constitute an effective tool to improve labor market integration. As youth gain more experience and firms are better able to observe their ability, it is intended that youth are offered regular work contracts following the initial subsidy period. Cockx and Picchio (2013) further suggest that stigmatization rather than the depreciation of human capital may be the source of state-dependence in long-term unemployment among youth. Following this line of reasoning, wage subsidies promoting the take-up of "real" employment, albeit subsidized, may help youth signal their employability.
A third issue to be addressed by ALMP is the avoidance of long-term unemployment spells, which were found to have particularly detrimental long-term effects for youth (see Section 1). Job search programs and tight monitoring schemes aim to achieve a fast activation of youth early in the unemployment spell. As youth are more likely to enter inactivity as a response to longer spells in unemployment, these measures may also prevent complete withdrawal of youth from the labor market in the long-run. A potential downside of these approaches is that they may result in a direct withdrawal from the labor market when monitoring and sanction are imposed too fiercely. Studies for adult unemployed find that monitoring and sanctioning increase take-up of employment, but may also result in withdrawal from the labor market (see, e.g., Arni, Lalive, and Van Ours, 2013;van den Berg, Hofmann, and Uhlendorff, 2013). Because of the higher risk of youth of entering inactivity, higher intensity activation schemes may result in stronger drop-out responses among youths compared to adults. In a similar vein, but targeted at more disadvantaged youth, public employment schemes are used to keep youth in the labor market, by offering a work-like environment including low levels of payment. While these types of programs are usually ineffective for adults, they could provide a stepping-stone for youth when combined with training for regular jobs.
A general issue arising from the previous Section is that youth tend to experience higher labor market mobility than adults, the consequences of which on labor market outcomes are ambiguous. On the one hand, job changes may allow an upward movement in the career-and wage-ladder and allow youth to become aware of their skills and preferences (Topel and Ward, 1992). On the other hand, it has been found that job-changes promote further job-changes (occurrence dependence) and that early job instability significantly reduces later wages (see, e.g., Neumark and Wascher, 2006;Doiron and Gørgens, 2008).
Consequentially, ALMP programs should also be measured by their ability to improve the job match quality and stability of accepted employment. If participation in ALMP helps youth to learn about their preferences, career or schooling opportunities, or allow to signal their abilities to employers, this is likely to improve choices and stability of subsequent employment. Against this background it is particularly interesting to assess the long-run effects of, e.g., training measures or financial incentives to employers, as the benefits of these measures may lie in an increased long-run stability of employment.

Active Labor Market Policies and Their Effects
In this Section, we summarize the findings of 37 evaluation studies assessing the impact of ALMP measures for youth in Europe (see Table A.1 for a full list of studies). We include evaluation studies that consider programs specifically targeted at unemployed youths, as well as evaluation studies assessing the performance of general ALMP programs including a subgroup-specific analysis for youth. Tables A.2 to A.5 in the Appendix provide a brief overview of the studies included in the analysis, classified by the type of program under investigation. In line with the most common types of ALMP encountered in practice, four broad types of programs are distinguished: labor market training, job search assistance and monitoring, wage subsidies, and public sector work programs.
We restrict our overview to studies that convincingly address the problem of non-random selection into treatment, e.g., by conducting randomized field experiments, exploiting exogenous variation in program access, controlling for a large set of informative control variables, or using other state-of-the-art econometric evaluation techniques. The bulk of evaluation studies use the conditional independence or "unconfoundedness" assumption for identification, thus assuming that controlling for observed characteristics is sufficient to capture selection into the different treatment options. The ALMP evaluation literature offers some guidelines regarding the most informative characteristics to be included to control for nonrandom selection (e.g., Lechner and Wunsch, 2013;Caliendo, Mahlstedt, and Mitnik, 2014), and we preselected studies adhering to these guidelines. However, it is clear that by the short previous labor market history of youth and the stronger variability in terms of initial labor market attachment, there is a risk that unobserved heterogeneity plays an even stronger role for the youth than for the adult working population.
Next to considering the employment effect of the ALMP programs, we also assess, where available, program impact estimates on education participation and the quality of accepted employment. On the one hand, participation in education constitutes a relevant outcome of interest as youth may wish to continue further formal education once exposed to the treatment rather than entering the labor market directly. Under the assumption that higher levels of human capital result in a better long-term labor market prospects, this may also be a desirable outcome of ALMP programs for youth. On the other hand, as youth tend to consider participation in formal education as an alternative to remaining unemployed, short-run positive employment effects of policies may arise due to control group entering education rather than remaining unemployed. As it is not clear how the return to labor market policy programs compare to that of formal education participation, this substitution effect should be kept in mind when evaluating the effect of ALMP for youth.
In the next four subsections we briefly describe the programs under consideration, the evidence we collected on their effects, and summarize the main findings; subsection 3.5 condenses the findings across programs and outcome variables and concludes.

Labor Market Training
Program Description: Labor market training courses are one of the main interventions used to integrate unemployed individuals into employment. The training can be very heterogenous, ranging from purely classroom-based training to purely on-the-job training within firms, with varying durations between a couple of weeks to over one year. The purpose of these labor market training programs is to extend or to adapt the labor market relevant skill set of participants, so that a faster and more stable integration into employment can be achieved. Training programs within firms serve the additional purpose of providing youth with some level of work experience and send productivity signals to employers, making them potentially more likely to hire participants later on. This additional "foot-in-the-door" effect of within-company training may be particularly relevant for youth with limited signals of prior labor market participation. It may hence be expected that, all else equal, within-firm training has a better employment effects than formal classroom training. At the same time, by being more practically oriented, firm-based training tends to be offered predominantly to disadvantaged youth with stronger barriers towards direct labor market integration. This differential selection into classroom-based and school-based training programs suggests that the evaluation results for these two programs are not readily comparable.
Evaluation Results: In total, we collected evidence from 19 studies in 8 countries. Overall, the employment effects of purely classroom-based labor market training are mixed, showing both positive and zero employment effects. Abstracting from negative locking-in effects during participation, only one of the studies (Norway) finds a negative longer-term employment effect. Three studies also assessing the effect of classroom-based training on unemployment or education show that a positive employment effect often coincides with a zero effect on the unemployment levels (see Table A.2 for details) or a negative effect on education. This confirms the hypothesis that classroom-based training may result in a crowding out of formal education or serve as a substitute for it. The close link between ALMP training and formal training participation is also supported by a study from Den-mark (1) assessing the effects of announcing labor market training to the unemployed. Here it is found that the "threat" of expected labor market training results in a increase in education take-up but no increase in the employment probability. It has to be noted that a large share of the evidence of classroom based training comes from Germany (five out of nine studies), but omitting these studies from the aggregation would not change the general conclusion.
The evidence of the employment effects of mixed school-and work-based training is somewhat more scarce and also more mixed: four studies find either positive, zero or negative effects. The negative results are found in the Swedish (3) and the Norwegian study, both examining a period during the early 1990's where both economies experienced a tremendous downturn. 6 Hence, the evidence is likely to be affected by these economic circumstances.
The French (1) study finds zero (negative) 7 effects for the higher educated and positive effects for youth with low previous education, thus suggesting that work-based training is more beneficial for the more disadvantaged and may entail stigmatization for youth with higher schooling.
Studies analyzing the effectiveness of labor market training relative to other types of ALMP tend to find that training performs better or similar to public sector job creation but worse than practical work experience, as provided, e.g., by wage subsidies. The Swedish (5) study suggests that practical training works better than school-based training. Four studies assess the effect of classroom training on the match quality of subsequent jobs, as, e.g., reflected by the wage level or duration of employment spell. These studies mostly find a positive effect, but by the limited amount of evidence, further studies are needed to support this finding.
Summary: The overall effectiveness of ALMP training is heterogenous. Purely schoolbased training has either positive or no effects on employment but negative effects on participation in formal education. The effects of firm-based training or mixtures of firm-based and classroom training are more negative in terms of employment outcomes, but they seem to entail less of a trade-off in terms of education outcomes. While there is much less evidence for firm-based training overall, the negative evidence from Sweden and Norway may not be representative for the overall effectiveness as both pertain to periods with very negative labor market conditions, a situation in which training is likely to be less effective. However, two other studies (Germany and Finland) also show zero overall effects; the only positive evidence comes from France (for youth with low levels of previous education). A potential explanation for the lower effectiveness of mixed training is that the most disadvantaged youth for whom practical training programs are intended may require more intensive or additional support. Negative employment effects for youth with higher levels of previous education could be due to the low reputation of practical training and participation in such programs exhibits stigmatization effects.

Job Search Assistance and Monitoring
Program Description: Job search assistance measures comprise counseling and mentoring activities by caseworkers of the public employment services or external providers, including the provision of vacancy information as well as short-term training or coaching programs assisting youth in their application process. A primary focus of these programs is to increase the commitment and motivation of job search among youth. In most countries, this comes with higher intensity support and is also linked to higher levels of monitoring.
This, in combination with implicit or explicit threats of benefit sanctioning, is expected to increase compliance with job search requirements and thus increase the exit rate out of unemployment. Previous research points to the double-edged consequences of monitoring and sanctioning schemes, as increased unemployment exit rates in the short-run tend to come at the cost of lower quality job matches and decreased employment stability in the long-run. For youth, the effectiveness of sanctioning is a-priori uncertain, as youth may be more likely to resort to their parents for financial support. Consequentially, the threat of or even actual benefit withdrawal may push youth towards non-activity rather than into employment relationships.
Evaluation Results: Based on evidence from 16 studies in 8 countries, we find that counseling and monitoring results in significantly positive employment effects in the majority of evaluation studies (see Table A.3). We distinguish between studies of combinations of counseling and monitoring (eight studies), counseling without monitoring (four studies), and monitoring or/and sanctioning only (four studies). We find that the programs involving counseling tend to yield predominantly positive effects, irrespective of whether they involve monitoring. Out of the studies combining job search assistance and monitoring, the studies from Denmark (3), Portugal and Sweden (8) are the only ones that result in a zero or even a negative effect. The Danish study assesses the effects of job search just prior to the start of the economic crisis in 2008 and suggests that the combination of unfavorable economic conditions and a very high baseline activation in the control group may have resulted in a zero effect and an increased exit rate into inactivity among the treated. In Sweden (8) zero effects are found for long-term unemployed youth under difficult economic conditions, suggesting that job search activities may may not be sufficient for this difficult target group.
The Portuguese study in contrast explores a pilot project implemented during fairly benefi-12 cial economic conditions. It hence seems more plausible that the results are attributable to other factors, such as the low connectedness of the public employment services with local economic actors (Centeno, 2001).
Of the four studies assessing job search assistance alone, three studies explore the effects of changing from public to private providers of assistance. As private providers have higher monetary incentives to place the unemployed in stable employment, these studies aim to capture the effect of more intensive counseling, assuming that the provider change itself does not have an additional employment effect. The studies from Germany (3) and France (4) find positive employment effects of the provider change, while the Swedish study does not find an effect, suggesting that this is due to the high baseline activation for youth at the public employment services. Exploiting random differences in the share of youth changing from public to private providers, the French study shows that a higher counseling intensity at private providers entails significant displacement effects for youth not benefitting from the intensified counseling, in particular in areas with problematic labor market conditions.
The overall labor market effects of the intensified counseling in France was zero.
Monitoring alone yields either zero results (in Hungary and Sweden (4)), or short-run positive results (in Germany (8), UK (4)) and long-run negative results due to increased long-run exits from the labor force. The studies for Hungary and Sweden evaluate the effect of an increased (announced) monitoring intensity and do not find any affect on employment rates. While the program set-up differs in many details, both interventions are reported to exhibit rather low actual risks of sanctioning for non-compliance in job search or for turning down job offers, which may hence have resulted in a low level of compliance. The study in the UK in contrast considers a policy reform increasing the actual risk of sanctioning, finding that after an initially positive employment effect, the medium-run effects on employment are negative, as youth tend to resort to alternative sources of social benefits, exempting them from any job search activities. Furthermore, negative effects on wage levels are found, the absolute size of which are larger for youth than for adults. The study for Germany (8) assesses the effects of temporary benefit withdrawal and finds substantial positive short-run employment effects that are increasing with the intensity of the sanction. While the effect on employment quality is not available, the authors suggest that the complete withdrawal of benefits may have had substantial negative effects on employment quality or labor force participation.
Summary: In summary, the evaluation evidence suggests that job search assistance programs exhibit a similar effectiveness for youth as they do for the overall working population (Kluve, 2010). Positive long-run effects of job search assistance suggest that counseling may not only help youth find employment faster but also helps them enter more stable employment of higher quality. But further research is needed to corroborate the quality 13 aspects of job search assistance. The study from France (4) suggests that positive long-run results may arise due to displacement of non-treated youth. This would clearly lower the overall benefit of the intensified job search. At the same time, there is some evidence that job search assistance exhibits decreasing marginal returns for the treated. Several countries having developed intensified activation specifically for youth -e.g., Denmark, Sweden and Germany -report zero or even negative effects of additional activation (see for a German study on an intensified activation mix Wolff and Nivorozhkin, 2012). At the same time, the effectiveness of counseling and monitoring seems to be low under bad economic conditions and for long-term unemployed youth.
The small evidence available regarding the effect of monitoring and sanctioning suggests that youth respond positively to a sanction (threat of sanctioning) in terms of employment outcomes in the short-run, but they may also leave the labor force. Accompanying qualitative evidence of the consequences of sanctions suggests that the unemployed subject to sanctions are commonly those exhibiting more profound difficulties, such as family-related problems, mental illness or drug addictions. Sanctions further tend to aggravate this problem, so it does not seem advisable to use sanctions as a method to activate the most disadvantaged.

Wage Subsidies
Program Description: Subsidized wages or income support schemes are primarily aimed at providing a financial incentive for employers to hire youth with lower relative initial productivity. As employers may expect costs of initial training investment, or may need to pay wages exceeding the expected initial productivity, wage subsidies are intended to compensate employers for these incurred costs. For example, in the presence of minimum wage regulations, wage subsidies may bridge the gap between a productivity equivalent payment and the minimum wage. At the same time, if youth are unwilling to work for the low wages offered to them by employers, wage subsidies may increase the wage level and thus the incentives of youth to work. Commonly, wage subsidies are paid for a limited time period (between several months up to one or two years) in the hope that by the time the subsidy expires, youth have sufficiently increased their skill set to be hired under regular working contracts by the same or a different firm. Some programs combine the payment of a wage subsidy with vocational training arrangements in an apprenticeship-type working contract. The level of the subsidy varies; in Germany and the UK it amounted to 40% to 60% of the wage costs. Additionally in the UK, a lump-sum payment was paid for additional training expenses.
Evaluation Results: We have identified 8 studies in 6 countries examining wage subsidies (see Table A.4 for details). Studies for Belgium, Germany, Norway and Sweden consider the effectiveness of subsidized wage contracts in which training is not a prominent element and find that wage subsidies either increase employment levels or have a zero employment effect. As the programs set-up in Norway, Sweden and Germany were very similar, the zero employment effects found for Sweden and Norway may be linked to the very bad labor market conditions mentioned above. The set-up of the Belgium subsidy was somewhat different in that it was only for part-time working women who earned less than the fulltime minimum wage. The set-up included an in-built disincentive for employers to increase the wages of subsidy-recipients, and it was paid for an unlimited duration as long as the part-time workers were willing to accept fulltime employment if it became available. Despite the risk that the program would become a "part-time trap," the program showed substantial positive effects on the take-up of regular employment, which were most likely attributable to the work-experience during the subsidy. The beneficial labor market conditions during the observation period may have also contributed positively to this "stepping-stone" effect of the subsidy.
Three studies from France (2) and the UK (1 and 3) analyze the effects of wage subsidies in combination with training. In France, low-skilled youth benefitted less from this practical work than from regular short-term work contracts but benefitted similarly compared to public work schemes, which could again be explained by potential stigmatization of practical training schemes. The UK (1) study finds, in contrast, that recipients of wage subsidies exhibit a significantly positive wage growth in the long-run. In a comparative study for the UK (3), it is found that subsidized wages in combination with training performs best in terms of employment compared to all other ALMP programs.
Summary: While most of the studies find pronounced positive employment and wage effects of wage subsidies, an obvious caveat of wage subsidy programs is the high likelihood of deadweight effects arising from employers hiring youth with a wage subsidy even though they would have hired the youth without. This is generally difficult to measure and none of the empirical studies addresses this problem. A further issue to be taken into account is the problem of worker substitution, resulting in a zero-sum game, when workers eligible for the subsidy are hired at the expense of un-eligible but substitutable workers (e.g., unemployed below 25 years vs. older than 25 years). Riley and Young (2001) and Van Reenen (2004) assess the magnitude of substitution effects in context of the NDYP in the UK and find little to no evidence of substitution of different age groups. However, as not all youth participating in the NDYP took part in the wage subsidy program, this evidence may not be transferable to more intensive uses of subsidies. Unfortunately, we are unaware of any study addressing the magnitude of the substitution effect of wage subsidies directly.

Public Sector Work Programs
Program Description: Public Sector Work programs are state-funded temporary employment opportunities in the public sector that usually involve production of socially valuable goods or services. The programs are mainly aimed at creating employment opportunities and giving youth some work experience. While they may comprise parallel participation in practical training courses, they are often intended to familiarize inexperienced, disadvantaged youth with a routine work environment. Participants usually receive a low level of remuneration during participation. While this may increase the willingness of youth to participate in the program, this may also have the unintended effect of reducing the search effort for "real" jobs. Also, as public work programs do not establish contact to "real" firms or employers, they do not offer a direct way into the labor market.
Evaluation Results: The evaluation evidence for these programs is largely based on evidence from Germany and France, where we have identified five and two studies, respectively (plus one from the UK, see Table A.5). However, here, a rather homogenous picture arises in that work programs most commonly have zero effect on the employment outcomes.
While this may result from a very negative selection of youth into these programs, comparative studies also suggest that public work programs tend to perform worse in terms of employment outcomes than other ALMP options.

Summary:
The results for the young unemployed participating in public work programs are rather discouraging. Very similar to the results for the adult working population, we find overwhelmingly zero or negative effects. Hence, it is very questionable whether these programs are an adequate solution -even in challenging economic situations. Table 2 summarizes the findings from Sections 3.1 to 3.4 and provides a brief description of the identified effects for the four types of programs along three outcome dimensions. As we have already mentioned previously, the most common outcome examined is the integration into the first labor market, i.e., into regular employment, and (nearly) all studies provide evidence on that. Since this is not the only interesting outcome, we also summarize the effects on job quality and education where available. The first two outcome dimensions are usually also examined for the adult population, the last one is of interest in the given context of youth unemployment. Table 2 not only lists the number of studies, but also the number of estimated effects.

Summary of Results
These numbers can differ because some studies contain effects for different subgroups (e.g., with/without a formal school degree) and or regions (e.g., East and West Germany). If  we concentrate on the employment outcome first, we see that the most positive effects are found for job search assistance (12 positive out of 20), followed by wage subsidies (4 positive out of 8). The evidence for labor market training is mixed (11 positive, 12 insignificant and 6 negative), whereas the effect for public work programs is clearly negative (5 negative, 8 insignificant, 1 positive). With respect to education participation and employment quality, evidence is rather scarce. However, the cumulated evidence on training allows for the tentative conclusion that training has a negative effect on formal education participation (7 out of 11) and a positive effect on employment quality (5 out of 9). For the other types of programs, the evidence is too scarce to make a meaningful interpretation.
Differentiating training programs by purely classroom based training, training containing practical elements, and training within the firm, we find that purely classroom based training tends to perform somewhat better (9 positive, 9 zero, 2 negative) than mixed classroom and practical training schemes. As outlined in the text, this differential finding may be attributable to difference in characteristics of the participants or stigmatization effects related to participation in practical training. In contrast, when differentiating job search assistance evidence by studies looking at programs that include counseling versus programs that only include monitoring or sanctioning, the qualitative finding on employment outcomes does not change. Overall, it hence seems that job search assistance and wage subsidies perform similarly well in terms of improving employment outcomes of their participants. Classroom based training often performs similarly well, but risks to lose effectiveness if it stands in competition to regular formal education. Unfortunately, however, a further comparison in terms of education outcomes and employment stability is not possible due to the lack of evidence.
Unfortunately, most of the evaluation studies under consideration do not address the issue of costs-effectiveness of the respective programs. It is interesting however, to look at approximate calculations 8 based on the programm specific expenditure information drawn from the Eurostat Database. This suggests that the average per-capita expenditure are highest for wage subsidies (about 3,200 Euros), followed by training programs (2,500 Euros), job creation schemes (2,200) and job search services as the least expensive (1,200 Euros).
The relatively high costs of job creation schemes stand in contrast to their effectiveness, and are likely to be driven by having the disadvantaged youths as focus group. Based on the calculations by Eurofund (2011, p. 62ff.) of the country-specific costs of NEET arising due to yearly foregone earnings in 2008, the per-capita costs incurred by these ALMP programs can be compared with the costs incurred by not having youths in the labor force. This can provide a more tangible assessment of the importance of the costs of maintaining ALMP.
This exercise shows that the per capita cost of wage subsidies amount to about 40% of foregone earnings, 30% of foregone earnings in case of training programs, about 35% for job creation schemes and 10% for job search programs. 9 The costs of wage subsidies are quite sizeable, but given their above average effectiveness, they stand out relative to similarly costly job creation schemes that are often found to result in zero or negative employment effects. In contrast, the low relative costs of job search measures in combination with their relatively high effectiveness suggest that they are commonly cost-effective.

Conclusions
Reducing youth unemployment is a key challenge in many European countries, especially in the aftermath of the most recent economic slowdown. Youth are a population at risk and exhibit a much higher risk of becoming unemployed than the adult population. The youth-adult unemployment ratio ranged from 1.6 to 3.6 in 2013, but even in relatively calm economic circumstances, as in the pre-crisis years 2005 to 2007, the youth-adult unemployment ratio was between 2 and 3 on average. Keeping in mind that unemployment at early stages can have severe long-term consequences on labor market outcomes as well as on other socio-economic factors, policy-makers use active labor market policies as a potential solution and spend significant resources on them. Most commonly, four broad types of programs are distinguished: labor market training, job search assistance and monitoring, wage subsidies, and public sector work programs.
We review the existing evidence on the effectiveness of these different ALMP programs from evaluation studies in Europe addressing the potential problem of selection bias in a convincing way. What becomes immediately apparent is that the overwhelming majority of studies only assess the effects on employment take-up. While this is understandable given the main objective (and also comparable to the adult population), it might be too shortsighted for the youth population. Here, additional outcome dimensions -such as the take-up up of higher formal education or the job quality -should also be considered.
The presented evidence shows differences in the results across but also within different ALMP types. Job search assistance with and without monitoring results in overwhelmingly positive effects. These programs are usually not very cost intensive and seem to work in many different circumstances. However, it also seems that "too much" job search activation can result in zero or even negative employment effects, suggesting that they do not provide the optimal solution for all youth. Similarly, the question of whether job search and monitoring also lead to "better" jobs has not been addressed sufficiently by the literature. The few studies considering employment quality find rather mixed effects, suggesting, however, that harsh monitoring and sanctioning schemes result in negative employment outcomes.
Labor market training programs are most commonly used for youths and have been studied most extensively. The overall results are somewhat mixed: for less than half of the programs/sub-groups, positive effects are found; for the majority, we find insignificant or even negative effects. The negative findings are predominantly driven by the performance of combinations of classroom and practical training, as well as classroom-based training programs under adverse economic conditions in which an upgrading of skills may not be sufficient to improve labor market integration chances in the short-to medium-run. Excluding these studies, the evidence on classroom-based training is similarly positive to that of job search assistance. A particularity of classroom-based training ALMP is that it may reduce the take up of formal education. This crowding out of formal training is clearly an issue to be addressed in further research.
The hopes one might have had with public work programs are not met. Very similar to the results for the adult population, only one of the reviewed studies shows positive effects. Instead of providing a bridge to regular employment, they seem to entail locking-in or even stigmatization effects. It is thus questionable whether they should be used in the current (or any) situation. In contrast, the effects of wage subsidies on employment takeup are always positive (or insignificant), suggesting that subsidized "real" work experience often provides a stepping stone in regular employment. Wage subsidies evaluated under bad economic conditions were found to perform less well, suggesting that they are no panacea for stimulating labor demand. Unfortunately, little is known about the effects on job quality or stability.
Overall, the aggregate evidence of the effectiveness of ALMP is somewhat discouraging, suggesting that some -but not all -elements of ALMP programs can be a solution for the youth unemployment problem. The evidence also raises the question of whether the money spent on ALMP for young unemployed is well invested or whether the money should be used to tackle potential problems earlier. While investing in early education is definitively favorable (Heckman, 2006), these investments have a long-term horizon and will not be a solution for all youth at risk.
In particular, it remains an important challenge for policy-makers to devise activation schemes that benefit youth with very low skills and motivation and/or socially disadvantaged backgrounds. While job search and monitoring programs seem to be a very promising start for many youth, neither of the programs under study were targeted to the benefit of the most disadvantaged. Similarly, training programs with practical elements that tend to be targeted at youth with low initial schooling are found not to work very well. Promising strategies for disadvantaged youth may comprise intensive mentoring programs (see Rodriguez-Planas, 2012, for evidence on the U.S.) but also programs that take into account social or health-related factors that may be at the source of a difficult labor market entry (currently ongoing projects include van den Berg, Blasco, Crépon, Skandalis, and Uhlendorff, 2015;Crépon, Pernaudet, and Romanello, 2015).
Similarly, more policy emphasis should be given to promoting the take-up of stable employment relationships. Helping youth to learn about their preferences, by personalized coaching, information about career opportunities, or structured labor market entry programs, could help improve the career choices made by youth. Saniter and Siedler (2014) show that the introduction of occupational counseling centers in Germany resulted in smoother labor market entry among affected school leavers. Similarly, it is expected that training programs might also bring the largest return in terms of human capital investment in the long-run. Unfortunately, most of the studies summarized here were not able to identify longterm effects. The observation period of most examined studies ranges from several months to two years (with very few exceptions), thus hardly qualifying as long-term. The review hence also highlights the shortcomings in current research with respect to the long-term consequences of policy measures. Further research should put a stronger focus on education and job quality outcomes in the long-term perspective. 20 Kernel hazard regression exploiting random timing of introduction + n/a n/a n/a n/a n/a