Home > Pubblicazioni > Ricerca sulla valutazione

Pubblicazioni / Ricerca sulla valutazione

  • Romagnosi S.
    (2016) La valutazione della Terza Missione da parte dell’Anvur , numero monografico 141

    La valutazione della Terza Missione da parte dell’Anvur

  • Romagnosi S.
    (2016) Produzione e gestione di beni culturali nella valutazione Anvur della terza missione , Vol. 10, pp. 25-32

    Produzione e gestione di beni culturali nella valutazione Anvur della terza missione

    Le attività di produzione e gestione dei beni culturali (scavi archeologici, poli museali e immobili storici) svolte da università ed enti di ricerca, rientrano nell’attuale esercizio di valutazione della terza missione, previsto dalla VQR 2011-2014. La terza missione è infatti rappresentata non solo da attività di valorizzazione della ricerca, ma anche da attività di produzione dei beni pubblici di natura sociale, educativa e culturale, sebbene queste ultime valutate in via sperimentale. Poiché si tratta di un primo sforzo organico da parte dell’Anvur di circoscrivere le numerose attività legate ai beni pubblici, la commissione di esperti cui è affidata la valutazione, fornirà informazioni sulla natura degli indicatori e dei criteri di valutazione proposti, al momento poco standardizzati e comparabili rispetto a quelli legati alle attività di valorizzazione della ricerca. I primi dati mostrano che le nostre università dispongono di un ricco patrimonio di beni culturali, di cui però sappiamo poco sulla sua effettiva valorizzazione.
  • Blasi B., Romagnosi S., Bonaccorsi A.
    (2018) Do SSH Researchers Have a Third Mission (And Should They Have)? , pp. 361-392

    Do SSH Researchers Have a Third Mission (And Should They Have)?

    The notion of the third mission in SSH is still problematic, as well as the concept of research impact. Several streams of critical literature have raised the concern that using the third mission notion or impact may limit the academic freedom of researchers, and reduce the independence from market pressure and impoverish the SSH’s potential for critical thinking and unorthodox visioning. However, countries which have experienced selective cuts in research funding which have penalised SSH disciplines, have seen efforts to make the hidden connections between SSH research and society more visible. This chapter reports on the debate and controversies surrounding this issue. For the first time, preliminary evidence on Public Engagement activities of scholars in SSH, taken from the large-scale assessment of third mission of Italian departments and universities, is presented. This chapter argues that not only scholars in SSH do have a third mission, but that they are not less engaged than their colleagues from STEM disciplines.

    DOI: 10.1007/978-3-319-68554-0_16

  • Bonaccorsi A, Secondi L, Setteducati E and Ancaiani A
    (2014) Journal of Technology Transfer , 39(2): 169-198

    Participation and commitment in third-party research funding: evidence from Italian Universities

    Over the last few years, the emergence of universities' third mission has significantly affected objectives, sources of funding and financing methods, as well as the management, of universities. Although the university-industry relationships have been widely investigated, several interesting theoretical and empirical issues still remain open in the literature. In this paper we construct an original data set, combining financial information with structural and organizational data on Italian University departments, with a twofold aim. First, to describe the importance and the extent of third-party funding in the Italian system of research as well as the pattern of evolution over the last few years. Second, to investigate the factors that influence both the probability and the intensity of the commitment of departments in third-party activities by building a multi-level framework combining factors at individual, departmental, university and territorial levels. The results obtained suggest a number of policy implications for universities and policy makers. On one hand, universities should explicitly recognize the role of dedicated internal organizations and provide training for professional staff capable of acting as value-added intermediaries. On the other hand, if policy makers wish to improve the relationships between universities and external actors, disciplinary differences across departments as well as regional inequalities in growth levels should be carefully considered, giving up a one-size-fits-all approach.

    DOI: 10.1007/s10961-012-9268-5

  • Cicero T, Malgarini M, Nappi CA and Peracchi F
    (2013) MPRA (Munich Personal REPEc Archive) , (50470)

    Bibliometric and peer review methods for research evaluation: a methodological appraisement

  • Cicero T, Malgarini M and Benedetto S
    (2014) Proceedings of Science and Technology Indicators Conference 2014

    Research quality, characteristics of publications and socio-demographic features of Universities and Researchers: evidence from the Italian VQR 2004-2010 evaluation exercise

  • Di Cristina F
    (2013) Munus , 2: 42


  • Abramo G, Cicero T and D'Angelo C
    (2014) Journal of Informetrics

    Are the authors of highly cited articles also the most productive ones?

    Ever more frequently, governments have decided to implement policy measures intended to foster and reward excellence in scientific research. This is in fact the intended purpose of national research assessment exercises. These are typically based on the analysis of the quality of the best research products; however, a different approach to analysis and intervention is based on the measure of productivity of the individual scientists, meaning the overall impact of their entire scientific production over the period under observation. This work analyzes the convergence of the two approaches, asking if and to what measure the most productive scientists achieve highly cited articles; or vice versa, what share of highly cited articles is achieved by scientists that are “non-top” for productivity. To do this we use bibliometric indicators, applied to the 2004–2008 publications authored by academics of Italian universities and indexed in the Web of Science.

    DOI: 10.1016/j.joi.2013.10.011

  • Ferrara A and Bonaccorsi A
    (2016) Research Evaluation

    How robust is journal rating in Humanities and Social Sciences? Evidence from a large-scale, multi-method exercise

    This article reports on a large-scale exercise of classification of journals in the fields of Humanities and Social Sciences, carried out by the Italian Agency for the Evaluation of Universities and Research Institutes. After discussing at some length the controversies linked with journal classification and its impact, we endeavor to compare such a classification with the scores that individual articles published in the same journals were assigned by completely independent assessors in the same period of time. The data refer to an important subset of disciplines covering History, Philosophy, Geography, Anthropology, Education, and Library Sciences, allowing for comparisons between scientific fields of different sizes, outlooks, and methods. As the controversies surrounding the rating of journals focus on the difference between the container (the journal) and the content (the individual article), we addressed the following research questions: (1) Is journal rating, produced by an expert-based procedure, a good predictor of the quality of articles published in the journal? (2) To what extent different panel of experts evaluating the same journals produce consistent ratings? (3) To what extent the assessment of scientific societies on journal rating is a good predictor of the quality of articles published in journals? (4) Are there systematic biases in the peer review of articles and in the expert-based journal rating? We find that journal rating is a legitimate and robust assessment exercise, as long as it is managed carefully and in a cautious way and used to evaluate aggregates of researchers rather than individual researchers.

    DOI: 10.1093/reseval/rvv048

  • Abramo G, Cicero T and D'Angelo CA
    (2015) Journal of Informetrics

    Should the research performance of scientists be distinguished by gender?

    The literature on gender differences in research performance seems to suggest a gap between men and women, where the former outperform the latter. Whether one agrees with the different factors proposed to explain the phenomenon, it is worthwhile to verify if comparing the performance within each gender, rather than without distinction, gives significantly different ranking lists. If there were some structural factor that determined a penalty in performance of female researchers compared to their male peers, then under conditions of equal capacities of men and women, any comparative evaluations of individual performance that fail to account for gender differences would lead to distortion of the judgments in favor of men. In this work we measure the extent of differences in rank between the two methods of comparing performance in each field of the hard sciences: for professors in the Italian university system, we compare the distributions of research performance for men and women and subsequently the ranking lists with and without distinction by gender. The results are of interest for the optimization of efficient selection in formulation of recruitment, career advancement and incentive schemes.

    DOI: 10.1016/j.joi.2014.11.002


Utilizzando il sito, accetti l'utilizzo dei cookie da parte nostra. maggiori informazioni

Questo sito utilizza i cookie per fornire la migliore esperienza di navigazione possibile. Continuando a utilizzare questo sito senza modificare le impostazioni dei cookie o cliccando su "Accetta" permetti il loro utilizzo.