Logo

Collecting Various Usage and Impact Metrics for Open Access Books

Aim

OPERAS metrics service aims at providing a reliable, accurate, and standardized metrics service across open access book publishing platforms, with the overall objective to achieve a comprehensive and transparent mechanism to collect and aggregate usage metrics from third-party platforms. In this presentation we will present the main features of this service, and how it was conceived to measure to leverage book statistics in an efficient way.

Methods

OPERAS metrics service has been developed within the framework of HIRMEOS, a project funded by the European Union. The service is designed to be neutral in terms of types of measurement: it does not adopt one particular metric but collects existing ones and aims at providing information to the user on the metrics that are displayed alongside the books, by referring to a namespace and a specific website. Therefore, OPERAS metrics service focusses more on the usage and representation of metrics than on the technical development of new types of metrics.

Results and discussion

Ubiquity Press (UP) developed an altmetrics service and a citation metrics service. The software that collects the altmetrics and citations runs in their servers, and a public API was provided for publishers to register DOIs, and then perform requests to the API to obtain the metrics per DOI. Open Book Publishers provided partners with a software to collect metrics from the different platforms (e.g. Google Books, Open Edition, etc.), an Open Standard format to enable the upload of statistics from other platforms, and an API to enable metrics upload/query.

Knowledge Unlatched provided a dashboard built for partners to visualize and interrogate usage data from a variety of sources. The dashboard is capable of displaying usage by country and other IP range selections for each book or identifier as appropriate.

A web Widget was developed to fetch and display metrics from the Metrics API. The Widget was designed to be embedded in an HTML page, such that it can be used in the HIRMEOS partners' existing platforms.

The Widget's layout was designed following feedback from the partners. For a given book/chapter, the metrics are tabulated, showing the Source and Type of each metric, along with the number of occurrences of the metric that were recorded for that book/chapter. If a user clicks on the row displaying a metric they will be linked to the definition of the metrics/measure indicated as documented on https://metrics.operas-eu.org/. The code for the Widget is maintained in the HIRMEOS GitHub repository. The 'usable' code is hosted on the Ubiquity Press CDN, and consists of a minimised JavaScript file and a CSS file for the Styling of the Widget. These are versioned together, in order to ensure that a CSS file of a given version will always match the JavaScript file for that version.

The Widget supports some localisation. It can currently be translated into five different languages, based on translations provided by the HIRMEOS partners. These can set when configuring the Widget, and include English ('en'), French ('fr'), German ('de'), Greek ('el') and Italian ('it'). More languages can be supported in future, as requested.

The Widget also supports some customisation, by setting configuration variables. These are described in the documentation at https://docs.metrics.ubiquity.press/widget/.

Knowledge Unlatched Research provided a dashboard built for partners to visualise and interrogate usage data from a variety of sources. The dashboard is capable of displaying usage by country and other IP range selections for each book or identifier as appropriate.

Using example data from Open Book Publishers and the test API provided by Ubiquity Press a dashboard application was built in Shiny, a platform that uses the R language to display data on a web platform. The dashboard was successfully deployed locally (using R Studio) and remotely on the Shiny platform to enable public access.

Conclusion

OPERAS metrics service provides a fully distributed framework to collect usage and impact metrics addressing the specific challenge of the open access book: it provides an open source mechanism that enables publishers, authors and readers to collect data on the same book disseminated across several platforms, and a clear and understandable representation of the meaning of those data that helps users to assess and compare them.

  • Gwen FranckGwen FranckEIFL, Lithuania

    Gwen Franck is consultant and facilitator, interested in the ‘hands on’ aspects of Open Science such open access publishing, self-archiving… More →

  • Victoria TsoukalaVictoria TsoukalaEuropean Commission

    Victoria Tsoukala works as a Policy Officer in the European Commission, DG RTD.G2: Open Science, in Secondment from her position at the… More →

  • Adriaan van der WeelAdriaan van der WeelLeiden University

    Adriaan van der Weel is Bohn extraordinary professor of Modern Dutch Book History at the University of Leiden and lecturer in Book and… More →

  • Sami SyrjämäkiSami SyrjämäkiFederation of Finnish Learned Societies

    Dr Sami Syrjämäki is the head of publications at the Federation of Finnish Learned Societies. His expert work focuses on science policies… More →

  • Thed van LeeuwenThed van LeeuwenLeiden University

    Thed van Leeuwen is a senior researcher at the Centre for Science and Technology Studies (CWTS) of Leiden University in the Netherlands. As… More →

  • Andrei RostovtsevAndrei RostovtsevDissernet, Russia

    Prof Andrei Rostovtsev is a Russian physicist, doctor of physical and mathematical sciences. He graduated from the National Research Nuclear… More →

  • Vanessa ProudmanVanessa ProudmanSPARC Europe

    Vanessa Proudman is Director of SPARC Europe; she is working to make Open the default in Europe. Vanessa has 20 years’ international… More →

  • Ana MarušićAna MarušićUniversity of Split

    Ana Marušić is Professor of Anatomy and Chair of the Department of Research in Biomedicine and Health at the University of Split School of… More →

  • Alen VodopijevecAlen VodopijevecRuđer Bošković Institute

    MSc Alen Vodopijevec obtained his diploma in 2003 at the University of Zagreb, Faculty of Social Sciences and Humanities, and currently is… More →

  • Anita Pavić Pintarić
  • Damien VannsonDamien VannsonThunken

    Builder at heart, driven by the satisfaction of turning shower thoughts and back-of-the-envelope plans into full-fledged, user-friendly… More →

  • Danijel GudeljDanijel GudeljUniversity of Zagreb

    Danijel Gudelj is M.A. of sociology and croatology, graduated at Centre for Croatian Studies, University of Zagreb. Currently, he is a… More →

  • Blaž RebernjakBlaž RebernjakUniversity of Zagreb

    Blaž Rebernjak was born in Zagreb in 1983, where he finished primary and secondary schools. In 2007 he obtained his MA and in 2013 his PhD… More →

  • Evgenia Arh
  • Drahomira CuparDrahomira CuparUniversity of Zadar

    Drahomira Cupar, Phd, is an assistant professor at the University of Zadar, Department of Information Sciences. She obtained her PhD in… More →

  • Elizabeth WagerElizabeth WagerSideview

    Elizabeth (Liz) Wager, PhD is a freelance consultant and trainer who has worked on six continents. She chaired the Committee on Publication… More →

  • Filip HorvatFilip HorvatUniversity of Rijeka

    Filip Horvat is a librarian at the Faculty of Civil Engineering, University of Rijeka. He received his Master’s degree in Information… More →

  • Goranka MitrovićGoranka MitrovićNational and University Library in Zagreb

    Goranka Mitrović, senior librarian, works at the National and University Library in Zagreb, Croatia (NUL) since 1993. Her research interest… More →

  • Draženko CeljakDraženko CeljakUniversity Computing Centre

    MSc Draženko Celjak is the head of data services at SRCE – University of Zagreb University Computing Centre. He coordinates and leads the… More →

  • Iva Melinščak ZlodiIva Melinščak ZlodiUniversity of Zagreb

    Iva Melinščak Zlodi works as an e-resources librarian at the Library of the University of Zagreb Faculty of Humanities and Social Sciences… More →

  • Ivana MajerIvana MajerUniversity of Zagreb

    Ivana Majer graduated from the Faculty of Humanities and Social Sciences at the University of Zagreb, and got her degree in Croatian… More →

  • Irena KranjecIrena KranjecUniversity of Zagreb

    Irena Kranjec works as a subject librarian for information sciences at the Library of the Faculty of Humanities and Social Sciences… More →

  • Jasminka MaravićJasminka MaravićCARNet Department for Education Support

    Jasminka Maravić is Project Manager at CARNet Department for Education Support. During her 14 years in CARNet she has been involved in… More →

  • Krešimir ZauderKrešimir ZauderUniversity of Zadar

    Krešimir Zauder was born in Zagreb, Croatia in 1980. He graduated Information science and English language and literature in 2006. In 201… More →

  • Jure TriglavJure TriglavCollaborative Knowledge Foundation

    Jure is the lead developer at the Collaborative Knowledge Foundation, where he develops the PubSweet framework and supports its community. More →

  • Josipa Zetović
  • Kristina RomićKristina RomićNational and University Library in Zagreb

    Kristina Romić works at the Acquisition Department, National and University Library in Zagreb, Croatia. She graduated from the Faculty of… More →

  • Ksenija Baždarić
  • Ksenija Švenda RadeljakKsenija Švenda RadeljakUniversity of Zagreb

    Ksenija Švenda Radeljak is employed at the Library of Department of Social Work at the Faculty of Law University in Zagreb. The areas of her… More →

  • Linda SīleLinda SīleUniversity of Antwerp

    Linda Sīle is doctoral student at the University of Antwerp within the Centre for R&D Monitoring (ECOOM). My current work spans somewhat… More →

  • Lovela Machala PoplašenLovela Machala PoplašenUniversity of Zagreb

    Lovela Machala Poplašen is a head librarian at the Andrija Štampar Library, School of Public Health, School of Medicine, University of… More →

  • Ljiljana Poljak
  • Luc BorutaLuc BorutaThunken

    Ph.D. in computational linguistics, natural language processor, interested in linked data and linguistic diversity. In previous lives, Luc… More →

  • Ljiljana Jertec MusapLjiljana Jertec MusapSRCE – University Computing Centre, University of Zagreb

    MSc Ljiljana Jertec is a librarian and computer specialist at SRCE – University of Zagreb University Computing Centre. She has a Master’s… More →

  • Lucija VejmelkaLucija VejmelkaUniversity of Zagreb

    Lucija Vejmelka is an assistant professor at the University of Zagreb, Faculty of Law, Department of Social Works, where she leads the… More →

  • Marijana Briški Gudelj
  • Marijana GlavicaMarijana GlavicaUniversity of Zagreb

    MSc Marijana Glavica works as a systems librarian at the University of Zagreb Faculty of Humanities and Social Sciences Library, where she… More →

  • Marina Cvitanušić BrečićMarina Cvitanušić BrečićCroatian Agency for Science and Higher Education

    Marina Cvitanušić Brečić works at the Analytics and Statistics Department of the Croatian Agency for Science and Higher Education (ASHE… More →

  • Marina GrubišićMarina GrubišićCroatian Agency for Science and Higher Education

    Marina Grubišić is the head of the Analytics and Statistics Department of the Croatian Agency for Science and Higher Education (ASHE). She… More →

  • Matko MarušićMatko MarušićUniversity of Split

    Matko Marušić is Professor Emeritus at the University of Split, Split, Croatia. He was a Professor at Medical Schools (in Zagreb and Split… More →

  • Nicolas Robinson-Garcia
  • Neven Pintarić
  • Paulin RibbePaulin RibbeOpenEdition

    Paulin Ribbe is Project Manager for the OPERAS infrastructure at OpenEdition (France, Marseille - CNRS, AMU, EHESS, Avignon Univ.). He holds… More →

  • Radovan VranaRadovan VranaUniversity of Zagreb

    Born in Zagreb, Croatia. Primary and secondary education completed in Zagreb. Croatia. Graduated information sciences and the English… More →

  • Rafaelly StavaleRafaelly StavaleUniversity of Brasília

    Rafaelly Stavale is a current student of Nursing at Universidade de Brasília – UnB. She has recently completed the Principles and Practices… More →

  • Olga KirillovaOlga KirillovaAssociation of Science Editors and Publishers (ASEP), Moscow, Russia

    Olga V. Kirillova, Candidate of Science (Engineering, 2004), the President of the Association of Science Editors and Publishers (ASEP, since… More →

  • Pierre MounierPierre MounierOpenEdition

    Pierre Mounier is deputy director of OpenEdition , a comprehensive infrastructure based in France for open access publication and… More →

  • Rodrigo CostasRodrigo CostasLeiden University

    Rodrigo Costas is an experienced researcher in the field of information science and bibliometrics. With a PhD in Library and Information… More →

  • Tihana RubićTihana RubićUniversity of Zagreb

    Tihana Rubić is an assistant professor at the Department of Ethnology and Cultural Anthropology, Faculty of Humanities and Social Sciences… More →

  • Vicko TomićVicko TomićUniversity of Split

    Vicko Tomić is a research assistant at the Department of Research in Biomedicine and Health at the University of Split School of Medicine… More →

  • Vanessa FairhurstVanessa FairhurstCrossref

    Vanessa Fairhurst joined Crossref in 2017 and is based at the Oxford office. As Community Outreach Manager, her role involves working… More →

  • Želimir KurtanjekŽelimir KurtanjekUniversity of Zagreb

    Želimir Kurtanjek is a retired professor of chemical engineering with an interest in biotechnology, biostatistics and big data analytics… More →

  • Vlatka BožičevićVlatka BožičevićUniversity of Zagreb

    Vlatka Božičević gratuated from Religious Pedagogy and Catechetics at the Catholic Faculty of Theology University of Zagreb and the… More →

  • Željka Salopek
  • Zoran VelagićZoran VelagićUniversity of Osijek

    Zoran Velagić is a professor of book history and publishing studies at the University of Osijek, Faculty of Humanities and Social Sciences… More →