Publisher and Institutional Repository Usage Statistics (PIRUS 2)

Yesterday I attended a seminar – Counting Individual Article Usage – which reported on the results of the JISC funded PIRUS 2 Project.

It was a full day, with many interesting speakers. In the morning the talks focused on the project itself, while afternoon talks covered the bigger picture.

All About PIRUS 2

• Hazel Woodward started things off by setting the stage and providing us with the aims and objectives of the PIRUS 2 project. These can be found here. Basically they were looking at the viability of creating a system that can bring together usage (download) data, at an article level, from publishers and repositories, in a standardised format.
• Peter Shepherd from COUNTER then gave a review of the organisational, economic, and political issues involved with the project. Cost allocation hasn’t been explored fully, but currently publishers would be expected to carry the brunt of the costs with repositories also contributing. Politically, there are still a lot of issues that remain (one being whether publishers and repositories are actually willing to provide their own data, and willing to pay for such a service).
• Paul Needham then took us through the technical side, and showed us that, yes, it is technically feasible to collect, consolidate, and standardise “download event” usage data from a number of different providers.
• Ed Pentz from CrossRef then talked about the importance (and relevance to PIRUS) of DOIs, and also described ORCID (Open Researcher and Contributor ID).
• Paul Smith from ABCe spoke about their possible role as auditor for PIRUS.

The bigger picture

• Mark Patterson from PLoS, then gave an interesting talk, describing some of the new alternative impact metrics (some that PLoS now provides). He cited people such as Jason Priem (see alt-metrics: a manifesto) and commented that changing the focus from Journal to article, would change the publication process.
• Gregg Gordon from SSRN also spoke of alternative methods to measure usage, and also noted the importance of context when thinking about usage.
• Daniel Beuke from OA Statistik then gave a review of their project (very similar to PIRUS) set in Germany. It would be interesting to see how these two teams could work together. These projects (along with SURE) have worked together under the Knowledge Exchange’s Open Access Usage Statistics work (see here for their work on International interoperability guidelines).
• Ross MacIntyre then spoke about the Journal Usage Statistics Portal, another JISC supported project
• Paul Needham then gave us a demonstration of the functioning PIRUS database and we closed the day with a panel discussion.

Unfortunately, I felt not enough emphasis was placed on demonstrating the usefulness of PIRUS 2 and the data that it could potentially generate. The political side of the discussion would also have been very interesting to delve into further.

Interesting things that kept popping up:

• The importance of standardisation of author and research names (ORCID)
• The need for metadata description standard (e.g. whether the paper is peer reviewed)
• And the need for all publishers to use DOIs

Some of the questions I’m still thinking about:

• Are publishers really willing to share this data?
• What can a publisher really gain from this type of collation of usage data? And a repository?
• To make it most useful everyone would need to contribute (and have access?) What would be the competitive advantage to having access to this data if everyone has access?
• We now know it is technically feasible, but is it economically and politically feasible?
• Are we ready to place value on these alternative metrics of usage (i.e. not Journal Impact Factor)? Who says we are ready? Are institutions ready? Will this usage data count as impact in the REF?
• What about other places people put articles – personal web pages, institutional web pages, etc. – could this data be included?
• What about including data from the downloads of briefing papers, working papers, and preprints? Doesn’t usage of these also signify impact?

Advertisement

Research management: smoothing the way

photo: Elsie esq

Interested in developing a seamless research management system in your institution? We’re organising (with partners from SCONUL, ARMA and RLUK) a free one-day conference in London on January 27 2011 looking at how “joined-up” workflows can help researchers through the process from grant application to publication – and exploit new methods of scholarly communication such as open access.

Librarians and research managers will discuss their experiences of integrated systems and we’ll also hear from funders and from one university that has set up a central publication fund to help researchers comply with open access mandates.

For more details go to the CRC website. Book now while places are available!

Scientists’ views on Open Access

I was at the Vitae Researcher Development Conference in the very handsome Midland Manchester Hotel on September 6 (and then had the flu, hence the delay in this post!). I ran a special interest session on Open Access and had a discussion around the continuing perception of researchers that citations from OA sources are less “valuable” than citations from traditional publications …

Which links into the fact that one of the most interesting sessions I attended was a workshop on academic scientists’ perceptions of their careers. The picture was one of a profession marked by anxiety, pressure and tension – with early-career researchers showing particularly high levels of insecurity. No real surprise there, then. But I wonder if this is connected with the tendency to be sceptical about the use of open access repositories for disseminating research results. Do scientists feel that by using OA methods they’d be somehow relinquishing ownership of, and/or control over, their research? Since the research results are the key to career progression, status and even permanent employment, the last thing researchers want is to lose control over them. 

Does this make sense as an analysis?

Science Online London

Earlier this month I attended Science Online London at the British Library (3rd and 4th of September). The conference was hosted by Mendeley, Nature Network (Nature Publishing Group), and the British Library, an interesting collaboration. The theme was “How is the web changing science?” Attendees included academics (predominately from the sciences), science journalist, science bloggers, publishers (including OA publishers), service providers (e.g.CiteULike, Mendeley), and to a lesser extent library and information professionals. A colleague and I manned a stand and attended sessions. Twitter had a major presence, with a “Twitterfall” following the conference hash tag(s) (there was even some dispute over which was the official #soloconf or #solo10) projected on a screen in most sessions.

I talked to a lot of people and most conversations eventually led to a general discussion of open access. Most people had some knowledge of OA and generally knew and agreed with the main arguments, though many people were concerned with the cost of OA (in the form of OA journals), and seemed to be unaware of the alternative OA pathway of repositories and self-archiving. Other topics of discussion included: FP7 and OA, the semantic web, and etheses. Open data was also clearly a hot topic.

Martin Rees gave the opening keynote titled How the web is changing science: A reader and author’s perspective. He was an excellent speaker and focused mostly on the current status of academic publishing and OA. He said almost everything that a supporter of OA could want a speaker to say, and set an appropriate tone for the conference.

Another session of note was the “unconference” session about Open Access. The discussion often strayed to topics including the problems with peer-review and impact factor (see Cameron Neylons blogpost here), and the dissatisfaction with the current methods used for tenure and promotion. A need for policy change was identified, though people seemed fairly confident that the academic publishing system would break, and change within 5 years. It is good to know that a session on OA no longer means defining OA and describing its benefits, but instead easily moves onto underlying scholarly communication issues and the changes that need to take place perhaps before OA will become widespread.

Image credit: Ian Mulvany