Shut all our websites down

I am proposing to turn off all online resources for the digital arts and humanities. Really? Really! Well, almost.

Last week I was speaking at the philtag n=7 workshop on "Communicating eHumanities: Archives, Textcentres, Portals" in Trier, Germany. Several of the presentations dealt with more strategic issues: Susan Schreibman was introducing the Digital Humanities Observatory in Dublin, Heike Neuroth presented on "Research data Curation in eHumanities" and I talked about the community building experience that was the AHRC ICT Methods Network.

One of the issues the discussions focussed on was how to increase the academic recognition our work gets, especially in the context of citations. Examples of well used digital resources were mentioned that no-one ever cites. People seem happy to use them to find and access digital resourced but then they quote the original source. Interestingly, the same issue had come up a few weeks earlier when I was interviewing a well know Byzantinist for a case study - researchers use digital resources, they may even thank the creators, but do still quote the analogue source.

When we discussed this in Trier, Susan, who had experienced the same, said (only half jokingly) that we should maybe think about turning off our websites for a while so that people would realise the value. Now, we could be that radical, form an alliance, including a few of the larger content providers, and shut it all down for a week. Or we could think about ways to raise awareness. Why not have a banner “support digital resources” on our project websites and explain why it would help us if people were citing these resources. We could even go a step further and agree on a standard to cite our online resources and make these citations easily visible.

Would that be useful? Could the community agree on that? I am curious to hear your thoughts.

Re: Shut all our websites down

Craig Bellamy has the right idea. If we can get established experts--who do not need the written exposure for advancement--to post significant findings or original ideas or comments, we can get on the track for establishing digital work as worthy of citation. When I was a Human Resources Management specialist in the USA Federal Government, I advised Medical Research Service on the amount of citation made on the work of persons being considered for hire or promotion. To do this, I used a periodical called Citation Digest--or someting to that effect. It not only listed who and what was cited but who did the citing--a useful tool that enabled me to point out that one applicant's extensive citation list consisted primarily of his citing his own work and to establish that another applicant with only two articles had several hundred citations that past year alone by a number of different authors. Unless and until professionals in position of influence make the value of digital citations known, only then can we get such citation digests to include digital citations.

Scott Catledge

Re: Shut all our websites down

Although this thread has gone quiet, it is worth adding some information from a discussion which took place at a recent workshop held by the the 1641 Depositions Project at Trinity College Dublin. When this issue came up in discussion one of the participants mentioned that in the history of science there has been a complete reversal in favour of citing the digital reference. Even in cases where a researcher has gone to the original, they cite the digital resource if one is available (as well as the original, one assumes). If this is in fact the case it would be extremely valuable to know how this sea change has come about, and what steps, if any, were taken in order to encourage this to the extent that it is now accepted practice.

Re: Shut all our websites down

In some respects I feel this discussion has missed the point. I am less concerned about getting credit for the sources created, than I am with the failure of scholarship involved. Citing the specific edition of the source actually used, whether digital or hard copy, is simply honest academic practise. The failure of most scholars to cite the sources they consult (preferring the pretence that they are getting dusty in the library) is a reflection of a significant decline in the standard of modern academic behaviour. Traditionally, you would expect an academic monograph or article to give full details of the edition of a source being used, or the location of a manuscript. One of the major reasons to footnote anything, is to ensure that other scholars can retrace your footsteps. The failure to do so, just because the edition involved is online, is an absolute abrogation of two years of academic practise.

Rather than close down digital resources, why not simply expose a few senior scholars for the academic charlatans they are. A simple comment (appropriately worded) in a review in THE would start a discussion, that would precipitate change.

Re: Shut all our websites down

Gregory Sporton
I thought I rather took your point, quite completely. The elision of the use of digital resources is a question of scholarly ethics. So we write something in the THE, and everyone will deny doing such a scurrilous thing. Because, arguably, they have not mislead you. This is only if the digital resource is considered a complete replication of the original source (and in many instances, it is not: I regularly ask this question of the acceptability of using digitised images for archeological interpretation, and I am always told it throws up issues). But, I agree, a good idea for a story for the THE. I know a guy there, does everyone want me to contact him?

Re: Shut all our websites down

I would definitely be up for a correspondence, or an article or a review on this in THE, and would be happy to contribute in any way I can. I do think, however, that most scholars are scholarly more from fear than conviction (I am working on my cynicism!), and suspect that a review where an individual is criticised would have more effect than a general article.

Re: Shut all our websites down

Lou Burnarrrrrgh coming to the party a bit late would just like to observe that one of the good things that the widespread availability and use of digital sources has done is to problematize the nature of the source, and hence to reinforce that fundamental scholarly requirement of citing them accurately. It's always been sloppy thinking to do otherwise, but it was easier to get away with it when we had the notion of the "authoritative" edition to fall back on.

Re: Shut all our websites down

I have to admit that I'm less optimistic than you are: Citing items as if quoting directly when only quoting indirectly has been frequent scholarly practice for centuries (no, I don't say "good scholarly practice", I say "frequent scholarly practice").
And I wouldn't call those 14th century authors who quote Augustine via Thomas Aquinas (without indicating that they quote him via Thomas Aquinas) as "academic charlatans" - though I do admit that editing them might mean less tedious work if they had cited/quoted "correctly".

It is difficult enough to get one's students to cite/quote correctly.

When it comes to colleagues: you'd need a really good cause: a case where incorrect citing/quoting let to factual error or misinterpretation, I guess.

Re: Shut all our websites down

Er, by the same logic, shouldn't all the libraries close for a week to demonstrate how valuable they are? Not a good way to make friends. Even when online repositories become the main means of access to digitized works, it will always be the analogue originals that deserve the citation. Born-analogue works deserve to keep their conventional citation.

That said, there's no good reason why a digital EDITION should not be cited as such. I can't see any good way of getting around the fact that digital research infrastructure is working at its best when it's least intrusive.

Re: Shut all our websites down

Are there any archivists out there who are radical enough to make primary sources available online only, rather than merely replicating online what is already available in the archives? Would it ever be possible to move away from the box and folder format in physical archives and create a new system for digitized primary sources? Wouldn't a new system of organizing information in the digital realm force historians to change their habits and formats of citation?

Re: Shut all our websites down

This is of course the fundamental challenge that archivists are now addressing - the provision of access to born-digital records. It is very difficult for "traditional" often smaller-scale archive services to make the case to their funders for realistic resourcing of this paradigm shift in research access. One way that historians can influence better provision is by evidencing their use of these resources directly through citation. Actual use is therefore indicated, rather than having web statistics possibly dismissed as mere curiosity browsing.

Re: Shut all our websites down

[quote=Paul Sillitoe]One way that historians can influence better provision is by evidencing their use of these resources directly through citation. Actual use is therefore indicated, rather than having web statistics possibly dismissed as mere curiosity browsing.[/quote]

Oh, well, ahem: (most probably) all of us are aware that citations are no proof at all of the real use of the resource cited. Yes, web statistics i.a. may be bloated by "mere curiosity browsing", but it is far easier to document "real" use via web statistics (where you can see where the user came from and what she/he did actually do when having a look at the statistics provided by your server, and where chances that in the event of something "cited" via linking to it the person citing it has at least seen it are by far higher than in the case of "traditional" citations).

No idea whether this makes sense to you.

Once upon a time maybe the "relevance" of some manuscript was measured by the number of requests to copy it. But we wouldn't use this measure for prints (especially in cases where the edition in question is not rare). Once upon a time the relevance of publications was measured by the number of other texts published in certain places citing them. But I wouldn't use this measure for any "electronic only" resource designed to be used in a potentially "electronic only" world.

I don't want to sound pessimistic, but I doubt that many people will come to copy the prints in our library, or that very many people will cite in a traditional publication the electronic version of something existing also in material form: it just does not look very impressive, and sweat produced in a library in front of a "material publication" is by far more a real hero's sweat than the sweat produced in your office in front of a screen.

Sorry!

Re: Shut all our websites down

Love the radical action, Torsten, but shutting them down will only provoke a certain kind of outcry until they are switched back on, and normal service is resumed (including the citation pattern). As Kuhn says, much of the Reference list on any project has to be treated as window dressing, and citing the original gives the impression of diligent scholarship. It is also something of a rule that secondary sources are considered more dubious (is a digitised image a secondary source? Of course it is!) and thus subject to substitution if the researcher chooses to look more industrious and thorough (and can satisfy themselves that in doing so they are not misrespresenting their research). Citation indexes are thought to be a means of measuring the quality of a research resource, and for that reason alone they have become more important.

Re: Shut all our websites down

There is an attempt to give to this question an answer. The Pinakes project (www.pinakes.org or http://pinakes.imss.fi.it) is precisely doing this: not replicating but recreating the complexity of semantic relationships that are buried in the primary sources. Have a look at the Panopticon Lavoisier Project or to the Waller Collection Project. Let me know what is your opininion.

Re: Shut all our websites down

Hi,

Why are citations, in particular, so important? You can publish papers about the resources themselves. Surely those get cited in the appropriate communities. You can track how a particular resource is being used and do surveys to establish its value. Seems, according to this reasoning every scholar should be citing Google or their OS manufacturer.

Is there something I'm missing?

Best,
-- Duane

Re: Shut all our websites down

I've talked with a colleague about this and I guess I did misunderstand, in part, what the problem is. I can clearly see why certain resources should always be cited if they source the material. For whatever reason, I thought the tools in question where more about indexing and accessing already sourced materials.

In any case. I should hope that departments, institutions, and the like should accept usage statistics and survey information as proper signification of value in lieu of citation lapses. But I can readily see how this would be very disappointing.

Please shut off my access at least for stupidity :-).

Best,
-- Duane

Re: Shut all our websites down

IMO you are making an important point (if I do understand it correctly): Real usage, weblinks and the like can be measured statistically, and provide apt metrics for the evaluation of websites.
Citation habits in "traditional" publications should not influence too much our judgements concerning "non-traditional" material.

Re: Shut all our websites down

I understand the scepticism about citations but I feel that they are useful for two reasons:

1) Whether you like them or not, traditional citations are still an important part of the RAE in the UK. That means the more citations in academic publications you get the more money for your department - and that in turn increases your employability. The RAE is changing and there is a lot of criticism but as long as this focus on citations stands we have to take it into account.

2) I agree that links and usage statistics can tell us a lot and that we should use them as best as we can. However, citation in a well known journal shows that the academic establishment is taking note of your work in some way at least. As long as the majority of relevant publications are still printed journals, and in the arts and humanities that is still the case, I think we should make sure that our work is being noticed there.

Having said all that I have to admit that I personally prefer links, good web stats and citations in mailing lists, blogs etc. as they can give much better direct feedback that is relevant to my work. But funding is too...

--
Torsten Reimer
editor arts-humanities.net

Re: Shut all our websites down

[quote=Torsten Reimer]I understand the scepticism about citations but I feel that they are useful for two reasons:

1) Whether you like them or not, traditional citations are still an important part of the RAE in the UK. That means the more citations in academic publications you get the more money for your department - and that in turn increases your employability. The RAE is changing and there is a lot of criticism but as long as this focus on citations stands we have to take it into account.

2) I agree that links and usage statistics can tell us a lot and that we should use them as best as we can. However, citation in a well known journal shows that the academic establishment is taking note of your work in some way at least. As long as the majority of relevant publications are still printed journals, and in the arts and humanities that is still the case, I think we should make sure that our work is being noticed there.
[/quote]

Do they really use the amount of citations for judgements in the arts and humanities? (I agree that citations are useful for evaluations in the sciences, but for that we seem to know they are far less useful when it comes to mathematics, and hardly useful when applied to the humanities. Serendipity, chance and friendships apparently are too important factors determining citation behaviour in (most of?) the humanities use the number (and place) of citations for judgements on the cited literature.) Yes, we want our electronic products/productions to be noticed by those publishing in the printed journals; yes, we want to be noted by "the academic establishment" (if, where, and when there is such a thing as "the academic establishment"), but: as long as it results in use and in respect and in funding: I don't care whether it is documented via a citation in a traditional journal or not.
But maybe I'm living in an environment which is just too backward and old fashioned to treat the humanities in every aspect (except, of course, the amount of funding) like the sciences ... .

Re: Shut all our websites down

[quote=Kuhn]Do they really use the amount of citations for judgements in the arts and humanities?[/quote]

Yes, they do - this is partly what inspired this thread... I should maybe have made this more obvious as the RAE is something specific to the UK. Having said that, I still get the impression that printed publications/editions are often seen as more valuable then electronic ones. This has changed a lot, obviously, but maybe not enough.

--
Torsten Reimer
editor arts-humanities.net

Re: Shut all our websites down

And the actual content's content is important component in this tale of down-troddeness as well? ie. is it content that relate to working class radical social movements in Britain in the 19th Century or is it content that relate to the rise of the populist new-right through activist think tanks in the 1980s. The method, the tool, the citation, the platform are all very important components of the puzzle (and legitimate research projects in themselves...well done)...but what about the content of the content? Citations that link content to other content exist in a political economy of ideas; and a computerised rationalist empirical framework that counts citations...where is the love in that? It just means that counters are more important than the people who don't count. How do you count good ideas? I'll ask one of my digital poet mates.

Re: Shut all our websites down

It is a good question and a good idea. Withdrawing the fruits of ones labour to address injustice has worked a treat for the labour movement for over a century and a half now. Academic labour should be no different.

Still, what I see as one of the best means to promote digital resources is perhaps not through large scale collectivist strike action (as much as I agree with this), but thorough the promotion of 'significance'. If a digital item is significant to a field and the questions that are addressed within that field, then the digital item will be seen as significant. Unfortunately if it is a mere facsimile of an original, then the original will perhaps be seen as more significant (and the researcher will cite the original as they perhaps don't want to appear to be lazy). It is when the digital item becomes a work of scholarship in itself through annotations, the use of tools and scholarly interpretations etc. (or it is a 'born digital' work), then it becomes a work of scholarship in itself and thus more 'significant'. It is then about finding significant questions to ask of this significant resources and fining innovative ways to communicate the results (citations is part of this).

Now, what are the significant questions we can ask of these resources?

I am about to read a book on the history of the institutional English Department. Perhaps a significant history for digital resources would be the history of the institutional computer centre.

Kind regards,

Craig

Re: Shut all our websites down

Hi Torsten,
This is a very good question. The HRI's Old Bailey Online is used extensively by many researchers but rarely cited, despite the presence of a citation guide. In one sense we see this as a good thing: that maybe Old Bailey Online is accepted as a fundamental tool of research in much the same way as the OED and DNB. After all, we don't cite the OED every time we consult it. However, this can also make it difficult to assess impact and formally demonstrate its value.
Mike

Syndicate content