Jan 28 2013

Positive Poster’ing for IDCC 2013

Dorothy Byatt

Creating the poster for the International Digital Curation Conference  (#IDCC13) was different to the ones we have done thus far. Although very much linked to the DataPool project, the choice of the content was only restricted to being of interest to the theme of the conference – “Infrastructure, Intelligence, Innovation: driving the Data Science agenda”. Our choice was to focus on our collaborative work by PhD and Early Career Researchers, that is, helping to embed and enable good research data management practices in the institution.

Gareth Beale and Hembo Pagi have been investigating 3D and 2D raster imaging being used in the University. We look forward to their report. A group of researchers came to a working lunch, led by iSolutions and the DataPool team, to look at progress on a SharePoint data deposit option and provided valuable feedback. Another development that will be of great assistance to those looking to capture a snapshot of life and society is that of a twitter archiver using ePrints currently in beta development. One snapshot will be of #IDCC13 tweets. Yet another collaboration was with Mark Scott on his work on his ‘Introducing research data’ guide and on a data sharing system for the Heterogeneous Data Cente (HDC). More details of his work and paper he presented will follow in our linked second IDCC blog. So there was our content, examples of essential building blocks coming out of researcher-focussed work.

And that just left the design …!

Oct 23 2012

Datapool presents at SxSC Creative Digifest

Gareth Beale

I recently presented the Datapool project’s plans for 3D and imaging data management research at #SxSC2 Creative Digifest. The event (organised by the University of Southampton Digital Economy USRG) was held with the aim of better understanding the impact digital technologies have upon our lives. Participants from several institutions came together to talk about their work, but also to talk more generally about the impact of digital technology on communities and individuals. It was the perfect place to present, but also to reflect upon, our work with the Datapool project.

The 3D and imaging strands of the DataPool project, led by Steve Hitchcock and administered by Gareth Beale and Hembo Pagi respectively, aim to develop a better understanding of how 3D and imaging data are currently handled at the University of Southampton: how they are created, how they are shared, how they are archived, and what this means for research and research culture.

A diverse range of technical and theoretical work was presented at #SXSC 2. The presentations served to highlight the highly innovative nature of contemporary research on digital themes, but they also placed repeated emphasis upon the need to understand how the growth of digital technology is affecting the way we live, think and work.

This need to understand the implications of digital technologies and to work in ways which are not only creative but also sustainable represents one impetus behind the Datapool project. It was fantastic to see so many people talking about how we manage our digital lives and to consider how different strategies might lead us in very different directions. It was important for the Datapool project to be at the centre of this discussion. We are left considering how some of the themes raised at the conference may relate to our digital working practice throughout the University.

Two of the talks which I found particularly interesting were Les Carr and Ramine Tinati talking about the Web Observatory. The idea that the web is sufficiently complex and poorly understood that it requires observation, as we might observe a complex natural phenomenon, is highly significant in thinking about relatively small scale data management on an institutional level. While we do not face many of the challenges faced by those seeking to understand the dynamics of an inherently social and dynamic global network, we must be aware that we are not simply looking at how people stucture their files. As research culture becomes increasingly digital and connected our data becomes socially significant. It will be very interesting to see, as we conduct our research, what the social landscape of Southampton’s 3D and imaging data looks like and whether as participants and observers we can develop a better understanding of the changes which are taking place.


Sep 27 2012

Surveying institutional data practices: the perils of ethics approval

Steve Hitchcock

“A discussion about the throttling of clinical knowledge exchange by well meaning but ill-informed ethics committees is a topic for another paper.” Goble et al., Accelerating scientists’ knowledge turns

Gareth Beale and Steve Hitchcock have been piloting a proposed study of three-dimensional data practices through institutional ethics clearance. Here they recount the experience so that others who are new to such processes – probably most of us – can save time, and some pain, and devote more energy to the study at hand.

Mesolithic stone tool captured in 3D

Mesolithic stone tool captured in 3D by CT scanning. The growing importance of image and 3D data in all areas of research require us to think deeply about how we treat these data.

So you want to find out how researchers at your institution generate and manage data. No problem. Set up a survey targetted at a well specified group. It will be fair and rigorous, the contributed information will be handled carefully to ensure anonymity of data so it won’t give secrets away or embarrass anyone. By the end we will have learned something that will shape our approach to data management and that we will share with the world by publishing the findings. Easy, done it before.

Well, things may not be quite as straightforward as you think. Current regulations require that all research, regardless of its nature, must be reviewed by an institutional ethics committee. Where humans are the subjects of the study this process can be lengthy and intricate. The need to guard against dubious research practice is a matter of great concern to all researchers. However, this post will argue that the system of ethics governance can cause delays and obstructions which threaten to hamper small ethically non-contentious research projects.

It’s not hard to imagine ethically dubious research practices. If you were the subject of a medical trial, say, you would want to know there was proper oversight to ensure full ethics compliance. In our particular case we are investigating practices in capturing and managing image and 3D data, beginning with 3D images. That does not immediately suggest big ethical dilemmas, but you might be surprised.

First, we are going to defend the ethics procedures here at the University of Southampton, even though hearts sank when we realised we would have to discover and learn this process. We have been helped through the process by numerous people intimately familiar with it. Once you understand the system it works well, and the process is logical and rigorous, from an ethics perspective. All submissions have been handled promptly, and responses are not obviously ‘ill-informed’. So what can go wrong?

  1. It can extend the timescale of your survey substantially. It might be first-time syndrome in our case, but the process has taken from mid-July and has just been approved. At Southampton there are online forms and six Word document templates to complete, so plenty of scope to take some wrong directions.
  2. You can end up committing yourself to an unworkable design or plan for your survey.
  3. You can tie yourself in knots over issues such as anonymity and confidentiality, to the extent that your capacity to publish data may be restricted, and unless you are careful, you can forget about open data.
  4. After the project has ended and staff may have moved on, you may find no one is authorised to access the data. So much for data verification.

How do we deal with the problems presented here? First, realise that this ethics process is here to stay, so we need to get used to it. In that case we need to treat ethics as integral to the study and not an additional hurdle to be jumped and then forgotten. That means starting with the design and planning of the study, rather than with the ethics process. The design will inform the ethics. In that way you will get consistency and hope to avoid unintended commitments in the ethics submissions that will later restrict your study.

However simple you think your study may be, the ethics process will present you with unexpected questions and tricky dilemmas, particularly when it comes to data dissemination, which is at the heart of research data management. Tackle these honestly, and try to envisage the longer-term consequences. Often the simplest approach to ethics may to limit and restrict studies, effectively to promise to do nothing with the data beyond your project or group. Ethics submission templates and questions may even be designed to lead you in this direction – easier to comply than confront these issues, especially if the ethics process is simply something you want to clear or avoid. Resist the temptation. Publication and open data are still possible and consistent with ethics clearance if you respect and present in your design the ethical principles of treating your subjects fairly.

There remains the issue of responsibility for confidential data. Survey results will typically contain some data that will remain confidential, notably identities of the subjects and how these might be linked to their contributions to the survey. It is important to remember that someone will have to be responsible for ensuring continued confidentiality as long as these data exist somewhere. As projects invariably come to an end and project staff may move on, this may not be as simple as it seems. Responsibility needs named individuals, and the means to authorise the passing of this responsibility to someone else. This is another process that projects will have to delegate effectively at conclusion, but first any studies subject to ethics approval have to specify names and a procedure that will enable this to happen.

The process of gaining ethical clearance to proceed with research is rigorous and has the capacity to shine a light on areas of your research that may not have seemed to be ethically significant when writing the proposal. However, the process is also time-consuming and perhaps unnecessarily complex where ethically uncontroversial projects are concerned.

We do not doubt that ethics clearance will ‘throttle’ some studies as Goble et al. suggest. Those studies with more difficult ethical issues to confront will find some ethics committees intractable, or researchers may be unwilling or unable to make the necessary compromises. Studies may be lost through the simple expedient of losing too much time on ethics clearance. We may have been lucky – we can still proceed despite the delay.

It’s not only the big issues that cost big time. Failure to align your marks perfectly in columns or rows of an MS Word table can cost you one extra round of the reviewing process, and a few more days. As can declaring that audio recordings will be made of interviews with subjects (a legitimate ethics issue, clearly), but failing to specify which medium (tape/digital/minidisc, etc.) will be used to record (less obviously a major ethics risk). Those extra days and rounds add up, as the documents circulate again between author, supervisor and reviewer. Don’t even think about going away!

As for our actual study, the investigation into 3D data portends some fascinating insights into a technology that is growing rapidly and is already sparking popular imagination:

Is this a common experience? Have others had similar experiences when confronting ethics processes for their research data surveys? Or are we at the precipice of change in the way we perform standard research surveys involving other people.

We were at once reassured, surprised and frustrated by our experiences with University of Southampton ethics governance. It was reassuring to observe the degree of attention that our research was receiving and heartening to receive detailed comments on how our research could be modified in order to conform to ethics guidelines. It would be worrying if research were not checked in this way. We were surprised by the complexity and intricate nature of the process to which our research was subjected, particularly given its relatively uncontroversial nature. The timescale over which the whole process took place was frustrating.

If ethics procedures are to be modified perhaps it should be to simplify and speed up the process, especially for those studies that might be quickly classified, through the process, as low risk. At Southampton there is such a classification, but that did not save us from an extended process.

Until that happens, or until all ethics submitters become more familiar and competent with the process, our experience may save others new to the process some time, and pain, so they have more energy to focus on their study.