Category Archives: Research Process

Musings about involvement in research…

By | Impact, Research Process | No Comments

Almost every research funding application will now have a section asking about involvement,  be it “patient and public involvement”, “public involvement” or “user, carer, practitioner involvement”.

The first response for some will then be what does the funder want me to write. For others it’ll be I will have an advisory group with one carer, one user, one practitioner representative and they will meet every 6 months. Some will slowly drift towards, what I’ll call, tokenistic involvement to keep the funder happy (or just to be able to write something in that particular section) and hope it’s enough.

That’s not necessarily because those completing that research funding application don’t care about involvement. They might not feel involvement works for their proposed study and the default fall back is having an advisory group. For others it may just be not knowing what does work.

There are, of course, many conversations and issues around involvement: not least defining it, how to do it well, whether involvement improves the research or the impact from the research. These are, by their nature, complex discussions and to different interest groups raise a number of sensitive issues. For me perhaps the difficulty with entering these discussions is the current lack of knowledge and evidence on what does work, how and the outcomes for research, impact and on those involved themselves.

Yet, our learning from the SCEiP project suggests research needs to be involve relevant stakeholder’s to have an effect on policy or practice. Trying to garner interest in research findings after a three year study is difficult at best. This is something many funders already know, research that involves relevant non-academic groups is more likely to lead to impact. So, we know that… it’s nothing new… so why aren’t we seeing more of it?

SCEiP activities

Two of the many activities within the SCEiP project included bringing people who use social care services together to discuss involvement in research. This also provided an opportunity for academics, professionals, users and carers to work together to develop their own research proposals for mini project funding.

Becki Meakin from Shaping Our Lives discussed the first activity at our final conference last year. About 25 people got together, discussed key areas of practice they would like to research, and worked to develop a research funding application. Some of them were (at the time or previously) already involved in research studies; others had academic links or background. The group met twice before submitting their proposal. A number of issues were discussed in the first workshop: some of the discussion focused on what user-led research should be, questions were asked about whether academics had to be involved in proposals for them to be considered robust by funders, and issues aired around the potential barriers that arise for service users to develop proposals including the perceived lack of organisational/university support for such proposals and complex funding application processes.

An ideas swop shop was also organised providing an opportunity for academics, professionals and others to get together, discuss their research interests and pitch a project application to us. Funding of up to £5,000 was made available for those project applications. One project pitched to us and subsequently developed into a formal proposal involved the Campaign to End Loneliness and the University of Kent. The project – Hidden Citizens – drew together interests around social isolation and led to a successful collaboration which Adrian Adams presented at our final conference.

Our key messages from the project have been set out before. The project wasn’t aiming to evaluate involvement or knowledge exchange approaches. We’re not able to say involvement through one form or another works best, or that co-production of research proposals is a necessity for impact. However, our aim was to explore ways to improve knowledge exchange between researchers and professionals, and to test out ways methods for doing this. Some thoughts about this follow.

Musings

Co-production may, or may not be, the answer to a more evidence-informed policy and practice environment. To me it still feels as though we need more evidence on this and case study examples to review. In reality, given the nature of funding and of academia, it’s perhaps a way off. But as we’ve said earlier, knowledge exchange can, and should, take place throughout a research study, and research proposals should be developed and undertaken in discussion with key stakeholders to improve their relevance and subsequent impact. Research of value to practice has to have been formulated knowing what is of value to practice (and the same for policy). We’ve discussed before issues around expectations and contexts, and ideally those need to be discussed and aired before a research question is formulated.

It’s probably very easy for me to say there’s a lack of evidence around involvement but most funders expect it, and co-production is generally accepted as useful (especially for increasing relevance), so think about that in your future funding proposals.

In a recent meeting a carer spoke about her expectations for a role she may could have in research projects, it was clear that she didn’t want to be researcher doing the fieldwork necessarily but felt she had valuable experience and expertise on the question itself, the design, interpreting the findings and so on. There are great examples of service users being involved in research – such as service users as research advisors within a study on homeless women and the QORU Public Involvement Implementation Group– and others of practitioners engaging in research.

We’re perhaps in a chicken and egg situation. Someone has to take the lead in identifying a potential research area (inevitably something they are personally interested in) when a call for research proposals comes out. With a short timeframe in some cases to develop proposals, they might invariably look to their existing relationships to develop a proposal. At the same time we know it takes many months to develop relationships and its difficult to do that without funding and without knowing if funding will follow at some stage in the future.

Perhaps my naïve starting point would be to say involvement should be planned as best for the proposed project, but that implies the project comes first contradicting the idea of co-production. In an ideal world we would have a vibrant research culture in adult social care where such relationships exist to share knowledge and exchange ideas, with practice, policy and research continually learning from each others’ expertise.

So what’s the answer?

Well I can’t honestly say I know… but a few key recommendations come to mind

1. We need to be better at building relationships between research, practice, policy, services users, carers etc without these being tied to a specific research project or funding opportunities. We should be developing approaches that allow us to share knowledge and expertise, and should a funding opportunity arise be well placed to respond to it. There are already a number of networks available and perhaps we need to be better at engaging with those. Such relationships could also build from involvement in earlier studies – relationships don’t have to stop when studies finish. In doing so, we need to improve our understanding of each other – our expectations, our requirements and our reasons for being involved in research.

2. A number of funding opportunities are time-limited. But there are also open calls (such as ESRC’s open research calls) which allow for proposals to be submitted at any time during the year. We need to try to be better at identifying and developing proposals to such calls to allow us to take as much time as needed to develop relevant relationships or collaborations.

3. Research funders need to make smaller seed fund budgets available to allow people to use these to develop their proposals and collaborations – in much the same way as the NIHR’s research proposal development grants work. Funders also need to be more open about what has worked or hasn’t in terms of involvement in the projects they are funding.

4. Those involved in research projects need to share their experiences – more critical reflection from both researchers and those involved in studies seems vital.

5. And I couldn’t end without saying… we need more research on involvement, co-production, what works and doesn’t and – perhaps a more objective evidence-based discussion around this.

Blogging… a piece of cake… isn’t it?

By | Impact, Research Process, Website | No Comments

Blog cake I’ve been meaning to blog since April… I have 5 or 6 drafts of different blogs exploring some of the findings and themes emerging from the SCEiP project, and another few post-it notes with thoughts for other blogs…

It’s now August and I haven’t quite managed to finish those drafts and post the blogs (probably much to the annoyance of two colleagues who dedicate a lot of their time to this website and the aim behind it, although they’re too kind to say so!). But blogging is easy. Takes a couple of hours to draft a blog (for me and I’m not saying it’s any good), a few more to come back to it later and see if it makes any sense, work on it further, login to WordPress and post it. And there’s excellent encouragement on this site too! Yet somehow I haven’t managed to find the time to do this in about 4 months (more if you consider our project ended before then).

In the meantime I’ve been in meetings where some of the themes from those draft blogs have been discussed, and some of those meetings I’ve left frustrated that the discussion hasn’t moved forward (not for the lack of trying!) and I’m making points that everyone should already know… until I realise that I’m expecting others to know what our findings were and how they answered some of the points being raised without ever having put all of them down somewhere publicly. It’s not that we haven’t discussed the findings (we held a conference in November for example) or that there won’t be reports and papers from our project and the various subprojects and activities since then (I’m almost done on those!), but they were not necessarily out there for those participating in the meetings to know about or consider before we met. It’s worse if they didn’t know that information even existed (albeit in my head for some of it).

We’ve spent a lot of time in the SCEiP project encouraging researchers to share their findings openly with blogs being one method, not just 8-9 months after a study ends and the journal paper is published (a minimum guestimate assuming the paper was written before the project ended or the day after…) but regularly and throughout the research process. And no doubt there must be instances when they themselves go to conferences or meetings and feel their research has already provided the answers to some discussion points… but the journal paper hasn’t quite been published or circulated or they didn’t have time (or think to) write a blog on their initial findings (or couldn’t in case it affected whether a journal would accept the paper if findings had already been shared elsewhere). So they raise their findings at those meetings and aim to schedule a further meeting, or hope to find ways to link back with those they networked with, to take the discussion further.

Yet if we don’t get the information out there and – more importantly – to the people who could use it, we’re effectively not helping to move discussions forward – perhaps going as far as stalling them – which in turn means we can’t collectively create a positive impact (be it on wider discussions on knowledge exchange or impact for social care research, or evidence use in practice, or the evidence that commissioners and providers can use for the care and support they manage, or policymakers could use for policy developments). At the end of the day then we’re still discussing things and not implementing actions to address issues, and potentially just going around in circles. Academic researchers do need those journal papers for their own career progression of course but they do need to find ways of sharing their work before and alongside that in an accessible ways. We all do.

We probably all agree with that… doesn’t quite address my problem of not having finished and posted those blogs…

But that’s then in the planning and – to some extent – the value we place on our activities. I appreciate many a researcher finishes one research project and then has to move on to the next one the following day or not receive their salary, which in turn means they submitted the report to the funder but have to find a way to balance writing their journal paper or public output while working fully on another study (or a multitude). We’ve addressed this before – by putting in funded time to proposals to allow for these outputs to be produced (which most funders will not raise concerns with) funded time could effectively be made available, and by building them into the full research process they are not getting stacked up for the last day of the project – but perhaps the day-to-day isn’t something we fully control and other priorities come up, or saying this that doesn’t help after the fact when a project is already underway.

At the same time I know of one example of a researcher whose findings were shared with a key external organisation who wanted to include them in a seminal report which may have led to policy impact. The findings paper was going through the journal submission process so wouldn’t be published for a (long) while and there was no output to cite. The organisation wanted to include the information in some way anyway. So the researcher wrote a blog post and the organisation referenced that in the report and the evidence clearly tied back to the researcher and their study. The blog post in itself was widely cited and picked up in a large number of media outlets with clear references back to the researcher; there has been policy impact and the journal paper has subsequently been well cited.

I’m not saying that that one researcher placed more importance on the impact of their research or the need to share it with others and so spent the time writing the blog post rather than any other priority on the same day(s) – and it was important to make sure the evidence included in the organisation’s report was clearly tied back to research – than any other researcher does. In the last 4 months I’ve tried to come back to the blog drafts I have but there’s always been another pressing deadline to work on first, and then another (and that’s  probably the case for other outputs too). But for me it is important that those blogs do go up, we share our findings (and wider thoughts), and we have the opportunity to have your comments and thoughts on them. Not least so that when we get to the next meeting or the next event we’ve moved the discussion forward, and hopefully have actions happening not just discussion of what action should be taken.

I’ve now revisited the drafts and worked on them further. They’ll start posting on this site over the next couple of weeks and I look forward to the discussions they generate. Similarly the final papers from our work too. Progress!

This blog was not in any way intended to explain myself or the large gap since the last blog we posted here (!!), but did get me thinking that somewhere along the line we need to balance what is shared, how and when to support progress, and to avoid those conversations with comments like “but my work addresses this very issue, let me give you a summary and we can meet up again to discuss” or “that’s great you’re starting this new project, did you know of this interesting overlap (in that it’s the same) with my own work?” with other priorities on our time. At some point surely the time spent revisiting the same discussions could be better spent on getting the outputs out and then discussing them for those who can (decision makers, policy makers, people who use services, carers) to take positive actions. Perhaps that’s me talking to myself – a key lesson in looking back at the last few months!

Next post early next week!

A balancing act? Academic impact versus practice impact? Really?

By | Impact, Research Process | No Comments

In considering all of the issues and queries that have arisen throughout the SCEiP project, perhaps one of the ones that still surprises me is the “but I can’t do both” statement. The idea that it’s not possible to achieve both academic and practice impact, and that researchers have to focus on activities to generate one or the other, but can’t manage both.

Is that really the case? Is it impossible to aim for both?

In fairness this doesn’t come from all researchers and the whole “non-academic impact agenda” is still relatively new… There are some great examples of researchers (across all levels) who are actively engaged in ensuring their research gets to those in practice or policy with the power to make best use of it – while still publishing regular journal papers of course. There are social care professionals studying Masters or PhDs, and working towards both academic and practice impact.

We’ve recently seen the REF2014 results come out and although still heavily weighted for academic outputs, the assessment does give consideration to impact (20%) and its evident that for many universities both the academic and the policy or practice impact is very important – an initial search found about 60 impact case studies submitted relevant to adult social care (more on those soon). There are rumours the 20% will be higher in REF2020.

So why not aim for both?

Professor Julia Black, LSE’s Pro-director for Research spoke at the SCEiP final conference and raised some interesting points. She noted that it’s not often the case that research is supply driven; a researcher can say they’ve got a fantastic piece of research, it’s obsessed them for the last 2-3 years and they think the rest of the world should be equally as interested in it and should know about it right now, only to find out that the rest of the world may not be interested or not feel this is the right time, or it’s not a priority. This may well be the case for some adult social care research.

So we go back to the suggestion that those in research and those in practice should work together to set research questions and undertake the research together. But, as Professor Black said, it can be very challenging for researchers to be told that what they think is a valid question isn’t that important for practitioners, and for practitioners to respond to academics that what they think is a practical solution, a practitioner knows is never going to work on the ground.

So they are right – it’s impossible to do both. The research and practice worlds travel on parallel tracks and can’t meet. There are different priorities and timetables: research is a long process and once completed researchers are aiming for top quality research publications to further their careers – which can take 9-12 months after the end of study to be written, submitted, accepted by a journal and revised ready for publication; professionals and decision-makers in social care need answers now, and preferably yesterday, and work within tight financial constraints and to competing demands for available funding. There are different languages and terminologies.

Well no…

Professor Black also said that these different expectations and timetables have to be managed and considered as part of the research process. It’s important to work with those who are operating in the area to ask how the world looks from their perspective and co-produce research on that basis. Constant dialogue needs to be maintained, and both researchers and professionals have to be prepared to be challenged.

This is where effective knowledge exchange plans come into play. And this doesn’t prevent a journal paper (or a few) being written and published.

What further surprises me is that some of those people state that their role is to do the research and that it’s for others to do the translating and get research out into practice or policy, yet those are also people who are translating their knowledge. They are presenting at conferences or events either organised by those in practice or policy settings or with those people in the audience, and are the very people that researchers say they are having conversations with at these events or in meetings. What’s more, when did research and impact become separated? Haven’t we always been doing “impact” but its just now labelled differently?

OK so where does that get us? Part of the issue seems to be recognising what is impact and where it is happening. Perhaps part of the issue is also that discussing the same barriers in numerous conversations is perpetuating the myth that it is academic versus practice/policy impact rather than alongside it. And that a handful of people saying they can’t do both does not suggest all researchers must feel that way.

It does seem to me that planning from the outset is key, identifying the target audience and the right knowledge exchange methods for those audiences. Funny how we’re back at our top six tips so far…

The SCEiP project …. And six lessons (to date…)

By | Impact, Research Process, Website | 3 Comments

About 29 months ago we set out to revolutionise the way in which knowledge was exchanged in social care, particularly between researchers and professionals… OK not quite what we were officially intending; we just wanted to explore what worked and how to remove the barriers that seemed to exist (or where believed by some to exist perhaps), and – with any luck – move from talking to action.

Why? We’ve had a long standing interest in how research, practice and policy work together to improve adult social care within the Personal Social Services Research Unit (PSSRU) at LSE, and various pieces of work have been undertaken exploring knowledge exchange (KE) in social care. Then along came HEFCE’s Research Excellence Framework with a view to putting impact firmly within its research assessment process, and the NIHR School for Social Care Research (which PSSRU is involved in) where the aim was to improve the evidence base for adult social care practice and to ensure that evidence was feeding into policy and practice developments. We knew of the barriers and it seemed that research and practice were moving along on parallel tracks to the same destination. So in 2012 we sought funding from the LSE’s Higher Education Innovation Fund and the SCEiP (Creating an Impact: Social Care Research in Action) project was established to test what could work and how, and provide tools to support greater KE.

Have we improved KE between researchers and practitioners in social care (as well as others)? Do we now know the best methods to use? SCEiP tested out a number of activities involving a large number of people, and we were lucky enough to have the scope to do that. There have been numerous times when we’ve stopped, reflected and realised that we’ve barely scratched the surface. That’s partly because improving the way knowledge is exchanged is not something we can do alone. At our final conference on 26 November it was great to see a very engaged room of 120+ people from a range of backgrounds all very enthusiastic to … well make sure research “makes a difference”, and hopefully each of those people will have gone back and made some (however small) improvement in the way they approach KE or more importantly how they approach their research or their practice. Perhaps that alone is not enough and one of the key lessons we came away from the project with is the need for reestablishing the foundations of research and practice rather than perhaps just trying to patch the knowledge exchange cracks… in an ideal world of course!

We did learn a lot and have a number of recommendations – on evidence into practice (and vice versa), building research capacity, impact assessment. Some of these were drawn out in the excellent visual note from Nat Al-Tahan at our final conference, while others we will share in papers and blogs over the coming weeks. Here we share our current top six lessons.

So what would be the top six lessons we would put forward now? There are probably quite a few… but to briefly limit to six:

Plan:
Somehow KE seems to be something that gets tagged on after a research project has been fully planned out. Maybe because it’s something research funders insist on but it’s still not clear how to do it or what actually works. Ensuring that KE activities are planned within research processes – as part of each core research activity and as part of the timeline for the proposed study – is very important and places research in a better position to have impact.

Knowing that research does not end with KE:
It seems the approach taken to KE is still that it’s something that happens at the end of a study when findings are available, as dissemination. It isn’t. It can – and should – take place throughout a research study from the development of the research question/proposal, telling the world the study is starting, sharing updates throughout, discussing interim findings, and so on. If target audiences do not know a study is happening, by the time the results come out the topic or area may not be relevant to them anymore and most practice decisions will already have been made. The more engaging the research process, the more likely it is that target audiences will stay engaged and use findings.

Knowledge exchange needs time and resources: A common barrier put forward is the lack of time and resources for KE activities. Yet funders want the research they fund to have impact and will fund clearly thought through KE activities relevant to the proposed project to support that. So why not ask them for the funding and build in time for integrated KE activities in research funding proposals?

Know your audience and target knowledge exchange methods to them:
KE activities will not work if they are not targeted. Proposing to use social media for professionals without addressing the issue that some face with lack of access to social media within work settings, or writing policy briefs when a decision maker will only read 2-4 pages maximum and will want to focus on the implications of those findings for them, may look good on paper but do not work in practice. Ideally planning of the research – and integrated KE activities – will take place with those audiences.

Innovative knowledge exchange methods and traditional methods are not mutually exclusive:
A KE activity targeted to professionals – such as a workshop or findings summary – does not have to replace the production of a journal paper. Arguments about not being able to do both are incorrect; academic and non-academic impact are not mutually exclusive. If planned appropriately with the right resources (time and funding) both can be done and any research project will be the better for that.

Evaluate:
It is very important to evaluate the activities as they take place and build in an evaluation process/framework in planning stages. Not knowing that an activity did or did not work – and why – until after a research project ends will not allow for learning to support tweaks in forthcoming activities.

These are all interlinked and doing one will lead to the others quite easily. Putting the time in to think through the proposed study (what the aim is, who the target audiences are, what would work best for those audiences, and resource implications) at the research proposal development stage will require some time, as does developing a research proposal anyway, but will ensure that any proposed study has the best possible start on its impact pathway, and then … its just a case of making it happen!

Welcome to the Social Care Research Impact Website

By | Impact, Research Process, Website | No Comments

Welcome to the Social Care Research Impact Website. It’s been a really interesting process designing and developing this site, which is built on some workbooks and workshops conducted as part of the SCEIP (Social Care Evidence in Practice) Project led by PSSRU @ LSE. We received strong feedback that having the contents of printed workbooks made available online would help engagement, and the development of a more engaged community of practice around the impact agenda in social care research. Hopefully, this site in its current form is the first step towards that longer term and ongoing goal.

I’ll leave other colleagues on this project to blog more about SCEIP itself and the origins of both the Impact agenda for research within Social Care and the other outputs and findings of the work that SCEIP has been doing over the last few years. You can find some of that information on the two links above. Instead, I want to introduce the website to you, which was, as one of the outputs of this project, designed as a repository of tools and methods to support researchers to consider, plan, and implement impact activity throughout their research processes.

On a slightly ‘meta’ level I suppose, but an illustrative one, the website itself forms part of the impact of the SCEIP project as a whole – a resource that lives on, even as the SCEIP project draws to an end in its current form. Hopefully, without getting too wrapped up in these different levels of abstraction of the concept of impact, the idea of the website as both an ‘output’ of the SCEIP project and an ongoing activity, or platform that communicates and continues to redefine and redevelop the findings of the SCEIP project in its own right is helpful in illustrating the concept of research impact that SCEIP is trying to support. This idea, that it is no longer good enough, or effective enough practice as a researcher to consider impact as an output at the end of the research process, and instead, that we must begin to see, and more adeptly capture the knowledge we generate, as manifest in performances, and recorded through use of the tools of impact such as those detailed on this site, as ongoing and dynamic parts of the research process itself. Put more simply, what would the world look like if every research project had it’s own blog site and published its findings in an engaging and accessible manner, freely available online?

Whilst you consider that question and it’s applicability and suitability for your own work and in conjunction with your own interests with regards to research impact and research implementation within social care, consider also that the requirements of many research funders and the wider RCUK Impact Agenda now demand that such ‘impact activities’ in fact become themselves embedded within, and enhance, the research you are conducting. Practicing impact activity in this way thereby becoming, in the current political, social and technological climate at least, fundamental to the way you as a researcher fund, qualify and evidence your work and communicate your research findings.

If you are convinced, or already aware of the need to consider Impact and utilise a web resource such as this as part of your practice as a researcher, you can find the tools we have assembled for performing and documenting impact using the menu above, assuming you haven’t already. We have two types of resources at this stage, namely Impact Tools and Impact Management Tools. These two repositories, designed to be useful to researchers in considering and planning impact activity build upon two of the findings from SCEIP that, 1. tools for impact are not clearly enough signposted for social care researchers, and that 2. the process of planning and managing the impact process is often difficult too, and a substantial barrier to success. We hope in providing a basic list of possible ways of creating, performing and documenting impact, and another resource supporting some of the ‘behind the scenes’ management aspects of these processes, we have begun to address these two identified barriers to impact for social care researchers. We welcome ongoing feedback about how useful these ‘front stage’ tools and ‘back stage’ management tools respectively are in supporting you in your research, and, we hope, assisting you in planning and increasing the impact of your research wherever you are currently working, and whatever the stage in your research you are currently at.

The design approach of thinking about impact as a process, rather than an outcome, is one of the key insights developed through the SCEIP project itself and mirrors the transition of what we now know as the ‘Impact Agenda’ from it’s previous incarnations as ‘awareness raising activity’ and ‘engagement activity’. This increasingly participatory transition, from purely didactic and static approaches of achieving impact such as journal articles, or conference proceedings towards more democratic and dynamic approaches not just to influencing or reviewing policy, but shaping the social care landscape through research from the bottom-up. This does of course open up many further questions about the motives and ethics associated with impact activity and also provokes further questions around the ethics and implicit assumptions of technology and media more generally as mechanisms for communicating and engaging people with research. I think at this point in time, however, the web is undoubtedly a fundamental tool in society in general for supporting people to use and access knowledge. However, a common metaphor we relied upon throughout the SCEIP project was the idea of avoiding research ‘just sitting on the shelf’ after it was done. The use of dynamic and social media such as websites, blogging, and social media tools as detailed elsewhere as impact methods themselves on this site, and manifest in this site itself, does not guarantee that web resources and social media won’t just become ‘virtual shelves’ gathering virtual dust, like many of the journal articles or conferences proceedings that we also produce as researchers and that are also available through the web. Addressing this point with respect to our own online resource, we are really keen that people begin to feedback how we can make this site more useful, and continue to develop ways of supporting people to both use and access it’s content, and in so doing engage with its aims. Please feedback to us through the comments below, or through twitter and we look forward to continuing to adapt and evolve this resource together with you further in future.