English French German Italian Portuguese Russian Spanish
Tools Lessons Learnt Workshop

Focus Group

A focus group is where a group of people (from around 4 to 12) are asked questions about their experiences and opinions on particular topics.

Focus groups use a facilitator and a semi-structured interview process to prompt discussion amongst a group of people. The group can be representative of the target group, or they may represent subsets of the target group  if you are looking to identify how different groups have experienced a certain intervention. Focus groups can be used in a self-contained manner for the purposes of exploring new initiatives or for understanding participant’s own perspectives on a project.  Two different types of focus group techniques (ORID and Lessons Learnt workshop) are explored in the sections below.

 

Pros Cons

Provides valuable information to explore and clarify a project’s goals and process

Research takes place in an unnatural setting

Provides valuable information from context of participants (and stakeholder) experiences of taking part in a project

Can stray from desired topic due to group discussion process

Can be hard to replicate

 

DSE Book 3For more information on focus groups, see the Department of Sustainability and Environment Effective Engagement Toolkit, Book 3, p32.

ORID FOCUS GROUP

The ORID method is a focus group process that facilitates a structured discussion process that can be used for small groups (up 12 people).

ORID stands for

  • Observation
  • Insights
  • Reflection
  • Decision.

The ORID process provides valuable qualitative information on the strengths and weaknesses of a project, based on the viewpoint of the participants (or other stakeholders). As such, the process can provide some valuable learnings to improve further phases of a program, or to design a new program or vision for future initiatives.

 

A short tutorial on how to hold an ORID focus group - opens up in PowerPoint

ORID Front Slide

ORID pros and cons

Pros Cons
Provides valuable information from context of participants (and stakeholder) experiences Requires some facilitation skills
Structured thinking that focuses discussion on topics of interest Can seem awkward based on the structured discussion process
Can be difficult to analyse unless session is voice-recorded or extensive notes are taken

ORID Requirements

  • A facilitator to lead the discussion, prompt questions, and ensure everyone has a say
  • A note taker, or digital voice recorder (or you could film the session) - remember that you must seek all participant’s approval prior to recording the session
  • A large writing pad or whiteboard to write down the “observations”
  • Set up chairs in a U-shape with the writing pad out or whiteboard at the front
  • About 2 hours, and some refreshments
  • A projector and computer are optional, but can be useful to show the ORID process, and remind the participants of the prompt questions for each part.

ORID How to Guide

A good way to start focus group sessions is to provide a general welcome and then use an icebreaker to get everyone speaking. For example, you can get people to have a quick chat in pairs, and find out a couple of things from each other, such as something sustainable that they have recently done, or their favourite food, or holiday destination etc. Then, one half of the pair will introduce the other person, by saying their name, what they have recently done, their favourite food (or whatever you choose). Everyone then has takes a turn at introducing the person next to them.


The facilitator should then provide a brief introduction to the ORID process, highlighting that it is a structured discussion which may seem awkward but that it provides a way to work through issues following the natural process of the mind. It is also worth the facilitator explaining that the ORID process provides valuable information from the participants perspective, and that the learnings will be valued by the Council (or organisation) as a means to improve the project. After all, there is nothing worse than thinking your input is not valued!


The facilitator should then proceed to set a few rules, such as listening to other people, respecting everyone’s opinion, and not having one person dominate the conversation. Once this has been completed, the facilitator can step through the ORID process, as outlined below.

ORID Front Slide

A running sheet to undertake an ORID focus group is provided here.


A PowerPoint to accompany the running sheet and to use in your ORID session is available here.

 

Step 1. Listing observations

The first step in the ORID process is to ask the participants for their observations about the project. These are to be written up (by the facilitator or an assistant) on the writing pad or whiteboard. This can be prompted by questions such as:

  • “What is your most significant observation about the program?”
  • “What do you remember?”
  • “What did you hear or see?”

It is important to remind the participants not to explain their observations, but rather keep them to one or two words. For example, observations of a workshop series may include speakers, or something a speaker said, the venue, handouts etc. If there are similar observations, it is best to group like themes, but remember to ask the participants if they agree on the groupings. If there is disagreement, keep them separated.


The following steps are repeated for each observation.

ORID process diagram

ORID process diagram

Step 2. Reflections

Once all the observations have been listed and liked themes grouped, go back to the first observation and ask participants to reflect on that observation and ask them what they liked or did not like- this could be a positive aspect, or an empowering experience, or a frustrating one. Prompt questions include:

  • “Was this exciting or surprising?”
  • “Did this engage your interest or empower you to become more sustainable?”
  • “Did you like this or not?”
  • “Did this frustrate you?”

It is important to ensure that participants do not explain their feelings at this stage. Remember to ask all the participants for their reflections on a theme, even though they may have not raised it as an observation.  The reflections do not necessarily have to be written up on a whiteboard, though it may be useful to jot down summary points in order to prompt the following step. It is recommended that the facilitator keep brief notes to recall interesting reflections that they may want to refer back to. Once you have obtained the reflections on the first observation, move on to discussing the insights that arise from the reflection.

 

Step 3. Insights

Based on the reflection that has just been discussed; ask the participants what this means for the project. For example, if they didn’t like the length of the workshops, find out at this step why they think that and what are the implications (e.g. that they can’t concentrate for that amount of time and hence they think they should be shorter). Prompt questions include:

  • “Why did this aspect work or not work?”
  • “What does this mean for the program?”
  • “What are the implications?”
  • “What are the options?”

Again, the insights do not necessarily have to be written up on a whiteboard, though it may be useful to jot down summary points, especially the implications and options, in order to prompt the following step. Once you have obtained the insights on the first observation, move on to discussing the decisions.

 

Step 4.  Decisions

The decision step provides some concrete and focused actions that the Council (or organisation) can take away to improve the project or plan strategies and future initiatives. The previous step may have revealed some options which you can enquire into further, or you could prompt the participants with your own options triggered from their insights and see what they say. Prompt questions include:

  • “What changes are needed?”
  • “How would you prioritise changes?”
  • “What would you say about the program to someone who was not there?”
  • “Having experienced and reflected on this program, what are your next steps?”

Having completed the R-I-D for the first O, go to the second observation and repeat the process until you have completed this for all of them.

 

lessons learntLESSONS LEARNT WORKSHOP

A lessons learnt workshop is another variation of the focus group.  The lessons learnt workshop can be used by projects, teams or organisations as a participatory evaluation tool.  The workshop can be held at stages throughout a project (formative evaluation) or held at the end of the project (summative evaluation).

Why conduct a lessons learnt workshop?

Monitoring and continuous improvement (formative evaluation)

Lessons learnt workshops can be held at multiple points throughout the design and implementation phase of a project as part of a continual monitoring process to assess how well the project is being designed or implemented. Through this monitoring, continual improvement can occur by trying to do more of ‘what the project is doing well’ and to address issues in areas that need improving. 

Project evaluation & information future projects (summative evaluation)

Lessons learnt workshops are often held at the end of a project as part of an end-of-project evaluation to uncover key findings and recommendations.  Findings and recommendations can be used to report back to project stakeholders and inform future project design and implementation to increase the likelihood of success.

 

The lessons learnt workshop is guided by three key questions documented in the table below.

FormativeSummative

What is working well?

What worked well?  

What can we improve upon?

What could have been improved?

What should be do differently for the remainder of the project?

What should be done differently next time? 

 


A downloadable guide on how to conduct a lessons learnt workshop has been created that will help you think about what you need to consider and what steps you need to follow to prepare, host, report back and provide feedback.  A detailed session plan is also included to help you or someone else facilitate the workshop.



 


Further Links & Resources

Pacific Edge Communication on ORID

Top 10 Lessons Learned Review Guidelines 

Facilitation of Lessons Learned Discussions

How to Facilitate an Effective Lessons Learned Discussion

 
Donate Now

Please make a donation to upgrade the Evaluation Toolbox.

The Evaluation Toolbox is maintained by Damien Sweeney and Martin Pritchard from PREA as their in-kind contribution back to the community. The Toolbox now needs several weeks of work to review and upgrade all the contents and add new content for you. Work has begun and we are seeking your donation (big or small) to help support this major upgrade. Email us to indicate what you want to be included in the Toolbox.

case study

What is the Toolbox?

The toolbox aims to provide a one-stop-site for the evaluation of community sustainability engagement projects that aim to change household behaviours. Through the toolbox you can learn how to conduct your own evaluation of a behaviour change project using the guides and templates provided.

see more...

Why Evaluate?

Conducting an evaluation is considered good practice in managing a project.

The monitoring phase of project evaluation allows us to track progress and identify issues early during implementation, thus providing and opportunity to take corrective action or make proactive improvements as required.

see more...

 

DSE
City of Whitehorse City of Whitehorse
Accord