Better case management of FOI and SAR requests ALPHA

Project details:

Organisation London Borough of Hackney
Department Information Management
Collaboration Level Open To Conversation
Budget £50K > £100k
Key Contact Sarah Palmer-Edwards
Phase start 08 January 2019
Phase Estimated end 30 April 2019



You can read our full Local Digital Fund bid here:

We want to work together with our partners (Suffolk Council, Stevenage Borough Council, Cornwall Council ) to conduct some further discovery and an alpha project looking at the user journey for council staff who manage and respond to FOI requests and SARs in order to prototype approaches to the unmet user needs we have discovered, and understand whether a digital solution and data standards could better support these needs and allow them to handle requests from the public more efficiently.

We’d like to develop a prototype of an end-to-end open-source solution that includes reporting, and subsequent publishing of non-personal requests. The main objectives would be to assess the potential for increasing efficiency and ease of use for the council, and better meeting the needs of citizens, both from ease of use and response time perspectives, and in such a way that supports reuse by other councils.

A successful outcome would be an end-to-end set of user interface prototypes for a request handling system that have been validated by user testing in multiple councils and a clear recommendation based on a business case on whether to proceed into a beta project for either open-source request handling software, or a set of open standards around request handling. In either case, the user research report created should outline.




Status Updates

21 March 2019

  • Sarah Palmer-Edwards

    2019-03-04: Week 10 & 11

    Here’s what we did this week

    • Alex and Gareth attended the Bradford roadshow to present our background research and get some early feedback on our playbook plans. We had some good discussions around our background research and prototype plans, and the other sessions we attended were really interesting too. We spoke to the DPIA project team as there’s similarities in our prototypes, so we’re now keenly following their progress on pipeline.

    • Martin’s shared a draft of the discovery phase write-up for our comments, so we’re pretty close to getting it published.

    • Louise is thinking about the business case around reducing inefficiency in the request handling process. We’ve sent off our initial data to the Local Digital team. Louise and Sarah met up to chat about the challenges around procurement.

    • Sarah hosted a roundtable discussion on the project at Share Digital in Birmingham.

    • We squeezed in another interview with a member of the team at Suffolk about SAR handling.

    • We’ve organised to meet in person for a workshop on March 18th in Hackney, where we’ll review the prototypes so far and run some sessions to guide the next iterations.

    • Gareth and Louise had a call with the Ministry of Justice for a demo and Q&A around their open source correspondence tool. We were pretty impressed, so we’re going to demo it at the Workshop next week.

    Here’s what we’re thinking about

    • We did some deeper thinking about the self assessment playbook and found some nice examples.

    • The SCIO has a self-assessment toolkit, but it covers more the “what”, rather than the “how” that we’re aiming to help with.

    • The ICO has some nice Data Protection self-assessment tools that highlight “next steps” based on your answers to their questions.

    • Atlassian’s Health Monitors have a nice interactive format for rating key team attributes and suggesting relevant guides.

    • The Madison Public Participation Playbook allows user generated content in the form of highlight comments.

    • We distilled the examples from our research to the key workflow that we’re aiming to prototype:

    Here’s what’s coming next week

06 March 2019

  • Sarah Palmer-Edwards

    2019-02-25: Week 9

    Here’s what we did this week

    • Had an extended conference call (it's a shame that not everyone can access video calls) where we chatted about the discovery phase and proposed prototypes.

    • We were pleased to hear that the discovery phase had helped to frame the challenges faced by authority partners and gave them a way of thinking where to focus improvement efforts next.

    • We also discussed which direction the remainder of the project should take, with broad agreement that we should focus primarily on prototyping an FOI playbook, and thinking about the Time-to-allocate problem.

    • The idea behind the FOI playbook is that there’s currently no clear path for understanding  and improving the people, process and technology areas of an FOI service. Our idea is to build a tool that helps councils self-assess to give them some indication of how they compare to others, and offer suggestions on how to tackle the most likely problems that occur based on what emerges from the self-assessment.

    • Reducing time-to-allocate is critical in giving enough time to gather information and compile an approved response. We think there’s a gap in the tooling that masks this problem. Improving visibility of time-to-allocate would help pinpoint workflow problems – hopefully ones that we can start to address through the playbook.

    • In the remainder of the week we started digging into what prototypes of these might look like.

    • We thought about what questions you might ask during a specific workflow:

    • We made some super early sketches of how a playbook might look:

    • Louise has been thinking about the business case in terms of social, user, financial value.

    Here’s what we’re thinking about

    • We’ve been looking at how other organisations have approached the concept of a playbook, to take inspiration from the better ones. Here are some we liked:

    • We’re also trying to figure out the right “depth” for the playbook: just how much detail is useful, and how much becomes off-putting or impractical?

    • An in-person workshop with attendees from partner councils would be a great way to start answering some of these questions, and to brainstorm ideas for guides/self assessment questions.

    • Some of the self assessment could be around a concept of standard comparator requests: if answering a FOI request is hard/expensive, that’s an indicator.

    • When thinking about self assessment tools we’re also considering the variance between service areas – different service area responses might indicate that cultural change is required, eg FOI comes up in the weekly meetings.

    • Katharine (Information Governance Lead at Hackney) sent over some analysis she’d previously done on overdue FOI requests. The stats are very interesting. One striking question that occurred to us is “how do you know what you don’t know”? If you have to ask several colleagues before you can ascertain that the information is not held, or not held in a returnable form, then those requests are going to be the most time-consuming, but you might not know that at the beginning of the process.

    Here’s what’s coming next week

    • Alex and Gareth are attending the Bradford roadshow to present our background research and get some early feedback on our playbook plans

    • Martin’s aiming to finish up the discovery phase write-up.

    • Sarah is hosting a roundtable discussion on the project at Share Digital in Birmingham.

    • Louise is thinking about the business case around reducing inefficiency in the request handling process.

26 February 2019

  • Sarah Palmer-Edwards

    2019-02-11: Week 7 & 8

    Here’s what we did this week

    • We were fully focused on developing the research and problem definitions last week, so the weeknotes fell behind, hence the joint update!

    • Back from the mySociety retreat, we spent time developing our ideas from the session we had there, putting them into a presentation, so that...

    • ...we could then coherently present the research and theories so far to the Show & Tell group.

    • We refined and recorded versions of the Show & Tell presentations so that we could share with council representatives who couldn’t make the Show & Tell calls. It also allowed us to address questions that came up from the initial presentations:

    • Sarah and Gareth co-led a session at the Local Digital Roadshow – here are Adam’s notes. It was good to get some external eyes and ears on our findings so far and confirm that we weren’t way off the mark.

    • During the discovery phase of the project we noticed that there were opportunities for small, single-purpose tools. One observation we made was that several councils create “due date” sheets – calculating the due dates of requests based on the date they were received. We hacked up a quick prototype in to Alaveteli – the software that powers WhatDoTheyKnow – and it looks like its something we can provide for everyone:

    Here’s what we’re thinking about

    • Universality: what are the main problems that broadly apply to all councils when dealing with SARs and FOI requests?

    • We’re starting to think about the business case for an open source FOI platform.

    • We’re hoping to present our background FOI research at the Bradford Roadshow

    Here’s what’s coming next week

    • We’ve presented what we think are the main problems we’ve discerned in current request processes, and asked the group to rank them, together with some of our prototype ideas to address them. The next Show & Tell is an extended call so that we can deliberate how to take the concepts forward. Should be fun!

12 February 2019

  • Sarah Palmer-Edwards

    2019-02-04: Week 6

    Here’s what we did this week

    • It was mySociety’s annual retreat this week, which saw us meeting up in a big house in the country and working face to face for once. This gave us a chance to talk through where we’ve got to so far and what the next steps will be.

    • During the retreat we designed a rough framework for comparing councils’ FOI handling capabilities.

    • We also started thinking about which prototype ideas will have the biggest impact.

    Here’s what we’re thinking about

    • How does a differing focus on People, Process and Technology affect an FOI system?

    • Where does knowledge lie in the council organisations, and how is that best extracted in response to information requests?

    • What prototypes should we go ahead with, in which of these three areas?

    Here’s what’s coming next week

    • Presenting our preliminary research findings on the weekly Show & Tell call.

    • We’ll be at the Local Digital Roadshow.

05 February 2019

  • Sarah Palmer-Edwards

    2019-01-28: Week 5

    Here’s what we did this week

    • More interviewing, by phone this time, and across the whole range of councils! We had really useful chats with Dumi and David, our main project contacts at Stevenage & East Herts and Cornwall, then moved on to no less informative conversations with other staff too: three from Cornwall, four from Stevenage & East Herts, and one from Suffolk.

    • In between all that, we were writing up our notes from these interviews and last week’s in-person sessions in Hackney.

    Here’s what we’re thinking about

    • The overlaps in each council’s process when it comes to dealing with requests: the processes all seem reasonably similar, but we discovered very different levels of contentment expressed within different authorities. Might headcount be a factor?

    • Whether there’s a size threshold where a council needs to move from lightweight processes to something more prescriptive.

    • What the final format of our report should be — we want people to read it, so it has to be accessible and not too dry.

    • What tool improvements could help improve processes for everyone.

    Here’s what’s coming next week

    • We’re interviewing two more staff members, from Suffolk.

    • It’s mySociety’s annual retreat, a couple of days where we all go away together to work intensively, face to face. We’ll be holding a session on this project to get together and review all our notes from the interviews, observations and research and define the scope of what’s next.

29 January 2019

  • Sarah Palmer-Edwards

    2019-01-21: Week 4

    Here’s what we did this week

    • On Monday we spent an enormously useful day, speaking to eight people from Hackney who work with FOI and SARs.

    • We came back on Tuesday to run six observation sessions, taking notes on how staff approach the various stages of fulfilling a request.

    • We also had a call with Alex Nash about the open source correspondence tool developed at the Ministry of Justice. It sounds like there might be some shared interest, so we’re getting the tool up and running to have a look at.

    • Then we spent the rest of the week writing up our notes, and starting to digest the information we have so far.

    Here’s what we’re thinking about

    • One theme that emerged from our sessions in Hackney was that of reporting FOI activity to the wider world. The Scottish Information Commissioner requires some data to be submitted for performance monitoring, so we should look into this as a starting point.

    • We also noted that minimising the time to assign to the people who can provide the information asked for in FOI requests is key for giving the responder enough time to gather the information on time.

    Here’s what’s coming next week

    • We’ll be interviewing again, but this time remotely. We’ll be talking with staff in Cornwall, Suffolk and Stevenage.

15 January 2019

  • Sarah Palmer-Edwards

    2019-01-11: Week 1 & 2

    This project involves several people working in different locations around the UK. It will generate a large quantity of information as we learn about users’ needs and refine the project scope. It’ll move fast and it’s really important that we’re all kept in the loop.

    Enter #weeknotes! Via this simple format, the aim is to record the project’s progress (and the process) where everyone involved can see it. We also hope that they’ll build into a permanent record that any other councils interested in the decisions and processes we went through will be able to access.

    Please feel very free to let us know your thoughts and comments.

    Here’s what we did this week

    • Kick-off! A call between mySociety and all partner councils.

    • We’ve scheduled a weekly Show & Tell call where we can demonstrate progress and receive feedback.

    • mySociety presented our draft user research plan, and we’ve got the ball rolling on scheduling interviews and observation. We want to get this underway as soon as possible in the next two weeks (scheduled for 21st & 22nd January). We’ve got a day of interviews and a day of observation.

      • In the interviews we’re aiming to talk to FOI team members from all partner councils, as well as individuals from other council departments who routinely take part in the FOI/SAR processes.

      • The observation sessions will cover Hackney Information Governance staff using Infreemation.

    • mySociety has been rereading our existing internal research on FOI statistics and local government FOI admin, as well as process documentation sent over by Hackney Council. This is helping us narrow down the questions to ask when we come to interviews.

    • Gareth and Martin took all the post-its from the earlier workshop during which people had shared Fears, Hopes, Pain Points, Users and User Stories, and typed them up.

    Here’s what we’re wondering about

    • How to make best use of the Trello board where we’re organising all the project to-dos.

    • Whether those “other councils interested in the decisions and processes we went through” mentioned in the intro to this piece, actually exist… or will find these notes if they do.

    • How to get this post added to Pipeline!

    Here’s what’s coming next week

    • Sarah from Hackney is aiming to get the project set up on as a central place to post updates. (As you’re reading this, obviously she succeeded!)

    • mySociety will complete work on the User Research plan, laying out a few different options on the scope.

    • Process documentation continues to come in from partner councils, so mySociety are reviewing this to aid preparations for the research interviews.

    • We’ll finalise our plan for working in the open on this project. We’d like to share previous user research and prototyping/testing reports with partners, and publicly.