Validating the previous usability test's pain points
Code for Chicago is a subsidiary of Code for America with the goal of making tech accessible to everyone. Through Civic Tech, our work can bridge the gap between nonprofits and technology. Code for Chicago operates as a pro-bono digital consultancy. Code for Chicago identities the needs of the community and partners with local organizations for Civic Tech projects. These roles include, but are not limited to: Developers, UX/UI Designer and UX Researchers.
Findings from the Code for Chicago website usability test and interview identified some concerns. First, some users are unclear of the exact mission of Code for Chicago, who code for Chicago helps, and what the exact volunteer expectations are.
A series of remote moderated usability tests were conducted between February 28th and March 4th, 2023. These usability tests were conducted to test an updated prototype for a website redesign for Code for Chicago. The purpose of this research was to validate the findings of the first Code for Chicago Website Validation test as well as the Code for Chicago Interview Study.
Five participants took part in this test. Each individual session lasted approximately 40 to 60 minutes. In general, participants found the website to be logical and enjoyed the overall aesthetic. However, there are still some pain points in identifying project timelines and the overall onboarding process with this current prototype.
February 2023 – March 2023
The existing Code for Chicago website has some elements that are not explicitly clear to potential volunteers, which may deter individuals from joining the brigade.
Our team conducted 5 moderated Usability Tests and 1 Pilot Test with a high-fidelity prototype of the redesigned Code for Chicago website.
A test-plan was created by the Meta Projects UX Research team. The test plan consisted of a problem statement, study purpose, scope, research questions, participant criteria, feature prioritization, logistics, test outline and script.
Participants were recruited through LinkedIn. In the post, potential participants were asked to fill out a short screener. If they met the screener criteria, they were contacted to coordinate a testing time. Participants also completed the online consent form prior to participation.
The required criteria was as follows:
We also outlined some preferred criteria in our research plan: People who have volunteered before but not for the Code for Chicago brigade, potential volunteers who haven’t heard of the brigade before and people interested in gaining tech-related experience. All of our participants met both the required and preferred criteria.
The Usability Test was conducted to validate the findings of the first Code for Chicago Website Validation Test as well as the Code for Chicago Interview Study. This round of testing focused on three main areas: understanding the purpose and mission of the organization, how you can get involved with Code for Chicago and how you can volunteer for Code for Chicago.
The usability tests were conducted via Zoom with one moderator and at least one notetaker. The meetings followed the script as outlined in the test plan. Each usability test lasted between 40 to 60 minutes. The test included pre-test interview-style questions, 3 task scenarios that were completed through a website prototype in Figma and post-test follow-up questions.
At least one member of the research team took notes on each session, noting any problem areas during tasks, and pre and post test questions. After the completion of the 5th test, the research team created an affinity diagram and identified key insights, pain points and opportunities per participant per task. After identifying these key parts, the research team submitted final insights and recommendations by task. Each usability test was recorded so the entire research team could review the usability test.
Based on the results of the usability test, the overall usability of the website seemed to be logical to participants. All participants liked the overall aesthetic and visual layout of the website. On the “About Us” page, we found that most participants are unclear of the distinction between Code for Chicago and Code for America. Some participants are still unclear how to define Civic Tech and had difficulty expressing their own definition of Civic Tech.
For the volunteer roles, most participants have a good sense of volunteer roles that exist within Code for Chicago. However, no participants were able to identify all three ways to be involved with Code for Chicago: donating, volunteering or being a non-profit partner.
Participants enjoyed the project-specific page outlining volunteer roles and expectations. Many participants had a positive impression of the project description and expectations. However, exact time commitments are still unclear –for both recurring meetings and the overall project timeline.
Finally, there is consistent confusion around pre-onboarding tasks. The current dichotomous pre-onboarding + onboarding process is unclear. Page layout and order only adds to confusion and hinders volunteers from completing tasks in the desired order.
\ Link to affinity diagram: https://miro.com/app/board/uXjVP81cL4U=/?share_link_id=575347694857
Rebuilding the Coalition's website to ensure easier access to cannabis equity resources
Creating a brigade design system to make updating and scaling our website easier in the future.
Validating the previous usability test's pain points
Identifying Code for Chicago's target user groups and leveraging that insight to inform the website's content and organization operations.
Identifying frequent pain points in the Code for Chicago website
Mediating discussion for the Parks of Oak Park residents
Improve the backend workflow to enable more autonomy.
Increasing student attendance by improving their marketing and logistics.
Measuring air quality at a local level using public sensors.
Identify a technical solution that fits the partner's use case and developing/designing a new brand and website.
Optimizing a digital workflow and ensuring a sustainable solution that scales.
Redesigning of text heavy handout to an infographic
Recommend an eComm platform solution that integrated with CFT’s current website
Designing and developing for an environmental campaign.
Recommend a better geofencing solution that best fits a number of PDOP’s use cases.