This deliverable presents the data collection and evaluation tools to be used to perform the assessment of stakeholder acceptance within GreenCharge project.
The assessment will consist of the computation of the KPIs already defined in deliverable D5.1-D6.1 Evaluation Design and Stakeholder Acceptance Evaluation Methodology and Plan. For most of the KPIs the information required to calculate the KPIs will be based on human interaction. The proposed tools to get this information from users are surveys, interviews, workshops and focus groups.
Surveys for data collection
Surveys are one of the basic tools that will be used to gather user’s feedback. According to CIVITAS guidelines, the design of a survey should take into account: objectives of the survey, population to be sampled, relevance of data, precision required, method of measurement, and sampling units.
There are several type of surveys, but the ones envisioned to be extensively used in GreenCharge are on-line surveys and paper-format surveys.
Since the population to be sampled is not very big, there is the risk of low participation. However, the size of the sample enables the direct contact and facilitates user engagement. Special attention will be paid to that risk and some mitigation actions has been envisioned such as incentivising including a draw or lottery for participants.
According to CIVITAS analysis, online surveys are the ones with the lowest rate of responses. However, they are very convenient in terms of accessibility to participants (they can provide their answers whenever and wherever it is suitable for them). To mitigate the risks, some incentivising mechanisms will be put in place.
Apart from surveys prepared by GreenCharge partners, additional information can be gathered from external surveys or collaboration with other initiatives. These surveys may help to contextualise the results and for comparison.
Interviews, workshops and focus groups for data collection
Interviews, workshops and focus groups offer a richer interaction with users and enable to capture details that may be overseen in surveys. They have the handicap to gather a group of people in a place for a specific time slot. For efficiency purposes, synergies will be established with other tasks in the project that need also to organise meetings and events such as business model workshops, local reference group meetings, uptake cities meetings and any other relevant dissemination event.
Additional channels to gather user’s feedback are user support sections in apps or web pages where users provide comments or complaint about some aspects of the application or service or user satisfaction surveys embedded in apps.
Calculation of KPI analysis will be performed based on data retrieved by the mechanisms previously described. The process is highly manual. In some cases, some categorization of answers may be needed to group and quantify the results. It is not envisioned the used of any additional tool for data processing beyond standard spreadsheets. Eventually, the results may be displayed in an integrated tool for evaluation developed within WP5.
The evaluation process will happen at the end of each iteration of the pilots. For the first iteration, the base line data gathering for most demonstrators will start in February-March 2020 and the evaluation will be completed by July 2020.