Success Metrics

Metric	Frequency	Indicator	Method to collect data	Level
App crash rate	Daily	The number of times the application experienced an unexpected exit.	User surveys and telemetry	Province
App latency		The time taken between a user's action (such as submitting a transaction) and the app’s response to the action.	Telemetry	Province
Error rates	Daily	The number of times users encounter systems errors over a defined period of time.	Telemetry	Province
Time taken to capture attendance transaction using the app	Once per campaign	The average time taken to mark attendance for a supervisor.	User Research	Province
Number of data records collected on paper forms	Once per campaign	Number of attendance record collected on paper versus on the app.	Programme/ digital forms filled	Province
Number of technical complaints raised	Once per campaign	The number of issues logged using the app and on other means.	Direct querying / user interviews	Province
Number of P1 bugs raised in production	Once per campaign		Direct querying	Province