Chimera: Usability Test Date f Reprt: Date f Test: Lcatin f Test: Octber 7, 0 Octber 5, 0 Bstn, MA Prepared fr: Timthy Bickmre Email: bickmre@ccs.neu.edu Prepared by: Email: Hudsn Klebs & Bryan Swrds klebs.h@husky.neu.edu & swrds.b@husky.neu.edu Executive Summary This study was cnducted t get user insight abut ur Chimera interface and cme up with imprvements based n bservatins and their feedback. We used fur participants wh each cmpleted three tasks with the interface. They had t custmize an animal fcusing n parts, breed, then persnality. There was a 00% cmpletin rate amng all participants ding all three tasks. The verall impressin was ease f use and minr imprvements that culd be made. All prblems users ran int were due t infrmatin that was nt present in the paper prttype versin f ur interface. Methdlgy Wh we tested Fur participants, having the fllwing characteristics, evaluated Chimera. Cmputer Literacy Cmputer Usage Medium High Very High Age 0 Gender 00-8 8-5 6-9 0-59 0 Highest Educatin Level: High Schl 0 t 0 hrs. wk. t 5 hrs. wk. 6+ hrs. wk. Sme Cllege Masters Wmen Men
What participants did The tests were perfrmed :00 :00 PM Friday, Octber 5, 0 and :00 t :00 PM Saturday, Octber 6, 0 at Hudsn Klebs apartment. They were all dne in the same envirnment, at the table with n distractins. The equipment used was the paper prttypes, a pen, a pad f paper, tape and a marker as a dummy muse pinter.
The prcess fllwed fr each test instance: Obtained verbal cnsent Briefed the user Had them wrk thrugh each task ne by ne, timed them and recrded errrs and bservatins Had user cmplete all three tasks Users filled ur shrt demgraphic survey Infrmal interview The sessin with each participant tk abut 0 minutes. What data we cllected We cllected data abut cmpletin f tasks which included if they succeeded in the task, time it tk fr each task, and number f errrs between the tasks' gal and their utcme. After the tasks they were given a shrt survey was given t gather demgraphic infrmatin and satisfactin ratings. Fllwing that was an infrmal interview t ask what they liked, disliked, culd be imprved, and didn't make sense abut the interface. Majr findings and recmmendatins Breed Screen des nt prvide enugh infrmatin abut hw t use it Tlbar t change main navigatin tabs is nt visible enugh Prvide labels, infrmatin bxes t give mre infrmatin Mve tlbar t tp f screen t make mre prminent It was difficult fr users t find the brwse buttn when custmizing animal parts
Will have t see if this cntinues with cmputer testing, seems t be mre a side effect f paper prttyping making it difficult t simulate muse-ver changes Overall, users reprted high satisfactin (median f 8.5 ut f 0) with the interface and all remarked that it was easy t use. Detailed findings and recmmendatins Task Custmizing Parts f the Pet Custmize yur pet t have a cat head, rabbit bdy, and bear legs. It shuld be able t respnd t sit, stay, and cme. Then g t checkut. Number f participants 00.00% Recmmendatins Mean f 6 secnds t cmplete task with a standard deviatin f 9. Issues met here seem t be side effects f the paper prttyping participants did nt find the brwse buttn n their wn participant was cnfused by the frward and backward buttns fr changing animal parts Inclusin f labels and side summary bar updating shuld reslve this in cmputer testing but will keep in mind participant finished the task with an errr: they had a bear bdy instead f rabbit bdy Tab navigatin shuld be mved t tp f screen fr better visibility and cnsistency with ther applicatins participants tk mre than a few secnds t search fr skills tab Task Ordering a pet with a specific breed and tricks Order a pet that is a dg with the breed Beagle. It shuld knw the tricks stay, cme, and shake hands. Then g t checkut. Number f participants 00.00% Recmmendatins Mean f 8 secnds t cmplete task with a standard deviatin f. Breed screen shuld include mre labels and maybe shrt instructins t guide user participants experienced initial cnfusin n breed screen with what t d next Feedback f highlighting selected breeds better will be added t cmputer versin participants waited fr feedback fr their actins f changing breed Task Custmizing persnality and training f the pet Order a glden retriever dg, with lw energy levels, a dcile temperament and therapeutic training. Then g t checkut.
Number f participants 00.00% Recmmendatins Mean f 66 secnds t cmplete task with a standard deviatin f. Pssibly rename skills tab, but in cntext f the ther ptins available it made sense t all participants were nt sure at first where t find therapy training, but after cnsidering the ptins available always chse the crrect Skills tab User Impressins Participant N. Like best? Like least? Imprvements Chsing training Ease f use Ethics f prject Nt enugh inf Makes cmplex tasks easy t d Chsing persnalizatin f pet Breed screen Mre ptins fr pet Nt aut select breed Mre infrmatin n breed screen N/a 5 Nne