Evaluation

To fully evaluate the final design, user research had to take place with help of the co-designer. Before the design team was able to conduct proper user research, they had to come up with a user study test plan. In this subchapter, you’ll read more about the contents of this user study test plan, as well as the results that came out of this research.

Usability & User Experience

As stated in the second lecture on cognitive ergonomics, the main difference between user experience and usability is described as follows: “User Experience is focused on creating first value for the end-users, UX plays on usefulness for people and on their emotion to create and promotes positive emotions toward a service or a product.
Usability is more about safety and learnability (= The extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency, and satisfaction in a specified context of use).” (Borsci, 2023)

Research aim

The aim of this research was to get better insight into the emotions, preferences, perceptions, and physical- and psychological responses that occurred during the interaction between the co-designer and the product.

Research equipment

The equipment that would be used during the user study test would be the prototype itself, a cane, and a vest for guide dogs. Besides, a phone would be used as a tool for both auditory- and visual documentation.

Research steps

  1. Ask Bram for consent for documenting the whole meeting after which the auditory documentation may start.
  2. Give Bram the real-life-size prototype without any further explanation and give him some time to understand and feel what he has in his hands.
  3. Observe all of Bram’s responses and take note of them in a written document.
  4. Take in-action pictures of scenarios in which Bram uses Lightmate.
  5. Throughout Bram’s interaction with the product, actively ask him for feedback.

*It is a must to never explain to Bram how to use the product. See whether he manages to figure out how to use it by himself and try to observe what actions he struggles with.

How the user research went down in practice

After further development of the concept, this prototype was made and evaluated with Bram.

Observations from user-product interaction

While performing Step 2 and Step 3 the following observations were made:

  • Co-designer had trouble finding the spot to open the product. Took him some seconds to know where to position his hands.
  • The prototype did not grab onto the cane as strongly as previously thought. The prototype slipped down to the end of the cane.
  • Closing the product was done swiftly and without any problems. The magnetic closing mechanism was appreciated.
  • Shape conveys how to use the product, which is appreciated.
  • When attached to the dog leash, the prototype did not dangle and was resistant to shocks and hits.
  • The dimensions and the weight of the prototype were optimal.
  • On off switch as well as the vibrating feedback is approved with excitement by the co-designer.
  • The prototype can be attached to different materials such as rope, metal, or aluminum.

Overall the prototype was received with great enthusiasm and positivity. The case owner was aware that creating a FULLY functional prototype within the time period given was not feasible, but he truly enjoyed the process and was glad to reach an ending.

Research aim conclusion

Having reviewed the observation points, the design team came to multiple conclusions and future modifications, such as:

The co-designer would prefer having tactile grips indicating where to open the product as well as close it. Even though the weight of the prototype was reviewed as good the goal should be to lessen the weight a significant amount, making the product as unnoticeable as possible.

Co-designer was quite excited about testing the prototype as well as being in the last phase of the project. In the beginning, there was some confusion regarding the function of each part of the product, such as the spring system being confused as press buttons.

Once all the parts were identified and put to the test, recognition of those parts had become easier. Hence, the co-designer had become accustomed to the product enabling the user to have a better and faster interaction with the product.

.