Pilot operation for digital terrestrial television and interactive MHP applacations

Usability-Tests by evolaris

In order to accompany and enrich the market research performed in this project, the evolaris research laboratory cooperated with Fessel-GfK in performing comprehensive lab tests for usability in evolaris‘ customer experience labs. Usability tests are detailed user surveys based on open and closed questions. For the !TV4GRAZ project, these tests provided important details on the way in which test subjects dealt with these new television products.


Probands in a living room atmosphere


evolaris carried out comprehensive usability tests in two waves with 30 subjects. The dates of individual laboratory tests were based on the broadcasting times of each broadcaster on the !TV4GRAZ channel. For each test, the subject was invited to the laboratories and asked to perform certain tasks on a television using the portals offered. These tasks consisted of user questionnaires as well as laboratory observation in connection with task analyses. The evolaris customer experience lab in Graz, where the usability tests were carried out, was designed as a test lab with the atmosphere of a living room in order to simulate as authentic a television viewing environment as possible for the subjects.

The objective of the usability tests was to investigate the specific usability of each MHP portal and to identify any use constraints. In the lab tests, special attention was paid to the following four dimensions: usability, functionality (services offered), experience and aesthetics.

In addition to the usability tests, evolaris also performed heuristic evaluations of the interactive portals offered by the broadcasters participating in the project; in this process, experts on usability and user interfaces assessed the additional digital services according to various criteria.

Evaluation

The qualitative and quantitative data collected in the course of the laboratory tests and heuristic evaluations are to be evaluated statistically and analytically. The results will be presented to RTR and the broadcasters in a detailed report.
The results of the usability tests and the heuristic evaluations should serve to advance the design of ITV applications and reception devices with attention to the overall use process (pre-use, use, after-use) and thus to increase and reinforce the acceptance of ITV.