Presentation
This is a snapshot of the Flash presentation. It will be available for download soon.
Findings
We recommend this method for integrating paperwork into digital systems instead of enforcing tablet-based PDAs on mobile workers as the sole means of information access and manipulation. After meeting with logistic truck drivers and witnessing their working methods, we think that it's unrealistic to believe they will stop using pen and paper to do their work. In order to improve efficiency, it will be required to work with the drivers, not against them. Finding a method to make their paperwork digital is a good start.
There are several reasons for integrating a natural writing system into a digital work flow Paper provides a higher resolution, more familiar, and less expensive medium for viewing information than LCD screens. The pen is a familiar tool capable of making both fast, accurate selections and producing fast, accurate input. We believe that in natural language input, handwriting is more intuitive than using a keyboard. Finally, an unobtrusive HMD allows a mobile worker to view hands free screen based information that can be positioned strategically in the field of vision so as to minimize the need to shift focus while working.
Using an HMD, it is possible to overlay digital information onto paper documents or search information. Here some parts of the physical document are highlighted for the person using the HMD and he also can see a search box on the right corner.
This unobtrusive GUI provides context-sensitive data, realtime-validation, and helps the user trust that his work is being captured electronically. This is a simulation of what could be done with existing technology.
Building user interfaces optimized for such a hybrid system introduces many challenges and new opportunities for interaction designers to explore. We foresee challenges in balancing context-sensitive and task-oriented information with information overload (content and graphics), and in determining the appropriate amount of control given to the user according to the place and task being performed.
The findings are partly described in the paper: Integrating Paper Documents into Digital Systems.