The DataTiles
system integrates the benefits of two major interaction paradigms:
graphical and physical user interfaces.

Tagged transparent tiles are used as modular construction units.
These tiles are augmented by dynamic graphical information when
they are placed on a sensor-enhanced flat panel display. They can
be used independently or can be combined into more complex configurations,
similar to the way language can express complex concepts through
a sequence of simple words. In this paper, we discuss our design
principles for mixing physical and graphical interface techniques,
and describe the system architecture and example applications of
the DataTiles system.

The Data Tile system integrates three significant interaction ideas:

1. Tagged transparent objects as graspable interaction modules.
It uses transparent acrylic tiles to serve both as physical windows
for digital information and to trigger specific actions (e.g., launch
an application, or submit a query) when placed on a sensor-enhanced
display surface.

2. Mixed visual and physical interactions. Users can interact with
the information displayed by DataTiles using a pen or mouse. In addition
to normal GUI interactions (e.g., mouse operations and widget operations),
several combinations of physical and graphical interfaces are possible.
For example, a printed high-resolution image (on a tile) can be visually
fused with dynamic displayed graphics. Grooves engraved
upon the tile surfaces also act as passive haptic guides of pen operations.

3. Physical language for combining multiple tiles. Following a simple
“tile language,” the placement of several tiles can compose
a kind of “sentence.” In this way, relatively simple combinations
of tiles can express complex computational behaviors and functions.

Data
Tile system design

The DataTiles system is designed and implemented to utilize the
benefits of both physical and graphical user interfaces. The system
consists of the following elements:

a. Acrylic transparent tiles with embedded radio frequency identification
(RFID) tags.
b. A flat-panel liquid crystal display.
c. An electromagnetic pen tablet behind the display.
d. RFID readers (sensor coils) mounted behind the display’s
cover glass.
e. Acustom electronic circuit for sensing multiple sensor coils
using a single RFID reader.

Types of tiles and interaction between
them

Various types of tiles are built to represent specific functions
like application, real worl devices, control, etc. These tiles interact
with one another to generate several processes that single, individual
tiles are incapable of.

For example, a portal (device) tile kept next to an application
tile can receive data from the latter and send it to the specific
device. The image drawn on the ‘paint’ application tile can in this
way, be sent to a printer via the ‘portal’ tile.

Thus, the same tile can be used in different contexts. This is one
of the critical principles upon which the concept of the system
is based.

Inter-tile communication is system based or user initiated. As soon
as appropriate tiles are kept next to each other, communication
between them can commence. The user can also start transfer of data
between tiles by certain gestures using the electronic pen. These
sweeping gestures can signal either the start of communication or
end of one. One of the gesture even supports linking tiles on remote
trays.

Click here to watch the video.

Sidharth
Thakur
cs.indiana.edu