On Thursday 20th October Kjetil Nordby will defend his thesis ‘Between the Tag and the Screen: Redesigning Short-Range RFID as Design Material’ for the PhD degree at AHO. The title of the trial lecture is “Opportunities and challenges for SR-RFID as design material”.

Industrial and interaction designers are increasingly faced with new computational technologies that may be used as materials in designing. Such materials are important in design practices because they offer conditions for conceptualisation and production of new designs. However, new computational technologies are often very complex and not presented with the intention of supporting design practices. In investigating SR-RFID as a design material, we are faced with two important challenges. First, the available information concerning SR-RFID in relation to industrial and interaction design is limited and often oriented toward finished solutions rather than exposing potentials for designing. Second, it is difficult to find frameworks that show how to analyse such a technology so as to present it as a material specifically oriented toward industrial and interaction design.

The trial lecture starts 10 am, Disputation starts 12.00. It will be held in the main auditorium at the Oslo School of Architecture and Design

Related things:

1. A PhD in Touch Radio Frequency IDentification is a wireless technology that is is......

“The complex technologies the networked city relies upon to produce its effects remain distressingly opaque, even to those exposed to them on a daily basis.” – Adam Greenfield (2009)

Immaterials: light painting WiFi film by Timo Arnall, Jørn Knutsen and Einar Sneve Martinussen.

This project explores the invisible terrain of WiFi networks in urban spaces by light painting signal strength in long-exposure photographs. A four-metre tall measuring rod with 80 points of light reveals cross-sections through WiFi networks using a photographic technique called light-painting.

This builds on a technique that was invented for the 2009 film ‘Immaterials: the Ghost in the Field’ which probed the edges of the invisible fields that surround RFID readers and tags in the world. It also began a series of investigations into what Matt Jones richly summarised as ‘Immaterials’.

While we were mapping out tiny RFID fields, we wondered what it would be like to apply the light painting process to larger-scale fields of Bluetooth, WiFi, GSM and 3G. What if we built huge light painting apparatus that could map out architectural and city-scale networks in the places and spaces they inhabited? We’re still very interested in understanding radio and wireless networks as one of the substrates essential to contemporary design practice.

We built the WiFi measuring rod, a 4-metre tall probe containing 80 lights that respond to the Received Signal Strength (RSSI) of a particular WiFi network. When we walk through architectural, urban spaces with this probe, while taking long-exposure photographs, we visualise the cross-sections, or strata, of WiFi signal strength, situated within photographic urban scenes. The cross-sections are an abstraction of WiFi signal strength, a line graph of RSSI across physical space. Although it can be used to determine actual signal strength at a given point, it is much more interesting as a way of seeing the overall pattern, the relative peaks and the troughs situated in the surrounding physical space.

After a week of walking through urban spaces holding and photographing this instrument, we have a much better sense of the qualities of WiFi in urban spaces, its random crackles, bright and dim spots, its reaction to the massing of buildings, and its broad reach through open areas. The resulting images show some of these qualities, and light painting is a brilliant medium for situating visualisations and data into physical world locations and situations.

Lots more visualisations and ‘making of’ pictures.

Einar writes more about this in an upcoming article called ‘Making material of the Networked City’ in Design Innovation for the Built Environment – Research by Design and the Renovation of Practice. There is also more detail on the project at the YOUrban weblog.

Related things:

1. Immaterials: the ghost in the field This video is about exploring the spatial qualities of RFID,......
2. New film: Wireless in the World 2 In this film, Wireless in the world 2, simple visualisations......
3. Making radio tangible Next week we’re launching some new work that explores the......

The article is called Depth of field: discursive design research through film written by Timo Arnall and Einar Sneve Martinussen. It is about the role of film in interaction and product design research, and the use of film in exploring and explaining emerging technologies.

In the last decade, interaction design has found itself in a rather unique position. As an interdisciplinary field, drawing upon many domains such as Human Computer Interaction (HCI), product and graphic design, informatics, art, engineering and critical practice, it has grown the potential to situate itself in a critical position between emerging technologies and culture. In particular, there are emerging modes of doing exploratory design research that result from the newfound relations between product, interaction and communications design.
In this article we discuss our design research activities that use film as a material for exploring, conceptualising and communicating with emerging technology. We analyse this through existing framings of audiovisual media in HCI, technology, and interaction design research. The central research question we address is how does audiovisual media enable new kinds of practice-based design research with emerging technology?

The relations between scientific advance and cinema are extremely close. Kirby proposes that film establishes achievability of scientific and technical discourses, and ‘cinematic depictions of future technologies demonstrate to large public audiences a technology’s need, viability and benevolence’. Historically, film has been a central part of the communication of new technology with interfaces mediated through film or video demonstrators. From televised events showing off household robotics at the 1939 New York World Fair to the invention of modern computing paradigms such as the mouse – in Engelbart’s ‘Mother of all demos’. Products too are often initially experienced through cinematic forms, from lifestyle commercials for Sony televisions, to explanatory ‘how to’ informercials for the Apple iPhone, to user-generated ‘unboxing’ videos on YouTube. The commercial film for the Polaroid SX-70 camera, directed by Charles and Ray Eames in 1972 is a fine example from design practice of new technology explained to the masses through a product commercial, conveying technology and experience combined into one sequence.

In this research we have used graphical, audiovisual, and time-based media as a tool, a material and a communicative artefact that enables us to approach complex, obscure and often invisible emerging technologies such as RFID. We give an account of how film has played an intricate role in the design research practice, from revealing the materiality of invisible wireless technology, to exploring prototypes in real-world settings, to communicating to a wide public audience.

In the article we propose that this kind of research with technology constitutes what we could call a ‘discursive design’ approach. The films below demonstrate design research approaches to RFID where film reveals and articulates complex subjects, through multiple genres, and for multiple audiences. By approaching design research in this way we may be able to explore emerging technologies through play, invention, imitation and parody in ways that are able to reveal and translate across many socio-cultural contexts.

Exploring materiality

The first films show a research approach that explores the materiality of RFID in experimental and highly aestheticised ways. These films emerged out of probing at the technology with the visual tools of photography and animation.

RFID is a largely immaterial technology, it is literally ‘black boxed’ into packaged components, and the qualities of its invisible radio fields are badly understood. The spatial and material aspects of RFID are important for design, in order to be able to create interactions and products that take advantage of the spatial and gestural properties of the technology.

In this film we use long-exposure photographs, light painting, layering and animation. These techniques support particularly expressive modes of explanation, the visualisations occupy a ‘real’ space and are sequenced in a way that provides an immediately graspable view into the spatial qualities of RFID. The use of documentary film form allows for the visual evidence to be laid out in sequences that contextualise, reveal and explain, the film is a highly communicative package for the methods and results.

This was originally written up here and here

In this related film, we show that the readable volume of an RFID tag can be shaped by actually manipulating the size and shape of the physical antenna. This demonstrates that the fundamental technology is not static and constant, and can be shaped through design. When taken together, these films are intended to build material knowledge of RFID, but also through their form, show how designers might begin to take some control over the technical materials, for aesthetic, interactional or functional purposes.

These creative deconstructions of RFID through film techniques point towards what might call a discursive design approach. Drawing on methods from critical design that unpack and re-conceptualise the technological material, combined with narrative and communicative approaches, we may begin to challenge some of the expectations and dominant understandings of RFID.

Communicating products and prototypes

The following product-focused films show technology in context through experiential and explanatory sequences, such as the use of motion diagrams and narrative ‘vignettes’ which convey experiences of using technological products in specific contexts.

Skål (Norwegian for Bowl) explores RFID interactions in a domestic media context, where it broadens the activity of television-based media consumption towards playful, physical engagement. Here film is used to communicate a functioning product prototype, while at the same time highlighting playful and tangible perspectives on RFID in use.

In Sniff we see the potential for reframing RFID technology through explanation and experiential representation of use and activities, and not by focusing on the technology itself. Here the use of cinematic qualities such as short depth-of-field and other stylistic devices such as quick-cut montages enable jumps in time and action that strongly reinforce the playful, exploratory perspectives on the technology.

Films as discursive objects

In this last set of films we wanted to create culturally relevant objects that could communicate to a broad audience.

This iPhone RFID film was created to engage with a large online discussion around Apple’s relatively new iPhone. We wanted to question the largely screen-based modes of interaction that the iPhone encouraged, and to subtly reframe the discussion around RFID to include media, toys, play and direct manipulation of objects in the world. The film was a speculative object from which to see the possibilities for the rich, playful interaction between mobile devices and the world.

Nearness offers a particular view of RFID and proximity interaction that playfully resonates with a history of the chain reaction film genre. It is designed to reach beyond a research or design community in order to provoke discussion and to increase awareness of the technological implications. It does this by parodying an existing popular cultural form in a way that inherently embeds the quality of the technology into the narrative. Originally this film was described here and here.

The making of

These films constitute more than documentation of the design research in Touch, they were the medium in which invention and reflection occurred. Audio-visual media allowed for the creation of products, spaces, objects, gestures and environments that supported our internal and external discussion and development around RFID.

This film shows some of the experiments, processes and film techniques behind the creation of the other films in the article. It shows that these design processes work within the material of film, where the analysis and reflection emerged through the design activity of filmmaking. As well as being highly communicative, film sequences provide a space to gather and articulate a set of ideas, providing a relatively stable outcome and further motivation within the design activity.

Summary

This is a body of design research work that demonstrates the communicative qualities of film, that represent physical objects and their interactive, tangible behaviours over time. Time-based, audiovisual media can combine both explanatory and experiential and contextualising power, and this opens up for prototypes, products and processes being externalised within a practice-based design research activity. We see the potentials for a kind of practice where the emphasis of design research is on communication and participation in public discourse.

We have shown how practice-based design research has the ability to create representations and communicative artefacts, as opposed to technological development or mass production. A communicative approach to interaction design is central to this research. It embodies the idea that the communication of ideas, concepts and arguments through mediated design artefacts is essential to both creating effective interactive products, and to provoking discourse in and around technology-centric research. The form of film – that embodies both a highly reflective design activity and communicative qualities – is an ideal medium for interaction design research, where it can coalesce knowledge around practices and processes and project towards potential futures. Film allows for a degree of probing, explanation and reflexive understanding of emerging technologies, but through its communicative qualities, also opens up for participation in broad social and cultural discourses around technology.

We have shown some perspectives on the role that film can play in exploring, conceptualising and communicating about emerging technology. Film can be used for cinematic explorations and enactments that enable speculation in practice-based design research, but we have also pointed towards the use of online mediation to support public discourse around ubiquitous technologies and materials. 

Read the full article here (pdf) which is published as part of a Research by design issue which also includes articles about designing mobile social software and investigations of motion sketching from our colleagues at AHO.

Related things:

1. Designing with film We’ve compiled a short sequence of some of the design......
2. Design research mediation, layering Just a quick post to flag up a little discovery:......
3. New film: Wireless in the World 2 In this film, Wireless in the world 2, simple visualisations......

In the Journal of Personal and Ubiquitous Computing the article Multi-field relations in designing for short-range RFID analyses some of the conceptual foundations for multi-field inputs with RFID enabled artifacts:

“Multi-field inputs are techniques driven by multiple short-range RFID-enabled artifacts like RFID-tags and RFID-tag readers. The technology is useful for designers so as to enable the construction of advanced interaction through the physical world. To take advantage of such opportunities, it is important to understand the technology in terms of what interactions it might offer designers. I address this issue by unwrapping and exposing elements that can be used to conceptualize multi-field interactions. This is done by way of a design driven inquiry in which design and research methods are used to investigate short-range RFID technology. My approach is informed by activity theory which I use to analyze RFID technology from a design perspective. The study presents multi-field relations as a conceptual framework that can be used to describe and generate multi-field inputs. Four types of multi-field relations are discussed: one-way, two-way, sequence and multiple relations. These are described and analyzed in context of a set of multi-field input examples. The multi-field relations expose elements that can be used to construct interactions. This is important for interaction designers, since new interactions presents designers with opportunities for making entirely new types of interfaces that can lead to interesting and surprising experiences.”

In the International Journal of Design the article Conceptual Designing and Technology: Short-Range RFID as Design Material unpacks RFID—or fields—as design material, and looks at designers motives around emerging technologies:

“Short-Range Radio Frequency Identification (RFID) is an emerging technology that interaction designers are currently embracing. There are, however, few systematic efforts to utilize the technology as a tool for the development of new design concepts. This article focuses on technology as a design material and its role in the formative process of conceptual design. My approach involves the use of activity theory and the concept of motives, used to analyze short-range RFID technology when considering the field of design. I employ practice-based research where qualitative design and research methods are used to scrutinize the use of this technology in design. A design material perspective frames the short-range RFID technology as a composite consisting of near-fields and the computational. This material is coined near-field material and is further described through six form-making qualities: Tap and Hold, Multi-Field Relations, Multi-Field Distribution, Field Shape, Context Sharing and Mediation Type. I propose that the near-field material and thus the six form-making qualities cited above, offer designers engaged in creating user-oriented experiences, a morphology of form types. I argue that by synthesizing and analyzing emerging technology in relation to designers’ motives for using them, we may further support research and practice by placing technology inside design discourse and culture.”

See more publications from Touch.

Related things:

1. RFID peripherals Plug and play RFID-reading USB peripherals are all the rage,......
2. iPhone RFID: object-based media This is a video prototype of an iPhone media player......
3. More RFID-based products A Dutch company, Swinxs is developing a physical RFID-based console......

We’ve compiled a short sequence of some of the design experiments and tests in audiovisual media in the Touch project. Here we show some of the ‘behind the scenes’ tests and processes where we used cinematic/video/filmmaking tools as a means to uncover potentials and constraints around an emerging technology.

In these experiments we designed and invented spaces, objects, movements and audiovisual techniques that map and visualise the interactive phenomena of RFID. Many of the visual/cinematic concepts for Nearness and Immaterials were invented by exploring and experimenting with film.

Rather than investing time in creating complex software and hardware prototypes, the interactive experience can be quickly explored inside film compositing applications. These experiments have shown us that there is great value in having tools that offer efficient prototyping of interactions at an experiential level, that don’t need to rely on complex electronics or physical design. There is also value in working within a medium that is not tied to a specific location or a unique demonstrator, and that is editable, reproducible and transmissible allowing it to be shared freely and widely amongst a research group and across the internet.

This is the subject of a forthcoming paper that we’ll flag up here as soon as it is published.

Related things:

1. Depth of field: Film in design research We’ve just had a new article (pdf) published as part......
2. Designing with RFID In Designing with RFID we explore the potential for RFID......
3. New film: Wireless in the World 2 In this film, Wireless in the world 2, simple visualisations......

This video is about exploring the spatial qualities of RFID, visualised through an RFID probe, long exposure photography and animation. It features Timo Arnall of the Touch project and Jack Schulze of BERG.

The problem and opportunity of invisibility

RFID is still badly understood as an interactive technology. Many aspects of RFID interaction are fundamentally invisible; as users we experience two objects communicating through the ‘magic’ of radio waves. This invisibility is also key to the controversial aspects of RFID technology; once RFID antennas are hidden inside products or in environments, they can be invoked or initiated without explicit knowledge or permission. (See here for more on the invisibility of radio.)

But invisibility also offers opportunities: the lack of touch is an enormous usability and efficiency leap for many systems we interact with everyday (hence the success of Oyster, Suica and Octopus cards). But there is also the ‘magic’ of nearness one of the most compelling experiential aspects of RFID.

As designers we took this invisibility as a challenge. We needed to know more about the way that RFID technology inhabits space so that we could better understand the kinds of interactions that can be built with it and the ways it can be used effectively and playfully inside physical products.

The experiments

In order to study the readable volume around an RFID reader, we built experimental probes that would flash an LED light when they successfully read an RFID tag. The readable volume is not the same as the radio field, instead it shows the space within the field in which an RFID tag and an RFID reader will interact with each other.

One version of our probe containing a tag and LED light connected to the RFID reader that is being studied.

In a dark room, the probes were moved around the various RFID tags and readers that we wanted to study, with a camera taking long-exposure photographs of the resulting patterns of light. In this way we could build up layers by slicing through the field in different ways, creating animations that clearly reveal the spatial properties of this interaction.

These experiments were carried out in order to help us flesh out our own models of the technology, and were not intended to be scientifically accurate. So although they accurately reflect the behaviour of the technologies in the situations that we work with, there were no controlled environments or settings for generalisable technical accuracy.

Innovations ID 20

The Innovations ID 20 RFID reader has become one of the standard components in a lot of our work, it is small, robust and relatively cheap. So it has been very important for us to gain an understanding of the readable volume it produces when we embed the reader inside products such as Sniff and Skål.

Details: Innovations ID20 low-frequency EM4102 reader, 20mm circular EM4102 tag.

The resulting visualisation shows the way in which we have mapped the boundary of the readable volume, although a tag will read anywhere inside this, we have only mapped the edge for the sake of clarity. From the animation (see the video) we start to clearly see that the readable volume is made up of a strong central sphere, accompanied by a smaller lobe that surrounds the edge of the reader.

Oyster card

Mifare cards are one of the largest public applications of RFID, used in many transit systems around the world such as the Oyster and Suica cards. It has become common to have to touch in and touch out of subway stations, and many people have become accustomed to this interaction. So what does the readable volume around an Oyster card look like?

Details: Standard Mifare Oyster card, probed with a Sonmicro high-frequency reader.

With a square antenna inside the Oyster and the Sonmicro reader, we get an elongated main volume, accompanied by long skinny lobes on each edge of the card. This looks very different from the ID 20 mapping.

Orientation

The first two mappings held the reader and the tag parallel to each other, but we predicted that there would be a higher degree of complexity in the relationship if the tag and the reader moved in different orientations. The rig below was built so that we could control the angle between the reader and the tag, which moved along the surface of the table.

Details: Innovations ID20 low-frequency EM4102 reader, 50mm circular EM4102 tag.

There is clearly enormous physical complexity in this relationship, in the animation we can see the volume growing and shrinking, lobes turning into spheres, and vice-versa. But the animation gives us a very clear picture of the ‘throw’ of the reader onto a single two-dimensional plane, almost like looking at it as a torch.

Parallel and perpendicular

To show the two extremes of the relationship between orientation and the readable volume, we created two mappings, one with the tag parallel to the reader, and the other with the tag perpendicular. We mapped them using two different colours of LED: green for parallel and red for perpendicular.

Details: Innovations ID20 low-frequency EM4102 reader, 20mm circular EM4102 tag.

This image is a composite of the two mappings (see the video for animations of the two mappings separately) and it is clear that the readable volume is significantly different. When the tag is perpendicular to the reader, there is a sizeable gap in the middle of the reader where the tag will not read, creating two readable volumes side by side.

Conclusions

We have been continually challenging the ways in which RFID technology has been framed. It is incredible how often RFID is seen as a long-range ‘detector’ or how little relevant information is contained in technical data-sheets. When this information is the primary material that we are working with as designers, this is highly problematic. By doing these kind of experiments we can re-frame the technology according to our experience of it, and generate our own material knowledge.

One of the early motivations in this project was the way in which the animations really captured our tacit, embodied knowledge of the readable volume in a visual way, it was almost as if you could wave your hand through the floating green LEDs and feel them. Of course we had felt it hundreds of times in experimenting with tags and readers, but we had never seen it captured in an image, in a way that was communicable to others without having them try an interactive demonstrator. With this visual material, we can communicate about RFID in ways that we couldn’t previously.

So we hope that this work goes some way towards building better spatial and gestural models of RFID, as material for designers to build better products and to take full advantage of the various ways in which spatial proximity can be used. And with this better understanding we hope to be able to discuss and design for privacy and the ‘leakage’ of data in a more rigorous way.

Field icon

Download a PDF file of the RFID icon.

This RFID icon is based on the shape of the ‘readable volume’. Created by Timo Arnall & Jack Schulze, it is licensed for use under a Creative Commons Attribution 3.0 Unported License.

Go ahead and use it!

Credits

The project was made by Timo Arnall and Einar Sneve Martinussen from AHO and Jack Schulze from BERG. Thanks to Jørn Knutsen for help in building the rigs.

Related things:

1. Immaterials: light painting WiFi “The complex technologies the networked city relies upon to produce......
2. Making radio tangible Next week we’re launching some new work that explores the......
3. New film: Wireless in the World 2 In this film, Wireless in the world 2, simple visualisations......

The ‘Radiogenic’

Dunne & Raby introduce the idea of ‘Hertzian space’ in Design Noir and Hertzian Tales where they describe a landscape of electronic products creating a “new, invisible but physical environment”.

In Tunable cities they map the radio signals from domestic equipment such as babycoms and begin to examine the “role of electronic products in the aesthetic inhabitation of a rapidly dematerialising, ubiquitous and intelligent environment.” Here there are visualisations of radio fields as bright red spaces overlaid on the streets of Chiswick, London.

Although their work specifically avoided issues around making the invisible visible or visualising radio, it explored the “links between the material and the immaterial that lead to new aesthetic possibilities for life in an electromagnetic environment”.

“It might seem strange to write about radio, a long-established medium, when discussion today centres on cyberspace, virtual reality, networks, smart materials and other electronic tehcnologies. But radio, meaning part of the electromagnetic spectrum is fundamental to electronics. Objects not only “dematerialise” into software in response to minituarisation and replacement by services but literally dematerialise into radiation. All electronic products are hybrids of radiation and matter. [...] Whereas cyberspace is a metaphor that spatialises what happens in computers distributed around the world, radio space is actual and physical, even though our senses detect only a tiny part of it.”

As Matt Jones points out, they go on to coin the term “radiogenic” to describe objects that:

“function as unwitting interfaces between the abstract space of electromagnetism and the material cultures of everyday life, revealing unexpected points of contact between them.”

The Faraday chair offers a slightly more nuanced ‘visualisation’ of the boundaries of electromagnetic waves through a physical object. These works operate by visualising and making tangible the boundaries between electromagnetic phenomena, and as such, serve to highlight and create discourse around the issue of radio in emerging products and systems

Celebrating the magic of remote action

The language used to describe RFID interaction includes closeness, touch, proximity and pointing but there are few explorations of the way that RFID systems shape the gestural and tangible aspects of this interaction. Within Human Computer Interaction (HCI) there is some discussion of the spatial aspects of sensor technologies. For instance Ailisto et al (2003) discuss the ways that RFID creates contactless interactions on mobile phones: “Physical selection may be based on proximity or pointing. In the case of proximity, the selection is activated by bringing the activating device, e.g. a smart phone, close to the target device.”.

In the Touch project we have experimented with the spatial aspects of RFID interaction, developing a tacit design knowledge of the technology over time. At an early RFID hacking workshop with BERG/Schulze & Webb we experimented with playful interactions that involved “the magic of remote action” where invisible interactions triggered events in the world.

This is something we went on to explore in much more detail in the film Nearness, where the relationship between proximity and physical interaction is explored in detail.

In projects like the Graphic language for touch we have begun to find ways of representing invisible radio as a tangible design material in a functional setting.

And in her project the Bubbles of Radio (that emerged from our Fields and Seams brief) Ingeborg Marie Dehs Thomas imagined and visualised many fictional representations of radio fields including Bluetooth and RFID. These drawings provide a playful starting point for the discussion of our relationship to radio fields and the possibilities they open up for interaction.

Exploring and experiencing waves

The political, social and phenomenological aspects of the electromagnetic spectrum are a recurring theme within contemporary media art practice. For instance the exhibition Waves at RIXC tuned in to artistic engagements with the electro-magnetic spectrum and suggested that “artists should take control of the very principles and materiality of the ‘network waves’.”

A common practice is to translate radio space into an audible, sonic experience. In projects like ætherspace, Aeriology, Electroprobes and in many RFID projects some kind of probe that senses radio and offers audible output is held or attached to the body. The experience is then about being mobile, moving through and probing the world to discover how the lanscape and patterns of radio changes through space.

Then there are a number of visual, interactive visualisation projects such as the Wifi camera, the sightseeing telescope that reveals open wifi networks in urban space and the Free Network Visible Network project. In most cases the visual representations of the radio waves are merged and overlaid into optical or video backgrounds of the physical world, in a kind of ‘augmented reality’ genre.

In Edge Town by Ben Hooker and Shona Kitchen visual approaches are used to explore the ways in which we can “design interfaces with the flows of electronic data that run through our cities so that they can be experienced as an enriching complement to other, more ‘earthly’ phenomena.” Their garden-like visualisations represent the desire to turn these invisible flows into something more tangible. In another architectural approach, Pedro Sepulveda-Sandoval proposes the demarcation of public areas that are free of mobile phone signals, using the visual language of yellow/black warning tape.

Artists Ruth Jarman & Joe Gerhardt visualised many kinds of fields in Magnetic Movie, where the fields are seen animated as crackling, pulsing and swirling waves that uncomfortably inhabit physical spaces. This animation reinforced by a strong soundtrack that crackles in time with the motion is one of the most engaging and compelling visualisations of radio fields that we have seen.

Spatial and seamful sensors

For engineers and scientists, accurately modelling and visualising invisible radio fields, and engaging in antenna measurement is a difficult task, if not almost a ‘black art’. Using specialist robotic equipment and slowly measuring the intensity of radio signals at various points in space, it is possible to build up a three dimensional map of a radio field. There are also specialist 3D simulation tools that create models of radio fields and their interactions with physical material. These tools are mainly used to optimise the design of radio antennae, probe and problem-solve radio interference problems in electronic equipment and to assess safety issues with human exposure to radio systems.

In a paper called The spatial character of sensor technology Reeves et al (2006) describe the importance of understanding seams and spatiality in sensor-based systems. Although they concentrate on ‘torch-based’ interactions, their concerns are relevant for other sensor technologies:

“We are primarily concerned with the way in which seams between devices create a particular spatial character for the location in which they are deployed. This spatial character of seams derives from the use of spatially-embedded sensor technologies (e.g., GPS, Wifi, etc.) which are particularly prevalent in ubiquitous computing. Sensor technology plays a fundamental part in the creation of seams, and thus the character of the space in which such technology is deployed. The main issue, then, is how interactive and ubiquitous system design may appropriately address this essential spatiality.”

There is also a discussion of the ‘seamful’ character of many ubiquitous technologies.

Chalmers and Galani (2001) describes the ways in which “wireless networks have distinct physical characteristics such as a tendency to be absorbed by metal, water and other conductive materials, and a pattern of coverage that makes for a limited area of usable network connectivity.” They suggest that there may be a method or conceptual process of ‘seamful design’ that builds upon the way that “people accommodate and take advantage of seams and heterogeneity, in and through the process of interaction.”

“We critique the ‘disappearance’ mentioned by Weiser as a goal for ubicomp, and Dourish’s ‘embodied interaction’ approach to HCI, suggesting that these design ideals may be unachievable or incomplete because they underemphasise the interdependence of ‘invisible’ non-rationalising interaction and focused rationalising interaction within ongoing activity.”

There is something in this ‘seamful design’ process that may help us to understand of the way that we deal with the invisible aspects of radio-based interaction, and the ways that mental models are built out of these systems.

Related things:

1. Fictional radio-spaces In spring 2007 interaction design students at AHO participated in......
2. Immaterials: the ghost in the field This video is about exploring the spatial qualities of RFID,......
3. Immaterials: light painting WiFi “The complex technologies the networked city relies upon to produce......

This video shows Skål in action. A bowl sits on the living room table and a range of physical objects are used to trigger various kinds of media. For example a physical Moomin character like Little My will play a sequence from the Moomin cartoon where she is featured. Skål can control all kinds of digital media; movie-clips, Youtube channels, Flickr photo streams, home videos and online radio.

The product has been used as a probe to build our understanding of RFID technology in playful and domestic contexts and is the result of extensive enquiry into the area. It differs from other similar products like Touchatag and Mirror by focusing specifically on direct and immediate tangible interaction with rich digital media. In some ways it is similar to the iPhone RFID prototype, and here it reflects on the interchangeability of tags and readers in media interaction: RFID systems are symmetrical and interactions can be built through manipulating the reader (the iPhone) or the objects (Skål).

Visit the Skål website for more on the bowl and how it works and Flickr for more images.

Related things:

1. iPhone RFID: object-based media This is a video prototype of an iPhone media player......
2. Bowl: Token-based media for children In spring 2007 interaction design students at AHO participated in......
3. RFID peripherals Plug and play RFID-reading USB peripherals are all the rage,......

Sara developed a speech bubble approach to annotating physical objects, so that they look like they are ‘saying’ the audio and haptic feedback.

The representation of sound and vibration uses waveforms, showing amplitude over time. Although this is quite limited, it seems to be a useful shorthand for communicating a small range of tangible feedback.

On this note, I’m getting increasingly interested in the use of speech bubbles in popular media.

Related things:

1. Tangible and Embedded Interaction 2009 We recently presented our paper Designing with RFID at the......
2. Making radio tangible Next week we’re launching some new work that explores the......
3. Touch as interaction medium This is a design brief, one of many themes that......

Hat tip towards The way things go, that Honda commercial and Pythagora Switch.

Some photos.

Related things:

1. ‘Nearness’ goes further Since the launch three weeks ago, our film Nearness has......
2. Making radio tangible Next week we’re launching some new work that explores the......
3. Designing with film We’ve compiled a short sequence of some of the design......

What is especially lovely is the way in which the images from our paper are carefully interpreted and annotated visually with notes and explanations. In many ways it communicates better than the original paper.

And on that note, Nicolas Nova also has a good writeup here.

Related things:

1. Depth of field: Film in design research We’ve just had a new article (pdf) published as part......
2. Re/Touch: Inspiring touch-related interaction design One of the things that social and cultural research on......
3. Norwegian Design Council awards Sniff Sniff has won the prize for Design for All at......

RFID is becoming more common in mobile phones (under the term Near Field Communication or NFC) from manufacturers such as Nokia. By looking at Apple’s patents we know that the technology is being considered for the iPhone. With the iPhone SDK 3.0 external hardware accessories can be accessed by iPhone software, so third party RFID or NFC readers are also possible.

So what kinds of applications would emerge if an iPhone had an NFC reader? Here we have prototyped a simple media player, which triggers the playback of content on the touch of a tag, and created a set of augmented objects that have relationships to different kinds of audiovisual content.

A lens for media

Compared to other mobile handsets the iPhone is a particularly media-friendly device, with a large, bright screen and high quality audiovisual playback. What if this screen could act as a ‘lens’ to content that resides in the world?

In a screen-based interface content may be buried many levels deep inside an information architecture. But in a physical RFID-driven interface a simple gesture can offer quick and direct access to content. Physical objects afford tangible manipulation that screens cannot, and this is great for playful products. Our Bowl prototype showed a natural blending of media consumption and playful activitiy in children, where media viewing became less passive and a more active experience.

Durrell Bishop has discussed these ideas in a more general way, what if objects were augmented with new properties, that can be perceived through an iPhone lens?

Media objects

In this video demo, the objects have been chosen to physically or visually represent the content. There are some obvious relationships, such as the Moomin figure leading to a favourite episode of a Moomin animation. The less obvious relationships such as the wooden house leading to home videos were chosen because they just somehow felt right. In fact the exact relationship may be of secondary importance, as over time the behaviour of the physical and digital objects becomes known and transparent through exploration and repetition.

Some of the objects felt particularly satisfying. The Make Podcast object for instance—where touching the ‘geek’ plays the latest ‘Weekend project’— shows how an object can be used for exploring a dynamic stream of content.

Going further

This video prototype is basic and intended to open up for discussion and new exploration around the experience of media selection through physical objects. At the moment the interaction is a trigger, but what if the phone doesn’t just react as output but also as input to physical objects? How do we programme and manage our sets of media and applications in these objects?

Overall this points towards opportunities around the distribution of media through physical objects, it is an example of general ideas around an ‘internet of things’ or ‘spimes’ applied to the world of media. What opportunities would the distribution of RFID-embedded products open up in terms of media, gaming, services and marketing? What does this mean for the future of products?

Related things:

1. Bowl: Token-based media for children In spring 2007 interaction design students at AHO participated in......
2. iPhone RFID and NFC peripherals We are beginning to see RFID and NFC peripherals beginning......
3. Skål: playing with media Skål (Norwegian for bowl) is a product that has emerged......

Presenting Touch at a event like this is a good opportunity to provide a glimpse into ongoing design and research and a chance to communicate to a broader audience. The talk focused on design as an approach to RFID and how we can use design to understand, communicate and explore emerging technologies.

The presentation consists of condensed presentation of RFID from a technical and material perspective and goes on to describe various aspects of designing with RFID. In this presentation we use the Touch-projects Bowl and Sniff to illustrate the process of designing RFID products. The presentation is available on Slideshare.

Related things:

1. Tangible Interactions – summer exhibition This week the the MA interaction design course Tangible Interactions......
2. Tangible and Embedded Interaction 2009 We recently presented our paper Designing with RFID at the......
3. Touch network building The Touch project is receiving considerable interest and over the......

The full presentation is available on Slideshare and you can read more about the paper here.

Related things:

1. Visual representation of tangible interaction In the design of the interactive elements of Sniff, Sara......
2. Designing with RFID In Designing with RFID we explore the potential for RFID......
3. Thoughts on Nokia’s NFC developments On April 15th Nokia announced the 6212 ‘classic’ phone that......

One of the things that social and cultural research on touch attempts to grapple with is everything people are supposed to touch and not supposed to touch—and what we actually end up touching or not touching in any given situation. When I first saw Sameer D’Costa’s photo on Flickr, it reminded me of people’s desire to touch things that we aren’t supposed to, and I wondered what that might mean in terms of research.

A year later we’re excited to share the result of that wondering: re/touch, an online resource for designers and researchers interested in touch-based interactions and relations. As the action of touch is technologically mediated by both contactless interactions in the world and through multi-touch on screen, awareness and reflection on the richness of touch is becoming increasingly important.

The re/touch website

re/touch brings together hundreds of cross-cultural examples of social norms and values involving touch—all categorised according to actions related to touching.

A collection of quotes from ethnographic accounts written between the late 1800s and the present, re/touch encourages designers and researchers to explore how touch is used by people to relate to one another and the worlds in which we live.

You can browse the quotes to create design briefs, refine interaction scenarios or otherwise inspire you to think, make or do things touch-related.

About the project

We like to think of re/touch as a work-in-progress. So far, it contains almost five hundred quotes from dozens of cultural groups around the world, and we’re working to add more. As the collection grows, we expect the action tags to change as well, so over the next couple of months you may notice different words in the tag cloud. In the end, we anticipate having over one thousand quotes and more than fifty categories of touch-related action.

The re/touch website also includes some background information on the content, and we plan to publish a paper on the research methodology and some thoughts on collaborations between anthropology and design.

If you notice any database problems or errors, please leave a comment below and we’ll look into it. We’re also still working on the web design—including making the site work well and look good on the iPhone—so we’d certainly appreciate any feedback you might have along those lines as well.

Ultimately, we hope you’ll find this resource as interesting and inspiring as we do!

Related things:

1. Depth of field: Film in design research We’ve just had a new article (pdf) published as part......
2. Introducing touch as culture Hello. My name is Anne Galloway and I’m very pleased......
3. Touch as interaction medium This is a design brief, one of many themes that......

In this process we explore ways in which RFID objects can be designed to balance various physical and digital qualities. This approach has illuminated opportunities and constraints in designing augmented objects that enriches the vocabulary around RFID for industrial and interaction designers where physical and visual material are essential elements.

RFID is most commonly used by consumers for ticketing, payments and access control. The design challenges in these contexts has concentrated on infrastructures and systems as opposed to the design of physical tokens. The design of these objects is limited to simple, mostly flat enclosures; cards, key-fobs or stickers.

The bare RFID tag itself does not offer significant meaning beyond its technical appearance. In order to create meaningful relationships towards these objects, RFID tags must be embedded in an object or signified by shape or sign. The physical design of most current RFID objects are limited to the form factors of the protective encapsulation of the tag. It remains at the simple level of encapsulation and packaging that does not yet address the wide range of physical possibilities for objects in everyday contexts.

Product review

To understand the ways that RFID tags have been designed into consumer products, we conducted a product review that documents the physical aspects of RFID products from around the world. This has been a process of reflection on existing industrial and consumer products that includes a range of cards, keyfobs and tokens, the Mattel Hyperscan games console, Star Wars Commtech figures, Brio Network, Violet Ztamps and other RFID peripherals.

The product review shows many uses for RFID but limited exploration of design qualities such as materials, shape, size, construction, manufacture, build quality, affordance or metaphors. But the potential for RFID in consumer products is significant, given the inexpensive hardware of RFID systems and the opportunity to enable digital interactions with even the simplest of objects. The technical properties of RFID, such as the batteryless tags which allow for cheap and maintenance free operation are perhaps the most significant opportunity for playful products and toys.

Form experiments

The intention for this series of experiments was to gain a rich working knowledge of the kinds of design qualities that RFID objects may embody. We used an explorative design approach to the physical aspects of RFID and this involved a process of prototyping, where physical RFID objects were built and evaluated in the Bowl environment. Through a sketching process we developed an understanding of the relationships between physical forms and tags. Form-explorations were then used to visualise findings, to generate further models and to examine surface qualities.

This approach has illuminated opportunities and constraints in designing physical RFID objects that now need to be translated into patterns and models that are useful for interaction and industrial design. See the full paper below for more detail around the objects, sketches and models.

Literal associations

The interactions and gestures that have been learned over time for such objects as dolls, toys, chesspieces, microphones, shower heads, telephones, flashlights, magnifying glasses, spraycans, screwdrivers, hammers, kitchen utensils, stamps, and handles, with gestures like stirring, pointing, poking, drawing and shaking are useful starting points for imagining RFID objects and interactions.

Two very distinct kinds of gestures emerged from our workshops and experiments with the Bowl and Orooni Table interfaces. These gestures are pick and place (eg. moving a chess piece) and grab and point (eg. waving a wand).

A form vocabulary for RFID

Designing new gestures, taxonomies of form and affordances specifically for RFID will come only from designing a new set of objects, with their own elements and properties. Through the process of designing new RFID objects we uncovered properties such as direction, balance, similarity and geometry. Here we see some of the variations and abstractions around the elements of RFID form. This is the beginning of a form vocabulary for RFID including balance, similarity, direction and multi-direction.

Through introducing RFID as an element that influences the shape of physical products, we begin to design an inspirational or generative set of forms for RFID-enabled objects. They effectively communicate the physical aspects of the design findings and help us to evaluate and refine a vocabulary of forms.

Conclusions

As the internet of things emerges as an increasingly important discourse within research and consumer products, the design of the RFID things themselves needs to be addressed. Our practice-driven approach involving products, models, objects and visualisations has resulted in a vision for an ‘internet of things’ that places designed things in the centre.

A hands-on approach has allowed a re-evaluation of RFID technology through the lens of design, and communication of this in design-focused language. Through a process of making, evaluation and communicating a number of artefacts and an emergent design vocabulary is being built, that talks to the needs and concerns of interaction and industrial designers.

These making, sketching and visualisation processes may also be important for the design of emerging technologies in general. With the increasing implementation of networked and interactive technology in consumer electronics, aspects of digital and physical design will increasingly need to be addressed by both industrial and interaction designers. Physical design is a critical part of the way in which tangible technologies are experienced, and by allowing design processes to guide product development we are able to approach emerging technology in a plausible and understandable way.

Full paper

‘Designing with RFID’ is being presented at Tangible & Embedded Interaction 2009 in Cambridge UK.

The paper contains a full account of the product review, the sketching, making and modelling, and conclusions around the design for RFID objects. The paper from the Tangible and Embedded Interaction conference will be available at the ACM digital library. You can also download the full PDF here.

Related things:

1. Designing with film We’ve compiled a short sequence of some of the design......
2. RFID and unique physical form Lisa Smith is a Masters of Design student at the......
3. iPhone RFID: object-based media This is a video prototype of an iPhone media player......

The console includes versions of Tag, multiple Quiz games, Hide and Seek and Charades. The base-station connects to the internet for uploading scores and downloading content.

The movie on their home page demonstrates some of the simple game mechanics.

It seems that many of the games are about measurement, tracking and timing of otherwise person-to-person negotiated activities. In this way the product becomes more about tagging people and measuring their activity, particuarly when combined with the wristband attached to the body rather than tagged objects.

This might sound insignificant, but the difference between tagged objects and tagged people is quite pertinent, particularly as this is intended as a playful, learning environment for children. The kinds of learnings that are achieved through a digital system that tracks you rather than the objects you manipulate could be very different.

Related things:

1. iPhone RFID: object-based media This is a video prototype of an iPhone media player......
2. RFID peripherals Plug and play RFID-reading USB peripherals are all the rage,......
3. Playful augmented products workshop Interaction Design students at the Oslo School of Architecture &......

Edit The book is now available as both a free booklet and downloadable PDF.

Related things:

1. RFID & the internet of things Julian Bleecker, Arie Altena and I will be participating at......
2. Interfacing the ‘internet of things’ This is a design brief, one of many themes that......
3. Rob van Kranenburg at ‘How I learned to love RFID’ On the 20th May, Rob van Kranenburg talked at How......