“The complex technologies the networked city relies upon to produce its effects remain distressingly opaque, even to those exposed to them on a daily basis.” – Adam Greenfield (2009)

Immaterials: light painting WiFi film by Timo Arnall, Jørn Knutsen and Einar Sneve Martinussen.

This project explores the invisible terrain of WiFi networks in urban spaces by light painting signal strength in long-exposure photographs. A four-metre tall measuring rod with 80 points of light reveals cross-sections through WiFi networks using a photographic technique called light-painting.

This builds on a technique that was invented for the 2009 film ‘Immaterials: the Ghost in the Field’ which probed the edges of the invisible fields that surround RFID readers and tags in the world. It also began a series of investigations into what Matt Jones richly summarised as ‘Immaterials’.

While we were mapping out tiny RFID fields, we wondered what it would be like to apply the light painting process to larger-scale fields of Bluetooth, WiFi, GSM and 3G. What if we built huge light painting apparatus that could map out architectural and city-scale networks in the places and spaces they inhabited? We’re still very interested in understanding radio and wireless networks as one of the substrates essential to contemporary design practice.

We built the WiFi measuring rod, a 4-metre tall probe containing 80 lights that respond to the Received Signal Strength (RSSI) of a particular WiFi network. When we walk through architectural, urban spaces with this probe, while taking long-exposure photographs, we visualise the cross-sections, or strata, of WiFi signal strength, situated within photographic urban scenes. The cross-sections are an abstraction of WiFi signal strength, a line graph of RSSI across physical space. Although it can be used to determine actual signal strength at a given point, it is much more interesting as a way of seeing the overall pattern, the relative peaks and the troughs situated in the surrounding physical space.

After a week of walking through urban spaces holding and photographing this instrument, we have a much better sense of the qualities of WiFi in urban spaces, its random crackles, bright and dim spots, its reaction to the massing of buildings, and its broad reach through open areas. The resulting images show some of these qualities, and light painting is a brilliant medium for situating visualisations and data into physical world locations and situations.

Lots more visualisations and ‘making of’ pictures.

Einar writes more about this in an upcoming article called ‘Making material of the Networked City’ in Design Innovation for the Built Environment – Research by Design and the Renovation of Practice. There is also more detail on the project at the YOUrban weblog.

Related things:

1. Immaterials: the ghost in the field This video is about exploring the spatial qualities of RFID,......
2. New film: Wireless in the World 2 In this film, Wireless in the world 2, simple visualisations......
3. Making radio tangible Next week we’re launching some new work that explores the......

The article is called Depth of field: discursive design research through film written by Timo Arnall and Einar Sneve Martinussen. It is about the role of film in interaction and product design research, and the use of film in exploring and explaining emerging technologies.

In the last decade, interaction design has found itself in a rather unique position. As an interdisciplinary field, drawing upon many domains such as Human Computer Interaction (HCI), product and graphic design, informatics, art, engineering and critical practice, it has grown the potential to situate itself in a critical position between emerging technologies and culture. In particular, there are emerging modes of doing exploratory design research that result from the newfound relations between product, interaction and communications design.
In this article we discuss our design research activities that use film as a material for exploring, conceptualising and communicating with emerging technology. We analyse this through existing framings of audiovisual media in HCI, technology, and interaction design research. The central research question we address is how does audiovisual media enable new kinds of practice-based design research with emerging technology?

The relations between scientific advance and cinema are extremely close. Kirby proposes that film establishes achievability of scientific and technical discourses, and ‘cinematic depictions of future technologies demonstrate to large public audiences a technology’s need, viability and benevolence’. Historically, film has been a central part of the communication of new technology with interfaces mediated through film or video demonstrators. From televised events showing off household robotics at the 1939 New York World Fair to the invention of modern computing paradigms such as the mouse – in Engelbart’s ‘Mother of all demos’. Products too are often initially experienced through cinematic forms, from lifestyle commercials for Sony televisions, to explanatory ‘how to’ informercials for the Apple iPhone, to user-generated ‘unboxing’ videos on YouTube. The commercial film for the Polaroid SX-70 camera, directed by Charles and Ray Eames in 1972 is a fine example from design practice of new technology explained to the masses through a product commercial, conveying technology and experience combined into one sequence.

In this research we have used graphical, audiovisual, and time-based media as a tool, a material and a communicative artefact that enables us to approach complex, obscure and often invisible emerging technologies such as RFID. We give an account of how film has played an intricate role in the design research practice, from revealing the materiality of invisible wireless technology, to exploring prototypes in real-world settings, to communicating to a wide public audience.

In the article we propose that this kind of research with technology constitutes what we could call a ‘discursive design’ approach. The films below demonstrate design research approaches to RFID where film reveals and articulates complex subjects, through multiple genres, and for multiple audiences. By approaching design research in this way we may be able to explore emerging technologies through play, invention, imitation and parody in ways that are able to reveal and translate across many socio-cultural contexts.

Exploring materiality

The first films show a research approach that explores the materiality of RFID in experimental and highly aestheticised ways. These films emerged out of probing at the technology with the visual tools of photography and animation.

RFID is a largely immaterial technology, it is literally ‘black boxed’ into packaged components, and the qualities of its invisible radio fields are badly understood. The spatial and material aspects of RFID are important for design, in order to be able to create interactions and products that take advantage of the spatial and gestural properties of the technology.

In this film we use long-exposure photographs, light painting, layering and animation. These techniques support particularly expressive modes of explanation, the visualisations occupy a ‘real’ space and are sequenced in a way that provides an immediately graspable view into the spatial qualities of RFID. The use of documentary film form allows for the visual evidence to be laid out in sequences that contextualise, reveal and explain, the film is a highly communicative package for the methods and results.

This was originally written up here and here

In this related film, we show that the readable volume of an RFID tag can be shaped by actually manipulating the size and shape of the physical antenna. This demonstrates that the fundamental technology is not static and constant, and can be shaped through design. When taken together, these films are intended to build material knowledge of RFID, but also through their form, show how designers might begin to take some control over the technical materials, for aesthetic, interactional or functional purposes.

These creative deconstructions of RFID through film techniques point towards what might call a discursive design approach. Drawing on methods from critical design that unpack and re-conceptualise the technological material, combined with narrative and communicative approaches, we may begin to challenge some of the expectations and dominant understandings of RFID.

Communicating products and prototypes

The following product-focused films show technology in context through experiential and explanatory sequences, such as the use of motion diagrams and narrative ‘vignettes’ which convey experiences of using technological products in specific contexts.

Skål (Norwegian for Bowl) explores RFID interactions in a domestic media context, where it broadens the activity of television-based media consumption towards playful, physical engagement. Here film is used to communicate a functioning product prototype, while at the same time highlighting playful and tangible perspectives on RFID in use.

In Sniff we see the potential for reframing RFID technology through explanation and experiential representation of use and activities, and not by focusing on the technology itself. Here the use of cinematic qualities such as short depth-of-field and other stylistic devices such as quick-cut montages enable jumps in time and action that strongly reinforce the playful, exploratory perspectives on the technology.

Films as discursive objects

In this last set of films we wanted to create culturally relevant objects that could communicate to a broad audience.

This iPhone RFID film was created to engage with a large online discussion around Apple’s relatively new iPhone. We wanted to question the largely screen-based modes of interaction that the iPhone encouraged, and to subtly reframe the discussion around RFID to include media, toys, play and direct manipulation of objects in the world. The film was a speculative object from which to see the possibilities for the rich, playful interaction between mobile devices and the world.

Nearness offers a particular view of RFID and proximity interaction that playfully resonates with a history of the chain reaction film genre. It is designed to reach beyond a research or design community in order to provoke discussion and to increase awareness of the technological implications. It does this by parodying an existing popular cultural form in a way that inherently embeds the quality of the technology into the narrative. Originally this film was described here and here.

The making of

These films constitute more than documentation of the design research in Touch, they were the medium in which invention and reflection occurred. Audio-visual media allowed for the creation of products, spaces, objects, gestures and environments that supported our internal and external discussion and development around RFID.

This film shows some of the experiments, processes and film techniques behind the creation of the other films in the article. It shows that these design processes work within the material of film, where the analysis and reflection emerged through the design activity of filmmaking. As well as being highly communicative, film sequences provide a space to gather and articulate a set of ideas, providing a relatively stable outcome and further motivation within the design activity.

Summary

This is a body of design research work that demonstrates the communicative qualities of film, that represent physical objects and their interactive, tangible behaviours over time. Time-based, audiovisual media can combine both explanatory and experiential and contextualising power, and this opens up for prototypes, products and processes being externalised within a practice-based design research activity. We see the potentials for a kind of practice where the emphasis of design research is on communication and participation in public discourse.

We have shown how practice-based design research has the ability to create representations and communicative artefacts, as opposed to technological development or mass production. A communicative approach to interaction design is central to this research. It embodies the idea that the communication of ideas, concepts and arguments through mediated design artefacts is essential to both creating effective interactive products, and to provoking discourse in and around technology-centric research. The form of film – that embodies both a highly reflective design activity and communicative qualities – is an ideal medium for interaction design research, where it can coalesce knowledge around practices and processes and project towards potential futures. Film allows for a degree of probing, explanation and reflexive understanding of emerging technologies, but through its communicative qualities, also opens up for participation in broad social and cultural discourses around technology.

We have shown some perspectives on the role that film can play in exploring, conceptualising and communicating about emerging technology. Film can be used for cinematic explorations and enactments that enable speculation in practice-based design research, but we have also pointed towards the use of online mediation to support public discourse around ubiquitous technologies and materials. 

Read the full article here (pdf) which is published as part of a Research by design issue which also includes articles about designing mobile social software and investigations of motion sketching from our colleagues at AHO.

Related things:

1. Designing with film We’ve compiled a short sequence of some of the design......
2. Design research mediation, layering Just a quick post to flag up a little discovery:......
3. New film: Wireless in the World 2 In this film, Wireless in the world 2, simple visualisations......

What is especially lovely is the way in which the images from our paper are carefully interpreted and annotated visually with notes and explanations. In many ways it communicates better than the original paper.

And on that note, Nicolas Nova also has a good writeup here.

Related things:

1. Depth of field: Film in design research We’ve just had a new article (pdf) published as part......
2. Re/Touch: Inspiring touch-related interaction design One of the things that social and cultural research on......
3. Norwegian Design Council awards Sniff Sniff has won the prize for Design for All at......

One of the things that social and cultural research on touch attempts to grapple with is everything people are supposed to touch and not supposed to touch—and what we actually end up touching or not touching in any given situation. When I first saw Sameer D’Costa’s photo on Flickr, it reminded me of people’s desire to touch things that we aren’t supposed to, and I wondered what that might mean in terms of research.

A year later we’re excited to share the result of that wondering: re/touch, an online resource for designers and researchers interested in touch-based interactions and relations. As the action of touch is technologically mediated by both contactless interactions in the world and through multi-touch on screen, awareness and reflection on the richness of touch is becoming increasingly important.

The re/touch website

re/touch brings together hundreds of cross-cultural examples of social norms and values involving touch—all categorised according to actions related to touching.

A collection of quotes from ethnographic accounts written between the late 1800s and the present, re/touch encourages designers and researchers to explore how touch is used by people to relate to one another and the worlds in which we live.

You can browse the quotes to create design briefs, refine interaction scenarios or otherwise inspire you to think, make or do things touch-related.

About the project

We like to think of re/touch as a work-in-progress. So far, it contains almost five hundred quotes from dozens of cultural groups around the world, and we’re working to add more. As the collection grows, we expect the action tags to change as well, so over the next couple of months you may notice different words in the tag cloud. In the end, we anticipate having over one thousand quotes and more than fifty categories of touch-related action.

The re/touch website also includes some background information on the content, and we plan to publish a paper on the research methodology and some thoughts on collaborations between anthropology and design.

If you notice any database problems or errors, please leave a comment below and we’ll look into it. We’re also still working on the web design—including making the site work well and look good on the iPhone—so we’d certainly appreciate any feedback you might have along those lines as well.

Ultimately, we hope you’ll find this resource as interesting and inspiring as we do!

Related things:

1. Depth of field: Film in design research We’ve just had a new article (pdf) published as part......
2. Introducing touch as culture Hello. My name is Anne Galloway and I’m very pleased......
3. Touch as interaction medium This is a design brief, one of many themes that......

Understanding ritual has long been the domain of anthropology, but one of my professors in graduate school was fond of reminding students that ritual is not just the domain of other, more exotic cultures, or of the intellectually-suspect religious amongst us. If nothing else, ritual is as mundane and crucial as everyday life. In New York, Charlie, Richard Coyne and I also spent some time discussing the religiosity of famous philosophers and theorists, and how embodied ritual is a way for different people with different orientations and directives to come together. Although these activities can involve the magical, they share more in common with Matt Jones’ recent descriptions of play, and Blast Theory or Jane McGonigal’s sense of games. Charlie also alluded to this in his talk when he connected the liturgy to the spectacular (one good reason not to abandon the Situationists in discussions of locative technologies!) and I think there are some interesting, and underexplored, connections between bricolage, hacking, syncretism and ritual.
In Touch in art and elsewhere, a small online exhibition he’s just curated for low-fi.org.uk, Charlie recalls bits of our conversations and continues to inspire me:

“Recently, for various reasons, I have become interested in the question of touch, in art and elsewhere. We live in a world in which the ways in which we can communicate with each other become more and more immaterial, incorporeal and virtual, particularly through the increased use and greater ubiquity of digital technologies. In this context touch is often occluded and, at the same time, overly fetishised. In the last half century or so, there has been an increasing interest in touch in art, especially in relation to performance and telematic works, that may be a response to the increasing virtualisation of culture, though the question of touch can be traced in far older works, particularly some of those dealing with the life of Christ, which is, whether we are religious or otherwise, the founding myth of Western culture, and which has determined much of our understanding of questions of presence and absence, corporeality and spirituality, and our relation to the senses and thus to touch.”

Like Charlie, I’m interested in cultural practices surrounding what can, and cannot, touch. Applied to RFID and Near-Field Communication, this becomes a question of connecting some things and disconnecting others. Put another way: whether we’re concerned with issues of technological privacy or publicity in our everyday lives, I believe we’re well served by a stronger understanding of cross-cultural examples of ritualised contact and avoidance. It’s my hope that the Touchpædia will be a step in that direction, and I’m looking forward to seeing where it might lead.

Related things:

1. Introducing touch as culture Hello. My name is Anne Galloway and I’m very pleased......
2. Re/Touch: Inspiring touch-related interaction design One of the things that social and cultural research on......

Where I’m coming from

As it so happened, I had also recently finished reading Constance Classen’s wonderful edited volume, The Book of Touch. Unique in its approach, it begins a cultural history of touch, and starts to draw out our cross-cultural experiences of touch. Of special interest to me was her claim that a cultural understanding of touch was probably best served not by detached or objective intellectual analysis, but rather by a “rough and ready approach that acknowledges and grapples with the tangled, bumpy and sticky nature of the topic.”

I was taught, and I now teach students, that it’s always a good idea to start any research project with a literature review. Not only does this help the researcher better understand the field in which they seek to intervene, and locate them within that field, but it helps identify strengths and weaknesses, or gaps in the existing research that can provide points of entry to further understanding.

But how could I turn the rather stodgy academic lit review into something “rough and ready” for other researchers and designers to work with? Well, one possibility was compiling a cultural encyclopædia of touch, and so my first contribution to the project will be the Touchpædia.

What’s the Touchpædia?

The content of the Touchpædia will be organised thematically – along the lines of “touch as contamination” and “touch as pleasure” or “touch as magic” and “touch as pain” etc. – and each entry will include the following:

1) a summary of current social and cultural research;

2) suggestions for further reading;

2) possible research questions, focussed on design and material culture;

3) possible ethnographic research methodologies, focussing on participatory, performative and playful engagement;

4) simple design briefs.

In other words, there’s lots more good stuff to come before summer 2007 and we’re excited!

And last, but certainly not least, we’re really looking forward to hearing people’s thoughts and sharing our experiences along the way. Cheers.

Related things:

1. Touch as culture This is a design brief, one of many themes that......
2. The rituals of touching I had the pleasure of meeting Charlie Gere at the......
3. Re/Touch: Inspiring touch-related interaction design One of the things that social and cultural research on......