“The complex technologies the networked city relies upon to produce its effects remain distressingly opaque, even to those exposed to them on a daily basis.” – Adam Greenfield (2009)

Immaterials: light painting WiFi film by Timo Arnall, Jørn Knutsen and Einar Sneve Martinussen.

This project explores the invisible terrain of WiFi networks in urban spaces by light painting signal strength in long-exposure photographs. A four-metre tall measuring rod with 80 points of light reveals cross-sections through WiFi networks using a photographic technique called light-painting.

This builds on a technique that was invented for the 2009 film ‘Immaterials: the Ghost in the Field’ which probed the edges of the invisible fields that surround RFID readers and tags in the world. It also began a series of investigations into what Matt Jones richly summarised as ‘Immaterials’.

While we were mapping out tiny RFID fields, we wondered what it would be like to apply the light painting process to larger-scale fields of Bluetooth, WiFi, GSM and 3G. What if we built huge light painting apparatus that could map out architectural and city-scale networks in the places and spaces they inhabited? We’re still very interested in understanding radio and wireless networks as one of the substrates essential to contemporary design practice.

We built the WiFi measuring rod, a 4-metre tall probe containing 80 lights that respond to the Received Signal Strength (RSSI) of a particular WiFi network. When we walk through architectural, urban spaces with this probe, while taking long-exposure photographs, we visualise the cross-sections, or strata, of WiFi signal strength, situated within photographic urban scenes. The cross-sections are an abstraction of WiFi signal strength, a line graph of RSSI across physical space. Although it can be used to determine actual signal strength at a given point, it is much more interesting as a way of seeing the overall pattern, the relative peaks and the troughs situated in the surrounding physical space.

After a week of walking through urban spaces holding and photographing this instrument, we have a much better sense of the qualities of WiFi in urban spaces, its random crackles, bright and dim spots, its reaction to the massing of buildings, and its broad reach through open areas. The resulting images show some of these qualities, and light painting is a brilliant medium for situating visualisations and data into physical world locations and situations.

Lots more visualisations and ‘making of’ pictures.

Einar writes more about this in an upcoming article called ‘Making material of the Networked City’ in Design Innovation for the Built Environment – Research by Design and the Renovation of Practice. There is also more detail on the project at the YOUrban weblog.

Related things:

1. Immaterials: the ghost in the field This video is about exploring the spatial qualities of RFID,......
2. New film: Wireless in the World 2 In this film, Wireless in the world 2, simple visualisations......
3. Making radio tangible Next week we’re launching some new work that explores the......

The article is called Depth of field: discursive design research through film written by Timo Arnall and Einar Sneve Martinussen. It is about the role of film in interaction and product design research, and the use of film in exploring and explaining emerging technologies.

In the last decade, interaction design has found itself in a rather unique position. As an interdisciplinary field, drawing upon many domains such as Human Computer Interaction (HCI), product and graphic design, informatics, art, engineering and critical practice, it has grown the potential to situate itself in a critical position between emerging technologies and culture. In particular, there are emerging modes of doing exploratory design research that result from the newfound relations between product, interaction and communications design.
In this article we discuss our design research activities that use film as a material for exploring, conceptualising and communicating with emerging technology. We analyse this through existing framings of audiovisual media in HCI, technology, and interaction design research. The central research question we address is how does audiovisual media enable new kinds of practice-based design research with emerging technology?

The relations between scientific advance and cinema are extremely close. Kirby proposes that film establishes achievability of scientific and technical discourses, and ‘cinematic depictions of future technologies demonstrate to large public audiences a technology’s need, viability and benevolence’. Historically, film has been a central part of the communication of new technology with interfaces mediated through film or video demonstrators. From televised events showing off household robotics at the 1939 New York World Fair to the invention of modern computing paradigms such as the mouse – in Engelbart’s ‘Mother of all demos’. Products too are often initially experienced through cinematic forms, from lifestyle commercials for Sony televisions, to explanatory ‘how to’ informercials for the Apple iPhone, to user-generated ‘unboxing’ videos on YouTube. The commercial film for the Polaroid SX-70 camera, directed by Charles and Ray Eames in 1972 is a fine example from design practice of new technology explained to the masses through a product commercial, conveying technology and experience combined into one sequence.

In this research we have used graphical, audiovisual, and time-based media as a tool, a material and a communicative artefact that enables us to approach complex, obscure and often invisible emerging technologies such as RFID. We give an account of how film has played an intricate role in the design research practice, from revealing the materiality of invisible wireless technology, to exploring prototypes in real-world settings, to communicating to a wide public audience.

In the article we propose that this kind of research with technology constitutes what we could call a ‘discursive design’ approach. The films below demonstrate design research approaches to RFID where film reveals and articulates complex subjects, through multiple genres, and for multiple audiences. By approaching design research in this way we may be able to explore emerging technologies through play, invention, imitation and parody in ways that are able to reveal and translate across many socio-cultural contexts.

Exploring materiality

The first films show a research approach that explores the materiality of RFID in experimental and highly aestheticised ways. These films emerged out of probing at the technology with the visual tools of photography and animation.

RFID is a largely immaterial technology, it is literally ‘black boxed’ into packaged components, and the qualities of its invisible radio fields are badly understood. The spatial and material aspects of RFID are important for design, in order to be able to create interactions and products that take advantage of the spatial and gestural properties of the technology.

In this film we use long-exposure photographs, light painting, layering and animation. These techniques support particularly expressive modes of explanation, the visualisations occupy a ‘real’ space and are sequenced in a way that provides an immediately graspable view into the spatial qualities of RFID. The use of documentary film form allows for the visual evidence to be laid out in sequences that contextualise, reveal and explain, the film is a highly communicative package for the methods and results.

This was originally written up here and here

In this related film, we show that the readable volume of an RFID tag can be shaped by actually manipulating the size and shape of the physical antenna. This demonstrates that the fundamental technology is not static and constant, and can be shaped through design. When taken together, these films are intended to build material knowledge of RFID, but also through their form, show how designers might begin to take some control over the technical materials, for aesthetic, interactional or functional purposes.

These creative deconstructions of RFID through film techniques point towards what might call a discursive design approach. Drawing on methods from critical design that unpack and re-conceptualise the technological material, combined with narrative and communicative approaches, we may begin to challenge some of the expectations and dominant understandings of RFID.

Communicating products and prototypes

The following product-focused films show technology in context through experiential and explanatory sequences, such as the use of motion diagrams and narrative ‘vignettes’ which convey experiences of using technological products in specific contexts.

Skål (Norwegian for Bowl) explores RFID interactions in a domestic media context, where it broadens the activity of television-based media consumption towards playful, physical engagement. Here film is used to communicate a functioning product prototype, while at the same time highlighting playful and tangible perspectives on RFID in use.

In Sniff we see the potential for reframing RFID technology through explanation and experiential representation of use and activities, and not by focusing on the technology itself. Here the use of cinematic qualities such as short depth-of-field and other stylistic devices such as quick-cut montages enable jumps in time and action that strongly reinforce the playful, exploratory perspectives on the technology.

Films as discursive objects

In this last set of films we wanted to create culturally relevant objects that could communicate to a broad audience.

This iPhone RFID film was created to engage with a large online discussion around Apple’s relatively new iPhone. We wanted to question the largely screen-based modes of interaction that the iPhone encouraged, and to subtly reframe the discussion around RFID to include media, toys, play and direct manipulation of objects in the world. The film was a speculative object from which to see the possibilities for the rich, playful interaction between mobile devices and the world.

Nearness offers a particular view of RFID and proximity interaction that playfully resonates with a history of the chain reaction film genre. It is designed to reach beyond a research or design community in order to provoke discussion and to increase awareness of the technological implications. It does this by parodying an existing popular cultural form in a way that inherently embeds the quality of the technology into the narrative. Originally this film was described here and here.

The making of

These films constitute more than documentation of the design research in Touch, they were the medium in which invention and reflection occurred. Audio-visual media allowed for the creation of products, spaces, objects, gestures and environments that supported our internal and external discussion and development around RFID.

This film shows some of the experiments, processes and film techniques behind the creation of the other films in the article. It shows that these design processes work within the material of film, where the analysis and reflection emerged through the design activity of filmmaking. As well as being highly communicative, film sequences provide a space to gather and articulate a set of ideas, providing a relatively stable outcome and further motivation within the design activity.

Summary

This is a body of design research work that demonstrates the communicative qualities of film, that represent physical objects and their interactive, tangible behaviours over time. Time-based, audiovisual media can combine both explanatory and experiential and contextualising power, and this opens up for prototypes, products and processes being externalised within a practice-based design research activity. We see the potentials for a kind of practice where the emphasis of design research is on communication and participation in public discourse.

We have shown how practice-based design research has the ability to create representations and communicative artefacts, as opposed to technological development or mass production. A communicative approach to interaction design is central to this research. It embodies the idea that the communication of ideas, concepts and arguments through mediated design artefacts is essential to both creating effective interactive products, and to provoking discourse in and around technology-centric research. The form of film – that embodies both a highly reflective design activity and communicative qualities – is an ideal medium for interaction design research, where it can coalesce knowledge around practices and processes and project towards potential futures. Film allows for a degree of probing, explanation and reflexive understanding of emerging technologies, but through its communicative qualities, also opens up for participation in broad social and cultural discourses around technology.

We have shown some perspectives on the role that film can play in exploring, conceptualising and communicating about emerging technology. Film can be used for cinematic explorations and enactments that enable speculation in practice-based design research, but we have also pointed towards the use of online mediation to support public discourse around ubiquitous technologies and materials. 

Read the full article here (pdf) which is published as part of a Research by design issue which also includes articles about designing mobile social software and investigations of motion sketching from our colleagues at AHO.

Related things:

1. Designing with film We’ve compiled a short sequence of some of the design......
2. Design research mediation, layering Just a quick post to flag up a little discovery:......
3. New film: Wireless in the World 2 In this film, Wireless in the world 2, simple visualisations......

In this film, Wireless in the world 2, simple visualisations of radio ‘spaces’ are overlaid into urban spaces. The film has been made as a follow up to this video experiment and has been specifically designed for exhibition in HABITAR at LABoral Centro de Arte y Creación Industrial.

Here is an excerpt from the exhibition description:

“Utopian and radical architects in the 1960s predicted that cities in the future would not only be made of brick and mortar, but also defined by bits and flows of information. The urban dweller would become a nomad who inhabits a space in constant flux, mutating in real time. Their vision has taken on new meaning in an age when information networks rule over many of the city’s functions, and define our experiences as much as the physical infrastructures, while mobile technologies transform our sense of time and of space.”

There are photos of the exhibition by Edgar Gonzalez here. The exhibition catalogue with essays by Anne Galloway, Usman Haque, Nicolas Nova and others is available to download here.

Related things:

1. Wireless in the world An ongoing Touch theme is about making invisible wireless technologies......
2. Designing with film We’ve compiled a short sequence of some of the design......
3. Immaterials: light painting WiFi “The complex technologies the networked city relies upon to produce......

We’ve compiled a short sequence of some of the design experiments and tests in audiovisual media in the Touch project. Here we show some of the ‘behind the scenes’ tests and processes where we used cinematic/video/filmmaking tools as a means to uncover potentials and constraints around an emerging technology.

In these experiments we designed and invented spaces, objects, movements and audiovisual techniques that map and visualise the interactive phenomena of RFID. Many of the visual/cinematic concepts for Nearness and Immaterials were invented by exploring and experimenting with film.

Rather than investing time in creating complex software and hardware prototypes, the interactive experience can be quickly explored inside film compositing applications. These experiments have shown us that there is great value in having tools that offer efficient prototyping of interactions at an experiential level, that don’t need to rely on complex electronics or physical design. There is also value in working within a medium that is not tied to a specific location or a unique demonstrator, and that is editable, reproducible and transmissible allowing it to be shared freely and widely amongst a research group and across the internet.

This is the subject of a forthcoming paper that we’ll flag up here as soon as it is published.

Related things:

1. Depth of field: Film in design research We’ve just had a new article (pdf) published as part......
2. Designing with RFID In Designing with RFID we explore the potential for RFID......
3. New film: Wireless in the World 2 In this film, Wireless in the world 2, simple visualisations......

Creativity contacted us for a “Behind the Work” feature where Jack Schulze goes deeper into the film:

“RFID is a complex and fairly abstract technology to grasp. We have to be careful in how we communicate with it. There are many leaps of imagination and understanding required to grasp it and hold a useful model of how it works and what is happening, let alone see how it maps usefully and elegantly into the world around us. The familiarity of the chain reaction form, means the audience quickly grasps that the normal kinetic transfer of force in the sequence is replaced by invisible forces that work very closely together. Like invisible digital breaths between objects. Because the form was familiar, our hope was the concept of nearness without touching would be clearly understood.”

Shots Magazine asked us to write about new design futures with rfid chips. Here we went a bit further into our film production process in general:

“There has been constant refinement of the production techniques not only to convey designed objects and their surroundings evocatively, but also the invisible layers of interchange and interaction that are increasingly both digital and physical. It turns out that contemporary cinematic techniques such as motion tracking, match moving and the integration of video with 3D motion graphics are ideal tools for visualising, prototyping and communicating about ubiquitous technology.”

And—in a twist that I find particularly satisfying—the UK newspaper Metro wrote about the film, calling it a ‘fun glimpse at a future where you control machines by waving your mobile at them, and everything goes ‘beep’ as you walk by.’

Since Metro is distributed mainly on public transport, it’s lovely to think of their 1.3 million readers all clutching their Oyster cards while reading about the film.

Related things:

1. Nearness One of the essential properties of Near Field Communication is......
2. Responses to ‘Nearness’ The broad response to the short film Nearness has been......
3. New film: Wireless in the World 2 In this film, Wireless in the world 2, simple visualisations......

It is great when a project is not just just well received, but thoroughly understood and appreciated for the underlying reasons it was made. The purpose of making the film was to introduce the ‘magic of proximity’ which is largely left out of the discourse around RFID. The film attempts to communicate the delicate and subtle aspects of a rather obscure technology, so we were pleasantly surprised by the engaged, thoughtful and broad discussions that it has initiated.

Adam Greenfield was one of the first people to pick up on the intertwined concept and aesthetics:

“What really gets me about it is the fusion of technical insight, aesthetic sense, skill in execution and sheer patience it represents. If every made thing in the world were even one-twentieth as carefully thought out as the most offhanded gesture here, we’d all of us be in inestimably better shape.”

While Lisa Smith at Core77 immediately saw the way in which the film explores RFID from a new direction:

“The video very sensitively explores the physical implications of proximity, using RFID for much more than identification.”

Moving Brands responded to the strong legacy of Fischli & Weiss and Honda Cog but saw how:

“Nearness takes the Fischli & Weiss concept further though as it explores how modern day interactive technologies (RFID) with the use of proximity detection make “touching” redundant. It’s an original modern day version of a masterpiece.”

We have always framed the film through a vivid memory of our first viewing of Der Lauf Der Dinge. But a cultural reference that emerged very quickly was Heath Robinson and Rube Goldberg. The Goldberg reference in particular stuck in many discussions, where the relative merits of physical versus virtual interactions were argued out. On Boingboing some commenters disparagingly described Nearness as the “Phantom Menace of Rube Goldbergs”, while another commenter thought the electronic aspect added a contemporary twist:

“The fact that it is entitled “Nearness” and each interface is from indirect interaction elevates this from science project to art for me.”

Guybrush over at Warrenellis.com has an amusing take on RFID chain reactions that manages to take RFID paranoia to new heights:

“Would be funnier with one of the new Barclaycards: swap your card to pay for groceries, see how thieves invisibly get your number, print a cloned card which is then used to access your bank account and to transfer all your money to Russia, where mafia associates can use it right away to pay for a plasma tv on the web which is then delivered to them in a few minutes. Closing shot of smiling Putin-lookalike turning on the tv by remote control.”

There were lots of lovely links from Delicious:

“A nice way to demonstrate near-field communication without getting all swipe-to-pay-for-x” by technekai

“No surprise, but this single page has possibly the highest concentration of awesome on the internet.” by Blaine Cook

“Lovely film of glancing blows, near-misses, wielded fields, touches-without-touching” by Rod McLaren.

And Twitter:

“Now mildly obsessed by non touch thanks to the awesome twist” by macintosh

“Beautiful piece of design and thinking. Like Moustrap for the digital generation.” by TheLeith

“Quite a thought provoking movie, such a rich capture of the nearness concept” by Dries De Roeck

But we’ll leave the final word (for now) to Bruce Sterling:

“Just cut to the chase and give them the Nobel, that’s what I say.”

Related things:

1. ‘Nearness’ goes further Since the launch three weeks ago, our film Nearness has......
2. Responses to ‘Immaterials’ In the two weeks since we launched our film Immaterials......
3. Nearness One of the essential properties of Near Field Communication is......

Hat tip towards The way things go, that Honda commercial and Pythagora Switch.

Some photos.

Related things:

1. ‘Nearness’ goes further Since the launch three weeks ago, our film Nearness has......
2. Making radio tangible Next week we’re launching some new work that explores the......
3. Designing with film We’ve compiled a short sequence of some of the design......

“Natural magnetic fields are revealed as chaotic, ever-changing geometries… Are we observing a series of scientific experiments, the universe in flux, or a documentary of a fictional world?” The stills don’t do the pulsing, crackling, moving visuals justice, I highly recommend that you go and watch the film.

Related things:

1. New film: Wireless in the World 2 In this film, Wireless in the world 2, simple visualisations......
2. Making radio tangible Next week we’re launching some new work that explores the......
3. Immaterials: the ghost in the field This video is about exploring the spatial qualities of RFID,......