We Rep Ideas

“To the analyst, such as me, interfaces are where the fun lies. Interfaces between people, people and machines, machines and machines, people and organizations. Anytime one system or set of activities abuts another, there must be an interface. Interfaces are where problems arise, where miscommunications and conflicting assumptions collide. Mismatched anything: schedules, communication protocols, cultures, conventions, impedances, coding schemes, nomenclature, procedures. it is a designer’s heaven and the practitioners hell. And it is where I prefer to be.”
Donald Norman

It’s a couple hundred years before the advent of GPS, Sextons and the Compass. You’re in the middle of the ocean, and your not lost. This is most likely because you have become literate to seamarks, the environmental cues and signals of open waters. Schools of fish, celestial alignment, cloud formations, and flocks of birds all tell of ones position and probable future conditions. It is also likely that you did not discover all of these cues on your own. The understanding of these signals and signs is a skill that has been passed down, preserved and cherished for generations. A complex mix of curiosity, mortality, and passion combined with the perceived value of unknowns too seductive to abandon forced these first literacies to emerge.

But are these signs really signs, or are they cues? In terms of the present-day way finding of concepts, could it be that our equivalent forms are more like hyperlinks than definitive words? Does a cloud, icon, or object contain meaning, or trigger a learned response?

When asked to write a paper for DeSForM: Design & Semantics of Form and Movement, I was intrigued by the purpose of the conference. Its edict is to facilitate a dialogue between schools of design, human-computer interaction, interface design, and tangible computing. The resultant discussion would determine how information will be communicated through a dynamic use of form and movement by objects and spaces.

How might object and spatial behavior communicate meaning? What dilemmas can we foresee at the outset of this exploration and how might we approach them? The question posed by the organizers of DeSForM was twofold. How might we set forth to design this system of dynamic symbols in a systematic and scientific manner, as well as what are some of the best practices, precedents and knowledge in this area?

One only needs to look at conferences such as DesFoRM and blogs such as WeMakeMoneyNotArt to see existing advances in university labs, art and design colleges, unorthodox startups, basements and garages all working towards solutions and applications in this area. The examples are exhaustive, there is opportunity in harnessing this narrative of edge competencies these diverse and driven collections of individuals are creating. In identifying the connections, links and overlaps between their work, there is much value in acknowledging, aggregating, framing their discoveries and explorations. Navigating these concepts and contributions to this language will be much like navigating open waters. Through the sketches, prototypes, products and papers we will individually and collectively negotiate their value and use, their successes or failures.

(more…)

INTRODUCTION

How is it that we truly know the world?

What is the true nature of things?

Science tells us that the true nature of things lies beneath the surface. If we look upon a chair and ask, what is that, the common answer would be, but of course - a chair. And who would deny this? It is after all what we have learned.

A chair is not a chair however. Beyond the surface of the chair are a whole series of phenomena that are invisible to the “naked” eye. The chair is actually made up of atoms, tiny particles that are the building blocks for everything. A desk, a chair, even humans are made up of atoms. And atoms themselves are made up of even smaller subatomic particles.

Science and the scientific pursuit have proven this to us through instruments that measure, and through experimentation. The scanning tunneling microscope used for observing atoms, for example, presents us with a reality that is objective and rational. Or so it seems.

But is this really how we know the world?

Knowing seems to be indicative of a deeper visceral engagement with the world. One that is mediated through the senses and understood only after repeated sensory impressions.

Experience is the mother of all invention.

Reality is not objective and rational. Rather it is a subjective experience dependant on the one doing the perceiving. And it is precisely this dependency that has given birth not only to the apparatus for sensing, but also to that which the senses pick up. There is a certain mutuality or reciprocity to the phenomenal world in the way that acts of expression and perception form mutually co-dependant relationships. If the bee cannot smell the pollen what good is it to the pollen producing plant? Thus, our perceptual ways of knowing are tethered to the world itself, intimately weaved, and not separate from it.

Science and technology however have distanced themselves from these corporeal ways of knowing preferring instead a rational and objective outlook. And has as a result of these extensions created a gap between nature and us. Between the mind, and the body.

Take for example, the term “naked eye” as it is used above. As if the eye that is naked is insufficient without the prosthesis of scientific technology. The assumption itself that the eye is naked to begin with is skewed. These assumptions, that have in essence made their way into a common language suggests a deeply engrained prejudice that displaces the senses from their natural ability to pick up what is given, and instead suggests that the true nature of things somehow lie beneath all appearances. This way of thinking has not only displaced the senses from their inherent right to know, but has distanced us from what I would call proper ways of thinking about the world and our place in it, by privileging a rational techno-scientific outlook over one grounded in the bodies corporeal ways of knowing.

I would like to close that gap and reclaim the rightful place of the Sensus Communis as an intelligent and rational faculty that can, and should inform our forages into technological and scientific pursuits.

Over the past several years I have been deeply engaged with a body of work that advocates for the inclusion of the human senses into a common practice. One that states that the senses are the foundational support for everything we experience and for everything that we create as a result of those experiences. As such, the senses are something we should be paying more attention to, and giving them their due credit.

In consideration of the many facets of multi-sensorial intelligence, this paper will briefly touch on three aspects I think are important in bringing to bear the relevance and significance of a return to the Sensus Communis.

FOOTNOTE: “Sensus Communis”

Aristotle postulated a central faculty capable of uniting all the senses, synthesizing what each sense picked up to form a coherent whole in the mind. He called this the “Sensus Communis”.

(more…)

PREAMBLE:

Once upon a time not long ago – when people whore tag jammers and rendered life on the low – when laws were stern and justice stood – and kids were misbehaving like they aught to should – There lived a little toy who was mislead – by another little toy and this is what he said: Me and you kid we’re gonna craft some fame – posting up drama while tagging his name. They hit some spots – fame came with ease – but one couldn’t stop it’s like he has a disease…

-Adapted from Children’s Story By Slick Rick 

The  scenario to follow is a “day in the life of” story about a Graffiti Writer overcoming and subverting what we might call “writers block”: the combined chilling effects of materials prohibition, pervasive surveillance technologies, inaccessible mediums, shrinking spaces for expression (aka habitat destruction) and the inattention of fragmented audiences lost in an over mediated fog of advertising. How does the artist overcome and adapt?

Along with the help of a growing creative insurgency made up of home grown hactivists, moonshiners, code breakers, trackers and map makers; Graffiti Writers do their best to bypass the barriers standing in between them and their pursuits of mediated presence, dialogue and fame. What is the future Graffiti  experience? Where does it take place?

Le Confiture (The Jam) takes place “once upon a time” several decades after the disappearance of graffiti, as we know it today. Technological progress, privatization and public paranoia has forced Graffiti Culture out of its more familiar and tangible surroundings- causing its migration towards freshly augmented realities and virtual worlds that present themselves as blank canvases (Habitats) to express on and speak from. Within this new context, Graffiti lives on.

Unfortunately, many of these augmented realities and virtual spaces apply and enforce the same laws, codes of conduct, and logics that squeezed Graffiti from its original habitats. Within this new paradigm, security, cost of production, bandwidth, connection speeds, traffic volume and membership agreements frequently determine the artist’s potential for self-actualization. Which often finds it-self half rendered and lagging. Further adaptation is required. How does one make their mark within this plural context?

As method to this madness, graffiti artists rely more heavily on soft-tools and semi-autonomous agents, also know as “toy soldiers”. These agents are designed and programmed to help the artist achieve and maintain a plural-all city- digital graffiti presence, now necessary within the complex mixture of overlapping worlds. These agents are, all at once, collaborators, students, and works of art; always evolving in style, sketching themselves out, questioning, collecting, learning from, and commenting on, the landscapes and experiences that surround them. Graffiti writers are their “imaginations”, temporary masters, and mentors guiding their actions, teaching and training them towards achieving mutually beneficial outcomes. What is the nature of this collaborative relationship? What is gained and what is lost? What is the role of imagination in a world of automation?

Within this highly mediated theatre known as Dataspace, the Graffiti Writer and his agents are just one in a billion actors fighting for space, bandwidth and attention on a massively multiplayer mixed reality stage; Performing for an always on and lurking audience inhabited by people places and things. Graffiti is the anomaly always acting up to be seen. What does this mean?

Graffiti has  evolved; writers embrace performance, playing more seriously with time-context-medium, and most importantly message. Graffiti shouts out at you; knowing it will be seen, heard, captured, broken apart, re-assembled and transmediated back into- and across other worlds, contexts- spaces and times by the all seeing, all appropriating audience.   

LE CONFITURE is a scenario-based exploration of expression, identity, learning and collaboration within a futuristic and intentionally dystopic - ubiquitous computing landscape otherwise known as Dataspace. The scenario introduces and projects existing political, socio-cultural, technological, and economic signals into a panoptic world inhabited by yet another generation of Graffiti artists and their culture jamming  hacktivist agents. The narrative explores their motives, logics, values and experiences as they struggle to make their mark within a feudal and over saturated attention economy controlled by pervasive and chilling DRM infrastructures, advanced materials prohibition, and networked surveillance. Furthermore, the scenario explores the context of multiple networked identities, master-mentor and actor-author-audience dynamics, and how new forms of digital media literacy might emerge within a transmediated (Plural) landscape where even the subtlest forms of temporary presence and participation can guarantee new and unimagined forms of permanence, fame and legacy.

 Keywords

Graffiti 2.OH!, Remix Culture, Prohibition, Digital Rights, Collaboration, Ubiquitous Computing, Dataspace, Transmediation New-Media, Expression, Virtual Identity, Surveillance, Telepresence, Trespass, Plurality, Asymmetric, Literacy, Attention Economy, Feudalism, Augmented Reality, Artificial Intelligence, Pattern Recognition, Mapping, RFID, 

Scenario: Saw-sees

My name is John Hammond and I can do almost anything you can imagine with wood. Ive spent the last thirty years building cabinets in my spare time, and mine are as good as any. Ivory inlays for days.

I’m considered a master.

I’m Xavier Borden, I’m an industrial poet and musician. I make kinetic sculptures that have a dual purpose as instruments. I transform, reform and perform, interact or die.

I’m considered an eccentric.

My friends call me Sady, I take consumer electronics, tools and vintage computers and build violent robots that’ll eat your kitsch installations.

I’m considered an artist

Call me John, Xavier or Sady, I’m a playlist of mastery, but my real name is DeWalt im a model 568X skill saw. Nice to meet you. My tricks, my trades are recallable at any time. Just ask my traces, they’ll shed light on an imagination that lived. The residual imprints of hands, paths, and purposes is my personality.

I’m considered innovation

—

Significance:

I began to toy with the idea that objects can house avatars. There are many ways in which people can express themselves and their identity beyond pixel and volume. As objects become more literate of our behaviors they may one day house our gestural traces.

How would one “play an environment” like a conductor of a remote symphony in real-time? - Embodying an instrument, a section, or whole orchestra at any given moment, an expressive variance similar to that of emphasis in speech. My son should be able to bring a play-list of these “contacts” - live or residual- with him everywhere, for use in a wide variety of contexts. Making any wood shop his fathers’ wood shop. The right contextual links and personal inquiry could prompt, or summon residual knowledge, or “live” presence of an individual or mix of individuals which that a given situation requires - providing - in context, information rich, experiential-mash-up-swarms, with read write capability.

I wonder how something like this could change educational models, could El P be in my sequencer? When I buy a paintbrush, could you throw in Rembrandt too? It brings a whole other meaning to buying a pair of “Jordan’s.”

Objects will perform unimagined means and modalities of representation, vessels of personal and group communication. It is foreseeable that things with communications will enable the expression of our various forms of presence. It is likely that social networks will evolve within single and multiple objects. Merely using something is synonymous to pressing record.

These recordings will be entries contributing to the history of an object, a history that can be searched, recalled, annotated and resituated. Object that teach are nothing new. New is how object may provide a platform to direct the hands in a spectrum of meaningful ways, based on other hands. Like a scene from Ghost. Gesture is technique, and technique can be recorded, codified and expressed. Objects may come to teach, translating motions, motivations and intents into tutorials and curricula. There are stories to tell of the roles they’ve played in the lives of people. If only these walls could talk.