Refining Ideas and Thesis Deliverables

Thesis

Where I’m At

I have been doing some extensive research into the possibility of developing an actual cave prototype. In discussions with my Thesis adviser, he commented that I need to keep focus on the design aspect and not become sidetracked by the technology issues. I have taken this to heart and after a great deal of additional investigation, have determined that such an endeavor would likely be outside of the scope of a Design thesis. However, the research is still extremely valid as it proves the proof-of-concept. So it is not fully lost or time that has not been well spent. It certainly helped me to refine my ideas, and find a way to make them more concrete. What I can now begin to do is focus my attention to the actual pieces that will comprise the design of an exhibit.

Interactive Exhibit Design

Things to Consider

In development of a full exhibit design there are a number of factors that need to be addressed and considered before design and development of artifacts can take place:

  • Audience – What is the target audience and demographic?
  • What are the best ways to engage various demographic segments?
  • Can we develop writing styles that will engage all types of readers?
  • Elements – What types of interactive elements will be used? What non-interactive elements will be used?
  • How can the ideas of the exhibit be expressed via visual design?
  • Can we develop various design systems that work together for exhibit branding, wayfinding, interactive elements, souvenirs.

Potential Deliverables

Interactive Display
  • User Personnas
  • Exhibit Contextual Design Research – Observation, Surveys & Documentation
  • Design Ideations – Sketches, Wireframes, Moodboards
  • Typography and Accessibility study of short throw projection on various screen materials.
  • One (1) Early prototype that is used for testing and refinement.
  • Test results from prototype compiled, reviewed & documented
  • One (1) fully functional and coded interactive informational display
Exhibit Design Guide
  • Color Palette
  • Logo Design & Usage
  • Typography
  • Wayfinding
  • UI Elements
  • Interaction Design
  • Merchandise
Film & Motion Graphics
  • Short film / motion graphic demonstration of interactive physical interface.
  • Projection of interface demo film / motion graphic
  • Paper exhibit model
Advertisements

Prototype Design Ideation

Thesis

Motion Tracking & Candle ‘Illumination’

After doing some additional research on various technologies, I have settled on using Open CV for motion tracking of participants as they move through the exhibit. In this way, as participants move, their locations can be tracked and the game engine can respond with appropriate lighting as they move. In this way, the cave can be dark, but when participants move closer to the cave walls, it will be illuminated by a faint “candle” similar in intensity to the ones used by Upper Paleolithic cave painters. I found a number of Open CV tutorials on YouTube by Kyle Hounslow and have been working to try and get those operational using only a simple webcamera. Luckily there are a number of open source MIT Licensed repositories on GitHub. In addition, there are also a number of Tutorials on integrating Open CV into a game engine like Unity.

Creating a Touch Screen

YouTube is amazing. You can find just about any DIY project on there, including one about how to create your own touchscreen using plexiglas, a wood frame, Infrared (IR) Lights, an IR camera, and a projector. I modified this a bit further and added white semi-translucent textured fabric I picked up from Jo-Ann’s. I need to take some videos to demonstrate once I get the back end code working properly.

Integrating in Unity

Unity is a game engine that can be used to create any type of environment (say, for example, a cave with Upper Paleolithic art). Unity can also be used with Open CV as well as a DIY touch screen, which can then be mapped to a physical environment using a projection mapping software such as Resolume.

prototype

 

Project Update – Fall Semester, 2016

Thesis

General Update

This semester begins my (hopefully only) year-long Thesis project for a Master of Fine Arts in Visual Communication Design (Interaction Design) at Rochester Institute of Technology. My Thesis advisor is Dan de Luna (https://cias.rit.edu/faculty-staff/149) an excellent Motion Graphics artist and skilled painter.

The idea of my thesis has changed dramatically as I have progressed in my thinking and scope so that the project may be achievable within my intended time frame. This will include a showing in the Spring of 2017, and a full written paper for submission to Proquest. For the moment, I am focused upon the project and preparation of my proposal and presentation.

Project & Content

The content and general ideas in my Thesis project such as the use of physical interfaces, projection mapping, and and group interaction have remained largely the same, but I have removed the ideas of wrapping the project within the ideas of a hero journey, or Monomyth.

As I have learned more about what will be needed for the technical details of this project, I am leaning towards some technologies that I had not previously anticipated. In particular, I am almost certain that a game engine such as Unity or Unreal Engine 4  will be needed in order to accommodate the use of lighting as participants move through the physical environment. This will mean that a mock cave environment will need to be created in a 3D asset development program such as Maya. However, as the projection mapping will work best with larger polys, the work required, texturing and image mapping will be within the realm of my knowledge. I can also call upon my Thesis chief for some technical assistance, should I run into issues.

The other major discovery is that I will need to have some motion tracking of participants as they move through the exhibit. Luckily I discovered a multi-person tracking program created by Kyle Hounslow. It is written using Open CV and C++. Kyle’s profile says that he is available for help and assistance if necessary, and I personally know plenty of programmers from my job that have told me that they can lend some programming assistance.

Seeking Input From Experts

I recently reached out to several people for assistance with asset creation including Dr. Jean Clottes, a world renowned expert on Upper Paleolithic Cave Art. (Hey, why not try to get the best?) I explained my project and asked Dr. Clottes for assistance with gaining access to particular 3D cave mappings, and photographic assets for use in the project. Dr. Clottes book What is Paleolithic Art was recently translated from French and published earlier this year.

I also reached out to Genevieve von Petzinger, the author of the wonderful new book The First Signs: Unlocking the Mysteries of the World’s Oldest SymbolsMrs. von Petzinger and her husband (a photographer) visited an astonishing number of caves throughout Spain, Germany, France, and Italy and documented signs and symbols that have been so often overlooked in favor of parietal art. For a more academic read, you can check out her Masters Thesis: Making the Abstract Concrete: The Place of Geometric Signs in French Upper Paleolithic Parietal Art.

I also reached out to a network of European museums, cave management agencies, researchers, and visitor centers called Ice Age Europe. I explained my project and asked them if they would be willing to work with me on it, and I would gladly provide them with my source files for the exhibit. They responded and expressed interest in the project! As it turns out, they have a number of portable exhibits that they loan out to members, so this would likely make a nice addition to their current offerings.

Nose-To-The-Grindstone Practical Stuff

There are several tasks that I now have to undertake to move this project forward including (but not limited to):

  • Deciding on two additional Thesis advisors. One must be from my department of Visual Communication Design, and one must be from outside my department – presumably one that with background and knowledge that can advise on technical and/or content issues.
  •  Figuring out portability, stability, and a stable interactive surface for the projection mappings.
  • Learning about Unity & Unreal Engine for the gamification environment…. and how the hell it’s all going to come together.

OK – that’s all for now. It’s Sunday and I need to get back to research and working on my proposal.

Machine Intelligence & Generative Design

generative design, machine Intelligence, Uncategorized

With my new User Experience job at Redcom Laboratories, I throttled back on my courses to part-time status, and took two classes for Fall 2015 semester, and two classes for Spring 2016 semester. This has allowed me some breathing room for more thesis development, as one of the classes is on developing my problem statement and research.

So I returned to my previous work from a year ago, and see lots of holes and gaps in what I had previously done, which is a very good thing. Last summer I was able to work on some prototypes, and think more about what my thesis needs to explore. As I now see it, the issues of primary importance seem to be:

  • Exploration of our humanity and expansion of consciousness via the concept of Personal Transformation.
  • Use of Generative Design system(s) to provide the basis of the experience.
  • Machine Intelligence to provide the neural network and backbone for Generative Design system.

Personal Transformation Process

In her review of Personal Transformation as it relates to the field of nursing, Gail Holland Wade provided this synopsis in her 1998 article ‘A Concept Analysis of Personal Transformation.’  

Personal transformation is preceded by a disorienting dilemma that disrupts the order of one’s life (Ferguson 1980, Loder 1981, Wildemeersch & Lierman 1988, Busick 1989, Mezirow 1991). Anything that draws the individual into a mindful, watchful state produces a disorienting dilemma and the potential for transformation. Disorienting dilemmas may include stressful life experiences and transitions, relationships with individuals, a book, or a new environment (Ferguson 1980, Wildemeersch & Lierman 1988).

Journal of Advanced Nursing, Volume 28, Issue 4, pages 713–719, October 1998

Ferguson (et. al.) established that a stressful life experience or environment may lead to an opportunity for Personal transformation, but as Wade further points out in her article, her research indicated that, “for transformation to occur, the individual must make a deliberate choice to confront the conflict or dilemma.”

So essentially, you can’t make someone play ball if they don’t want to. And that’s fine. Participants can always have the choice, and not everyone with experience a catharsis. In fact, I would be shocked if it did. My intent would be to use Generative Design as a way to explore our humanity in new ways.

Machine Intelligence

As part of my ongoing research, I have slowly stumbled upon the concepts of machine learning and machine intelligence. This has lead me through various articles and programming languages related to AI and machine learning. It seems that there are many ways to take a bite at the apple, and I will definitely need some assistance in figuring out the right pathways to achieve my desired results.

I am also going to have to learn some additional programming languages like Python and Tensor Flow. I also came across some articles on Medium by Blaise Aguera y Arcas. Blaise is apparently a big deal in the machine intelligence world. He runs the machine intelligence research at Google. Google is also apparently very interested in how machine learning and the arts can work together. Hmmm… Interesting…

So what’s a grad student to do? Well, I sent him an email telling him about my project and asking a few questions about machine intelligence. Maybe he’ll answer me. Or maybe it was just a note in a bottle that is now adrift in the internet ether. Who knows…

Like Sands Through the Hour Glass…

Uncategorized

So I was very productive this summer. I did a number of arduino projects and did a lot of additional reading and research on Joseph Campbell and made some significant updates. One of the books I finished reading was ‘The Mind in the Cave: Consciousness and the Origins of Art’ by David Lewis-Williams. The book presents an excellent  study into the background and possible social implications of cave painting and suggests some meanings for the activity of cave painting in upper neolithic societies.

At the end of the summer, I was ready to head back to school full time to continue my program and dive headlong into more thesis research and refining my proposal.

As it happened, I was recruited by a local software company for a User Experience position. It was a position and offer that was too good to pass up – so I am now working full time and I am taking two classes at RIT part-time. While this puts my formal Thesis work on hold for a bit, I will certainly continue to push forward with it in addition to my other coursework, career work, and everything else in my life.

I will likely return back to this as things develop more, but for now, I will take a bit of a break from it.

Summertime Sadness

Uncategorized

With the end of the school term, I now have time to devote to what else… more research. In speaking with my thesis advisor (Dan Deluna) last semester, I realize that I will need to work over this summer to close the knowledge gaps in order to ensure that my thesis will be completed by Spring of next year (2016). So, I purchased a basic Arduino starter kit and some additional sensors and plan to do some work on those items. As I work on these things, I will (hopefully) provide some updates along the way.

So here’s my summer to-do list and required reading:

To Do:

Javascript, Java & Arduino Tutorials & Prototypes

  • IR Sensor Arrays
  • Interconnection of Arduino with Processing

Processing Tutorials & Prototypes

  • Build functional version using simple geometry.
  • Creating vector shapes in processing via interpolation of points.

Projection Mapping with Quartz Composer & tests with a projector.

Reading List:

The mind in the cave : consciousness and the origins of art: David Lewis-Williams
Inside the Neolithic Mind: Consciousness, Cosmos and the Realm of the Gods: David Lewis-Williams, David Pearce
The Shamans of Prehistory: Trance and Magic in the Painted Caves: Jean Clottes, David Lewis-Williams, Sophie Hawkes
The Hero With a Thousand Faces: Joseph Campbell
Myths to Live By: Joseph Campbell
Primitive Mythology (The Masks of God): Joseph Campbell

Confluence of Experiences

Experiential Design, Interaction Design, Interactive, Planning, Theory, Thesis

In thinking further about my thesis, I have taken a step back, and have been doing a lot of thinking about the nature of the project. From the start, I have wanted this project to be about expanding the definition of Interaction Design and Experiential Design.

To me, these ideas have been limited by the creativity of designers and artists. For the most part, they have existed solely to display technology and advancements. It is akin to tricks of a street corner magician. Entertaining for a moment, but rather unmemorable and having no lasting impact.

I started to look at the various aspects that will be brought in and have an affect upon the Monomyth as an experience. I divided them into the loose and broad categories of Art / Design / Architecture, Computer Programming, Social & Psychological, and Education. In the accompanying diagram to this post, I have begun to analyze the interaction between these various components, and list some concrete examples of how they manifest in experiences.

At the center of this confluence is The Monomyth. The experience of the hero journey via the interactive installation brings together all these spheres into one place. It is unlike any showing previously, as the experience is designed towards human connection.

The whole is greater than the sum of its parts.

The Hero Journey & Paleolithic Cave Painting

Cave Art, Experiential Design, Interaction Design, Planning, Thesis

A Search For Our Common Humanity

At the core of this project is a search for shared humanity through interaction design. My intent and interest is in creating interactive experiences that are genuine and authentic.

Adding social buttons to share something does not make a meaningful connection. Scrolling through a feed only skims the surface of our friend’s likes, interests and daily activities. So my wish list for a successful Thesis show would look something like this:

  1. Causes participants to interact with each other — not just the installation or software.
  2. Forces participants to be in the present moment and have a shared experience of our innate natures.
  3. To allow participants to play and learn from one another.
  4. To awaken participants to the experience of being present, reflecting on their own lives, and witness the power of the hero journey in their own lives.

Of course, it goes without saying that I want everything to be perfect — no computer or network glitches, etc. etc. etc. But that’s another list for another blog post.

As I began to delve deeper into Joseph Campbell’s Monomyth theories and explore his writings, I have come to understand that his ideas transcend time, and are universally found in all human cultures. The ideas, concepts, and even some of the stories are typically universal in their basis. They are often found with subtle variations in local color, cultural ideas / importances, or language, however the general themes, plotlines, and stories of the hero myth are almost always universal.

This is the central point that intrigued Campbell. It is clear that he studied Eastern and Western cultures in great detail  — drawing comparisons and contrasts of various universal human stories of creation, parenting, loss, death, success, work, transition and transcendence.  One area that Cambell returned to over and over is Paleolithic art.

Paleolithic Cave Painting

The earliest known caves are found in modern day France, Spain, Italy and Germany. Paleolithic humans lived in semi-nomadic groups, and practiced Shamanic religions. To them, their understanding of the world was one of interconnectedness and where anything was possible. The stories of the famous caves of Altamira (Spain), Lascaux (France), Niaux (France) from the late 19th and early 20th Century have gained a history of their own. Established archaeologists scoffed at the idea of these Prehistoric paintings and for many years ridiculed those who supported the idea and refused to even view them. Established academia believed the paintings and artifacts to be forgeries or badly scrawled graffiti done by charlatans looking to make money and sell admission to the caves.

Eventually, when the preeminent French archeologist Émile Cartailhac reluctantly viewed the caves at Altamira, Spain and saw the calcifications and concretions (which can only take many thousands of years) covered some of the artwork, he recanting and understood the impact of these great discoveries. (Curtis, Gregory. The Cave Painters: Probing the Mysteries of the World’s First Artists. 1st ed., New York: Anchor Books, 2007.)

As I read and study more about Paleolithic cave art, I understand that there are many different theories regarding their importance. During the 20th Century, the common consensus has been that the caves were used for magico-religious practices, and for certain, there are remnants of this. However, in his book, The Nature of Paleolithic Art, R. Dale Guthrie argues that to only view the artwork in this light has not only, “resulted in a derailment of rock art research, but at its worst has presented early peoples in a distorted light as superstitious dolts totally preoccupied with mystical concerns.”

Guthrie goes on to point out that Paleolithic art goes beyond this and had a much deeper meaning to Paleolithic humans. Theirs was the art of the everyday. It shows a direct connection to their physical world, and provides an invaluable record of Paleolithic natural history. It is only when one begins to draw these same animals (unsuccessfully, as I have done) that you realize the level of skill, practice and training that the most exceptional of these artists must have had. When studied in detail, we can see that many of the artists often understood concepts like scale, proportion, volume, lighting and shading. There is a sophisticated understanding of animal anatomy that goes beyond mere observation. It clear that as a result of their hunting culture, the Eurasian Paleolithic artists understood anatomy to a great degree. To draw cows, bulls, lions, and horses with this skill required getting up close to these dangerous wild animals — only possible after a successful hunt.

Thesis Ideas

So, with this in mind, I now have a much clearer basis for my Thesis project. This will be to create a built interactive environment using Paleolithic cave art to take the participants on a a hero journey.

Using projection mapping, the images will be projected onto constructed wall surfaces. This will provide them with a similar experience as visiting a cave. Part of the interactive experience will be to have the images move at various points, triggered by events like sounds or movement from the participants. Participants will be able to leave their handprints for others to see.

As I delve deeper into this project, I realize that there is always more that I need to know and understand in order to make this a success.

Typography Today and its Roles

Planning, Thesis

I spent this week investigating and creating a typographic pallette for the exhibition, web, and print. I have often heard the analogy that good typography should be like a crystal goblet — merely holding the contents by giving them shape and form without distortions, and how Helvetica was the ultimate incarnation of this concept.

Is that all typography needs to do? How quaint.

Typography along with its function and usage is undergoing a dramatic metamorphosis due to (of course) the Internet and more recently smaller screen sizes for mobile devices.

Today, users do not read — they scan. The average web page only has about 3 seconds to capture a user’s attention before they move on to search for something of greater interest or more closely matching their search requirements.

It is therefore of utmost importance for a focus on visual clarity, interest and conveying the most important information in a concise manner. So it’s time for typography (and designers) to put their backs into it, because there’s some heavy lifting that needs to be done, and quickly.

It is no longer enough for typography to just sit there. It is also no good for typography to just be pretty or unique. It is now of utmost importance that the most applicable typefaces are chosen for the right purpose.

The Internet has, in effect, upped the ante. It is now crucial for design planning to be as close to perfect as possible. Errors, miscalculations, and bad taste lose eyeballs very quickly. It does no good to either bore users with trite typographics conventions or hit them across the face with the baseball bat of Gotham (over and over and over and over…).

OK, so this is me getting down off my soapbox now.

Typography and The Monomyth Experience

For “The Monomyth Experience” (as I have now dubbed my Thesis project), I need my typography to convey some ideas, and I think I’ve found what will suit the project’s needs.

I’m not a conventional person by any means, and since this project is as much a personal expression as anything else, I want my typography to show this as well.  The typography will need to serve as wayfinding, signage, and provide instruction and information. It will also need to view well on small and large screens as well as when projected at a large scale. That’s a pretty tall order.

Ideally, I would want the typography to help communicate the following:

  • Modern — clean & clear.
  • Technology — looking towards the future.
  • Humanity — keeping us held tight to our relationships & personal connections.

To this end, I have been trying various combinations of typefaces. Ultimately, I realized that I would need one that was robust with a lot of weights, which meant that I would have to shell out some cash. So I did – and I’m pretty happy I did.

Carnas Y Consolas

I decided on going with a typeface called Carnas and pairing it with Consolas. Carnas is a monoline sans that was designed by the German typographer Dieter Hofrichter. It is casual, but professional with a tall x-height and slender ascenders. The square shapes have a very nice thick/thin contrast without becoming boring or zipping off to the extremes of Bodoni (which I do happen to like).

Information_Signage

So this is ends first round of typography edits. I’m sure that I will come back to this later and make revisions as I get feedback. But for now, it’s a good start.

Further Developments… The Monomyth & Generative Design

generative design, Processing, Thesis

The Monomyth or Hero Story

In the development of an interactive environment with any authenticity, it becomes necessary to have a particular point of view. It is imperative for it to express my own life experience, which is not so different from the experience of all people.

One of the benefits of growing older (I will soon celebrate my 42nd year of life on planet Earth) is that you can finally have some perspective on yourself and your past — both the positive and not–so–positive. You begin to see that the tale that we were told of being unique snowflakes is only partly true. At some point, you realize that we are all not so unique and unusual at all. You begin to understand that while the cast of characters, scenery and dialogue may change from person to person, we each play out strangely familiar plot lines in our individual lives.

“The usual hero adventure begins with someone from whom something has been taken, or who feels there is something lacking in the normal experience available or permitted to the members of society. The person then takes off on a series of adventures beyond the ordinary, either to recover what has been lost or to discover some life-giving elixir. It’s usually a cycle, a coming and a returning.”

– Joseph Campbell, The Hero With A Thousand Faces

Aiding me in peeling back that layer of the onion, has been an understanding of the Monomyth (or Hero Story) by Joseph Campbell. Campbell wrote a great deal about the power of myth, and how the Hero Story is written into the most famous of fables, religions and literature. In dissecting these, Cambell explored how these timeless themes have shaped the lives of humans from the beginning of time. Campbell divided the Hero Story into 17 distinct stages which can be grouped into the phases of Departure, Initiation, and Return.

Generative Design

Generative Design is a completely new design system that utilizes modern computer languages such as Processing, vvvv, JavaScript and others to provide a framework for development of unique design systems with opportunities for multiple types of output.

In a 2012 lecture, Cedric Kiefer of onformative gave a brief overview of Generative Design — the captions are my own notes on his presentation:

Create a system to process inputs (data, sound, images, vectors, motion, video, etc) into outputs ( other data, sound, images, vectors, motion, video, etc.)

Create a system to process inputs (data, sound, images, vectors, motion, video, etc) into outputs ( other data, sound, images, vectors, motion, video, etc.)

There is no limit to the type of input you can use with a generative design system.

There is no limit to the type of input you can use with a generative design system.

Likewise, there is also no limit to the type of output produced in generative design.

Likewise, there is also no limit to the type of output produced in generative design.

It is even possible to use the output of a generative design system as an input through the system again!

It is even possible to use the output of a generative design system as an input through the system again!

In one example cited by Kiefer, using properties of physics, and data they were able to create a visualization of concept linkages.

In one example cited by Kiefer, using properties of physics, and data they were able to create a visualization of concept linkages.

They first started with programming the physics and physical properties so that the groups of concepts would "unfold" and not be blocked from view.

They first started with programming the physics and physical properties so that the groups of concepts would “unfold” and not be blocked from view.

This would create a concept tree.

This would create a concept tree.

They then were able to develop to same concept in 3D space.

They then were able to develop to same concept in 3D space.

They could then export the data for 3D rendering for other purposes such as motion graphics or film.

They could then export the data for 3D rendering for other purposes such as motion graphics or film.

The basic idea is that you can create infinite variations of designs by simply changing the inputs or the parameters of the software that will get tremendously different results from very small and simple changes. Those outputs can then be used in many different ways to examine or infer relationships, analyze and develop possibilities, draw conclusions, etc.

It is therefore at the discretion of the designer to create the design system and the manner in which information is processed and how the output is expressed.

 Incorporation Into The Thesis Project

In delving into the concept of the Monomyth, it could potentially serve as a backdrop for my thesis presentation. In creating an environment, I could potentially work to develop a “learning tool” through creation of a generative design environment. This would take a participant on a “Hero’s Journey” with accompanying stages. Through gamification, each person could work towards achieving the quest, and along the way learning small lessons, that can be put into practice at various stages of the environment.

With each phase of the game, the graphics would change and provide feedback to the participants of their progress and development. In addition, the challenges would become greater and more difficult as the game progresses.

As with all Monomyths, each individual could be on an individual quest. The lessons of which could be different from others. Ideally, I would like for all participants to understand the value of working together towards a common goal, and experiencing a sense of coming together to achieve a common goal.