Mock Objects is a moving image work which consists of a modified version of the debugging output of a popular JavaScript AR library, js-aruco. It shows the augmented reality software algorithm’s best guess of the orientation of a marker in a video scene. Since the estimated position and angle of the marker changes with each frame of the video, the image flickers from one orientation to another. The restless image is evidence of the software’s indecision about how it understands what it sees.
Viewers may be able to infer that the movement is generated from human activity, since even after processing, there is still an identifiably organic character to the motion. The piece highlights an instance of algorithmic uncertainty, making the measurement of this uncertainty a major formal component of the work. While highly visually reductive and utilitarian in appearance, the piece makes visible a process of computation that is contingent and inconclusive.
Video documentation
Documentation images
Production process
Having made the decision to explore augmented reality, the software library js-aruco seemed to generate interesting errors in its debugging screen.
Markers of various sizes were produced for testing.
Proposal process
Possible locations outside of SIA Gallery in Cantor building were located on a site visit.
Proposal for Testing Testing – 28th June 2016
This location was rejected because of equipment sourcing and H&S issues.
Proposal for Testing Testing – 5th July 2016
The second proposal relied on the rotation of the in-gallery projector, which it turned out wasn’t possible.
The final proposal located the work on a screen, mounted on the upper storey of the gallery, as shown in the mock-up below.
Plan of works for whole exhibition
Exhibition History
Testing, Testing, SIA Gallery, Sheffield, July–August 2016.