Algorithmic Serialities

I recently gave a talk with the unwieldy title “Post-Cinematic Seriality and the Algorithmic Conditions of Identity and Difference” for the Center for Inter-American Studies at the University of Graz and the Austro-American Society for Styria in Austria (see the *somewhat creepy, but appropriately so, lol* flyer below); and on October 12, 2021 (at 6:30pm Central European time / 9:30am Pacific US time) I’ll be giving a related talk with the much more wieldy (possibly misleadingly simple) title “Seriality and Digital Cultures” at the University of Zurich’s English Department (see the flyer with registration info above).

Both of these talks are related to a larger project that I am developing, which will link seriality as a medial form (in both popular and artistic media) and as a social form (following the late Sartre, Iris Marion Young, Benedict Anderson, and others) in order to think about the ways that — with the shift from a broadly “cinematic” media regime (with its past-oriented, memorial, recording, retentional functions) to a “post-cinematic” one (with its future-oriented, anticipatory, predictive, protentional functions) — algorithmic media are poised to transform categories and lived realities of class, gender, and race.

On the Embodied Phenomenology of DeepFakes — Full Text of Talk from #SLSA21

DeepFake videos pose significant challenges to conventional modes of viewing. Indeed, the use of machine learning algorithms in these videos’ production complicates not only traditional forms of moving-image media but also deeply anchored phenomenological categories and structures. By paying close attention to the exchange of energies around these videos, including the consumption of energy in their production but especially the investment of energy on the part of the viewer struggling to discern the provenance and veracity of such images, we discover a mode of viewing that both recalls pre-cinematic forms of fascination while relocating them in a decisively post-cinematic field. The human perceiver no longer stands clearly opposite the image object but instead interfaces with the spectacle at a pre-subjective level that approximates the nonhuman processing of visual information known as machine vision. While the depth referenced in the name “deep fake” is that of “deep learning,” the aesthetic engagement with these videos implicates an intervention in the depths of embodied sensibility—at the level of what Merleau-Ponty referred to as the “inner diaphragm” that precedes stimulus and response or the distinction of subject and intentional object. While the overt visual thematics of these videos is often highly gendered (their most prominent examples being so-called “involuntary synthetic pornography” targeting mostly women), viewers are also subject to affective syntheses and pre-subjective blurrings that, beyond the level of representation, open their bodies to fleshly “ungenderings” (Hortense Spillers) and re-typifications with far-reaching consequences for both race and gender.

Let me try to demonstrate these claims. To begin with, DeepFake videos are a species of what I have called discorrelated images, in that they trade crucially on the incommensurable scales and temporalities of computational processing, which altogether defies capture as the object of human perception (or the “fundamental correlation between noesis and noema,” as Hussserl puts it). To be sure, DeepFakes, like many other forms of discorrelated images, still present something to us that is recognizable as an image. But in them, perception has become something of a by-product, a precipitate form or supplement to the invisible operations that occur in and through them. We can get a glimpse of such discorrelation by noticing how such images fail to conform or settle into stable forms or patterns, how they resist their own condensation into integral perceptual objects—for example, the way that they blur figure/ground distinctions.

The article widely credited with making the DeepFake phenomenon known to wider public in December 2017 notes with regard to a fake porn video featuring Gal Gadot: “a box occasionally appeared around her face where the original image peeks through, and her mouth and eyes don’t quite line up to the words the actress is saying—but if you squint a little and suspend your belief, it might as well be Gadot.” There’s something telling about the formulation, which hinges the success of the DeepFake not on the suspension of disbelief—a suppression of active resistance—but on the suspension of belief—seemingly, a more casual form of affirmation—whereby the flickering reversals of figure and ground, or of subject and object, are flattened out into a smooth indifference.

In this regard, DeepFake videos are worth comparing to another type of discorrelated image: the digital lens flare, which is both to-be-looked-at (as a virtuosic display of technical achievement) and to-be-overlooked (after all, the height of their technical achievement is reached when they can appear as transparently naturalized simulations of a physical camera’s optical properties). The tension between opacity and transparency, or objecthood and invisibility, is never fully resolved, thus undermining a clear distinction between diegetic and medial or material levels of reality. Is the virtual camera that registers the simulated lens flare to be seen as part of the world represented on screen, or as part of the machinery responsible for revealing it to us? The answer, it seems, must be both. And in this, such images embody something like what Neil Harris termed the “operational aesthetic” that characterized nineteenth-century science and technology expos, magic shows, and early cinema alike; in these contexts, spectatorial attention oscillated between the surface phenomenon, the visual spectacle of a machine or a magician in motion, and the hidden operations that made the spectacle possible.

It was such a dual or split attention that powered early film as a “cinema of attractions,” where viewers came to see the Cinematographe in action, as much as or more than they came to see images of workers leaving the factory or a train arriving at the station. And it is in light of this operational aesthetic that spectators found themselves focusing on the wind rustling in the trees or the waves lapping at the rocks—phenomena supposedly marginal to the main objects of visual interest.

DeepFakes also trade essentially on an operational aesthetic, or a dispersal of attention between visual surface and the algorithmic operation of machine learning. However, I would argue that the post-cinematic processes to whose operation DeepFakes refer our attention fundamentally transform the operational aesthetic, relocating it from the oscillations of attention that we see in the cinema to a deep, pre-attentional level that computation taps into with its microtemporal speed.

Consider the way digital glitches undo figure/ground distinctions. Whereas the cinematic image offered viewers opportunities to shift their attention from one figure to another and from these figures to the ground of the screen and projector enabling them, the digital glitch refuses to settle into the role either of figure or of ground. It is, simply, both—it stands out, figurally, as the pixely appearance of the substratal ground itself. Even more fundamentally, though, it points to the inadequacy, which is not to say dispensibility, of human perception and attention with respect to algorithmic processing. While the glitch’s visual appearance effects a deformation of the spatial categories of figure and ground, it does so on the basis of a temporal mismatch between human perception and algorithmic processing. The latter, operating at a scale measured in nanoseconds, by far outstrips the window of perception and subjectivity, so that by the time the subject shows up to perceive the glitch, the “object” (so to speak) has already acted upon our presubjective sensibilities and moved on. This is why glitches, compression artifacts, and other discorrelated images are not even bound to appear to us as visual phenomena in the first place in order to exert a material force on us. Another way to account for this is to say that the visually-subjectively delineated distinction between figure and ground itself depends on the deeper ground of presubjective embodiment, and it is the latter that defines for us our spatial situations and temporal potentialities. DeepFakes, like other discorrelated images, are able to dis-integrate coherent spatial forms so radically because they undercut the temporal window within which visual perception occurs. The operation at the heart of their operational aesthetic is itself an operationalization of the flesh, prior to its delineation into subjective and objective forms of corporeality. The seamfulness of DeepFakes—their occasional glitchy appearance or just the threat or presentiment that they might announce themselves as such—points to our fleshly imbrication with technical images today, which is to say: to the recoding not only of aesthetic form but of embodied aesthesis itself. 

In other words: especially and as long as they still routinely fail to cohere as seamless suturings of viewing subjects together with visible objects, but instead retain their potential to fall apart at the seams and thus still require a suspension of belief, DeepFake videos are capable of calling attention to the ways that attention itself is bypassed, providing aesthetic form to the substratal interface between contemporary technics and embodied aesthesis. To be clear, and lest there be any mistake about it, I in no way wish to celebrate DeepFakes as a liberating media-technology, the way that the disruption of narrative by cinematic self-reflexivity was sometimes celebrated as opening a space where structuring ideologies gave way to an experience of materiality and the dissolution of the subject positions inscribed and interpellated by the apparatus. No amount of glitchy seamfulness will undo the gendered violence inflicted, mostly upon women, in involuntary synthetic pornography. Not only that, but the pleasure taken by viewers in their consumption of this violence seems to depend, at least in part, precisely on the failure or incompleteness of the spectacle: what such viewers desire is not to be tricked into actually believing that it is Gal Gadot or their ex-girlfriend that they are seeing on the screen, but precisely that it is a fake likeness or simulation, still open to glitches, upon which the operational aesthetic depends. Nevertheless, we should not look away from the paradoxical opening signaled by these viewers’ suspension of belief. The fact that they have to “squint a little” to complete the gendered fantasy of domination also means that they have to compromise, at least to a certain degree or for a short duration, their subjective mastery of the visual object, that they have to abdicate their own subjective ownership of their bodies as the bearers of experience. Though it is hard to believe that any trace of conscious awareness of it remains, much less that viewers will be reformed as a result of the experience, it seems reasonable to believe that viewers of DeepFake videos must experience at least an inkling of their own undoing as their de-subjectivized vision interfaces with the ahuman operation of machine vision. 

What I am saying, then, and I am trying to be careful about how I say it, is that DeepFake videos open the door, experientially, to a highly problematic space in which our predictive technologies participate in processes of subjectivation by outpacing the subject, anticipating the subject, and intervening materially in the pre-personal realm of the flesh, out of which subjectivized and socially “typified” bodies emerge. The late Sartre, writing in the Critique of Dialectical Reason, defined commodities and the built environment in terms of the “practico-inert,” in light of the ways that “worked matter” stored past human praxis but condensed it into inert physical form. Around these objects, increasingly standardized through industrial capitalism’s serialized production processes, are arrayed alienated and impotent social collectives of interchangeable, fungible subjects. Compellingly, feminist philosopher Iris Marion Young takes Sartre’s argument as the basis for rethinking gender as a non-essentialist formation, a nascent collectivity, that is imposed on bodies materially—through architecture, clothing, and gender-specific objects that serve to enforce patriarchy and heterosexism. The practico-inert, in other words, participated in the gendered typification of the body—and we could extend the argument to racialization processes as well. But the computational infrastructures of today’s built environment are no longer adequately captured by the concept of the practico-inert. These infrastructures and objects are still the products of praxis, but they are far from inert. In their predictive and interactive operations, they are better thought of under the concept of the practico-alert—they are highly active, always on alert, and like the viewers of DeepFake videos on the lookout for a telling glitch, so are we ever and exhaustingly on the alert. In these circuits, which are located deeper than subjective attention, the standardization and typification processes I just mentioned are more fine-grained, more “personalized” or targeted, operating directly on the presubjective flesh. In this sense, the flattening of subjectivity, the suspension of belief and depersonalization of vision in DeepFake videos, points towards the contemporary “ungendering” of the flesh, as Hortense Spillers calls it in a different context, that marks a preliminary step in the computational intensification of racialized and gendered subjectivization. This is a truly insidious aesthetics of the flesh.Sartre and practico-inert — updated to practico-alert; cf. gender via Iris Marion Young: typification (or serialization) via practico-inert. Now a more direct, because immeasurably fast, operation on presubjective flesh.

Media Philosophy in the Flesh — talk in Stanford German Studies Lecture Series

Next Tuesday, October 5, 2021 (12pm Pacific), I will be giving a talk in Stanford’s German Studies Lecture Series titled “Media Philosophy in the Flesh.” See here for more information and Zoom registration.

Interview about Discorrelated Images with Roger Whitson and Christian Haines (Gamers with Glasses podcast)

A couple of weeks ago, I was interviewed by Roger Whitson and Christian Haines for the Gamers with Glasses podcast. I don’t wear glasses, and I’m honestly not much of a gamer these days, but we still found lots of things to talk about, like:

what the Transformers movies might teach us about philosophy, how streaming has transformed how we literally see things, the appeal of vinyl records, and how Netflix and Hulu might just be responsible for the end of the world!

We also talked a little about my book Discorrelated Images (which is currently 50% off during Duke University Press’s Fall Sale with code FALL21). Check it out!

Out Now: Gaming and the “Parergodic” Work of Seriality in Interactive Digital Environments

Recently, at long last, the 2020 edition of Eludamos: Journal for Computer Game Culture, a special issue “On the Philosophy of Computer Games,” came out — followed immediately by the 2021 issue, so you might have missed it!

Included, among other things, is my article “Gaming and the ‘Parergodic’ Work of Seriality in Interactive Digital Environments,” which begins the work of reading seriality in a double register, as both a medial and a social phenomenon (following Sartre’s late work in the Critique of Dialectical Reason, among others).

Be sure also to check out Doug Stark’s excellent “Training for the Military? Some Historical Considerations Towards a Media Philosophical Computer Game Philosophy”!

Post-Cinematic Animation

Today I presented a short paper on “Post-Cinematic Animation” as part of a roundtable discussion at the Society for Animation Studies. The roundtable, on “Expanded Animation,” was organized by Deborah Levitt and Phillip Thurtle, and also included Heather Warren-Crow, Misha Mihailova, and Thomas Lamarre—all of whom gave excellent papers. Here’s mine:

My recent book Discorrelated Images (Duke UP 2020) is not first and foremost intended as an intervention in the field of animation studies. Rather, it is an attempt to bring together some of the primarily aesthetic concerns of cinema studies and visual culture more generally with media philosophical and media archaeological interests in the invisible, or anaesthetic if not positively anti-aesthetic, dimensions of technical infrastructures in order to understand how, on the one hand, images have become unyoked from subjective perception and how, on the other hand, this post-phenomenological “discorrelation” opens new avenues of political control and subjectivation. In short, algorithmic images are processed in microtemporal intervals that elude the window of subjective perception; operating faster than us, they thus not only exceed perceptual objecthood but also anticipate our subjectivities; with their predictive or protentional, future-oriented operations, such images mark a significant departure from the past-based recording paradigm of a cinematic media regime, such that post-cinematic media become potent agencies or vectors that lead the way in shaping who we will be; and they do this by operating at or on the cusp between the visible and the invisible, the subjective and the pre-subjective, the aesthetic and the insensible. 

But if, as I have said, this argument is not primarily framed in terms of animation studies, it necessarily implicates animation as both a thematic and a medial site of change. In a thread that runs through the book, the question of animation becomes a question precisely of the difference between cinema and post-cinema, one that resonates, in many ways, with Lev Manovich’s argument in the mid-1990s that the postindexical images of “digital cinema” are closer in spirit (and, in some respects, closer materially) to pre-cinematic technologies of animation—phenakistiscopes, thaumatropes, zoetropes, and the like—than to cinema in its classical form. Beyond formal and technical dimensions, I am interested in the philosophical implications, such as those foregrounded by Alan Cholodenko who, writing even earlier than Manovich, argued that “the idea of animation” should be approached “as a notion whose purchase would be transdisciplinary, transinstitutional, implicating the most profound, complex and challenging questions of our culture, questions in the areas of being and becoming, time, space, motion, change—indeed, life itself.” My approach to animation, as the locus of a media-historical transformation that also concerns a reconfiguration of subjectivation’s material parameters, therefore mediates between Manovich’s technical focus and Cholodenko’s philosophical one. I therefore follow Deborah Levitt in her recent probing of animation as “the dominant medium of our time”—by which she refers not to a specific technique but to a broad cultural and sociotechnical condition, which is related as much to moving-image technologies as to biomedical ones (from “novel developments in the biological sciences that open possibilities for producing living beings” to antidepressants and hormone therapy for transgender people); for Levitt, in short, ours is “the age of the animatic apparatus.” 

Two other recent theoretical interventions, by Esther Leslie and Joel McKim (writing in a special issue of Animation) and Jim Hodge (in his book Sensations of History: Animation and New Media Art), both suggest that animation mediates between human sense and the insensible processes of computation—a suggestion that helps ground the interrelation of concrete changes in media infrastructure and the forms of subjectivity that they subtend. For example, processes like motion smoothing, in which our so-called “smart TVs” algorithmically compute new images between visible frames and engage in a real-time generative tweening operation, or DeepFake and related AI-driven imaging processes that categorically elude perception in their black boxed operation—such acts of animation in its computationally expanded field activate what Merleau-Ponty referred to as the “inner diaphragm” between subjectivity and objectivity, which, “prior to stimuli and sensory contents, […] determines, infinitely more than they do, what our reflexes and perceptions will be able to aim at in the world, the area of our possible operations, the scope of our life.” That is, algorithmic animation is situated between embodied sensation and the circuits of computational processing, and it thus sets such a pre-subjective and likewise pre-objective membrane in motion, fundamentally recomputing what counts as an image and what our relation to it is. If this means that what Husserl called “the fundamental correlation between noesis and noema,” or the relational bond between perceptual consciousness and its intentional objects, is called into question by computational processes, then animation’s central role as mediator ensures that such discorrelation is not the end but the reinvigoration of embodied sensation—indeed, a redefinition of life itself in the contemporary world.

References:

Cholodenko, Alan. “Introduction.” In The Illusion of Life, edited by Alan Cholodenko, 9-36. Sydney: Power Publications, 1991.

Denson, Shane. Discorrelated Images. Durham: Duke University Press, 2020.

Hodge, James J. Sensations of History: Animation and New Media Art. Minneapolis: University of Minnesota Press, 2019.

Husserl, Edmund. The Phenomenology of Internal Time Consciousness. Translated by James Churchill. Bloomington: Indiana University Press, 1964.

Leslie, Esther, and Joel McKim. “Life Remade: Critical Animation in the Digital Age.” Animation 12.3 (2017): 207-213.

Levitt, Deborah. The Animatic Apparatus: Animation, Vitality, and the Futures of the Image. Winchester, UK: Zero Books, 2018.

Manovich, Lev. “What Is Digital Cinema?” In Post-Cinema: Theorizing 21st-Century Film, edited by Shane Denson and Julia Leyda, 20-50. Falmer, UK: REFRAME Books, 2016.

Merleau-Ponty, Maurice. Phenomenology of Perception. Translated by Colin Smith. New York: Routledge, 2002. 

Gender, Seriality, Mediality

I have had the good fortune to be a Faculty Research Fellow at the Clayman Institute for Gender Research over the past academic year, which has given me an opportunity to work on a new project that thinks about serialization in digital cultures as a vector of change. The larger project takes off from Sartre’s concept of “seriality” (as developed in his late Critique of Dialectical Reason) and connects it to forms of serialized media in order to think about reconfigurations of class, gender, and race. Back in March, I presented some of the work pertaining to gender and embodiment to my colleagues at the Clayman, and they have now posted a short write-up about it. Here’s the (controversial) crux:

Also enjoy this image that I used to illustrate my talk!

Video: “Post-Cinematic Bodies” (Mercator Lecture, Goethe-Universität Frankfurt)

The video of my Mercator Lecture for the Configurations of Film Graduiertenkolleg at the Goethe-Universität Frankfurt, “Post-Cinematic Bodies” (from November 23, 2020), is now online. Hope you enjoy!

Discorrelation, or: Images between Algorithms and Aesthetics — Nov. 3 at CESTA

On November 3 (12pm Pacific), I’ll be giving a talk, via Zoom, titled “Discorrelation, or: Images between Algorithms and Aesthetics” at Stanford’s Center for Spatial and Textual Analysis (CESTA). The talk will focus on my book Discorrelated Images, just out from Duke University Press (and 50% off right with code FALL2020).

In case you’re wondering, this is a different “book talk” than anything you might have seen recently, so check it out if you can! (Though I am told that there is something else going on on November 3rd, so only tune in if you’ve already voted!)

See here for more information and registration!

Complete Video of Rendered Worlds: New Regimes of Imaging

Here is the complete video of the event Rendered Worlds: New Regimes of Imaging from October 23, 2020. Featuring Deborah Levitt (The New School), Ranjodh Singh Dhaliwal (UC Davis and Universität Siegen), Bernard Dionysius Geoghegan (King’s College London), and Shane Denson (Stanford) discussing their recent work, with Hank Gerba (Stanford) and Jacob Hagelberg (UC Davis) co-moderating the round-table.

Sponsored by the Linda Randall Meier workshop on Digital Aesthetics (Stanford) and the Technocultural Futures Research Cluster (UC Davis), with support from the Mellon Foundation and the National Endowment for the Humanities.