Creative Convergence: The AI Renaissance in Art and Design (Springer Series on Cultural Computing) 3031451260, 9783031451263

Table of contents :
Acknowledgments
Contents
About the Authors
List of Figures
List of Tables
1 Introduction: Embracing the AI Renaissance in Art and Design
1.1 Art, Technology, and the AI Revolution
1.2 Reshaping the Art World
1.3 Redefining Creativity
References
2 Of Techne and Praxis: Redefining Creativity
2.1 The Evolving Relationship Between Artists and AI
2.1.1 The Limits of Creativity
2.2 Exploring Aesthetics in AI Art: Existing Theories and Provoking New Thought
2.3 Ethics, Authorship, and Social Implications
2.3.1 Copyright and Ownership
References
3 Painting by Numbers: A Brief History of Art and Technology
3.1 The Art of Disruption
3.1.1 Redefining Art: The Dawn of Modernity
3.2 From Gutenberg to the Masses: Printmaking and the Printing Press
3.3 Photography: The Democratization of Representation
3.4 Digital Art and the Rise of the Machines
3.5 Reflecting Humanity: Artificial Intelligence in Art
References
4 Pedagogical Paradigm Shift: Reimagining Art and Design Education
4.1 Word and Image Unbound: Rethinking Tradition
4.2 From Technique to Concept: The New Curriculum
4.3 Integrating AI in the Classroom
References
5 Expanding Horizons: AI Tools and Workflows in Art Practice
5.1 The Augmented Artistic Process: AI-Driven Workflows and Expanded Creativity
5.2 Exploring AI-Driven Art Tools
5.2.1 DALL-E 2
References
6 Case Studies: AI in Action in Art and Design
6.1 Case Studies in AI Integration Across Art and Design Disciplines
6.2 3D Design Fundamentals: Sculpting the Future
6.3 Drawing: The Fine (AI) Line Between Tradition and Innovation
6.4 Digital Art: Pixels, Patterns, and AI Paintbrushes
References
7 Case Studies: Redefining Web Design and Co-creation
7.1 Web Design and AI: A Perfect Partnership
7.2 Generating a Signature Style: AI as Co-creator
References
8 Conclusion: Future Perspectives—Embracing the AI Renaissance
8.1 Navigating the Brave New World of AI and Art
8.1.1 The Enduring Nature of Human Creativity
8.2 The Role of Artists and Designers in an AI-Driven Society
8.2.1 The AI Renaissance and Beyond
References

Citation preview

Springer Series on Cultural Computing

James Hutson · Jason Lively · Bryan Robertson · Peter Cotroneo · Martin Lang 

Creative Convergence The AI Renaissance in Art and Design

Springer Series on Cultural Computing Founding Editor Ernest Edmonds

Series Editor Craig Vear, University of Nottingham, Nottingham, UK Editorial Board Paul Brown, University of Sussex, Brighton, UK Nick Bryan-Kinns, Queen Mary University of London, London, UK Sam Ferguson, University of Technology, Sydney, Australia Brona˙c Ferran, Birkbeck, University of London, London, UK Nicholas Lambert, Ravensbourne, London, UK Ellen Yi-Luen Do , University of Colorado Boulder, Boulder, CO, USA Sean Clark, De Montfort University, Leicester, UK Nelson Zagalo , Department of Communication & Arts, University of Aveiro, Aveiro, Portugal Matthias Rauterberg, Eindhoven University of Technology, Eindhoven, The Netherlands Deborah Turnbull Tillman, F219C - UNSW Art & Design, Paddington, NSW, Australia Jocelyn Spence, Mixed Reality Laboratory, University of Nottingham, Nottingham, UK

Cultural Computing is an exciting, emerging field of Human Computer Interaction, which covers the cultural impact of computing and the technological influences and requirements for the support of cultural innovation. Using support technologies such as artificial intelligence, machine learning, location-based systems, mixed/virtual/ augmented reality, cloud computing, pervasive technologies and human-data interaction, researchers can explore the differences across a variety of cultures and cultural production to provide the knowledge and skills necessary to overcome cultural issues and expand human creativity. This series presents monographs, edited collections and advanced textbooks on the current research and knowledge of a broad range of topics including creativity support systems, creative computing, digital communities, the interactive arts, cultural heritage, digital culture and intercultural collaboration. This Series is abstracted/indexed in Scopus.

James Hutson · Jason Lively · Bryan Robertson · Peter Cotroneo · Martin Lang

Creative Convergence The AI Renaissance in Art and Design

James Hutson Department of Art History and Visual Culture Lindenwood University St. Charles, NY, USA Bryan Robertson Department of Visual Art Yavapai College Prescott, AZ, USA

Jason Lively Department of Art and Design Lindenwood University St. Charles, MO, USA Peter Cotroneo Department of Art and Design The University of Tampa Tampa, AZ, USA

Martin Lang Chair of the Studio Art Program, Department of Art Columbia College Columbia, SC, USA

ISSN 2195-9056 ISSN 2195-9064 (electronic) Springer Series on Cultural Computing ISBN 978-3-031-45126-3 ISBN 978-3-031-45127-0 (eBook) https://doi.org/10.1007/978-3-031-45127-0 © The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG 2024 This work is subject to copyright. All rights are solely and exclusively licensed by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed. The use of general descriptive names, registered names, trademarks, service marks, etc. in this publication does not imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use. The publisher, the authors, and the editors are safe to assume that the advice and information in this book are believed to be true and accurate at the date of publication. Neither the publisher nor the authors or the editors give a warranty, expressed or implied, with respect to the material contained herein or for any errors or omissions that may have been made. The publisher remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. This Springer imprint is published by the registered company Springer Nature Switzerland AG The registered company address is: Gewerbestrasse 11, 6330 Cham, Switzerland Paper in this product is recyclable.

This manuscript is dedicated to our families, whose unwavering support and encouragement have been the cornerstone of our journey. To our parents, we express deep gratitude for instilling in us a thirst for knowledge and the determination to pursue our passions. Your belief in our abilities and unwavering support have propelled us forward. To our spouses and partners, we extend heartfelt appreciation for standing by our side throughout the long hours of research and writing. To our children, we are grateful for your inspiration and the joy you bring to our lives. Your presence reminds us of the importance of our work and motivates us to strive for excellence. To our extended families, friends, and loved ones, we thank you for your encouragement, words of wisdom, and unwavering belief in our abilities. In particular, Peter Cotroneo would like to thank his wife, Taylor. Martin Lang would like to thank his wife, Rebecca. James Hutson would like to thank his wife, Piper, and children, Bishop and Aurora, and his father,

Jim Hutson, who introduced him to art. Bryan Robertson would like to thank his mother, Cathleen Robertson, father, David Robertson, wife, Elizabeth Robertson, sons, Hunter and Henry Robertson, and daughter, Heidi Robertson. Jason Lively would like to thank his wife, Dawn Lively, his daughters, Shandi, Elizabeth, Sara, Emma, and Zadi, his parents, Sharon and Gerald Lively, and finally, his uncle and mentor, Randy Thomas. Your patience, understanding, and unwavering support have been invaluable. Your support has been a source of strength and inspiration. We acknowledge the sacrifices you have made and the understanding you have shown, allowing us the time and space to pursue our scholarly endeavors. This manuscript stands as a testament to your love and support. With deepest appreciation and heartfelt gratitude, we dedicate this work to our families.

Acknowledgments

We would like to extend our sincere gratitude to the individuals and institutions who have contributed to the creation of this book and supported us throughout this journey. First and foremost, we would like to thank Dr. Katherine Herrell for her pioneering efforts in piloting the decentered collaborative interdisciplinary author model alongside Dr. James Hutson during the challenging times of the COVID-19 pandemic in 2020. Her innovative approach and unwavering dedication to collaboration have greatly influenced the development of this work. We are immensely grateful to Dr. Kathi Vosevich, Dean of the College of Arts and Humanities, for her unwavering support and encouragement for the research that has culminated in this text. Her guidance and belief in our scholarly pursuits have been instrumental in shaping this book. Along with the research team who wrote this manuscript, we would also like to thank the following colleagues and co-authors on other projects that provided invaluable insight and work that directly and indirectly contributed to this volume. James Hutson would like to thank Profs. Ben Fulcher, Jeremiah Ratican, Joe Weber, Ben Scholle, and Dr. Trent Olsen, as well as MFA student Morgan Harper-Nichols. Peter Cotroneo would like to thank his colleagues Ry McCullough and Emily Bivens. Martin Lang would like to thank his colleague Toluope Filani. Bryan Robertson would like to thank his mentors Phillip Robinson, David Brody, Zhi Lin, Paul LaJeunesse, Nicholas Nihira, and Kathryn Nahorski. Jason Lively would like to thank his colleagues Dr. James Hutson and Dr. Les Plagens. We would also like to express our deep appreciation to the administrative leadership at Yavapai College and South Carolina State University for their unwavering support and commitment to fostering a conducive environment for academic excellence and scholarly pursuits. The guidance and resources provided by the leadership teams at both institutions, including the Presidents, Provosts, and Deans, have played a crucial role in enabling us to undertake this research and writing endeavor. Additionally, we would like to acknowledge the faculty and staff at Yavapai College and South Carolina State University for their valuable contributions to our intellectual growth and development. Their expertise, mentorship, and commitment to excellence have had a profound impact on our academic journey. vii

viii

Acknowledgments

We are also grateful to our colleagues and fellow researchers who have shared their insights and provided constructive feedback throughout the course of this project. Their contributions have enriched our work and helped shape the ideas presented in this book.

Contents

1 Introduction: Embracing the AI Renaissance in Art and Design . . . . 1.1 Art, Technology, and the AI Revolution . . . . . . . . . . . . . . . . . . . . . . . . 1.2 Reshaping the Art World . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.3 Redefining Creativity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

1 1 7 15 18

2 Of Techne and Praxis: Redefining Creativity . . . . . . . . . . . . . . . . . . . . . . 2.1 The Evolving Relationship Between Artists and AI . . . . . . . . . . . . . . 2.1.1 The Limits of Creativity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2.2 Exploring Aesthetics in AI Art: Existing Theories and Provoking New Thought . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2.3 Ethics, Authorship, and Social Implications . . . . . . . . . . . . . . . . . . . . 2.3.1 Copyright and Ownership . . . . . . . . . . . . . . . . . . . . . . . . . . . . . References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

21 21 22

3 Painting by Numbers: A Brief History of Art and Technology . . . . . . 3.1 The Art of Disruption . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.1.1 Redefining Art: The Dawn of Modernity . . . . . . . . . . . . . . . . 3.2 From Gutenberg to the Masses: Printmaking and the Printing Press . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3.3 Photography: The Democratization of Representation . . . . . . . . . . . . 3.4 Digital Art and the Rise of the Machines . . . . . . . . . . . . . . . . . . . . . . . 3.5 Reflecting Humanity: Artificial Intelligence in Art . . . . . . . . . . . . . . . References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

37 37 38

4 Pedagogical Paradigm Shift: Reimagining Art and Design Education . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.1 Word and Image Unbound: Rethinking Tradition . . . . . . . . . . . . . . . . 4.2 From Technique to Concept: The New Curriculum . . . . . . . . . . . . . . 4.3 Integrating AI in the Classroom . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

27 30 31 34

53 65 73 77 81 87 87 90 95 99

ix

x

Contents

5 Expanding Horizons: AI Tools and Workflows in Art Practice . . . . . . 5.1 The Augmented Artistic Process: AI-Driven Workflows and Expanded Creativity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5.2 Exploring AI-Driven Art Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5.2.1 DALL-E 2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

101

6 Case Studies: AI in Action in Art and Design . . . . . . . . . . . . . . . . . . . . . 6.1 Case Studies in AI Integration Across Art and Design Disciplines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.2 3D Design Fundamentals: Sculpting the Future . . . . . . . . . . . . . . . . . 6.3 Drawing: The Fine (AI) Line Between Tradition and Innovation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6.4 Digital Art: Pixels, Patterns, and AI Paintbrushes . . . . . . . . . . . . . . . . References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

133

7 Case Studies: Redefining Web Design and Co-creation . . . . . . . . . . . . . 7.1 Web Design and AI: A Perfect Partnership . . . . . . . . . . . . . . . . . . . . . 7.2 Generating a Signature Style: AI as Co-creator . . . . . . . . . . . . . . . . . References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

197 197 217 223

8 Conclusion: Future Perspectives—Embracing the AI Renaissance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8.1 Navigating the Brave New World of AI and Art . . . . . . . . . . . . . . . . . 8.1.1 The Enduring Nature of Human Creativity . . . . . . . . . . . . . . . 8.2 The Role of Artists and Designers in an AI-Driven Society . . . . . . . 8.2.1 The AI Renaissance and Beyond . . . . . . . . . . . . . . . . . . . . . . . References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

225 225 227 233 234 235

101 110 112 130

133 134 142 150 194

About the Authors

James Hutson is an administrator and researcher in higher education specializing in artificial intelligence, neurodiversity, immersive realities, digital humanities, and gamification of education. He received his B.A. in Art from the University of Tulsa, M.A. in Art History from Southern Methodist University, and his Ph.D. in Art History from the University of Maryland, College Park. He has also received his M.A. in Leadership and M.A. in Game Design at Lindenwood University and is now pursuing his Ph.D. in Artificial Intelligence at Capitol Technology University. He has taught at five universities across the country since 2006 and has served as the chair of Art History and a program manager of Pre-Art Therapy and Pre-Art Conservation, an assistant dean of Graduate and Online Programs for the School of Arts, Media, and Communication, and now serves as a lead XR disruptor and the department head of Art History and Visual Culture for the College of Arts and Humanities. His scholarship focuses on the intersections of art, culture, and technology. Jason Lively has been teaching both online and in a traditional classroom in the field of Interactive Media, Web Design, and Computer Information Systems since 1998. He has a B.B.A. in Computer Information Systems from Howard Payne University in Brownwood Texas; an M.B.A. in Computer Information Systems from Tarleton State University in Stephenville Texas; an Educational Specialist degree from Nova Southeastern University in Fort Lauderdale Florida; and a Ph.D. in Computing Technology in Education from Nova Southeastern University in Fort Lauderdale Florida. He brings a plethora of life experiences to the classroom. As a programmer, a production manager, and a charter web master in the late 90’s for a large computer manufacturing firm, he was able to garnish some early expertise in the areas of web design, multimedia, and project management. He later served as a university webmaster for 4 years and has continued to evolve in the field through active engagement in consulting work, research, freelance graphic design, and training. In academia, he has served as the president of the faculty governance body, a program chair, an assistant dean, an associate dean, and a dean. Although a recognized leader in his administrative roles, his real passion is found in the classroom. He is an innovative professor and an early

xi

xii

About the Authors

adopter of emerging technologies. Most recent research interests have included Artificial Intelligence, Virtual Reality, Augmented Reality, and Simulations as a means of increasing engagement with course content and promoting the development of durable/power skills. Bryan Robertson lives in the mountains of Northern Arizona between Phoenix and the Grand Canyon. As a professional educator, he teaches various college-level visual arts courses and, as a department chair, works with a diverse group of students and teachers. His research into utilizing Artificial Intelligence in the classroom seeks to find what AI cannot accomplish. For example, his study on one point perspective revealed that AI could not successfully generate correct orthogonal lines and required student alteration to achieve the mathematical solution. Ultimately, his students split between not finding any usefulness in using AI and others who thought AI would be an essential tool for them in the future. He is a multimedia artist using paint and pixels who explores an ongoing sense of cultural dislocation in a digital world. He has been in international shows in New Jersey, New York, Florida, Bulgaria, and Korea and international publications such as Politics in Collage and Brave New World: New Media 2023. Recent exhibitions include the Long Island Museum of Contemporary Art and the CiCA Museum. Peter Cotroneo is an artist and an educator living and working in Tampa, Florida. His work is a combination of traditional art forms, including drawing and painting, blended with lo-fi technologies, and animated by negation and repetition. He has exhibited his work nationally in major cultural hubs such as New York, St. Louis, Baltimore, and Tampa. As an educator, he is interested in creating accessible means to creative practice using open-source technologies to enhance the way we see and a D.I.Y. approach to materials to enhance the way we make. He is interested in bringing AI into the classroom as a means of conducting research into sub-cultural image practices and generating a broader understanding of aesthetic trends in the largely stratified online world. He received a Bachelor’s of Fine Arts from the University of South Florida and a Master’s of Fine Arts from the University of Tennessee in painting and drawing. He currently serves as an adjunct instructor at the University of Tampa, Lindenwood University, and Polk State College. Martin Lang is an artist and educator living and working in Columbia, South Carolina and is an assistant professor of Art and the chair of the Studio Art Program at Columbia College. He received his Master of Fine Arts in Transmedia Design at the University of Tennessee and his Bachelor of Fine Arts in Photography with Honors from Webster University. As an educator, he is interested in introducing students to emerging technologies and exploring their political, cultural, and aesthetic possibilities. His interest in AI lies in how open-source AI tools can speed up artistic production and become studio assistants for students. His work and research are rooted in lens-based practices and have expanded to a focus on video and new media sculpture. He maintains an active studio practice with research investigating the artist as persona, privilege and power, design and branding, text and language, ego, and identity. He’s

About the Authors

xiii

exhibited nationally and internationally at the University of Dallas, Tranzit.SK in Bratislava and Sharp Projects in Copenhagen among others. He’s received a variety of grants and awards and has completed residencies with Arts Unfold in Toronto and with the Museumsquartier in Vienna. He also founded, directs, and programs the gallery My Friend Sparksburg in Columbia South Carolina.

List of Figures

Fig. 1.1

Fig. 1.2 Fig. 1.3 Fig. 1.4 Fig. 1.5 Fig. 1.6

Fig. 1.7 Fig. 1.8

Fig. 1.9

Fig. 1.10 Fig. 1.11

Fig. 1.12

Rhino XY plot with different CFG scale, stable diffusion. December 12, 2022 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Artisaurus, Mona Lisa, Midjourney, February 18, 2023 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . Adobe Photoshop, 2021 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Stable diffusion web UI, October 22, 2022 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . Kris Kashtanova, Zarya of the Dawn Cover, comic book, 2022 (from Wikimedia Commons, licensed under CC0) . . . . . . . Demonstration of the Gutenberg Press at the International Printing Museum. February 21, 2009 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . Albrecht Dürer, Adam and Eve, 1504, engraving (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . Louis Dauguerre, L’Atelier de l’artiste, 1837, daguerreotype (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . William Henry Fox Talbot, Portrait of Venus, early 1840s, salt print from calotype negative, 3 7/8 × 3 in (9.9 × 7.5 cm), Carnegie Museum of Art (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . Claude Monet, Waterlilies, 1907 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . Honoré Daumier, Nadar Élevant la Photographie à la Hauteur de l’Art, ca.1862, Brooklyn Museum (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . Vera Molnar, Interruptions à recouvrements, 1969 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . .

2 3 4 5 6

8 9

10

11 12

13 14

xv

xvi

Fig. 1.13

Fig. 1.14

Fig. 3.1 Fig. 3.2 Fig. 3.3 Fig. 3.4

Fig. 3.5 Fig. 3.6 Fig. 3.7

Fig. 3.8 Fig. 3.9 Fig. 3.10 Fig. 3.11 Fig. 3.12

Fig. 3.13

Fig. 3.14

Fig. 3.15

List of Figures

Nam-June Paik, One-Hundred-and-Eight Tournaments, Gyeongju, North Gyeongsang province, South Korea (from Wikimedia Commons, licensed under CC-BY 4.0) . . . . . . Jenny Holzer, 7 World Trade Center. Photo taken November 2006 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Gustave Courbet, A Burial at Ornans, 1849–50 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . Claude Monet, Impression Sunrise, 1872 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . Vincent van Gogh, Starry Night, 1889 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . Paul Gauguin, Where Do We Come From? What Are We? Where Are We Going? 1897 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Henri Matisse, Le Bonheur de vivre (The Joy of Life), 1905–06 (from Wikimedia Commons, licensed under CC0) . . . . Wassily Kandinsky, Composition VII, 1913 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . Marcel Duchamp, Fountain, 1917. Philadelphia Art Museum (from Wikimedia Commons, licensed under CC-BY 2.0) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Donald Judd, Untitled, 1986. Chinati Foundation (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . Andy Warhol, Campbell’s Soup Cans, 1962 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . Gutenberg Bible, BNF Res A71 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . Albrecht Dürer, Apocalypse, 1498, woodcut (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . Martin Schongauer, The Temptation of St. Anthony, engraving (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Albrecht Dürer, Knight, Death, and the Devil, 1513, engraving (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Marcantonio Raimondi after Raphael, The Judgment of Paris, c. 1510–1520, engraving (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . Andreas Vesalius, De Humani Corporis Fabrica (first published 1543) Johann Oporinus, Basel (from Wikimedia Commons, licensed under CC-BY 4.0) . . . . . . . . . . . . . . . . . . . . .

14

15 39 40 41

42 44 46

47 50 52 54 56

57

58

61

62

List of Figures

Fig. 3.16

Fig. 3.17

Fig. 3.18 Fig. 3.19 Fig. 3.20

Fig. 3.21

Fig. 3.22 Fig. 5.1

Fig. 5.2 Fig. 5.3

Fig. 5.4

Fig. 5.5 Fig. 5.6 Fig. 5.7 Fig. 5.8 Fig. 5.9 Fig. 5.10 Fig. 5.11 Fig. 5.12 Fig. 5.13 Fig. 5.14

Denis Diderot and Jean Le Rond d’Alembert. Glassware in Bottles, Encyclopédie ou dictionnaire raisonné des sciences, des arts et des métiers, (1751–1772) Frankrijk, Parijs (from Wikimedia Commons, licensed under CC0) . . . . . . Honoré Daumier, Le Cauchemar (The Nightmare), lithograph, La Caricature no. 69, February 23, 1832 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . Félix Nadar, Charles Baudelaire, 1855 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . Mathew Brady, The Dead of Antietam, 1862 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . William Henry Fox Talbot, The Pencil of Nature (1844–1846), calotype (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Anna Atkins, Photographs of British Algae: Cyanotype Impressions (1843–1853), cyanotype (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . Nam June Paik, TV Buddha, 1974 (from Wikimedia Commons, licensed under CC-BY 2.0) . . . . . . . . . . . . . . . . . . . . . Agostino Veneziano, The Academy of Baccio Bandinelli in Rome, 1531 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Jacques Gamelin, A Life Drawing Class, 1778/1779 (from Wikimedia Commons, licensed under CC-BY 4.0) . . . . . . Students in Sculpting Department, Middelbare Kunstnijverheidsschool, Brusselsestraat 60, Maastricht, ca.1935 (from Wikimedia Commons, licensed under CC-BY 3.0) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Anonymous, The Model (Students in the Drawing Room), 1910, oil on canvas (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Buy credits, DALL-E 2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Prompt input field, DALL-E 2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . “Image of an Apple” prompt generation, four examples, DALL-E 2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Selecting desired apple image, DALL-E 2 . . . . . . . . . . . . . . . . . . Generating more apples based on selection, DALL-E 2 . . . . . . . . Using outpainting feature, DALL-E 2 . . . . . . . . . . . . . . . . . . . . . . Expanding stylistic cues in generation frame (selection), DALL-E 2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Expanding stylistic cues in generation frame (generation), DALL-E 2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Newcomer rooms, Midjourney Discord . . . . . . . . . . . . . . . . . . . . Text prompt input bar, Midjourney Discord . . . . . . . . . . . . . . . . .

xvii

64

65 67 68

69

70 72

103 104

105

107 113 114 114 115 115 116 116 116 118 119

xviii

Fig. 5.15 Fig. 5.16 Fig. 5.17 Fig. 5.18

Fig. 5.19 Fig. 5.20

Fig. 5.21

Fig. 5.22 Fig. 5.23

Fig. 6.1 Fig. 6.2 Fig. 6.3 Fig. 6.4 Fig. 6.5 Fig. 6.6 Fig. 6.7 Fig. 6.8 Fig. 6.9 Fig. 6.10 Fig. 6.11 Fig. 6.12 Fig. 6.13 Fig. 6.14 Fig. 6.15

List of Figures

“Bottles of water on fire with wings” text prompt (four generated versions), Midjourney Discord . . . . . . . . . . . . . . . . . . . Version selection options, Midjourney Discord . . . . . . . . . . . . . . A water bottle on fire soring like an eagle (four generated versions), Midjourney Discord . . . . . . . . . . . . . . . . . . . . . . . . . . . . A water bottle on fire soring like an eagle attached to a water bottle (four generated versions), Midjourney Discord . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Stable diffusion web UI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Rhino X Y Plot demonstrating different seeds, stable diffusion, December 12, 2022 (from Wikimedia Commons, licensed under CC0) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . “Create an image of an American horned toad lizard against the sunset of the Palo Duro canyon” text prompt (four generated versions), Adobe Firefly, 2023 . . . . . . . . . . . . . . . Selected image generative options, Adobe Firefly, 2023 . . . . . . . Generate an image of a rusted robotic dinosaur roaming the Palo Duro canyon on a windy day with stylizing tags “Graphic,” “Fantasy,” “Warm Tone,” “Dramatic Lighting,” and “Wide Angle” text prompt (four generated versions), Adobe Firefly, 2023 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Bottle, fire, wings, Craiyon . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Final sculpture of a water bottle on fire with wings, mixed media, 2022 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Final sculpture of bread, zipper, puzzle piece, mixed media, 2022 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Shoes, lightbulb and sunglasses, Craiyon, 2022 . . . . . . . . . . . . . . A house made out of clouds, Craiyon, 2022 . . . . . . . . . . . . . . . . . Pottingshed, DALL-E 2, 2022 . . . . . . . . . . . . . . . . . . . . . . . . . . . . Student artwork based on AI potting shed image, 2022 . . . . . . . . Domestic furnishings, Craiyon, 2022 . . . . . . . . . . . . . . . . . . . . . . Student artwork based on AI domestic furnishings image, 2022 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Domestic interior geometric shapes, Crayon, 2022 . . . . . . . . . . . Student artwork based on AI domestic interior geometric shapes, 2022 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . “Pink Panther in the Rain” prompt image generation, Craiyon, 2022 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Student artwork based on AI Pink Panther in the Rain Image, 2022 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . “Portrait of a Woman with Flower,” prompt image generation, Craiyon, 2022 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Student artwork based on AI Portrait of Woman with Flower Image, 2022 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

119 120 121

122 124

124

127 127

128 138 139 140 141 141 146 147 147 148 148 149 154 155 156 157

List of Figures

Fig. 6.16 Fig. 6.17 Fig. 6.18 Fig. 6.19 Fig. 6.20 Fig. 6.21 Fig. 6.22 Fig. 6.23 Fig. 6.24

Fig. 6.25

Fig. 6.26

Fig. 6.27 Fig. 6.28

Fig. 6.29 Fig. 6.30 Fig. 6.31

Fig. 6.32 Fig. 6.33

Fig. 6.34

“Cats at a Birthday Party” prompt image generation, Craiyon, 2022 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Student artwork based on AI Cats at a Birthday Party image, 2022 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . “Fire and Water Type Pokémon” prompt image generation, Craiyon, 2022 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Student artwork based on AI Fire and Water Type Pokémon image, 2022 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . “Dragon flying in mystical forest” prompt image generation, Craiyon, 2022 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Student artwork based on AI Dragon Flying in Mystical Forest image, 2022 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . “Underwater City with Mermaids, Photorealistic” prompt image generation, DALL-E 2, 2023 . . . . . . . . . . . . . . . . . . . . . . . . Underwater city with mermaids, photorealistic, photoshop, 2023 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . “A charcoal drawing of a crying green robot trying to open a can of peaches with a screwdriver in an alley” prompt image generation, DALL-E 2, 2023 . . . . . . . . . . . . . . . . . . . . . . . . Student artwork of a charcoal drawing of a crying green robot trying to open a can of peaches with a screwdriver in an Alley, Photoshop, 2023 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . “A geisha walking through the streets of feudal Japan in a 1 pt perspective digital art” prompt image generation, DALL-E 2, 2023 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Student Artwork of A Geisha Walking through the Streets of Feudal Japan, Photoshop, 2023 . . . . . . . . . . . . . . . . . . . . . . . . . “Photorealistic abandoned Disney ride with water dripping from the ceiling with a decayed Donald the Duck character costume in the corner” prompt image generation, DALL-E 2, 2023 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Student artwork of a Photorealistic Abandoned Disney Ride, photoshop, 2023 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Student artwork of an Alien Plant Design, 2023 . . . . . . . . . . . . . . “A toxic, red/purple plant made of round bulbs with rings connecting them, spikes, and a yellow stem, in a desert; photorealistic” prompt after original student artwork, DALL-E 2, 2023 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Student Artwork of an Alien Plant Design, 2023 . . . . . . . . . . . . . “An underwater plant that looks like a blue jellyfish mixed with a mushroom that has a yellow blob at its tip” prompt after original student artwork, DALL-E 2, 2023 . . . . . . . . . . . . . . “Rainbow Noodles” prompt image generation, MidJourney, 2023 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

xix

158 159 160 161 162 163 172 173

174

175

176 177

178 179 183

184 185

186 187

xx

Fig. 6.35 Fig. 6.36 Fig. 6.37 Fig. 7.1 Fig. 7.2 Fig. 7.3 Fig. 7.4 Fig. 7.5 Fig. 7.6 Fig. 7.7

List of Figures

Rainbow Noodles Midjourney image modified by student, adobe illustrator, 2023 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . “Rainbow Noodles” prompt image generation, DALL-E 2, 2023 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Rainbow Noodles DALL-E 2 image modified by student, adobe illustrator, 2023 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Options: Black, 35–50, Female. This person does not exist, 2023 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Options: Asian, 50+, Male. This person does not exist, 2023 . . . Student animated logo example assignment, 2023 . . . . . . . . . . . . Student example of AI-generated employees, 2023 . . . . . . . . . . . Student final website example, 2023 . . . . . . . . . . . . . . . . . . . . . . . Dataset samples of acrylic and watercolor paintings on canvas and paper, 2023 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Generative AI imagery from dataset samples, stable diffusion, 2023 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

191 192 193 201 202 204 206 214 221 221

List of Tables

Table 2.1 Table 4.1 Table 4.2 Table 6.1 Table 6.2 Table 6.3 Table 6.4 Table 6.5 Table 6.6 Table 6.7 Table 6.8 Table 6.9 Table 7.1 Table 7.2 Table 7.3 Table 7.4 Table 7.5 Table 7.6 Table 7.7 Table 7.8 Table 7.9 Table 7.10

Boden’s three types of human creativity . . . . . . . . . . . . . . . . . . . Pathways to integrating AI in art and design curriculum . . . . . . Recommended strategies for integrating AI into the art and design classroom . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Example 3D design AI assignment . . . . . . . . . . . . . . . . . . . . . . . Example of drawing and AI assignment . . . . . . . . . . . . . . . . . . . Digital art AI image redux assignment . . . . . . . . . . . . . . . . . . . . Digital art class discussion: The ETHICS of AI image generation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Digital art class working with synectics and AI assignment . . . Student prompts for digital art class working with synectics and AI assignment . . . . . . . . . . . . . . . . . . . . . . . . The AI treatment assignment and discussion . . . . . . . . . . . . . . . AI image generation and creative remix assignment . . . . . . . . . AI artistic exploration assignment . . . . . . . . . . . . . . . . . . . . . . . . Color palette selection assignment . . . . . . . . . . . . . . . . . . . . . . . Logo design assignment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Image generation assignment . . . . . . . . . . . . . . . . . . . . . . . . . . . . Content generation assignment . . . . . . . . . . . . . . . . . . . . . . . . . . Font selection and pairing assignment . . . . . . . . . . . . . . . . . . . . Code generation and integration assignment . . . . . . . . . . . . . . . Layout optimization assignment . . . . . . . . . . . . . . . . . . . . . . . . . Impact of AI discussion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Generative art techniques using original artwork datasets assignment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Recommendations for integrating AI into coursework . . . . . . .

23 94 95 135 144 152 164 166 171 180 188 190 200 203 205 207 210 211 213 215 219 221

xxi

Chapter 1

Introduction: Embracing the AI Renaissance in Art and Design

Abstract This chapter explores the transformative impact of artificial intelligence (AI) on art and creativity. It delves into the historical disruptions caused by technological advancements, leading to redefinitions of art and creativity. The chapter investigates the broader definitions of creativity, including its neural underpinnings and the role of agency in defining artistic styles. It examines the current state of AI-generated art, acknowledging its limitations while proposing AI as a tool for creativity rather than a replacement. The chapter calls for a new framing of the human-AI relationship, recognizing the continued agency of artists and the potential for AI to enhance human creativity. It raises questions about the boundaries and definitions of art in an AI-driven society, setting the stage for further exploration of the evolving landscape of art and creativity.

1.1 Art, Technology, and the AI Revolution As we stand on the cusp of a new era in art and design, the incorporation of artificial intelligence (AI) and machine learning (ML) technologies is already transforming the creative domain. In recent times, the emergence of generative AI art tools, including Stable Diffusion (Fig. 1.1), DALL-E 2, and Midjourney, has not only fascinated the general public but also sparked a heated debate among artists, designers, and educators (DelSignore 2022; Ansari 2022; Murphy 2022; Hazucha 2022). These groundbreaking tools have raised critical questions about the future of creativity, the evolving relationship between artists and AI, and the ethical, legal, and social implications of AI-generated art, prompting both excitement and apprehension among those engaged in the creative process. As we navigate this new frontier, it is essential to consider the transformative impact AI and ML technologies have on the field and to explore the potential for collaboration and co-creation in this burgeoning AI renaissance. Generative AI art refers to the process of creating visual artwork using artificial intelligence and machine learning algorithms. These algorithms are trained on vast datasets of images, often scraped from the internet, to learn patterns, styles, and visual

© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024 J. Hutson et al., Creative Convergence, Springer Series on Cultural Computing, https://doi.org/10.1007/978-3-031-45127-0_1

1

2

1 Introduction: Embracing the AI Renaissance in Art and Design

Fig. 1.1 Rhino XY plot with different CFG scale, stable diffusion. December 12, 2022 (from Wikimedia Commons, licensed under CC0)

elements present in human-created art (Fig. 1.2). By analyzing and understanding these elements, generative AI models are capable of producing original imagery based on user inputs, such as text prompts or specific visual cues. In the case of text-toimage generation, the AI model takes a text prompt provided by the user and translates it into a coherent visual representation, synthesizing the learned visual elements to create a unique piece of art. This process involves complex interactions between AI algorithms and neural networks, which allow the model to understand and interpret both the textual input and the visual output. The creative process differs significantly from digital imaging using Adobe products like Photoshop and Illustrator. These graphic design and digital art software programs provide users with a wide array of tools, brushes, and filters for creating, editing, and manipulating images (Fig. 1.3). Such programs serve as advanced digital canvases and workspaces, where artists and designers have trained to apply their own creativity, skills, and techniques to generate their desired visual outcomes. Unlike other digital imaging software, however, Generative AI tools rely on AI algorithms to create artwork based on the patterns and styles learned from the input data. Instead of providing users with a set of tools for manual manipulation of images, generative AI models generate visual content autonomously or semi-autonomously by interpreting user inputs, such as text prompts or visual cues. The creative process in generative AI art is driven by the machine’s understanding of artistic elements, style, and composition, which it has learned from the training data. In essence, digital imaging with Adobe products like Photoshop and Illustrator is a hands-on, skill-based approach to creating and manipulating visuals, where the artist or designer directly controls the outcome. On the other hand, generative AI art is an emergent process, where the algorithm interprets the user’s input or “prompt” and creates visual content based on its learned knowledge, leading to a more collaborative relationship between the human user and the machine (Fig. 1.4). This distinction highlights the shift in the creative process and raises essential questions about the role of human creativity, authorship, and artistic expression in the age of AI-driven art. The accessibility of these new AI tools has been significantly enhanced by their browser-based interfaces, rather than relying on proprietary software. This approach lowers the barrier to entry, making them more user-friendly and encouraging widespread adoption. Furthermore, their innovative creative capabilities have attracted users eager to explore the new artistic possibilities offered by AI-driven technologies. At the same time, the swift adoption of AI-driven art by the general

1.1 Art, Technology, and the AI Revolution

3

Fig. 1.2 Artisaurus, Mona Lisa, Midjourney, February 18, 2023 (from Wikimedia Commons, licensed under CC0)

public has prompted a considerable backlash from traditionally trained artists and designers, who have expressed concerns over copyright infringement and raised questions about the legitimacy of AI-generated art as a distinct genre (Ansari 2022; Murphy 2022; Hazucha 2022). This debate has been further fueled by recent legal developments concerning the copyright of AI-created artwork. On February 21, 2023, the U.S. Copyright Office revoked the initial copyright protection granted to Kris Kashtanova’s comic book, Zarya of the Dawn (Fig. 1.5), which had been

4

1 Introduction: Embracing the AI Renaissance in Art and Design

Fig. 1.3 Adobe Photoshop, 2021 (from Wikimedia Commons, licensed under CC0)

illustrated using the text-to-image AI program, Midjourney. The updated copyright was restricted to the author’s text and arrangement, explicitly excluding the artwork generated by Midjourney. The landmark ruling has brought the application of copyright law to algorithmically created art to the forefront, presenting both philosophical and practical challenges related to the human understanding of creativity and the role of AI in artistic production (Ford 2023). While the U.S. Copyright Office continues to grapple with the changing landscape of intellectual property and creatives using AI as a co-pilot, co-author, and co-creators, industry has sidestepped the concern. The move comes after the lawsuit levied by Getty Images against Stability AI, creators of the popular generative art tool Stable Diffusion, January 17, 2023. Getty Images claimed that Stability AI “unlawfully copied and processed millions of copyright-protected images” to train its software (Vincent 2023). Stability AI responded that its practice of scraping human-created images from the web for training data is protected by laws like the US fair use doctrine, while rights holders like Getty Images argue that this constitutes copyright infringement. Getty Images CEO Craig Peters likens the current legal landscape in the generative AI scene to the early days of digital music and hopes this legal action will provide clarity on the issue of intellectual property rights. As the press release states, Getty Images believes artificial intelligence has the potential to stimulate creative endeavors. Accordingly, Getty Images provided licenses to leading technology innovators for purposes related to training artificial intelligence systems in a manner that respects personal and intellectual property rights. Stability AI did not seek any such license from Getty Images and instead, we believe, chose to ignore viable licensing options and long-standing legal protections in pursuit of their stand-alone commercial interests (Vincent 2023).

1.1 Art, Technology, and the AI Revolution

5

Fig. 1.4 Stable diffusion web UI, October 22, 2022 (from Wikimedia Commons, licensed under CC0)

Legal experts have yet to reach a consensus on the matter, and the lawsuit marks an escalation in the legal battle between AI firms and content creators over credit, profit, and the future of the creative industries. However, recent events point to a potential solution, at least for copyright infringement considerations. On March 21, 2023 two Silicon Valley companies, Adobe Inc and Nvidia Corp, have introduced AI-powered tools that generate images while addressing copyright and payment concerns. Adobe added AI to its popular software, including Photoshop and Illustrator, speeding up image and text effect generation, and ensuring creators get paid. Nvidia unveiled “Picasso,” an AI service generating images, videos, and 3D applications from text descriptions, with plans to pay royalties to licensed image providers, such as Getty Images, Shutterstock, and Adobe. Adobe’s AI feature, “Firefly,” generates images, illustrations, or videos based on

6

1 Introduction: Embracing the AI Renaissance in Art and Design

Fig. 1.5 Kris Kashtanova, Zarya of the Dawn Cover, comic book, 2022 (from Wikimedia Commons, licensed under CC0)

user descriptions, using Adobe Stock images, openly licensed content, and out-ofcopyright content, making creations commercially safe. Adobe is also advocating for a universal “do not train” tag, allowing photographers to opt out of their content being used for training models (Chmielewski and Nellis 2023). These developments

1.2 Reshaping the Art World

7

address the ongoing tension between copyright holders and emerging technology, aiming to create a responsible and creator-friendly AI development path. The latest advancements in AI-powered tools from companies like Adobe Inc, Nvidia Corp, and others showcase a promising strategy for tackling copyright infringement issues while making certain that creators are duly compensated. These advancements in responsibly incorporating AI technology into the creative process are poised to alleviate the friction between copyright holders and emerging technologies, without hindering the adoption of AI-driven tools in the art and design world (Chmielewski and Nellis 2023).

1.2 Reshaping the Art World As a result, educational institutions and industry professionals must acknowledge and adapt to the transformative impact AI is having on their processes, training, and curricula. The shift towards responsible AI use in creative practices calls for a reassessment of traditional educational methods and the inclusion of AI-related courses, aiming to equip students and professionals with the necessary knowledge and skills to harness the potential of AI-driven art tools. Moreover, industry professionals need to be prepared for the changing landscape of art and design, as AI-enabled tools will likely become a staple in various creative processes, requiring an understanding of the ethical, legal, and creative implications involved. But the academic community has shown reluctance to adopt the practical applications of AI in art and design, opting to concentrate on theoretical and aesthetic considerations. In the face of emerging AI technologies, such as ChatGPT, educational institutions have expressed apprehensions, often preferring to engage in debates about the philosophical implications of AI-generated art. This cautious approach has led to a focus on understanding the nature and value of “art” in the context of AI, while practical aspects and potential benefits of these technologies have remained largely unexplored within traditional education (Ajani 2022; Francke and Alexander 2019; Sherry 2022). Consequently, this hesitance has not only limited the integration of AI in art and design curricula but has also fueled concerns and calls for outright bans in many US States. This reluctance, however, overlooks the transformative potential of AI and the profound impact it is already having on the creative process (Slotte Dufva 2023; Compton 2022). Moreover, the resistance to adopting these emerging technologies due to a belief that it may undermine the very idea of “art” overlooks past revolutions. Throughout history, disruptions caused by technological innovations have played a pivotal role in defining and redefining the landscape of art. For example, three key inflection points may be cited as transformative moments in the history of art and technology: printmaking and the printing press (c. 1440), photography and photomechanical processes (c. 1839), and computer-generated imagery and digital art (c. 1960s). The invention of the printing press (Fig. 1.6) by Johannes Gutenberg (d. 1468) around

8

1 Introduction: Embracing the AI Renaissance in Art and Design

Fig. 1.6 Demonstration of the Gutenberg Press at the International Printing Museum. February 21, 2009 (from Wikimedia Commons, licensed under CC0)

1440 revolutionized the production and dissemination of information. This technological breakthrough enabled the mass production of books and artworks, making them more accessible to a wider audience (Füssel 2020). Shortly thereafter, printmaking, as an art form, became popular with artists like Albrecht Dürer (1471–1528), who created intricate woodcuts and engravings (Fig. 1.7), allowing for the broad and rapid dissemination of artistic ideas across continents (Weiss and Parshall 2022). Likewise, the printing press also fostered the spread of artistic ideas, leading to the cross-pollination of styles and techniques across Europe. No surprise the period saw the rise of the Renaissance, characterized by a renewed interest in classical art, humanism, and naturalism (Mack 2023). Arguably, the rapid spread of such ideas, and even the Reformation, would not have been possible without this new technology (Binzel et al. 2023). Transformation of the very notion of what could be considered “art” and the role of the artist would follow in the Industrial Age. Photography, another exactly repeatable pictorial medium, emerged in the early nineteenth century with the invention of the daguerreotype (Fig. 1.8) by Louis Daguerre (1787–1851) and the calotype (Fig. 1.9) by William Henry Fox Talbot (1800–1877). But unlike printmaking in the early modern era, this new technology challenged traditional art forms, such as painting, by capturing images with a degree of realism never seen before. The artistic

1.2 Reshaping the Art World

9

Fig. 1.7 Albrecht Dürer, Adam and Eve, 1504, engraving (from Wikimedia Commons, licensed under CC0)

crisis that followed involved accepting that the role of painting was no longer representational accuracy (Osborne 2022). The invention of photomechanical processes, such as halftone printing, facilitated the mass reproduction of photographs, further democratizing visual information (Ennis 2022). Artists like Édouard Manet (1832– 1883) and Impressionists like Claude Monet (1840–1926) were influenced by photography’s ability to capture fleeting moments, leading them to explore new ways of depicting light, color, and movement in their paintings (Fig. 1.10). Others, such as Honoré Daumier (1808–1879), would satirize the new technology and those that could train in an afternoon and then call themselves “artists” (Fig. 1.11). Photography also contributed to the development of modernist art movements, such as Dada

10

1 Introduction: Embracing the AI Renaissance in Art and Design

Fig. 1.8 Louis Dauguerre, L’Atelier de l’artiste, 1837, daguerreotype (from Wikimedia Commons, licensed under CC0)

and Surrealism, with artists like Man Ray (1890–1976) and Hannah Höch (1889– 1978) using the medium to create innovative, experimental works. Therefore, artists revolted against the use of photography for fear of being redundant and then coopted the technology for their own creative processes. The emergence of computer-generated imagery and digital art in the 1960s marked another major turning point in the history of art and technology. Early pioneers like Frieder Nake (1938–), Georg Nees (1926–2016), and Vera Molnar (1924–) (Fig. 1.12) began experimenting with algorithmic and computational approaches to artmaking, laying the foundation for the digital art movement. The development of software like Adobe Photoshop and Illustrator in the 1980s and 1990s enabled artists to manipulate images in unprecedented ways, blurring the boundaries between traditional and digital media. This period also saw the rise of new media art, with artists like Nam June Paik (1932–2006) (Fig. 1.13) and Jenny Holzer (1950–) (Fig. 1.14) exploring the potential of video and electronic displays to create immersive, interactive experiences. Today, the continued advancement of technology, including AI and machine learning, offers artists even more possibilities for creative exploration and expression. Each of these technological advancements has significantly altered the practice, reception, and definition of art, laying the groundwork for the AI-driven evolution that we are currently experiencing. These inflection points provide a better understanding of the dynamic nature of the reception and valuation of art and theory over time. These

1.2 Reshaping the Art World

11

Fig. 1.9 William Henry Fox Talbot, Portrait of Venus, early 1840s, salt print from calotype negative, 3 7/8 × 3 in (9.9 × 7.5 cm), Carnegie Museum of Art (from Wikimedia Commons, licensed under CC0)

shifts have not only shaped artistic expression but also influenced the perception of art and the broader cultural context in which it is produced and consumed. As we witness the rise of AI in art and design, it is crucial to consider the lessons learned from previous technological disruptions, recognizing that they have consistently pushed the boundaries of creativity and opened new possibilities for artistic exploration.

12

1 Introduction: Embracing the AI Renaissance in Art and Design

Fig. 1.10 Claude Monet, Waterlilies, 1907 (from Wikimedia Commons, licensed under CC0)

1.2 Reshaping the Art World

13

Fig. 1.11 Honoré Daumier, Nadar Élevant la Photographie à la Hauteur de l’Art, ca.1862, Brooklyn Museum (from Wikimedia Commons, licensed under CC0)

14

1 Introduction: Embracing the AI Renaissance in Art and Design

Fig. 1.12 Vera Molnar, Interruptions à recouvrements, 1969 (from Wikimedia Commons, licensed under CC0)

Fig. 1.13 Nam-June Paik, One-Hundred-and-Eight Tournaments, Gyeongju, North Gyeongsang province, South Korea (from Wikimedia Commons, licensed under CC-BY 4.0)

1.3 Redefining Creativity

15

Fig. 1.14 Jenny Holzer, 7 World Trade Center. Photo taken November 2006 (from Wikimedia Commons, licensed under CC0)

1.3 Redefining Creativity Aside from legal and educational considerations, the integration of AI in the arts raises questions about the nature of creativity and its implications for artists and designers. Existing literature has largely focused on philosophical and theoretical discussions, with little emphasis on practical applications, strategies, or workflows for practicing artists and designers to adopt. One such conceptual framework was proposed by Coeckelbergh (2017) where framework for understanding whether machines can create art, highlighting the need for a reevaluation of our definitions of “creation,” “art,” and the role of machines in “creating art.” He argues that the traditional binary of human versus non-human forms of art is arbitrary and calls for a more collaborative approach, where technology assists in the creative process. This idea aligns with Mazzone and Elgammal’s (2019) perspective, who see the connection between machine and human creativity as parallel and complementary, rather than in conflict. Tao (2022) also describes this partnership as the “actor network” of art, where humans and machines work together as co-agents to maximize the strengths of each party. This collaborative effort could lead to new and innovative ways of creating art, in which both the artist and the machine contribute to the creative process. By

16

1 Introduction: Embracing the AI Renaissance in Art and Design

embracing a more “poetic” understanding of creativity, as suggested by Coeckelbergh, artists, designers, and the broader creative community can explore novel ways of working with AI, redefining traditional notions of artistic expression and pushing the boundaries of what is possible in the arts. Further discussions in the field have also questioned the role of machines in the creative process, calling for a reconceptualization of creativity itself. Ahmed (2020) frames the discussion of AI within the context of a design-based praxis, originating from the disciplines of the arts and humanities. According to Ahmed, the permanent physical manifestations of AI in media museums should not be understood as mere designs, but rather as elements for design. By examining interactive and immersive media installations, Ahmed argues that AI should be reconsidered as more than just a product or traditional image for design. Instead, the focus should be on how AI makes “immaterial humanistic characteristics”—such as emotions, experiences, senses, and memories—concrete and physical (p. 133). In this view, the interactions and emotions that humans experience while engaging with art generated by AI can be seen as design elements themselves. However, these considerations of AI and art do not directly address one of the most controversial aspects of art—creativity. The exploration of AI’s role in the creative process raises questions about the nature of creativity, its definition, and its implications for artists, designers, and the broader creative community. By engaging in these discussions, we can better understand the transformative potential of AI and its impact on the future of art and design. The concepts of artistic autonomy and creativity often drive discussions about whether AI-generated art can be considered “art” in its true sense. Many definitions for “creativity” exist, but for this discussion, Csikszentmihályi’s (1988) model is particularly relevant. This model considers three interrelated elements: a body of agreed-upon knowledge; a volitional agent who produces something innovative by changing an element of the field in question; and experts in the field who judge whether the novel production should be accepted into that domain or field. Building on this definition, Jennings (2010) further identified three criteria that an “agent” must possess to qualify as a volitional system with creative autonomy: the ability to autonomously evaluate without outside or undue influence; the ability of a system to change autonomously and then direct variations on a standard without explicit direction; and, finally, the ability of a system to avoid randomness. When applied to AI art and “creativity,” Jennings notes that “[…] to progress from a capable apprentice to a creator in its own right, an AI system must be able to both independently apply and independently change the standards it uses. This ideal will be called ‘creative autonomy,’ and represents the system’s freedom to pursue a course independent of its programmer’s or operator’s intentions” (2010, p. 491). However, as Ajani (2022) points out, creativity does not exist independently. Instead, “creativity depends on individual capacity, acquisition of information, and judgment by experts” (p. 258). Since creativity requires external validation, AI has been absolved from being judged in these terms. In each domain (art and/or design), experts must “judge” whether the product can be considered “creative,” implying that creativity cannot be inherently attributed to AI. This perspective highlights

1.3 Redefining Creativity

17

the complex relationship between AI, art, and creativity, and the ongoing debate surrounding the role of AI in the creative process. As such, this book seeks to bridge the gap between theory and practice, presenting a comprehensive exploration of how AI is revolutionizing art and design. By examining historical precedents and contemporary case studies, the authors delve into the evolving relationship between artists, AI, and the creative process, as well as the ethical, social, and cultural implications of this new technological frontier. Central to this investigation is the concept of “creative convergence,” a term that embodies the fusion of human ingenuity and cutting-edge technology to redefine artistic practice, pedagogy, and the very essence of creativity itself. By scrutinizing the synergistic interplay between AI and human creativity, Creative Convergence aims to provide a roadmap for artists, designers, and educators as they navigate the challenges and opportunities presented by the AI Renaissance. This exploration not only offers new perspectives on the artistic landscape but also empowers creative professionals to embrace the potential of AI in shaping the future of art and design. Building upon the concepts introduced in the previous section, this manuscript takes a proactive stance in equipping students and faculty with the knowledge and skills necessary to embrace a collaborative future where humans and AI coexist and thrive. Rather than perceiving AI-generated components as replacements for human creativity, the approach advocated in this book emphasizes their integration as valuable building blocks within the design process. By recognizing the potential of AI-generated content and elements, artists and designers gain access to powerful and efficient resources that enhance their craft, enabling them to achieve improved designs, streamline workflows, convey effective messages, and ultimately contribute to the advancement of their disciplines. The intent of this manuscript goes beyond mere theoretical exploration. It seeks to empower creative professionals by providing practical guidance and insights into harnessing the capabilities of AI in art and design. By shifting the focus from apprehension to collaboration, the authors aim to foster a mindset where artists and designers actively work with AI-generated components and materials, leveraging their potential to unlock new levels of creativity and innovation. Embracing AI as a tool and ally, rather than fearing it as a threat, opens up boundless possibilities for artistic expression and pushes the boundaries of what can be achieved in the field. Throughout this book, students and faculty will find a wealth of knowledge, case studies, and practical examples that demonstrate the ways in which AI can be effectively integrated into their creative processes. By embracing the principles of collaboration and creative convergence, artists and designers can leverage AI-generated resources to elevate their work, optimize their workflows, and create impactful designs that resonate with their audiences. This manuscript serves as a guide, offering a comprehensive roadmap that prepares readers for a future where the harmonious partnership between human ingenuity and AI technology leads to enhanced artistic outcomes and a reimagining of the possibilities within art and design.

18

1 Introduction: Embracing the AI Renaissance in Art and Design

References Ahmed D (2020) Senses, experiences, emotions, memories: artificial intelligence as a design instead of for a design in contemporary Japan. Int Build Int 1–18 Ajani G (2022) Human authorship and art created by artificial intelligence—where do we stand? Dig Ethic ISS Imag 11:253 Ansari T (2022) How AI transformed the art world in 2022. Analytics India Magazine (AIM). https://analyticsindiamag.com/how-ai-transformed-the-art-world-in-2022/. Accessed 30 Oct Binzel C, Link A, Ramachandran R (2023) The protestant reformation and language choice in the holy roman empire. Available at SSRN 4381316 Chmielewski D, Nellis S (2023) Adobe, Nvidia AI imagery systems aim to resolve copyright questions. Reuters. https://www.reuters.com/technology/adobe-nvidia-ai-imagery-systems-aim-res olve-copyright-questions-2023-03-21/. Accessed 21 Mar 2023 Coeckelbergh M (2017) Can machines create art? Philos Technol 30(3):285–303 Compton N (2022) Generative art: the creatives powering the AI art boom. Wallpaper. https://www. wallpaper.com/art/generative-art Csikszentmihályi M (1988) Society, culture, and person: a systems view of creativity. In: Sternberg R (ed) The nature of creativity—contemporary psychological perspectives. Cambridge University Press, pp 325–339 DelSignore P (2022) The new age of creative AI began in 2022. Medium. https://medium.com/pre dict/the-new-age-of-creative-ai-began-in-2022-ece07bb93350. Accessed 23 Dec Ennis E (2022) Writing, authorship and photography in British literary culture, 1880–1920: capturing the image. Bloomsbury Publishing Ford M (2023) Artificial intelligence meets its worst enemy: the U.S. Copyright Office. The New Republic. https://newrepublic.com/article/170898/ai-midjourney-art-copyright-office. Accessed 3 March 2023 Francke E, Alexander B (2019) The potential influence of artificial intelligence on plagiarism a higher education perspective. In: Proceedings of European conference on the impact of artificial intelligence and robotics. EM Normandie Business School, Oxford, pp 131–140 Füssel S (2020) Gutenberg and the impact of printing. Routledge, London Hazucha B (2022) Artificial intelligence and cultural production: possible impacts on creativity and copyright law. Available at SSRN 4028106 Jennings K (2010) Developing creativity—artificial barriers in artificial intelligence. Mind Mach 20:489–501 Mack P (2023) Humanism and the classical tradition. The Oxford history of the renaissance, p 10 Mazzone M, Elgammal A (2019) Art, creativity, and the potential of artificial intelligence. Arts 8(1):26 Murphy B (2022) Is Lensa AI stealing from human art? An expert explains the controversy. Sci Alert. https://www-sciencealert-com.cdn.ampproject.org/c/s/www.sciencealert.com/ is-lensa-ai-stealing-from-human-art-an-expert-explains-the-controversy/amp. Accessed 15 Dec 2022 Osborne P (2022) Crisis as form. Verso Books Sherry B (2022) 3 limits to artificial intelligence’s creativity (and how to solve them): here’s what you need to know about harnessing A.I. technology to be more creative. Inc. https://www.inc. com/ben-sherry/3-limits-to-artificial-intelligences-creativity-and-how-to-solve-them.html Slotte Dufva T (2023) Entanglements in AI Art. In: Global media arts education Palgrave Macmillan, Cham, pp. 181–196 Tao F (2022) A new harmonisation of art and technology: philosophic interpretations of artificial intelligence art. Crit Arts 36(1–2):110–125

References

19

Weiss J, Parshall P (2022) The melancholy studio: Albrecht Dürer and Bruce Nauman. Res Anthro Aesthet 77(1):318–350 Vincent J (2023) Getty images is suing the creators of AI art tool Stable Diffusion for scraping its content. The Verge. https://www.theverge.com/2023/1/17/23558516/ai-art-copyright-stable-dif fusion-getty-images-lawsuit. Accessed 17 Jan 2023

Chapter 2

Of Techne and Praxis: Redefining Creativity

Abstract This chapter delves into the evolving relationship between artists and AI, centering on the redefinition of creativity in the context of technological advancements. It explores the limits of creativity, examining the interplay between facts, abstract truths, and AI, and how computational creativity is reshaping traditional notions of artistic expression. The chapter also delves into the exploration of aesthetics in AI art, analyzing existing theories and provoking new thoughts on the intersection of aesthetics and AI-generated content. Additionally, it delves into the ethical considerations surrounding AI art, particularly in terms of authorship and ownership, addressing the complex issues of copyright and the social implications of AI-generated art. The chapter concludes by contemplating future considerations in the realm of AI art, envisioning potential shifts in the understanding of authorship and the ongoing ethical debates surrounding the role of AI in the creative process. Through a comprehensive analysis of these topics, it offers insights into the transformative effects of AI on artistic practices and encourages critical reflection on the ethical and conceptual implications of this evolving relationship.

2.1 The Evolving Relationship Between Artists and AI The relationship between artists and AI is undergoing a profound transformation, redefining the boundaries of creativity and artistic practice. This section delves into the dynamic interplay between artists and AI, exploring the evolving nature of their relationship and the implications it holds for the art world. As AI systems continue to advance in sophistication and capability, artists are compelled to reconsider their role and embrace AI as a collaborator or medium in their creative process. The traditional concept of techne, encompassing skill, craft, and knowledge, is being reshaped by the integration of AI, opening up new possibilities for innovation, experimentation, and expression. As such, this chapter examines the multifaceted dimensions of this evolving relationship, shedding light on the transformative potential of AI in the realm of artistic creation. By navigating the intricacies of this intersection, artists

© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024 J. Hutson et al., Creative Convergence, Springer Series on Cultural Computing, https://doi.org/10.1007/978-3-031-45127-0_2

21

22

2 Of Techne and Praxis: Redefining Creativity

are challenged to reflect on their artistic praxis, reimagining the conventional boundaries and exploring the ethical, social, and cultural implications of AI-generated art (Adiwijaya 2018). Despite the prevailing belief that machines are incapable of creating art, recent developments in computational art have presented a new form of artistic expression. AI programs are now generating poetry, music, visual art, architecture, and design, encompassing a broad range of artistic dimensions (Kurt 2018). In the realm of computational art, AI serves as more than just a tool for creating art; it assumes an active role as an artistic phenomenon. This redefines our traditional notions of artistry and raises philosophical questions about the creative abilities of AI. As well, AIgenerated artworks challenge conventional notions of authorship, as the distinction between human and machine contributions becomes blurred. The involvement of AI algorithms raises questions about the creative input and intent of the artist, as well as the role of the audience in interpreting and engaging with AI-generated art (Kharchenko et al. 2023).

2.1.1 The Limits of Creativity Previous scholarship provides valuable insights into the evolving relationship in question, especially The Creativity Code: Art and Innovation in the Age of AI by du Sautoy (2019). Du Sautoy argues that AI has the potential to revolutionize the way we think about creativity by providing new forms of inspiration and enabling us to explore new dimensions of art and innovation. By incorporating AI into the creative process, artists can tap into its generative capabilities and leverage new abilities to generate novel ideas and augment existing workflows. The function of AI in artistic creativity goes beyond mere automation or replication of human artistic processes. Kurt (2018) argues that AI algorithms exhibit their own creative agency, capable of producing novel and innovative works of art. They engage in a process of exploration, experimentation, and iteration, often generating results that surprise and challenge human artists and audiences alike. The fusion of human and machine creativity opens up new frontiers of artistic possibilities (Kurt 2018). However, this evolving relationship between artists and AI raises important questions about the nature of artistic praxis and the ethical, social, and cultural implications of AI-generated art (Sturm et al. 2019). As artists navigate the intricacies of this intersection, they are challenged to reflect on their artistic practice, reimagining the conventional boundaries and exploring the transformative potential of AI. The integration of AI into the creative process calls for a deeper understanding of the implications and considerations associated with its use, including issues of authorship, originality, and the impact on society and the art world. By examining the multifaceted dimensions of this evolving relationship, valuable insights and perspectives for artists, students, and teachers alike as they navigate the new convergence of AI with the creative process. For instance, when exploring the role of models and templates in the creative process, Du Sautoy emphasizes the

2.1 The Evolving Relationship Between Artists and AI

23

benefits of learning from successful and innovative individuals and organizations, as it can help individuals and organizations develop their own creativity and generate new ideas and solutions. On the other hand, he also acknowledges the potential limitations of relying too heavily on models and templates, as it can lead to a lack of originality and creativity. Therefore, he highlights the importance of finding a balance between learning from others and developing one’s own original and creative ideas. The same can be said of human-AI collaborations. Another significant argument is that AI can enhance human creativity by providing new forms of inspiration and enabling exploration of new dimensions of art and innovation. AI algorithms can generate ideas, analyze data, and identify patterns, making the creative process more efficient and effective, particularly in the realm of exploratory and transformational creativity. However, AI is limited in replicating the unique human touch and context that is integral to imaginative creativity, which is closely tied to human emotion, intention, and meaning. Thus, artists have recognized that AI can serve as a tool that augments and enhances their creative abilities rather than replacing them. By embracing AI as a creative partner, artists can tap into its computational power and explore new artistic territories. AI algorithms can inspire artists with unexpected outcomes, leading to novel artistic expressions (Kurt 2018; Mazzone and Elgammal 2019). While AI brings its own unique capabilities, it is important to recognize the enduring value of human ingenuity and imaginative creativity. AI algorithms may struggle to replicate the deeply personal and emotionally nuanced aspects of human expression. Artists, with their individual experiences, perspectives, and cultural contexts, continue to bring a human touch to the creative process, creating art that resonates with audiences on multiple levels. Such creativity can be leveraged and augmented, but first must be understood. For instance, by relating to Margaret Boden’s three types of human creativity (Table 2.1)—exploratory, transformational, and imaginative—art and technology researchers highlight that AI can significantly benefit human creatives in the formative stages of the creative process, where exploration and transformation are key (Boden 2010; Hong and Curran 2019). The ability of these new Ai tools to generate ideas and identify patterns can support artists and designers in pushing the boundaries of their work. However, the truly original and imaginative aspects of creativity that involve human emotion and intention remain a distinct human capability. Table 2.1 Boden’s three types of human creativity Type of creativity

Description

Examples

Type 1

Use of established algorithms and rules to generate creative outputs

Mathematics, science, engineering

Type 2

Use of chance and exploration to generate new ideas

Art, music, literature

Type 3

Use of intuition and insight to generate new ideas

Psychology, philosophy, social sciences

24

2 Of Techne and Praxis: Redefining Creativity

These three types of creativity encompass diverse approaches to generating new ideas and solutions, highlighting the multifaceted nature of the creative process across various fields. Type 1 creativity involves working within established rules and constraints, while type 2 creativity thrives on chance and exploration, and type 3 creativity relies on intuition and insight. Recognizing and understanding these different types of creativity is particularly relevant in the context of the relationship between artists and AI. While AI algorithms excel in Type 1 creativity, where established rules and algorithms are utilized to generate creative outputs, they can also contribute significantly to Type 2 creativity, which involves chance and exploration (Boden 2010). AI tools can assist artists and designers in the formative stages of the creative process by generating ideas, identifying patterns, and suggesting novel directions for exploration. The computational power of AI enables artists to uncover new possibilities and push the boundaries of their work (Hong and Curran 2019). For example, AI algorithms can analyze vast amounts of data, identify correlations, and generate novel combinations that human artists may not have considered. This exploratory aspect of creativity is enhanced by AI’s ability to process and interpret large datasets, enabling artists to explore new aesthetic possibilities and unconventional approaches (Mazzone and Elgammal 2019). However, when it comes to Type 3 creativity, which involves intuition, insight, and the deeply personal aspects of human expression, AI falls short. The imaginative aspects of creativity, driven by human emotion, intention, and the ability to infuse art with personal meaning, remain a distinct human capability (Boden 2010). Artists possess the unique capacity to draw upon their individual experiences, cultural backgrounds, and subjective perspectives to create art that resonates on a profound level with audiences. Therefore, while AI can significantly benefit artists and designers in the exploratory and transformational stages of creativity, it is crucial to acknowledge the limitations of AI in replicating the deeply human and imaginative aspects of artistic expression. Artists must harness AI as a tool and partner in their creative process while remaining true to their own unique vision and the emotional depth that only human creativity can provide. However, it is important to emphasize that the different types of creativity are not mutually exclusive, and many creative individuals and processes embody a combination of these types (Hong 2021). Additionally, different fields may prioritize one type of creativity more than others. By understanding the diverse nature of creativity, individuals and organizations can foster and support creativity in all its forms, leveraging AI as a tool to enhance and augment the creative process.

2.1.1.1

Facts, Abstract Truths, and AI

The interplay between words and images can be seen in the growing interest in multimodal generative AI where text-to-text and text-to-image seamlessly move between one another in input and output (Akkus et al., 2023; Ananthanagu and Agarwal 2023;

2.1 The Evolving Relationship Between Artists and AI

25

Di Mitri et al. 2023). However, the development of generative AI, including imagebased applications like Stable Diffusion or text-based examples such as ChatGPT, can be seen as part of a larger historical shift in our understanding of knowledge. In pre-modern times, knowledge was structured hierarchically, with abstract principles at the top and specific facts below (Collet-Sabé 2023). Interestingly, this hierarchy gradually reversed, with particular facts gaining prominence over abstract truths (Hengeveld and Mackenzie 2008) and the shift can be traced back to the philosophy of nominalism put forth by William of Ockham in the fourteenth century. Ockham argued against the existence of universal concepts and emphasized the discrete nature of objects, undermining the notion of transcendent frameworks of knowledge and paving the way for empirical approaches that focused on accumulating specific facts (Orr 2020). As knowledge continued to expand exponentially, the need for external tools to store and access information became evident. Vannevar Bush’s concept of the “memex” in 1945 foreshadowed the rise of search engines, which now serve as vast repositories of human knowledge, replacing our own memory and providing instant access to information (Van Dijck 2005). ChatGPT and other generative AI represent the logical progression of this trend, where all knowledge and/or imagery is available at our fingertips through a simple prompt. It reflects a cultural and educational shift underway since the launch of Google in 1998 in our reliance on personally remembering and organizing knowledge towards a culture of instant access to facts (Säljö 2010). However, generative AI, including ChatGPT, cannot provide the abstract frameworks or hierarchies of knowledge that dictate morality, aesthetics, and truth. While algorithms can quickly retrieve information from the internet, they cannot uncover transcendental truths or discern the complex nuances of human values and meaning (Lazer et al. 2021). The responsibility of organizing and interpreting the vast amount of information provided by AI still lies with humans, who must grapple with the task of finding permanent and transcendent truths about concepts like goodness, beauty, and meaning. Generative AI has undoubtedly revolutionized our access to information and ability to create virtually anything visually at any time, but the technology does not possess the capacity to provide the ultimate truths that humans seek. The organization and interpretation of knowledge in a meaningful and hierarchical manner remain distinctively human endeavors, even in the face of AI advancements. This holds true not only for knowledge but also for generative art, where the role of artists and designers in infusing meaning and interpretation into AI-generated works remains indispensable. Computational Creativity By examining the historical precedent and exploring the literature on computational creativity, a nuanced understanding of the evolving relationship between artists and AI in the realm of creativity and artistic practice can be achieved. The field of computational creativity encompasses the study and development of computer systems that exhibit creative behaviour or generate creative outputs. It involves the intersection of

26

2 Of Techne and Praxis: Redefining Creativity

AI, cognitive science, psychology, and computer science, among other disciplines. Computational creativity seeks to understand, model, and simulate human creativity using computational methods and algorithms. In this field, researchers explore various aspects of creativity, including idea generation, problem-solving, artistic expression, and innovation, with the goal of developing computer systems that can autonomously exhibit these creative behaviours. The aim is not to replace human creativity but to augment and enhance it by leveraging computational techniques. Computational creativity involves the development of algorithms, machine learning models, and computational frameworks that can generate novel ideas, produce artistic outputs such as music, visual art, and literature, and engage in creative problem-solving. It also encompasses the study of cognitive processes involved in creativity, such as analogy, conceptual blending, and divergent thinking, and how these processes can be incorporated into computational systems. The field of computational creativity has applications in various domains, including art, design, music, literature, gaming, and even scientific discovery. It offers opportunities for human–computer collaboration, exploring new avenues for innovation, and pushing the boundaries of creative expression and sheds light on the role of AI as an artistic actor and can offer a framework for understanding its implications in the creative process. The International Conference on Computational Creativity, which has been active for over a decade, has been a key platform for researchers and practitioners to explore the intersection of AI and creativity. The papers published in this conference and related literature delve into various aspects of computational creativity, including AI-generated art, music, and literature, as well as the algorithms and methodologies used in these creative processes. For instance, the field of computational creativity includes various disciplines and topics. Pinel and Varshney (2014) discuss the use of computational systems to generate innovative and flavourful culinary recipes through the application of big data techniques. Duch (2006) focuses on the analysis of brain processes to develop algorithms that can generate interesting and novel names. Jordanous (2016) emphasizes the significance of broader perspectives in computational investigations of creativity. In addition to these general discussions, there are papers that explore specific applications of computational creativity. Znidarsic et al. (2016) examine the utilization of conceptual blending in online software composition, while Barreto et al. (2014) investigate the connection between procedural content generation and computational creativity. The domain of music also receives attention in the field of computational creativity, with researchers like Cope (2015) and Carnovalini and Rodà (2020) exploring various aspects of music generation systems. These examples collectively contribute to our understanding of computational creativity by exploring different themes and applications within the field. They demonstrate how computational systems can generate innovative outputs in areas such as culinary arts, name generation, software composition, and music. The insights from these papers collectively contribute to our understanding of the potential and limitations of computational creativity. While computational algorithms can generate new and innovative outputs, it is important to recognize that they are tools that

2.2 Exploring Aesthetics in AI Art: Existing Theories and Provoking New …

27

augment human creativity rather than replace it. Human artists and creators bring their unique experiences, emotions, and cultural contexts to the creative process, adding a distinct human touch that algorithms may struggle to replicate.

2.2 Exploring Aesthetics in AI Art: Existing Theories and Provoking New Thought In the realm of AI-generated art, a fundamental question arises: can existing aesthetic theories and lenses adequately address and interpret the unique aesthetic qualities and implications of AI-generated artworks? Or does AI art, with its distinctive processes and outputs, demand new modes of aesthetic thought? This section delves into the exploration of aesthetics in AI art, examining the tension between established theories and the need for fresh perspectives to comprehend the complexities and nuances of this emerging artistic domain. As AI algorithms play an increasingly prominent role in the creative process, it becomes imperative to critically evaluate and expand upon existing aesthetic frameworks to capture the intricacies and transformative potential of AI-generated art. By engaging in this inquiry, we aim to shed light on the evolving aesthetic landscape shaped by the intersection of AI and art, and to provoke new thought that can enrich our understanding and appreciation of this innovative form of artistic expression. A fundamental aspect of understanding the role of AI in art is to delve into the aesthetics of the field. Aesthetics, a branch of philosophy, delves into the nature of beauty, taste, and the creation and appreciation of art. To appreciate the aesthetics of AI art, it is crucial to consider the historical context and philosophical underpinnings that have shaped our understanding of art and beauty beginning in the early modern era (Dwivedi 2021). For in the Enlightenment era, there was a transition from rationalism to empiricism, where the emphasis shifted from abstract concepts and universal truths to the observation and experience of the natural world. Immanuel Kant (1724–1804), a prominent philosopher of the time, made significant contributions to aesthetics with his theory of beauty and the nature of artistic appreciation (Kant, 1987; Dupré 2008). Kant’s aesthetics, as outlined in his seminal work The Critique of Judgment (1790, 1987) challenged the idea that art serves merely as a means to an end or as a representation of external concepts. Instead, Kant argued that art could be appreciated in its own right, independent of its external function or purpose. He proposed that the judgment of beauty is a subjective experience, rooted in the harmonious interplay between the faculties of understanding and imagination. Furthermore, Kant’s aesthetics introduced the notion of disinterested pleasure, suggesting that true aesthetic appreciation is free from personal interest or utility. This perspective invites us to consider art as a realm where we can engage with the experience of beauty and evoke a reflective response that transcends our everyday concerns (Lehman 2020).

28

2 Of Techne and Praxis: Redefining Creativity

However, as we navigate the realm of AI-generated art, we must also confront the question of authorship and the critique of the Author Function. In his influential essay “What is an Author?” (1969), Michel Foucault challenged the traditional understanding of the author as a singular, original source of meaning and creativity. Foucault argued that the concept of authorship has historically been used as a means of control and authority, limiting the potential for multiple interpretations and diverse creative expressions. In the context of AI art, the question of authorship becomes particularly complex. With AI algorithms generating artworks, the notion of a singular human author is disrupted, raising questions about the role of intentionality, originality, and creativity. The AI system becomes an active participant in the creative process, blurring the boundaries between human and machine agency. By examining Kantian aesthetics and engaging with Foucault’s critique of the Author Function, we can begin to navigate the intricate relationship between AI and aesthetics in the realm of art. This exploration invites us to reconsider traditional definitions of authorship, originality, and creative agency, and to contemplate the new possibilities and challenges presented by AI-generated art. One approach to addressing this question is to consider the different ways in which AI art can be evaluated, including through the use of metrics such as originality, creativity, and technical proficiency (Wang 2019). Previous discussions on AI art have primarily focused on the theoretical and aesthetic aspects of the field. In a study conducted by Ahmed (2020), the author examined AI art within the framework of a design-based praxis originating from the realm of arts and humanities. The study highlighted the adoption of AI as a design element rather than using AI solely for the purpose of design. This approach was evident in ephemeral interactive and immersive media installations, as well as in their permanent manifestations in media museums. Ahmed argued that by materializing intangible humanistic characteristics such as emotions, experiences, senses, and memories, AI should be reconceptualized beyond a mere product or traditional image in the design process. Instead, the interactions between humans and AI-generated art embody AI as a design in itself. However, while these considerations shed light on the role of AI as a design element, they do not directly address the concept of creativity, which has gained increasing attention in recent discourse on AI art. The question of whether AI-generated art can be considered as “art” raises debates surrounding artistic creativity and autonomy. Throughout history, numerous definitions and perspectives on creativity have emerged. For the purpose of this discourse, Csikszentmihályi’s (1988) model provides a valuable framework, consisting of three interconnected elements. First, there is an agreed-upon domain of knowledge. Second, there is an agent who introduces novelty by altering a component within that domain. Third, there are experts in the field who assess whether the novel creation should be accepted into the domain or field. Expanding on this, Jennings (2010) has proposed three criteria for an “agent” to exhibit volition and possess creative autonomy within a system. These criteria encompass autonomous evaluation, where the system can assess the acceptance of its creation without relying on external opinion; autonomous change, where the

2.2 Exploring Aesthetics in AI Art: Existing Theories and Provoking New …

29

system initiates and guides variations on a standard without explicit direction; and non-randomness, where the system’s evaluations are not purely based on random processes. Building upon these concepts, Jennings applies these criteria to AI art and the notion of “creativity.” Applying these criteria to AI systems, Jennings (2010) argues that for an AI system to progress from being a capable apprentice to becoming a creator in its own right, it must possess the ability to independently apply and change the standards it employs. This concept, referred to as “creative autonomy,” represents the system’s freedom to pursue a course of action that is separate from the intentions of its programmer or operator (p. 491). Ajani (2022) acknowledges that creativity is not solely the result of an individual artist or author, as it relies on individual capacity, the acquisition of information, and the judgment of experts in the field. In other words, creativity depends on external validation and cannot exist in isolation. Therefore, the notion of “autonomy” when applied to AI art is contingent upon the judgment of humans with expertise in the relevant domains of art and design. These experts are responsible for determining whether a product can be deemed “creative,” as creativity itself requires external evaluation and validation. The autonomous nature of AI art has been the subject of investigation, leading to the proposal of new criteria for evaluating this emerging genre. Cheng (2022) examines the question of whether AI can be considered creative and puts forth the notion of a new category for AI art. The author highlights the controversy surrounding the sale of the AI Portrait of Edmond de Belamy at Christie’s in 2018, which raised debates about the origin of the artwork and the role of human creativity. Ethical concerns regarding the conventional assessment of art as a means of communication between individuals were also raised. Cheng argues for the need for alternative approaches that go beyond historical perspectives in evaluating AI-generated artworks. To frame the discussion, Cheng draws on Schema Theory as a critical empirical framework that sheds light on the audience’s attitudes towards art based on their artistic identity. Hong and Curran (2019) define schema as “any active processing data structure that organizes memory and guides perception, performance, and thought” (p. 58). Within this framework, Schemata encompass various aspects, including the understanding of art concepts, the audience’s perceptions when judging the work as creative or not, the method of viewing artworks, and more. In contrast to the judging criteria proposed by Jennings (2010) and Ajani (2022), Cheng argues that AI art should be evaluated using different criteria that move beyond the historical framing of traditional artistic works. The author cites the new possibilities offered by AI technologies to explore novel creative processes, the reinterpretation of the psychological processes of human art through computational abstraction, and the creation of entirely new art forms as reasons for adopting alternative criteria.

30

2 Of Techne and Praxis: Redefining Creativity

2.3 Ethics, Authorship, and Social Implications The integration of AI into the realm of art raises profound ethical questions, challenges conventional notions of authorship, and carries significant social implications. This final section explores the complex intersection of ethics, authorship, and social implications in the context of AI-generated art. By examining the ethical dilemmas, shifting landscape of authorship, and potential societal consequences of AI art, we gain a deeper understanding of the multifaceted ethical, artistic, and societal dimensions of AI in the creative realm. One of the primary concerns in AI-generated art revolves around the ethical dilemmas it poses. AI algorithms have the ability to produce artworks, blurring the lines between human creativity and machine-generated output. This raises questions about the originality and authenticity of AI-generated art, as well as the attribution and recognition of artists. Additionally, issues of intellectual property and copyright infringement arise when AI systems generate works that resemble existing styles or infringe upon copyrighted material. The evolving role of the artist is another crucial aspect to consider. AI-generated art challenges the traditional notion of authorship, as it involves algorithms and machine learning that contribute to the creative process. This shift raises questions about the autonomy and creative agency of artists, as well as the collaborative nature of AI systems and human creators. The tension between the role of the artist as a creator and the role of AI as a generative tool needs to be carefully examined and understood. Furthermore, the social implications of AI-generated art extend beyond the art world. The accessibility and democratization of AI tools and platforms have the potential to transform the art landscape, making art creation more accessible to a wider audience. However, it is important to address issues of bias and representation within AI algorithms to ensure that AI-generated art does not perpetuate harmful stereotypes or exclude marginalized voices. Additionally, the environmental impact of new digital art trends, such as the energy consumption associated with non-fungible tokens (NFTs), raises concerns about sustainability and ecological responsibility. By delving into these ethical considerations, we aim to foster a deeper understanding of the complex dynamics between AI, art, and society. It is crucial to engage in thoughtful discourse and develop ethical frameworks that can guide the responsible use of AI in the creative realm. Through critical examination and discussion, we can navigate the ethical complexities and ensure that AI-generated art respects the rights of artists, acknowledges their contributions, and promotes a sustainable and inclusive art ecosystem.

2.3 Ethics, Authorship, and Social Implications

31

2.3.1 Copyright and Ownership The surge of AI-driven art has given rise to pressing ethical concerns regarding copyright, ownership, and the future of art itself. AI generative tools often source imagery indiscriminately from the internet, including copyrighted material, raising questions about the rights and ownership of resulting artworks. Concerns over copyright infringement and debates about the legitimacy of AI-generated art as a distinct genre have become prominent in the art community (Ansari 2022; Murphy 2022; Hazucha 2022). These discussions have been further intensified by recent legal developments surrounding the copyright of AI-created artwork. One of the most important events occurred on February 21, 2023, when the U.S. Copyright Office made a landmark ruling that revoked the initial copyright protection granted to Kris Kashtanova’s comic book, Zarya of the Dawn, which was illustrated using the text-to-image AI program, Midjourney. The updated copyright was limited to the author’s text and arrangement, explicitly excluding the artwork generated by Midjourney. This ruling has brought the application of copyright law to algorithmically created art to the forefront, raising philosophical and practical challenges concerning the human understanding of creativity and the role of AI in artistic production (Ford 2023). While the U.S. Copyright Office grapples with the evolving landscape of intellectual property and the involvement of AI in the creative process, the industry itself has also encountered legal disputes. One notable example is the lawsuit filed by Getty Images against Stability AI, the creators of the popular generative art tool Stable Diffusion, on January 17, 2023. Getty Images claimed that Stability AI “unlawfully copied and processed millions of copyright-protected images” to train its software (Vincent 2023). Stability AI defended its practice of scraping human-created images from the web for training data, citing laws like the US fair use doctrine as protection, while rights holders like Getty Images argued that this constituted copyright infringement. The CEO of Getty Images, Craig Peters, sees the current legal landscape in the generative AI scene as reminiscent of the early days of digital music and hopes this legal action will provide clarity on intellectual property rights. As stated in their press release, Getty Images believes in the potential of artificial intelligence to stimulate creative endeavors and has provided licenses to leading technology innovators for AI training purposes that respect personal and intellectual property rights. Stability AI, on the other hand, allegedly chose to disregard viable licensing options and long-standing legal protections in pursuit of their commercial interests (Vincent 2023). Despite ongoing discussions, legal experts have yet to reach a consensus on the matter. The lawsuit between AI firms and content creators marks a significant escalation in the legal battle over issues of credit, profit, and the future of the creative industries. The similarities between accusations of copyright infringement among artists may remind one of another creative industry that went through a similar shift over two decades ago. In fact, the experiences of the music industry during the rise of digital music sharing platforms in the 2000s provide valuable insights into how the

32

2 Of Techne and Praxis: Redefining Creativity

art industry may respond to AI art generators and image-based generative content (Bakos and Brynjolfsson 2000). Artists and music labels struggled to control the distribution and monetization of their music, leading to legal battles that reshaped revenue generation and monetization models for musicians (Magaudda 2021). The art industry is now confronting similar challenges, as AI art generators pull imagery from datasets gleaned from the internet, raising concerns about the legality of their use and the rights to resulting images (Vincent 2023). The issues of copyright and ownership in AI-generated art have prompted researchers and scholars to propose new frameworks and examine the ethical implications. Shlomit Yanisky Ravid and Oren Bracha argue for a new framework where AI creators are considered “co-authors” of the generated work, with rights and obligations specified in advance through contract (Jung 2020). Others, such as Zhou and Nabus (2023), emphasize the responsibility of artists and designers to consider the ethical implications of AI-generated art, including the potential perpetuation of harmful stereotypes or the exploitation of others’ work. The discussion surrounding AI-generated art must consider principles of transparency, accountability, and fairness, guided by the broader ethical implications of AI. The impact on traditional artists cannot be ignored, as AI art relies heavily on the labor of past and present visual artists. Existing artworks are used to train AI programs, transforming fine art into freely accessible data. This poses a threat to emerging artists, as AI-generated works comparable to their own jeopardize their livelihoods. Instances of unauthorized use of artists’ work in AI training have raised concerns of copyright infringement and fair compensation. At the same time, the field must evolve with the technology as the music industry has. Acknowledging the contributions of traditional artists and addressing the ethical considerations surrounding AI art are crucial steps towards creating a sustainable and inclusive art ecosystem. The reexamination of copyright laws and monetization models is essential in the face of AI art generators and image-based generative content. Institutions that actively incorporate AI into their curricula must also consider the ethical implications and find new ways to support and compensate artists. Striking a balance between innovation and ethical responsibility is paramount to protect artists’ rights and preserve the value of human-made art. The ethical considerations surrounding AI-generated art, particularly in the realms of copyright, ownership, and artist recognition, necessitate thorough examination and the development of appropriate frameworks. By critically evaluating the impact of AI on the art and design landscape, we can foster an environment that upholds artists’ rights and encourages responsible and ethical practices, while simultaneously not hampering the development and use of these new generative tools. As AI continues to evolve, it is vital to navigate these ethical challenges to ensure a sustainable and thriving art ecosystem for all stakeholders involved.

2.3 Ethics, Authorship, and Social Implications

2.3.1.1

33

Future Considerations

Future considerations surrounding the use of AI in art and design extend beyond the current ethical and legal questions. As institutions actively incorporate AI into their curricula, it is vital to ensure that ethical considerations remain at the forefront of AI integration. One of the key areas of concern is the potential for AI to perpetuate harmful stereotypes or biases. AI algorithms are trained on existing data, which may contain embedded biases present in society. If these biases are not addressed and mitigated, AI-generated art runs the risk of further reinforcing discriminatory narratives or exclusionary representations. Artists, designers, and educators have a responsibility to critically examine the data used to train AI models and actively work towards eliminating biases and promoting inclusivity in AI-generated art. Additionally, the ethical implications of AI extend beyond copyright and ownership. The development and use of AI have broader social and cultural impacts that must be carefully considered. This includes concerns about privacy, data security, and the potential for AI to replace or devalue human creativity. It is crucial to engage in ongoing discussions and debates surrounding the ethical implications of AI in art and design, ensuring that decisions and practices align with societal values and principles. As the integration of AI into art and design becomes more widespread, it is essential to proactively address the ethical considerations and challenges that arise. This involves collaboration between lawmakers, artists, designers, educators, and other stakeholders to develop a framework that promotes responsible and ethical use of AI in the creative process. By embracing transparency, accountability, and fairness, we can navigate the evolving landscape of AI art and design in a way that upholds the values of creativity, inclusivity, and ethical practice. Reflecting on the chapter, technology has become an integral part of the creative process, challenging traditional notions of creativity and reshaping the landscape of artistic production. By examining the concepts of techne and praxis, we have gained a deeper understanding of how technology is redefining the very essence of creativity itself. Throughout history, human creativity has been synonymous with individual genius and the ability to generate novel and original ideas. However, the advent of technology has disrupted this traditional paradigm, inviting us to reconsider the nature of creativity and its relationship with technological innovation. We have seen how technologies like artificial intelligence, machine learning, and digital tools have become powerful collaborators in the creative process, expanding the boundaries of what is possible and enabling new forms of artistic expression. One key insight that has emerged from our exploration is the notion of cocreativity, where humans and machines work together in a symbiotic relationship to generate creative outcomes. The collaborative dynamic between human ingenuity and technological capabilities has opened up new avenues for exploration and experimentation, blurring the lines between human agency and technological influence. We have witnessed how artists and designers are embracing these technological tools

34

2 Of Techne and Praxis: Redefining Creativity

as partners, harnessing their potential to unlock new realms of creativity and push the boundaries of artistic practice. However, this new paradigm of co-creativity also raises important questions and challenges. As technology continues to advance at an unprecedented pace, we must navigate the ethical, social, and philosophical implications that accompany these transformative changes. Issues such as algorithmic bias, intellectual property rights, and the impact of technology on cultural heritage require careful consideration and thoughtful discourse. It is crucial that we approach these challenges with a deep understanding of the complex interplay between technology, creativity, and society, striving for responsible and inclusive practices that prioritize ethical considerations and human values. As we move forward, it is clear that the redefinition of creativity through technology will continue to shape our artistic landscapes and cultural narratives. The potential for innovation, collaboration, and democratization of creative expression is immense. It is up to us, as artists, designers, scholars, and society at large, to embrace this new era of techne and praxis with a spirit of curiosity, open-mindedness, and critical inquiry. By doing so, we can unlock the full potential of technology as a catalyst for creativity, enriching our lives, expanding our understanding of the human experience, and fostering a more inclusive and vibrant artistic ecosystem. As such, the fusion of technology and creativity offers us an unprecedented opportunity to reimagine, redefine, and expand our notions of what it means to be creative. It is an invitation to embrace the power of collaboration, to explore new frontiers of artistic expression, and to cultivate a deep appreciation for the ever-evolving relationship between technology and the human creative spirit. By embracing this new paradigm, we can shape a future where creativity knows no boundaries and where technology becomes a catalyst for the limitless possibilities of human imagination.

References Adiwijaya DR (2018) Techne as technology and techne as art: Heidegger’s phenomenological perspective. Int J Creat Art Stud 5(1):13–24 Ahmed D (2022) Senses, experiences, emotions, memories: artificial intelligence as a design instead of for a design in contemporary Japan. Int Build Int 14(2):133–150 Ajani G (2022) Human authorship and art created by artificial intelligence—where do we stand? Dig Ethic Iss Imag 11:253 Akkus C, Chu L, Djakovic V, Jauch-Walser S, Koch P, Loss G, Aßenmacher M (2023) Multi deep learn. arXiv preprint arXiv:2301.04856 Ananthanagu U, Agarwal P (2023) A systematic review and future perspective of mental illness detection using artificial intelligence on multimodal digital media. Intell Sustain Syst 1(1):35–46 Ansari T (2022) How AI transformed the art world in 2022. Analytics India Magazine (AIM). https:// analyticsindiamag.com/how-ai-transformed-the-art-world-in-2022/. Accessed 30 Oct 2022 Bakos Y, Brynjolfsson E (2000) Bundling and competition on the internet. Market Sci 19(1):63–82 Barreto N, Cardoso A, Roque L (2014) Computational creativity in procedural content generation: a state of the art survey. In: Proceedings of the 2014 conference of science and art of video games

References

35

Boden MA (2010) Creativity and art: three roads to surprise. Oxford University Press Cheng M (2022) The creativity of artificial intelligence in art. Proc MDPI 81(1):1 Collet-Sabé J (2023) Pre-modern epistemes inspiring a new global sociology of education imagination. Brit J Soc Edu 1:1–18 Cope D (2015) Computational creativity and music. Comp Creat Res Toward Creat Mach, Atlantis Press, pp 309–326 Carnovalini F, Rodà A (2020) Computational creativity and music generation systems: an introduction to the state of the art. Front Artif Intel 3:14 Csikszentmihályi M (1988) Society, culture, and person: a systems view of creativity. In: Sternberg R (ed) The nature of creativity—contemporary psychological perspectives. Cambridge University Press, pp 325–339 Di Mitri D, Schneider J, Drachsler H (2023) The rise of multimodal tutors in education: insights from recent research. In: Handbook of open, distance and digital education, pp 1037–1056 Duch W (2006) Computational creativity. In: The 2006 IEEE international joint conference on neural network proceedings, pp 435–442 Dupré L (2008) The enlightenment and the intellectual foundations of modern culture. Yale University Press du Sautoy M (2019) The creativity code: art and innovation in the age of AI. The Belknap Press of Harvard University Press, Cambridge, MA Dwivedi PS (2021) Aesthetics and the philosophy of art: Comparative perspectives. Taylor & Francis Ford M (2023) Artificial intelligence meets its worst enemy: the U.S. Copyright Office. The New Republic. https://newrepublic.com/article/170898/ai-midjourney-art-copyright-office. Accessed 3 Mar 2023 Foucault M (1969) What is an author. In: Textual strategies, pp 141–160 Hazucha B (2022) Artificial intelligence and cultural production: possible impacts on creativity and copyright law. Available at SSRN 4028106 Hengeveld K, Mackenzie JL (2008) Functional discourse grammar: a typologically-based theory of language structure. OUP Oxford Hong JW, Curran NM (2019) Artificial intelligence, artists, and art: attitudes toward artwork produced by humans vs. artificial intelligence. ACM Trans Multim Comput Commun Appl 15(2):1–16 Hong, J. (2021). The creativity code: art and innovation in the age of AI by marcus du sautoy. Information & Culture, 56(2), 221-222 Jennings K (2010) Developing creativity—artificial barriers in artificial intelligence. Mind Mach 20:489–501 Jordanous A (2016) Four PPPPerspectives on computational creativity in theory and in practice. Conn Sci 28(2):194–216 Jung G (2020) Do androids dream of copyright? Examining AI copyright ownership, vol 35. Berkeley Tech, LJ, p 1151 Kant I (1987) Critique of judgment. Hackett Publishing Kharchenko P, Chibalashvili A, Savchuk I, Sydorenko V, Khasanova I (2023) Technologies as a mediator between creator and audience in postmodern art practices. Brain 14(1):500–514 Kurt DE (2018) Artistic creativity in artificial intelligence. Radboud University Lazer D, Hargittai E, Freelon D, Gonzalez-Bailon S, Munger K, Ognyanova K, Radford J (2021) Meaningful measures of human society in the twenty-first century. Nat 595(7866):189–196 Lehman RS (2020) Criticism and judgment. ELH 87(4):1105–1132 Magaudda P (2021) Smartphones, streaming platforms, and the infrastructuring of digital music practices. Rethinking music through science and technology studies. Routledge, London, pp 241–255 Mazzone M, Elgammal A (2019) Art, creativity, and the potential of artificial intelligence. Art 8(1):26

36

2 Of Techne and Praxis: Redefining Creativity

Murphy B (2022) Is Lensa AI stealing from human art? An expert explains the controversy. Sci Alert. https://www-sciencealert-com.cdn.ampproject.org/c/s/www.sciencealert.com/ is-lensa-ai-stealing-from-human-art-an-expert-explains-the-controversy/amp. Accessed 15 Dec 2022 Orr J (2020) The discarded mind: from divine ideas to secular concepts. Neue Zeitschrift Für Systematische Theologie Und Religionsphilosophie 62(2):167–189 Pinel F, Varshney LR (2014) Computational creativity for culinary recipes. In: CHI’14 extended abstracts on human factors in computing systems, pp 439–442 Säljö R (2010) Digital tools and challenges to institutional traditions of learning: technologies, social memory and the performative nature of learning. J Comp Assist Learn 26(1):53–64 Sturm BL, Iglesias M, Ben-Tal O, Miron M, Gómez E (2019) Artificial intelligence and music: open questions of copyright law and engineering praxis. Arts 8(3):115 Van Dijck J (2005) From shoebox to performative agent: the computer as personal memory machine. New Med Soc 7(3):311–332 Vincent J (2023) Getty Images is suing the creators of AI art tool Stable Diffusion for scraping its content. The Verge. https://www.theverge.com/2023/1/17/23558516/ai-art-copyright-stable-dif fusion-getty-images-lawsuit. Accessed 17 Jan 2023 Wang JZ (2019) AI and art: a review. ACM Comp Surv 52(5):1–33 Zhou KQ, Nabus H (2023) The ethical implications of DALL-E: opportunities and challenges. Mesopotamian J Comput Sci 2023:17–23 Znidarsic M, Cardoso A, Gervás P, Martins P, Hervás R, Alves AO, Lavrac N (2016) Computational creativity infrastructure for online software composition: a conceptual blending use case. Int Conf Comput Creat Sony CSL Paris, pp 371–379. https://ieeexplore.ieee.org/document/863 7717

Chapter 3

Painting by Numbers: A Brief History of Art and Technology

Abstract This chapter delves into pivotal moments in the history of art and technology, specifically focusing on three significant milestones: the advent of printmaking and the printing press around 1440, the introduction of photography and photomechanical processes in 1839, and the emergence of computer-generated imagery and digital art in the 1960s. These transformative technological advancements have consistently reshaped the practice, reception, and definition of art, laying the foundation for the current era of AI-driven evolution. By closely examining these historical developments, the chapter explores how the reception and valuation of art, as well as artistic expression and perception, have evolved over time, highlighting the profound impact of these shifts within the broader cultural context of art production and consumption. Moreover, the chapter delves into the ethical and philosophical considerations stemming from the integration of art and technology, including discussions on the authenticity of digitally created artworks and the democratization of artistic production. Through a combination of historical insights and contemporary examples, this chapter elucidates the intricate and ever-evolving relationship between art and technology, prompting readers to contemplate the future possibilities and challenges that lie ahead in this dynamic landscape.

3.1 The Art of Disruption Throughout history, the art world has experienced significant disruptions driven by emerging technologies. These disruptions have challenged the established norms and conventions, reshaping the very fabric of artistic practice, perception, and cultural relevance. Each major paradigm shift, marked by transformative moments in technology, has introduced new techniques, mediums, materials, and economic dynamics, while also prompting critical discussions about the social and historical applicability and impact of art. By examining these disruptions, we gain a deeper understanding of the interplay between art and technology and how it has shaped the artistic landscape we know today.

© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024 J. Hutson et al., Creative Convergence, Springer Series on Cultural Computing, https://doi.org/10.1007/978-3-031-45127-0_3

37

38

3 Painting by Numbers: A Brief History of Art and Technology

The advent of printmaking and the printing press around 1440 was a pivotal moment in the history of art and technology. With the ability to reproduce images and texts on a mass scale, printmaking revolutionized the dissemination of knowledge, challenged the authority of handwritten manuscripts, and democratized access to art (Füssel 2020). The printing press allowed artists to reach broader audiences and sparked discussions on the originality and authenticity of art. The shift from handcrafted, one-of-a-kind artworks to mechanically reproduced prints disrupted traditional notions of artistic creation and ownership (Bilyeu et al. 2022). The invention of photography and photomechanical processes in the midnineteenth century brought about another seismic shift in the art world. Photography challenged the dominance of traditional painting and portraiture by offering a new means of capturing and representing the world (Coughlin 2021). With its ability to reproduce reality with precision and accuracy, photography prompted debates about the nature of art, the role of the artist, and the relationship between art and technology. It also had profound implications for the perception of time, memory, and the documentation of historical events (Schwartz and Ryan 2021). The rise of computer-generated imagery and digital art in the 1960s marked yet another significant disruption (Jaskot 2019). The use of computers and digital technologies expanded the possibilities of artistic expression, allowing artists to explore new realms of creativity and challenge traditional boundaries. Digital art pushed the boundaries of the medium, blurring the lines between traditional art forms and emerging technologies. It raised questions about the uniqueness of the artwork, the role of the artist as a programmer or curator of algorithms, and the evolving relationship between the audience and the artwork (Du Preez 2020). In each of these paradigm shifts, emerging technologies have introduced new tools and techniques that have both enriched and disrupted the art world. These disruptions have not only influenced artistic creation but have also transformed the ways in which art is perceived, valued, and consumed. They have sparked debates about the nature of art, the role of the artist, and the impact of technology on the artistic process. By exploring these historical inflection points, we can gain valuable insights into the dynamic interplay between art and technology and better understand the current AI-driven evolution of the art world.

3.1.1 Redefining Art: The Dawn of Modernity Perhaps no debate in the realm of art has been more fiercely contested than the nature, role, and definition of art itself. In the mid-nineteenth century, as noted, the advent of new technologies like photomechanical reproduction challenged the representational requirements of traditional academic art, leading to a reevaluation and subsequent emergence of modern art movements (Larson 2019). This transformative period began with Realism, Impressionism, and Post-Impressionism, each movement questioning and reshaping the purpose of art (Hung et al. 2023).

3.1 The Art of Disruption

39

Fig. 3.1 Gustave Courbet, A Burial at Ornans, 1849–50 (from Wikimedia Commons, licensed under CC0)

The Realist movement, which emerged in the mid-nineteenth century, aimed to depict the world in a straightforward and objective manner (Smith 2020). Artists like Gustave Courbet (1819–1877) rejected idealized depictions and instead focused on representing ordinary people and everyday life. Courbet’s painting A Burial at Ornans (Fig. 3.1) (1849–1850) exemplifies the Realist approach, portraying a funeral scene with raw and unidealized figures. The first notable aspect of the work is its scale (Switzer 2019). The painting measures an impressive 10 feet by 22 feet, emphasizing the importance and significance of the subject matter normally reserved for the grand machines of the Parisian Salons (Langbein 2022). Courbet’s decision to depict a funeral scene reflects his commitment to representing ordinary people and their experiences, rather than focusing on idealized or grandiose themes (Jørgensen and Higonnet 2022). The composition of the painting is carefully arranged, with a central group of mourners and the deceased placed prominently in the foreground. The figures are portrayed with a remarkable level of detail and individuality, showcasing Courbet’s dedication to capturing the unique characteristics of each person. The artist eschews the traditional idealized representation of individuals, instead opting for a raw and unidealized portrayal of the mourners. Courbet’s use of color is subdued, reflecting the somber and solemn atmosphere of the funeral. Earthy tones dominate the palette, with various shades of browns and grays creating a sense of realism and authenticity. The lack of vibrant or exaggerated colors further reinforces the painting’s focus on ordinary life and the mundane. Finally, the brushwork in the painting is precise and meticulous, reflecting Courbet’s technical skill and attention to detail. Each figure is rendered with care, capturing their clothing, facial expressions, and body language. The artist’s emphasis on individuality and capturing the specific features of each person adds depth and humanizes the scene. Through this work, Courbet challenges the traditional conventions of art by focusing on ordinary subjects and capturing the essence of the human experience.

40

3 Painting by Numbers: A Brief History of Art and Technology

Impressionism, which followed the Realist movement, sought to capture fleeting moments and the effects of light and atmosphere on the subject. Artists like Claude Monet (1840–1926), Pierre-Auguste Renoir (1841–1919), and Edgar Degas (1834– 1917) embraced loose brushwork, vibrant colors, and an emphasis on the sensory experience of a scene (Groom and Muir 2021). Monet’s Impression, Sunrise (Fig. 3.2) (1872) is a quintessential Impressionist work, depicting a hazy sunrise over a harbor with loose brushstrokes and a focus on the play of light and color (Alexander et al. 2021). The first notable characteristic of the work is the loose and spontaneous brushwork employed by Monet. The brushstrokes are visible and energetic, creating a sense of movement and immediacy. The use of quick, short brushstrokes contributes to the overall impressionistic style, capturing the essence of the scene rather than providing detailed and precise representations (Cooper 2020). The color palette in the painting is dominated by soft, muted tones, evoking the tranquility and atmospheric conditions of a sunrise. Shades of blues, purples, pinks, and oranges blend seamlessly together, creating a harmonious and ethereal effect. Monet skillfully captures the ephemeral qualities of natural light, allowing the colors to blend and interact on the canvas. The composition is characterized by a sense of immediacy and spontaneity. The horizon line is low, emphasizing the expansive sky and water. The harbor and boats

Fig. 3.2 Claude Monet, Impression Sunrise, 1872 (from Wikimedia Commons, licensed under CC0)

3.1 The Art of Disruption

41

in the foreground are simplified and suggested with minimal details, allowing the viewer’s attention to focus on the play of light and color. The composition is dynamic, with diagonal lines created by the boats and the reflection of the sun on the water, adding a sense of movement and energy to the scene. Monet’s emphasis on capturing the transient qualities of light is evident in the depiction of the sunrise. The sun, represented as a small, radiant orb, casts a warm glow across the water and sky. The reflections of light on the water are rendered with delicate brushstrokes, creating a shimmering effect (Wan 2022). This focus on capturing the ever-changing qualities of light is a hallmark of the Impressionist style. The painting epitomizes the Impressionist desire to convey impressions and sensations rather than detailed representations, leaving room for individual interpretation and engagement. Building on the innovations of the Impressionists, Post-Impressionist artists further explored the possibilities of artistic expression (Rose 2022). Vincent van Gogh’s (1853–1890) bold use of color and expressive brushwork became a hallmark of his style. In works such as Starry Night (Fig. 3.3) (1889), van Gogh conveyed a sense of emotion and personal interpretation, moving beyond the strict representation of the visible world (Mahmood and Ismail 2022). One of the most striking features of the painting is van Gogh’s vivid and intense color palette. The painting is

Fig. 3.3 Vincent van Gogh, Starry Night, 1889 (from Wikimedia Commons, licensed under CC0)

42

3 Painting by Numbers: A Brief History of Art and Technology

dominated by rich blues, deep yellows, and vibrant greens, which create a dramatic contrast and contribute to the overall expressive quality of the work. The swirling strokes of blues and yellows in the night sky give the impression of a dynamic and tumultuous atmosphere, evoking a sense of movement and energy. The use of impasto, a technique in which paint is applied thickly and with visible brushstrokes, is prominent and Van Gogh’s expressive brushwork adds texture and depth to the painting, enhancing its tactile quality. The bold and energetic brushstrokes give a sense of urgency and intensity, reflecting the artist’s emotional state and personal interpretation of the scene. The composition is characterized by a sense of harmony and balance. The night sky dominates the upper half of the painting, with swirling patterns and radiating lines that draw the viewer’s attention towards the bright yellow stars. The cypress tree on the left side of the composition acts as a vertical element that anchors the painting, while the rolling hills and village in the middle ground provide a sense of depth and perspective. Through the use of bold colors and expressive brushwork, van Gogh transcends the limitations of traditional representation, conveying a deeply emotional and subjective interpretation of the scene (Stein 2023). Starry Night is not simply a depiction of a night sky but a reflection of the artist’s inner world and his unique perspective on the beauty and mystery of the universe. Paul Gauguin (1848–1903), another prominent Post-Impressionist artist, sought to convey the spiritual and symbolic aspects of his subjects. His works, like Where Do We Come From? What Are We? Where Are We Going? (Fig. 3.4) (1897–1898), incorporated vibrant colors, simplified forms, and symbolic elements to evoke a deeper meaning. The painting features a horizontal composition divided into three distinct sections, each representing a different stage in human existence (Ole´s 2019). The left side depicts infancy and birth, with a nursing mother and a baby. The center section portrays a group of women in various stages of life, engaged in different activities that symbolize the earthly realm. The right side presents figures and symbols associated with death and the afterlife, suggesting a spiritual and transcendental dimension.

Fig. 3.4 Paul Gauguin, Where Do We Come From? What Are We? Where Are We Going? 1897 (from Wikimedia Commons, licensed under CC0)

3.1 The Art of Disruption

43

Gauguin’s use of vibrant colors is evident throughout the composition. The palette includes bold and saturated hues, such as deep blues, rich greens, and vibrant yellows, which create a sense of visual intensity. The colors contribute to the emotional impact of the painting, reinforcing the symbolic and spiritual aspects of the subjects. Simplified and stylized forms dominate Gauguin’s depiction of figures and objects. The artist reduces the human form to its essential elements, emphasizing the expressive and symbolic qualities. The faces of the figures are rendered with flat and mask-like features, emphasizing the spiritual and timeless aspects of their existence. Symbolism plays a crucial role in Where Do We Come From? What Are We? Where Are We Going? Gauguin incorporates various symbolic elements to convey deeper meanings. For example, the tree in the background represents the Tree of Life, connecting the earthly and spiritual realms. The presence of a crouching figure on the right, reminiscent of a contemplative Buddha, suggests spiritual enlightenment and transcendence (Goddard 2019). The composition and arrangement of the elements in the painting contribute to its overall harmony and balance. Gauguin creates a sense of rhythm and movement through the repetition of curved and diagonal lines, guiding the viewer’s eye across the canvas. The horizontal format of the painting further reinforces the notion of a narrative progression from left to right. The painting invites viewers to reflect on the spiritual and existential aspects of life, emphasizing the artist’s exploration of deeper meanings beyond the surface representation. Through its composition and symbolic choices, Gauguin’s work resonates with a sense of introspection and invites contemplation of the profound questions surrounding human existence. The modern art movements mentioned, and their artists challenged the traditional notions of art, pushing the boundaries of representation and embracing subjective experiences and personal expression. Their works marked a significant shift in artistic practice and set the stage for the revolutionary artistic movements that followed (Duncan and Wallach 2019). And as the twentieth century unfolded, artists such as Henri Matisse (1869–1954) and the Fauves continued to make significant strides in pushing the boundaries of artistic expression, venturing beyond the confines of representational painting. Matisse, known for his bold use of color and expressive brushwork, played a pivotal role in the development of Fauvism, a movement that embraced vibrant and non-naturalistic colors (Haddad et al. 2022). Matisse’s painting The Joy of Life (Fig. 3.5) (1905–1906) exemplifies the Fauvist style, with its intense and saturated hues applied in a seemingly spontaneous manner. The composition is centered around a lush, idyllic landscape, populated with a diverse array of figures engaged in various activities. The painting presents a harmonious and dreamlike setting, where human figures and nature coexist in a vibrant and energetic environment. The figures are depicted in simplified and stylized forms, emphasizing their emotional and expressive qualities (Salus 2021). One of the distinctive features of the Fauvist style evident in this painting is the bold and intense use of color. Matisse employs an exuberant palette of vibrant and non-naturalistic hues, such as bold blues, vibrant greens, fiery reds, and sunny yellows. These colors are applied in broad, expressive brushstrokes, creating a sense of dynamism and vitality. The Joy of Life embodies the Fauvist belief in the expressive

44

3 Painting by Numbers: A Brief History of Art and Technology

Fig. 3.5 Henri Matisse, Le Bonheur de vivre (The Joy of Life), 1905–06 (from Wikimedia Commons, licensed under CC0)

power of color and form. It celebrates the joyous and harmonious aspects of life, presenting a vision of paradise where nature and humanity are intertwined. Matisse’s innovative use of color and bold brushwork reflects his desire to create a visual language that expresses the emotional and spiritual dimensions of existence. In the realm of Cubism, Pablo Picasso (1881–1973) and Georges Braque (1882– 1963) are key figures. Picasso’s painting Les Demoiselles d’Avignon (1907) is regarded as one of the early Cubist works, breaking away from traditional forms and depicting five nude figures with distorted and angular features. The faces of the women are fragmented into multiple perspectives, showing different angles simultaneously, reflecting the influence of African and Iberian art on Picasso’s work (Mallen 2019). One of the key elements of Cubism evident in this painting is the rejection of the traditional notion of space and perspective. Picasso fractures the figures and objects into multiple facets and planes, creating a fragmented and fragmented spatial arrangement. The forms are depicted from different viewpoints, simultaneously presenting various sides of the subjects (Zhao 2023). The color palette in Les Demoiselles d’Avignon is muted, dominated by earthy tones and shades of brown and ochre. The restrained use of color allows the forms and geometric structure to take center stage, emphasizing the formal qualities of the painting.

3.1 The Art of Disruption

45

Braque’s collaboration with Picasso resulted in the development of Analytical Cubism, characterized by the deconstruction and reassembling of objects into fragmented geometric shapes (Mallen 2022). Violin and Candlestick (1910) by Braque exemplifies this approach, with its intricate overlapping forms and geometric patterns. The composition features a violin and a candlestick, both of which are depicted from multiple perspectives and fragmented into various geometric shapes. The objects are deconstructed and reassembled, challenging the viewer’s traditional understanding of form and spatial representation. The overlapping forms create a sense of depth and complexity within the composition. The color palette in the painting is muted, dominated by shades of brown, gray, and black. Braque deliberately avoids vibrant colors, focusing instead on tonal variations and subtle shifts in value. This restrained use of color enhances the emphasis on form and structure, allowing the viewer to focus on the intricate interplay of shapes and patterns. The surface of the canvas is built up with layers of paint, creating a rich and tactile quality. The brushwork is precise and controlled, with visible brushstrokes adding texture and depth to the forms. The violin and the candlestick are depicted in a fragmented and abstracted manner. The objects are dissected into geometric facets, resembling the intricate pieces of a puzzle. The interlocking shapes and overlapping planes create a dynamic visual rhythm, inviting the viewer to engage with the painting from different viewpoints. The intricate overlapping forms, fragmented objects, and geometric patterns demonstrate Braque’s meticulous approach to deconstructing and reconstructing reality. Such works invite the viewer to engage with the painting on multiple levels, challenging traditional notions of representation and embracing a new visual language based on abstraction and fragmentation. Another influential movement during this period was Expressionism, which aimed to convey subjective and emotional experiences through art. The emphasis was on expressing the inner experiences and psychological states of the artist rather than creating a faithful representation of the external world. Bold and distorted forms, vibrant colors, and expressive brushwork were characteristic features of Expressionist artworks, which aimed to evoke powerful emotional responses from the viewer. Wassily Kandinsky (1866–1944), a pioneer of Abstract Expressionism, sought to depict the spiritual and emotional aspects of the world through nonrepresentational forms. His painting Composition VII (1913) (Fig. 3.6) is a prime example of his work, with its dynamic and abstract arrangement of shapes, lines, and colors (Nassar 2021). The painting is dominated by a rich and vibrant color palette. Kandinsky employs a wide range of hues, including bold primary colors such as red, blue, and yellow, as well as secondary and tertiary colors. The colors are applied in a bold and expressive manner, with varying degrees of saturation and intensity. This deliberate use of color contributes to the emotional impact of the artwork, evoking different moods and sensations. Lines play a significant role in Composition VII, serving as both structural elements and expressive marks. Kandinsky employs both straight and curvilinear lines, creating a sense of rhythm and movement. The lines intersect and intersect

46

3 Painting by Numbers: A Brief History of Art and Technology

Fig. 3.6 Wassily Kandinsky, Composition VII, 1913 (from Wikimedia Commons, licensed under CC0)

with the shapes, adding depth and complexity to the composition. Some lines are sharp and defined, while others are more fluid and organic, enhancing the overall dynamism of the painting (House 2020). The painting lacks any recognizable or representational imagery, instead focusing on abstract forms and compositions. The intention of the artist is to transcend the limitations of figurative representation and tap into the viewer’s emotions and spirituality. The non-representational nature of the artwork allows for a more direct and personal connection between the viewer and the painting. The overall effect of the painting is one of visual and emotional intensity. The painting elicits a range of emotions and sensations, inviting the viewer to interpret and engage with the artwork on a personal level. Kandinsky’s exploration of nonrepresentational forms and his ability to evoke spiritual and emotional responses through abstract compositions make the work a powerful example of his work and invites the viewer to experience the power and depth of abstract art, engaging with the painting’s visual language and exploring their own personal responses to the artwork.

3.1.1.1

Rethinking Creativity: Skill, Originality, and Concept in Art

The preceding movements shocked traditional audiences and the academy and these avant-garde artists paved the way for new directions of visual expression to come.

3.1 The Art of Disruption

47

However, it was Marcel Duchamp (1887–1968) who made the most profound rupture with tradition in response to the devastation of World War I (1914–1918). His conceptually driven artworks, known as “readymades,” challenged the prevailing notions of artistic creation and the commodification of art. One of his most iconic readymades, the Fountain, (Fig. 3.7) “created” in 1917, epitomized Duchamp’s radical approach (Bailey 2019). The Fountain was a porcelain urinal that Duchamp presented as an artwork by simply signing it with the pseudonym “R. Mutt” and submitting it to an exhibition (Banz 2020). The primary characteristic of the sculpture is its provocative and subversive nature. Duchamp challenges traditional notions of art and questions the role of the artist as a creator. By selecting an everyday object, the urinal, and declaring it as art, Duchamp challenges the audience’s preconceived notions of what can be considered art. The mere act of signing it with a pseudonym adds an element of mystery and anonymity, further disrupting the conventional relationship between artist and artwork (Girst 2019). The choice of the urinal as the readymade object is deliberate and significant. Duchamp’s selection of such a mundane and utilitarian object raises questions about the nature of art, the boundaries of creativity, and the role of the artist in elevating everyday objects to the realm of art. The urinal’s association with bodily functions

Fig. 3.7 Marcel Duchamp, Fountain, 1917. Philadelphia Art Museum (from Wikimedia Commons, licensed under CC-BY 2.0)

48

3 Painting by Numbers: A Brief History of Art and Technology

and the private sphere adds an additional layer of controversy and challenges societal norms and conventions. In terms of form, Fountain retains the original object’s shape and functionality. Duchamp intentionally refrains from altering or manipulating the urinal, allowing its original design to remain intact. By presenting an unaltered readymade object, the concept behind the artwork is emphasized rather than any physical alteration or craftsmanship. Furthermore, the presentation within an exhibition context is also significant. By submitting the urinal to an exhibition, Duchamp challenges the authority of art institutions and their power to define and legitimize artworks. The act of presenting a mass-produced object as art questions the role of aesthetics, originality, and craftsmanship in the evaluation and appreciation of artworks. Through the Fountain, Duchamp sought to provoke a reevaluation of what constitutes art and to challenge the conventions of artistic production and display. By taking an everyday object, devoid of any artistic manipulation, and designating it as art, Duchamp questioned the prevailing notion that artistic merit lies solely in the artist’s technical skill or craftsmanship. Instead, he emphasized the importance of the artist’s concept and intention in defining art (Hutchings 2021). Duchamp’s subversive act with the Fountain had a profound impact on the art world and paved the way for the development of conceptual art and the idea-based approach to artistic creation. By shifting the focus from the object itself to the ideas and concepts behind it, Duchamp challenged the traditional notions of authorship, craftsmanship, and aesthetic judgment. The significance of Duchamp’s Fountain can be understood through his own words. In a letter to his sister Suzanne, Duchamp wrote, “Whether Mr. Mutt with his own hands made the fountain or not has no importance. He CHOSE it. He took an ordinary article of life, placed it so that its useful significance disappeared under the new title and point of view—created a new thought for that object” (Duchamp 1917; Cojocaru 2022). Duchamp’s emphasis on choice and the transformation of ordinary objects through artistic intention underscored his radical reimagining of art as a conceptual endeavor. Duchamp’s groundbreaking ideas continue to resonate in contemporary art, challenging traditional notions of artistic production and the role of the artist. His questioning of the boundaries and definitions of art has had a lasting impact, influencing subsequent generations of artists and contributing to the evolution of art as an idea-driven practice (Rogers and Halpern 2021). Following World War II (1939–1945), the trajectory of art took a transformative turn, culminating in the emergence of Abstract Expressionism. Artists sought to break free from representational imagery and traditional artistic constraints, embracing abstraction as a means of personal expression (Filreis 2021). One of the prominent figures of this movement was Jackson Pollock (1912–1956), whose innovative “action painting” technique involved dripping and splattering paint onto the canvas. His renowned work No. 5, 1948 (1948) exemplifies the expressive and gestural nature of Abstract Expressionism. The first striking characteristic of the painting is its non-representational nature. There are no recognizable objects or figures in the painting, inviting the viewer to engage with the artwork purely on a visual and

3.1 The Art of Disruption

49

emotional level. The entire canvas is covered with intricate layers of paint, resulting in a densely textured and vibrant surface (Taylor et al. 2002). Pollock’s signature technique of dripping and pouring paint onto the canvas is prominently featured in this work. The artist employed a unique process of laying the canvas on the floor and moving around it, allowing him to work from all sides and angles. This method created a sense of freedom and spontaneity in his brushwork, capturing the essence of his physical gestures and movements. The rhythmic drips, splatters, and overlapping lines create a dynamic visual rhythm that animates the painting. The color palette is dominated by earthy tones, including browns, blacks, and whites, with subtle hints of blue and yellow. The colors blend and interact with each other, blurring boundaries and creating a sense of depth and movement. The layering of paint and the interplay of light and shadow further enhance the three-dimensional quality of the work. The artwork invites the viewer to experience a sense of energy, motion, and freedom. As the movement progressed, artists pushed the boundaries of artistic representation even further. Minimalism emerged as a response to the complexity and emotional intensity of Abstract Expressionism. Artists such as Donald Judd (1928–1994) and Dan Flavin (1933–1996) embraced simple geometric forms and industrial materials, stripping art down to its bare essence (Dreishpoon 2022). Judd’s untitled works, composed of geometrically arranged metal or wood structures, epitomized the minimalist aesthetic. One notable work that exemplifies Judd’s aesthetic and approach is his untitled piece from 1986 (Fig. 3.8). This work, similar to the artist’s other works is composed of geometrically arranged cubes, encapsulates the essence of Minimalism (Weng 2020). The untitled work embraces simplicity and purity of form. The sculptures consist of carefully crafted geometric shapes, often consisting of rectangular or square elements, arranged in a precise and systematic manner. These clean lines and simplified forms create a sense of order and precision, reflecting the minimalist ethos of reducing art to its essential elements. The choice of industrial materials, such as metal, concrete or wood, further emphasizes the minimalist approach. By utilizing these materials, Judd removes any associations with artistic craftsmanship or preciousness. The use of industrial materials also aligns with the movement’s rejection of subjective expression and the desire for a more objective and standardized approach to art. Like Duchamp’s Fountain, the placement of Judd’s sculptures within a gallery or exhibition space is crucial to their formal impact. The works are often positioned directly on the floor or mounted on walls, removing any pedestals or supports that could detract from their clean and minimalist aesthetic. The deliberate integration of the sculptures into the exhibition space blurs the boundaries between the artwork and its environment, emphasizing their objecthood and presence (Fitzgerald 2019). Simultaneously, the rise of Pop Art brought a new visual language to the forefront, incorporating elements from popular culture and mass media (Considine 2019). Artists like Roy Lichtenstein (1923–1997) and Andy Warhol (1928–1987) utilized imagery from dime comic books, romance novels, advertisements, and consumer

50

3 Painting by Numbers: A Brief History of Art and Technology

Fig. 3.8 Donald Judd, Untitled, 1986. Chinati Foundation (from Wikimedia Commons, licensed under CC0)

products to create artworks that blurred the boundaries between high and low culture (Beaty 2012). Lichtenstein’s iconic painting Kiss V (1964) appropriated imagery from comic books, merging the worlds of art and popular culture. Here, the artist employs his signature technique of appropriating comic book imagery and translating it into a large-scale painting. The composition centers around a close-up image of a passionate kiss, taken from a comic book panel. The forms are simplified to their essential elements, utilizing bold outlines and a limited color palette reminiscent of the printing process used in comic books (Frey and Baetens 2019). The use of Ben-Day dots, a technique employed in comic book printing to create shading and texture, is a distinctive feature of Lichtenstein’s work. In Kiss V, the dots are carefully applied throughout the composition, adding a graphic quality and mimicking the mechanical reproduction process of mass media. The dots not only contribute to the visual texture but also serve to flatten the image, blurring the distinction between high art and commercial art (Wolfe 2023). Lichtenstein’s choice of subject matter, a romantic kiss, carries symbolic and cultural connotations. By appropriating this particular moment of intimacy and passion, Lichtenstein elevates it to the realm of fine art, challenging traditional notions of artistic subject matter and hierarchy. The contrast between the highly emotional and personal act of kissing and its mass media depiction emphasizes the tension between individual experience and the pervasive influence of popular culture. By elevating the imagery of comic books and merging it with the language of painting,

3.1 The Art of Disruption

51

Lichtenstein creates a visual dialogue between the realms of art and mass media, inviting viewers to reconsider the boundaries and definitions of artistic expression. Even more so than Lichtenstein, it was Warhol who epitomized the commodification of celebrity culture and mass production within the art world (Greenberg and Jordan 2009). Through his screenprinting techniques and his studio, The Factory, Warhol embraced the replication and mass dissemination of images. His iconic works, such as Campbell’s Soup Cans (Fig. 3.9) (1962) and Marilyn Diptych (1962), challenged notions of originality and authenticity in art (White 2022). Warhol’s work is an exploration of consumerism, media influence, and the blurred boundaries between art and everyday life. Campbell’s Soup Cans consists of a series of thirty-two paintings, each depicting a different variety of Campbell’s Soup. The composition is methodically organized, with each painting displayed side by side in a grid-like format. The repetition of the soup can imagery emphasizes the mass production and uniformity of consumer goods that permeate modern society. Warhol’s approach to the subject matter is characterized by his use of a silkscreen printing technique, which replicates the appearance of mass-produced commercial art. The crisp lines, flat colors, and absence of visible brushwork create a precise and mechanical aesthetic, reminiscent of advertising and consumer packaging. By employing this technique, Warhol challenges the traditional concept of the artist’s hand and the notion of the unique, one-of-a-kind artwork. The choice of Campbell’s Soup cans as the subject matter carries symbolic and cultural significance. These familiar objects represent the ubiquity of consumer products in daily life, while also reflecting the influence of media and advertising in shaping popular culture. By elevating a mundane item to the status of fine art, Warhol questions the boundaries between high and low culture, challenging the established hierarchy within the art world. The repetitive compositions draw attention to the mass-produced nature of consumer goods and the inherent sameness in contemporary society. Each individual soup can painting becomes a fragment of a larger whole, highlighting the uniformity and standardization prevalent in consumer culture. The absence of variation or deviation reinforces the idea of conformity and the power of branding and marketing in shaping consumer choices. As with other examples here, the choice to exhibit the cans in a gallery context further complicates the relationship between art and commerce. By presenting these everyday objects as art, Warhol questions the concept of originality and challenges the traditional expectations associated with fine art. The act of transforming a massproduced product into an artistic statement raises questions about the role of the artist, the value of the artwork, and the commodification of culture. The impact of artists like Lichtenstein and Warhol can be understood through their own artistic philosophies. Lichtenstein once stated, “I am interested in entertaining people, in bringing art to the masses” (Foster 2014). Warhol, known for his provocative statements, famously proclaimed, “In the future, everyone will be world-famous for 15 min” (Willet 2010), reflecting his fascination with celebrity culture and the notion of fame as a commodity.

52

3 Painting by Numbers: A Brief History of Art and Technology

Fig. 3.9 Andy Warhol, Campbell’s Soup Cans, 1962 (from Wikimedia Commons, licensed under CC0)

The artistic movements of the twentieth century, including Pop Art and its incorporation of popular culture, marked a profound shift in the art world. Artists such as Lichtenstein and Warhol challenged traditional artistic practices, redefined representation, and interrogated the role of the artist in contemporary society. Furthermore, these artistic movements were not isolated phenomena but were shaped by the technological advancements of their time. The incorporation of new technologies, such as photomechanical reproduction and screenprinting, allowed artists to engage with mass production, advertising, and the media landscape in innovative ways. These

3.2 From Gutenberg to the Masses: Printmaking and the Printing Press

53

technological shifts not only influenced artistic practice but also had broader social and cultural implications, reshaping the relationship between art and society. Next, we will delve deeper into the transformative moments in the history of art and technology. Through vignettes that span the transition from the early modern to the contemporary world, we will examine specific technological advancements and their impact on the art world. From the invention of the printing press to the birth of photography, from the emergence of computer-generated imagery to the rise of AI-driven art, these moments have shaped artistic practice, reception, and the broader cultural context in which art is produced and consumed. By understanding the historical precedents set by these pivotal moments, we gain a comprehensive perspective on the intricate relationship between art and technology. This understanding not only illuminates the path that has led us to the present era of AI-driven art but also sets the stage for further exploration of its implications and potential. As we navigate the ever-evolving landscape of art and technology, it is essential to critically examine and understand the impact of technological advancements on artistic expression, perception, and the broader societal and ethical dimensions of art. Through this exploration, we aim to foster a deeper understanding of the complex dynamics between art, technology, and society. By grappling with the challenges and opportunities presented by the integration of technology in art, we can shape a responsible and meaningful engagement with AI-driven art and envision the future possibilities for artistic creation, appreciation, and cultural discourse.

3.2 From Gutenberg to the Masses: Printmaking and the Printing Press The invention of the printing press by Johannes Gutenberg in 1440 revolutionized the world of art and information dissemination. This groundbreaking technological advancement enabled the mass production of books and artworks, making them more accessible to a wider audience (Füssel 2020). As a result, printmaking as an art form gained popularity, with artists like Albrecht Dürer producing intricate woodcuts and engravings. These printmaking techniques allowed for the broad and rapid dissemination of artistic ideas, transcending geographical boundaries and reaching audiences across continents (Weiss and Parshall 2022). The printing press played a pivotal role in the cross-pollination of religious and scientific ideas across Europe. It facilitated the exchange of ideas and artistic influences, contributing to the rise of the Renaissance period characterized by a renewed interest in classical art, humanism, and naturalism (Törnqvist 2011). The rapid spread of artistic ideas through printed materials also had far-reaching consequences beyond the art world, influencing the cultural, intellectual, and religious landscapes of Europe, playing a significant role in the advent of the Reformation (Michalski 2013).

54

3 Painting by Numbers: A Brief History of Art and Technology

Fig. 3.10 Gutenberg Bible, BNF Res A71 (from Wikimedia Commons, licensed under CC0)

The transition to this renaissance of ideas was made possible by Gutenberg and his use of moveable type as evinced in the Gutenberg Bible (Fig. 3.10). The monumental work, also known as the 42-line Bible or the B42, marked a significant milestone in the history of printing and the dissemination of religious texts to a broader audience. The Gutenberg Bible exemplifies the collaborative efforts of artists, scholars, and craftsmen who worked together to produce this masterpiece, showcasing the potential of moveable type and illumination in creating visually stunning and informative books (Raven 2020). The preparation of the Bible likely began soon after 1450, and the first finished copies became available in 1454 or 1455 (Della Rocca de Candal 2022). The Gutenberg Bible was the earliest major book printed using mass-produced movable metal type in Europe, signifying the start of the “Gutenberg Revolution” and the age of printed books in the West (Adler 2021). Each page consists of 42 lines, with hand-painted or illustrated details added after the printing process. This combination of typography and visual embellishments showcased the possibilities of printing, creating a visually striking and informative text. The collaborative nature of its production involved the expertise of artisans, illuminators, and craftsmen, working alongside Gutenberg’s innovative printing techniques (Archer-Parré 2020). Of the original edition, approximately 49 copies or substantial portions have survived to this day. These surviving copies bear witness to the enduring legacy of the Gutenberg Bible and its profound impact on the history of printing, religion, and the dissemination of knowledge. These historical editions not only transformed the way books were produced but also paved the way for future advancements in printing technology, democratizing access to information and shaping the course of human history (Mitchell 2022). The advent of relief printing and the advent of moveable type had a profound impact on the art world, especially during the early years of printmaking. Woodblock

3.2 From Gutenberg to the Masses: Printmaking and the Printing Press

55

printing, with its origins in East Asia, involved the intricate process of carving a design into a wooden block, inking it, and transferring the image onto paper. This technique revolutionized the reproduction of images and texts, allowing for the creation of illustrated books, playing cards, and religious imagery on a larger scale than ever before (Chia 2020). An example of the early impact of printing in Europe can be seen in the virtuoso woodblock prints of Dürer, a renowned German artist of the Renaissance period. Dürer’s woodcuts, such as his series of prints on the Apocalypse of 1498 (Fig. 3.11) -capitalizing on the millennial anxiety as a savvy entrepreneur- demonstrate the intricate detail and expressive power that could be achieved through relief printing. Dürer’s prints were widely disseminated, and their popularity contributed to the spread of his artistic style and ideas throughout Europe (Paolicchi 2023). The impact of moveable type and woodblock prints on the art world cannot be underestimated. These techniques democratized access to art and knowledge, enabling the dissemination of ideas, stories, and visual representations to a broader audience. They fostered collaboration between artists, scholars, and craftsmen, fueling a creative atmosphere that led to remarkable artistic achievements and advancements in various disciplines. The innovation of relief printing laid the foundation for future developments in printmaking and set the stage for the technological disruptions that would reshape the art world in the centuries to come (Jarvis 2023). Along with woodblock prints, the development of intaglio printmaking, particularly engraving, had a profound impact on the dissemination of ideas during the Renaissance. Engraving involved the incision of an image onto a metal plate, typically copper, which was then inked, wiped, and transferred onto paper. This technique allowed for more intricate and detailed prints compared to woodblock printing, leading to its popularity among artists of the time (Hughes and Vernon-Morris 2023). Of the artists to adopt the new technique early on was Martin Schongauer (1448– 1491), an Alsatian artist who exemplified the northern interest in capturing various textural appearances. His work The Temptation of St. Anthony (c. 1470–1475) (Fig. 3.12) exemplifies the level of intricacy and expressive power that could be achieved through this medium. Schongauer’s technique demonstrates the potential of engraving to move beyond the broad and blocky lines of woodcuts and capture texture through swelling and tapering of line (Viljoen 2021). In this way, the engraver could differentiate between the scraggly beard of St. Anthony, the scales of demon scampering up his left side, the curling matted fur of the demon clubbing him over his right shoulder and the spiky appendages of the fish-like demon next to it. In the cultivation of new techniques, Dürer also embraced engraving as a new medium. His engravings, such as Knight, Death, and the Devil (1513) (Fig. 3.13), Melencolia I (1514), and Saint Jerome in His Study (1514), would also showcase the meticulous detail and technical mastery that could be achieved through this new intaglio technique (Kostov 2020). Dürer’s meticulous engraving technique is evident in every aspect of the artwork. The fine lines and cross-hatching technique employed in the engraving create an astonishing level of detail and texture. As seen in the first in the series, each element is rendered with precision from the intricate armor of the knight to the texture of the horse’s mane and the intricate patterns on Death’s

56

3 Painting by Numbers: A Brief History of Art and Technology

Fig. 3.11 Albrecht Dürer, Apocalypse, 1498, woodcut (from Wikimedia Commons, licensed under CC0)

3.2 From Gutenberg to the Masses: Printmaking and the Printing Press

57

Fig. 3.12 Martin Schongauer, The Temptation of St. Anthony, engraving (from Wikimedia Commons, licensed under CC0)

58

3 Painting by Numbers: A Brief History of Art and Technology

Fig. 3.13 Albrecht Dürer, Knight, Death, and the Devil, 1513, engraving (from Wikimedia Commons, licensed under CC0)

cloak. The attention to detail is particularly noticeable in the realistic depiction of the knight’s facial features, capturing both his strength and vulnerability. Dürer’s prints were in high demand and widely circulated, playing a crucial role in the transformation in the economics of art and diversifying the art market to include those outside of the clergy and nobility. In such a way, Dürer embraced

3.2 From Gutenberg to the Masses: Printmaking and the Printing Press

59

an entrepreneurial approach as both an artist and a printmaker. He recognized the potential profitability of selling prints and limited editions, which proved to be more lucrative than relying solely on commissioned works from patrons or the Church (Ekserdjian 2023). The mass production and widespread distribution of prints enabled Dürer to reach a larger market and generate substantial sales volumes. One notable example of his success in this venture is the immensely popular Apocalypse series begun upon settling in Nuremberg in 1497. It was at this time that Dürer focused primarily on printmaking as a more reliable income stream compared to pursuing commissions for paintings (Low 2019). Along with his series detailing what the End of Days would look like, he also embarked on an ambitious and innovative plan to create an illustrated edition of the Passion of Jesus, which he worked on concurrently. Dürer not only executed the preparatory drawings for the work but also personally produced the woodblocks for printing the images and text. Similar to his approach in the Apocalypse series, the illustrations in the Passion series were presented as full-page works accompanied by the relevant Biblical verses, allowing viewers to experience the scenes through both visual and textual narratives seamlessly. The series is seminal in the history of the art market for capitalizing on the limitededition series and marketing to different clientele with the larger and more expensive engravings appealing to more wealthy patrons and the smaller woodcuts to lower income consumers (Ellis 2019). The combination of the intricate and detailed nature of engraving, along with the mass production and commercial success of prints, revolutionized the art market during the Renaissance. The entrepreneurial endeavors of Dürer extended beyond his artistic innovations in printmaking. He was also instrumental in the development of copyright protection for artists, demonstrating his forward-thinking approach to intellectual property rights. Announced in his 1511 engraving Imperial Privilege for Albrecht Dürer, Nuremberg, he warns: Woe to you, ambusher of other people’s labor and talent. Beware of laying your rash hand on our work. Know you not what the most glorious Roman Emperor Maximilian has conceded to us?—that no one shall be allowed to re-print these pictures from spurious blocks, nor sell them within the imperial realm. And if you do so, through spite or covetousness, not only will your goods be confiscated, but you will also find yourself in the greatest danger (Dürer 1511).

The warning announces the establishment of a system that would protect his prints from unauthorized copying and ensure their authenticity. He devised a unique solution by seeking permission from Emperor Maximilian I to use the imperial crown insignia and the letter “A” (representing “Albrecht”) as a mark of authenticity on his prints. This act effectively created a form of copyright protection for his works, as it allowed viewers to identify genuine prints authorized by Dürer himself (Klima 2023). By obtaining the emperor’s endorsement, Dürer not only asserted his rights as the creator of these prints but also established a brand identity and a sense of trustworthiness associated with his works. The inclusion of the imperial mark and his

60

3 Painting by Numbers: A Brief History of Art and Technology

personal monogram on his prints became a symbol of quality and authenticity, distinguishing them from unauthorized reproductions and imitations (Kubíková 2019). The innovative approach to protecting intellectual property laid the foundation for future discussions on copyright and the importance of artist’s rights. As such, artists like Dürer and Schongauer not only pushed the boundaries of artistic expression through their engravings but also demonstrated the economic viability of prints as a means of dissemination and financial gain. At the same time, the spread of mechanically reproduced text and images played a crucial role in the dissemination of ideas during a time of immense social and religious change. The Protestant Reformation, sparked by Martin Luther’s Ninety-Five Theses in 1517, upended the authority of the Roman Catholic Church and challenged established religious beliefs (Hendrix 2019). The availability of inexpensive printed materials, including engraved prints, facilitated the rapid spread of such reformatory ideas and enabled them to reach a wide audience, contributing to the momentum of the Reformation. Because of the speed and breadth of distribution possible, printmaking became a powerful tool for disseminating propaganda, shaping public opinion, and fostering intellectual discourse (Soreanu 2020). However, the impact of printmaking extended far beyond religious and political movements. It also played a pivotal role in the exchange of artistic ideas across regions and cultures, fostering the development of a common visual language. Artists capitalized on the medium by creating prints based on their original works, allowing their imagery to reach a broader audience and establishing their reputations beyond their immediate surroundings. One example of this collaborative relationship between an artist and an engraver is the partnership between the high Renaissance artist Raphael Sanzio and the Italian engraver Marcantonio Raimondi (Pon 2021). Raimondi would transform original drawings and designs from Raphael into engravings, such as the The Judgement of Paris (1510–1520) (Fig. 3.14), disseminating the image widely and making it accessible to a broader audience. This collaboration between Raphael and Raimondi not only allowed Raphael’s artistic vision to reach a wider audience but also showcased the technical skills of the engraver and diversified the income of both creators. The exchange of ideas through prints enabled artists to influence and inspire one another, contributing to the development of a shared visual vocabulary. It fostered the growth of artistic movements, such as Mannerism, as artists across Europe absorbed and adapted the styles and techniques showcased in prints. The proliferation of printmaking during this period facilitated a dynamic dialogue among artists, encouraging experimentation and pushing the boundaries of artistic expression (Melo et al. 2022). Printmaking not only served as a means to disseminate religious and secular imagery but also played a crucial role in sharing scientific advancements and ideas across regions and continents. The medium facilitated the rapid spread of anatomical, mathematical, geometrical, and astronomical illustrations, contributing to the progress of various fields of study. One notable example is the work of Andreas Vesalius (1514–1564), a renowned anatomist of the sixteenth century, whose groundbreaking anatomical treatise, De Humani Corporis Fabrica (On the Structure of the Human Body), first published in 1543, revolutionized the understanding of human

3.2 From Gutenberg to the Masses: Printmaking and the Printing Press

61

Fig. 3.14 Marcantonio Raimondi after Raphael, The Judgment of Paris, c. 1510–1520, engraving (from Wikimedia Commons, licensed under CC0)

anatomy. The book featured detailed and accurate illustrations of the human body, showcasing Vesalius’ meticulous dissections and observations (Fig. 3.15). Vesalius’ anatomical prints not only advanced medical knowledge but also influenced the practices of physicians and anatomists across Europe (van der Wal 2020). Another significant example is astronomical treatise, Theatrum Mundi (Theatre of the World), published in 1588 by Gian Paolo Gallucci (1538-ca 1621). According to the astronomer and pedagogue, the work “explains celestial bodies by means of instruments and figures” (Gallucci 1603). The text is structured into six sections, each devoted to describing and mapping the celestial and terrestrial realms comprehensively. It presents a unique perspective by depicting the inferno within the Earth, divided into ten concentric circles. These maps, serving as the inaugural modern celestial atlas, employ a coordinate and trapezoidal projection system. This innovative approach enables precise calculations of star positions, utilizing data derived from the Copernicum catalog (Hutson 2020). Such astronomical prints contributed to the dissemination of Galilean and Copernican theories, challenging the prevailing geocentric view of the universe with Galileo Galilei (McKechnie 2022). The Enlightenment era witnessed the publication of comprehensive works, such as general encyclopedias, which aimed to compile and categorize all human knowledge. One notable example is Encyclopédie, ou dictionnaire raisonné des sciences, des arts et des métiers (Encyclopedia, or a Systematic Dictionary of the Sciences, Arts, and Crafts), better known as Encyclopédie, edited by Jean le Rond d’Alembert (1717–1783). Published between 1751 and 1772, this monumental work included a

62

3 Painting by Numbers: A Brief History of Art and Technology

Fig. 3.15 Andreas Vesalius, De Humani Corporis Fabrica (first published 1543) Johann Oporinus, Basel (from Wikimedia Commons, licensed under CC-BY 4.0)

3.2 From Gutenberg to the Masses: Printmaking and the Printing Press

63

vast array of engraved illustrations covering diverse subjects, ranging from scientific principles and mathematical concepts to illustrations of machinery, screws, and tools (Fig. 3.16). The encyclopedic text and accompanying illustrations played a crucial role in disseminating knowledge and promoting intellectual inquiry during the Enlightenment (Vigier et al. 2020). The availability of printed illustrations enabled scholars, scientists, and artists to share their discoveries and findings with a wider audience, fostering intellectual exchange and contributing to the advancement of various fields of study. The combination of text and visuals in these printed works enhanced the accessibility and comprehensibility of complex subjects, leaving a lasting impact on the scientific and intellectual progress of humanity. But until the nineteenth century, these volumes were out of reach for the general public. Two more inventions had to happen to further democratize information. The first would be the invention of lithography. Developed by the German actor and playwright, Alois Senefelder (1771–1834) in 1796, lithography allowed artists to directly draw on a stone or metal plate using a greasy crayon or ink, and then transfer the image onto paper. The technique provided artists with greater freedom to create spontaneous and expressive marks, contributing to the rise of printmaking as a distinct art form, but also to illustrate new printed materials that could be broadly distributed (Sabour 2021). During the nineteenth century, the spread of popular newspapers played a crucial role in democratizing access to information. These newspapers, such as The Time (originally The Daily Universal Register founded in 1785) in London and Le Figaro in Paris (founded in 1826), became widely available to the general public, first with just text but later offering a combination of printed text and illustrations. This integration of text and visuals allowed for the mass production and dissemination of ideas, as well as the emergence of popular culture (Quayson and Watson 2023). Illustrations became an essential component of these newspapers, enabling them to engage and captivate readers with visual storytelling and informative imagery (Meadows 2002). One notable example of the impact of popular culture and printed editions can be seen in France during the July Monarchy (1830–1848). This period witnessed the rise of illustrated newspapers and magazines, such as Le Charivari (1832–1937) and La Caricature (1830–1843) (Fig. 3.17), which used lithography to create satirical and political cartoons. These publications played a significant role in shaping public opinion and critiquing the social and political climate of the time, especially the lithographs of Honoré Daumier (1808–1879) (Larson 2022). The combination of accessible print technologies and the integration of illustrations allowed for the widespread dissemination of ideas, fostering a culture of visual literacy and public engagement. The advent of lithography and the popularization of illustrated newspapers transformed the landscape of printmaking and information dissemination. These developments not only empowered artists to explore new creative possibilities but also made knowledge and visual culture more accessible to a wider audience. The intersection of printmaking, popular culture, and technology during this period laid the foundation for the modern media landscape, setting the stage for further advancements in mass communication and the integration of images and text (Mainardi 2017).

64

3 Painting by Numbers: A Brief History of Art and Technology

Fig. 3.16 Denis Diderot and Jean Le Rond d’Alembert. Glassware in Bottles, Encyclopédie ou dictionnaire raisonné des sciences, des arts et des métiers, (1751–1772) Frankrijk, Parijs (from Wikimedia Commons, licensed under CC0)

3.3 Photography: The Democratization of Representation

65

Fig. 3.17 Honoré Daumier, Le Cauchemar (The Nightmare), lithograph, La Caricature no. 69, February 23, 1832 (from Wikimedia Commons, licensed under CC0)

The advancements in printmaking throughout the course of history have had a significant influence on artistic expression, the exchange of ideas, and cultural dissemination. These developments transformed the accessibility of knowledge, providing artists with the means to reach broader audiences and sparking intellectual and artistic movements. The invention of the printing press and the subsequent evolution of printmaking techniques played a crucial role in shaping pivotal periods such as the Renaissance and the Enlightenment, fueling artistic and intellectual exploration. However, the disruptive force of technology did not stop there, as the emergence of photography further revolutionized the art world by enabling an even more precise reproduction of visual phenomena.

3.3 Photography: The Democratization of Representation In the Industrial Age, the concept of art and the role of the artist underwent a profound transformation, largely influenced by the emergence of photography as a new pictorial medium. Whereas printmaking represents an early step towards an exactly repeatable pictorial medium, photography would advance the precision with which one could capture the appearance of the natural world (Eskilson 2019). Photography made its

66

3 Painting by Numbers: A Brief History of Art and Technology

debut in the early nineteenth century and swiftly revolutionized the world of visual arts, challenging traditional notions of representation. The birth of photography as a medium can be attributed to the patenting of the daguerreotype by Louis Daguerre in 1839. The daguerreotype process involved exposing a silver-plated copper plate to light, resulting in a direct positive image (Fig. 1.8). Although intricate and time-consuming, the process garnered immense popularity due to its remarkable ability to capture highly detailed and permanent images. The chemical treatment and exposure times required careful precision, ranging from several seconds to several minutes. As a result, daguerreotypes became prized possessions for individuals seeking to immortalize their loved ones, commemorate significant events, or capture detailed landscapes (Barger and White 2000). One prominent example of the early impact of photography is the work of French photographer Félix Nadar (1820–1910). Renowned for his portraits, Nadar captured images of notable figures of the time, including writers, artists, and politicians. His famous portrait of French author and poet Charles Baudelaire (Fig. 3.18), taken in 1855, showcases the precision and level of detail achievable through the daguerreotype process (Paigneau 2019). However, daguerreotypes were not well suited to mass production and were thus not adopted for illustrations in newspapers and other popular media. Another significant advancement in the field of photography would set to solve that limitation and was the introduction of the wet plate collodion process, which allowed for greater ease and efficiency in image production. This technique, introduced by Frederick Scott Archer (1813–1857) in 1851, involved coating a glass plate with a collodion solution and sensitizing it with silver nitrate, enabling shorter exposure times. The wet plate collodion process became the dominant photographic method throughout the mid-nineteenth century, providing artists with greater flexibility and creative possibilities (Kontou et al. 2023). The widespread adoption of photography had a profound impact on the representation of various subjects, from portraiture to landscapes and historical events. For instance, the photographs of Mathew Brady (1822–1896), often referred to as the “father of photojournalism,” during the American Civil War documented the realities of war, presenting a new perspective on the conflict to the public. His images presented a new perspective on the conflict, showing the harsh conditions, the devastation, and the human cost of war (Coddington 2022). Among his most notable photographic series is The Dead of Antietam (Fig. 3.19) taken in 1862. This photograph captures the aftermath of the Battle of Antietam, one of the bloodiest battles in American history. The image shows a field strewn with fallen soldiers, presenting a somber and poignant depiction of the human toll of war. This photograph, along with other war images by Brady, played a crucial role in shaping public perception of the Civil War, providing a visual testament to its brutality and impact (Hazard 2023). In parallel to the daguerreotype, another significant development in photography emerged in the same year. William Henry Fox Talbot introduced the calotype process, also known as the talbotype, in 1839. Unlike the daguerreotype, which produced a direct positive image on a copper plate, the calotype process utilized a paper negative from which multiple positive prints could be made. This groundbreaking innovation

3.3 Photography: The Democratization of Representation

67

Fig. 3.18 Félix Nadar, Charles Baudelaire, 1855 (from Wikimedia Commons, licensed under CC0)

made photography more accessible and reproducible, revolutionizing the medium and paving the way for its democratization. The calotype process involved sensitizing a sheet of paper with silver iodide, exposing it in a camera to capture the image, and then developing it through a chemical process. Talbot’s calotype offered several advantages over the daguerreotype. Not only could multiple prints be made from a

68

3 Painting by Numbers: A Brief History of Art and Technology

Fig. 3.19 Mathew Brady, The Dead of Antietam, 1862 (from Wikimedia Commons, licensed under CC0)

single negative, but the calotype also provided a softer, more tonally varied image. This flexibility and reproducibility democratized photography by allowing for the mass production and distribution of images (Daher et al. 2019). One notable example of the impact of the calotype process is Talbot’s own work, including his series The Pencil of Nature (1844–1846) (Fig. 3.20), which became the first commercially published book illustrated with photographs. Through this publication, Talbot demonstrated the potential of photography as a means of visual documentation and artistic expression. The Pencil of Nature featured a range of subjects, from landscapes and architectural studies to stilllives and portraits, showcasing the versatility and artistic potential of the calotype process (Halkyard 2021). Furthermore, the significance of the series extends beyond its technical achievements. It effectively bridged the gap between the scientific and artistic realms, positioning photography as a viable and accessible art form. By demonstrating the artistic possibilities of photography, Talbot’s series played a pivotal role in popularizing the medium and expanding its reach beyond scientific circles (Lipton and Lipton 2021). The accessibility and reproducibility offered by the calotype process also played a significant role in the advancement of scientific photography. For instance, Anna

3.3 Photography: The Democratization of Representation

69

Fig. 3.20 William Henry Fox Talbot, The Pencil of Nature (1844–1846), calotype (from Wikimedia Commons, licensed under CC0)

Atkins (1799–1871), a British botanist and photographer, utilized the calotype process to produce her groundbreaking work Photographs of British Algae: Cyanotype Impressions (1843–1853) (Fig. 3.21). Atkins’s publication, considered the first book illustrated entirely with photographs, utilized a variant of the calotype process known as cyanotype to capture intricate details of algae specimens. Her work not only contributed to the scientific understanding of botany but also exemplified the democratizing potential of photography in the field of scientific illustration (Franchi 2023). At the same time, the advent of photography had a profound impact on the established art academies of Europe and the Americas. These academies, which were institutions responsible for the training and education of artists, were compelled to grapple with the emergence of this new medium and its implications for traditional artistic practices. The Royal Academy of Arts in London (founded in 1768), for instance, had to consider the inclusion of photography as a medium within the realm of fine art and adapt curriculum accordingly (Lee 2020). The Academy initially resisted accepting photography as a legitimate artistic form, viewing it as a threat to the traditional artistic disciplines. The École des Beaux-Arts in Paris, (established in 1648) initially held a similar stance to the Royal Academy, dismissing photography as a lesser form of art. However, as the medium gained recognition and popularity,

70

3 Painting by Numbers: A Brief History of Art and Technology

Fig. 3.21 Anna Atkins, Photographs of British Algae: Cyanotype Impressions (1843–1853), cyanotype (from Wikimedia Commons, licensed under CC0)

3.3 Photography: The Democratization of Representation

71

photography was also incorporated into its curriculum, reflecting the changing landscape of the art world (Kremnitzer 2022). Finally, in the United States, the National Academy of Design in New York, founded in 1825, played a significant role in the reception and acceptance of photography as an art form. Like the other institutions, the Academy initially maintained a conservative approach towards photography, but as its artistic merits became increasingly evident, the National Academy embraced the medium and provided opportunities for photographers to exhibit their work alongside more traditional forms of art (McCoy 1972). Photography not only impacted academic curricula but also had a profound influence on traditional art forms, particularly painting. The precision and accuracy of photography in capturing realistic images raised questions about the purpose of traditional representational art (Snyder and Allen 1975). Photography offered an alternative means of representation that was perceived as more objective and truthful (Mnookin 1998). This new challenge presented itself to established art institutions that had upheld the principles of academic art. The emphasis on meticulous technique and faithful representation was called into question as photography demonstrated its ability to faithfully reproduce reality. As noted, the Impressionists, such as Monet (Fig. 3.2) and Renoir, would draw inspiration from the fleeting effects of light and atmosphere that photography struggled to capture at the time (Sgourev 2021). Other artists would incorporate compositional strategies and cropping techniques used in photography, resulting in dynamic compositions and intimate moments as in the works of Degas and Manet (Staub 2019). Freed from the constraints of representation, painting followed by sculpture could explore other forms of human experience and expression. As photography continued to shape the field of fine art, significant advancements were made throughout the nineteenth and twentieth centuries that left a lasting impact on the visual arts. Among these developments, the introduction of tintypes (commonly known as ferrotypes) in the 1850s was particularly noteworthy. Tintypes offered a cost-effective and durable alternative for portrait photography. Their affordability and resilience made photography accessible to a broader range of individuals, further democratizing the medium (Caverhill and Thomson 2022). Another significant breakthrough came with the invention of roll film by George Eastman (1854–1932) in 1888. This innovative technology replaced the earlier glass plate negatives, revolutionizing the photographic process. Roll film brought efficiency and convenience to photographers, allowing them to capture multiple exposures without the need for bulky equipment. This advancement expanded their ability to capture a wider range of subjects and fleeting moments, enhancing the artistic possibilities of photography (Sturchio 2020). The introduction of tintypes and roll film exemplified the continuous progress of photography, enabling greater accessibility, efficiency, and creative freedom for artists. These advancements played a vital role in shaping the visual arts, influencing the way photographers approached their craft and expanding the medium’s potential for artistic expression. The introduction of color photography marked yet another milestone in the evolution of the medium. Although early experiments with color photography were made, it was the introduction of Kodachrome film by Kodak in 1935 that practical and

72

3 Painting by Numbers: A Brief History of Art and Technology

widely accessible color film emerged. Kodachrome offered a pioneering color reproduction process that utilized layers of dye to capture and preserve colors with remarkable accuracy and vibrancy. This breakthrough allowed photographers to delve into the realm of color, exploring the rich interplay of hues, tones, and shades within their compositions (Pope 2020). With color photography, artists gained the ability to experiment with color relationships, infuse their works with distinct moods and atmospheres, and evoke emotions in ways that surpassed the limitations of black and white photography. One notable advancement in color photography was This development revolutionized the field, enabling photographers to embrace color as a powerful element in their artistic expression. Advancements in color photography continued, leading to the development of various color processes and techniques. The emergence of color film and the accessibility of color printing enabled photographers to create vibrant and visually captivating images. Artists such as William Eggleston (1939–), Saul Leiter (1923–2013), and Ernst Haas (1921–1986) embraced color photography as a means of artistic expression, capturing the beauty and nuances of the world in vivid hues (Fig. 3.22). The availability of color photography also influenced other visual art forms. Painters and other artists drew inspiration from color photographs, incorporating the vibrant palettes and dynamic compositions seen in photographs into their own works (Froger 2021). The exploration of color and its impact on artistic representation became a

Fig. 3.22 Nam June Paik, TV Buddha, 1974 (from Wikimedia Commons, licensed under CC-BY 2.0)

3.4 Digital Art and the Rise of the Machines

73

central focus in many artistic movements and styles, further blurring the boundaries between photography and other visual arts. The influence of photography on the visual arts and the traditional art academies cannot be overstated. It challenged established conventions and forced artists to reconsider their approaches to representation and artistic expression. The democratization of photography provided new opportunities for artists and individuals to capture and document the world around them, while also contributing to the everevolving dialogue between technology and artistic practice. Reflecting on the history of photography, we recognize its transformative power as a medium that revolutionized visual representation, challenged traditional artistic practices, and paved the way for the exploration of new artistic territories. From the daguerreotype to color photography, each technological development left an indelible mark on the visual arts, pushing artists to experiment, innovate, and redefine the boundaries of artistic expression.

3.4 Digital Art and the Rise of the Machines The emergence of computer-generated imagery and digital art in the 1960s brought about a revolution in the field of art, paving the way for innovative approaches that pushed the boundaries of traditional artistic practices. This technological leap marked a natural progression in the adoption of new technologies within the realm of the arts, following in the footsteps of earlier transformative advancements such as printmaking and photography. Early pioneers like Frieder Nake (1938–), Georg Nees (1926–2016), and Vera Molnar (1924–) played a pivotal role in this transformation by exploring algorithmic and computational approaches to artmaking. Nake, a German computer scientist and artist, delved into the use of algorithms and computer programs to create abstract visual compositions. His work Grid Picture (1965) is a prime example of his exploration of systematic structures and mathematical algorithms in art (Franco 2022). The composition of the work is based on a strict grid structure, which serves as the foundational element of the artwork. The grid consists of a series of horizontal and vertical lines, creating a network of intersecting lines that form a regular pattern. The lines are precisely aligned and evenly spaced, emphasizing a sense of order and geometric precision. The color palette is minimalistic and restrained, allowing for focus on the underlying structure and geometry of the grid, highlighting the formal qualities of the composition. The repetitive nature of the grid creates a sense of rhythm and pattern within the artwork. The precision and regularity of the grid system suggests a mathematical logic and computational precision inherent in Nake’s approach to artmaking. Georg Nees, another influential figure in early digital art, focused on the use of algorithms to generate visual forms and patterns. His work Sine Curve Studies (1969) employed mathematical formulas to create intricate and precise geometric shapes (Oliveira 2021). The composition of the work is based on the mathematical concept of sine curves and, therefore, consists of a series of curved lines that form sinuous

74

3 Painting by Numbers: A Brief History of Art and Technology

patterns and variations. These curves are generated through algorithmic calculations, with each line representing a segment of the sine function. The curves are precisely defined and plotted with mathematical accuracy. The lines are executed with great precision and smoothness, giving the artwork a sense of fluidity and elegance. The curves appear to flow seamlessly from one segment to another, creating a harmonious visual rhythm. The repetition and variation of the curves contribute to the overall dynamism of the composition. Regardless of the specific format, the artwork of Nees often features a high level of detail and precision, showcasing his meticulous approach to computational aesthetics. Vera Molnar, a Hungarian-born artist, also embraced the computational nature of artmaking, employing algorithms and mathematical formulas to produce geometric abstractions. Her work Interruptions à recouvrements (1969) (Fig. 1.12) exemplifies her exploration of systematic structures and the combination of mathematical concepts with artistic expression. Molnar, a pioneer in the field of computer art, employed mathematical algorithms to create intricate and visually captivating compositions (de Almeida 2020). The composition here is based on a grid structure, with intersecting lines forming a network of geometric shapes. The artwork consists of a series of repetitive patterns, each defined by mathematical calculations and algorithmic rules. The lines intersect and overlap, creating a sense of complexity and visual depth. The scale and size of the work of Molnar can vary, as the artwork can be produced as a print or displayed on a computer screen. Regardless, the potential of mathematical algorithms and computational processes in artistic creation is explored by each of these artists. Their artwork exemplifies their innovative approach to computer-generated art, challenging traditional notions of artmaking and embracing the possibilities offered by technology. The significance of these early pioneers lies in their ability to bridge the gap between art and technology, demonstrating the creative potential of computer-generated imagery. Their works not only challenged established artistic practices but also laid the foundation for the emergence of the digital art movement. By embracing algorithmic and computational approaches, they paved the way for future artists to explore the possibilities of technology in artistic creation (Paul 2023). The development of software tools like Adobe Photoshop and Illustrator in the 1980s had a transformative impact on the field of digital art, ushering in a new era of artistic possibilities. These powerful programs revolutionized the way artists worked with images, offering unprecedented capabilities for manipulation and creation. Artists now had access to a vast array of digital brushes, filters, and effects, enabling them to experiment with color, form, and composition in ways that were previously unimaginable. First released in 1988, Adobe Photoshop (Fig. 1.3) quickly became an essential tool for digital artists. Its ability to manipulate and enhance images opened up a world of creative possibilities. Artists could now seamlessly blend multiple images, alter colors and textures, and apply various effects to create visually striking compositions. With Photoshop, digital artists could experiment and iterate their ideas with ease, pushing the boundaries of artistic expression (Sugiarto et al. 2021). Likewise, Adobe Illustrator, introduced in 1987, revolutionized the creation of vector-based graphics. This software allowed artists to create scalable and precise

3.4 Digital Art and the Rise of the Machines

75

illustrations, giving them the flexibility to work across various mediums and sizes. Artists could now create intricate and detailed digital artwork that retained its quality at any scale. Illustrator enabled artists to explore new forms of visual expression, blurring the line between traditional art forms and digital creations (Wang 2021). As such, the introduction of these software tools had a profound impact on the field of digital art. Artists embraced the digital medium, pushing the boundaries of creativity and challenging traditional art forms. They could seamlessly blend digital and traditional techniques, incorporating elements from photography, painting, and illustration into their digital compositions. The distinction between traditional and digital art began to blur as artists embraced the unique capabilities of these software tools. The accessibility and versatility of software like Photoshop and Illustrator also democratized the field of digital art. Artists no longer needed expensive equipment or specialized training to create digital works. The digital medium became more accessible, allowing a broader range of artists to explore and express their creative visions. The impact of software tools like those released by Adobe on the field of digital art cannot be overstated. They revolutionized the creative process, enabling artists to manipulate images, explore new forms of expression, and blur the boundaries between traditional and digital media. These tools continue to shape the landscape of digital art, providing artists with the means to push the boundaries of their creativity and create visually stunning compositions that captivate audiences worldwide (Zhang 2020). During this period, a new form of art known as new media art emerged, encompassing various digital and multimedia art forms. Prominent artists like Nam June Paik (1932–2006) and Jenny Holzer (1950–) played significant roles in shaping this movement and exploring the potential of digital technology in their artistic practices. Paik, often regarded as the “father of video art,” was a pioneering figure in integrating television sets, video projections, and electronic devices into his installations (Trail 2021). His works challenged traditional notions of art and the role of technology in society. One notable example is his installation TV Buddha (1974), where a Buddha statue faces a television monitor displaying a live feed of the statue itself. The seminal installation artwork that combines technology and spirituality, exploring the relationship between Eastern philosophy and Western media culture (Holling 2020). The artwork features a television set placed in front of a traditional Buddha statue, creating an intriguing juxtaposition of ancient and modern elements. The Buddha sits in a meditative pose, radiating tranquility and serenity. Positioned in front of the Buddha, the television displays a live video feed of the Buddha itself. This creates a reflective loop where the Buddha observes its own image on the screen, blurring the boundaries between the real and the mediated (Lim 2019). The contrast between the traditional and the contemporary is heightened through the use of materials. The Buddha statue is typically made of stone or other traditional materials, while the television represents the cutting-edge technology of the time. This juxtaposition invites viewers to contemplate the intersection of spirituality and the mass media culture that was becoming increasingly prevalent in the twentieth

76

3 Painting by Numbers: A Brief History of Art and Technology

century. Light plays a significant role in the artwork. The glow emitted by the television screen illuminates the Buddha, creating a dramatic visual contrast between the darkness surrounding the installation and the ethereal light emanating from the screen. This interplay of light and darkness adds a sense of mystery and spiritual ambiance to the artwork. The use of technology is both symbolic and transformative. By placing the Buddha statue in front of a television, Paik highlights the influence of media and technology on our perceptions and understanding of spirituality. The live video feed reinforces the idea of constant observation and surveillance, drawing attention to the pervasive presence of media in our lives. The artwork prompts contemplation about the effects of media on our perception and understanding of traditional values and spiritual practices. The new media artist’s innovative use of video and technology blurred the boundaries between art and media, creating immersive and thought-provoking experiences. Jenny Holzer is renowned for her provocative use of text and LED displays, utilizing digital technology to communicate social and political messages in public spaces. Her site-specific LED text installation 7 World Trade Center (2006) (Fig. 1.14) engages with the architectural space and provokes reflection on the significance of the location. The artwork consists of scrolling LED text displayed on the facade of 7 World Trade Center, a building situated in Lower Manhattan, New York (Holzer 2021). The text is projected onto the building’s surface in large, bold letters, commanding attention and inviting viewers to engage with the message. The scrolling nature of the text creates a dynamic and ever-changing visual experience. The content of the text is crucial to the artwork’s meaning and impact. Holzer’s works often incorporate words and phrases that address social, political, and cultural themes. In the context of 7 World Trade Center, the text may explore concepts related to memory, loss, resilience, and the rebuilding of the World Trade Center site after the tragic events of September 11, 2001. The use of LED technology adds a contemporary and luminous element to the artwork. The bright and vibrant colors of the LED lights contrast with the surrounding architectural elements, drawing attention to the message and creating a striking visual impact. The movement of the scrolling text adds a sense of urgency and dynamism to the overall composition (Luger 2015). Through the use of scrolling text, vibrant LED lights, and a site-specific approach, Holzer engages viewers with social and cultural themes while also acknowledging the unique context of the World Trade Center site. The artwork invites reflection, sparks dialogue, and serves as a poignant tribute to the resilience of the human spirit. The rise of digital art and new media art during this period was closely intertwined with the rapid advancements in computer technology. Artists embraced the possibilities offered by digital tools and techniques, pushing the boundaries of creativity and exploring new avenues for experimentation, interactivity, and multimedia integration. The use of computer-generated imagery, virtual reality, interactive installations, and internet-based art became prevalent, expanding the scope of artistic expression. Simultaneously, there was a growing recognition and acceptance of digital art within the art world. Museums and galleries started exhibiting and collecting digital artworks alongside more traditional forms of art. Institutions like the Museum of

3.5 Reflecting Humanity: Artificial Intelligence in Art

77

Modern Art (MoMA) and the Whitney Museum of American Art played significant roles in showcasing and legitimizing digital art through dedicated exhibitions and acquisitions (Morigi 2004). The recognition provided digital artists with a platform to share their work and contributed to the integration of digital art into the broader artistic discourse.

3.5 Reflecting Humanity: Artificial Intelligence in Art AI has made significant strides in the field of art, revolutionizing various artistic domains and pushing the boundaries of creativity. The history of AI in art can be traced through different themes and periods, each marked by specific developments and examples that have transformed the landscape of artistic expression (Cetinic and She 2022). During the early stages of AI development from the 1950s to the 1990s, significant progress was made in the field of generative models. Two notable models, Hidden Markov Models (HMMs) and Gaussian Mixture Models (GMMs), emerged in the 1950s and were primarily employed for generating sequential data (Patel and Rao 2010). These models allowed for the generation of data that followed a specific sequence, enabling applications such as speech recognition and handwriting synthesis. Building on this foundation, the concept of N-gram language modeling gained prominence in the 1960s and 1970s (Room 2020). N-grams are sequences of words or characters that occur together frequently in a given language. Language models based on N-grams paved the way for sentence generation, allowing AI systems to generate coherent and grammatically correct sentences based on learned patterns and probabilities. A significant breakthrough in sequence prediction tasks came in 1997 with the introduction of Long Short-Term Memory (LSTM) neural network architecture (MA et al. 2015). LSTMs were designed to address the challenge of capturing long-term dependencies in sequential data, which is essential for tasks like speech recognition, machine translation, and text generation. By introducing memory cells and gating mechanisms, LSTMs enabled the learning of complex dependencies over extended periods, facilitating more accurate and contextually meaningful sequence predictions. The development of these generative models marked important milestones in the advancement of AI. They expanded the capabilities of AI systems to generate sequential data, including sentences and sequences of events. The ability to generate coherent and contextually appropriate text has applications in various fields, such as natural language processing, text generation, and dialogue systems. These advancements laid the foundation for subsequent developments in AI, leading to the emergence of more sophisticated generative models and approaches. The impact of AI on the visual arts became particularly significant in the 2000s and 2010s, ushering in a new era of image generation and manipulation. One pivotal breakthrough was the introduction of Generative Adversarial Networks (GANs)

78

3 Painting by Numbers: A Brief History of Art and Technology

in 2014, which revolutionized the field by enabling the creation of realistic and high-quality images through the interplay between a generator and a discriminator (Gauthier 2014). GANs have since become a powerful tool for artists and designers, allowing them to generate visually appealing and diverse images that push the boundaries of traditional artistic creation. In the same year, another significant development emerged with the advent of Variational Autoencoders (VAEs) (Figueira and Vaz 2022). VAEs enabled the compression and decompression of data, which facilitated the generation of high-quality images. By learning latent representations of data, VAEs enabled artists to explore different visual styles and generate novel compositions. Building on these advancements, the year 2016 saw the introduction of StackGAN, a system that utilized two GANs to generate high-resolution images based on text descriptions. This breakthrough allowed for a more precise and detailed synthesis of images from textual input, enabling artists to bring their visions to life with greater fidelity (Zhang et al. 2018). Shortly thereafter in 2017, StyleNet emerged as a notable development, aiming to generate attractive captions for images and videos with different styles. This innovative approach added a new dimension to the creative process, allowing artists to explore the interplay between visual and textual elements in their works (Gan et al. 2017). The advancements in AI during the 2000s and 2010s have transformed the visual arts and music composition, offering artists and musicians new tools and techniques for creative expression. The development of GANs, VAEs, and other AI algorithms has expanded the boundaries of artistic creation, enabling artists to explore new visual styles, generate realistic images, and compose original music compositions. The integration of AI in these fields has not only challenged traditional artistic practices but also opened up exciting avenues for innovation and experimentation. In recent years, there have been exciting advancements in generative tools for art creation that continue to push the boundaries of AI-driven creativity. One notable development is Midjourney, an AI model that uses style transfer to transform images and videos into various artistic styles. Another breakthrough is Stable Diffusion, which focuses on creating stable and controllable generative models for image synthesis. Additionally, DALL-E 2, an extension of the original DALL-E model, enables the generation of high-quality images from textual prompts, showcasing the power of language-guided image generation. Most recently, Adobe introduced Firefly, a generative AI tool that allows artists to experiment with dynamic and interactive visual effects in real-time. These advancements highlight the ongoing progress in generative tools, providing artists with new avenues for creative exploration and further blurring the boundaries between human and AI-generated art. The advent of AI in art production has opened up new possibilities for artists, challenging traditional notions of creativity and expanding the boundaries of artistic expression. Several artists have been at the forefront of using AI in their creative processes, harnessing its capabilities to generate innovative and thoughtprovoking artworks. Memo Akten (1975–), a Turkish artist based in London, for example, has explored the artistic potential of deep learning models. His work

3.5 Reflecting Humanity: Artificial Intelligence in Art

79

Distributed Consciousness (2021) (https://www.memo.tv/works/distributed-consci ousness/) delves into the cognition of the octopus, using AI to simulate synthetic alien intelligences. The project pushes the boundaries of AI-generated art, as it raises profound questions about the nature of intelligence and the intricate relationship between humans and machines. Through the use of deep learning models, Akten aims to provoke contemplation on the complexity and diversity of consciousness beyond human comprehension (Berio et al. 2017; Deterding et al. 2017). The integration of robotics in the field of art has seen a notable rise, with artists using these technological tools to push the boundaries of creative expression. Sougwen Chung, a multidisciplinary artist born in China, raised in Canada, and currently based in London, has made significant contributions in this domain. She has developed a unique and collaborative approach to artmaking with her robots, collectively known as D.O.U.G. (Drawing Operations Unit: Generation_1) (https:// sougwen.com/project/drawing-operations). These robots, driven by AI and recurrent neural networks, learn to draw in the artist’s own style. This innovative use of AI and robotics allows for a dynamic and interactive exploration of the creative process. Through performances and installations, Chung engages in a dialogue between human and machine, blurring the lines of authorship and challenging traditional notions of creativity (Schnugg 2019). The collaborations between Chung and her robots not only challenge conventional ideas of authorship but also explore the concept of embodied AI. By working alongside the robots, Chung examines the potential of collaborative partnership, emphasizing the symbiotic relationship between humans and machines. These interactions raise thought-provoking questions about the role of technology in art, the boundaries of creativity, and the evolving definition of artistic collaboration. While some artists explore cutting-edge technologies, others find a compelling balance between traditional media and the possibilities offered by artificial intelligence. One such artist is Linda Dounia, an artist and curator from Senegal, born in 1994. Her artistic practice combines generative adversarial networks (GANs) with traditional materials, resulting in a unique blend of AI-generated and analog art. By training AI models on her own works, Dounia investigates the capacity of AI art to convey spontaneity and meaning. Her NFT (non-fungible token) project Dust is Hard to Breathe (2022) (https://nft.artsy.net/artwork/linda-dounia/dust-is-hardto-breathe/6/) showcases the curated outputs of a generative adversarial network, engaging with themes of identity, resistance, and the limitations of AI-generated art (Boucher 2023). The exploration of identity is a central focus in the work, as the artist contemplates the intersection of human expression and the inherent limitations of AI. By utilizing generative adversarial networks, Dounia creates thought-provoking art pieces that challenge conventional notions of artistic authorship and the boundaries of creativity. Other artists investigate algorithmic biases with their work. British media artist Jake Elwes (1993–) employs AI to question the ways in which computer systems are trained and the biases they may contain. His video piece Zizi—Queering the Dataset (2019) (https://www.jakeelwes.com/project-zizi-2019.html) inserts the faces of drag

80

3 Painting by Numbers: A Brief History of Art and Technology

performers into existing facial recognition datasets, challenging the limited representation of marginalized identities. By intentionally intervening in these datasets, Elwes aims to expose the limitations and biases that exist within AI algorithms and raise awareness about the potential consequences of such biases in real-world applications. His work sheds light on the importance of diverse and inclusive data sets in the development of AI technologies, emphasizing the need for fair and equitable representation. Elwes’s artistic exploration of algorithmic biases goes beyond mere critique. Through his art, he seeks to empower marginalized communities and give voice to those who have been historically underrepresented or misrepresented. By challenging the limitations of AI systems, he opens up a dialogue about the ways in which technology can be harnessed to support and uplift these communities rather than perpetuate societal biases (Voto 2022). These artists, alongside others, have embraced AI as a powerful tool for artistic creation, giving rise to profound questions about authorship, creativity, and the future of art in the digital age. By pushing the boundaries of AI-generated art and exploring its vast potential, they actively contribute to the ongoing dialogue surrounding the intersection of art and technology. As this brief review of the intersections of technology and art attests, throughout history, technological advancements have played a pivotal role in shaping the definition, production, and reception of art. From the Renaissance to the present day, each new technological leap has brought about fresh possibilities and presented artists with new challenges, transforming the very nature of artistic creation and redefining the perception of visual culture. The adoption of groundbreaking technologies such as the printing press, photography, and digital art has revolutionized the production and dissemination of artistic works, allowing for increasingly realistic, rapid, and even automated creative processes. As technology has advanced, the focus on the intrinsic value of the physical art object has gradually shifted towards the exploration of concepts and ideas behind the visual manifestations. In this rapidly evolving landscape, artists have consistently sought to challenge traditional notions of art and break free from established conventions. They have ventured into uncharted territories, embracing technological innovations as means of expanding the horizons of artistic expression. These visionary artists recognize that art is not confined to a specific medium or traditional form, but rather a reflection of the human condition and perpetual quest for discovery and innovation. Therefore, generative AI merely represents the latest frontier in this ongoing journey of artistic exploration and redefinition. It has realized what artists like Manet sought to challenge in the Salon des Refusés in 1863—the notion of what constitutes art (Arscott 2021). By blurring the boundaries between human and machine-generated creativity, generative AI has expanded the possibilities of artistic production, offering new tools and techniques for artists to explore; it has become a powerful catalyst for innovation, enabling artists to push the boundaries of their imagination and create art that was previously unimaginable. With generative AI, the creative process has become a collaboration between human artists and intelligent machines, challenging traditional notions of authorship, ownership, and artistic agency and prompting us to reconsider the role of the artist

References

81

and the meaning of artistic expression. The value of art now lies not only in the final product but also in the process, the concept, and the exploration of new possibilities. Moreover, the integration of AI in art invites us to question and redefine the very essence of creativity and the role of agency in human-AI collaboration. As technology continues to evolve, so too will our understanding and appreciation of art produced with it. The dynamic relationship between technology and art will continue to refine and redefine what art is, how it is produced, valued, and used in society. The boundaries will be pushed further, and new paradigms will emerge. Artists, scholars, and society at large must engage in ongoing dialogue and critical reflection to navigate the complexities of this ever-changing landscape.

References Adler PJ (2021) The curating city: a functional account of the agglomeration of creative industries. University of California, Los Angeles Alexander RG, Venkatakrishnan A, Chanovas J, Macknik SL, Martinez-Conde S (2021) Microsaccades mediate perceptual alternations in Monet’s “Impression, sunrise.” Sci Rep 11(1):1–8 Archer-Parré C (2020) Places, spaces and the printing press: trade interactions in Birmingham. Mid Hist 45(2):145–160 Arscott C (2021) James McNeill Whistler. A companion to impressionism, p 234 Bailey (2019) Rethinking Marchel Duchamp’s fountain. In: Creative Collaboration in Art, Practice, Research & Pedagogy. Cambridge Scholars Publishing, p 247 Banz S (2020) Marcel Duchamp: Richard Mutt’s fountain. Les presses du réel Barger MS, White WB (2000) The daguerreotype: nineteenth-century technology and modern science. JHU Press Beaty B (2012) Comics versus art. University of Toronto Press Berio D, Akten M, Leymarie FF, Grierson M, Plamondon R (2017) Calligraphic stylisation learning with a physiologically plausible model of movement and recurrent neural networks. In: Proceedings of the 4th international conference on movement computing, pp 1–8 Bilyeu E, Ferreira K, Peterson L, Weber CM (2022) Introduction to new media art. Understanding New Media Art Boucher B (2023) 6 artists who were using artificial intelligence before ChatGPT. Art. https://www. artsy.net/article/artsy-editorial-6-artists-artificial-intelligence-chatgpt Caverhill H, Thomson C (2022) Kinscapes, counter histories, and nineteenth-century tintypes. Vict Rev 48(1):28–32 Cetinic E, She J (2022) Understanding and creating art with AI: review and outlook. ACM Trans Multi Comp Commun Appl 18(2):1–22 Chia L (2020) Printing and publishing in East Asia through circa 1600: an extremely brief survey. Mediaevalia 41(41):129–162 Coddington RS (2022) The camera is the eye of history. Milit Imag 40(220):56–59 Cojocaru M (2022) The creative solution: privileged things as heroic objects. Philosophia 50(2):473– 486 Considine L (2019) American pop art in France: politics of the transatlantic image. Routledge Cooper CN (2020) The influence of japonisme in Claude Mone’ts impression, sunrise. Doctoral dissertation, Kent State University Coughlin M (2021) Material ecologies in the Géniaux Brothers’ picture archive of Brittany, ca. 1900. Photo Multi 71. In Ubiquity: Photography’s Multitudes. Leuven University Press

82

3 Painting by Numbers: A Brief History of Art and Technology

Daher C, Languille MA, de Mondenard A, Becka M, Garnier C, Tournié A, Lavédrine B (2019) Spectroscopic characterization of selected French paper negatives (1843–1856): how to see through many processes? Microchem J 149:104069 de Almeida J (2020) The dot and the line: drawing amongst computers. A companion to contemporary drawing, pp 407–429 Della Rocca de Candal G (2022) The circulation of printed books among cultural minorities in the Ottoman Empire (1450–1600)—an overview. Rencontres 7:81–103 Deterding S, Hook J, Fiebrink R, Gillies M, Gow J, Akten M, Compton K (2017) Mixed-initiative creative interfaces. In: Proceedings of the 2017 CHI conference extended abstracts on human factors in computing systems, pp 628–635 Dreishpoon D (ed) (2022) Modern sculpture: artists in their own words. University of California Press Duncan C, Wallach A (2019) The museum of modern art as late capitalist ritual: an iconographie analysis. In: Grasping the world. Routledge, pp 483–499 Du Preez A (2020) Approaching Aby Warburg and digital art history: thinking through images. In: The Routledge companion to digital humanities and art history, Routledge, pp 374–385 Dürer A (1511) Imperial privilege for Albrecht Dürer, Nuremberg (1511). In: Bently L, Kretschmer M (eds) Primary sources on copyright (1450–1900). Germanisches Nationalmuseum, Nuremberg Ekserdjian D (2023) Albrecht Dürer: art and autobiography. Reaktion Books Ellis JW (2019) Albrecht Dürer’s large passion: art, history, and theology. J Soc Pol Sci 2(3):492–513 Eskilson SJ (2019) Graphic design: a new history. Yale University Press Figueira A, Vaz B (2022) Survey on synthetic data generation, evaluation methods and GANs. Math 10(15):2733 Filreis A (2021) 1960: when art and literature confronted the memory of world war II and remade the modern. Columbia University Press Fitzgerald M (2019) Maximising minimalism. Art Mon Aust 314:50–55 Foster H (2014) The first pop age: painting and subjectivity in the art of Hamilton, Lichtenstein, Warhol, Richter, and Ruscha. Princeton University Press Franchi S (2023) Crafting and collecting cyanotypes: Anna Atkins’s photographs of British algae: cyanotype impressions. Lit Comp, p 12708 Franco F (2022) Interview with Frieder Nake: interview recorded in Bremen, 7 March 2017, and Venice, 20 October 2017. The algorithmic dimension: five artists in conversation. Springer International Publishing, Cham, pp 101–125 Frey H, Baetens J (2019) Comics culture and Roy Lichtenstein. Art Hist 42(1):126–152 Froger L (2021) Phillip Prodger, Ernst Haas: New York in color: 1952–1962. Critique d’art. Actualité internationale de la littérature critique sur l’art contemporain Füssel S (2020) Gutenberg. Haus Publishing Gallucci GP (1603) Coelestium corporum et rerum ab ipsis pendentium accurata explicatio per instrumenta, rotulas et figuras. Venice Gan C, Gan Z, He X, Gao J, Deng L (2017) Stylenet: generating attractive visual captions with styles. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3137–3146 Gauthier J (2014) Conditional generative adversarial nets for convolutional face generation. Class project for Stanford CS231N: convolutional neural networks for visual recognition. Winter Semester 2014(5):2 Girst T (2019) “That very funny article”, pollyperruque, and the 100th anniversary of Duchamp’s Fountain. Nord J Aes 28(57–58):48–64 Goddard L (2019) Savage tales: the writings of Paul Gauguin. Yale University Press Greenberg J, Jordan S (2009) Andy Warhol, prince of pop. Laurel Leaf. Groom G, Muir K (2021) Impression, improvisation, and premeditation. In: A companion to impressionism, p 129

References

83

Haddad A, Pastorelli G, Ortiz Miranda AS, Ludvigsen L, Centeno SA, Duvernois I, Zycherman L (2022) Exploring the private universe of Henri Matisse in The Red Studio. Herit Sci 10(1):1–25 Halkyard S (2021) A lecture upon the shadow: William Henry Fox Talbot’s the Pencil of Nature. PN Rev 47(4):0_2–0_2 Hazard AM (2023) Marketing the dead of Antietam: photographs of death as a cultural commodity. Civ War Hist 69(1):9–41 Hendrix SH (2019) Reformation by accident? Martin Luther’s ninety-five theses of 1517. In: LotzHeumann U (ed) A sourcebook of early modern European history. Routledge, pp 153–155 Holling H (2020). Archival activations: writings by Nam June Paik. Metropolis M. Holzer J (2021) Covid-19/expose. Crit Inq 47(S2):S121–S122 House J (2020) Composition VII. Doctoral dissertation, Bowling Green State University Hughes ADA, Vernon-Morris H (2023) Printmaking bible, revised edition: the complete guide to materials and techniques. Chronicle Books Hung J, Sidó A, Veress D, Hansen J, Ira J, Klement J, Tompkins A (2023) Experiments and avantgardes in modern history (ca. 1800–1900) Hutchings P (2021) Marcel Duchamp and JL Austin: readymades and performative utterances. Lit Aesthet 31(2) Hutson J (2020) Gallucci’s commentary on Dürer’s’ four books on human proportion’: renaissance proportion theory. Open Book Publishers, p 226 Jarvis J (2023) The Gutenberg parenthesis: the age of print and its lessons for the age of the internet. Bloomsbury Publishing USA Jaskot PB (2019) Digital art history as the social history of art: towards the disciplinary relevance of digital methods. Vis Res 35(1–2):21–33 Jørgensen SB, Higonnet MR (2022) Core essay. Landscapes of realism: rethinking literary realism in comparative perspectives. In: Volume II: Pathways through realism, p 367 Klima A (2023) Entwined meanings and organic form at the prague cathedral royal oratory. In: Sullivan AI, Sweeney K (eds), Lateness and modernity in medieval architecture. Brill, pp 237– 261 Kontou T, Mills V, Nichols K (2023) Frederick Scott Archer, ‘on the use of collodion in photography’: the chemist, March 1851. In: Victorian material culture. Routledge, pp 445–447 Kostov RI (2020) The enigma of the polyhedron and five-fold symmetry in Dürer’s “Melencolia I”. Symm Cult Sci 31(4):417–424 Kremnitzer K (2022) Manet and photography: looking at Olympia. Hist Photo 46(1):20–30 Kubíková B (2019) The image of princess and Queen Anne of Bohemia and Hungary in the Habsburg dynasty self-presentation. Umeni/art 67(4):270–293 Langbein J (2022) Laugh lines: caricaturing painting in nineteenth-century France. Bloomsbury Publishing Larson B (2019) The birth of modernism: how the science of aesthetics created one of the most popular periods of art. In: On art and science: Tango of an eternally inseparable duo, pp 67–79 Larsen SE (2022) Caricature and realism. In: Gottsche D, Mucignat R, Weninger R (eds) Landscapes of realism: rethinking literary realism in comparative perspectives. Volume II: Pathways through realism, p 287 Lee TC (2020) Anatomy and academies of art II—a tale of two cities. J Anatomy 236(4):577–587 Lim TS (2019) Moving meditation: June Nam Paik’s TV Buddha and its Zen Buddhist aesthetic meaning. Dao 18:91–107 Lipton L, Lipton L (2021) Fox Talbot’s photography. The cinema in flux: the evolution of motion picture technology from the magic lantern to the digital era. Springer, Newyork, NY, pp 67–74 Low UW (2019) Then I saw: the influence of Albrecht Dürer’s apocalypse as paratext. Relig Arts 23(4):341–359 Luger M (2015) Poetry as monument: Jenny Holzer and the memorial poems of 9/11. Mem Stud 8(2):183–196 Ma X, Tao Z, Wang Y, Yu H, Wang Y (2015) Long short-term memory neural network for traffic speed prediction using remote microwave sensor data. Trans Res Part C Emerg Tech 54:187–197

84

3 Painting by Numbers: A Brief History of Art and Technology

Mahmood AH, Ismail IN (2022) A cognitive study of profiling in Vincent van Gogh’s (1889) the starry night. Diy J Hum Res 4(93):753–765 Mainardi P (2017) Another world: nineteenth-century illustrated print culture. Yale University Press Mallen E (2019) Pablo Picasso: the Aphrodite period (1924–1936). Liverpool University Press Mallen E (2022) The impact of Cezanne in early cubism. Int J Cult Hist 9(1):1–41 McCoy G (1972) Photographs and photography in the archives of American art. Arch Am Art J 12(3):1–18 McKechnie TS (2022) History of the telescope and its remarkable contribution to scientific discovery (and the 400-year journey from Galileo to a rigorous general theory of imaging through Earth’s turbulent atmosphere). In: McKechnie TS (ed) General theory of light propagation and imaging through the atmosphere. Springer International Publishing, Cham, pp 1–22 Meadows MS (2002) Pause & effect: the art of interactive narrative. Pearson Education Melo HP, Cruz AJ, Valadas S, Cardoso AM, Helvaci YZ, Candeias A (2022) Italian influence in a Portuguese mannerist painting (Part II): a matter of image or a matter of technique? Stud Conserv, 68:7, 747–759. https://doi.org/10.1080/00393630.2022.2119726 Michalski S (2013) Reformation and the visual arts: the sprotestant image question in Western and Eastern Europe. Routledge Mitchell AC (2022) The Bible project and the sensorium: opening spaces for new media ecologies. New Explor Stud Cult Comm 2(2):1–23 Mnookin JL (1998) The image of truth: photographic evidence and the power of analogy. Yale JL Hum 10:1 Morigi M (2004) New media, new museum practices? Museums Respond to the Challenges of Digital Art Nassar S (2021) The cornerstone imprint of Kandinsky in the history of abstract art. RAIS J Soc Sci 5(2):77–81 Ole´s PK (2019) The Paul Gauguin syndrome: a great life change. In: Lebuda I, Glˇaveanu VP (eds) The Palgrave handbook of social creativity research. Palgrave Macmillan, Switzerland, pp 317–334 Oliveira J (2021) Computer art in Portugal? Art Mus Dig Cult 94–106. https://run.unl.pt/bitstream/ 10362/135432/1/Art_Museums_and_Digital_Cultures_ebook_2021_med_res_94_106.pdf Paigneau D (2019) Baudelaire, Delacroix, Nadar. Enjeux de la représentation de soi, de l’autre et du monde. Act Iass Comp 1(23):11–22 Paolicchi A (2023) Lutheran apocalyptic imagery in the Orthodox Context. In: Arts, vol 12, no 3. MDPI, p 99 Patel I, Rao YS (2010) Speech recognition using hidden Markov model with MFCC-subband technique. In: 2010 International conference on recent trends in information, telecommunication and computing. IEEE, pp 168–172 Paul C (2023) Digital art. Thames & Hudson Pon L (2021) Raphael and Marcantonio Raimondi as readers of Virgil. In: Oberhelman S, Abbamonte G, Baker P (eds) Habent sua fata libelli Brill, pp 188–202 Pope N (2020) The reception of Kodachrome sheet film in American commercial photography. Tech Cult 61(1):1–41 Quayson A, Watson JK (eds) (2023) The Cambridge companion to the city in world literature. Cambridge University Press Raven J (ed) (2020) The Oxford illustrated history of the book. Oxford University Press Rogers HS, Halpern MK (2021) Introduction: the past, present, and future of art, science, and technology studies. In: Rogers H, Halpern M, Hannah D, de Ridder-Vignone K (eds) Routledge handbook of art, science, and technology studies. Routledge, pp 1–46 Room C (2020) Natural language generation. Algorithms 10(18):06 Rose S (2022) Post-impressionism: universal, british, global. Art Hist 45(3):546–569 Sabour WA (2021) Developing the waterless lithography printmaking process. Int Des J 11(1):393– 402 Salus C (2021) Poetic transformations in Matisse’s earliest dance images. Dan Res 39(1):6–32

References

85

Schnugg C (2019) Aesthetics. In: Creating ArtScience collaboration: bringing value to organizations, pp 113–135 Schwartz JM, Ryan JR (2021) Introduction: photography and the geographical imagination. In: Picturing place. Routledge, pp 1–18 Sgourev SV (2021) Materiality as a basis for valuation entrepreneurship: Re-modeling impressionism. Org Sci 32(5):1235–1255 Smith JK (2020) Scoundrels, cads, and other great artists. Rowman & Littlefield Publishers. Snyder J, Allen NW (1975) Photography, vision, and representation. Crit Inq 2(1):143–169 Soreanu C (2020) From media to mediums of expression. Visual art communication and meaning from fine arts to advertising. Anast Res Med Cult Art 7(2):261–276 Staub L (2019) Revisiting Renoir, Manet and Degas: impressionist figure paintings in contemporary Anglophone art fiction, vol 145. Narr Francke Attempto Verlag Stein SA (2023) Van Gogh’s cypresses. Metropolitan Museum of Art Sturchio J (2020) Festschrift: experimenting with research: Kenneth Mees, Eastman Kodak and the challenges of diversification. Sci Mus Gro J (13): 1-21. Sugiarto E, Kurniawati DW, Febriani M, Fiyanto A, Imawati RA (2021) Computer-based art in folklore illustration: development of mixed media digital painting in education context. In: IOP Conference Series: materials science and engineering, vol 1098, no 3. IOP Publishing, p 032017 Switzer A (2019) Realism contested: Jean Améry’s Charles Bovary, country doctor. In: Améry J (ed) Beyond the mind’s limits, pp 313–339 Taylor RP, Micolich AP, Jonas D (2002) The construction of Jackson Pollock’s fractal drip paintings. Leonardo 35(2):203–207 Törnqvist G (2011) The geography of creativity. Edward Elgar Publishing Trail G (2021) Constructing a case for the first truly global contemporary medium. Art Mon Aust 328:68–71 van der Wal J (2020) De fabrica humani corporis—fascia as the fabric of the body. In: Lesondak D, Akey AM (eds) Fascia, function, and medical applications. Routledge, London, pp 3–18 Vigier D, Moncla L, Brenon A, Mcdonough K, Joliveau T (2020) Classification des entités nommées dans l’Encyclopédie ou dictionnaire raisonné des sciences des arts et des métiers par une société de gens de lettres (1751–1772). SHS Web Conf EDP Sci 78:11008 Viljoen MC (2021) Aes incidimus: early modern engraving as sculpture. In: Faietti M, Bloemacher A, Richter M (eds) Sculpture in print, 1480–1600. Brill, pp 41–69 Voto C (2022) From archive to dataset. Visualizing the latency of facial big data. PUNCTUM Int J Semi 8(1):47–62 Wan Z (2022) Image, impressionism and imagism. In: 2022 international conference on social sciences and humanities and arts (SSHA 2022). Atlantis Press, pp 70–74 Wang R (2021) Computer-aided interaction of visual communication technology and art in new media scenes. Comput Aid Des Appl 19(S3):75–84 Weiss J, Parshall P (2022) The melancholy studio: Albrecht Dürer and Bruce Nauman. Res Anthro Aesthet 77(1):318–350 Weng CC (2020) Making minimalism disappear…. J Contem Paint 6(1–2):149–164 White M (2022) Warhol: the void beneath the emptiness. Quadrant 66(1–2):114–119 Willett E (2010) Andy Warhol: everyone will be Famous for 15 Minutes. Enslow Publishing, LLC Wolfe J (2023) Roy Lichtenstein: outdoor painted sculpture. Getty Publications Zhang N (2020) Application of computer graphics and image software in marine graphic design. J Coast Res 106(SI):600–604 Zhang H, Xu T, Li H, Zhang S, Wang X, Huang X, Metaxas DN (2018) Stackgan++: Realistic image synthesis with stacked generative adversarial networks. IEEE Trans Patt Anal Machintell 41(8):1947–1962 Zhao Y (2023) An analysis of the inspiration of cubist painting on contemporary graphic design. High Art Des 2(2):62–65

Chapter 4

Pedagogical Paradigm Shift: Reimagining Art and Design Education

Abstract This chapter explores the transformative potential of AI-generated art in art and design education, advocating for a significant shift in pedagogical approaches. It highlights the importance of transitioning from a technique-focused curriculum to one that emphasizes the interplay between form and content. Practical strategies, use cases, and recommendations are provided for integrating AI-driven tools and processes into the classroom. By examining the evolving nature of artistic practice and its relationship with AI, this chapter offers valuable insights into the future of art and design education. Embracing AI as a tool for creative exploration can expand artistic horizons, develop critical thinking skills, and foster interdisciplinary problem-solving. Educators are encouraged to create an environment that encourages experimentation, innovation, and exploration of the conceptual implications of AIgenerated art. This chapter serves as a guide to empower educators and students to navigate the evolving landscape of art and design, shaping the future of the creative industries.

4.1 Word and Image Unbound: Rethinking Tradition Art and design education stands at the forefront of a groundbreaking transformation catalyzed by the emergence of AI-generated art. The integration of artificial intelligence (AI) into creative practices has the capacity to revolutionize the way we teach and learn art, challenging conventional pedagogical approaches and unlocking novel avenues for creative expression. This paradigm shift that is reshaping art and design education demands a curriculum that transcends mere technical skills and places paramount importance on the dynamic interplay between form and content. By exploring the evolving relationship between AI and artistic practice, the profound potential of AI-generated art in cultivating critical thinking, fostering interdisciplinary problem-solving, and fostering a culture of innovation can be unveiled. Traditionally, art and design education has centered around the instruction of technical skills and medium-specific knowledge. While elements of aesthetics, art

© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024 J. Hutson et al., Creative Convergence, Springer Series on Cultural Computing, https://doi.org/10.1007/978-3-031-45127-0_4

87

88

4 Pedagogical Paradigm Shift: Reimagining Art and Design Education

theory, and criticism have found their place in the curriculum through oral and written critiques, the primary focus has remained on the technical processes and the intricate relationship between form and content (Lindström 2012). However, the advent and widespread accessibility of generative AI tools have instigated a significant shift towards emphasizing the conceptual aspects of artmaking. One pivotal consideration in this transformation is the blurring of boundaries between traditional artistic mediums and digital workflows (Kraus et al. 2021). This evolution in art education signifies a broader recognition of the transformative capabilities of technology in creative practice (Ascott 2003; Henriksen et al. 2021). The translation of digital creations into tangible forms challenges conventional understandings of art production and beckons a reevaluation of the interplay between the physical and digital realms. Over the past two decades, even traditional studio art curricula have embraced the integration of digital imaging, video editing, photography, and web design as core requirements (Knochel and Patton 2015). Just as art academies in the nineteenth century reluctantly acknowledged the rise of photography as a formidable tool, institutions must now come to terms with the importance of AI as a novel artistic tool (Bate 2020). On the other hand, while both photography and AI have made significant impacts on the art world and the training of artists, it is important to recognize the notable differences between the two. One fundamental distinction lies in the training process of AI tools using image databases, which has raised profound questions about the very essence of creativity and originality. This has led to discussions surrounding accusations of “stealing” and concerns about copyright infringement (Škilji´c 2021). Moreover, the concept of aesthetic engineering, the act of recombining visual elements to construct new compositions, challenges traditional notions of craftsmanship and prompts students to critically evaluate ideas of originality and intentionality (Kang 2022). Unlike earlier technologies such as daguerreotypes, calotypes, and tin types, which were limited by their black and white nature and lacked generative capabilities, AI tools have expanded the creative possibilities by enabling designers to compose textbased prompts and generate desired outputs (Silverman 2019). This shift in focus moves away from searching for existing elements to intentionally composing with a specific vision in mind. AI tools now provide access to a wide range of options, including subject matter, the style of any artist within the trained data set, the effects of specific camera lenses, and more (Vartiainen and Tedre 2023). Simply having a clear vision of what one wants to materialize becomes sufficient, without necessarily knowing the precise technical steps to achieve it. This transformation in artistic practice challenges traditional notions of the artist as a solely skilled craftsman and underscores the increasing role of intentionality and creative decision-making. AI becomes a powerful tool for artists and designers, expanding their possibilities and enabling them to push the boundaries of artistic expression. By exploring the capabilities of AI tools and integrating them into art education, artists can cultivate a deep understanding of the potential and implications of these technologies while critically examining the concepts of creativity, originality, and intention in the digital age.

4.1 Word and Image Unbound: Rethinking Tradition

89

In this new paradigm, logocentrism has gained central importance, leading to a growing emphasis on verbalizing the visual and integrating words with images in art education. While the realm of verbal analysis has traditionally belonged to art historians within the academic sphere, artists have been trained to defend their work through oral critiques, placing a primary emphasis on the visual output itself. However, a new approach is emerging that draws on art historical methodology and encourages students to critically evaluate and engage in formal analysis, strengthening their ability to navigate the complexities of contemporary art practices (Bell and Ommer 2023). The shift towards a multimodal approach in art education also empowers students to articulate their artistic intentions and engage in thoughtful discussions about their work. It recognizes the value of verbal communication in complementing and enhancing visual expression. By learning to carefully, decisively, and specifically describe what they aim to achieve, artists become proficient in prompt engineering, enabling them to effectively utilize AI tools and generate desired outputs. Prompt engineering, defined as the skillful composition of text-based prompts to generate desired outputs using AI tools, will become a central component of training in visual fields. This process involves formulating clear and specific instructions to guide the AI system in producing the desired artistic outcomes. Therefore, the ability to express oneself clearly and precisely becomes a vital skill in this new context. By verbalizing their artistic ideas, students develop a deeper understanding of their creative process and gain the ability to communicate their intentions to a broader audience. The approach cultivates critical thinking, analytical skills, and a heightened awareness of the concepts and theories that inform contemporary art. By integrating verbal and visual modes of expression, art education enables students to engage in dialogue, engage with art historical contexts, and actively participate in critical discussions about their own work and the broader art world. The synthesis of words and images enhances students’ ability to analyze and interpret artworks, fostering a more comprehensive understanding of artistic concepts and contributing to the development of their own artistic practice. In this evolving landscape, the ability to effectively navigate the relationship between words and images becomes increasingly important. Artists who can skillfully articulate their creative vision and engage in critical discussions surrounding their work are better equipped to navigate the complexities of the art world and contribute to the broader discourse on contemporary art practices. The integration of AI in art and design education necessitates a transformation in teaching methods. Educators must create an environment that fosters experimentation, innovation, and exploration of the conceptual implications of AI-generated art. To achieve this, a reexamination of the curriculum is essential. Departments must consider how they will respond to the changing demands of the art market and equip students with the necessary skills and knowledge to navigate this dynamic field. The curriculum should incorporate AI-related topics, techniques, and ethical considerations, enabling students to critically engage with AI-generated art and its broader implications.

90

4 Pedagogical Paradigm Shift: Reimagining Art and Design Education

Educators need to facilitate an open and collaborative learning environment that encourages students to experiment with AI tools, explore innovative approaches, and challenge established norms. This includes providing opportunities for interdisciplinary collaboration, where students from different disciplines can work together to explore the creative potential of AI. As well, incorporating AI into the curriculum also involves integrating theoretical discussions on the ethical, social, and cultural implications of AI-generated art. Students should be encouraged to critically analyze the impact of AI on artistic processes, authorship, originality, and the art market. By addressing these issues, art and design education can foster a deeper understanding of the complexities surrounding AI-generated art and equip students with the skills to navigate its implications. As the art and design fields continue to evolve, educators play a vital role in shaping the future of art education. By embracing the integration of AI, reexamining teaching methods, and adapting the curriculum, educators can empower students to navigate the challenges and opportunities presented by AI-generated art. Through this forward-thinking approach, art and design education can ensure that students are prepared to thrive in the ever-changing landscape of the creative industries.

4.2 From Technique to Concept: The New Curriculum Art and design education has traditionally placed a strong emphasis on teaching technical skills and mastery of knowledge and techniques associated different media. Students have been guided through the acquisition of craftsmanship, honing their abilities to manipulate materials and create visually appealing artworks. While technical proficiency remains important, the emergence of AI-generated art calls for a reevaluation of the curriculum to prioritize conceptual thinking and the exploration of ideas (Eager and Brunton 2023). To understand the current state of art and design education, it is essential to review the existing curriculum and consider the requirements and recommendations put forth by organizations such as the National Association of Schools of Art and Design (NASAD) (https://nasad.arts-accredit.org/). NASAD provides accreditation standards that guide institutions in developing comprehensive art and design programs. These standards cover various aspects, including curriculum content, learning outcomes, faculty qualifications, and resources. While not all institutions that offer art and design degrees are accredited by the organization, the standards updated annually in the associated handbook is used to guide curricular and course offerings in postsecondary institutions (Youngblade et al. 2022). These recommendations include a clear course of instruction that progress from introductory to advanced levels with appropriate associated outcomes. Specific techniques and media, such as drawing, painting, sculpture, photography, and digital media are included and supported by appropriately credentialed faculty and adequate facilities. These courses provide students with a foundation in technical skills, encouraging the development of technical proficiency in each respective area. Additionally, art history and theory

4.2 From Technique to Concept: The New Curriculum

91

courses are required to deepen student understanding of art movements, aesthetics, and critical analysis (NASAD 2022). Credit and time requirements play a crucial role in postsecondary institutions, ensuring that degree programs meet established academic standards. The length of programs varies depending on the degree level and are discussed as followed in the 2022–2023 NASAD Handbook. Associate degrees typically require a minimum of 60 semester credit hours or 90 quarter credit hours, equivalent to two academic years. Baccalaureate degrees, on the other hand, necessitate a minimum of 120 semester credit hours or 180 quarter credit hours, equivalent to four academic years. Postbaccalaureate degrees typically require 30 semester credit hours or 45 quarter credit hours, equivalent to one academic year, with additional requirements based on the degree level and title. Non-degree-granting programs in degree-granting institutions have specific time requirements aligned with the subject matter and program objectives. Total time requirements for any postsecondary program should be reasonable and published, ensuring they align with the number of credit or clock hours required for program completion. Community or precollegiate programs have time requirements that correspond to their specific goals, while standards for accreditation may not apply to such programs, except for certain aspects (NASAD 2022). In the context of art and design programs, NASAD outlines that applicants are evaluated based on their visual aptitudes, including creative ability, potential, and problem-solving skills. For certain specializations, math and science aptitudes may also be considered important. Scholarly aptitudes are relevant for degree programs in scholarly subjects, and evidence of creative and scholarly potential or work is typically reviewed during the admission process. Portfolio reviews or other evaluations are often required prior to confirming degree candidacy, with member institutions encouraged to conduct such reviews before matriculation. Professional undergraduate degrees require evidence of exceptional talent, the potential to develop high-level competencies, artistic and/or design sensibilities, and a strong sense of commitment (NASAD 2022). Institutions that offer art and design programs adhere to guidelines set forth by accrediting bodies such as NASAD, which provide definitions and direction for programmatic requirements. However, it is important to note that these guidelines allow for some flexibility and interpretation by individual institutions, as long as the general parameters, such as percentages, credit requirements, and time on task, are met. This flexibility enables institutions to tailor their programs to meet the specific needs and goals of their students while maintaining the quality and standards expected by accrediting bodies. It also allows for innovation and adaptation in response to emerging trends and developments in the field of art and design education. Therefore, while there are overarching standards and guidelines in place, individual institutions have the freedom to shape their programs within these parameters to best serve their students and their unique educational objectives (Schwartz et al. 2023). While traditional art and design courses remain important, the integration of AIgenerated art calls for a reevaluation of curriculum offerings and a shift in focus from technique to concept. It is essential to note that accrediting bodies’ guidelines do not dictate the specific tools or methods that must be used in the curriculum, providing

92

4 Pedagogical Paradigm Shift: Reimagining Art and Design Education

institutions with the flexibility to incorporate AI in ways that align with their educational objectives. The new curriculum should foster critical thinking skills, encourage exploration of the conceptual implications of AI, and enhance students’ ability to articulate their ideas through artistic practice. This shift in emphasis reflects the evolving demands of the art world, which values originality, criticality, and innovation. Administrators and faculty should take the first step in this process by assessing their current offerings and determining how to integrate AI into their curriculum effectively (Jeffers 2022). The standard degree structure for Studio Art programs varies depending on the level of accreditation and the specific requirements of each institution. In general, however, such a typically consists of a range of courses that provide a solid foundation in various artistic disciplines (Kackovic et al. 2022). At the lower end of the credit spectrum, often found in BA Art History degrees, the program may require around 36 credits in the major. BA Studio Art degrees typically include core courses such as 2D Design, 3D Design, Color Theory, Drawing I, Drawing II, Digital Video Editing, Digital Imaging, and Photography. Some programs may even offer courses in web design to introduce students to digital platforms and art creation (Sanders 2022). As students progress in their studies, they may choose to specialize or concentrate in a specific area of art. This is most common in BFA degrees. Concentrations can include disciplines such as Painting, Ceramics, Sculpture, or Photography. These concentrations allow students to develop expertise in their chosen medium and explore advanced techniques and concepts within that area. For those seeking a BFA degree, which often requires 78 credits to meet NASAD accreditation standards, a portfolio review is often a mandatory component. This review assesses the student’s artistic abilities and readiness to pursue the professional degree. Additionally, BFA students are typically required to complete a capstone project or exhibition, which serves as a culminating experience and showcases their artistic growth and achievements. On the other hand, BA degree-seeking students may be required to complete a capstone project that involves research and critical analysis of art history or contemporary art issues. Overall, the degree structure in Studio Art programs combines foundational courses, concentration-specific classes, and opportunities for artistic exploration and development. The portfolio review and capstone projects provide students with the chance to demonstrate their artistic skills and knowledge, culminating in a comprehensive showcase of their artistic journey (Berrier et al. 2022). In addition to Studio Art programs, design degrees offer students the opportunity to explore various creative disciplines with a specific focus on design principles, problem-solving, and industry-specific skills. Design degrees, such as Graphic Design, Web Design UI/UX, Industrial Design, Interior Design, and Fashion Design, follow a similar credit structure to Studio Art degrees, with credit requirements ranging from 36 to 78 credits based on the level of accreditation and program requirements. Design degrees often have a more discipline-specific curriculum compared to Studio Art degrees, providing students with targeted coursework that hones their skills and knowledge within their chosen design field. While design programs may

4.2 From Technique to Concept: The New Curriculum

93

share core courses with Studio Art degrees, intermediate-level classes in design often include Typography, Digital Imaging, and Illustration. These courses focus on developing students’ proficiency in design software tools, honing their ability to create visually compelling and effective designs (Ni and Cattaneo 2022). Advanced courses in design degrees may emphasize industry-specific training and techniques. For example, students pursuing Graphic Design may undergo advanced Adobe training to master software applications commonly used in the field. Web Design UI/UX programs may delve into user experience principles, web development, and interface design, equipping students with the skills to create engaging and user-friendly digital experiences. Industrial Design programs may focus on prototyping, materials, and manufacturing processes, preparing students to design and develop functional and aesthetically appealing products. Interior Design degrees often include coursework on space planning, lighting design, and materials selection, enabling students to create innovative and harmonious interior spaces. Fashion Design programs typically cover topics such as fashion illustration, garment construction, and fashion marketing, fostering creativity and technical proficiency in the fashion industry (Cheng 2022). While Studio Art degrees often provide flexibility through concentration options, design degrees tend to have a more structured curriculum with a strong focus on discipline-specific skills. The coursework in design degrees reflects the demands and expectations of the respective industries, aiming to equip students with the knowledge and expertise necessary for professional success. By immersing themselves in discipline-specific courses, design students develop a comprehensive understanding of their field and are prepared to meet the challenges and opportunities within their chosen design career path (Faerm 2022). With the differences in general degree structure outlined, identifying the right strategy to incorporate new generative tools into curriculum need be considered. Integrating AI into the art and design curriculum offers many possibilities for departments, but there is no one-size-fits-all approach. Here we outline three potential pathways for institutions to consider when incorporating AI into their programs (Table 4.1). The first pathway involves creating an entirely new curriculum with dedicated classes that explore the intersection of AI and art. This approach allows institutions to develop cutting-edge courses tailored to the specific needs and interests of students. For example, a 4D Design class can focus on digital design, incorporating AI techniques and tools. XR sphere and spatial computing courses can delve into the world of extended reality and its applications in artistic expression. Prompt engineering classes can explore the process of generating creative prompts for AI-driven art projects. Additionally, a Contemporary Design Tool Box class can serve as a capstone course, introducing students to the latest AI-powered tools for ideation and content creation. The second pathway involves keeping the existing curriculum largely intact while integrating AI through modules and assignments. This approach allows institutions to leverage their current courses and structure while incorporating AI-related content. Faculty can develop modules that introduce AI concepts and techniques within

94

4 Pedagogical Paradigm Shift: Reimagining Art and Design Education

Table 4.1 Pathways to integrating AI in art and design curriculum Pathway

Description

Pathway 1: New curriculum

Create entirely new classes that focus on AI integration, such as 4D Design, XR sphere and spatial computing, prompt engineering, and Contemporary Design Tool Box. This pathway involves designing a curriculum from scratch that emphasizes the use of AI tools and concepts

Pathway 2: Augmentation

Keep the existing curriculum structure intact and augment it with modules and assignments that incorporate AI. This pathway allows for the integration of AI-related content into existing courses, providing students with opportunities to explore AI within the context of their chosen disciplines

Pathway 3: Core class integration

Add a specific class in the core curriculum that introduces students to XR/AR/VR/AI technologies and concepts. This pathway ensures that all students have a foundational understanding of AI and its applications in art and design. It provides a dedicated space for students to engage with AI-related content and develop their skills in utilizing AI tools

existing classes, providing students with opportunities to explore AI’s potential in their chosen fields. Drawing from case studies and real-world examples, assignments can challenge students to incorporate AI-generated elements into their creative projects, fostering a deeper understanding of the technology’s impact on artistic practice. The third pathway entails adding a specific class(es) dedicated to emerging to the core curriculum. This class would provide students with a comprehensive overview of these emerging technologies and their applications in art and design. Students would learn about the principles, tools, and ethical considerations associated with XR and AI. By incorporating this dedicated class, institutions can ensure that all students receive exposure to these transformative technologies, regardless of their specialization. The choice of pathway will depend on various factors, including the Carnegie classification of the institution, its size, culture, available materials and resources, capacities and capabilities, and whether it is public or private. Institutions should carefully consider their unique circumstances and goals when determining the most appropriate approach for integrating AI into their art and design curriculum. By embracing one of these pathways, institutions can empower students to explore the dynamic relationship between AI and artistic expression, preparing them for the evolving landscape of the creative industries.

4.3 Integrating AI in the Classroom

95

4.3 Integrating AI in the Classroom As AI becomes increasingly prevalent and integrated into various artmaking tools, it is crucial for educators to address the practical, theoretical, aesthetic, and ethical implications of this technology in the classroom. While the field of AI in art continues to evolve, there are strategies that can assist educators in seamlessly integrating AI into their teaching practices. By adopting these strategies, educators can create a dynamic learning environment that encourages critical thinking, exploration, and ethical considerations surrounding AI-generated art (Table 4.2). One effective strategy is to provide students with a strong foundation in the theoretical and historical context of AI in art. This can include exploring the origins of AI, its development over time, and its impact on artistic practices. By examining case studies, artworks, and critical texts, students can gain a deeper understanding of the possibilities and limitations of AI in creative processes. This contextual knowledge will enable students to engage in meaningful discussions and debates about the role of AI in shaping artistic production and interpretation (Cetinic and She 2022). Another strategy is to incorporate hands-on experiences with AI tools and techniques. By providing students with opportunities to experiment and create using AIgenerated art tools, educators can foster a deeper understanding of the technology’s capabilities and challenges. This can involve incorporating AI-powered software, applications, or platforms into class assignments, projects, or workshops. Through these practical experiences, students can explore the potential of AI as a tool for artistic expression, while also grappling with the ethical considerations associated with using AI in their creative processes (Eager and Brunton 2023). Table 4.2 Recommended strategies for integrating AI into the art and design classroom Strategy

Description

Intrinsic and extrinsic approaches

Incorporate content and methods that cater to students’ creative motivations, whether it is self-expression or problem-solving for clients

Design thinking process

Guide students through the Design Thinking process, emphasizing empathy, problem-solving, and the role of AI as a tool for addressing specific needs

Acknowledge resistance

Recognize that some studio art students may initially resist using AI and create an environment that demystifies AI while highlighting its potential as an optional tool

Support imagination

Foster an environment that values imagination and demonstrates how AI can enhance creativity rather than replace it, addressing any concerns students may have about their own creativity

Ethical discussions

Encourage discussions on the ethical implications of AI-generated art, allowing students to explore the boundaries and make informed decisions about its use

Gradual integration

Start with optional AI exercises, allowing students to experiment with AI-generated elements and ideas, and based on outcomes and feedback, determine further integration into the curriculum

96

4 Pedagogical Paradigm Shift: Reimagining Art and Design Education

Furthermore, promoting interdisciplinary collaboration can enrich the integration of AI in the classroom. Encouraging collaborations between art and technology disciplines can lead to innovative projects that push the boundaries of AI-generated art. By fostering interdisciplinary dialogue and teamwork, educators can facilitate the exchange of ideas and expertise, allowing students to explore the intersections of art, technology, and AI. This approach not only encourages a holistic understanding of AI in art but also cultivates skills in communication, teamwork, and problem-solving (Klimova et al. 2023). Finally, engaging in critical reflection and dialogue about the ethical implications of AI-generated art is essential. Educators can facilitate discussions around issues such as authorship, privacy, bias, and the societal impact of AI. Encouraging students to critically evaluate the ethical dimensions of AI-generated art will empower them to make informed decisions and shape the ethical use of AI in their future artistic endeavors (Zhou and Nabus 2023). In applying these recommendations, there are more specific recommendations educators may consider. Incorporating AI into the art classroom requires considering the different creative motivations of students and adopting integrative strategies that cater to their needs. The use of intrinsic and extrinsic approaches can be effective in introducing AI content and methods for fostering self-expression or problemsolving in a client-based context (Urban and Urban 2023). Studio Art students are typically encouraged to tap into their intrinsic motivation and personal vision to create artworks that express their individual ideas, emotions, and experiences. They are often driven by the desire for self-expression and exploration, seeking to push the boundaries of their artistic abilities and challenge traditional norms. For these students, the integration of AI into the art classroom can be approached as a tool that enhances their creative process, offering new possibilities for experimentation, inspiration, and expanding their artistic repertoire. On the other hand, design students, particularly those studying disciplines like Graphic Design, Industrial Design, or User Interface/User Experience (UI/UX) Design, often work in a more extrinsically motivated context. Their creative process revolves around problem-solving and addressing specific client needs or user requirements. Design students are trained to identify and analyze problems, conduct research, and develop effective solutions. In this context, the integration of AI can serve as a valuable resource for generating ideas, exploring different design options, and streamlining the design process. AI can help them analyze data, visualize concepts, and create prototypes that align with user expectations and project goals (Lin et al. 2022). To cater to the different motivations of studio art and design students, educators can adopt specific strategies that align with their creative processes. For studio art students, the focus can be on introducing AI as a tool that supports their exploration and self-expression. This may involve demonstrating how AI-generated elements can inspire new directions in their artwork, offering alternative perspectives or techniques they may not have considered before. The emphasis is on enhancing their individual

4.3 Integrating AI in the Classroom

97

artistic voice and expanding their creative horizons (Tang et al. 2022). Alternatively, the integration of AI can be approached from a problem-solving perspective for design students. Educators can highlight how AI can assist in data analysis, generate design variations, or simulate user interactions. By framing AI as a valuable resource in the design process, design students can leverage its capabilities to develop innovative solutions, improve user experiences, and optimize design outcomes. By acknowledging and addressing the distinct creative motivations of art and design students, educators can foster an inclusive and effective learning environment. Integrating AI into the art classroom becomes an opportunity to empower students with tools that complement their individual approaches, allowing them to explore their intrinsic creativity or excel in problem-solving within a client-based context. For instance, one highly effective recommendation for teaching design students is to incorporate the principles of the Design Thinking process, which places a strong emphasis on empathizing with the human experience. Educators can draw inspiration from renowned resources such as Stanford’s d.school (https://dschool.stanford.edu/), which provides valuable insights and frameworks for implementing user-centered design methodologies (Jones 2022). The Design Thinking process starts by encouraging students to empathize with potential users, gaining a deep understanding of their needs, desires, and challenges. This empathetic perspective forms the foundation for developing meaningful and impactful design solutions. By creating personas and delving into the ideation process, students can explore how AI tools can be applied to address specific problems or fulfill particular needs identified during the empathizing phase (Cross 2023). Integrating AI into the design curriculum using the human-centered design processes ensures that the human element remains at the core of the creative process. Students are encouraged to consider the unique experiences and perspectives of users, enabling them to develop solutions that align with real-world contexts and enhance the human experience. AI is viewed as a powerful tool that can augment the design process, providing valuable insights, generating design variations, or automating certain tasks. It is important to emphasize that AI should be seen as a complementary tool rather than a substitute for human creativity and problem-solving abilities (Demirel et al. 2023). Through the integration of the Design Thinking process and AI tools, design students gain a holistic understanding of how AI can be harnessed as a valuable resource within the broader framework of their creative practice. They develop the skills and mindset needed to navigate the evolving landscape of design, combining technical expertise, empathetic problem-solving, and a deep appreciation for the human experience. Recognizing the unique characteristics and motivations of students in traditional studio art classes, on the other hand, it is important for educators to implement strategies that address their initial resistance to using generative AI. These students often value the opportunity to “unplug” and rely on their own intrinsic creativity, and may initially perceive AI as a threat to their artistic autonomy (Barker 2022). To effectively integrate generative AI into the studio art curriculum, educators can begin by demystifying AI and providing a clear understanding of its capabilities

98

4 Pedagogical Paradigm Shift: Reimagining Art and Design Education

and limitations. By explaining that AI will be used as a tool to support exploration, ideation, and creation, students can gradually overcome their apprehensions and develop a more open mindset towards incorporating AI into their artistic practice. Allowing students the freedom to evaluate the outputs generated by AI is crucial in this process. By encouraging them to critically assess the results and determine whether they align with their artistic vision, students maintain a sense of control and agency over their creative process. This approach empowers them to make informed decisions about when and how to utilize AI as an optional tool in their artistic endeavors. Emphasizing the potential of AI as a valuable resource for inspiration and experimentation, rather than as a mandatory requirement, is key to engaging studio art students. By highlighting the benefits and possibilities that AI can offer, educators can foster an environment of exploration and discovery. Students can choose to incorporate AI into their artistic practice if they find it enhances their creative process or resonates with their conceptual objectives (Grabsch et al. 2022). By offering AI as an optional tool, educators create a space that encourages studio art students to embrace the integration of AI at their own pace, allowing them to gradually discover its potential while respecting their individual artistic identities. This approach ensures that students are not compelled to abandon their preferred traditional techniques, but rather have the opportunity to expand their creative toolkit with AI as a complementary tool for experimentation and artistic growth (Sheridan et al. 2022). In certain instances, regardless of creative major, students may perceive AI as a threat to their own sense of creativity, which can hinder their willingness to embrace its integration. To address these concerns, educators should cultivate a supportive environment that values and celebrates imagination. By highlighting the ways in which AI can serve as a catalyst for new forms of creativity and artistic exploration, educators can help students see AI as a tool that enhances their creative process rather than diminishing it (Schober 2022). Engaging students in discussions about the ethical implications of AI-generated art is also crucial. These conversations enable students to critically examine the boundaries and implications of using AI in the creative process. By encouraging them to explore questions of authorship, originality, and the impact of AI on the art world, educators empower students to make informed decisions about the role and extent of AI integration in their own artistic practice (Hutson and Cotroneo 2023). The degree of AI integration in the curriculum should be tailored to the specific context and technological landscape of the program. Initially, introducing AI as an optional exercise allows students to experiment with AI-generated elements and ideas. This approach provides valuable insights into how students engage with AI and allows educators to address any ethical concerns that may arise. By observing the outcomes and gathering student feedback, educators can then make informed decisions about the extent and nature of further AI integration in the curriculum. By acknowledging and respecting the diverse perspectives and creative motivations of students, educators can successfully integrate AI into the art classroom while fostering individual artistic growth and critical thinking skills. By creating

References

99

a supportive and adaptable learning environment, educators empower students to embrace the potential of AI, navigate its ethical implications, and leverage it as a tool for innovation and artistic expression.

References Ascott R (2003) Telematic embrace: visionary theories of art, technology, and consciousness. University of California Press Barker C (2022) Dipping a toe in: collecting and promoting introductory texts to studio art students. In: ARLIS/NA conference 2022 Bate D (2020) Photography: the key concepts. Routledge Bell P, Ommer B (2023) Measuring art, counting pixels? The collaboration of art history and computer vision oscillates between quantitative and hermeneutic methods. In: Measurement and understanding in science and humanities: interdisciplinary approaches. Wiesbaden, Springer Fachmedien Wiesbaden, pp 191–200 Berrier S, Koehle K, Loken KL, Tetzlaff M, Thomas T (2022) Interdisciplinary project-driven learning in game design and development. J Comput Sci Coll 38(4):61–66 Cetinic E, She J (2022) Understanding and creating art with AI: review and outlook. ACM Trans Multi Comp Commun Appl 18(2):1–22 Cheng YC (2022) The requirements for graphic designers in 2021: compare between students, educators, and industry professionals. California State University, Long Beach Cross N (2023) Design thinking: understanding how designers think and work. Bloomsbury Publishing Demirel HO, Goldstein MH, Li X, Sha Z (2023) Human-centered generative design framework: an early design framework to support concept creation and evaluation. Int J Hum Comput Int 1–12. https://doi.org/10.1080/10447318.2023.2171489 Eager B, Brunton R (2023) Prompting higher education towards AI-augmented teaching and learning practice. J Univ Teach Learn Pract 20(5):02 Faerm S (2022) Introduction to design education: theory, research, and practical applications for educators. Taylor & Francis Grabsch D, Webb H, Leibowitz R, Chinnam D, Webb L, Kunovich S (2022) Examining the motivations, advantages, and disadvantages experienced by undergraduate students who pursue multiple majors. Coll Stud J 56(2):135–150 Henriksen D, Creely E, Henderson M, Mishra P (2021) Creativity and technology in teaching and learning: a literature review of the uneasy space of implementation. Educ Tech Res Dev (69): 2091–2108 Hutson J, Cotroneo P (2023) Generative AI tools in art education: exploring prompt engineering and iterative processes for enhanced creativity. Metaverse 4(1):1–14 Jeffers III JJ (2022) Where does graphic design belong? Decision-making under ambiguity by visual applied arts administrators. Doctoral dissertation, University of Florida Jones H (2022) Beyond human-centred design: mapping empathy in living systems. In: Metadesigning designing in the Anthropocene. Routledge, pp 108–121 Kackovic M, Hartog J, van Ophem H, Wijnberg N (2022) The promise of potential: a study on the effectiveness of jury selection to a prestigious visual arts program. Kyklos 75(3):410–435 Kang LL (2022) Improvisation and aesthetic engagement for human-computer-interaction. Doctoral dissertation, Cornell University Klimova B, Pikhart M, Kacetl J (2023) Ethical issues of the use of AI-driven mobile apps for education. Front Pub Health 10(1):1118116 Knochel AD, Patton RM (2015) If art education then critical digital making: computational thinking and creative code. Stud Art Edu 57(1):21–38

100

4 Pedagogical Paradigm Shift: Reimagining Art and Design Education

Kraus S, Jones P, Kailer N, Weinmann A, Chaparro-Banegas N, Roig-Tierno N (2021) Digital transformation: an overview of the current state of the art of research. Sag Open 11(3):21582440211047576 Lin C, Shipton H, Teng W, Kitt A, Do H, Chadwick C (2022) Sparking creativity using extrinsic rewards: a self-determination theory perspective. Hum Res Manag 61(6):723–735 Lindström L (2012) Aesthetic learning about, in, with and through the arts: a curriculum study. Int J Art Des Educ 31(2):166–179 National Association of Schools of Art and Design (NASAD) (2022) Handbook 2022–2023. Reston, Virginia Ni M, Cattaneo T (2022) Social impact in design education. In: Cross-cultural design. Applications in learning, arts, cultural heritage, creative industries, and virtual reality: 14th international conference, CCD 2022, held as part of the 24th HCI international conference, HCII 2022, virtual event, June 26–July 1, 2022, proceedings, Part II. Springer International Publishing, Cham, pp 96–108 Sanders D (2022) A comparative study on self perceived efficacy of teaching inclusion between career technical education, fine arts, and general core teachers at a selected school district in northeast Tennessee. Doctoral dissertation Schober R (2022) Passing the turing test? AI generated poetry and posthuman creativity. Artifi Intell Hum Enhan 21:151 Schwartz JB, St John PA, Lagstein CG, Pate MC, Denning HJ (2023) Instructional content in undergraduate art therapy education. Art Thera 40 (1): 1–10 Sheridan KM, Zhang X, Konopasky AW (2022) Strategic shifts: How studio teachers use direction and support to build learner agency in the figured world of visual art. J Learn Sci 31(1):14–42 Silverman K (2019) The miracle of analogy: or, the history of photography, part 1. In: Philosophers on film from Bergson to Badiou: a critical reader. Columbia University Press, pp 328–340 Škilji´c A (2021) When art meets technology or vice versa: key challenges at the crossroads of AIgenerated artworks and copyright law. IIC Inter Rev Intell Prop Comput Law 52(10):1338–1369 Tang C, Mao S, Naumann SE, Xing Z (2022) Improving student creativity through digital technology products: a literature review. Think Skill Creat 44:101032 Urban M, Urban K (2023) Orientation toward intrinsic motivation mediates the relationship between metacognition and creativity. J Creat Behav 57(1):6–16 Vartiainen H, Tedre M (2023) Using artificial intelligence in craft education: crafting with text-toimage generative models. Dig Creat 34(1):1–21 Youngblade L, Hawley JM, Haar SJ, Rees K, Warfield CL (2022) Benefits of program accreditation—an administrative perspective. In: International textile and apparel association annual conference proceedings, vol 79, no 1. Iowa State University Digital Press Zhou KQ, Nabus H (2023) The ethical implications of DALL-E: opportunities and challenges. Meso J Comput Sci 2023(1):17–23

Chapter 5

Expanding Horizons: AI Tools and Workflows in Art Practice

Abstract In this chapter, the integration of artificial intelligence (AI) tools and workflows into the artistic process is thoroughly explored. The focus is on how these AI-driven workflows can augment and expand creativity, providing artists with new avenues for artistic expression and pushing the boundaries of their practice. Various AI-driven art tools are discussed, showcasing their potential to revolutionize the artistic process. One notable tool is DALL-E 2, an advanced image generation model that allows artists to manipulate and create unique visuals using features like Midjourney and Stable Diffusion. Another AI-powered tool, Adobe Firefly, is also examined, highlighting the new possibilities it brings to creative exploration. By presenting the potential of AI tools and workflows in art practice, this section sheds light on the transformative impact of AI on the creative process. It emphasizes the importance of artists embracing these technological advancements as powerful tools that can enhance their artistic output, expand their horizons, and open up new realms of artistic exploration.

5.1 The Augmented Artistic Process: AI-Driven Workflows and Expanded Creativity Throughout history, the training of artists has undergone significant transformations, with notable shifts occurring since the establishment of the first art academy in Florence in 1563. Traditionally, artists have honed their skills through rigorous training, often relying on techniques passed down through generations, observational studies from life, and the exploration of source materials. Building on the medieval guild and workshop tradition, artists would receive practical workshop training while living and working with an established “master” in their bottega (Bellavitis and Sapienza 2023). Here boys would learn how to prepare panels and canvas, grind pigments and copy the style of their mentor until they could demonstrate mastery of their craft. But as early as the fifteenth century, artists were also to consider themselves among the artes liberales (liberal arts) and supplement their workshop training with an understanding of literary works (Hutson 2016).

© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024 J. Hutson et al., Creative Convergence, Springer Series on Cultural Computing, https://doi.org/10.1007/978-3-031-45127-0_5

101

102

5 Expanding Horizons: AI Tools and Workflows in Art Practice

As Leon Battista Alberti (1404–1472) recommended: “the studious painter to make himself familiar with poets, orators and other men of letters, for he will not only obtain excellent ornaments from such learned minds, but he will also be assisted in those very inventions which in painting may gain him the greatest possible praise” (Grayson 1972, p. 97). In his influential treatise Della Pittura (On Painting) from 1435, Alberti advocated for the integration of knowledge from various fields to enhance the creative process and achieve the highest level of artistic accomplishment. This recommendation aimed to supplement the practical training received in workshops (botteghe) with intellectual stimulation and ideas derived from literature and other disciplines. Alberti’s seminal treatise, itself meant to augment practical workshop training, played a significant role in shaping the understanding of artistic education during that time, emphasizing the value of interdisciplinary learning and the fusion of practical skills with intellectual pursuits (Davis 2022). Throughout the Renaissance and into the seventeenth century, the apprenticeship model in the visual arts was supplemented by the establishment of academies. The Accademia del Disegno, founded in 1563, marked the beginning of this trend, followed by the Accademia di San Luca in Rome in 1593, and ultimately, the Académie Royale de Peinture et de Sculpture in Paris in 1648 (Bonfait 2022; Skaarup 2017; Wa´zbi´nski 1985). These academies served as advanced educational institutions that went beyond technical training, incorporating theoretical knowledge alongside practical skills (McNeely 2009). This combination of practica and teorica aimed to provide artists with a comprehensive and well-rounded education. By integrating theory into their training, artists gained a deeper understanding of the principles and concepts underlying their artistic practice (Quiviger 2002). These academies played a pivotal role in reshaping and refining the development of visual arts curricula, offering artists the opportunity to refine their skills and broaden their knowledge within an institutional structure that supported their social advancement (Dressen 2021). The course of Renaissance apprenticeships that would later be adopted for study in the academies was a structured progression that aimed to develop their artistic skills and understanding of the visual world (Gross 2019). These foundational practices provided a pathway for artists to transfer three-dimensional objects convincingly onto a two-dimensional surface. The journey began with the meticulous task of copying drawings, usually produced by masters they were apprenticing with, which allowed students to observe and replicate existing artworks, honing their ability to translate complex forms onto paper (Wei 2021). Once proficiency in copying drawings was demonstrated, students would advance to the next stage of their training, which involved drawing after plaster casts (Fig. 5.1). The exercise enabled them to apply the lessons learned from copying drawings and adapt their skills to represent threedimensional objects in a flat, two-dimensional format. The process of translating the physical world onto a surface required careful observation, attention to detail, and an understanding of proportion and perspective (Jackson 2022). Finally, students would embark on the pinnacle of their training: life drawing (Fig. 5.2). This demanding practice involved capturing the human form, the most complex and nuanced subject for artists (Portnova 2019). By studying live models,

5.1 The Augmented Artistic Process: AI-Driven Workflows and Expanded …

103

Fig. 5.1 Agostino Veneziano, The Academy of Baccio Bandinelli in Rome, 1531 (from Wikimedia Commons, licensed under CC0)

artists were challenged to depict the intricacies of anatomy, movement, and expression, further refining their observational and technical skills (Graham and Buehler 2021). Given that the Hierarchy of Genres codified by the French Academy would privilege history painting above all others, being able to convincingly place multifigural groups in narratives from history of the Bible, such training was highly coveted and necessary for those wishing to elevate themselves in the field (Hehmeyer 2021). Additionally, the study of anatomy in art academies elevated the status of the discipline to a liberal art (Sealy and Lee 2020). Art academies, inspired by the Florentine tradition, further built upon this model by expanding access to a rich array of source materials. These institutions curated collections of plaster casts and ancient statuary, providing students with tangible references to study and draw from (Fig. 5.3) (Risdonne et al. 2022). They also amassed a vast collection of prints, which allowed artists to explore artworks from distant lands and study renowned monuments. In addition, many art academies boasted well-stocked libraries, housing treatises on art and theory that served as

104

5 Expanding Horizons: AI Tools and Workflows in Art Practice

Fig. 5.2 Jacques Gamelin, A Life Drawing Class, 1778/1779 (from Wikimedia Commons, licensed under CC-BY 4.0)

invaluable resources for students seeking a deeper understanding of the natural world and artistic tradition (Hutson 2021). Beyond practical lessons in the studio, art academies recognized the importance of contextual knowledge and intellectual exploration. Lectures and discussions accompanied the hands-on training, providing students with a comprehensive understanding of the reasons behind artistic techniques and the natural world (Hutson 2019). An example can be found in the famous lecture was given by the antiquarian, theorist and artist biographer Giovanni Pietro Bellori (1613–1696) to the Accademia di San Luca on the third Sunday in May 1664. Through the lecture on The Idea of Beauty, defined as a concept that encompasses the perfect harmony and proportion of forms in art, Bellori provides the rhetorical and theoretical construct for arts education. According to Bellori, Beauty (capital “B”) is not merely subjective but is based on objective standards of excellence. He notes: “Thus the Idea constitutes the perfection of natural beauty and unites the truth with verisimilitude of things that appear before the eye, always aspiring to the best and to the marvelous, so that it not only rivals but becomes superior to nature, revealing its works to us elegant and finished, whereas nature is not wont to display them to us perfect in every part” (Bellori 2005, p. 3). The stance relies on the early modern understanding for the purpose of art being primarily didactic in nature. Derived from the three roles of oratory and Quintillian,

5.1 The Augmented Artistic Process: AI-Driven Workflows and Expanded …

105

Fig. 5.3 Students in Sculpting Department, Middelbare Kunstnijverheidsschool, Brusselsestraat 60, Maastricht, ca.1935 (from Wikimedia Commons, licensed under CC-BY 3.0)

art, as with poetry, should docere (to teach), delectare (to delight) and movere (to move) (Farago 2020). Given these goals, Bellori emphasized the importance of studying ancient GrecoRoman art as the ultimate model, with their idealized representations of the human figure and their adherence to the principles of symmetry and balance. As well, the pursuit of Beauty should be guided by reason and intellect, aiming to evoke elevated emotions and spiritual contemplation in the viewer as it is timeless and universal, transcending individual preferences and cultural variations (Bellori 1672). Artists were thus not merely copying from nature, or making aesthetically appealing work, but were delivering a persuasive message that was visually pleasing and would also move an audience to action. Such educational experiences as lectures by academicians fostered a deeper appreciation for the historical and theoretical aspects of art, enriching the creative process and informing artistic decision-making (Reiter 2021). In parallel with the Renaissance tradition, contemporary art education recognizes the significance of contextual knowledge and intellectual inquiry. Artists today supplement their creative practice through a curriculum that also includes art history, theory and criticism that delve into the theories, concepts, and philosophies underpinning artistic expression. Since the first edition was published in 1963, H.W. Jansen’s History of Art would be the first in an ever-growing series of surveys of Western art and the grand narrative that stretched from Paleolithic cave paintings to Jackson Pollock. Non-Western art (now global art) would be appended to many art history

106

5 Expanding Horizons: AI Tools and Workflows in Art Practice

departments course offerings by the dawn of the last millennium, but the structure and types of classes have remained largely unchanged (Elizondo 2020; Juneja 2011). The curriculum for art and design students often begins with introductory surveys that provide a broad overview of art history, covering various periods, movements, and styles (Ishii 2022). These courses introduce students to key artists, artworks, and historical contexts. Building upon this foundation, students then progress to more specialized courses that focus on specific periods or regions, such as Renaissance Art, Modern Art, or Asian Art (Wellington 2020). These intermediate courses delve deeper into the historical, cultural, and social contexts of art, encouraging students to develop critical analysis and interpretation skills (Calvert 2013). As students advance in their studies, they may choose advanced courses that explore specific themes or topics within art history, such as gender and art, contemporary art theory, or the history of photography. These courses often require in-depth research and analysis, culminating in research papers or projects. Additionally, students may have the opportunity to take seminar-style courses where they engage in scholarly discussions and debates with their peers and professors (Pointon 2014). This sequence of coursework allows art and design students to develop a comprehensive understanding of art history, its influences, and its relevance to their own artistic practice. By combining practical studio work with an understanding of historical context, the art pedagogy of today aims to develop well-rounded artistic practice that is informed, self-reflective, and responsive to the complexities of the world. The structure of the curriculum draws heavily from the academic tradition outlined above. Also, the classroom and makerspaces with accompanying furniture have also remained largely unchanged (Doren 2015). In fact, many students from the past would find familiarity in the studio art classrooms of today, as certain aspects have remained consistent throughout the years, including the circumferential organization of spaces for life drawing and still-life sessions, the collections of plaster casts, driftwood, drapery, and other sundries to stage tableaux (Fig. 5.4) (Salazar 2014). Painting studios are equipped with painting stations to set up canvases on easels, various palette knives for mixing the paint on palettes, drying racks and other working environments (Marinkovic 2021). Ceramics studios still include a range of pottery wheels for throwing clay, kilns for firing ceramics at high temperatures, a clay mixing area for preparing clay bodies, and a variety of hand tools such as sculpting tools, brushes, and carving implements (Salazar 2013). With all of these continuities in artistic tradition, there are some adaptations to reflect contemporary practices in the curriculum that should be noted (Bolin et al. 2021). For instance, instead of starting with the meticulous copying of drawings by established “master,” students now begin their studies with fundamentals of twodimensional design. Often the first class taken in the sequence, 2D Design classes explore the fundamental principles and elements of design as they apply to twodimensional visual compositions. Students engage in hands-on projects and creative exercises to develop their understanding of visual communication, composition, and design aesthetics. Through a combination of theory, critique, and studio practice, students learn to effectively use line, shape, color, texture, and space to create visually compelling artworks (Caner Yüksel and Dinç Uyaro˘glu 2021).

5.1 The Augmented Artistic Process: AI-Driven Workflows and Expanded …

107

Fig. 5.4 Anonymous, The Model (Students in the Drawing Room), 1910, oil on canvas (from Wikimedia Commons, licensed under CC0)

While some programs have combined 2D Design with Color Theory, many still keep the latter separate as a required foundational class. In the class, students explore the principles and theories of color, focusing on elements of psychological and emotional impact, cultural significance, and practical applications in various artistic media. Through a combination of theory, experimentation, and hands-on projects, students are encouraged to develop a deeper understanding of color relationships, color mixing, and the use of color as a powerful tool for visual communication. For instance, students learn to select color schemes (such as complementary, analogous, or triadic) and use them as the foundation for their artwork or designs. They experiment with different hues, tones, and saturation levels and learn to create a harmonious balance of colors when desired (Clayson 2021). They also consider the psychological and emotional effects of their chosen color scheme and explore ways to create a sense of unity and coherence in their composition. Through careful color selection and arrangement, students are taught to create visually compelling works that effectively communicate their intended message or mood (Jin and Tiejun 2023). The next phase of artistic training returns to tradition and involves the discipline of drawing. Through drawing coursework, students have the opportunity to apply the principles learned in 2D Design to various subjects and develop another foundational skill. Often students learn various drawing techniques such as atmospheric or linear

108

5 Expanding Horizons: AI Tools and Workflows in Art Practice

perspective, further enhancing their ability to represent three-dimensional space and create compelling compositions (Owen 2020). Though drawing is considered an artform in and of itself, many students will primarily use the techniques learned as an ideational or recursive tool to work through various initial concepts for other finished works in different media (Fava 2020). Therefore, while drawing is a fundamental skill in the visual arts and is widely practiced as a means of capturing and representing the visual world, the application in the creative workflow is often limited to initial stages (Simmons 2021). As the training progresses, artists delve into the realm of 3D Design. These courses introduce students to the principles and techniques of three-dimensional art and design. Through hands-on projects and exercises, students explore the fundamental concepts of form, space, and structure in creating three-dimensional artworks (Owen 2020). Technical skills, critical thinking, and creativity are developed in the realm of three-dimensional design. Students often work with a variety of materials and tools to create sculptures, installations, and functional objects, depending upon available facilities, while considering the relationship between form, function, and aesthetics. This discipline specifically expands their understanding of space, volume, and the relationships artworks have with their surrounding environments. By exploring threedimensional forms and the spatial dynamics they create, artists develop a deeper appreciation for the interplay between art and its physical context (Hutson et al. 2022). Art history survey courses that span the breadth of human history are essential elements of the curriculum, offering students a comprehensive understanding of the historical and critical context that underpins their artistic pursuits (Hildebrandt 2021). Concurrently with core studio courses, students engage in introductory survey courses in art history, which provide them with valuable insights into the development of artistic styles, movements, and concepts over time. By studying art history, artists gain a deeper appreciation for the contributions of influential artists and a broader comprehension of the societal, cultural, and political factors that shape artistic expression (Kastner et al. 2021). The integration of art history, theory, and criticism alongside studio courses empowers students to develop applied skills while simultaneously developing their knowledge and appreciation of the historical and conceptual foundations of art (Archino et al. 2020). Once students have acquired proficiency in drawing, color theory, and two- and three-dimensional design principles, and have completed their art history surveys, they are ready to embark on more specialized areas of concentration within their artistic practice (Graham 2019). These concentrations provide opportunities for students to apply their foundational knowledge and skills at an intermediate and advanced level (Meyer and Norman 2020). For instance, students may choose to pursue painting as their area of concentration. Painting encompasses and builds upon the fundamental skillsets of drawing, color theory, and design principles. Through coursework, students further develop their technical abilities and explore the expressive potential of various painting media, such as oil or acrylic. They learn to manipulate color, form, texture, and composition to create visually captivating and conceptually rich artworks (Hubard 2020).

5.1 The Augmented Artistic Process: AI-Driven Workflows and Expanded …

109

Another area of concentration that students may pursue is sculpture. Sculpture offers a unique avenue for artists to delve into three-dimensional forms and spatial relationships in a tangible and tactile manner. Students receive further training on fabrication methods and gain hands-on experience in working with different materials, such as clay, wood, metal, or found objects. They learn to conceptualize, plan, and execute sculptural works that engage with space, texture, and the viewer’s physical presence (Puppe et al. 2021). These areas of concentration are just a few examples of the diverse paths that students can explore within their artistic journey. The curriculum allows for flexibility and individualized development, enabling students to focus on their specific artistic interests and strengths. As they progress in their chosen concentration, they receive guidance and mentorship from faculty members who are experienced practitioners in their respective fields (Long et al. 2019). However, throughout the various levels of art education, one technology has consistently served as the backbone for gathering and sorting source material: photography. Since the advent of photography in the nineteenth century, artists have relied on this medium to capture images that serve as inspiration and reference material for their creative process (Sweet 2021). Whether in an introductory fundamentals course or a capstone project, students frequently turn to photography to source visual ideas, which they then combine with sketching and refine over time (Mesías-Lema and Calviño-Santos 2022). In art education, students are often encouraged to venture out into their immediate environment to seek inspiration (Janes and Sandell 2019). Armed with smartphones that have become ubiquitous, even among teenagers from diverse socioeconomic backgrounds (with approximately 95% of traditional students having access to a smartphone), students are equipped with a powerful tool for capturing photographs that resonate with their artistic vision (McCrann et al. 2021). Photography enables students to document their surroundings, explore diverse perspectives, and capture fleeting moments that inspire their creativity; it provides a means to visually communicate ideas, study light and shadow, document textures and forms, and explore various compositional arrangements (K˛edra and Žakeviˇci¯ut˙e 2019). Through photography, students gain firsthand experiences of observation, documentation, and visual analysis, which are vital skills for any artist or designer (Meehan 2022). By incorporating photography into their artistic practice, students learn to translate the three-dimensional world into two-dimensional representations, similar to the early training artists received through drawing plaster casts in traditional studio art education. The reliance on photography as a source material gathering tool has been deeply ingrained in art education for generations. However, with the emergence of generative AI tools, there is the potential to revolutionize the initial stages of artistic investigation and output. These tools have the ability to exponentially generate concepts, compositions, and color palettes, transforming the creative process and offering new possibilities for artists. The integration of the tools offers a transformative shift in the traditional workflow of gathering and sorting source material since artists no longer have to rely solely on the camera as a primary tool for capturing visual references.

110

5 Expanding Horizons: AI Tools and Workflows in Art Practice

Instead, generative AI can now assist in the creative ideation process by generating an unlimited number of potential initial visual solutions. For example, when tasked with exploring atmospheric perspective or geographic features, instead of physically traveling to distant locations or relying solely on photographs, AI can iterate through thousands of options, offering a vast array of possibilities that can serve as valuable sources of inspiration. From limitless views of deserts and rainforests to different camera effects, any conceivable image can be created for reference. This not only saves time and resources but also expands the creative horizons of artists, allowing them to explore a broader range of visual concepts and possibilities. At the same time, it is important to note that while AI tools can greatly enhance the creative process, they should not replace the traditional methods and approaches entirely. Rather, they should be seen as valuable tools that complement and augment the artist’s vision and skills. AI-generated concepts and compositions can serve as a catalyst for inspiration, providing artists with new perspectives and possibilities. The generative process with AI can offer fresh insights and stimulate creativity, particularly when applicable to specific projects or assignments. As art educators and practitioners, it is crucial to strike a balance between utilizing AI tools and maintaining the essential artistic skills and principles that form the foundation of traditional art education. By integrating AI into the classroom, students can gain valuable experience in navigating the intersection of technology and creativity, developing the critical thinking skills necessary to evaluate when and how AI can enhance their artistic practice. In the following sections, we will delve into the four main AI-driven tools: Stable Diffusion, DALL-E 2, Midjourney, and Adobe Firefly. Through step-by-step instructions and guidance, we will explore how these tools can be effectively utilized to harness the power of AI in generating initial visual solutions. By embracing the potential of AI in the art and design classroom, educators and students can unlock new realms of creative exploration and inspiration.

5.2 Exploring AI-Driven Art Tools In the ever-evolving landscape of art and design education, the integration of AIdriven tools presents a myriad of possibilities for artists and educators alike. As we explore the realm of AI-driven art tools in this section, we will delve into four prominent tools: Stable Diffusion, DALL-E 2, Midjourney, and Adobe Firefly. Each tool offers its own unique approach and capabilities, catering to different creative needs and preferences. For instance, when using DALL-E 2, specificity is key. The more precise and detailed the text prompt, the more intriguing and intricate the generated image becomes. On the other hand, Midjourney thrives on simplicity and brevity. It embraces short and concise prompts, allowing its creative capabilities to take the lead. The more general the prompt, the more imaginative and open-ended the resulting image becomes.

5.2 Exploring AI-Driven Art Tools

111

These four distinct generative AI tools offer unique capabilities for generating media content. Each tool has its own approach and features that set it apart, while sharing the common goal of utilizing artificial intelligence to generate visuals based on textual prompts. Stable Diffusion, for instance, released in 2022, is a deep learning model focused on generating detailed images conditioned on text descriptions. It excels in tasks such as inpainting, outpainting, and image-to-image translations guided by a text prompt. What distinguishes Stable Diffusion is its use of a latent diffusion model, a type of deep generative neural network. This model allows for efficient training and generation of images by removing successive applications of Gaussian noise on training images. Stable Diffusion has publicly released its source code and model weights, making it accessible to users who can run it on consumer hardware equipped with a modest GPU. DALL-E 2, developed by OpenAI, is the successor to the original DALL-E model. It is designed to generate more realistic images at higher resolutions while combining concepts, attributes, and styles. DALL-E 2 utilizes a multimodal implementation of GPT-3, a generative pre-trained transformer model, with a large number of parameters. OpenAI has made DALL-E 2 available through its API, enabling developers to integrate it into their own applications. By inputting natural language descriptions, users can generate digital images with DALL-E 2’s advanced capabilities. Midjourney, a generative artificial intelligence program developed by Midjourney, Inc., stands out for its preference for short, simple prompts. Unlike other models that rely on detailed descriptions, Midjourney shines when given general prompts that allow it to exercise its own creativity. Users interact with Midjourney through Discord bot commands, providing text prompts to generate artwork. Its unique approach and focus on simplicity make Midjourney a distinct tool in the AI art generation landscape. Adobe Firefly, on the other hand, is a family of AI models specifically designed for Adobe’s suite of apps and services. Its initial focus is on generating image and text effects, offering new ways to ideate, create, and communicate. As an expansion of Adobe’s previous generative AI tools, Firefly will be integrated directly into Adobe’s Creative Cloud, Document Cloud, Experience Cloud, and Adobe Express workflows. It is part of a series of new Adobe Sensei generative AI services. Adobe Firefly is trained on content that is licensed or out of copyright, ensuring it does not generate based on other people’s brands or intellectual property. The aim is to empower users to create amazing content without worrying about copyright issues. While Stable Diffusion, DALL-E 2, Midjourney, and Adobe Firefly all harness the power of AI to generate visuals, their distinct approaches and features provide users with a range of options depending on their specific needs and preferences. Whether it’s generating detailed images conditioned on text, combining concepts and styles, embracing simplicity and creativity, or integrating seamlessly into Adobe’s suite of creative tools, these AI-driven tools expand the boundaries of artistic expression and open up new possibilities for creators. With these varying approaches and capabilities in mind, it becomes apparent that different AI tools can be utilized for different purposes, depending on the desired output and creative intentions. Artists and teachers have the freedom to explore and

112

5 Expanding Horizons: AI Tools and Workflows in Art Practice

experiment with these tools, adapting their use according to the specific needs of their projects or educational objectives. By embracing the potential of AI-driven art tools, we open doors to new realms of creative exploration and inspiration. These tools have the ability to enhance and expand our artistic practices, pushing the boundaries of what is possible and challenging traditional notions of creativity. In the following sections, we will provide step-by-step instructions and guidance on how to effectively harness the power of these AI tools. Through hands-on experimentation and discovery, we can unlock the transformative potential of AI in both the creative process and the classroom.

5.2.1 DALL-E 2 DALL-E and DALL-E 2 are deep learning models developed by OpenAI that generate digital images based on natural language descriptions, known as “prompts”. DALL-E was introduced in January 2021 and utilizes a modified version of GPT-3 to generate images. In April 2022, OpenAI announced DALL-E 2, a successor designed to generate more realistic images at higher resolutions with the ability to combine concepts, attributes, and styles. Access to DALL-E 2 was initially limited to a research preview, but it entered beta phase in July 2022 with invitations sent to waitlisted individuals. Users can generate a certain number of images for free each month and have the option to purchase additional images. In November 2022, OpenAI released DALL-E 2 as an API, enabling developers to integrate the model into their applications. The models are based on the generative pre-trained transformer (GPT) architecture developed by OpenAI, with DALL-E employing a multimodal implementation of GPT-3. The model is trained on text-image pairs from the internet, using 12 billion parameters in the case of DALL-E and 3.5 billion parameters in DALL-E 2. DALLE’s output is evaluated and ranked using the CLIP (Contrastive Language-Image Pre-training) model, which helps filter and select the most appropriate images. DALL-E demonstrates the capability to generate imagery in various styles, including photorealistic imagery, paintings, and emojis. It can manipulate and rearrange objects in its images and accurately place design elements in novel compositions. The model showcases the ability to fill in missing details and infer appropriate elements without explicit prompts. It also exhibits a broad understanding of visual and design trends. Furthermore, DALL-E can blend concepts and generate images for a wide range of arbitrary descriptions with rare failures. Its visual reasoning ability is sufficient to solve visual tests like Raven’s Matrices. The models have garnered significant attention and are being adopted by various applications and platforms, showcasing their potential for creative image generation. DALL-E 2 offers artists, designers, and creative individuals a powerful tool for ideation, exploration, and inspiration. Its ability to generate visually rich and diverse images based on textual prompts opens up new possibilities for artistic expression

5.2 Exploring AI-Driven Art Tools

113

and design innovation. Whether used for concept development, visual exploration, or creative experimentation, DALL-E 2 provides a valuable resource for those seeking to push the boundaries of their creativity. Using DALL-E 2 DALL-E 2, developed by OpenAI, is a powerful language model and text-to-image generator. This innovative system operates by allowing users to input a text prompt, which the program reads and utilizes to generate a series of four images, drawing inspiration from the language used in the prompt. To get started, visit: https://openai. com/dall-e-2 1. Set up an account: Visit the OpenAI website and sign up for an account. Provide your email address and phone number for verification. Adding a payment method is optional. 2. Receive free credits: Upon setting up your account, you will receive 50 free credits for your first month of usage (Fig. 5.5). Each credit corresponds to one prompt input. Unused credits expire, and you will start each calendar month with 15 credits. Additional credits can be purchased for a fee. 3. Access the DALL-E interface: Once you’re logged into your account, navigate to the DALL-E section. The interface is straightforward, featuring a text input field at the top, sample images displayed below it, and a collapsible bank of previously generated images on the right side (Fig. 5.6). 4. Input your prompt: Enter a text-based prompt in the provided text input field. The language within your prompt will determine the output images generated Fig. 5.5 Buy credits, DALL-E 2

114

5 Expanding Horizons: AI Tools and Workflows in Art Practice

Fig. 5.6 Prompt input field, DALL-E 2

Fig. 5.7 “Image of an Apple” prompt generation, four examples, DALL-E 2

5.

6.

7.

8.

by DALL-E. For example, you could use the prompt “Make an image of an apple.” View and save the generated images: After submitting your prompt, DALL-E will generate four related images based on the language you provided (Fig. 5.7). These images will appear below the text input field. You can save each image to your computer as a.png file. By default, the images will be titled based on your prompt input, making it easier to track your generated images. Explore variations: If you want to explore variations of a specific image, you can select one of the generated images (Fig. 5.8). DALL-E will then create four additional iterations related to the selected image (Fig. 5.9). Keep in mind that this action will cost you one credit. Utilize the “outpainting” feature: DALL-E offers an “outpainting” feature that allows you to expand the frame of the initial image by adding additional prompts (Fig. 5.10). This can provide more context or information to the generated image. You can also edit the images directly within the DALL-E program by erasing portions or adding uploaded photographs. In order to achieve the best results and continue stylistic cues in the generation frame, it is best to overlap the image slight as in Figs. 5.11 and 5.12. Optimize your prompts: To achieve desired output styles or formats, it is recommended to include specific qualifiers at the end of your prompt. For example, if you want a cartoon-style dog wearing a Hawaiian shirt lounging by a pool, you could structure your prompt as “A cartoon dog in a Hawaiian shirt lounging by a pool, vector graphic.”

5.2 Exploring AI-Driven Art Tools

115

Fig. 5.8 Selecting desired apple image, DALL-E 2

Fig. 5.9 Generating more apples based on selection, DALL-E 2

9. Note the image size and watermark: The default size of the generated images is 1024 × 1024 pixels. Additionally, there will be a DALL-E watermark displayed in the bottom right corner of each image, consisting of red, green, blue, cyan, and yellow squares. 10. Gain inspiration from examples: While waiting for your images to load, the DALL-E site will display examples of prompts and outcomes. These can serve as inspiration for generating new ideas and prompt structures.

116

5 Expanding Horizons: AI Tools and Workflows in Art Practice

Fig. 5.10 Using outpainting feature, DALL-E 2

Fig. 5.11 Expanding stylistic cues in generation frame (selection), DALL-E 2

Fig. 5.12 Expanding stylistic cues in generation frame (generation), DALL-E 2

5.2 Exploring AI-Driven Art Tools

117

To get the best results with DALL-E 2, users should sign up and set up an account with OpenAI, provide clear and specific prompts that include the desired type, action, objective, and format/style, and use the “outpainting” feature and image editing capabilities to enhance and customize the generated images. It’s important to remember the default image size, the presence of the DALL-E watermark, and the availability of free credits and options to purchase additional credits. By following these steps, users can harness the power of DALL-E 2 to generate impressive images based on their textual prompts.

5.2.1.1

Midjourney

The Midjourney platform entered open beta on July 12, 2022, allowing users to explore its capabilities and create artwork using Discord bot commands. Midjourney is a generative AI program and service created and hosted by Midjourney, Inc., an independent research lab based in San Francisco, California. Led by David Holz, co-founder of Leap Motion, the Midjourney team developed the tool to generate images from natural language descriptions, known as “prompts.” It operates similarly to OpenAI’s DALL-E and Stable Diffusion, utilizing language prompts to create visually compelling images. With its unique approach and continuous development, Midjourney offers artists, designers, and creators a powerful AI tool to explore the possibilities of generative art and unleash their creative potential. Unlike some other AI tools that require specific and detailed prompts, Midjourney prefers short and general prompts to encourage its own creative interpretation. The unique aspect of Midjourney lies in its ability to generate visually interesting and diverse images based on minimal input. Users can provide simple and concise prompts, allowing Midjourney to exercise its creative capabilities and generate a wide range of imaginative visual concepts. By embracing simplicity in the prompts, Midjourney encourages a more open-ended and exploratory approach to image generation. Its algorithm explores various possibilities and creative directions, resulting in visually intriguing and unconventional outputs that may not be predictable based on the initial prompt alone. Midjourney’s preference for brevity and generality in prompts allows users to tap into their own creativity and interpretation. It fosters a collaborative relationship between the user and the AI tool, enabling a dynamic interplay of ideas and inspirations. Artists, designers, and creators can leverage the creative capabilities of the tool to explore new realms of visual expression, spark inspiration, and discover unexpected visual possibilities. Whether used as a standalone tool or in combination with other AI-driven or traditional creative methods, Midjourney offers a fresh and innovative approach to generating artistic content. Using Midjourney Follow these simple steps to set up your Midjourney account and create your first generative image. Midjourney is an AI-powered image generator developed by Midjourney Studio. It allows users to input text prompts and generates unique and

118

5 Expanding Horizons: AI Tools and Workflows in Art Practice

diverse images based on the provided input. To get started with Midjourney, you need to create an account and follow a few simple steps to unlock the creative possibilities of this innovative AI tool. 1. Visit the Midjourney website: Open your preferred web browser and go to the Midjourney website (www.midjourney.com). 2. Sign up for an account: Look for the “Sign In” button on the homepage to begin creating an account. 3. Register a Discord Account: Midjourney works as a chatbot on Discord’s instant messaging social platform (https://discord.com/). Click “Register” to create an account. If you already have a Discord account, log in and proceed to step 10. 4. Create your first Discord server: A list of Discord servers will appear. Select “Create My Own” and choose the type of server. Finish creating your server by selecting “Create.” 5. Verify your email: Check your email inbox for a verification email from Midjourney. Click on the verification link to confirm your account. 6. Navigate back to Midjourney: Return to the Midjourney website and sign into your account. Authorize the Midjourney Bot on your Discord account by selecting “Authorize.” 7. Join Discord to start creating: Click on “Join the Discord to start creating!” and accept the invite to join Midjourney on Discord. 8. Set up your profile: Complete your profile on the Midjourney Discord server by adding a profile picture, bio, and any other optional information. 9. Generate an image: In the Discord server, select one of the rooms with the Midjourney Bot by clicking on a “newcomer room” in the navigation bar (Fig. 5.13). 10. Type a prompt: At the bottom of the newcomer room, enter a prompt in the text box. Use the “/imagine” command followed by your prompt (Fig. 5.14). 11. Analyze your image generation: Scroll to the bottom of the newcomer room to view the generated images. Midjourney will provide four options for upscaling

Fig. 5.13 Newcomer rooms, Midjourney Discord

5.2 Exploring AI-Driven Art Tools

119

Fig. 5.14 Text prompt input bar, Midjourney Discord

Fig. 5.15 “Bottles of water on fire with wings” text prompt (four generated versions), Midjourney Discord

or creating variations of the images. In this instance from the text prompt “A water bottle on fire with wings” (Fig. 5.15). 12. Create your final image: Underneath each image, you will see options labeled with letters and numbers. Use “U1” to upscale the first image and “U2, U3, and U4” for the second, third, and fourth images. Use “V1” to create variations of one of the images (Fig. 5.16). The refresh icon can generate four new concepts.

120

5 Expanding Horizons: AI Tools and Workflows in Art Practice

Fig. 5.16 Version selection options, Midjourney Discord

13. Consider prompt engineering: Experiment with different prompts to observe the differences in image quality. Try varying the level of detail and specificity in your prompts, such as “A Water Bottle on Fire Soring Like an Eagle” or “…Attached to a Water Bottle” (Figs. 5.17 and 5.18). 14. Save Images: Once a final image is decided upon, click “Download from Midjourney” to a destination of your choice. To get the best results from Midjourney, there are a few key takeaways to keep in mind. First, when creating an account, make sure to provide accurate and complete information during the registration process. Second, take the time to set up your profile on the Midjourney Discord server, including adding a profile picture and bio, as this helps personalize your experience. Third, experiment with different prompts and explore prompt engineering to discover the range of possibilities and image variations that Midjourney can generate. Remember that the tool excels at extrapolating concise information, so try to strike a balance between being specific and providing enough detail to guide the AI. Finally, explore the options for upscaling and creating variations of the generated images to refine and customize your final results. By following these tips, you can maximize your creative potential and get the best results from the tool.

5.2.1.2

Stable Diffusion

Stable Diffusion is a deep learning, text-to-image model that was released in 2022. Developed by Stability AI in collaboration with academic researchers and non-profit organizations, it is primarily used to generate detailed images based on text descriptions. This versatile model can also be applied to tasks like inpainting, outpainting, and image-to-image translations guided by a text prompt. The development of Stable Diffusion was funded and shaped by Stability AI, with the technical license for the model released by the CompVis group at Ludwig Maximilian University of Munich. The model utilizes a latent diffusion architecture, which involves a variational autoencoder (VAE), U-Net, and an optional text encoder. The VAE compresses the image into a smaller latent space, while Gaussian noise is applied iteratively during the diffusion process. The U-Net block denoises the output,

5.2 Exploring AI-Driven Art Tools

121

Fig. 5.17 A water bottle on fire soring like an eagle (four generated versions), Midjourney Discord

and the VAE decoder generates the final image. The model can be conditioned on text using the pretrained CLIP ViT-L/14 text encoder. Training data for Stable Diffusion comes from the LAION-5B dataset, derived from Common Crawl data. It consists of image-caption pairs that were classified and filtered based on language, resolution, watermark likelihood, and aesthetic score. The dataset was created by LAION, a German non-profit funded by Stability AI. The model was trained on subsets of LAION-5B, including laion2B-en, laion-highresolution, and laion-aesthetics v2 5+. Stable Diffusion represents a significant advancement in text-to-image generation, providing a powerful tool for artists, designers, and researchers to create visually compelling and diverse images based on text prompts. Its release marks a departure from previous proprietary models, as Stable Diffusion is publicly available and can be run on consumer hardware with a modest GPU.

122

5 Expanding Horizons: AI Tools and Workflows in Art Practice

Fig. 5.18 A water bottle on fire soring like an eagle attached to a water bottle (four generated versions), Midjourney Discord

Stable Diffusion operates by iteratively refining a low-resolution image through a series of steps, gradually increasing the resolution and enhancing the details. This process involves a diffusion model that gradually adds noise to the image and then progressively removes it. By iteratively applying these diffusion steps, Stable Diffusion is able to generate visually appealing and realistic images with remarkable fidelity and coherence. One of the key advantages of Stable Diffusion is its ability to produce highresolution images with fine details. The progressive diffusion process allows for the generation of images that exhibit smooth transitions, sharp edges, and intricate textures. This makes it particularly suitable for tasks that require precise and detailed visual outputs, such as digital art, graphic design, and computer-generated imagery. Stable Diffusion can be used by artists, designers, and creators as a powerful tool for generating unique and visually compelling images. By providing input to guide

5.2 Exploring AI-Driven Art Tools

123

the diffusion process, users can influence the characteristics and aesthetics of the generated images. This enables creative exploration and experimentation, opening up new possibilities for artistic expression and design. Using Stable Diffusion 1. Open the Stable Diffusion website. Go to https://stablediffusionweb.com/ in your web browser. Ensure you have a stable internet connection. 2. Create an account (optional). If you want to access additional features or save your work, consider creating an account on Stable Diffusion. Look for the “Sign up” or “Create an account” option on the website’s homepage and follow the prompts to register. 3. Explore the website. Take some time to familiarize yourself with the website’s layout and navigation. You’ll find menus, tutorials, workflows, and a shop. 4. Choose the method of using Stable Diffusion: You have two options for using Stable Diffusion: a. Online generator: If you’re a beginner or prefer a simpler approach, you can use the online generator available on the Stable Diffusion website. It provides a user-friendly interface and streamlined functionality. b. Advanced GUI: If you’re more experienced or require additional features, you can use an advanced Graphical User Interface (GUI) like AUTOMATIC1111. This GUI offers more tools and options for generating and editing images with Stable Diffusion. 5. Build a good prompt: A prompt is a description of the image you want to generate (Fig. 5.19). To get the desired results, follow these rules of thumb: a. Be detailed and specific: Provide as much detail as possible in your prompt to guide Stable Diffusion accurately. b. Use powerful keywords: Incorporate influential keywords related to the style, subject, or other aspects of the image to guide the AI model. 6. Adjust parameters (optional): When using Stable Diffusion, you can adjust certain parameters to fine-tune the generated images. Parameters may include image size, sampling steps, CFG scale, and seed value. Experiment with these settings to achieve the desired output. 7. Generate multiple images: It’s recommended to generate multiple images when testing a prompt (Fig. 5.20). This allows you to explore different variations and increase the likelihood of finding a satisfactory result. 8. Post-process the images (optional): After generating the images, you can further enhance them through post-processing techniques. For example, you can use face restoration techniques or inpainting to fix defects or refine certain parts of the image. 9. Download or save the image: Once you’re satisfied with an image, you can download it to your computer or save it in the desired format. Follow the instructions provided on the Stable Diffusion website or GUI to complete this step.

124

5 Expanding Horizons: AI Tools and Workflows in Art Practice

Fig. 5.19 Stable diffusion web UI

Fig. 5.20 Rhino X Y Plot demonstrating different seeds, stable diffusion, December 12, 2022 (from Wikimedia Commons, licensed under CC0)

Achieving optimal results with Stable Diffusion necessitates a strategic approach and adherence to best practices. Central to this endeavor is the art of constructing meticulous prompts. By meticulously outlining explicit details and employing evocative language, researchers can effectively guide the AI system to produce images that transcend expectations. Leveraging influential keywords and iteratively refining prompts enable the exploration of diverse variations and yields more creative possibilities. Moreover, integrating post-processing techniques such as face restoration and inpainting provides invaluable means for fine-tuning and perfecting the generated images. A comprehensive understanding of the available parameters, including image size and sampling steps, empowers researchers to finely calibrate their outputs

5.2 Exploring AI-Driven Art Tools

125

and attain desired outcomes. For those seeking enhanced control, advanced graphical user interface (GUI) tools like AUTOMATIC1111 offer a wealth of features to further augment the image generation process. The utilization of both base and custom models opens up an extraordinary avenue for scholarly pursuits, facilitating the creation of photorealistic marvels and compelling visual representations. By embracing the capabilities of Stable Diffusion, researchers are invited to unlock their creative potential and transform their scholarly visions into captivating realities.

5.2.1.3

Adobe Firefly

Adobe Firefly is a family of AI models developed specifically for Adobe’s suite of apps and services, with a focus on generating media content. It represents an expansion of the generative AI tools introduced by Adobe during its 2022 Max conference, which were initially integrated into Photoshop, Express, and Lightroom. Firefly is designed to be seamlessly integrated into Adobe’s Creative Cloud, Document Cloud, Experience Cloud, and Adobe Express workflows, becoming part of the broader Adobe Sensei generative AI services. One of the key aspects emphasized by Adobe is that the AI models used in Firefly are trained on content that is licensed or out of copyright, ensuring that they do not rely on artists’ work found across the internet. This approach aims to address ethical concerns and avoid any copyright infringements. Adobe officially unveiled Firefly on March 21, 2023, launching a beta version primarily focused on commercial users. The beta release includes two initial tools. The first tool allows users to input natural language prompts and receive generated images, similar to other generative AI image models like DALL-E and Midjourney. The second tool focuses on generating stylized text, applying various styles or textures to lettering and fonts. During the beta phase, the Firefly tools are available through the Adobe Firefly website. However, Adobe plans to integrate Firefly into its other applications, including Express, Photoshop, Illustrator, and Adobe Experience Manager. Throughout the beta release, Adobe aims to engage with the creative community to gather feedback and insights on how to further enhance and integrate Firefly into its applications. Firefly’s initial AI models were trained on a vast collection of Adobe Stock images, openly licensed content, and public domain content. The intention is to ensure that Firefly does not generate based on other people’s brands or intellectual property. Adobe also plans to introduce a “Do Not Train” tag, which will allow creators to opt out of using their content for model training. Additionally, Adobe aims to develop a compensation model that enables customers to monetize their creations by providing opportunities for Adobe Stock creators. Using Adobe Firefly Firefly (in beta at the time of this publication) by Adobe is a creative tool that allows you to generate and customize images based on text prompts. Additionally, the tool

126

5 Expanding Horizons: AI Tools and Workflows in Art Practice

is able to use generative fills to augment photographs, text-effect controls to generate graphically stylized typography, generate recoloring of existing graphics allowing for exploration of color variations, generate images based on the positioning of 3d elements, and even adjust the aspect ratio of images with a single click. The following provides a set of instructions for using Firefly specifically for text to image generation. 1. Create an Adobe Firefly account by visiting the Adobe website (https:// www.adobe.com/). You will need to provide your email address for verification purposes. Phone number verification may be required as well, but it is not mandatory. You can also choose to associate a payment method with your account, although it is not a requirement. Alternatively, you may login with existing adobe credentials to access the beta version of the application. 2. Receive free “image credits” for first month once your account is set up. Each credit corresponds to one image generation. Unused credits will expire, and at the beginning of each month, you will receive a certain number of credits. Additional credits can be purchased for a nominal fee, such as 100 credits for $10 USD (pricing subject to change). If an existing adobe account has been used to access the application credits do not apply during the beta version of the utility. 3. Select the text-to-image option once you have chosen “explore firefly” from the home page found at firefly.adobe.com. The Firefly interface is user-friendly and intuitive. You will find a text input field at the top of the screen, where you can enter your text prompt. The generated images will appear below the input field. On the right side of the screen, there is a collapsible panel that displays your previously generated images. You can access your account information and purchase additional credits by clicking on the account icon in the top right corner. The top left corner features a tab for viewing your image generation history and managing your image collections. 4. Enter a text prompt describing what you want to see in the generated image. Firefly will create a set of related images based on your prompt. For instance, using the following text prompt “Create an image of an American horned toad lizard against the sunset of the Palo Duro canyon” will produce Fig. 5.21. Additionally, a panel displaying stylization tags and options is presented with the generated images. These tags can be used to further adjust the images being generated to achieve the look the designer may be striving to achieve. These images may exhibit similarities or display variations, depending on the language used in your prompt. Each generated image can be saved to your computer as a.png file. By default, the image will be named based on your prompt input. This feature helps you keep track of your used prompts. The image history section will also store your generated images and provide details about the prompt used for their generation. 5. After receiving the initial set of images, you have the option to select one of them and have Firefly generate similar images based on the choice, submit the image to the firefly gallery, save it as a favorite, or even download it (Fig. 5.22). 6. For optimal results, it is recommended to include a “type” of image output as part of your prompt. This can be done using the stylizing panel that appears

5.2 Exploring AI-Driven Art Tools

127

Fig. 5.21 “Create an image of an American horned toad lizard against the sunset of the Palo Duro canyon” text prompt (four generated versions), Adobe Firefly, 2023

Fig. 5.22 Selected image generative options, Adobe Firefly, 2023

128

5 Expanding Horizons: AI Tools and Workflows in Art Practice

Fig. 5.23 Generate an image of a rusted robotic dinosaur roaming the Palo Duro canyon on a windy day with stylizing tags “Graphic,” “Fantasy,” “Warm Tone,” “Dramatic Lighting,” and “Wide Angle” text prompt (four generated versions), Adobe Firefly, 2023

after the initial image is generated. Specify whether you want a photographic, drawn, oil-painted, or digital art style for the image. Including these qualifiers at the end of the prompt tends to produce more accurate results. Start with a subject, describe its action or objective, and end with the desired format or style. For example, one can used the following text prompt “Generate an image of a rusted robotic dinosaur roaming the Palo Duro canyon on a windy day with stylizing tags “Graphic,” “Fantasy,” “Warm Tone,” “Dramatic Lighting,” and “Wide Angle” and Fig. 5.23 will be the output. When using Adobe Firefly, a creative tool for generating and customizing images based on text prompts, there are key takeaways and recommendations for optimal results. Create an Adobe Firefly account on the Adobe website, providing an email address for verification. Receive free “image credits” for the first month, with each credit corresponding to one image generation. Select the text-to-image option on the user-friendly interface, enter a text prompt, and Firefly will generate related images. Utilize the stylization panel to adjust the images and choose specific image styles or formats. Save the images as .png files, considering the default image size of 1024 × 1024 pixels and the Firefly watermark in the bottom right corner. For best results, include image style qualifiers in the prompt, such as “photographic,” “drawn,” “oil-painted,” or “digital art.” By following these recommendations, users can fully leverage Adobe Firefly to generate customized images and unleash their creative potential.

5.2 Exploring AI-Driven Art Tools

129

Understanding the different prompting strategies for each generative AI tool is crucial to achieving the desired results. Each tool, whether it’s DALL-E 2, Midjourney, Stable Diffusion, or Adobe Firefly, has its own unique approach and features. By following the step-by-step instructions provided and taking note of the key takeaways, users can effectively harness the power of these AI models to generate impressive and creative outputs. Whether it’s generating images from text prompts, exploring variations, or experimenting with different types of prompts, users can unlock the full potential of these tools and unleash their creativity. Remember, practice and exploration are key to mastering these tools and discovering new and exciting possibilities in the realm of generative AI. These generative AI tools, such as DALL-E 2, Midjourney, Stable Diffusion, and Adobe Firefly, represent a significant advancement in the field of art and design instruction. They bring a new dimension to the long tradition of art education that has evolved over centuries, from the Renaissance art academies to modern art and design programs. In the Renaissance, art academies played a crucial role in training artists by providing a structured curriculum focused on developing technical skills, understanding perspective, composition, and mastering various artistic techniques. These academies emphasized the importance of observation, study of nature, and meticulous craftsmanship, as well as the theoretical context for artmaking. Turning to modern times, art and design education has expanded to incorporate various disciplines, including digital art, graphic design, and multimedia. With the emergence of generative AI tools, artists and designers now have access to a powerful set of tools that can augment their creative process and offer new possibilities for exploration and experimentation. These act as innovative tools for artists and designers to generate visual content, explore new ideas, and push the boundaries of their artistic practice. By leveraging the capabilities of generative AI, artists and designers can combine their own creativity with the algorithms of these tools, resulting in unique and inspiring artworks. Integrating these tools into art and design education opens up exciting opportunities for students to explore the intersection of technology and creativity. By incorporating these AI tools into the curriculum, educators can encourage students to experiment with novel approaches, think critically about the role of AI in the creative process, and develop a deep understanding of how these tools can be leveraged to enhance their artistic vision. Just as Renaissance artists honed their skills through rigorous training and practice, today’s artists and designers can embrace these AI tools as part of their artistic toolkit. By merging the traditional foundations of art education with the cuttingedge capabilities of generative AI, artists and designers can expand their creative horizons and continue to push the boundaries of artistic expression in the digital age. The integration of generative AI tools into art and design education bridges the gap between tradition and innovation, allowing students of today to explore new realms of creativity. By embracing these tools alongside the rich history of art instruction, artists and designers can embark on a transformative journey of artistic discovery, creating works that blend the power of human imagination with the computational capabilities of AI.

130

5 Expanding Horizons: AI Tools and Workflows in Art Practice

References Archino S, Lanier M, McClain R (2020) Reframing the arts within the liberal arts community: Teaching an arts entrepreneurial mindset to achieve transdisciplinary outcomes. Art 9(2):5–18 Bellavitis A, Sapienza V (eds) (2023) Apprenticeship, work, society in early modern Venice. Taylor & Francis Bellori GP (1672) Le vite de pittori, scultori e architetti moderni. Rome Bellori GP (2005) The lives of the modern painters, sculptors and architects. In: Wohl H, Sedgwick Wohl A (trans). Cambridge University Press, New York Bolin PE, Kantawala A, Stankiewicz MA (2021) Steppingstones: Pivotal moments in art education history. Teachers College Press Bonfait O (2022) Conférences sans conférer? Les conférences de l’Académie royale de peinture et de sculpture, 1648–1699. Les Doss du Gri (01) Bellori GP (1976) Le vite de’pittori, scul? tori e architetti moderni, Borea E, Previtali G (eds) Turin, Einaudi Calvert AE (2013) A rationale and model for a cultural contextual art history curriculum. Can Rev Art Educ Res Iss 40(1): 38-46 Caner Yüksel Ç, Dinç Uyaro˘glu ˙I (2021) Experiential learning in basic design studio: body, space and the design process. Int J Art Des Educ 40(3):508–525 Clayson JE (2021) Broadening constructionism through visual modelling: my self as subject and object. Brit J Edu Tech 52(3):1143–1163 Davis JC (2022) Invention: the art of liberal arts. J Interdisc Stud 34(1/2):205–207 Doren M (2015) Is the critique relevant? The function of critique in a studio art classroom, told three times. Vis Inq 4(3):193–203 Dressen A (2021) The intellectual education of the Italian renaissance artist. Cambridge University Press Elizondo K (2020) Art history, art museums, and power: a critical art history curriculum. Art Hist Pedagog Pract 5(1):4 Farago C (2020) The truth in painting. J Art Hist 22:1–8 Fava M (2020) A decline in drawing ability? Int J Art Des Educ 39(2):319–332 Graham M (2019) Assessment in the visual arts: challenges and possibilities. Art Edu Pol Rev 120(3):175–183 Graham M, Buehler F (2021) Figure drawing and alternate narratives of artistic mastery. Draw Res Theor Pract 6(1):171–187 Grayson C (ed) (1972) Leon Battista Alberti on painting and sculpture: the Latin texts of ‘De Pictura’ and ‘De Statua.’ Phaidon Press, London Gross L (2019) Art and artists on the margins. In: On the margins of art worlds. Routledge, pp 1–16 Hehmeyer L (2021) “Let the world know you are alive”: May Alcott Nieriker and Louisa May Alcott confront nineteenth-century ideas about women’s genius. In: The forgotten Alcott. Routledge, pp 161–177 Hildebrandt M (2021) Creativity and resilience in art students during COVID-19. Art Edu 74(1):17– 18 Hubard OM (2020) A different kind of learning: The value of a studio art class for non-art graduate students. In: Multidisciplinary approaches to art learning and creativity. Routledge, pp 232–255 Hutson J (2019) Le accademie Bolognese e Romana: reconsidering center-periphery pedagogy. Art Des Rev 7(3):1–21 Hutson J (2021) Li pittori parlano con l’opere: visualizing poetry in practice in early modern Italian art. Athen J Hum Art 8(3):1–18 Hutson J, Lively J, Weber J (2022) In the studio with virtual reality: student perceptions and potential integrations into art and design curriculum. Art Des Commun High Educ 21(2):235–256 Hutson J (2016) Early modern art theory. Visual culture and ideology, 1400–1700. Anchor Academic Publishing

References

131

Ishii S (2022) Art history, open educational resources (OERs), and social justice-oriented pedagogy: adaptations to introductory world art history survey courses. Art Hist Pedagog Pract 7(1):1 Jackson P (2022) Apprentice artists. The art of copying art. Springer International Publishing, Cham, pp 15–36 Janes RR, Sandell R (2019) Museum activism. Taylor & Francis, p 406 Jin Y, Tiejun Z (2023) The application of Metaverse XiRang game in the mixed teaching of art and Design in Colleges and Universities. Educ Inf Technol 1–31 https://doi.org/10.1007/s10639023-11844-z Juneja M (2011) Global art history and the ‘burden of representation’. In: Global studies: mapping contemporary art and culture, pp 274–297 Kastner L, Umbach N, Jusyte A, Cervera-Torres S, Fernández SR, Nommensen S, Gerjets P (2021) Designing visual-arts education programs for transfer effects: development and experimental evaluation of (digital) drawing courses in the art museum designed to promote adolescents’ socio-emotional skills. Front Psychol 11(1):603984 K˛edra J, Žakeviˇci¯ut˙e R (2019) Visual literacy practices in higher education: what, why and how? J vis Lit 38(1–2):1–7 Long A, Bischoff WR, Aduddell K (2019) Research prescription for undergraduate students: research mentoring in a small liberal arts university. J Prof Nurs 35(3):170–173 Marinkovic B (2021) Tacit knowledge in painting: from studio to classroom. Int J Art Des Educ 40(2):389–403 McCrann S, Loughman J, Butler JS, Paudel N, Flitcroft DI (2021) Smartphone use as a possible risk factor for myopia. Clin Exper Opt 104(1):35–41 McNeely IF (2009) The renaissance academies between science and the humanities. Configurations 17(3):227–258 Meehan O (2022) Discipline-led thinking through cultural collections and art. In: Visual pedagogies in higher education. Brill, pp 89–102 Mesías-Lema JM, Calviño-Santos G (2022) Self-portrait in the photo booth: self-representation in the selfie era, a photo-based educational research project. Vis Stud 37(1–2):54–68 Meyer MW, Norman D (2020) Changing design education for the 21st century. She Ji J Des Econ Innov 6(1):13–49 Owen C (2020) Through a glass darkly: the teaching and assessment of drawing skills in the UK post-16 art & design curriculum. Inter J Art Des Educ 39(2):333–345 Pointon M (2014) History of art: a student’s handbook. Routledge Portnova TV (2019) Integration of science and art in the study of Renaissance art culture. Persp Sci Educ 41(5) Puppe L, Jossberger H, Gruber H (2021) Creation processes of professional artists and art students in sculpting. Empir Stud Arts 39(2):171–193 Quiviger F (2002) Renaissance art theories. In: A companion to art theory, pp 49–60 Reiter A (2021) Kant on the aesthetic ideas of beautiful nature. Brit J Aes 61(4):403–419 Risdonne V, Hubbard C, López Borges VH, Theodorakopoulos C (2022) Materials and techniques for the coating of nineteenth-century plaster casts: a review of historical sources. Stud in Conserv 67(4):186–208 Salazar SM (2013) Studio interior: investigating undergraduate studio art teaching and learning. Stud Art Educ 55(1):64–78 Salazar SM (2014) Educating artists: theory and practice in college studio art. Art Edu 67(5):32–39 Sealy U, Lee TC (2020) Anatomy and academies of art I: founding academies of art. J Anat 236(4):571–576 Simmons III S (2021) The value of drawing instruction in the visual arts and across curricula: historical and philosophical arguments for drawing in the digital age. Routledge Skaarup BO (2017) Applied science in the renaissance art academy. In: Art, technology and nature: renaissance to postmodernity, p 105 Sweet D (2021) Before and after photography. J Contemp Paint 7(1–2):163–175

132

5 Expanding Horizons: AI Tools and Workflows in Art Practice

Wa´zbi´nski Z (1985) “San Luca che dipinge la Madonna” all’Accademia di Roma: un” pastiche” zuccariano nella maniera di Raffaello? Artib et Hist, pp 27–37 Wei B (2021) The influence of materials and techniques on art studios in the early renaissance. In: 7th international conference on humanities and social science research (ICHSSR 2021). Atlantis Press, pp 204–207 Wellington R (2020) Metadata, material culture, and global art history. In: The Routledge companion to digital humanities and art history. Routledge, pp 326–337

Chapter 6

Case Studies: AI in Action in Art and Design

Abstract This chapter presents a collection of practical case studies showcasing the integration of generative AI into diverse art and design disciplines. Spanning across 3D design, drawing, and digital art, these case studies provide a comprehensive exploration of the transformative potential on the creative process. Highlighting versatile applications in graphic design, product design, architecture, and more, these case studies underscore the boundless possibilities AI offers to the creative industry. The chapter begins by delving into the realm of 3D design, unveiling how AI-driven technologies are revolutionizing the sculpting process and shaping the future of three-dimensional art. Moving to traditional drawing techniques, AI blurs the lines between tradition and innovation by enabling artists to explore novel realms of creativity. The chapter also examines the captivating world of digital art, where AIgenerated content becomes a unique form of expression. From manipulating pixels to crafting intricate patterns, the role of AI tools in pushing the boundaries of digital art is vividly illustrated. Through these case studies, this chapter provides a deep insight into the profound influence of AI integration across art and design disciplines. From 3D design to drawing and digital art, these examples offer a glimpse into the transformative potential of AI, promising to reshape the creative landscape.

6.1 Case Studies in AI Integration Across Art and Design Disciplines In the rapidly evolving field of art and design education, the integration of AI tools holds immense potential to transform the way we teach and practice creativity. This chapter presents a series of case studies that showcase the progressive integration of AI tools in four distinct art and design categories: 3D Design, Drawing, and Digital Art. At the core of art and design education lies the exploration of fundamental concepts and principles (Gray and Malins 2016). The case studies focuses on how AI can be employed for ideation, iteration, and formative stages of the creative process. By leveraging AI tools, artists and designers can expand their creative possibilities, generate novel ideas, and explore new aesthetic territories. The integration of AI in

© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024 J. Hutson et al., Creative Convergence, Springer Series on Cultural Computing, https://doi.org/10.1007/978-3-031-45127-0_6

133

134

6 Case Studies: AI in Action in Art and Design

these initial stages fosters experimentation and pushes the boundaries of traditional artistic practices. The case studies in Digital Art showcase how AI can be integrated into the final output, while still maintaining an iterative process with the human-in-the-loop. AIgenerated elements can serve as a starting point for artistic exploration, allowing artists to add their personal touch and intentionality throughout the creative journey (Chung 2021). Finally, we will build on this approach further in the final case study wherein it is demonstrated how, regardless of the medium, creatives can use the same tools to create a signature style using their own work to train the model. These case studies emphasize the symbiotic relationship between human creativity and AI capabilities, demonstrating that AI is a tool that can augment and enhance artistic expression rather than replace it. By examining these diverse case studies, we gain valuable insights into the potential applications and benefits of integrating AI tools into art and design curricula. As educators, it is essential to recognize the evolving landscape of technology and equip our students with the skills and mindset necessary to navigate this new frontier (Ng et al. 2023). The case studies presented in this chapter serve as practical examples and inspiration for integrating AI in art and design education, showcasing the progressive integration of AI tools across different disciplines and highlighting the iterative nature of the creative process in the age of AI-generated art.

6.2 3D Design Fundamentals: Sculpting the Future The case study presented here aimed to explore the integration of AI generative art into a traditional 3D design studio art course, with the objective of investigating the potential changes in the artistic process and the benefits associated with incorporating new technology. Students participating in the study were instructed to utilize either the Craiyon or DALLE-2 art generator as tools to generate verbal cues for combining three distinct objects into a novel composition that would subsequently be translated into a physical three-dimensional sculpture or model. The assignment, known as Design Project 04: Form and Texture (refer to Table 6.1), yielded various approaches, including the direct mention of the three objects or the use of descriptive adjectives. The findings indicate that effective prompt engineering, including thoughtful interaction between the chosen objects, resulted in favorable outcomes. However, it is important to note that the study emphasizes the continued relevance of fundamental principles of art and design, highlighting the need for a dedicated module on prompt design and creation within the curriculum (Bellagente et al. 2023). This investigation serves as a valuable model for other art and design departments interested in integrating AI technologies into their courses, offering a pragmatic use case and a concrete assignment example. The investigation encompassed a single assignment conducted within a studio art 3D course during the initial period of the Spring 2023 semester (Hutson and Robertson 2023). Through a comprehensive evaluation of different AI software

6.2 3D Design Fundamentals: Sculpting the Future

135

Table 6.1 Example 3D design AI assignment Design Project 04: Form and texture In this project, you will carve foam to create a unique object. To generate the idea for your unique form, you should utilize an artificial intelligence image generator, such as Craiyon or DALLE-2 to combine three everyday objects into a new thing. For the final design, you will carve foam and cover it with a distinct texture such as paint, glitter, newspaper, beads, duct tape, fur, fabric, etc. Anything you can find to apply over the top of the form to enhance the texture is applicable. You may use spray foam to cover a 2D shape cut from cardboard, a foam block, or modeling foam to carve the object Artificial intelligence ideation For this project, you will utilize an artificial intelligence (AI) application to generate a combination of three different objects. What kind of combinations can you think of verbally? What kind of objects can AI generate for you visually? What happens if you search in an AI program for “sunglasses made from leaves connected to a hose?” Or what if you had “a water bottle with wings on fire?” Have fun generating imagery with Artificial Intelligence! Please upload some of these source images into your final submission For this project, you will use the AI image generation program Midjourney. Please review the following instructional video discussing setting up your Midjourney account and begin creating Course learning objectives 1. Identify, analyze, and synthesize design principles in three-dimensional artwork 2. Assemble found objects to create three-dimensional artwork 3. Use subtractive art techniques to create three-dimensional artwork Module 04: Form learning objectives 1. Experiment with methods of creativity and how they can lead to unexpected results 2. Explore the relationships of form between different objects 3. Investigate how texture can enhance the power of a work of three-dimensional design Instructions 1. Think of how you could combine three everyday objects into a brand new thing and unique form. Could you create a new, never before seen object by combining different aspects of a chicken, a water bottle, and fire? 2. Utilize an AI image generator such as Craiyon or DALLE-2 to help you combine those objects into a new form 3. Think about describing how to combine your objects versus just listing three things. For example, prompting “a water bottle on fire with wings” will be more successful than prompting “combine water bottle, fire, wings.” 4. STOP and evaluate the image that the tool generates for you. Are you happy with the new form AI generated for you? Does it successfully combine three objects into a new thing? Is the new object interesting? Are you excited to make this object? If the answers to these questions are yes, proceed to the next step. If the answer is no, sketch a brief correction to your AI-generated image before starting the next step 5. Are you totally opposed to AI and want to make your own object? Set out to create your idea without AI, but upload your AI-generated images 6. Work through Design Project 4: Concept Sketches to consider several ideas before settling on a final form 7. Consider what kind of object your new form is 8. Is it an animal? Is it a fictional creation? Is it an inanimate object? Or is it an abstract sculpture? (continued)

136

6 Case Studies: AI in Action in Art and Design

Table 6.1 (continued) 9. Once you have settled on your final design, draw a light outline/contour of the design on a piece of cardboard 10. Cut out the basic shape of the outline/contour from the cardboard. This shape is the first plane that will form the basis of your three-dimensional design 11. Use craft spray foam, or spray foam insulation from a hardware store to spray one side of your cardboard. *pro-tip: This stuff is sticky. Wear gloves, and make sure to put down a sheet of plastic or spray the foam into a box so it doesn’t get on any surface you don’t want it to get on 12. Also, consider making several different planes to start with. If you combine chicken, water bottle, and fire, you could cut out three separate pieces of cardboard and attach them at the end with wire 13. Let the spray dry, flip over your shape, and spray the other side 14. You have now turned your basic shape into a form! 15. If you are using modeling foam, you can manipulate the foam into a general approximation of your design and then proceed to step 13 16. If you are using the foam block, draw the shape of the form on one side 17. Start to slowly carve away material to reveal the basic structure of your form 18. Work from the general to the specific, slowly carving out details 19. Remember, with the reductive technique of carving, there is no going back and adding more material to your work. Working slowly from the general to the specific is essential 20. After you block out the basic structure, add more details like rounded forms, curves, negative spaces, etc. 21. Consider using sandpaper to smooth the texture and create details 22. Think hard about what your object is and find a texture that will mimic what the thing is 23. For example, if you do an animal, find fur to cover the sculpture with or cover it with sandpaper to simulate the course skin of a lizard 24. How could covering it with newspaper, tape, or fabric enhance the meaning of your sculpture? 25. You may use more than one texture, or you may use only one 26. Use glue to attach your texture to your foam sculpture Materials Spray Foam, modeling foam, and or foam block Cardboard Carving tools (optional) Sandpaper Xacto knife/utility knife Found textures Glue Rubric Criteria

Ratings

Execution: Fulfilled all project objectives through a successful use of media, appropriate content, and a written explanation of creative process

15 pts 12 pts 0–11 pts Exceeds Meets Approaching Expectations Expectations Expectations

Craft: The project is executed with appropriate and quality crafts Student exhibits improvements of techniques from project to project

15 pts 12 pts 0–11 pts Exceeds Meets Approaching Expectations Expectations Expectations (continued)

6.2 3D Design Fundamentals: Sculpting the Future

137

Table 6.1 (continued) Criteria

Ratings

Composition: 15 pts 12 pts 0–11 pts Student implements design principals to achieve Exceeds Meets Approaching successful visual composition. Student considers Expectations Expectations Expectations and fills the entire picture plane when completing work Effort and Risk: Consistent work is put into producing quality artwork. Student tries new ideas to improve overall quality of design projects

15 pts 12 pts 0–11 pts Exceeds Meets Approaching Expectations Expectations Expectations

options and their alignment with the objectives of the 3D design class, researchers identified the form and texture assignment as the most suitable choice for the study and its research question. The research question aimed to explore the extent to which the AI tool could assist students in amalgamating diverse objects to create innovative and unique forms. As part of the assignment, students were instructed to employ AI technology to generate a range of example object combinations for their final projects. To gain deeper insights from the gathered data, students were surveyed regarding their pre-existing expectations concerning AI generative art prior to the assignment and subsequently after its completion. Upon careful consideration of the qualitative feedback provided by the instructor and a thorough examination of the artifacts submitted by students, the survey results provide additional substantiation (Hutson and Robertson 2023). They indicate that despite the students’ predominantly pessimistic attitudes towards AI art, the inspirational and iterative characteristics of AI are indeed evident. In this particular project, students are assigned the task of conceptualizing novel forms by combining commonplace household objects. By transforming the mundane into something unexpected and captivating, the potential for the iterative nature of AI becomes apparent. At the commencement of the project, students are encouraged to critically reflect on their typical, logic-centered assessment of their interaction with everyday objects. Consequently, the initial phase involves compiling a list of engaging object nouns, such as staplers, scissors, chairs, rulers, and others. Subsequently, students select three of these objects and contemplate how they can be integrated to generate a new threedimensional structure. Finally, in the concluding phase, students infuse their final sculptures with diverse textures and continue to modify the inherent connotations of the original objects. To foster the generation and ideation of imagery for the culminating project, students were encouraged to leverage AI tools, employing descriptive adjectives and verbs to explore innovative solutions with the support of prompts. The utilization of the Craiyon and DALL-E 2 programs offered distinctive functionalities by combining written language with visual imagery. Throughout the project, students had the opportunity to input descriptive language into these programs and receive tangible outputs. For example, by inputting the nouns “bottle, fire, and wings” and

138

6 Case Studies: AI in Action in Art and Design

the verb “conjoin,” a generative AI image was produced (Fig. 6.1). This ethereal and almost celestial image elevates the seemingly ordinary water bottle, endowing it with a sense of spiritual significance. While the flame-like halo present in the initial image was omitted in the final version (Fig. 6.2), the inspiration remains evident, enhanced by an added element of motion as the wings and bottle tilt as if propelled forward. The ability of students to translate their thoughts into tangible illustrations was undeniably exhilarating. Furthermore, participants embraced the creative workflow, as one student expressed in class that the process “facilitated branching out my ideas and gave me an idea of what they should look like.” While a few students initially approached AI with a degree of skepticism, mentioning that “AI had a hard time grasping the ideas I had or the creativity I wanted behind it all,” the inventive solutions showcased in the final projects are unmistakable. For instance, one student generated an image incorporating bread, a zipper, and a puzzle piece, resulting in a truly innovative solution, as depicted in Fig. 6.3.

Fig. 6.1 Bottle, fire, wings, Craiyon

6.2 3D Design Fundamentals: Sculpting the Future

139

Fig. 6.2 Final sculpture of a water bottle on fire with wings, mixed media, 2022

Despite any initial reservations, the instructor observed that all students had an extraordinary and almost “transcendental experience” when engaging in a creative dialogue with AI software applications. One of the most significant findings of the study emphasized the critical role of prompt engineering. The choice of words and phrases employed by students exerted a profound influence on the level of novelty and innovation evident in the imagery generated by AI tools (McCormack et al. 2023). For instance, a simple combination of the words “shoe, lightbulb, and sunglasses” proved ineffective, resulting in a literal depiction of the objects (Fig. 6.4). In this instance, the AI placed sunglasses on a lightbulb over a pair of brown shoes against an indistinct background, combining an oblique angle with a profile view. Conversely, students who utilized complete sentences with verbs achieved much greater success, as exemplified in (Fig. 6.5), which was created with the prompt “house made out of clouds.” Therefore, regardless of any preconceived bias against AI, the projects showcased the profound impact that AI tools can have in facilitating the creative process, emphasizing the significance of prompt engineering to ensure favorable outcomes. Through active engagement with AI software applications, students were

140

6 Case Studies: AI in Action in Art and Design

Fig. 6.3 Final sculpture of bread, zipper, puzzle piece, mixed media, 2022

able to generate and refine innovative solutions throughout the various stages of the project. This endeavor not only provided students with a novel tool to support their creative endeavors but also underscored the potential for the integration of AI in diverse creative fields. The study examining the integration of AI tools into 3D design fundamentals coursework yielded several key takeaways and recommendations for educators seeking to incorporate AI into their curriculum. One of the main findings was the transformative potential of prompt engineering. The choice of words and phrases used

6.2 3D Design Fundamentals: Sculpting the Future

Fig. 6.4 Shoes, lightbulb and sunglasses, Craiyon, 2022 Fig. 6.5 A house made out of clouds, Craiyon, 2022

141

142

6 Case Studies: AI in Action in Art and Design

by students had a significant impact on the novelty and innovation of the AI-generated imagery. Encouraging students to utilize descriptive language and complete sentences with verbs resulted in more successful outcomes, fostering greater creativity and pushing the boundaries of traditional design thinking. Furthermore, this study highlights the importance of introducing AI tools as a means of ideation and inspiration rather than as a replacement for traditional artistic skills (Paananen et al. 2023). Students experienced a sense of excitement and empowerment as they engaged in a creative dialogue with AI software applications. This approach allowed them to explore new possibilities and expand their creative horizons. Based on these findings, it is recommended that educators provide clear guidelines and instructions on prompt engineering techniques to maximize the potential of AI tools in generating innovative solutions. Additionally, integrating AI into coursework should be seen as a supplementary tool that complements traditional artistic skills and techniques, rather than a replacement. Emphasizing the importance of prompt design and encouraging students to combine AI-generated imagery with their own artistic interpretation can result in dynamic and compelling outcomes. Moreover, it is crucial to foster a supportive and open-minded environment that encourages students to embrace AI technology and explore its possibilities. Addressing any initial skepticism or reservations through comprehensive discussions and demonstrations can help students overcome barriers and fully engage with AI tools. Finally, the study demonstrated that the integration of AI into 3D design fundamentals coursework can bring about transformative experiences for students, fostering creativity, and expanding the boundaries of traditional design thinking. By incorporating prompt engineering techniques and emphasizing the complementary nature of AI tools, educators can effectively integrate AI into their curriculum and provide students with new avenues for exploration and artistic expression.

6.3 Drawing: The Fine (AI) Line Between Tradition and Innovation While in many ways, the use of AI can be seen to replace many of the earlier uses of drawing for creatives, as with 3D design, the technology can also be used to support students in their creativity and decision-making processes. As such, the study conducted during the Fall 2022 term in a studio art drawing course aimed to examine the integration of AI into the curriculum, specifically focusing on one assignment aligned with the content and goals of a Drawing I class. Extensive research was conducted to identify suitable AI software options that could effectively support the objectives of the assignment. Ultimately, the study chose to center the investigation on linear perspective assignments encompassing both interior and exterior spaces.

6.3 Drawing: The Fine (AI) Line Between Tradition and Innovation

143

The primary objective of the study was to explore how students navigate the challenges posed by AI-generated content in accurately depicting linear perspective. To delve into this inquiry, students were given specific instructions to utilize AI tools to gather inspirational imagery related to interior and exterior spaces. Subsequently, they were tasked with incorporating the AI-generated outputs into their final drawings. This approach provided an opportunity to assess the students’ ability to mediate between the limitations of AI-generated content and the fidelity required in portraying accurate linear perspective in their artwork. The given instructions (Table 6.2) tasked students with exploring the ability of AI to accurately depict linear perspective. As observed by most participants, AI struggled to effectively converge orthogonal lines onto a vanishing point and often introduced distortions similar to those seen in a fish-eye lens, as depicted in (Fig. 6.6). Due to these distortions, students in the study modified the AI-generated results to “correct” the perspectival renderings, as exemplified in the student example shown in Fig. 6.7. Additionally, the relatively crude nature of the AI-generated drawings posed limitations for first-year students who were accustomed to producing more sophisticated and fully rendered artworks without the assistance of AI. However, despite these limitations, the integration of AI introduced more creative and interesting elements into the drawings. Students incorporated objects such as a wave master punching bag, ceiling lamp, wall shrine, cobblestone flooring, floor mat, Christmas lights, pirate flag, Japanese window, and various chairs and beds, some of which were unrefined or awkwardly generated. While some students based their final drawings on a single AI-generated example, most utilized the tool to generate multiple iterations that were then synthesized into a cohesive composition. For instance, the student represented in Fig. 6.8 used AI prompts to generate three distinct AI examples, drawing inspiration from different elements of individual pieces of furniture, rather than focusing on a complete interior space. These disparate elements were then combined within an interior space rendered by the student themselves, as shown in Fig. 6.9. Some students capitalized on the iterative capabilities of the AI tool and generated a larger number of samples to draw inspiration from. Figure 6.10 showcases one student who created twelve examples of different domestic interior spaces, including items like a clock, bookshelf, and chairs. The student selectively incorporated elements from these examples into their final artwork, as depicted in Fig. 6.11. In this composition, the clock takes on a central role, and the unique chair is also prominently featured. The working process adopted by students and the potential future use of AI in traditional studio art courses is best summarized by one student’s response: “I used artificial intelligence to create a dining table with a palm growing in the middle, with a TV on the back.” This demonstrates how text-based prompts enabled visual arts students to explore the connections between language and visual elements in their artwork. Similar to these examples, students were able to quickly find creative solutions by using the AI tool and evaluate whether the generated examples were valuable additions to their final projects. To gain valuable insights into the perspectives and experiences of the students, a comprehensive survey was conducted both before and after the completion of the

144

6 Case Studies: AI in Action in Art and Design

Table 6.2 Example of drawing and AI assignment Drawing Project 05: Scale and space In this project, you will create a one-point perspective drawing of a room that represents the use of scale and space. Pay close attention to scale, line, value, and atmospheric perspective in the video tutorials. Please see the directions below on Artificial Intelligence Ideation. For this drawing, you will utilize AI to help generate objects for your room and test whether AI can accurately depict one point perspective Artificial intelligence ideation For this project, you will utilize an AI (artificial intelligence) application to generate the interior decoration of your one-point perspective room study. What kind of interior space can AI generate for you? What happens if you create a prompt for a one-point perspective room? Or what if you type in “lamps with a flame made out of vines?” Or a “sofa in the shape of the moon with an astronaut?” Have fun generating imagery with Artificial Intelligence! Please upload some of these source images into your project submission For this project, you will use the AI image generation program Midjourney. Please review the following instructional video discussing setting up your Midjourney account and begin creating Course learning objectives 1. Apply the principles of scale and space in the creation of a one-point perspective drawing 2. Demonstrate an understanding of line, value, and atmospheric perspective in the representation of scale and space 3. Utilize artificial intelligence (AI) tools to generate objects for a one-point perspective room study Module 05: Scale and space learning objectives 1. Understand the principles of scale and space in the context of visual art 2. Apply the concepts of scale and space to create a sense of depth and dimension in artwork 3. Demonstrate proficiency in depicting objects and environments with accurate proportions and spatial relationships 4. Explore the use of perspective techniques, such as one-point perspective, to create the illusion of depth and distance Instructions 1. Visit Midjourney and create a prompt for a one-point perspective drawing, such as “A living room in one-point perspective with a cow, two windows, a computer chair, and neon lighting.” Think about the subjects, lighting, environment, and mood you want to create. Choose verbs for each category and plug them into the prompt for your room 2. STOP and evaluate the image that Midjourney generates for you. Is it from one point perspective? Are there orthogonal lines? Do the orthogonal lines converge at a single vanishing point? If the answers to these questions are yes, proceed to the next step. If the answer is no, sketch a brief correction to your AI-generated image before starting the next step 3. Next, create a 15'' × 22'' rectangle with a 4H Graphite Pencil and a Straight Edged Ruler. This rectangle will be your picture plane 4. Create a Horizon Line in your 15'' × 22'' picture plane using a 4H Graphite Pencil. *Pro-tip: The horizon line is equal to the level of your eye. If you are down on the ground, your horizon line will be close to the floor. If you are standing on a chair, your horizon line will be close to the ceiling 5. Draw a rectangle or square (at least 8'' × 8'' ) with the horizon line running through it 6. Place the vanishing point on the horizon line inside the rectangle (continued)

6.3 Drawing: The Fine (AI) Line Between Tradition and Innovation

145

Table 6.2 (continued) 7. Connect the corners of the rectangle to the vanishing point and extend the lines to the edge of your paper 8. Erase the lines inside the rectangle 9. You now have something that looks like two walls, a floor, and a ceiling 10. Can you fill your room with objects that are AI-generated for you? Did AI create such a fantastic room for you that you want to draw it exactly as AI sees it? Are you totally opposed to AI and want to make your own room? 11. At this point, get creative and have fun! 12. Incorporate Darker lines and details with your 2B Graphite Pencil 13. The foreground should have darker lines to increase the visual effect of depth 14. Please Keep your Lines confined within your 15 “× 22” picture plane 15. Use Clean Craftsmanship 16. Utilize Artificial Intelligence and your imagination to create various objects that vary in scale and size to personalize your newly designed interior 17. Upload a photo of your final drawing. Please also write a few sentences explaining how you used Artificial Intelligence in the Creative Process. Does this drawing meet the assignment’s criteria, and what have you learned about the subject, your materials, techniques, etc., while doing this work? Be specific in your explanations, using examples from your work to support your statements 18. Due by Sunday, 11:59 PM Materials • • • • •

Drawing paper 4H and 2B pencils Straight-edged ruler Sketchbook Clean craftsmanship materials (eraser, sharpener, etc.)

Rubric Criteria

Ratings

Execution: Fulfilled all project objectives through a successful use of media, appropriate content, and a written explanation of creative process

15 pts 12 pts 0–11 pts Exceeds Meets Approaching Expectations Expectations Expectations

Craft: The project is executed with appropriate and quality crafts Student exhibits improvements of techniques from project to project

15 pts 12 pts 0–11 pts Exceeds Meets Approaching Expectations Expectations Expectations

Composition: 15 pts 12 pts 0–11 pts Student implements design principals to achieve Exceeds Meets Approaching successful visual composition. Student considers Expectations Expectations Expectations and fills the entire picture plane when completing work Effort and Risk: Consistent work is put into producing quality artwork. Student tries new ideas to improve overall quality of design projects

15 pts 12 pts 0–11 pts Exceeds Meets Approaching Expectations Expectations Expectations

146

6 Case Studies: AI in Action in Art and Design

Fig. 6.6 Pottingshed, DALL-E 2, 2022

assignment (Hutson and Robertson in press). The primary objective of the initial survey was to assess the students’ pre-existing expectations and attitudes towards AI generative art. Subsequently, the post-assignment survey aimed to delve deeper into their insights and analyze the collected data. By examining how the students interacted with AI-generated content within the context of their drawing assignments, the study sought to explore their perceptions and experiences before and after engaging with this innovative technology. This research approach provided a comprehensive understanding of the impact and effectiveness of integrating AI into the drawing curriculum, offering valuable insights into the students’ perspectives and the outcomes of their experiences. The survey concluded with an additional question that aimed to gather further insights into the students’ experiences and perceived utility of AI art generators in art and design classes. The responses overwhelmingly conveyed a positive sentiment, with students expressing surprise and dispelling their previous misconceptions. As

6.3 Drawing: The Fine (AI) Line Between Tradition and Innovation

147

Fig. 6.7 Student artwork based on AI potting shed image, 2022

Fig. 6.8 Domestic furnishings, Craiyon, 2022

one student aptly stated, “Not what I expected it to be.” The user-friendly nature of the tool was also emphasized, as a student expressed their surprise at how intuitive the image-making process was with the provided keywords. The students highlighted that the AI tool facilitated the development of their initial ideas and supported problem-solving for new creative solutions. One student remarked, “I thought the AI was fun to play around with and create a base of the start of an idea.” Another student acknowledged that “The generators make it easier to bring abstract ideas

148

6 Case Studies: AI in Action in Art and Design

Fig. 6.9 Student artwork based on AI domestic furnishings image, 2022

Fig. 6.10 Domestic interior geometric shapes, Crayon, 2022

6.3 Drawing: The Fine (AI) Line Between Tradition and Innovation

149

Fig. 6.11 Student artwork based on AI domestic interior geometric shapes, 2022

closer to an actual finished product.” It is important to acknowledge that one respondent expressed disapproval, raising concerns about the use of other artists’ work without consent and the lack of individual process beyond a search query. Nonetheless, the overall consensus among the students was supportive of integrating this new technology into their traditional art-making process. A final student response encapsulated the general sentiment of the cohort, stating, “It gave me a lot of inspiration for what I should include within my drawing and allowed me to understand the design of various furniture items.” This sentiment reflects the iterative process employed by most students, generating multiple images from the AI tool to synthesize into a final drawing for further discussion and exploration. The qualitative feedback provided by the instructor and the examination of students’ submitted artworks further corroborate the findings from the survey, affirming the presence of inspirational and iterative characteristics within AI. The instructor observed that the integration of AI tools in the class was a novel concept for the students, indicating that they had not previously considered incorporating AI into their own artmaking processes. It is important to note that the use of AI in the department was unprecedented, resulting in potentially diverse student approaches and processes. Additionally, considering the introductory nature of the class, it is essential to take into account the students’ level of experience when evaluating whether AI can match human capabilities in art creation. Despite the technical limitations, as mentioned earlier, students unanimously recognized the “inspirational” qualities

150

6 Case Studies: AI in Action in Art and Design

of the AI tool, which proved beneficial to their artmaking processes and facilitated modifications and improvements to their own workflows. The case study on the use of AI in a Drawing class provides valuable insights into the integration of AI tools in traditional artmaking processes. Through the exploration of AI-generated content and its incorporation into drawing assignments, several key takeaways and recommendations can be derived. Firstly, the study highlights the potential of AI tools to inspire and enhance the creative process (Kim and Maher 2023). Students expressed surprise and enthusiasm for the AI-generated imagery, finding it to be a valuable source of inspiration and a starting point for their artistic ideas. The iterative nature of AI allowed students to explore multiple iterations and creative solutions quickly, enabling them to push the boundaries of their artistic expression (Turchi et al. 2023). Secondly, prompt engineering emerged as a crucial factor in the effectiveness of AI-generated content. Students noted that providing descriptive and specific prompts yielded more successful results, while generic or simplistic prompts led to less satisfactory outcomes. Therefore, it is recommended to educate students on how to formulate effective prompts that encourage AI to generate relevant and intriguing imagery. Furthermore, the study highlights the need to balance the use of AI with the foundational principles and techniques of traditional artmaking. While AI tools can be valuable resources, it is essential to maintain a strong understanding of artistic fundamentals and techniques. AI should be viewed as a tool to augment and support the creative process rather than replace traditional skills. Based on the findings of this case study, several recommendations can be made for other art and design departments looking to integrate AI into their coursework. Firstly, providing introductory sessions or tutorials on AI tools can familiarize students with the technology and its potential applications. Additionally, incorporating modules on prompt engineering and effective utilization of AI tools can empower students to make the most of these resources. It is crucial to strike a balance between technical skills and conceptual understanding, ensuring that AI is integrated into the curriculum in a thoughtful and purposeful manner.

6.4 Digital Art: Pixels, Patterns, and AI Paintbrushes This section delves into three case studies that explore the integration of AI in the digital art classroom. As a rapidly evolving field in art and design, digital art presents a unique opportunity for the incorporation of AI into its creative workflow. Educators can employ various strategies to integrate AI, drawing inspiration from examples utilized in drawing and 3D design, where AI tools support the ideational phase of the creative process through recursive and iterative generations. However, digital art, being inherently born in the digital realm, presents additional possibilities and challenges, prompting educators and students to navigate their roles within the human-AI collaborative process (Lee et al. 2021). Consequently, the integration of AI in digital

6.4 Digital Art: Pixels, Patterns, and AI Paintbrushes

151

art coursework can span from a formative aspect to a pivotal role in the final project, with varying degrees of human intervention. The first of these studies focused on an assignment conducted in a digital art course during the Fall 2022 term. The assignment Digital Art II—AI Image Redux (Table 6.3) was part of an advanced online class called Digital Art II (Hutson and Cotroneo 2023). Students were instructed to use an AI generator, specifically the Craiyon image generator, to create an image. They were then tasked with recreating the generated image using Adobe Photoshop. The choice of the Craiyon image generator was based on its availability and accessibility, which was crucial for the decentralized nature of the online class. The AI-generated image was treated as a sketchbook in a traditional studio art class, serving as an initial phase for ideation and iteration. To foster creativity and encourage imaginative exploration, students were deliberately provided with minimal guidance when crafting the AI image prompt. They were encouraged to experiment with different phrasing techniques, incorporating elements of poetry and declarations, and to iterate on their prompts multiple times. The prompts centered around the concepts of “subject,” “object,” and “action,” offering students diverse possibilities for exploration. While students were made aware of the limitations of the AI software, particularly in terms of potential distortions, they were also encouraged to embrace the potential intrigue and unique qualities that these distortions could add to the generated images. This approach aimed to empower students to develop their own artistic voice, engage in self-expression, and navigate the creative process with autonomy, ultimately fostering their growth as artists in the realm of AI-generated imagery. Following the completion of the assignment, students were provided with a thorough tutorial on the utilization of Photoshop’s mixer brush feature, further developing their technical proficiency in image manipulation. To gather valuable insights and assess the impact of the assignment, a survey was administered to capture the students’ initial expectations regarding AI generative art and to gain additional perspectives from the collected data. This survey aimed to delve into the students’ viewpoints and experiences both before and after engaging with the assignment, enabling a comprehensive analysis of how the assignment influenced their perceptions and creative processes. By gathering this feedback, instructors were able to gain valuable insights into the effectiveness of the assignment in enhancing students’ skills, knowledge, and attitudes towards AI generative art. The students were presented with open-ended instructions on how to use prompts in order to generate an image using the Craiyon AI image generator. These AIgenerated images served as inspiration for the students to recreate their own versions using Adobe Photoshop. The purpose of this process was to simulate the role of a sketchbook in a traditional studio art class, where the AI-generated images acted as initial sketches during the iterative phase of ideation, leading to the development of a final concept. The students were intentionally given minimal guidance to ensure that their creativity and imaginative exploration were not constrained. Instead, they were encouraged to experiment with different phrasing, incorporate poetic and declarative elements, and iterate on their prompts multiple times. The prompts themselves

152

6 Case Studies: AI in Action in Art and Design

Table 6.3 Digital art AI image redux assignment Digital Art II—AI Image Redux Introduction Where do our images come from? And how do we invent new ways of seeing to arrive at new images? For centuries artists have been tricking themselves into finding inspiration for picturing the internal and external worlds of their vision. From sketch booking, to collaging, to collaborative games, to using found images, to building algorithms, processes at arriving at compositions have evolved, receded, and been re-implemented in new eras to create new references from which to work. In just the past few years we have seen an explosion in user friendly “Text to Image” A.I. image generators. But have we tapped into the potential we see this having in our artistic practice? This week we will be using Photoshop to create a digital painting recreation of one of our A.I. generated images from last week Assignment Last week, we used the Dall-e2 software to create a set of unique images. We modified that image through altering our prompting, and then work-shopped those results in our critique. Now we are going to use this image as a sketch/or reference photo for a painting we make from the ground up A.I. image generation isn’t perfect, and there are often very noticeable distortions within the image. In some instances, this may be desirable, and others maybe not. Maybe this was part of your process you completed last week. Maybe this week you want to bring this back into the painting you create… Move into photoshop to begin attempting to repaint your image using the different brushes, gradients, and filters available to us here. Maybe you like the warped quality of the image the A.I. generated, or perhaps you want to polish up the disconnects, whichever the case maybe you should explore this in your final painted version. Maybe there are stylistic tweaks you want to make to the image; this is something else worth exploring in this stage Size your work space at 1080 × 1080 pixels at a 100 dpi. This will give you a square work space (mimicking the source image you are working with) with a screen-ready resolution in mind to be shared There are many ways to make marks in Photoshop. Different paths can also be taken to get to the same result. Explore around and experiment with the tools Ps is equipped with to get the best result you can and make the image that you want to see in the world. Below are some tutorials for some tools, but know that you are not required to use any specific method to create your image Software tutorials Below is a tutorial on how to use Photoshop’s mixer brush, a tool that is often overlooked, but something that can really help in the genesis of a digital painting https://youtu.be/df5iF12V1w0 Some more tutorials that may assist you are provided below. Explore LinkedIn Learning and YouTube for more guidance on specific problems you are running into Painting in Photoshop: https://youtu.be/4sJ1D1mL3uY Course learning outcomes (continued)

6.4 Digital Art: Pixels, Patterns, and AI Paintbrushes

153

Table 6.3 (continued) 1. Develop an understanding of the potential of AI image generation in artistic practice and its role in expanding ways of seeing and creating new images 2. Utilize Photoshop to recreate a digital painting based on an AI generated image, demonstrating proficiency in digital painting techniques 3. Explore and experiment with different brushes, gradients, and filters in Photoshop to manipulate and enhance the A.I. generated image, allowing for creative expression and personal artistic style Criteria

Weight (%)

Excellent (A) (90–100%)

Good (B) (80–89%)

Fair (C) (70–79%)

Poor (D) (