AI—A Blessing or a Curse?
Fredrik Malmedal Salhus
I want to start off by saying that I am very ambivalent about the topic of AI generated art. Is it a blessing or is it a curse? I can’t seem to wrap my head around the question.
I both love and despise AI generated art. I don’t know whether I should laugh or cry when I get image results from an AI. If I manage to adjust my prompts to a description that yields high quality results, I get dazzled and amazed, but completely terrified at the same time. What are, and what will be, the consequences of the fact that we can generate content this way?
When I get disappointing image results from the prompt page, I feel misunderstood. I get this urge to fine tune my choice of words; to be more specific. It is as if the site is whispering to me: ‘Look at all these incredible results people are getting. You can also generate amazing images, you just have to try again—and again. ‘Come on now … spend your credits, explore more’.
The past six months I have been learning the prompt language, and I see it has a lot of nuance to it, both technically and descriptive. Nit-picking at words and implementing cryptic code to get desirable results from image generators like DALL·E, Midjourney, and Stable Diffusion seems to call for continuous or even endless practice.
I am both worried and enthusiastic for artists, designers, and the future of the visualizing industry. The momentum AI technology has now seems unstoppable. I am under the impression that the algorithms and the image results are improving as time passes. New iterations and updates of AI generators are constantly being released. Input from millions of users over the past six months has been rocket fuel for these AI ventures, launching it to the moon and probably further into space sooner rather than later. Optimised, tweaked, and improved by software developers and scientists, and the utilization of all of our valuable input data. Computationally learning to perform better. In a Youtube clip from the channel ‘Help Me Understand Clips’the Artificial Intelligence expert Dr. Thomas R. Jeffrey says;
‘The goal of machine learning is to learn from multiple iterations of something’
Let´s wind back the clock a bit. Last summer the visual communication industry was hit with a paradigm shift in technology. The release of online artificial intelligence image generators that create unique images based on text input called prompting. This means everyone can type nuanced image descriptive words into a text box and let Artificial Intelligence create unique digital artworks in just seconds.
How did that happen? It is a result of exponential development. Technology that could only generate a tiny unrecognizable 32x32 pixel image of a green blob seven years ago, in a lab, based on the text prompt ‘green apple’, has developed rapidly and can now generate unique images in seemingly all thinkable visual styles defined by the user.
The technology is manifold and is generating waves of innovation in multiple areas. Soon we will be able to generate 3D-files from single images. Free and open tools are already available to do the opposite as well. On the Replicate (2022) website we can generate descriptive prompt words based on images we upload.
The increasingly popular and well known open source 3D program Blender has new plugins that render artificially intelligently made textures on digital models automagically. And voluntary members of the community around Blender are currently developing more AI features using the open-source code made available. (Hawat, 2022)
In his book Profiles of the Future: An Inquiry into the Limits of the Possible, published in 1962, science fiction writer Arthur C. Clarke wrote ‘Any sufficiently advanced technology is indistinguishable from magic’. (Efraín Foglia et al, 2018)
The AI platforms surely felt this way to me when I started using them. The experience has a whiff of sheer magic to it! It is fun, exciting, and mesmerizing.
AI technology is, however, forcing change in all industries right now: It is coming for bus drivers, bankers, lawyers, editors, developers, publishers, journalists, photographers, shop owners, athletes, chess players, and now visual artists and designers of whom many thought they would not be impacted. (Rowan, 2019)
Already in September of 2021. Nearly a year before it all took off, the scientist and writer Eric Hole wrote;
‘In my office hangs a painting called “Rule of Consciousness.” An ironic title, as it actually signifies the end of the rule of consciousness. For it was designed by an AI. I keep it not because I like it. In fact, I hate it. Or rather, I’m afraid of it. It’s a sobering reminder of what’s coming, which is that human art is close to total control by corporations, and no one seems to care. Hoel. E (2021)
Humans are adapting to the ever more increasingly, optimised and complex landscape of computers outsmarting us in speed, accuracy. AI powered robotic systems are now running warehouses (Del Ray, 2022) and winning over all humans in games like Go, Chess and Poker (Wali, 2022). They consist of continuously fed optimized algorithms and code and it improves the technology in time in an exponential way. Technology advancement has been a part of industrial progress since the dawn of the industrial revolution. And the utilization of it has not been without push back. There were people in the early 1900s that didn’t want automobiles on the roads.
‘... the anti-car movement was a real thing that lasted until 1930, when the US reached more than twenty cars for every hundred people, or about one per family.’ (Scott, 2016)
They thought it would suffice to have horses and buggies, and they were probably right, before critical legislation and sufficient infrastructure was in place.
The way I personally observe the situation is that we are facing a faster rate of change than ever before. Due to digitalization, we are witnessing monumental changes occurring over much shorter timespans, and we the people have a hard time adjusting to the situation.
The infrastructure and systems that are being put in place now do have dire side effects as they increasingly pave way for a more authoritarian society.
The authoritarian part I refer to is the fact that our online presence is increasingly tracked and monitored. An extreme example is that social score systems implemented in certain cities in China are pointing at a bleak dystopian future of an oppressed civilisation.
It is, in a sense, perpetuating a trend which leads to a ruling elite over an otherwise technologically distanced population.
The nerds have become the new emperors.
Do we need all this?
I have to ask:. Do we really need all these tools? I can, as an example, refer to Adobe Sensei (an new piece of software from Adobe) which artificially analyses and discerns all objects in images and gives you the opportunity to delete them, move them in 3D space.
I would argue that just because something is programmatically possible that doesn't make it a needed feature. It is impressive tech, but is it necessary? Chief Product Officer at Adobe, Scott Belsky, said in an interview recently ‘We want to benefit creatives, not replace them”’. (Piper, 2022) Mmmmhhhmmmmm. Right … But I guess what he wants is to sell automated AI generated stock photos, and not need to pay content creators their fair share anymore.
In my observation a seemingly increasing number of Youtubers are sharing the gospel in the AI echo chambers. They are telling their audience that they don’t have to be ‘professional artists’ to create amazing art and photos. ‘As long as you have good ideas and you can describe what you want, … Bingo! … here you go sir. Here is your piece of art.’ (PiXimperfect, 2022
Ethical issues
To me it just seems awfully wrong to reference (copy the style of) specific artists to create ‘your own artificial piece of art’. Especially when the licence agreement between the users and the platforms are diffuse about the ownership of the art you generate.
I understand the temptations of working ultra-fast, the high inspirational level, how efficient it can seem to generate references and documentation for research, but it makes me think more deeply about creative ownership and authorship. What is ownership? Physical possession is one thing. If you have something locked up, then it is out of reach. Digital works, however, are so easy to copy and transfer.
Being conscious of Bitcoin and one of its novel value propositions (impossible to copy) we now have ways of copyright protecting digital artworks. The invention of Bitcoin has paved way for digital scarcity. Before Bitcoin there was no way to limit people from copying digital tokens. One of the many aspects of the Bitcoin invention is the solving of the digital double spend problem. Sadly, sharing open-source code has led to the escalation of the NFT frenzy and a scammers paradise exposing a boom-and-bust tulip mania phase. This is currently under supervision from SEC as many tokens classify as securities and are traded on unregulated exchanges which in turn easily leads to a lot of wash trading, money laundering and other shady activity. (Chainanalysis, 2020)
I guess that, to some degree, all still images are copyable, because you can always take a picture or a screenshot of it to then recreate or restore it to higher resolution and present it as your own work.
Data scraping
Scraping is a term used for stealing artworks and images en masse from the entire world wide web in order to train and improve a for profit owned image learning platforms. They also improve algorithms in order for subscribers to be able to emulate any living or dead artist out there. I find this devious, fraudulent and see it as a stab in the back of every struggling artist out there. The community should rise up with pitch forks and claim payment from all these engines every time their name is being referenced and used in a prompt.
It does worry me that Midjourneys generated images look like a combination between things we have seen on Pinterest, Artstation, Behance, and in Dream Works, Disney and Pixar movies. I really do wonder; has the usage of all the millions of reference photos been addressed and clarified legally?
The latest scraping farce occurred only a few weeks before writing this article. The website Deviant art which has been in service for 22 years has open-source code released by Stable Diffusion) utilising all the members images to train the system without the members' consent. The community literally freaked out! The site has in recent days seen a mass exodus of talented artists who have been posting for years and the owners of Deviant art have now apologised and changed their policy on usage of their artists uploads.
For the people, but also for profit?
There is a technological race now to utilize the open-source technology and create new infrastructure and services that are valuable for people and industries. In my opinion the market will decide the winners the same way we have adopted new technology earlier. We will choose the platforms and the services that provide us with logical and easy to use user interfaces, speedy, snappy, reactive solutions, the feeling of fair value for money and the best output quality.
The industry has vast revolutionary potential and some of the best engineers and scientists are flocking to AI now. You might have noticed though, it has become very scientific. DALL·E 2 and Midjourney are partly founded as non-profit scientific research labs. By fronting the scientific aspect of their services, they are probably able to apply for grants and state funding. Lack of transparency might hide some of their for-profit minded activity. Clever use of lawyers and multiple subsidiaries in non-taxable geographic locations collect subscription fees and income. Price wise, with a few million users paying 15+ USD a month these companies have swiftly entered the big boys club with potentially generating 350—500 million dollars a year in subscription fees alone. That is a lot of cashflow and can be used as leverage to escalate scopes and services. It would be of significant moral, ethical, and creative advantage, as I see it, if these companies also came up with a novel way of paying all the contributing artists. All prompt queries from users that include reference to artists could as an example generate a micropayment to the artist. That could be a motivational factor and a more sustainable and future proof feature in my eyes. Let’s see what the future brings.
Refrences:
-
Anello, E. (2022). How to quickly build your own dataset of images for Deep Learning.
Available at: https://medium.com/mlearning-ai/how-to-quickly-build-your-own-dataset-of-images-for-deep-learning-1cf79073f1bd
(Accessed: 29 November 2022). -
askNK (2022). Adobe A.I - The Future of A.I Photo Editing!
Available at: https://youtu.be/pp_9cGrT_Is
(Accessed: 14 December 2022). -
askNK (2022). Restore A.I - Free Human Face Restoration Tool!
Available at: https://www.youtube.com/watch?v=ORtYP8NW4T0
(Accessed: 2 December 2022) -
Babel Image Libraries.(2015)
Available at: https://babelia.libraryofbabel.info/
(Accessed: 8 December 2022). -
Baio, A. (2022). [Text Wrapping Break]Invasive Diffusion: How one unwilling illustrator found herself turned into an AI
model
Available at: https://waxy.org/2022/11/invasive-diffusion-how-one-unwilling-illustrator-found-herself-turned-into-an-ai-model/
(Accessed: 14 December 2022) -
Bouchard, L. (2022). AI Creates Amazing Artwork from Text and Sketches!
Available at: https://www.youtube.com/watch?v=K3bZXXjW788
(Accessed: 7 December 2022). -
Broderick, R. (2022) Generative AI tools are already changing the creativity landscape—and some artists aren’t happy
about it
Available at: https://www.fastcompany.com/90816817/generative-ai-tools-are-rocking-creativity-the-way-napster-shook-up-music
(Accessed: 14 December 2022). -
Chainalysis. (2020) Crypto Money Laundering: How Criminals Cash Out Billions in Bitcoin and Other Cryptocurrencies
Available at: https://blog.chainalysis.com/reports/crypto-laundering/
(Accessed: 19 December 2022) -
Chambers, S. W. (2020). “Artificial intelligence might take my factory job but it will keep its hands off my paint
brushes”
Available at: https://towardsdatascience.com/artificial-intelligence-agents-are-not-artists-9743d5dba2d0
(Accessed: 13 December 2022) -
Clip Interrogator (2022)
Available at: https://huggingface.co/spaces/pharma/CLIP-Interrogator
(Accessed: 3 December 2022). -
Deep Imagination
Magic3D: High-Resolution Text-to-3D Content Creation
Available at: https://deepimagination.cc/Magic3D/
(Accessed: 8 December 2022). -
Del Ray. J (2022). Amazon’s robots are getting closer to replacing human hands
Available at: https://www.vox.com/recode/2022/9/27/23373588/amazon-warehouse-robots-manipulation-picker-stower
(Accessed: 12 December 2022). -
Deviant Art Team (2022). Create AI-Generated Art Fairly with DreamUp.
Available at: https://www.deviantart.com/team/journal/Create-AI-Generated-Art-Fairly-with-DreamUp-933537821
(Accessed: 8 December 2022). -
Draftsmen (2022). Why Be An Artist When There's AI?
Available at: https://www.youtube.com/watch?v=lc-RX2AGGNA&list=WL&index=71
(Accessed: 14 December 2022). -
Dream Fusion (2022)
Text-to-3D using 2D Diffusion
Available at: https://dreamfusion3d.github.io/gallery.html
(Accessed: 4 December 2022). -
Dream Studio (Stablity AI) (2022)
Available at: https://beta.dreamstudio.ai/dream
(Accessed: 18 December 2022) -
Emergent Garden (2022). Evolving AI Art
Available at: https://www.youtube.com/watch?v=K8TG0ZwYu7Y&list=WL&index=74
(Accessed: 2 December 2022). -
Foglia. E et al, (2018). Any sufficiently advanced technology is indistinguishable from magic.
Available at: https://tinyurl.com/2fj4f56v
(Accessed: 2 December 2022). -
Hawat. M (2022). Blender and Stable Diffusion
Available at: https://www.blendernation.com/2022/09/09/blender-and-stable-diffusion/
(Accessed: 12 December 2022). -
Help Me Understand Clips (2022).
THE END OF HUMAN CREATIVITY? - Artificial Intelligence Expert Reacts to A.I. Art
Available at: https://www.youtube.com/watch?v=T76BBT_qWdg
(Accessed: 2 December 2022) -
Hoel. E (2021). Big Tech is replacing human artists with AI
Available at: https://erikhoel.substack.com/p/big-tech-is-replacing-human-artists/after-go-and-chess-ai-is-back-to-defeat-mere-humans-this-time-its-stratego
(Accessed: 12 December 2022). -
Huggingface (2016)
Available at: https://huggingface.co/spaces/stabilityai/stable-diffusion
(Accessed: 5 December 2022). -
Imagen (2022)
Available at: https://imagen.research.google/
(Accessed: 7 December 2022). -
Klingemann, M. (2018). Memories of Passersby.
Available at: https://underdestruction.com/2018/12/29/memories-of-passersby-i/
(Accessed: 5 December 2022). -
Meta Team (2021). Using AI to Animate Children’s Drawings
Available at: https://about.fb.com/news/2021/12/using-ai-to-animate-childrens-drawings/
(Accessed: 21 November 2022). -
Octoparse (2016)
Available at: https://www.octoparse.com/
(Accessed: 21 November 2022). -
Piper, D. (2022). Adobe has a message for creatives worried about the rise of AI art.
Available at: https://www.creativebloq.com/news/adobe-ai-art
(Accessed: 1 December 2022). -
PiXimperfect (2022). Steal AI Art? AI Creates Text Prompts from Any Image!
Available at: https://www.youtube.com/watch?v=jS5VjQiO13I
(Accessed: 3 December 2022). -
Plunkett, L. (2022). DeviantArt Embraces AI Art, Fucks Up Massively.
Available at: https://kotaku.com/deviantart-ai-art-nft-crypto-scam-hustle-protest-stable-1849778362
(Accessed: 5 December 2022). -
Replicate. (2022) Image to prompt text generator.
Available at: https://replicate.com/methexis-inc/img2prompt
(Accessed: 15 December 2022). - Rowan, D. (2019) Non-Bullshit Innovation - Radical Ideas from the Worlds Smartest Minds. Ebook. Imprint: Transworld Digital.
-
Scott. A (2016). Bitcoin is the Automobile 'Menace' of the 21st Century
Available at: https://news.bitcoin.com/bitcoin-menace-automobile-21st-century/
(Accessed: 12 December 2022). -
Steven Zapata Art (2022). The End of Art: An Argument Against Image AIs
Available at: https://www.youtube.com/watch?v=tjSxFAGP9Ss&t=509s
(Accessed: 4 December 2022) -
Vizcom
Available at: https://www.vizcom.ai/
(Accessed: 2 December 2022). -
Vowles, S. (2022). 7 Use Cases NOW Possible in Midjourney
Available at: https://www.youtube.com/watch?v=5n153Ee8ODI
(Accessed: 16 December 2022). -
Wali, K. (2022). After Go and Chess, AI Is Back to defeat Mere Humans—this time its Stratego.
Avaliable at: https://analyticsindiamag.com/after-go-and-chess-ai-is-back-to-defeat-mere-humans-this-time-its-stratego/
(Accessed: 12 Dec. 2022). -
Zhou et. al. (2022). CodeFormer: Robust Face Restoration and Enhancement Network.
Available at: https://huggingface.co/spaces/sczhou/CodeFormer
(Accessed: 8 December 2022). -
@bl_artcult (2022). An Open Letter To The Media from Black Label Art Cult
Available at: https://www.tiktok.com/@bl_artcult/video/7163313696587124014?is_copy_url=1&is_from_webapp=v1
(Accessed: 10 December 2022).