Generative AI Tools (GAIT)
This page is for Generative AI Tools: ChatGPT and Beyond, the special offering of ECE:5995 at the University of Iowa in Fall 2023. The topics covered in this hands-on course are below. Please scroll through or click a particular topic to jump to some of the examples given in Lecture 1. Too many examples? Start here:
LLMs: Large Language Models (e.g., ChatGPT, Bard, Llama)
Image / Art Generation (e.g., Midjourney, Stable Diffusion, DALL-E)
Video Generation (e.g., RunwayML, Pika Labs)
Audio / Music Generation (e.g., AudioCraft, MusicLM, Mubert)
NERFs: Neural Radiance Fields (e.g., Luma AI, NVIDIA instant-ngp)
3D Skeletal Extraction (e.g., Wonder Dynamics)
Combo Projects: Chaining GAITs Together (e.g., AI Music Videos, Movie Trailers, Conversational Agents, etc.)
Ethical, Legal, and Societal Implications of Generative AI
Students in GAIT will learn to use and combine these tools within a variety of domains, from solving engineering problems to creating mixed media artworks. I cannot wait to see what they’ll make—it should be a magical time! ✨
The full course description and details of the Fall 2023 offering can be found here.
🖼️
Image / Art Generation
Images Generated by Remixing the Course Description with ChatGPT
Avatar Tyler
Then and Now
Look how far things have progressed in just a short amount of time…
“Cats Playing Chess” — April 2021
"Cats Playing Chess” — July 2023
“photograph of cats playing chess” — August 2023
“The Priests of the Temples of Syrinx” (from 2112 by Rush) — April 2021
“photograph of The Priests of the Temples of Syrinx, cinematic” — August 2023
“Babies in Space” — April 2021
“Babies in Space” — July 2023
🎬
Video Generation
Videos Generated from the Course Description
Synthetic Scenery: AI Generated Video Montage
Whimsical AI Generated Video Vignette
These AI Cats Can Jam! — “Careless Whisker”
LIFE: AI Generated Video Vignette
🎶
Audio / Music Generation
Controllable Text-to-Music
“90s rock song with electric guitar and heavy drums”
“A grand orchestral arrangement with thunderous percussion, epic brass fanfares, and soaring strings, creating a cinematic atmosphere fit for a heroic battle”
“Pop dance track with catchy melodies, tropical percussion, and upbeat rhythms, perfect for the beach”