Example Assignment Incorporating AI: Professor Jeremy Morris
CA 346: Critical Internet Project Instructions and Rubric
Artificially (Un?)Intelligent Essay
In this assignment, Professor Jeremy Morris asks students to prompt ChatGPT with a complex task and to analyze the output and the interaction between human and chatbot.
PROMPT: Using ChatGPT (https://chat.openai.com/chat), you will ask the bot to write a song based on a course concept in the style of a popular band or artist. You will then analyze the response, by annotating/analyzing the interaction. In doing so, you will analyze how well/accurately ChatGPT covers the topic in question. You will also expand on what ChatGPT offers in its response by providing additional information on the topic in question, based on your knowledge of course materials and the use of sources from class and beyond. Ultimately, you will ask ChatGPT to:
Write a song about [TOPIC] in the style of [BAND OR ARTIST].
Topic choices are: The History of the Internet, Technology, The Californian Ideology Band/Artist choice: Up to you (though ideally they’re popular enough that we know them)
CHATGPT PAPER GUIDELINES AND STEPS TO COMPLETE:
- This option will take the form of an essay, interspersed with screenshots from ChatGPT
- Include a title page (your name, student number and section number on the first page)
- Begin the essay with a one paragraph introduction that summarizes some general reflections about the song and how well ChatGPT responded to the prompt. Try to create a thesis statement or argument about where you felt ChatGPT excelled or could improve.
- Then provide a screen shot of the 1st portion of the song ChatGPT outputs (e.g. Verse 1)
- Then provide one or two paragraphs of analysis of the screen shot/lyrics.
- Repeat this process for the Chorus, Verse 2, Bridge and Outro
- Your analysis should focus on the lyrics of the song, making note of what ChatGPT gets right and wrong about the topic you chose. You can also make note of how well it imitates the style of the artist you chose, though this should not be the focus of the essay.
- You should end with 1 paragraph reflecting on the process of working/writing with artificial intelligence as a partner.
- Your analysis should include at least 2 references to class material and 1 reference to an academic article from outside the class.
- In total, you should have between 4-5 screenshots from ChatGPT and about 5-6 pages (double-spaced) of analysis.
CHATGPT PAPER MECHANICS:
- Sign up for an account at https://openai.com/blog/chatgpt/. Note, the site is often busy with lots of users, so refreshing multiple times, and not leaving the project to the last minute will be crucial.
- Start a chat with the chatbot. ChatGPT saves previous chats, but taking screenshots of conversations that you think will be used in your final essay will be a good idea. – We recommend playing around with a variety of different prompts and subprompts as you get used to how the system responds, before you get into the business of specifically asking it the question(s) you plan to for the final project.
CHATGPT PAPER RUBRIC:
Content (10) – How well does the student analyze the ChatGPT output? Does the analysis have an intro paragraph that provides an overall assessment of the ChatGPT output and a clear conclusion at the end? Does the student simply describe what ChatGPT is outputting, or do they analyze/expand/critique the output? How in-depth/sophisticated an analysis of the flaws or successes of ChatGPT does the student provide? Does the essay have a clear overall argument or is it just a series of smaller analyses of specific song sections? How engaging is this argument?
Research (5) – Does the student use the recommended amount of sources from class materials and other materials? How appropriate and original are the sources the students use? How well does the student connect the sources they are linking to with the annotations and comments they are making? Can the student fully explain the concepts they are citing, or do they simply mention course material in passing without fully engaging with it to comment on or expand the text in question?
Delivery (5) – How well laid out is the overall presentation of the ChatGPT song and the analysis? Does it follow proper and consistent citation format? Is it particularly creative or engaging, or is it difficult to read, not clearly structured or laid-out? Does the student take advantage of the features that ChatGPT provides? Does the student demonstrate a thoughtful approach to annotations that balances academic seriousness with playfulness?
