Sonic Synergy

Project Goal: Design an app for an AI songwriting collaborator that utilizes an AI model to provide the user suggestions and feedback on their songs.

Project Type: AI Mobile App Design
Role: Designer
Collaborators: N/A
Skills: Figma, Wireframing, Prototyping, UX Research, Usability Testing, Artificial Intelligence, ChatGPT

The Sonic Synergy prototype was created with Figma and mock responses from the AI Collaborator were generated with ChatGPT.

Important Design Considerations:

Combatting the use of material under copyright:

The interface would utilize an AI copyright detection algorithm. If the system detects audio under copyright, whether this audio is recorded, live, or uploaded to the application, it may output the following message: “I've analyzed the audio file, and it appears to be under copyright. While I can't provide generated audio, I'm still here to assist with creative ideas and inspiration based on the audio. [insert relevant suggestions here].” However, if the system detects original audio, AI-generated audio files could be output by the system in response to the original audio, in addition to additional songwriting suggestions for the user.

Providing users with personalized content:

The home page of the app provides users an option to record live original audio into the app and also an option to upload existing audio files. Another design decision that positively benefits the user is the ability to access the AI chat mode or their archive of chats right from the home screen as well. Ideally, the ability for users to upload audio to the AI model would train the model specifically from user-input files, allowing the AI to provide more personalized collaborative suggestions based on an individual's writing style.

Streamlining the collaborative process for the user:

An important design decision made was to add shortcut buttons in the chat pages of the app. These shortcuts are simply streamline the collaborative process for the user, providing specific prompts for the AI in relation to lyrics, production, or chord charts.

Prototype Walkthrough

This video shows a walkthrough of the user immediately accessing the chat feature of the app from the home page. It also displays a functioning chat between the user and AI model, and ultimately, a return to the home page.

This video shows a walkthrough of a user recording live audio into the app. After stopping the recording, the user is directed to the chat page of the app. The AI response shows that the live audio recorded is under copyright protection, so the AI only offers text-based suggestions and inspiration.

This video shows a walkthrough of the user accessing the archive feature and the ability to upload audio files. Once a file is uploaded, the user is directed to the chat page and is able to receive AI-generated audio files and text-based content. Shortcuts are also featured, with the ability to prompt the AI for lyrics, production, and chord chart suggestions.