π΅ AI-Powered Lyric Bot Application - Overview
Lyric Bot is a lightweight web/mobile app that transforms user-submitted lyrics or poems into short, AI-generated songs. Users can select a genre (Pop, Lo-fi, or Rap) and a voice style (Male, Female, or Robotic) to create personalized musical pieces.
π§© Problem
Creating a seamless experience that combines AI-generated music, realistic text-to-speech vocals, and synchronized audio playback typically requires complex integrations and technical expertise. Lyric Bot aims to simplify this process, enabling users to generate custom songs effortlessly.
π― Goals
Allow users to input lyrics or poems (up to 200 words).
Enable genre selection: Pop, Lo-fi, or Rap.
βProvide voice style options: Male, Female, or Robotic.
βGenerate background music using Fal.aiβs Cassette AI API.
βConvert lyrics to vocals using Eleven Labs API.
βSynchronize vocals with background music.
βOutput a final MP3 file in under 1 minute.
βOffer a simple, mobile-optimized UI with no login required.
Steps
1. Initial Prompt
I started by defining a prompt that described both the functionality and UI layout for the app within Famous.ai.
2. User Input Interface
I set up a text input field for lyrics (with a 200-word limit) and added dropdowns for genre and voice selection.
3. Integrating AI-generated Music and Text-to-Speech
Upon submission, the app uses Cassette AI to generate a background track in the chosen genre and Eleven Labs API to convert the inputted lyrics into vocals, matching the selected voice style.
4. Connecting Supabase as Backend Service
I connected the app to Supabase to handle backend operations. I selected a Supabase project as part of the setup.
5. Providing API keys for External Services
Famous.ai will ask user to input API keys for any external API service that is being used in the application in my case it happened to be Eleven Labs and Fal.ai
I can click on "How to get this" to view instructions for obtaining the API key. Once the keys are filled in, I can submit them to continue the application generation process
6. Error handling and Continuation
Issue: Got AI parsing error while integrating APIs
I got an AI parsing error while APIs were being integrated. I asked famous AI to fix the error and instructed for further operations
Result : Fixed parsing error and added voice selector
As a result of my prompt famous.ai fixed the generate song button and added voice selector that will allow user to select voice of their choice
Issue : Nothing happens on generate song button click
I ran into another issue, I noticed when I filled in the information in the form and clicked on the generate song button. There is no response from the application. I asked the famous.ai to investigate and fix the issue
Result : Fixed no response issue
As a result of my previous response the famous.ai has fixed the no response issue while clicking on the generate song button. As you can see in the image attached below song is being generated successfully.
Issue: Playing and Downloading not working
I ran into another issue, after generation I was unable to either play the song or download it and to overcome this issue I asked famous.ai to fix it up
Result: Fixed Download and Playback
As a result of my prompt, famous.ai has fixed up the song playing and downloading issue.
7. Output and Playback
The final song, limited to under 1 minute, is available for playback and download in MP3 format.
β οΈ Error Handling
If synchronization fails, the app defaults to a spoken-word track over the background music to ensure a continuous user experience.
π± User Interface Overview
The app features a clean, mobile-optimized interface with the following components:
Text input field for lyrics.
βOption menus for genre and voice selection.
βButtons for "Generate Song," "Play," and "Download."
π οΈ Technical Stack
Frontend: Built using Famous.AI's no-code platform.
βMusic Generation: Fal.aiβs Cassette AI API.
βText-to-Speech: Eleven Labs API.
βAudio Processing: Integrated within the app for synchronization and output.
β
β Conclusion
Lyric Bot demonstrates the power of integrating AI services to create personalized musical experiences. With a user-friendly interface and seamless backend processes, users can effortlessly transform their words into songs.